title: A general-purpose machine learning Pt interatomic potential for an accurate description of bulk, surfaces and nanoparticles

abstract: A Gaussian approximation machine learning interatomic potential for platinum is presented. It has been trained on DFT data computed for bulk, surfaces and nanostructured platinum, in particular nanoparticles. Across the range of tested properties, which include bulk elasticity, surface energetics and nanoparticle stability, this potential shows excellent transferability and agreement with DFT, providing state-of-the-art accuracy at low computational cost. We showcase the possibilities for modeling of Pt systems enabled by this potential with two examples: the pressure-temperature phase diagram of Pt calculated using nested sampling and a study of the spontaneous crystallization of a large Pt nanoparticle based on classical dynamics simulations over several nanoseconds.


title: Hardware Implementation of Task-based Quantization in Multi-user Signal Recovery

abstract: Quantization plays a critical role in digital signal processing systems, allowing the representation of continuous amplitude signals with a finite number of bits. However, accurately representing signals requires a large number of quantization bits, which causes severe cost, power consumption, and memory burden. A promising way to address this issue is task-based quantization. By exploiting the task information for the overall system design, task-based quantization can achieve satisfying performance with low quantization costs. In this work, we apply task-based quantization to multi-user signal recovery and present a hardware prototype implementation. The prototype consists of a tailored configurable combining board, and a software-based processing and demonstration system. Through experiments, we verify that with proper design, the task-based quantization achieves a reduction of 25 fold in memory by reducing from 16 receivers with 16 bits each to 2 receivers with 5 bits each, without compromising signal recovery performance.


title: The guide to the guiding center aka pseudo-momentum operator construction

abstract: The strictly gauge invariant approach to the construction of the analog of guiding center integrals of motion in spatially homogeneous/inhomogeneous constant magnetic fields is considered. With their help the gauge invariant equations, describing the wave functions of highly degenerate Landau levels in the classical non-relativistic case, are formulated. The proposed gauge-invariant approach was used also for the construction of the equations describing the quasi-relativistic carriers behavior in the homogeneous/inhomogeneous magnetic field in the single layer graphene.


title: A Numerical Method for a Nonlocal Form of Richards' Equation Based on Peridynamic Theory

abstract: Forecasting water content dynamics in heterogeneous porous media has significant interest in hydrological applications; in particular, the treatment of infiltration when in presence of cracks and fractures can be accomplished resorting to peridynamic theory, which allows a proper modeling of non localities in space. In this framework, we make use of Chebyshev transform on the diffusive component of the equation and then we integrate forward in time using an explicit method. We prove that the proposed spectral numerical scheme provides a solution converging to the unique solution in some appropriate Sobolev space. We finally exemplify on several different soils, also considering a sink term representing the root water uptake.


title: Primes, knots and periodic orbits

abstract: This is a text written for the Ennio De Giorgi Colloquio volume. It covers analogies between algebraic number theory and knot theory, analogies between analytic number theory and certain dynamical systems, and a report on our construction of dynamical systems for arithmetic schemes which realize some of these analogies.


title: Realization of valley-spin polarized current via parametric pump in monolayer $\rm MoS_2$

abstract: Monolayer $MoS_2$ is a typical valleytronic material with valley-spin locked valence bands. We numerically investigate the valley-spin polarized current in monolayer $\rm MoS_2$ via adiabatic electron pumping. By introducing an exchange field to break the energy degeneracy of monolayer $MoS_2$, the top of its valence bands is valley-spin polarized and tunable by the exchange field. A device with spin-up polarized left lead, spin-down polarized right lead, and untuned central region is constructed through applying different exchange fields in the corresponding regions. Then, equal amount of pumped currents with opposite valley-spin polarization are simultaneously generated in the left and right leads when periodically varying two pumping potentials. Numerical results show that the phase difference between the pumping potentials can change the direction and hence polarization of the pumped currents. It is found that the pumped current exhibits resonant behavior in the valley-spin locked energy window, which depends strongly on the system size and is enhanced to resonant current peaks at certain system lengths. More importantly, the pumped current periodically oscillates as a function of the system length, which is closely related to the oscillation of transmission. The effects of other system parameters, such as the pumping amplitude and the static potential, are also thoroughly discussed.


title: Tailored plasmons in pentacene/graphene heterostructures with interlayer electron transfer

abstract: Van der Waals (vdW) heterostructures, which are produced by the precise assemblies of varieties of two-dimensional (2D) materials, have demonstrated many novel properties and functionalities. Here we report a nano-plasmonic study of vdW heterostructures that were produced by depositing ordered molecular layers of pentacene on top of graphene. We find through nano-infrared (IR) imaging that surface plasmons formed due to the collective oscillations of Dirac fermions in graphene are highly sensitive to the adjacent pentacene layers. In particular, the plasmon wavelength declines systematically but nonlinearly with increasing pentacene thickness. Further analysis and density functional theory (DFT) calculations indicate that the observed peculiar thickness dependence is mainly due to the tunneling-type electron transfer from pentacene to graphene. Our work unveils a new method for tailoring graphene plasmons and deepens our understanding of the intriguing nano-optical phenomena due to interlayer couplings in novel vdW heterostructures.


title: Real-space imaging of the tailored plasmons in twisted bilayer graphene

abstract: We report a systematic plasmonic study of twisted bilayer graphene (TBLG) - two graphene layers stacked with a twist angle. Through real-space nanoimaging of TBLG single crystals with a wide distribution of twist angles, we find that TBLG supports confined infrared plasmons that are sensitively dependent on the twist angle. At small twist angles, TBLG has a plasmon wavelength comparable to that of single-layer graphene. At larger twist angles, the plasmon wavelength of TBLG increases significantly with apparently lower damping. Further analysis and modeling indicate that the observed twist-angle dependence of TBLG plasmons in the Dirac linear regime is mainly due to the Fermi-velocity renormalization, a direct consequence of interlayer electronic coupling. Our work unveils the tailored plasmonic characteristics of TBLG and deepens our understanding of the intriguing nano-optical physics in novel van der Waals coupled two-dimensional materials.


title: Learning the Dynamics of Sparsely Observed Interacting Systems

abstract: We address the problem of learning the dynamics of an unknown non-parametric system linking a target and a feature time series. The feature time series is measured on a sparse and irregular grid, while we have access to only a few points of the target time series. Once learned, we can use these dynamics to predict values of the target from the previous values of the feature time series. We frame this task as learning the solution map of a controlled differential equation (CDE). By leveraging the rich theory of signatures, we are able to cast this non-linear problem as a high-dimensional linear regression. We provide an oracle bound on the prediction error which exhibits explicit dependencies on the individual-specific sampling schemes. Our theoretical results are illustrated by simulations which show that our method outperforms existing algorithms for recovering the full time series while being computationally cheap. We conclude by demonstrating its potential on real-world epidemiological data.


title: Top-down and bottom-up approaches to video Quality of Experience studies; overview and proposal of a new model

abstract: Modern video streaming services require quality assurance of the presented audiovisual material. Quality assurance mechanisms allow streaming platforms to provide quality levels that are considered sufficient to yield user satisfaction, with the least possible amount of data transferred. A variety of measures and approaches have been developed to control video quality, e.g., by adapting it to network conditions. These include objective matrices of the quality and thresholds identified by means of subjective perceptual judgments. The former group of matrices has recently gained the attention of (multi)media researchers. They call this area of study ``Quality of Experience'' (QoE). In this paper, we present a review of QoE's theoretical models together with a discussion of their properties and implications for the field. We argue that most of them represent the bottom-up approach to modeling. Such models focus on describing as many variables as possible, but with a limited ability to investigate the causal relationship between them; therefore, the applicability of the findings in practice is limited. To advance the field, we therefore propose a structural, top-down model of video QoE that describes causal relationships among variables. We hope that our framework will facilitate designing comparable experiments in the domain.


title: Frequency Energy Multiplier Approach to Uniform Exponential Stability Analysis of Semi-discrete Scheme for a Schrodinger Equation under Boundary Feedback

abstract: In this paper, we investigate the uniform exponential stability of a semi-discrete scheme for a Schr\"{o}dinger equation under boundary feedback stabilizing control in the natural state space $L^2(0,1)$. This study is significant since a time domain energy multiplier that allows proving the exponential stability of this continuous Schr\"{o}dinger system has not yet found, thus leading to a major mathematical challenge to semi-discretization of the PDE, an open problem for a long time. Although the powerful frequency domain energy multiplier approach has been used in proving exponential stability for PDEs since 1980s, its use to the \emph{uniform} exponential stability of the semi-discrete scheme for PDEs has not been reported yet. The difficulty associated with the uniformity is that due to the parameter of the step size, it involves a family of operators in different state spaces that need to be considered simultaneously. Based on the Huang-Pr\"{u}ss frequency domain criterion for uniform exponential stability of a family of $C_0$-semigroups in Hilbert spaces, we solve this problem for the first time by proving the uniform boundedness for all the resolvents of these operators on the imaginary axis. The proof almost exactly follows the procedure for the exponential stability of the continuous counterpart, highlighting the advantage of this discretization method.


title: Fast Region of Interest Proposals on Maritime UAVs

abstract: Unmanned aerial vehicles assist in maritime search and rescue missions by flying over large search areas to autonomously search for objects or people. Reliably detecting objects of interest requires fast models to employ on embedded hardware. Moreover, with increasing distance to the ground station only part of the video data can be transmitted. In this work, we consider the problem of finding meaningful region of interest proposals in a video stream on an embedded GPU. Current object or anomaly detectors are not suitable due to their slow speed, especially on limited hardware and for large image resolutions. Lastly, objects of interest, such as pieces of wreckage, are often not known a priori. Therefore, we propose an end-to-end future frame prediction model running in real-time on embedded GPUs to generate region proposals. We analyze its performance on large-scale maritime data sets and demonstrate its benefits over traditional and modern methods.


title: On particle dynamics near the singularity inside the Schwarzschild black hole and T-spheres

abstract: The problem of the speed of the objects inside the Schwarzschild black hole is considered. The general result is that the value of the relative speed of the objects following their non-zero angular momentum trajectories, both of geodesic and non-geodesic character, when approaching the ultimate singularity, tends to the value of speed of light. There is only one exception when both objects move in the same plane and have parallel angular momenta. This outcome appears to have a deeper sense: it reflects the anisotropic character of the dynamics of interior of this particular black hole. The result in question means that near the singularity, collisions of two particles lead to an indefinitely large energy in the center of mass frame. Aforementioned properties have their counterpart in the phenomenon of an indefinitely large blueshift near the singularity. Thus the angular momentum of a particle turns out to be an important feature that affects the final behavior of particle near the singularity. Motivated by this fact, we generalize the Lema\^{\i}tre frame under the horizon in such a way that reference particles themselves have nonzero angular momentum. Our results apply not only to the Schwarzschild singularity but also to other space-like ones for which the scale factor $g\rightarrow \infty $. We also analyze another type of singulairites for which the circumference radius vanishes but $g$ remains finite.


title: Two-dimensional superconductors with intrinsic p-wave pairing or nontrivial band topology

abstract: Over the past fifteen years, tremendous efforts have been devoted to realizing topological superconductivity in realistic materials and systems, predominately propelled by their promising application potentials in fault-tolerant quantum information processing. In this article, we attempt to give an overview on some of the main developments in this field, focusing in particular on two-dimensional crystalline superconductors that possess either intrinsic p-wave pairing or nontrivial band topology. We first classify the three different conceptual schemes to achieve topological superconductor (TSC), enabled by real-space superconducting proximity effect, reciprocal-space superconducting proximity effect, and intrinsic TSC. Whereas the first scheme has so far been most extensively explored, the subtle difference between the other two remains to be fully substantiated. We then move on to candidate intrinsic or p-wave superconductors, including Sr2RuO4, UTe2, Pb3Bi, and graphene-based systems. For TSC systems that rely on proximity effects, the emphases are mainly on the coexistence of superconductivity and nontrivial band topology, as exemplified by transition metal dichalcogenides, cobalt pnictides, and stanene, all in monolayer or few-layer regime. The review completes with discussions on the three dominant tuning schemes of strain, gating, and ferroelectricity in acquiring one or both essential ingredients of the TSC, and optimizations of such tuning capabilities may prove to be decisive in our drive towards braiding of Majorana zero modes and demonstration of topological qubits.


title: Exact hierarchical reductions of dynamical models via linear transformations

abstract: Dynamical models described by ordinary differential equations (ODEs) are a fundamental tool in the sciences and engineering. Exact reduction aims at producing a lower-dimensional model in which each macro-variable can be directly related to the original variables, and it is thus a natural step towards the model's formal analysis and mechanistic understanding. We present an algorithm which, given a polynomial ODE model, computes a longest possible chain of exact linear reductions of the model such that each reduction refines the previous one, thus giving a user control of the level of detail preserved by the reduction. This significantly generalizes over the existing approaches which compute only the reduction of the lowest dimension subject to an approach-specific constraint. The algorithm reduces finding exact linear reductions to a question about representations of finite-dimensional algebras. We provide an implementation of the algorithm, demonstrate its performance on a set of benchmarks, and illustrate the applicability via case studies. Our implementation is freely available at https://github.com/x3042/ExactODEReduction.jl


title: Particle identification with the Belle II calorimeter using machine learning

abstract: I present an application of a convolutional neural network (CNN) to separate muons and pions in the Belle II electromagnetic calorimeter (ECL). The ECL is designed to measure the energy deposited by charged and neutral particles. It also provides important contributions to the particle identification (PID) system. Identification of low-momenta muons and pions in the ECL is crucial if they do not reach the outer muon detector. Track-seeded cluster energy images provide the maximal possible information. The shape of the energy depositions for muons and pions in the crystals around an extrapolated track at the entering point of the ECL is used together with crystal positions in $\theta-\phi$ plane and transverse momentum of the track to train a CNN. The CNN exploits the difference between the dispersed energy depositions from pion hadronic interactions and the more localized muon electromagnetic interactions. Using simulation, the performance of the CNN algorithm is compared with other PID methods at Belle II which are based on track-matched clustering information. The results show that the CNN PID method improves muon-pion separation in low momentum.


title: Nitrogen in Silicon for Room Temperature Single Electron Tunneling Devices

abstract: Single electron transistor (SET) is an advanced tool to exploit in quantum devices. Working of such devices at room-temperature is essential for practical utilization. Dopant based single-electron devices are well studied at low-temperature although a few devices are developed for high-temperature operation with certain limitations. Here, we propose and theoretically exhibit that nitrogen (N) donor in silicon is an important candidate for effective designing of such devices. Theoretical calculation of density-of-states using semi-empirical DFT method indicates that N-donor in silicon has deep ground state compared to a phosphorus (P) donor. N-donor spectrum is explored in nano-silicon along with the P-donor. Comparative data of Bohr radius of N-donor and P-donor is also reported. The simulated current-voltage characteristics confirm that N-doped device is better suited for SET operation at room-temperature.


title: Laplacian regularized eikonal equation with Soner boundary condition on polyhedral meshes

abstract: In this paper, we propose a numerical algorithm based on a cell-centered finite volume method to compute a distance from given objects on a three-dimensional computational domain discretized by polyhedral cells. Inspired by the vanishing viscosity method, a Laplacian regularized eikonal equation is solved and the Soner boundary condition is applied to the boundary of the domain to avoid a non-viscosity solution. As the regularization parameter depending on a characteristic length of the discretized domain is reduced, a corresponding numerical solution is calculated. A convergence to the viscosity solution is verified numerically as the characteristic length becomes smaller and the regularization parameter accordingly becomes smaller. From the numerical experiments, the second experimental order of convergence in the $L^1$ norm error is confirmed for smooth solutions. Compared to solve a time-dependent form of eikonal equation, the Laplacian regularized eikonal equation has the advantage of reducing computational cost dramatically when a more significant number of cells is used or a region of interest is far away from the given objects. Moreover, the implementation of parallel computing using domain decomposition with $1$-ring face neighborhood structure can be done straightforwardly by a standard cell-centered finite volume code.


title: Multilayer hypergraph clustering using the aggregate similarity matrix

abstract: We consider the community recovery problem on a multilayer variant of the hypergraph stochastic block model (HSBM). Each layer is associated with an independent realization of a d-uniform HSBM on N vertices. Given the similarity matrix containing the aggregated number of hyperedges incident to each pair of vertices, the goal is to obtain a partition of the N vertices into disjoint communities. In this work, we investigate a semidefinite programming (SDP) approach and obtain information-theoretic conditions on the model parameters that guarantee exact recovery both in the assortative and the disassortative cases.

categories: math.ST cs.IT math.IT math.PR stat.ML stat.TH


title: Semi-Supervised Machine Learning: a Homological Approach

abstract: In this paper we describe the mathematical foundations of a new approach to semi-supervised Machine Learning. Using techniques of Symbolic Computation and Computer Algebra, we apply the concept of persistent homology to obtain a new semi-supervised learning method.


title: Matching Linear Algebra and Tensor Code to Specialized Hardware Accelerators

abstract: Dedicated tensor accelerators demonstrate the importance of linear algebra in modern applications. Such accelerators have the potential for impressive performance gains, but require programmers to rewrite code using vendor APIs - a barrier to wider scale adoption. Recent work overcomes this by matching and replacing patterns within code, but such approaches are fragile and fail to cope with the diversity of real-world codes. We develop ATC, a compiler that uses program synthesis to map regions of code to specific APIs. The mapping space that ATC explores is combinatorially large, requiring the development of program classification, dynamic analysis, variable constraint generation and lexical distance matching techniques to make it tractable. We apply ATC to real-world tensor and linear algebra codes and evaluate them against four state-of-the-art approaches. We accelerate between 2.6x and 7x more programs, leading to over an order of magnitude performance improvement.


title: Probing Out-of-Distribution Robustness of Language Models with Parameter-Efficient Transfer Learning

abstract: As the size of the pre-trained language model (PLM) continues to increase, numerous parameter-efficient transfer learning methods have been proposed recently to compensate for the tremendous cost of fine-tuning. Despite the impressive results achieved by large pre-trained language models (PLMs) and various parameter-efficient transfer learning (PETL) methods on sundry benchmarks, it remains unclear if they can handle inputs that have been distributionally shifted effectively. In this study, we systematically explore how the ability to detect out-of-distribution (OOD) changes as the size of the PLM grows or the transfer methods are altered. Specifically, we evaluated various PETL techniques, including fine-tuning, Adapter, LoRA, and prefix-tuning, on three different intention classification tasks, each utilizing various language models with different scales.


title: A Denoising Diffusion Model for Fluid Field Prediction

abstract: We propose a novel denoising diffusion generative model for predicting nonlinear fluid fields named FluidDiff. By performing a diffusion process, the model is able to learn a complex representation of the high-dimensional dynamic system, and then Langevin sampling is used to generate predictions for the flow state under specified initial conditions. The model is trained with finite, discrete fluid simulation data. We demonstrate that our model has the capacity to model the distribution of simulated training data and that it gives accurate predictions on the test data. Without encoded prior knowledge of the underlying physical system, it shares competitive performance with other deep learning models for fluid prediction, which is promising for investigation on new computational fluid dynamics methods.


title: Insights into the need for ab-initio calculations to accurately predict the optical properties of metallic carbon nanotubes based on experimental confrontation

abstract: In this article, we conduct comparative studies on the optical properties of metallic carbon nanotubes. Firstly, we compare the complex dielectric constant predicted by an analytical model, the Linear Surface Conductivity Model, with \textit{ab initio} calculations based on Density Functional Theory. We highlight the similarities and differences between these two models, with the major discrepancy being a significantly different behavior of the plasma frequency with respect to the carbon nanotube diameter. In the second step, we compare the predictions of these models with experimental measurements of the dielectric function. We demonstrate that the screened plasma frequency serves as a reliable quantifier for distinguishing between the two models. In conclusion, we find that the \textit{ab initio} calculations more accurately describe the optical properties of metallic carbon nanotubes compared to the commonly used Linear Surface Conductivity Model.


title: Deep Residual Compensation Convolutional Network without Backpropagation

abstract: PCANet and its variants provided good accuracy results for classification tasks. However, despite the importance of network depth in achieving good classification accuracy, these networks were trained with a maximum of nine layers. In this paper, we introduce a residual compensation convolutional network, which is the first PCANet-like network trained with hundreds of layers while improving classification accuracy. The design of the proposed network consists of several convolutional layers, each followed by post-processing steps and a classifier. To correct the classification errors and significantly increase the network's depth, we train each layer with new labels derived from the residual information of all its preceding layers. This learning mechanism is accomplished by traversing the network's layers in a single forward pass without backpropagation or gradient computations. Our experiments on four distinct classification benchmarks (MNIST, CIFAR-10, CIFAR-100, and TinyImageNet) show that our deep network outperforms all existing PCANet-like networks and is competitive with several traditional gradient-based models.


title: Automatic Alignment in Higher-Order Probabilistic Programming Languages

abstract: Probabilistic Programming Languages (PPLs) allow users to encode statistical inference problems and automatically apply an inference algorithm to solve them. Popular inference algorithms for PPLs, such as sequential Monte Carlo (SMC) and Markov chain Monte Carlo (MCMC), are built around checkpoints -- relevant events for the inference algorithm during the execution of a probabilistic program. Deciding the location of checkpoints is, in current PPLs, not done optimally. To solve this problem, we present a static analysis technique that automatically determines checkpoints in programs, relieving PPL users of this task. The analysis identifies a set of checkpoints that execute in the same order in every program run -- they are aligned. We formalize alignment, prove the correctness of the analysis, and implement the analysis as part of the higher-order functional PPL Miking CorePPL. By utilizing the alignment analysis, we design two novel inference algorithm variants: aligned SMC and aligned lightweight MCMC. We show, through real-world experiments, that they significantly improve inference execution time and accuracy compared to standard PPL versions of SMC and MCMC.


title: Causal structure and the geodesics in the hairy extension of the Bertotti-Robinson spacetime

abstract: A hairy extension of the Bertotti-Robinson regular spacetime has been recently introduced in the context of the Einstein-Maxwell-Scaler theory that surprisingly is a singular black hole formed in the $S_{3}$ background spatial topology [CQG39(2022)167001]. In this research, we first clarify the topology of the spacetime based on the coordinate transformations as well as the energy-momentum configuration and the causal structure of the black hole. Furthermore, we investigate the geodesics of the null and timelike particles in this spacetime. It is shown that in the radial motion on the equatorial plane, while photons may collapse to the singularity or escape to the edge of the universe, a massive particle always collapses to the singularity. The general geodesics of null and massive particles reveal that all particles except the outgoing light ray, eventually fall into the black hole.


title: Thermal curvature perturbations in thermal inflation

abstract: We compute the power spectrum of super-horizon curvature perturbations generated during a late period of thermal inflation, taking into account fluctuation-dissipation effects resulting from the scalar flaton field's interactions with the ambient radiation bath. We find that, at the onset of thermal inflation, the flaton field may reach an equilibrium with the radiation bath even for relatively small coupling constants, maintaining a spectrum of thermal fluctuations until the critical temperature $T_c$, below which thermal effects stop holding the field at the false potential minimum. This enhances the field variance compared to purely quantum fluctuations, therefore increasing the average energy density during thermal inflation and damping the induced curvature perturbations. In particular, we find that this inhibits the later formation of primordial black holes, at least on scales that leave the horizon for $T>T_c$. The larger thermal field variance also reduces the duration of a period of fast-roll inflation below $T_c$, as the field rolls to the true potential minimum, which should also affect the generation of (large) curvature perturbations on even smaller scales.


title: Active Spaghetti: Collective Organization in Cyanobacteria

abstract: Filamentous cyanobacteria can show fascinating examples of nonequilibrium self-organization, which however are not well-understood from a physical perspective. We investigate the motility and collective organization of colonies of these simple multicellular lifeforms. As their area density increases, linear chains of cells gliding on a substrate show a transition from an isotropic distribution to bundles of filaments arranged in a reticulate pattern. Based on our experimental observations of individual behavior and pairwise interactions, we introduce a nonreciprocal model accounting for the filaments' large aspect ratio, fluctuations in curvature, motility, and nematic interactions. This minimal model of active filaments recapitulates the observations, and rationalizes the appearance of a characteristic lengthscale in the system, based on the Peclet number of the cyanobacteria filaments.


title: Time-of-flight spectroscopy of ultracold neutrons at the PSI UCN source

abstract: The ultracold neutron (UCN) source at the Paul Scherrer Institute (PSI) provides high intensities of storable neutrons for fundamental physics experiments. The neutron velocity spectrum parallel to the beamline axis was determined by time-of-flight spectroscopy using a neutron chopper. In particular, the temporal evolution of the spectrum during neutron production and UCN storage in the source storage volume was investigated and compared to Monte Carlo simulation results. A softening of the measured spectrum from a mean velocity of 7.7(1) m s$^{-1}$ to 5.1(1) m s$^{-1}$ occurred within the first 30 s after the proton beam pulse had impinged on the spallation target. A spectral hardening was observed over longer time scales of one measurement day, consistent with the effect of surface degradation of the solid deuterium moderator.


title: Predator Extinction arose from Chaos of the Prey: the Chaotic Behavior of a Homomorphic Two-Dimensional Logistic Map in the Form of Lotka-Volterra Equations

abstract: A two-dimensional homomorphic logistic map that preserves features of the Lotka-Volterra equations was proposed. To examine chaos, iteration plots of the population, Lyapunov exponents calculated from Jacobian eigenvalues of the $2$D logistic mapping, and from time series algorithms of Rosenstein and Eckmann et al. were calculated. Bifurcation diagrams may be divided into four categories depending on topological shapes. Our model not only recovered the $1$D logistic map, which exhibits flip bifurcation, for the prey when there is a nonzero initial predator population, but it can also simulate normal competition between two species with equal initial populations. Despite the possibility for two species to go into chaos simultaneously, where the Neimark-Sacker bifurcation was observed, it is also possible that with the same interspecies parameters as normal but with a predator population $10$ times more than that of the prey, the latter becomes chaotic, while the former dramatically reduces to zero with only a few iterations, indicating total annihilation of the predator species. Interpreting humans as predators and natural resources as preys in the ecological system, the above-mentioned conclusion may imply that not only excessive consumption of natural resources, but its chaotic state triggered by an overpopulation of humans may backfire in a manner of total extinction of the human species. Fortunately, there is little chance for the survival of the human race, as isolated fixed points in the bifurcation diagram of the predator reveal. Finally, two possible applications of the phenomenon of chaotic extinction are proposed: one is to inhibit viruses or pests by initiating the chaotic states of the prey on which the viruses or pests rely for existence, and the other is to achieve the superconducting state with the chaotic state of the applied magnetic field.


title: Study of ttbb and ttW background modelling for ttH analyses

abstract: This note presents Monte Carlo generator comparisons of the ttbb and ttW processes at particle level. The aim is to compare the modelling of important backgrounds to ttH measurements in multi-lepton final states and in the ttH(H->bb) decay channel and the treatment of the associated theory uncertainties for a combination of the full Run-2 ttH results from ATLAS and CMS. As a first step, modelling and theory uncertainties as used in ATLAS an CMS are compared in the relevant analysis regions. Significant differences in the treatment of systematic uncertainties between the experiments have been observed in ttbb and ttW. As a first step, ATLAS and CMS agreed on a common reference value of the inclusive ttW cross section to allow direct comparisons between experiments.


title: PAC structures as invariants of finite group actions

abstract: We study model theory of actions of finite groups on substructures of a stable structure. We give an abstract description of existentially closed actions as above in terms of invariants and PAC structures. We show that if the corresponding PAC property is first order, then the theory of such actions has a model companion. Then, we analyze some particular theories of interest (mostly various theories of fields of positive characteristic) and show that in all the cases considered the PAC property is first order.


title: Excitons and trions with negative effective masses in two-dimensional semiconductors

abstract: We study theoretically fundamental Coulomb-correlated complexes: neutral and charged excitons, also known as trions, in transition metal dichalogenides monolayers. We focus on the situation where one of the electrons occupies excited, high-lying, conduction band characterized by a negative effective mass. We develop the theory of such high-lying excitons and trions with negative effective mass and demonstrate the key role of the non-parabolicity of the high-lying conduction band dispersion in formation of the bound exciton and trion states. We present simple, accurate and physically justified trial wavefunctions for calculating the binding energies of Coulomb-bound complexes and compare the results of variational calculations with those of a fully numerical approach. Within the developed model we discuss recent experimental results on observation of high-lying negative effective mass trions [K.-Q. Lin et al., Nat. Commun. 13, 6980 (2022)].


title: Bayesian Self-Supervised Contrastive Learning

abstract: Recent years have witnessed many successful applications of contrastive learning in diverse domains, yet its self-supervised version still remains many exciting challenges. As the negative samples are drawn from unlabeled datasets, a randomly selected sample may be actually a false negative to an anchor, leading to incorrect encoder training. This paper proposes a new self-supervised contrastive loss called the BCL loss that still uses random samples from the unlabeled data while correcting the resulting bias with importance weights. The key idea is to design the desired sampling distribution for sampling hard true negative samples under the Bayesian framework. The prominent advantage lies in that the desired sampling distribution is a parametric structure, with a location parameter for debiasing false negative and concentration parameter for mining hard negative, respectively. Experiments validate the effectiveness and superiority of the BCL loss.


title: Optimally-Weighted Estimators of the Maximum Mean Discrepancy for Likelihood-Free Inference

abstract: Likelihood-free inference methods typically make use of a distance between simulated and real data. A common example is the maximum mean discrepancy (MMD), which has previously been used for approximate Bayesian computation, minimum distance estimation, generalised Bayesian inference, and within the nonparametric learning framework. The MMD is commonly estimated at a root-$m$ rate, where $m$ is the number of simulated samples. This can lead to significant computational challenges since a large $m$ is required to obtain an accurate estimate, which is crucial for parameter estimation. In this paper, we propose a novel estimator for the MMD with significantly improved sample complexity. The estimator is particularly well suited for computationally expensive smooth simulators with low- to mid-dimensional inputs. This claim is supported through both theoretical results and an extensive simulation study on benchmark simulators.


title: fnets: An R Package for Network Estimation and Forecasting via Factor-Adjusted VAR Modelling

abstract: The package fnets for the R language implements the suite of methodologies proposed by Barigozzi et al. (2022) for the network estimation and forecasting of high-dimensional time series under a factor-adjusted vector autoregressive model, which permits strong spatial and temporal correlations in the data. Additionally, we provide tools for visualising the networks underlying the time series data after adjusting for the presence of factors. The package also offers data-driven methods for selecting tuning parameters including the number of factors, vector autoregressive order and thresholds for estimating the edge sets of the networks of interest in time series analysis. We demonstrate various features of fnets on simulated datasets as well as real data on electricity prices.


title: High-frequency complex impedance analysis of the two-dimensional semiconducting MXene-$Ti_2CO_2$

abstract: The two-dimensional compound group of MXenes, which exhibit unique optical, electrical, chemical, and mechanical properties, are an exceptional class of transition metal carbides and nitrides. In addition to traditional applications in Li-S, Li-ion batteries, conductive electrodes, hydrogen storage, and fuel cells, the low lattice thermal conductivity coupled with high electron mobility in the semiconducting oxygen-functionalized MXene-$Ti_2CO_2$ has led to the recent interests in high-performance thermoelectric and nanoelectronic devices. Apart from the above dc-transport applications, it is crucial to also understand ac-transport across them, given the growing interest in applications surrounding wireless communications and transparent conductors. In this work, we investigate using our recently developed $ab~initio$ transport model, the real and imaginary components of electron mobility and conductivity to conclusively depict carrier transport beyond the room temperature for frequency ranges upto the terahertz range. We also contrast the carrier mobility and conductivity with respect to the Drude's model to depict its inaccuracies for a meaningful comparison with experiments. Our calculations show the effect of acoustic deformation potential scattering, piezoelectric scattering, and polar optical phonon scattering mechanisms. Without relying on experimental data, our model requires inputs calculated from first principles using density functional theory. Our results set the stage for providing ab-initio based ac-transport calculations given the current research on MXenes for high frequency applications.


title: Strong unique continuation from the boundary for the spectral fractional Laplacian

abstract: We investigate unique continuation properties and asymptotic behaviour at boundary points for solutions to a class of elliptic equations involving the spectral fractional Laplacian. An extension procedure leads us to study a degenerate or singular equation on a cylinder, with a homogeneous Dirichlet boundary condition on the lateral surface and a non homogeneous Neumann condition on the basis. For the extended problem, by an Almgren-type monotonicity formula and a blow-up analysis, we classify the local asymptotic profiles at the edge where the transition between boundary conditions occurs. Passing to traces, an analogous blow-up result and its consequent strong unique continuation property is deduced for the nonlocal fractional equation.


title: Approximating Higher-Order Derivative Tensors Using Secant Updates

abstract: Quasi-Newton methods employ an update rule that gradually improves the Hessian approximation using the already available gradient evaluations. We propose higher-order secant updates which generalize this idea to higher-order derivatives, approximating for example third derivatives (which are tensors) from given Hessian evaluations. Our generalization is based on the observation that quasi-Newton updates are least-change updates satisfying the secant equation, with different methods using different norms to measure the size of the change. We present a full characterization for least-change updates in weighted Frobenius norms (satisfying an analogue of the secant equation) for derivatives of arbitrary order. Moreover, we establish convergence of the approximations to the true derivative under standard assumptions and explore the quality of the generated approximations in numerical experiments.


title: On dilation analyticity and spatial exponential decay of atomic ground states in non-relativistic qed

abstract: We consider the ground state and the ground state energy of an atom with spinless electrons in the framework of non-relativistic qed. We show that the ground state energy as well as the ground state depend analytically on the parameters of the group of dilations, the parameter of a group of spatial dependent phase changes, and on the minimal coupling constant. As a corollary we obtain spatial exponential decay of the ground state as well as of its dilation analytic extension. No infrared regularization is needed for the result. Our result is based on operator theoretic renormalization.


title: Codes for Correcting Asymmetric Adjacent Transpositions and Deletions

abstract: Codes in the Damerau--Levenshtein metric have been extensively studied recently owing to their applications in DNA-based data storage. In particular, Gabrys, Yaakobi, and Milenkovic (2017) designed a length-$n$ code correcting a single deletion and $s$ adjacent transpositions with at most $(1+2s)\log n$ bits of redundancy. In this work, we consider a new setting where both asymmetric adjacent transpositions (also known as right-shifts or left-shifts) and deletions may occur. We present several constructions of the codes correcting these errors in various cases. In particular, we design a code correcting a single deletion, $s^+$ right-shift, and $s^-$ left-shift errors with at most $(1+s)\log (n+s+1)+1$ bits of redundancy where $s=s^{+}+s^{-}$. In addition, we investigate codes correcting $t$ $0$-deletions, $s^+$ right-shift, and $s^-$ left-shift errors with both uniquely-decoding and list-decoding algorithms. Our main contribution here is the construction of a list-decodable code with list size $O(n^{\min\{s+1,t\}})$ and with at most $(\max \{t,s+1\}) \log n+O(1)$ bits of redundancy, where $s=s^{+}+s^{-}$. Finally, we construct both non-systematic and systematic codes for correcting blocks of $0$-deletions with $\ell$-limited-magnitude and $s$ adjacent transpositions.


title: Multi-scale and Multi-directional VLBI Imaging with CLEAN

abstract: Very long baseline interferometry (VLBI) is a radio-astronomical technique in which the correlated signal from various baselines is combined into an image of highest angular resolution. Due to sparsity of the measurements, this imaging procedure constitutes an ill-posed inverse problem. For decades the CLEAN algorithm was the standard choice in VLBI studies, although having some serious disadvantages and pathologies that are challenged by the requirements of modern frontline VLBI applications. We develop a novel multi-scale CLEAN deconvolution method (DoB-CLEAN) based on continuous wavelet transforms that address several pathologies in CLEAN imaging. We benchmark this novel algorithm against CLEAN reconstructions on synthetic data and reanalyze BL Lac observations of RadioAstron with DoB-CLEAN. DoB-CLEAN approaches the image by multi-scalar and multi-directional wavelet dictionaries. Two different dictionaries are used. Firstly, a difference of elliptical spherical Bessel functions dictionary fitted to the uv-coverage of the observation that is used to sparsely represent the features in the dirty image. Secondly, a difference of elliptical Gaussian wavelet dictionary that is well suited to represent relevant image features cleanly. The deconvolution is performed by switching between the dictionaries. DoB-CLEAN achieves super-resolution compared to CLEAN and remedies the spurious regularization properties of CLEAN. In contrast to CLEAN, the representation by basis functions has a physical meaning. Hence, the computed deconvolved image still fits the observed visibilities, opposed to CLEAN. State-of-the-art multi-scalar imaging approaches seem to outperform single-scalar standard approaches in VLBI and are well suited to maximize the extraction of information in ongoing frontline VLBI applications.


title: Towards Personalized Review Summarization by Modeling Historical Reviews from Customer and Product Separately

abstract: Review summarization is a non-trivial task that aims to summarize the main idea of the product review in the E-commerce website. Different from the document summary which only needs to focus on the main facts described in the document, review summarization should not only summarize the main aspects mentioned in the review but also reflect the personal style of the review author. Although existing review summarization methods have incorporated the historical reviews of both customer and product, they usually simply concatenate and indiscriminately model this two heterogeneous information into a long sequence. Moreover, the rating information can also provide a high-level abstraction of customer preference, it has not been used by the majority of methods. In this paper, we propose the Heterogeneous Historical Review aware Review Summarization Model (HHRRS) which separately models the two types of historical reviews with the rating information by a graph reasoning module with a contrastive loss. We employ a multi-task framework that conducts the review sentiment classification and summarization jointly. Extensive experiments on four benchmark datasets demonstrate the superiority of HHRRS on both tasks.


title: Neural Abstractions

abstract: We present a novel method for the safety verification of nonlinear dynamical models that uses neural networks to represent abstractions of their dynamics. Neural networks have extensively been used before as approximators; in this work, we make a step further and use them for the first time as abstractions. For a given dynamical model, our method synthesises a neural network that overapproximates its dynamics by ensuring an arbitrarily tight, formally certified bound on the approximation error. For this purpose, we employ a counterexample-guided inductive synthesis procedure. We show that this produces a neural ODE with non-deterministic disturbances that constitutes a formal abstraction of the concrete model under analysis. This guarantees a fundamental property: if the abstract model is safe, i.e., free from any initialised trajectory that reaches an undesirable state, then the concrete model is also safe. By using neural ODEs with ReLU activation functions as abstractions, we cast the safety verification problem for nonlinear dynamical models into that of hybrid automata with affine dynamics, which we verify using SpaceEx. We demonstrate that our approach performs comparably to the mature tool Flow* on existing benchmark nonlinear models. We additionally demonstrate and that it is effective on models that do not exhibit local Lipschitz continuity, which are out of reach to the existing technologies.


title: Generic unfolding of an antiholomorphic parabolic point of codimension $k$

abstract: We classify generic unfoldings of germs of antiholomorphic diffeomorphisms with a parabolic point of codimension~$k$ (i.e.~a fixed point of multiplicity $k+1$) under conjugacy. Such generic unfoldings depend real analytically on $k$ real parameters. A preparation of the unfolding allows to identify real analytic \emph{canonical parameters}, which are preserved by any conjugacy between two prepared generic unfoldings. A modulus of analytic classification is defined, which is an unfolding of the modulus assigned to the antiholomorphic parabolic point. Since the second iterate of such a germ is a real unfolding of a holomorphic parabolic point, the modulus is a special form of an unfolding of the \'Ecalle-Voronin modulus of the second iterate of the antiholomorphic parabolic germ. We also solve the problem of the existence of an antiholomorphic square root to a germ of generic analytic unfolding of a holomorphic parabolic germ.


title: Eigenvalue estimates for Fourier concentration operators on two domains

abstract: We study concentration operators associated with either the discrete or the continuous Fourier transform, that is, operators that incorporate a spatial cut-off and a subsequent frequency cut-off to the Fourier inversion formula. Their spectral profiles describe the number of prominent degrees of freedom in problems where functions are assumed to be supported on a certain domain and their Fourier transforms are known or measured on a second domain. We derive eigenvalue estimates that quantify the extent to which Fourier concentration operators deviate from orthogonal projectors, by bounding the number of eigenvalues that are away from 0 and 1 in terms of the geometry of the spatial and frequency domains, and a factor that grows at most poly-logarithmically on the inverse of the spectral margin. The estimates are non-asymptotic in the sense that they are applicable to concrete domains and spectral thresholds, and almost match asymptotic benchmarks. Our work covers for the first time non-convex and non-symmetric spatial and frequency concentration domains, as demanded by numerous applications that exploit the expected approximate low dimensionality of the modeled phenomena. The proofs build on Israel's work on one dimensional intervals [arXiv: 1502.04404v1]. The new ingredients are the use of redundant wave-packet expansions and a dyadic decomposition argument to obtain Schatten norm estimates for Hankel operators.


title: Generalized curvature tensor and the hypersurfaces of the Hermitian manifold for the class of Kenmotsu type

abstract: This paper determined the components of the generalized curvature tensor for the class of Kenmotsu type and established the mentioned class is {\eta}-Einstein manifold when the generalized curvature tensor is flat; the converse holds true under suitable conditions. It also introduced the notion of generalized {\Phi}-holomorphic sectional (G{\Phi}SH-) curvature tensor and thus found the necessary and sufficient conditions for the class of Kenmotsu type to be of constant G{\Phi}SH-curvature. In addition, the notion of {\Phi}-generalized semi-symmetric was introduced and its relationship with the class of Kenmotsu type and {\eta}-Einstein manifold established. Furthermore, this paper generalized the notion of the manifold of constant curvature and deduced its relationship with the aforementioned ideas. It finally showed that the class of Kenmotsu type exists as a hypersurface of the Hermitian manifold and derived a relation between the components of the Riemannian curvature tensors of the almost Hermitian manifold and its hypersurfaces.


title: Theoretical Analysis of Offline Imitation With Supplementary Dataset

abstract: Behavioral cloning (BC) can recover a good policy from abundant expert data, but may fail when expert data is insufficient. This paper considers a situation where, besides the small amount of expert data, a supplementary dataset is available, which can be collected cheaply from sub-optimal policies. Imitation learning with a supplementary dataset is an emergent practical framework, but its theoretical foundation remains under-developed. To advance understanding, we first investigate a direct extension of BC, called NBCU, that learns from the union of all available data. Our analysis shows that, although NBCU suffers an imitation gap that is larger than BC in the worst case, there exist special cases where NBCU performs better than or equally well as BC. This discovery implies that noisy data can also be helpful if utilized elaborately. Therefore, we further introduce a discriminator-based importance sampling technique to re-weight the supplementary data, proposing the WBCU method. With our newly developed landscape-based analysis, we prove that WBCU can outperform BC in mild conditions. Empirical studies show that WBCU simultaneously achieves the best performance on two challenging tasks where prior state-of-the-art methods fail.


title: Can We Use Probing to Better Understand Fine-tuning and Knowledge Distillation of the BERT NLU?

abstract: In this article, we use probing to investigate phenomena that occur during fine-tuning and knowledge distillation of a BERT-based natural language understanding (NLU) model. Our ultimate purpose was to use probing to better understand practical production problems and consequently to build better NLU models. We designed experiments to see how fine-tuning changes the linguistic capabilities of BERT, what the optimal size of the fine-tuning dataset is, and what amount of information is contained in a distilled NLU based on a tiny Transformer. The results of the experiments show that the probing paradigm in its current form is not well suited to answer such questions. Structural, Edge and Conditional probes do not take into account how easy it is to decode probed information. Consequently, we conclude that quantification of information decodability is critical for many practical applications of the probing paradigm.


title: A rule-free workflow for the automated generation of databases from scientific literature

abstract: In recent times, transformer networks have achieved state-of-the-art performance in a wide range of natural language processing tasks. Here we present a workflow based on the fine-tuning of BERT models for different downstream tasks, which results in the automated extraction of structured information from unstructured natural language in scientific literature. Contrary to existing methods for the automated extraction of structured compound-property relations from similar sources, our workflow does not rely on the definition of intricate grammar rules. Hence, it can be adapted to a new task without requiring extensive implementation efforts and knowledge. We test our data-extraction workflow by automatically generating a database for Curie temperatures and one for band gaps. These are then compared with manually-curated datasets and with those obtained with a state-of-the-art rule-based method. Furthermore, in order to showcase the practical utility of the automatically extracted data in a material-design workflow, we employ them to construct machine-learning models to predict Curie temperatures and band gaps. In general we find that, although more noisy, automatically extracted datasets can grow fast in volume and that such volume partially compensates for the inaccuracy in downstream tasks.


title: A statistical framework for planning and analysing test-retest studies for repeatability of quantitative biomarker measurements

abstract: There is an increasing number of potential biomarkers that could allow for early assessment of treatment response or disease progression. However, measurements of quantitative biomarkers are subject to random variability. Hence, differences of a biomarker in longitudinal measurements do not necessarily represent real change but might be caused by this random measurement variability. Before utilizing a quantitative biomarker in longitudinal studies, it is therefore essential to assess the measurement repeatability. Measurement repeatability obtained from test-retest studies can be quantified by the repeatability coefficient (RC), which is then used in the subsequent longitudinal study to determine if a measured difference represents real change or is within the range of expected random measurement variability. The quality of the point estimate of RC therefore directly governs the assessment quality of the longitudinal study. RC estimation accuracy depends on the case number in the test-retest study, but despite its pivotal role, no comprehensive framework for sample size calculation of test-retest studies exists. To address this issue, we have established such a framework, which allows for flexible sample size calculation of test-retest studies, based upon newly introduced criteria concerning assessment quality in the longitudinal study. This also permits retrospective assessment of prior test-retest studies.


title: Large-Scale Traffic Data Imputation with Spatiotemporal Semantic Understanding

abstract: Large-scale data missing is a challenging problem in Intelligent Transportation Systems (ITS). Many studies have been carried out to impute large-scale traffic data by considering their spatiotemporal correlations at a network level. In existing traffic data imputations, however, rich semantic information of a road network has been largely ignored when capturing network-wide spatiotemporal correlations. This study proposes a Graph Transformer for Traffic Data Imputation (GT-TDI) model to impute large-scale traffic data with spatiotemporal semantic understanding of a road network. Specifically, the proposed model introduces semantic descriptions consisting of network-wide spatial and temporal information of traffic data to help the GT-TDI model capture spatiotemporal correlations at a network level. The proposed model takes incomplete data, the social connectivity of sensors, and semantic descriptions as input to perform imputation tasks with the help of Graph Neural Networks (GNN) and Transformer. On the PeMS freeway dataset, extensive experiments are conducted to compare the proposed GT-TDI model with conventional methods, tensor factorization methods, and deep learning-based methods. The results show that the proposed GT-TDI outperforms existing methods in complex missing patterns and diverse missing rates. The code of the GT-TDI model will be available at https://github.com/KP-Zhang/GT-TDI.


title: Ergodic Mean Field Games: existence of local minimizers up to the Sobolev critical case

abstract: We investigate the existence of solutions to viscous ergodic Mean Field Games systems in bounded domains with Neumann boundary conditions and local, possibly aggregative couplings. In particular we exploit the associated variational structure and search for constrained minimizers of a suitable functional. Depending on the growth of the coupling, we detect the existence of global minimizers in the mass subcritical and critical case, and of local minimizers in the mass supercritical case, notably up to the Sobolev critical case.


title: Magnetospheric accretion at the late phases of the Pre-Main-Sequence evolution. The case of RZ Psc

abstract: It has been shown that during the outburst of accretion activity observed in UX Ori type star RZ Psc in 2013, the accretion rate increased approximately by an order of magnitude. This means that the accretion process at the late stages of the Pre-Main Sequence evolution is very unstable. Using the spectra obtained during this episode we have studied the magnetospheric emission in the H$\alpha$ line. Models of magnetospheric accretion are calculated to obtain the parameters of the magnetosphere from this observation. In present work we have taken into account the influence of the recombination delay effect during gas motion in the stellar magnetosphere. The accounting for this effect and the presence of the magnetospheric absorption in the IR CaII triplet lines and its absence in D Na I resonance lines allowed us to place a lower limit on the temperature in the magnetosphere at $\approx$ 10000 K, which significantly improved precision of our estimate of accretion rate. According to the best fit model the logarithm of accretion rate is $\log\dot{M} = -10.1\pm0.3$ ($\dot{M} \approx 7\times10^{-11}$ M$_\odot$yr$^{-1}$) and the inclination angle of RZ Psc is $43\pm 3^\circ$. It is less than the inclination, typical for the UX Ori stars (about 70$^\circ$), that explains the weak photometric variability of this star. Using the obtained accretion rate and magnetosphere radius we estimate the strength of the dipole component of the magnetic field of RZ Psc $\approx$ 0.1 kGs.


title: First natural connection on Riemannian $\Pi$-manifolds

abstract: A natural connection with torsion is defined and it is called the first natural connection on Riemannian $\Pi$-manifold. Relations between the introduced connection and the Levi-Civita connection are obtained, as well as relations between their respective curvature tensors, torsion tensors, Ricci tensors, and scalar curvatures in the main classes of a classification of Riemannian $\Pi$-manifolds are presented. An explicit example of dimension 5 is provided.


title: LegendreTron: Uprising Proper Multiclass Loss Learning

abstract: Loss functions serve as the foundation of supervised learning and are often chosen prior to model development. To avoid potentially ad hoc choices of losses, statistical decision theory describes a desirable property for losses known as \emph{properness}, which asserts that Bayes' rule is optimal. Recent works have sought to \emph{learn losses} and models jointly. Existing methods do this by fitting an inverse canonical link function which monotonically maps $\mathbb{R}$ to $[0,1]$ to estimate probabilities for binary problems. In this paper, we extend monotonicity to maps between $\mathbb{R}^{C-1}$ and the projected probability simplex $\tilde{\Delta}^{C-1}$ by using monotonicity of gradients of convex functions. We present {\sc LegendreTron} as a novel and practical method that jointly learns \emph{proper canonical losses} and probabilities for multiclass problems. Tested on a benchmark of domains with up to 1,000 classes, our experimental results show that our method consistently outperforms the natural multiclass baseline under a $t$-test at 99% significance on all datasets with greater than 10 classes.


title: SLCNN: Sentence-Level Convolutional Neural Network for Text Classification

abstract: Text classification is a fundamental task in natural language processing (NLP). Several recent studies show the success of deep learning on text processing. Convolutional neural network (CNN), as a popular deep learning model, has shown remarkable success in the task of text classification. In this paper, new baseline models have been studied for text classification using CNN. In these models, documents are fed to the network as a three-dimensional tensor representation to provide sentence-level analysis. Applying such a method enables the models to take advantage of the positional information of the sentences in the text. Besides, analysing adjacent sentences allows extracting additional features. The proposed models have been compared with the state-of-the-art models using several datasets. The results have shown that the proposed models have better performance, particularly in the longer documents.


title: Big portfolio selection by graph-based conditional moments method

abstract: How to do big portfolio selection is very important but challenging for both researchers and practitioners. In this paper, we propose a new graph-based conditional moments (GRACE) method to do portfolio selection based on thousands of stocks or more. The GRACE method first learns the conditional quantiles and mean of stock returns via a factor-augmented temporal graph convolutional network, which guides the learning procedure through a factor-hypergraph built by the set of stock-to-stock relations from the domain knowledge as well as the set of factor-to-stock relations from the asset pricing knowledge. Next, the GRACE method learns the conditional variance, skewness, and kurtosis of stock returns from the learned conditional quantiles by using the quantiled conditional moment (QCM) method. The QCM method is a supervised learning procedure to learn these conditional higher-order moments, so it largely overcomes the computational difficulty from the classical high-dimensional GARCH-type methods. Moreover, the QCM method allows the mis-specification in modeling conditional quantiles to some extent, due to its regression-based nature. Finally, the GRACE method uses the learned conditional mean, variance, skewness, and kurtosis to construct several performance measures, which are criteria to sort the stocks to proceed the portfolio selection in the well-known 10-decile framework. An application to NASDAQ and NYSE stock markets shows that the GRACE method performs much better than its competitors, particularly when the performance measures are comprised of conditional variance, skewness, and kurtosis.


title: On $\lambda-$ Pseudo bi-starlike functions related with Fibonacci numbers

abstract: In this paper we define a new subclass $\lambda$-bi-pseudo-starlike functions of $\Sigma$ related to shell-like curves connected with Fibonacci numbers and determine the initial Taylor-Maclaurin coefficients $|a_2|$ and $|a_3|$ for $f\in\mathcal{PSL}_{\Sigma}^\lambda(\tilde{p}(z)).$ Further we determine the Fekete-Szeg\"{o} result for the function class $\mathcal{PSL}_{\Sigma}^\lambda(\tilde{p}(z))$ and for special cases, corollaries are stated which some of them are new and have not been studied so far.


title: Image Restoration with Mean-Reverting Stochastic Differential Equations

abstract: This paper presents a stochastic differential equation (SDE) approach for general-purpose image restoration. The key construction consists in a mean-reverting SDE that transforms a high-quality image into a degraded counterpart as a mean state with fixed Gaussian noise. Then, by simulating the corresponding reverse-time SDE, we are able to restore the origin of the low-quality image without relying on any task-specific prior knowledge. Crucially, the proposed mean-reverting SDE has a closed-form solution, allowing us to compute the ground truth time-dependent score and learn it with a neural network. Moreover, we propose a maximum likelihood objective to learn an optimal reverse trajectory that stabilizes the training and improves the restoration results. The experiments show that our proposed method achieves highly competitive performance in quantitative comparisons on image deraining, deblurring, and denoising, setting a new state-of-the-art on two deraining datasets. Finally, the general applicability of our approach is further demonstrated via qualitative results on image super-resolution, inpainting, and dehazing. Code is available at https://github.com/Algolzw/image-restoration-sde.


title: The Schwarzian derivative and the degree of a classical minimal surface

abstract: Using the Schwarzian derivative we construct a sequence $\left\{P_{\ell}\right\}_{\ell \geqslant 2}$ of meromorphic differentials on every non-flat oriented minimal surface in Euclidean $3$-space. The differentials $\left\{P_{\ell}\right\}_{\ell \geqslant 2}$ are invariant under all deformations of the surface arising via the Weierstrass representation and depend on the induced metric and its derivatives only. A minimal surface is said to have degree $n$ if its $n$-th differential is a polynomial expression in the differentials of lower degree. We observe that several well-known minimal surfaces have small degree, including Enneper's surface, the helicoid/catenoid and the Scherk - as well as the Schwarz family. Furthermore, it is shown that locally and away from umbilic points every minimal surface can be approximated by a sequence of minimal surfaces of increasing degree.


title: TransNet: Transferable Neural Networks for Partial Differential Equations

abstract: Transfer learning for partial differential equations (PDEs) is to develop a pre-trained neural network that can be used to solve a wide class of PDEs. Existing transfer learning approaches require much information of the target PDEs such as its formulation and/or data of its solution for pre-training. In this work, we propose to construct transferable neural feature spaces from purely function approximation perspectives without using PDE information. The construction of the feature space involves re-parameterization of the hidden neurons and uses auxiliary functions to tune the resulting feature space. Theoretical analysis shows the high quality of the produced feature space, i.e., uniformly distributed neurons. Extensive numerical experiments verify the outstanding performance of our method, including significantly improved transferability, e.g., using the same feature space for various PDEs with different domains and boundary conditions, and the superior accuracy, e.g., several orders of magnitude smaller mean squared error than the state of the art methods.


title: From particle systems to the BGK equation

abstract: In [Phys. Rev. 94 (1954), 511-525], P.L. Bhatnagar, E.P. Gross and M. Krook introduced a kinetic equation (the BGK equation), effective in physical situations where the Knudsen number is small compared to the scales where Boltzmann's equation can be applied, but not enough for using hydrodynamic equations. In this paper, we consider the stochastic particle system (inhomogeneous Kac model) underlying Bird's direct simulation Monte Carlo method (DSMC), with tuning of the scaled variables yielding kinetic and/or hydrodynamic descriptions. Although the BGK equation cannot be obtained from pure scaling, it does follow from a simple modification of the dynamics. This is proposed as a mathematical interpretation of some arguments in [Phys. Rev. 94 (1954), 511-525], complementing previous results in [Arch. Ration. Mech. Anal. 240 (2021), 785-808] and [Kinet. Relat. Models 16 (2023), 269-293].


title: Competitive exclusion and Hebbian couplings in random generalised Lotka-Volterra systems

abstract: We study communities emerging from generalised random Lotka--Volterra dynamics with a large number of species with interactions determined by the degree of niche overlap. Each species is endowed with a number of traits, and competition between pairs of species increases with their similarity in trait space. This leads to a model with random Hopfield-like interactions. We use tools from the theory of disordered systems, notably dynamic mean field theory, to characterise the statistics of the resulting communities at stable fixed points and determine analytically when stability breaks down. Two distinct types of transition are identified in this way, both marked by diverging abundances, but differing in the behaviour of the integrated response function. At fixed points only a fraction of the initial pool of species survives. We numerically study the eigenvalue spectra of the interaction matrix between extant species. We find evidence that the two types of dynamical transition are, respectively, associated with the bulk spectrum or an outlier eigenvalue crossing into the right half of the complex plane.


title: Jacobian-Free Variational Method for Constructing Connecting Orbits in Nonlinear Dynamical Systems

abstract: In a dynamical systems description of spatiotemporally chaotic PDEs including those describing turbulence, chaos is viewed as a trajectory evolving within a network of non-chaotic, dynamically unstable, time-invariant solutions embedded in the chaotic attractor of the system. While equilibria, periodic orbits and invariant tori can be constructed using existing methods, computations of heteroclinic and homoclinic connections mediating the evolution between the former invariant solutions remain challenging. We propose a robust matrix-free variational method for computing connecting orbits between equilibrium solutions of a dynamical system that can be applied to high-dimensional problems. Instead of a common shooting-based approach, we define a minimization problem in the space of smooth state space curves that connect the two equilibria with a cost function measuring the deviation of a connecting curve from an integral curve of the vector field. Minimization deforms a trial curve until, at a global minimum, a connecting orbit is obtained. The method is robust, has no limitation on the dimension of the unstable manifold at the origin equilibrium, and does not suffer from exponential error amplification associated with time-marching a chaotic system. Owing to adjoint-based minimization techniques, no Jacobian matrices need to be constructed and the memory requirement scales linearly with the size of the problem. The robustness of the method is demonstrated for the one-dimensional Kuramoto-Sivashinsky equation.


title: FedPH: Privacy-enhanced Heterogeneous Federated Learning

abstract: Federated Learning is a distributed machine-learning environment that allows clients to learn collaboratively without sharing private data. This is accomplished by exchanging parameters. However, the differences in data distributions and computing resources among clients make related studies difficult. To address these heterogeneous problems, we propose a novel Federated Learning method. Our method utilizes a pre-trained model as the backbone of the local model, with fully connected layers comprising the head. The backbone extracts features for the head, and the embedding vector of classes is shared between clients to improve the head and enhance the performance of the local model. By sharing the embedding vector of classes instead of gradient-based parameters, clients can better adapt to private data, and communication between the server and clients is more effective. To protect privacy, we propose a privacy-preserving hybrid method that adds noise to the embedding vector of classes. This method has a minimal effect on the performance of the local model when differential privacy is met. We conduct a comprehensive evaluation of our approach on a self-built vehicle dataset, comparing it with other Federated Learning methods under non-independent identically distributed(Non-IID).


title: Input Perturbation Reduces Exposure Bias in Diffusion Models

abstract: Denoising Diffusion Probabilistic Models have shown an impressive generation quality, although their long sampling chain leads to high computational costs. In this paper, we observe that a long sampling chain also leads to an error accumulation phenomenon, which is similar to the exposure bias problem in autoregressive text generation. Specifically, we note that there is a discrepancy between training and testing, since the former is conditioned on the ground truth samples, while the latter is conditioned on the previously generated results. To alleviate this problem, we propose a very simple but effective training regularization, consisting in perturbing the ground truth samples to simulate the inference time prediction errors. We empirically show that, without affecting the recall and precision, the proposed input perturbation leads to a significant improvement in the sample quality while reducing both the training and the inference times. For instance, on CelebA 64$\times$64, we achieve a new state-of-the-art FID score of 1.27, while saving 37.5% of the training time. The code is publicly available at https://github.com/forever208/DDPM-IP


title: Improving deep learning precipitation nowcasting by using prior knowledge

abstract: Deep learning methods dominate short-term high-resolution precipitation nowcasting in terms of prediction error. However, their operational usability is limited by difficulties explaining dynamics behind the predictions, which are smoothed out and missing the high-frequency features due to optimizing for mean error loss functions. We experiment with hand-engineering of the advection-diffusion differential equation into a PhyCell to introduce more accurate physical prior to a PhyDNet model that disentangles physical and residual dynamics. Results indicate that while PhyCell can learn the intended dynamics, training of PhyDNet remains driven by loss optimization, resulting in a model with the same prediction capabilities.


title: Classical Monte Carlo algorithm for simulation of a pseudospin model for cuprates

abstract: A classical Monte Carlo algorithm based on the quasi-classical approximation is applied to the pseudospin Hamiltonian of the model cuprate. The model takes into account both local and non-local correlations, Heisenberg spin-exchange interaction, single-particle and correlated two-particle transfer. We define the state selection rule that gives both the uniform distribution of states in the phase space and the doped charge conservation. The simulation results show a qualitative agreement of a phase diagrams with the experimental ones.


title: Semantic Network Model for Sign Language Comprehension

abstract: In this study, the authors propose a computational cognitive model for sign language (SL) perception and comprehension with detailed algorithmic descriptions based on cognitive functionalities in human language processing. The semantic network model (SNM) that represents semantic relations between concepts, it is used as a form of knowledge representation. The proposed model is applied in the comprehension of sign language for classifier predicates. The spreading activation search method is initiated by labeling a set of source nodes (e.g. concepts in the semantic network) with weights or "activation" and then iteratively propagating or "spreading" that activation out to other nodes linked to the source nodes. The results demonstrate that the proposed search method improves the performance of sign language comprehension in the SNM.


title: Reconstruction of three-dimensional turbulent flow structures using surface measurements for free-surface flows based on a convolutional neural network

abstract: A model based on a convolutional neural network (CNN) is designed to reconstruct the three-dimensional turbulent flows beneath a free surface using surface measurements, including the surface elevation and surface velocity. Trained on datasets obtained from the direct numerical simulation (DNS) of turbulent open-channel flows with a deformable free surface, the proposed model can accurately reconstruct the near-surface flow field and capture the characteristic large-scale flow structures away from the surface. The reconstruction performance of the model, measured by metrics such as the normalised mean squared reconstruction errors and scale-specific errors, is considerably better than that of the traditional linear stochastic estimation (LSE) method. We further analyse the saliency maps of the CNN model and the kernels of the LSE model and obtain insights into how the two models utilise surface features to reconstruct subsurface flows. The importance of different surface variables is analysed based on the saliency map of the CNN, which reveals knowledge about the surface-subsurface relations. The CNN is also shown to have a good generalization capability with respect to the Froude number if a model trained for a flow with a high Froude number is applied to predict flows with lower Froude numbers. The results presented in this work indicate that the CNN is effective regarding the detection of subsurface flow structures and by interpreting the surface-subsurface relations underlying the reconstruction model, the CNN can be a promising tool for assisting with the physical understanding of free-surface turbulence.


title: An Adaptive-Discard-Graph for online error control

abstract: In recent years, graphical multiple testing procedures have gained popularity due to their generality and ease of interpretation. In contemporary research, online error control is often required, where an error criterion, such as familywise error rate (FWER) or false discovery rate (FDR), shall remain under control while testing an a priori unbounded sequence of hypotheses. Although the classical graphical procedure can be extended to the online setting, previous work has shown that it leads to low power, and other approaches, such as Adaptive-Discard (ADDIS) procedures, are preferred instead. In this paper, we introduce an ADDIS-Graph with FWER control and its extension for the FDR setting. These graphical ADDIS procedures combine the good interpretability of graphical procedures with the high online power of ADDIS procedures. Moreover, they can be adapted to a local dependence structure and an asynchronous testing setup, leading to power improvements over the current state-of-art methods. Consequently, the proposed methods are useful for a wide range of applications, including innovative complex trial designs, such as platform trials, and large-scale test designs, such as in the evaluation of A/B tests for marketing research.


title: Criticality of quantum energy teleportation at phase transition points in quantum field theory

abstract: Quantum field theory can be a new medium for communication through quantum energy teleportation. We performed a demonstration of quantum energy teleportation with a relativistic fermionic field theory of self-coupled fermions, called the massive Thirring model. Our results reveal that there is a close relation between the amount of energy teleported and the phase diagram of the theory. In particular, it is shown that the teleported energy peaks near the phase transition points. The results provide new implications for phase diagrams of field theory in terms of quantum communication and quantum computing.

categories: hep-th cond-mat.stat-mech hep-lat hep-ph quant-ph


title: Dispersed graph labellings

abstract: A $k$-dispersed labelling of a graph $G$ on $n$ vertices is a labelling of the vertices of $G$ by the integers $1, \dots , n$ such that $d(i,i+1) \geq k$ for $1 \leq i \leq n-1$. $DL(G)$ denotes the maximum value of $k$ such that $G$ has a $k$-dispersed labelling. In this paper, we study upper and lower bounds on $DL(G)$. Computing $DL(G)$ is NP-hard. However, we determine the exact values of $DL(G)$ for cycles, paths, grids, hypercubes and complete binary trees. We also give a product construction and we prove a degree-based bound.


title: Distributed Consensus in Wireless Networks with Probabilistic Broadcast Scheduling

abstract: We consider distributed average consensus in a wireless network with partial communication to reduce the number of transmissions in every iteration/round. Considering the broadcast nature of wireless channels, we propose a probabilistic approach that schedules a subset of nodes for broadcasting information to their neighbors in every round. We compare several heuristic methods for assigning the node broadcast probabilities under a fixed number of transmissions per round. Furthermore, we introduce a pre-compensation method to correct the bias between the consensus value and the average of the initial values, and suggest possible extensions for our design. Our results are particularly relevant for developing communication-efficient consensus protocols in a wireless environment with limited frequency/time resources.


title: Online Harassment in Majority Contexts: Examining Harms and Remedies across Countries

abstract: Online harassment is a global problem. This article examines perceptions of harm and preferences for remedies associated with online harassment with nearly 4000 participants in 14 countries around the world. The countries in this work reflect a range of identities and values, with a focus on those outside of North American and European contexts. Results show that perceptions of harm are higher among participants from all countries studied compared to the United States. Non-consensual sharing of sexual photos is consistently rated as harmful in all countries, while insults and rumors are perceived as more harmful in non-U.S. countries, especially harm to family reputation. Lower trust in other people and lower trust in sense of safety in one's neighborhood correlate with increased perceptions of harm of online harassment. In terms of remedies, participants in most countries prefer monetary compensation, apologies, and publicly revealing offender's identities compared to the U.S. Social media platform design and policy must consider regional values and norms, which may depart from U.S. centric-approaches.


title: Pre-training for Speech Translation: CTC Meets Optimal Transport

abstract: The gap between speech and text modalities is a major challenge in speech-to-text translation (ST). Different methods have been proposed to reduce this gap, but most of them require architectural changes in ST training. In this work, we propose to mitigate this issue at the pre-training stage, requiring no change in the ST model. First, we show that the connectionist temporal classification (CTC) loss can reduce the modality gap by design. We provide a quantitative comparison with the more common cross-entropy loss, showing that pre-training with CTC consistently achieves better final ST accuracy. Nevertheless, CTC is only a partial solution and thus, in our second contribution, we propose a novel pre-training method combining CTC and optimal transport to further reduce this gap. Our method pre-trains a Siamese-like model composed of two encoders, one for acoustic inputs and the other for textual inputs, such that they produce representations that are close to each other in the Wasserstein space. Extensive experiments on the standard CoVoST-2 and MuST-C datasets show that our pre-training method applied to the vanilla encoder-decoder Transformer achieves state-of-the-art performance under the no-external-data setting, and performs on par with recent strong multi-task learning systems trained with external data. Finally, our method can also be applied on top of these multi-task systems, leading to further improvements for these models. Code and pre-trained models are available at https://github.com/formiel/fairseq.


title: $\theta$-diagram technique for $\mathcal{N}=1$, $d=4$ superfields

abstract: We describe a diagrammatic procedure to carry out the Grassmann integration in super-Feynman diagrams of 4d theories expressed in terms of $\mathcal{N}=1$ superfields. This method is alternative to the well known $D$-algebra approach. We develop it in detail for theories containing vector, chiral and anti-chiral superfields, with the type of interactions which occur in $\mathcal{N}=2$ SYM theories with massless matter, but it would be possible to extend it to other cases. The main advantage is that this method is algorithmic; we implemented it as a Mathematica program that, given the description of a super Feynman diagram in momentum space, returns directly the polynomial in the momenta produced by the Grassmann integration.


title: Sampling without replacement from a high-dimensional finite population

abstract: It is well known that most of the existing theoretical results in statistics are based on the assumption that the sample is generated with replacement from an infinite population. However, in practice, available samples are almost always collected without replacement. If the population is a finite set of real numbers, whether we can still safely use the results from samples drawn without replacement becomes an important problem. In this paper, we focus on the eigenvalues of high-dimensional sample covariance matrices generated without replacement from finite populations. Specifically, we derive the Tracy-Widom laws for their largest eigenvalues and apply these results to parallel analysis. We provide new insight into the permutation methods proposed by Buja and Eyuboglu in [Multivar Behav Res. 27(4) (1992) 509--540]. Simulation and real data studies are conducted to demonstrate our results.


title: The Exploration of Knowledge-Preserving Prompts for Document Summarisation

abstract: Despite the great development of document summarisation techniques nowadays, factual inconsistencies between the generated summaries and the original texts still occur from time to time. This study explores the possibility of adopting prompts to incorporate factual knowledge into generated summaries. We specifically study prefix-tuning that uses a set of trainable continuous prefix prompts together with discrete natural language prompts to aid summary generation. Experimental results demonstrate that the trainable prefixes can help the summarisation model extract information from discrete prompts precisely, thus generating knowledge-preserving summaries that are factually consistent with the discrete prompts. The ROUGE improvements of the generated summaries indicate that explicitly adding factual knowledge into the summarisation process could boost the overall performance, showing great potential for applying it to other natural language processing tasks.


title: Extraordinary-log Universality of Critical Phenomena in Plane Defects

abstract: The recent discovery of the extraordinary-log (E-Log) criticality is a celebrated achievement in modern critical theory and calls for generalization. Using large-scale Monte Carlo simulations, we study the critical phenomena of plane defects in three- and four-dimensional O($n$) critical systems. In three dimensions, we provide the first numerical proof for the E-Log criticality of plane defects. In particular, for $n=2$, the critical exponent $\hat{q}$ of two-point correlation and the renormalization-group parameter $\alpha$ of helicity modulus conform to the scaling relation $\hat{q}=(n-1)/(2 \pi \alpha)$, whereas the results for $n \geq 3$ violate this scaling relation. In four dimensions, it is strikingly found that the E-Log criticality also emerges in the plane defect. These findings have numerous potential realizations and would boost the ongoing advancement of conformal field theory.


title: Single-Trajectory Distributionally Robust Reinforcement Learning

abstract: As a framework for sequential decision-making, Reinforcement Learning (RL) has been regarded as an essential component leading to Artificial General Intelligence (AGI). However, RL is often criticized for having the same training environment as the test one, which also hinders its application in the real world. To mitigate this problem, Distributionally Robust RL (DRRL) is proposed to improve the worst performance in a set of environments that may contain the unknown test environment. Due to the nonlinearity of the robustness goal, most of the previous work resort to the model-based approach, learning with either an empirical distribution learned from the data or a simulator that can be sampled infinitely, which limits their applications in simple dynamics environments. In contrast, we attempt to design a DRRL algorithm that can be trained along a single trajectory, i.e., no repeated sampling from a state. Based on the standard Q-learning, we propose distributionally robust Q-learning with the single trajectory (DRQ) and its average-reward variant named differential DRQ. We provide asymptotic convergence guarantees and experiments for both settings, demonstrating their superiority in the perturbed environments against the non-robust ones.


title: Diffusion Models as Artists: Are we Closing the Gap between Humans and Machines?

abstract: An important milestone for AI is the development of algorithms that can produce drawings that are indistinguishable from those of humans. Here, we adapt the 'diversity vs. recognizability' scoring framework from Boutin et al, 2022 and find that one-shot diffusion models have indeed started to close the gap between humans and machines. However, using a finer-grained measure of the originality of individual samples, we show that strengthening the guidance of diffusion models helps improve the humanness of their drawings, but they still fall short of approximating the originality and recognizability of human drawings. Comparing human category diagnostic features, collected through an online psychophysics experiment, against those derived from diffusion models reveals that humans rely on fewer and more localized features. Overall, our study suggests that diffusion models have significantly helped improve the quality of machine-generated drawings; however, a gap between humans and machines remains -- in part explainable by discrepancies in visual strategies.


title: Program Dependence Net and On-demand Slicing for Property Verification of Concurrent System and Software

abstract: When checking concurrent software using a finite-state model, we face a formidable state explosion problem. One solution to this problem is dependence-based program slicing, whose use can effectively reduce verification time. It is orthogonal to other model-checking reduction techniques. However, when slicing concurrent programs for model checking, there are conversions between multiple irreplaceable models, and dependencies need to be found for variables irrelevant to the verified property, which results in redundant computation. To resolve this issue, we propose a Program Dependence Net (PDNet) based on Petri net theory. It is a unified model that combines a control-flow structure with dependencies to avoid conversions. For reduction, we present a PDNet slicing method to capture the relevant variables' dependencies when needed. PDNet in verifying linear temporal logic and its on-demand slicing can be used to significantly reduce computation cost. We implement a model-checking tool based on PDNet and its on-demand slicing, and validate the advantages of our proposed methods.


title: Meta-Learning Mini-Batch Risk Functionals

abstract: Supervised learning typically optimizes the expected value risk functional of the loss, but in many cases, we want to optimize for other risk functionals. In full-batch gradient descent, this is done by taking gradients of a risk functional of interest, such as the Conditional Value at Risk (CVaR) which ignores some quantile of extreme losses. However, deep learning must almost always use mini-batch gradient descent, and lack of unbiased estimators of various risk functionals make the right optimization procedure unclear. In this work, we introduce a meta-learning-based method of learning an interpretable mini-batch risk functional during model training, in a single shot. When optimizing for various risk functionals, the learned mini-batch risk functions lead to risk reduction of up to 10% over hand-engineered mini-batch risk functionals. Then in a setting where the right risk functional is unknown a priori, our method improves over baseline by 14% relative (~9% absolute). We analyze the learned mini-batch risk functionals at different points through training, and find that they learn a curriculum (including warm-up periods), and that their final form can be surprisingly different from the underlying risk functional that they optimize for.