title: Analyzing Lottery Ticket Hypothesis from PAC-Bayesian Theory Perspective

abstract: The lottery ticket hypothesis (LTH) has attracted attention because it can explain why over-parameterized models often show high generalization ability. It is known that when we use iterative magnitude pruning (IMP), which is an algorithm to find sparse networks with high generalization ability that can be trained from the initial weights independently, called winning tickets, the initial large learning rate does not work well in deep neural networks such as ResNet. However, since the initial large learning rate generally helps the optimizer to converge to flatter minima, we hypothesize that the winning tickets have relatively sharp minima, which is considered a disadvantage in terms of generalization ability. In this paper, we confirm this hypothesis and show that the PAC-Bayesian theory can provide an explicit understanding of the relationship between LTH and generalization behavior. On the basis of our experimental findings that flatness is useful for improving accuracy and robustness to label noise and that the distance from the initial weights is deeply involved in winning tickets, we offer the PAC-Bayes bound using a spike-and-slab distribution to analyze winning tickets. Finally, we revisit existing algorithms for finding winning tickets from a PAC-Bayesian perspective and provide new insights into these methods.


title: Lessons learnt from the recent EURADOS intercomparisons in computational dosimetry

abstract: Organized by Working Group 6 "Computational Dosimetry" of the European Radiation Dosimetry Group (EURADOS), a group of intercomparison exercises was conducted in which participants were asked to solve predefined problems in computational dosimetry. The results of these comparisons were published in a series of articles in this virtual special issue of Radiation Measurements. This paper reviews the experience gained from the various exercises and highlights the resulting conclusions for future exercises, as well as regarding the state of the art and the need for development in terms of quality assurance for computational dosimetry techniques.


title: Hook length and symplectic content in partitions

abstract: The dimension of an irreducible representation of $GL(n,\mathbb{C})$, $Sp(2n)$, or $SO(n)$ is given by the respective hook-length and content formulas for the corresponding partition. The first author, inspired by the Nekrasov-Okounkov formula, conjectured combinatorial interpretations of analogous expressions involving hook-lengths and symplectic/orthogonal contents. We prove special cases of these conjectures. In the process, we show that partitions of $n$ with all symplectic contents non-zero are equinumerous with partitions of $n$ into distinct even parts. We also present Beck-type companions to this identity. In this context, we give the parity of the number of partitions into distinct parts with odd (respectively, even) rank. We study the connection between the sum of hook-lengths and the sum of inversions in the binary representation of a partition. In addition, we introduce a new partition statistic, the $x$-ray list of a partition, and explore its connection with distinct partitions as well as partitions maximally contained in a given staircase partition.


title: Attack vs Benign Network Intrusion Traffic Classification

abstract: Intrusion detection systems (IDS) are used to monitor networks or systems for attack activity or policy violations. Such a system should be able to successfully identify anomalous deviations from normal traffic behavior. Here we discuss the machine learning approach to building an anomaly-based IDS using the CSE-CIC-IDS2018 dataset. Since the publication of this dataset a relatively large number of papers have been published, most of them presenting IDS architectures and results based on complex machine learning methods, like deep neural networks, gradient boosting classifiers, or hidden Markov models. Here we show that similar results can be obtained using a very simple nearest neighbor classification approach, avoiding the inherent complications of training such complex models. The advantages of the nearest neighbor algorithm are: (1) it is very simple to implement; (2) it is extremely robust; (3) it has no parameters, and therefore it cannot overfit the data. This result also shows that currently there is a trend of developing over-engineered solutions in the machine learning community. Such solutions are based on complex methods, like deep learning neural networks, without even considering baseline solutions corresponding to simple, but efficient methods.


title: Transkimmer: Transformer Learns to Layer-wise Skim

abstract: Transformer architecture has become the de-facto model for many machine learning tasks from natural language processing and computer vision. As such, improving its computational efficiency becomes paramount. One of the major computational inefficiency of Transformer-based models is that they spend the identical amount of computation throughout all layers. Prior works have proposed to augment the Transformer model with the capability of skimming tokens to improve its computational efficiency. However, they suffer from not having effectual and end-to-end optimization of the discrete skimming predictor. To address the above limitations, we propose the Transkimmer architecture, which learns to identify hidden state tokens that are not required by each layer. The skimmed tokens are then forwarded directly to the final output, thus reducing the computation of the successive layers. The key idea in Transkimmer is to add a parameterized predictor before each layer that learns to make the skimming decision. We also propose to adopt reparameterization trick and add skim loss for the end-to-end training of Transkimmer. Transkimmer achieves 10.97x average speedup on GLUE benchmark compared with vanilla BERT-base baseline with less than 1% accuracy degradation.


title: The Probabilistic Solar Particle Event foRecasting (PROSPER) Model

abstract: The Probabilistic Solar Particle Event foRecasting (PROSPER) model predicts the probability of occurrence and the expected peak flux of Solar Energetic Particle (SEP) events. Predictions are derived for a set of integral proton energies (i.e. E$>$10, $>$30 and $>$100 MeV) from characteristics of solar flares (longitude, magnitude), coronal mass ejections (width, speed) and combinations of both. Herein the PROSPER model methodology for deriving the SEP event forecasts is described and the validation of the model, based on archived data, is presented for a set of case studies. The PROSPER model has been incorporated into the new operational Advanced Solar Particle Event Casting System (ASPECS) tool to provide nowcasting (short term forecasting) of SEP events as part of ESA's future SEP Advanced Warning System (SAWS). ASPECS also provides the capability to interrogate PROSPER for historical cases via a run on demand functionality.


title: Adjoint-based optimization of two-dimensional Stefan problems

abstract: A range of optimization cases of two-dimensional Stefan problems, solved using a tracking-type cost-functional, is presented. A level set method is used to capture the interface between the liquid and solid phases and an immersed boundary (cut cell) method coupled with an implicit time-advancement scheme is employed to solve the heat equation. A conservative implicit-explicit scheme is then used for solving the level set transport equation. The resulting numerical framework is validated with respect to existing analytical solutions of the forward Stefan problem. An adjoint-based algorithm is then employed to efficiently compute the gradient used in the optimisation algorithm (L-BFGS). The algorithm follows a continuous adjoint framework, where adjoint equations are formally derived using shape calculus and transport theorems. A wide range of control objectives are presented, and the results show that using parameterised boundary actuation leads to effective control strategies in order to suppress interfacial instabilities or to maintain a desired crystal shape.

categories: math-ph cs.NA math.MP math.NA physics.comp-ph physics.flu-dyn


title: Systematic construction of non-autonomous Hamiltonian equations of Painlev\'e-type. III. Quantization

abstract: This is the third article in our series of articles exploring connections between dynamical systems of St\"ackel-type and of Painlev\'e-type. In this article we present a method of deforming of minimally quantized quasi-St\"ackel Hamiltonians, considered in Part I to self-adjoint operators satisfying the quantum Frobenius condition, thus guaranteeing that the corresponding Schr\"odinger equations posses common, multi-time solutions. As in the classical case, we obtain here both magnetic and non-magnetic families of systems. We also show the existence of multitime-dependent quantum canonical maps between both classes of quantum systems.


title: Quotients of the Bruhat-Tits tree by function field analogs of the Hecke congruence subgroups

abstract: Let C be a smooth, projective and geometrically integral curve defined over a finite field F. For each closed point P of C, let R be the ring of functions that are regular outside P, and let K be the completion at P of the function field of C. In order to study groups of the form GL2(R), Serre describes the quotient graph GL2(R)\t, where t is the Bruhat-Tits tree defined from SL2(K). In particular, Serre shows that GL2(R)\t is the union of a finite graph and a finite number of ray shaped subgraphs, which are called cusps. It is not hard to see that finite index subgroups inherit this property. In this work we describe the associated quotient graph H\t for the action on t of the group H of matrices in GL2(R) that are upper triangular modulo a certain ideal I of R. More specifically, we give a explicit formula for the cusp number of H\t. Then, by using Bass-Serre Theory, we describe the combinatorial structure of H. These groups play, in the function field context, the same role as the Hecke congruence subgroups of SL2(Z).


title: Near-field Probing of Optical Superchirality for Enhanced Bio-detection

abstract: Nanophotonic platforms in theory uniquely enable < femtomoles of chiral biological and pharmaceutical molecules to be detected, through the highly localised changes in the chiral asymmetries of the near-fields that they induce. However, current chiral nanophotonic based strategies are intrinsically limited because they rely on far-field optical measurements that are sensitive to a much larger near-field volume, than that influenced by the chiral molecules. Consequently, they depend on detecting small changes in far-field optical response restricting detection sensitivities. Here we exploit an intriguing phenomenon, plasmonic circularly polarised luminescence (PCPL), which is an incisive local probe of near-field chirality. This allows chiral detection of monolayer quantities of a de novo designed peptide, which is not achieved with a far-field response. Our work demonstrates that by leveraging the capabilities of nanophotonic platforms with the near-field sensitivity of PCPL, optimal biomolecular detection performance can be achieved, opening new avenues for nanometrology.


title: High-sensitivity Frequency Comb Carrier-Envelope-Phase Metrology in Solid State High Harmonic Generation

abstract: Non-perturbative and phase-sensitive light-matter interactions have led to the generation of attosecond pulses of light and the control electrical currents on the same timescale. Traditionally, probing these effects via high harmonic generation has involved complicated lasers and apparatuses to generate the few-cycle and high peak power pulses needed to obtain and measure spectra that are sensitive to the phase of the light wave. Instead, we show that nonlinear effects dependent on the carrier-envelope phase can be accessed in solid state crystals with simple low-energy frequency combs that we combine with high-sensitivity demodulation techniques to measure harmonic spectral modulations. Central to this advance is the use of a scalable 100 MHz Erbium-fiber frequency comb at 1550 nm to produce 10 nJ, 20 fs pulses which are focused to the TW/cm2 level. In a single pass through a 500 {\mu}m ZnO crystal this yields harmonic spectra as short as 200 nm. With this system, we introduce a technique of carrier-envelope amplitude modulation spectroscopy (CAMS) and use it to characterize the phase-sensitive modulation of the ultraviolet harmonics with 85 dB signal-to-noise ratio. We further verify the non-perturbative nature of the harmonic generation through polarization gating of the driving pulse to increase the effects of the carrier-envelope phase. Our work demonstrates robust and ultra-sensitive methods for generating and characterizing harmonic generation at 100 MHz rates that should provide advantages in the study of attosecond nonlinear processes in solid state systems. Additionally, as a simple and low-noise frequency comb, this broadband source will be useful for precision dual-comb spectroscopy of a range of physical systems across the ultraviolet and visible spectral regions (200 - 650 nm).


title: Sobolev Acceleration and Statistical Optimality for Learning Elliptic Equations via Gradient Descent

abstract: In this paper, we study the statistical limits in terms of Sobolev norms of gradient descent for solving inverse problem from randomly sampled noisy observations using a general class of objective functions. Our class of objective functions includes Sobolev training for kernel regression, Deep Ritz Methods (DRM), and Physics Informed Neural Networks (PINN) for solving elliptic partial differential equations (PDEs) as special cases. We consider a potentially infinite-dimensional parameterization of our model using a suitable Reproducing Kernel Hilbert Space and a continuous parameterization of problem hardness through the definition of kernel integral operators. We prove that gradient descent over this objective function can also achieve statistical optimality and the optimal number of passes over the data increases with sample size. Based on our theory, we explain an implicit acceleration of using a Sobolev norm as the objective function for training, inferring that the optimal number of epochs of DRM becomes larger than the number of PINN when both the data size and the hardness of tasks increase, although both DRM and PINN can achieve statistical optimality.

categories: math.NA cs.LG cs.NA math.ST physics.comp-ph stat.ML stat.TH


title: Fluctuations in the canonical ensemble of an Abelian charge

abstract: We study fluctuations in the canonical ensemble, where the net baryon number is exactly conserved. The focus is on cumulants and factorial cumulants linked to the baryon and antibaryon multiplicities and their sum or difference in full phase-space as well as in subsystems. In particular, we connect the fluctuations of the net baryon number in a subsystem, relevant for fluctuation studies in nucleus-nucleus collisions, with fluctuations of the baryon and antibaryon numbers of the total system. We derive analytic expressions for factorial cumulants of arbitrary order. Compact results are obtained in terms of cumulants of the baryon number of the total system. Moreover, we derive the asymptotic forms of the factorial cumulants of baryon and antibaryon multiplicities in the high- and low-temperature limits and discuss the results in the context of heavy-ion collision experiments.


title: Trucks Don't Mean Trump: Diagnosing Human Error in Image Analysis

abstract: Algorithms provide powerful tools for detecting and dissecting human bias and error. Here, we develop machine learning methods to to analyze how humans err in a particular high-stakes task: image interpretation. We leverage a unique dataset of 16,135,392 human predictions of whether a neighborhood voted for Donald Trump or Joe Biden in the 2020 US election, based on a Google Street View image. We show that by training a machine learning estimator of the Bayes optimal decision for each image, we can provide an actionable decomposition of human error into bias, variance, and noise terms, and further identify specific features (like pickup trucks) which lead humans astray. Our methods can be applied to ensure that human-in-the-loop decision-making is accurate and fair and are also applicable to black-box algorithmic systems.


title: Mack-Net model: Blending Mack's model with Recurrent Neural Networks

abstract: In general insurance companies, a correct estimation of liabilities plays a key role due to its impact on management and investing decisions. Since the Financial Crisis of 2007-2008 and the strengthening of regulation, the focus is not only on the total reserve but also on its variability, which is an indicator of the risk assumed by the company. Thus, measures that relate profitability with risk are crucial in order to understand the financial position of insurance firms. Taking advantage of the increasing computational power, this paper introduces a stochastic reserving model whose aim is to improve the performance of the traditional Mack's reserving model by applying an ensemble of Recurrent Neural Networks. The results demonstrate that blending traditional reserving models with deep and machine learning techniques leads to a more accurate assessment of general insurance liabilities.


title: Automating Defeasible Reasoning in Law

abstract: The paper studies defeasible reasoning in rule-based systems, in particular about legal norms and contracts. We identify rule modifiers that specify how rules interact and how they can be overridden. We then define rule transformations that eliminate these modifiers, leading in the end to a translation of rules to formulas. For reasoning with and about rules, we contrast two approaches, one in a classical logic with SMT solvers as proof engines, one in a non-monotonic logic with Answer Set Programming solvers.


title: Liquid-phase purification for multi-tonne xenon detectors

abstract: As liquid xenon detectors grow in scale, novel techniques are required to maintain sufficient purity for charges to survive across longer drifts. The Xeclipse test facility at Columbia University was built to test the removal of electronegative impurities through cryogenic filtration powered by a liquid xenon pump, enabling a far higher mass flow rate than gas-phase purification through heated getters. In this paper, we present results from Xeclipse, including measured oxygen removal rates for two sorbent materials, which were used to guide the design and commissioning of the XENONnT liquid purification system. Thanks to this innovation, XENONnT has achieved an electron lifetime greater than 10 ms in an 8.6 tonne total mass, perhaps the highest purity ever measured in a liquid xenon detector.


title: Output-Feedback Path Planning with Robustness to State-Dependent Errors

abstract: We consider the problem of sample-based feedback motion planning from measurements affected by systematic errors. Our previous work presented output feedback controllers that use measurements from landmarks in the environment to navigate through a cell-decomposable environment using duality, Control Lyapunov and Barrier Functions (CLF, CBF), and Linear Programming. In this paper, we build on this previous work with a novel strategy that allows the use of measurements affected by systematic errors in perceived depth (similarly to what might be generated by vision-based sensors), as opposed to accurate displacement measurements. As a result, our new method has the advantage of providing more robust performance (with quantitative guarantees) when inaccurate sensors are used. We test the proposed algorithm in the simulation to evaluate the performance limits of our approach predicted by our theoretical derivations.


title: Reductive MDPs: A Perspective Beyond Temporal Horizons

abstract: Solving general Markov decision processes (MDPs) is a computationally hard problem. Solving finite-horizon MDPs, on the other hand, is highly tractable with well known polynomial-time algorithms. What drives this extreme disparity, and do problems exist that lie between these diametrically opposed complexities? In this paper we identify and analyse a sub-class of stochastic shortest path problems (SSPs) for general state-action spaces whose dynamics satisfy a particular drift condition. This construction generalises the traditional, temporal notion of a horizon via decreasing reachability: a property called reductivity. It is shown that optimal policies can be recovered in polynomial-time for reductive SSPs -- via an extension of backwards induction -- with an efficient analogue in reductive MDPs. The practical considerations of the proposed approach are discussed, and numerical verification provided on a canonical optimal liquidation problem.


title: Depletion of Moderately Volatile Elements by Open-System loss in the Early Solar Nebula

abstract: Rocky bodies of the inner solar system display a systematic depletion of the "Moderately Volatile Elements" (MVEs) that correlates with the expected condensation temperature of their likely host materials under protoplanetary nebula conditions. In this paper, we present and test a new hypothesis in which open system loss processes irreversibly remove vaporized MVEs from high nebula altitudes, leaving behind the more refractory solids residing much closer to the midplane. The MVEs irreversibly lost from the nebula through these open system loss processes are then simply unavailable for condensation onto planetesimals forming even much later, after the nebula cooled, overcoming a critical difficulty encountered by previous models of this type. We model open system loss processes operating at high nebula altitudes, such as resulting from disk winds flowing out of the system entirely, or layered accretion directly onto the young sun. We find that mass loss rates higher than found in typical T-Tauri disk winds, lasting short periods of time, are most satisfactory, pointing to multiple intense early outburst stages. Using our global nebula model, incorporating realistic particle growth and inward drift for solids, we constrain how much the MVE depletion signature in the inner region is diluted by the drift of undepleted material from the outer nebula. We also find that a significant irreversible loss of the common rock-forming elements (Fe, Mg, Si) can occur, leading to a new explanation of another longstanding puzzle of the apparent "enhancement" in the relative abundance of highly refractory elements in chondrites.


title: Room Temperature Magneto-dielectric coupling in the CaMnO3 modified NBT lead-free ceramics

abstract: The sol-gel prepared (1-x) Na0.5Bi0.5TiO3- (x) CaMnO3 (x=0, 0.03, 0.06, 0.12) compositions show a Rhombohedral (R3c) phase for x=0.06 while a mixed Rhombohedral (R3c) and orthorhombic (Pnma) phases for the x=0.12. The lattice volume consistently decreased with an increase in the CaMnO3 content. The phase transition temperature (Tc) decreased with an increase in the CaMnO3 compositions. The room temperature dielectric constant increased, and loss decreased for the x=0.03 composition due to a decrease in the oxygen vacancy and Bi loss confirmed by the valence state study (XPS). All the compositions show a variation of the room temperature dielectric property with an application of magnetic field confirming a magnetodielectric coupling. The x=0.06 composition shows the highest negative magnetodielectric constant (MD%) of 3.69 at 100kHz at an applied field of 5 kG.


title: The influence of Hickson-like compact group environment on galaxy luminosities

abstract: Compact groups of galaxies are devised as extreme environments where interactions may drive galaxy evolution. In this work, we analysed whether the luminosities of galaxies inhabiting compact groups differ from those of galaxies in loose galaxy groups. We computed the luminosity functions of galaxy populations inhabiting a new sample of 1412 Hickson-like compact groups of galaxies identified in the Sloan Digital Sky Survey Data Release 16. We observed a characteristic absolute magnitude for galaxies in compact groups brighter than that observed in the field or loose galaxy systems. We also observed a deficiency of faint galaxies in compact groups in comparison with loose systems. Our analysis showed that the brightening is mainly due to galaxies inhabiting the more massive compact groups. In contrast to what is observed in loose systems where only the luminosities of Red (and Early) galaxies show a dependency with group mass, luminosities of Red and Blue (also Early and Late) galaxies in compact groups are affected similarly as a function of group virial mass. When using Hubble types, we observed that Elliptical galaxies in compact groups are the brightest galaxy population, and groups dominated by an Elliptical galaxy also display the brightest luminosities in comparison with those dominated by Spiral galaxies. Moreover, we show that the general luminosity trends can be reproduced using a mock catalogue obtained from a semi-analytical model of galaxy formation. These results suggest that the inner extreme environment in compact groups prompts a different evolutionary history for their galaxies.


title: Temperature induced change of conformation of Sc2TbN@C80 on h-BN/Ni(111)

abstract: The conformation of molecules on surfaces is decisive for their functionality. For the case of the endofullerene paramagnet Sc2TbN@C80 the conformation is linked to an electric and a magnetic dipole moment. Therefore a workfunction change of a substrate with adsorbed molecules, qualifies the system to be magnetoelectric. One monolayer of Sc2TbN@C80 has been studied on h-BN/Ni(111). The molecules assume a hexagonally close packed lattice aligned with the substrate high symmetry directions. The structure is incommensurate and arranges at a periodicity of about 4.3x4.3 substrate unit cells. At low temperatures a (2 x 2) superstructure is observed. Angular resolved valence band photoemission spectroscopy shows a temperature induced 0.3 eV shift on the C80 molecular orbitals to lower binding energies that is parallel to a workfunction increase. From comparison of the molecular orbital angular photoemission intensity distributions it is conjectured that the molecules undergo a change in conformation between 30 and 300 K. This phase transition is centred at 125 K as observed with high resolution x-ray photoelectron spectroscopy that shows the core levels of the atomic species on the molecules to shift parallel to the workfunction. The temperature dependence of the workfunction can be described with a two level model that accounts for the disordering with an excitation energy of 60 meV into a highly degenerate ensemble. The experimental findings are backed by density functional theory calculations for the diamagnetic sibling of Sc2TbN@C80 : Sc2YN@C80 that rationalize the incommensurate structure, show a permanent dipole moment of Sc2YN@C80 and a relation between the workfunction and the orientation of the endohedral cluster.


title: Momentum-inversion symmetry breaking on the Fermi surface of magnetic topological insulators

abstract: Magnetic topological insulators (MnBi$_2$Te$_4$)(Bi$_2$Te$_3$)$_n$ were anticipated to exhibit magnetic energy gaps while recent spectroscopic studies did not observe them. Thus, magnetism on the surface is under debate. In this work, we propose another symmetry criterion to probe the surface magnetism. Because of both time-reversal symmetry-breaking and inversion symmetry-breaking, we demonstrate that the surface band structure violates momentum-inversion symmetry and leads to a three-fold rather than six-fold rotational symmetry on the Fermi surface if corresponding surface states couple strongly to the surface magnetism. Such a momentum-inversion symmetry violation is significant along the $\Gamma-K$ direction for surface bands on the (0001) plane.


title: Policy Gradient Method For Robust Reinforcement Learning

abstract: This paper develops the first policy gradient method with global optimality guarantee and complexity analysis for robust reinforcement learning under model mismatch. Robust reinforcement learning is to learn a policy robust to model mismatch between simulator and real environment. We first develop the robust policy (sub-)gradient, which is applicable for any differentiable parametric policy class. We show that the proposed robust policy gradient method converges to the global optimum asymptotically under direct policy parameterization. We further develop a smoothed robust policy gradient method and show that to achieve an $\epsilon$-global optimum, the complexity is $\mathcal O(\epsilon^{-3})$. We then extend our methodology to the general model-free setting and design the robust actor-critic method with differentiable parametric policy class and value function. We further characterize its asymptotic convergence and sample complexity under the tabular setting. Finally, we provide simulation results to demonstrate the robustness of our methods.


title: Joint Location and Cost Planning in Maximum Capture Facility Location under Multiplicative Random Utility Maximization

abstract: We study a joint facility location and cost planning problem in a competitive market under random utility maximization (RUM) models. The objective is to locate new facilities and make decisions on the costs (or budgets) to spend on the new facilities, aiming to maximize an expected captured customer demand, assuming that customers choose a facility among all available facilities according to a RUM model. We examine two RUM frameworks in the discrete choice literature, namely, the additive and multiplicative RUM. While the former has been widely used in facility location problems, we are the first to explore the latter in the context. We numerically show that the two RUM frameworks can well approximate each other in the context of the cost optimization problem. In addition, we show that, under the additive RUM framework, the resultant cost optimization problem becomes highly non-convex and may have several local optima. In contrast, the use of the multiplicative RUM brings several advantages to the competitive facility location problem. For instance, the cost optimization problem under the multiplicative RUM can be solved efficiently by a general convex optimization solver or can be reformulated as a conic quadratic program and handled by a conic solver available in some off-the-shelf solvers such as CPLEX or GUROBI. Furthermore, we consider a joint location and cost optimization problem under the multiplicative RUM and propose three approaches to solve the problem, namely, an equivalent conic reformulation, a multi-cut outer-approximation algorithm, and a local search heuristic. We provide numerical experiments based on synthetic instances of various sizes to evaluate the performances of the proposed algorithms in solving the cost optimization, and the joint location and cost optimization problems.


title: Optimal Error-Detecting Codes for General Asymmetric Channels via Sperner Theory

abstract: Several communication models that are of relevance in practice are asymmetric in the way they act on the transmitted "objects". Examples include channels in which the amplitudes of the transmitted pulses can only be decreased, channels in which the symbols can only be deleted, channels in which non-zero symbols can only be shifted to the right (e.g., timing channels), subspace channels in which the dimension of the transmitted vector space can only be reduced, unordered storage channels in which the cardinality of the stored (multi)set can only be reduced, etc. We introduce a formal definition of an asymmetric channel as a channel whose action induces a partial order on the set of all possible inputs, and show that this definition captures all the above examples. Such a general approach allows one to treat all these different models in a unified way, and to obtain a characterization of optimal error-detecting codes for many interesting asymmetric channels by using Sperner theory.


title: Wigner-Smith Time Delay Matrix for Acoustic Scattering: Theory and Phenomenology

abstract: The Wigner-Smith (WS) time delay matrix relates a lossless system's scattering matrix to its frequency derivative. First proposed in the realm of quantum mechanics to characterize time delays experienced by particles during a collision, this article extends the use of WS time delay techniques to acoustic scattering problems governed by the Helmholtz equation. Expression for the entries of the WS time delay matrix involving renormalized volume integrals of energy densities are derived, and shown to hold true independent of the scatterer's geometry, boundary condition (sound-soft or sound-hard), and excitation. Numerical examples show that the eigenmodes of the WS time delay matrix describe distinct scattering phenomena characterized by well-defined time delays.


title: Novel Multicolumn Kernel Extreme Learning Machine for Food Detection via Optimal Features from CNN

abstract: Automatic food detection is an emerging topic of interest due to its wide array of applications ranging from detecting food images on social media platforms to filtering non-food photos from the users in dietary assessment apps. Recently, during the COVID-19 pandemic, it has facilitated enforcing an eating ban by automatically detecting eating activities from cameras in public places. Therefore, to tackle the challenge of recognizing food images with high accuracy, we proposed the idea of a hybrid framework for extracting and selecting optimal features from an efficient neural network. There on, a nonlinear classifier is employed to discriminate between linearly inseparable feature vectors with great precision. In line with this idea, our method extracts features from MobileNetV3, selects an optimal subset of attributes by using Shapley Additive exPlanations (SHAP) values, and exploits kernel extreme learning machine (KELM) due to its nonlinear decision boundary and good generalization ability. However, KELM suffers from the 'curse of dimensionality problem' for large datasets due to the complex computation of kernel matrix with large numbers of hidden nodes. We solved this problem by proposing a novel multicolumn kernel extreme learning machine (MCKELM) which exploited the k-d tree algorithm to divide data into N subsets and trains separate KELM on each subset of data. Then, the method incorporates KELM classifiers into parallel structures and selects the top k nearest subsets during testing by using the k-d tree search for classifying input instead of the whole network. For evaluating a proposed framework large food/non-food dataset is prepared using nine publically available datasets. Experimental results showed the superiority of our method on an integrated set of measures while solving the problem of 'curse of dimensionality in KELM for large datasets.


title: Moduli spaces of quadratic maps: arithmetic and geometry

abstract: We establish an implication between two long-standing open problems in complex dynamics. The roots of the $n$-th Gleason polynomial $G_n\in\mathbb{Q}[c]$ comprise the $0$-dimensional moduli space of quadratic polynomials with an $n$-periodic critical point. $\mathrm{Per}_n(0)$ is the $1$-dimensional moduli space of quadratic rational maps on $\mathbb{P}^1$ with an $n$-periodic critical point. We show that if $G_n$ is irreducible over $\mathbb{Q}$, then $\mathrm{Per}_n(0)$ is irreducible over $\mathbb{C}$. To do this, we exhibit a $\mathbb{Q}$-rational smooth point on a projective completion of $\mathrm{Per}_n(0)$, using the admissible covers completion of a Hurwitz space. In contrast, the Uniform Boundedness Conjecture in arithmetic dynamics would imply that for sufficiently large $n$, $\mathrm{Per}_n(0)$ itself has no $\mathbb{Q}$-rational points.


title: Leptonic $g-2$ in 2HDM

abstract: The experimental observations of the electron and muon anomalous magnetic moment present discrepancies with respect to the Standard Model predictions. A class of flavor conserving Two Higgs Doublet model, stable under renormalization, that is capable of explaining both anomalies simultaneously is presented. This model can also explain an excess observed by ATLAS in $\sigma(pp\to S)_{[\text{ggF}]}\times \text{Br}(S\to\tau^+\tau^-)$.


title: Non-invertible planar self-affine sets

abstract: We compare the dimension of a non-invertible self-affine set to the dimension of the respective invertible self-affine set. In particular, for generic planar self-affine sets, we show that the dimensions coincide when they are large and differ when they are small. Our study relies on thermodynamical formalism where, for dominated and irreducible matrices, we completely characterize the behavior of the pressures.


title: Long-term Control for Dialogue Generation: Methods and Evaluation

abstract: Current approaches for controlling dialogue response generation are primarily focused on high-level attributes like style, sentiment, or topic. In this work, we focus on constrained long-term dialogue generation, which involves more fine-grained control and requires a given set of control words to appear in generated responses. This setting requires a model to not only consider the generation of these control words in the immediate context, but also produce utterances that will encourage the generation of the words at some time in the (possibly distant) future. We define the problem of constrained long-term control for dialogue generation, identify gaps in current methods for evaluation, and propose new metrics that better measure long-term control. We also propose a retrieval-augmented method that improves performance of long-term controlled generation via logit modification techniques. We show through experiments on three task-oriented dialogue datasets that our metrics better assess dialogue control relative to current alternatives and that our method outperforms state-of-the-art constrained generation baselines.


title: Unstable Neutrinos can Relax Cosmological Mass Bounds

abstract: The light neutrino masses are at present most stringently constraint via cosmological probes. In particular the Planck collaboration reports $ \sum m_\nu \leq 0.12\,\mathrm{eV}$ at $95\%$ CL within the standard cosmological model. This is more than one order of magnitude stronger than the one arising from laboratory searches. The cosmological bound taken at face value excludes a plethora of neutrino flavour models which can successfully explain the neutrino oscillation data. The indirect nature of the cosmological bound, however, allows to relax the bound to up to $ \sum m_\nu \sim 1\,\mathrm{eV}$ if neutrinos decay on timescales shorter than the age of the Universe, $\tau_\nu \leq t_U$. We present how a decay of the type $\nu_i\to\nu_4\phi$ can be realized within general models of the minimal extended seesaw framework. The idea is then explicitly realized within the context of a $U(1)_{\mu-\tau}$ flavour model.


title: Exciton density waves in Coulomb-coupled dual moir\'e lattices

abstract: Strongly correlated bosons in a lattice are a platform to realize rich bosonic states of matter and quantum phase transitions. While strongly correlated bosons in a lattice have been studied in cold-atom experiments, their realization in a solid-state system has remained challenging. Here we trap interlayer excitons--bosons composed of bound electron-hole pairs--in a lattice provided by an angle-aligned WS2/bilayer WSe2/WS2 multilayer; the heterostructure supports Coulomb-coupled triangular moir\'e lattices of nearly identical period at the top and bottom interfaces. We observe correlated insulating states when the combined electron filling factor of the two lattices, with arbitrary partitions, equals to 1/3,2/3,4/3 and 5/3. These new states can be interpreted as exciton density waves in a Bose-Fermi mixture of excitons and holes. Because of the strong repulsive interactions between the constituents, the holes form robust generalized Wigner crystals , which restrict the exciton fluid to channels that spontaneously break the translational symmetry of the lattice. Our results demonstrate that Coulomb-coupled moir\'e lattices are fertile ground for correlated many-boson phenomena.


title: Pinning-depinning transitions in two classes of discrete elastic-string models in (2+1)-dimensions

abstract: The pinning-depinning phase transitions of interfaces for two classes of discrete elastic-string models are inverstigated numerically. In the (1+1)-dimensions, we revisit these two elastic-string models with slight modification on growth rule, and compare with the previous numerical results. In the (2+1)-dimensional case, we perform extensive simulations on pinning-depinning transitions in these quenched models. For full comparisons in the physically relevant spatial dimensions, we also visit numerically two distinct quenched universality classes, including the quenched Edwards-Wilkinson (QEW) and the quenched Kardar-Parisi-Zhang (QKPZ) equations with and without external driving forces. The critical exponents of these quenched systems are numerically estimated. Our results show that the critical exponents satisfy scaling relations well, and these two discrete elastic-string models do not fall into the existing universality classes. In order to visually comparisons of these quenched systems in (2+1)-dimensional cases, we also exhibit surface morphologies with various external driving forces during the saturated time regimes.


title: Inference of Stochastic Disease Transmission Models Using Particle-MCMC and a Gradient Based Proposal

abstract: State-space models have been widely used to model the dynamics of communicable diseases in populations of interest by fitting to time-series data. Particle filters have enabled these models to incorporate stochasticity and so can better reflect the true nature of population behaviours. Relevant parameters such as the spread of the disease, $R_t$, and recovery rates can be inferred using Particle MCMC. The standard method uses a Metropolis-Hastings random-walk proposal which can struggle to reach the stationary distribution in a reasonable time when there are multiple parameters. In this paper we obtain full Bayesian parameter estimations using gradient information and the No U-Turn Sampler (NUTS) when proposing new parameters of stochastic non-linear Susceptible-Exposed-Infected-Recovered (SEIR) and SIR models. Although NUTS makes more than one target evaluation per iteration, we show that it can provide more accurate estimates in a shorter run time than Metropolis-Hastings.


title: Conservative Binary Dynamics with a Spinning Black Hole at $\mathcal{O}(G^3)$ from Scattering Amplitudes

abstract: We compute the conservative two-body Hamiltonian of a compact binary system with a spinning black hole through $\mathcal{O}(G^3)$ to all orders in velocity, including linear and quadratic spin terms. To obtain our results we calculate the classical limit of the two-loop amplitude for the scattering of a massive scalar particle with a massive spin-1 particle minimally coupled to gravity. We employ modern scattering amplitude and loop integration techniques, in particular numerical unitarity, integration-by-parts identities, and the method of regions. The conservative potential in terms of rest-frame spin vectors is extracted by matching to a non-relativistic effective field theory. We also apply the Kosower-Maybee-O'Connell (KMOC) formalism to calculate the impulse in the covariant spin formalism directly from the amplitude. We work systematically in conventional dimensional regularization and explicitly evaluate all divergent integrals that appear in full- and effective-theory amplitudes, as well as in the phase-space integrals that arise in the KMOC formalism.


title: End-to-end Memory-Efficient Reconstruction for Cone Beam CT

abstract: Cone Beam CT plays an important role in many medical fields nowadays, but the potential of this imaging modality is hampered by lower image quality compared to the conventional CT. A lot of recent research has been directed towards reconstruction methods relying on deep learning. However, practical application of deep learning to CBCT reconstruction is complicated by several issues, such as exceedingly high memory costs of deep learning methods for fully 3D data. In this work, we address these limitations and propose LIRE: a learned invertible primal-dual iterative scheme for Cone Beam CT reconstruction. Memory requirements of the network are substantially reduced while preserving its expressive power, enabling us to train on data with isotropic 2mm voxel spacing, clinically-relevant projection count and detector panel resolution on current hardware with 24 GB VRAM. Two LIRE models for small and for large Field-of-View setting were trained and validated on a set of 260 + 22 thorax CT scans and tested using a set of 142 thorax CT scans plus an out-of-distribution dataset of 79 head \& neck CT scans. For both settings, our method surpasses the classical methods and the deep learning baselines on both test sets. On the thorax CT set, our method achieves PSNR of 33.84 $\pm$ 2.28 for the small FoV setting and 35.14 $\pm$ 2.69 for the large FoV setting; U-Net baseline achieves PSNR of 33.08 $\pm$ 1.75 and 34.29 $\pm$ 2.71 respectively. On the head \& neck CT set, our method achieves PSNR of 39.35 $\pm$ 1.75 for the small FoV setting and 41.21 $\pm$ 1.41 for the large FoV setting; U-Net baseline achieves PSNR of 33.08 $\pm$ 1.75 and 34.29 $\pm$ 2.71 respectively. Additionally, we demonstrate that LIRE can be finetuned to reconstruct high-resolution CBCT data with the same geometry but 1mm voxel spacing and higher detector panel resolution, where it outperforms the U-Net baseline as well.


title: On a particular scaling for the prototype anisotropic p-Laplacian

abstract: In this brief note we show that under a volume non-preserving scaling it is possible to recover the basics for a regularity theory regarding local weak solutions to a parabolic fully anisotropic equation. We characterize self-similar solutions regarding this particular scaling and we show that semi-continuity for solutions to this equation is a consequence of a simple property that is itself invariant under scaling.


title: Qualitative dynamics of chemical reaction networks: an investigation using partial tropical equilibrations

abstract: We discuss a method to describe the qualitative dynamics of chemical reaction networks in terms of symbolic dynamics. The method, that can be applied to mass-action reaction networks with separated timescales, uses solutions of the partial tropical equilibration problem as proxies for symbolic states. The partial tropical equilibration solutions are found algorithmically. These solutions also provide the scaling needed for slow-fast decomposition and model reduction. Any trace of the model can thus be represented as a sequence of local approximations of the full model. We illustrate the method using as case study a biochemical model of the cell cycle.


title: Model-Free Statistical Inference on High-Dimensional Data

abstract: This paper aims to develop an effective model-free inference procedure for high-dimensional data. We first reformulate the hypothesis testing problem via sufficient dimension reduction framework. With the aid of new reformulation, we propose a new test statistic and show that its asymptotic distribution is $\chi^2$ distribution whose degree of freedom does not depend on the unknown population distribution. We further conduct power analysis under local alternative hypotheses. In addition, we study how to control the false discovery rate of the proposed $\chi^2$ tests, which are correlated, to identify important predictors under a model-free framework. To this end, we propose a multiple testing procedure and establish its theoretical guarantees. Monte Carlo simulation studies are conducted to assess the performance of the proposed tests and an empirical analysis of a real-world data set is used to illustrate the proposed methodology.


title: What is an equivariant neural network?

abstract: We explain equivariant neural networks, a notion underlying breakthroughs in machine learning from deep convolutional neural networks for computer vision to AlphaFold 2 for protein structure prediction, without assuming knowledge of equivariance or neural networks. The basic mathematical ideas are simple but are often obscured by engineering complications that come with practical realizations. We extract and focus on the mathematical aspects, and limit ourselves to a cursory treatment of the engineering issues at the end.


title: Cylinder quantum field theories at small coupling

abstract: We show that any 2D scalar field theory compactified on a cylinder and with a Fourier expandable potential $V$ is equivalent, in the small coupling limit, to a 1D theory involving a massless particle in a potential $V$ and an infinite tower of free massive Kaluza-Klein (KK) modes. Moving slightly away from the deep IR region has the effect of switching on interactions between the zero mode and the KK modes, whose strength is controlled by powers of the coupling, hence making the interactions increasingly suppressed. We take the notable example of Liouville field theory and, starting from its worldline version, we compute the torus (one-loop) partition function perturbatively in the coupling constant. The partition function at leading order is invariant under a T-duality transformation that maps the radius of the cylinder to its inverse and rescales it by the square of the Schwinger parameter of the cylinder. We show that this behavior is a universal feature of cylinder QFTs.


title: Prospects for Dark Matter Search at the Super c-tau Factory

abstract: We present perspectives for searching for light dark matter production mediated by a leptophilic scalar {\phi} and a dark photon A' in in experiments at the Super c-tau Factory. Based on the analysis of the associative production of mediators and {\tau} -leptons at the energies of the future collider, the possibility of searching in the non-excluded region of the parameter space was found. The obtained sensitivity curves at the 90% C.L. for the mediators mass range below 4 GeV demonstrate the power of the SCTF for light dark matter search.


title: Predicting HCN, HCO + , multi-transition CO, and dust emission of star-forming galaxies: Constraining the properties of resolved gas and dust disks of local spiral galaxies

abstract: The ISM is a turbulent, multi-phase, and multi-scale medium following scaling relations. Analytical models of galactic gaseous disks need to take into account the multi-scale and multi-phase nature of the interstellar medium. They can be described as clumpy star-forming accretion disks in vertical hydrostatic equilibrium, with the mid-plane pressure balancing the gravity of the gaseous and stellar disk. ISM turbulence is taken into account by applying Galactic scaling relations to the cold atomic and molecular gas phases. Turbulence is maintained through energy injection by supernovae. With the determination of the gas mass fraction at a given spatial scale, the equilibrium gas temperature between turbulent heating and line cooling, the molecular abundances, and the molecular line emission can be calculated. The resulting model radial profiles of IR, H{\sc i}, CO, HCN, and HCO$^+$ emission are compared to THINGS, HERACLES, EMPIRE, SINGS, and GALEX observations of 17 local spiral galaxies. The Toomre parameter, which measures the stability against star formation (cloud collapse), exceeds unity in the inner disk of a significant number of galaxies. In two galaxies it also exceeds unity in the outer disk. Therefore, in spiral galaxies $Q_{\rm tot}=1$ is not ubiquitous. The model gas velocity dispersion is consistent with the observed H{\sc i} velocity dispersion where available. Within our model HCN and HCO$^+$ is already detectable in relatively low-density gas ($\sim 1000$~cm$^{-3}$). CO and HCN conversion factors and molecular gas depletion time were derived. Both conversion factors are consistent with values found in the literature. Whereas in the massive galaxies the viscous timescale greatly exceeds the star formation timescale, the viscous timescale is smaller than the star formation timescale within $\rm{R}~\sim~2~\rm{R}_{\rm d}$, the disk scale length, in the low-mass galaxies.


title: Particle acceleration in an MHD-scale system of multiple current sheets

abstract: We investigate particle acceleration in an MHD-scale system of multiple current sheets by performing 2D and 3D MHD simulations combined with a test particle simulation. The system is unstable for the tearing-mode instability, and magnetic islands are produced by magnetic reconnection. Due to the interaction of magnetic islands, the system turns into a turbulent state. The 2D (3D) case yields both $-5/3$ ($-11/3$ and $-7/3$) power-law spacetra for magnetic and velocity fluctuations. Particles are efficiently energized by the generated turbulence, and it forms a power-law tail with an index of $-2.2$ and $-4.2$ in the energy distribution function for the 2D and 3D case, respectively. We find more energetic particles outside magnetic islands rather than inside. We observe super-diffusion in the 2D ($\sim t^{2.27}$) and 3D ($\sim t^{1.2}$) case in the energy space of energetic particles.


title: Surface plasmon-phonon-magnon polariton in a topological insulator-antiferromagnetic bilayer structure

abstract: We present a robust technique for computationally studying surface polariton modes in hybrid materials. We use a semi-classical model that allows us to understand the physics behind the interactions between collective excitations of the hybrid system and develop a scattering and transfer matrix method that imposes the proper boundary conditions to solve Maxwell equations and derive a general equation describing the surface polariton in a heterostructure consisting of N constituent materials. We apply this method to a test structure composed of a topological insulator (TI) and an antiferromagnetic material (AFM) to study the resulting surface Dirac plasmon-phonon-magnon polariton (DPPMP). We find that interactions between the excitations of the two constituents result in the formation of hybridized modes and the emergence of avoided-crossing points in the dispersion relations for the DPPMP. For the specific case of a Bi2Se3 TI material, the polariton branch with low frequency below 2 THz redshifts upon increasing the thickness of TI thin film, which leads to an upper bound on the thickness of the TI layer that will allow an observable signature of strong coupling and the emergence of hybridized states. We also find that the strength of the coupling between the TI and the AFM, which is parameterized by the amplitude of the avoided-crossing splitting between the two polariton branches at the magnon resonance frequency, depends on the magnitude of the magnetic dipole and the line width of the magnon in the AFM material as well as on the Fermi energy of Dirac plasmon in the TI. Finally, we predict that materials with extremely high quality, i.e. low scattering loss rate, are essential to achieve an experimentally-observable strong coupling between a TI and AFM.


title: High-Resolution CMB Lensing Reconstruction with Deep Learning

abstract: Next-generation cosmic microwave background (CMB) surveys are expected to provide valuable information about the primordial universe by creating maps of the mass along the line of sight. Traditional tools for creating these lensing convergence maps include the quadratic estimator and the maximum likelihood based iterative estimator. Here, we apply a generative adversarial network (GAN) to reconstruct the lensing convergence field. We compare our results with a previous deep learning approach -- Residual-UNet -- and discuss the pros and cons of each. In the process, we use training sets generated by a variety of power spectra, rather than the one used in testing the methods.


title: Understanding Emergent Behaviours in Multi-Agent Systems with Evolutionary Game Theory

abstract: The mechanisms of emergence and evolution of collective behaviours in dynamical Multi-Agent Systems (MAS) of multiple interacting agents, with diverse behavioral strategies in co-presence, have been undergoing mathematical study via Evolutionary Game Theory (EGT). Their systematic study also resorts to agent-based modelling and simulation (ABM) techniques, thus enabling the study of aforesaid mechanisms under a variety of conditions, parameters, and alternative virtual games. This paper summarises some main research directions and challenges tackled in our group, using methods from EGT and ABM. These range from the introduction of cognitive and emotional mechanisms into agents' implementation in an evolving MAS, to the cost-efficient interference for promoting prosocial behaviours in complex networks, to the regulation and governance of AI safety development ecology, and to the equilibrium analysis of random evolutionary multi-player games. This brief aims to sensitize the reader to EGT based issues, results and prospects, which are accruing in importance for the modeling of minds with machines and the engineering of prosocial behaviours in dynamical MAS, with impact on our understanding of the emergence and stability of collective behaviours. In all cases, important open problems in MAS research as viewed or prioritised by the group are described.


title: On the vortex dynamics of synthetic jet -- turbulent boundary layer interactions

abstract: The vortex dynamics resulting from the interaction of synthetic jets with turbulent boundary layers was investigated experimentally using stereoscopic particle image velocimetry (SPIV). Three aspect ratio 18 rectangular orifice geometries were tested including spanwise and streamwise-oriented orifices issuing normal to the wall and a spanwise-oriented orifice pitched $45^\circ$ downstream. Additionally, three actuation conditions were tested to explore the impact of varying blowing ratio and Strouhal number. SPIV data obtained on an array of measurement planes was used to reconstruct the three-dimensional mean and phase-locked velocity fields, enabling detailed analysis of the formation and development of the vortices. The variations in the orifice geometry and the flow conditions produced a range of vortex structures including distorted vortex rings, hairpin vortices, and arch-shaped vortices. The jets from wall-normal orifices were dominated by vortices that rotated in the same direction as the boundary layer vorticity which enhanced the near-wall flow velocity by increasing mixing. Conversely, the dominant structures in the pitched jets rotated counter to the boundary layer vorticity, and these jets enhanced the flow velocity near the wall through direct momentum addition. Flow field analysis revealed that the synthetic jet-boundary layer interaction caused pitched jets operated at low blowing ratios to produce dominant vortices which were much weaker than those generated by wall-normal jets at the same conditions. Finally, at the lowest Strouhal number tested the increased spacing between the vortices in the wall-normal jets resulted in much higher unsteady mixing than was observed at higher Strouhal numbers.


title: Truncations of random unitary matrices drawn from Hua-Pickrell distribution

abstract: Let $U$ be a random unitary matrix drawn from the Hua-Pickrell distribution $\mu_{\mathrm{U}(n+m)}^{(\delta)}$ on the unitary group $\mathrm{U}(n+m)$. We show that the eigenvalues of the truncated unitary matrix $[U_{i,j}]_{1\leq i,j\leq n}$ form a determinantal point process $\mathscr{X}_n^{(m,\delta)}$ on the unit disc $\mathbb{D}$ for any $\delta\in\mathbb{C}$ satisfying $\mathrm{Re}\,\delta>-1/2$. We also prove that the limiting point process taken by $n\to\infty$ of the determinantal point process $\mathscr{X}_n^{(m,\delta)}$ is always $\mathscr{X}^{[m]}$, independent of $\delta$. Here $\mathscr{X}^{[m]}$ is the determinantal point process on $\mathbb{D}$ with weighted Bergman kernel \begin{equation*} \begin{split} K^{[m]}(z,w)=\frac{1}{(1-z\overline w)^{m+1}} \end{split} \end{equation*} with respect to the reference measure $d\mu^{[m]}(z)=\frac{m}{\pi}(1-|z|)^{m-1}d\sigma(z)$, where $d\sigma(z)$ is the Lebesgue measure on $\mathbb{D}$.


title: Effect of Batch Normalization on Noise Resistant Property of Deep Learning Models

abstract: The fast execution speed and energy efficiency of analog hardware has made them a strong contender for deployment of deep learning model at the edge. However, there are concerns about the presence of analog noise which causes changes to the weight of the models, leading to performance degradation of deep learning model, despite their inherent noise resistant characteristics. The effect of the popular batch normalization layer on the noise resistant ability of deep learning model is investigated in this work. This systematic study has been carried out by first training different models with and without batch normalization layer on CIFAR10 and CIFAR100 dataset. The weights of the resulting models are then injected with analog noise and the performance of the models on the test dataset is obtained and compared. The results show that the presence of batch normalization layer negatively impacts noise resistant property of deep learning model and the impact grows with the increase of the number of batch normalization layers.


title: Block Copolymer Double Diamond Twin

abstract: A twin boundary (TB) is a common low energy planar defect in crystals including those with the atomic diamond structure (C, Si, Ge, etc.). We study twins in a self-assembled soft matter block copolymer (BCP) supramolecular crystal having the double diamond (DD) structure, consisting of 2 translationally shifted, interpenetrating diamond networks of the minority polydimethyl siloxane block embedded in a polystyrene block matrix. The coherent, low energy, mirror-symmetric double tubular network twin has one minority block network with its nodes offset from the (222) TB plane while nodes of the second network lie in the plane of the boundary. The offset network, although at a scale about a factor of 103 larger, has precisely the same geometry and symmetry as a (111) twin in atomic single diamond where the tetrahedral units spanning the TB retain nearly the same strut (bond) lengths and strut (bond) angles as in the normal unit cell. In the DD, the second minority block network undergoes a dramatic restructuring - the tetrahedral nodes transform into 2 new types of mirror-symmetric nodes (pentahedral and trihedral) which alternate and link to form a hexagonal mesh in the plane of the TB. The collective re-organization of the supramolecular packing highlights the hierarchical structure of ordered BCP phases and emphasizes the remarkable malleability of soft matter.


title: Finite inflation in curved space

abstract: We investigate the effects of non-zero spatial curvature on cosmic inflation in the light of cosmic microwave background (CMB) anisotropy measurements from the Planck 2018 legacy release and from the 2015 observing season of BICEP2 and the Keck Array. Even a small percentage of non-zero curvature today would significantly limit the total number of e-folds of the scale factor during inflation, rendering just-enough inflation scenarios with a kinetically dominated or fast-roll stage prior to slow-roll inflation more likely. Finite inflation leads to oscillations and a cutoff towards large scales in the primordial power spectrum and curvature pushes them into the CMB observable window. Using nested sampling, we carry out Bayesian parameter estimations and model comparisons taking into account constraints from reheating and horizon considerations. We confirm the preference of CMB data for closed universes with Bayesian odds of over $100:1$ and with a posterior on the curvature density parameter of $\Omega_{K,0}=-0.051\pm0.017$ for a curvature extension of LCDM and $\Omega_{K,0}=-0.031\pm0.014$ for Starobinsky inflation. Model comparisons of various inflation models give similar results as for flat universes with the Starobinsky model outperforming most other models.


title: Chetaev Instability Framework for Kinetostatic Compliance-Based Protein Unfolding

abstract: Understanding the process of protein unfolding plays a crucial role in various applications such as design of folding-based protein engines. Using the well-established kinetostatic compliance (KCM)-based method for modeling of protein conformation dynamics and a recent nonlinear control theoretic approach to KCM-based protein folding, this paper formulates protein unfolding as a destabilizing control analysis/synthesis problem. In light of this formulation, it is shown that the Chetaev instability framework can be used to investigate the KCM-based unfolding dynamics. In particular, a Chetaev function for analysis of unfolding dynamics under the effect of optical tweezers and a class of control Chetaev functions for synthesizing control inputs that elongate protein strands from their folded conformations are presented. Based on the presented control Chetaev function, an unfolding input is derived from the Artstein-Sontag universal formula and the results are compared against optical tweezer-based unfolding.


title: On Yang-Mills Stability Bounds and Plaquette Field Generating Function

abstract: We consider the Yang-Mills (YM) QFT with group $U(N)$. We take a finite lattice regularization $\Lambda\subset a\mathbb Z^d$, $d = 2,3,4$, with $a\in (0,1]$ and $L$ (even) sites on a side. Each bond has a gauge variable $U\in U(N)$. The Wilson partition function is used and the action is a sum of gauge-invariant plaquette (minimal square) actions times $a^{d-4}/g^2$, $g^2\in(0,g_0^2]$, $0<g_0^2<\infty$. A plaquette action has the product of its four variables and the partition function is the integral of the Boltzmann factor with a product of $U(N)$ Haar measures. Formally, when $a\searrow 0$ our action gives the usual YM continuum action. For free and periodic b.c., we show thermodynamic and stability bounds for a normalized partition function of any YM model defined as before, with bound constants independent of $L,a,g$. The subsequential thermodynamic and ultraviolet limit of the free energy exist. To get our bounds, the Weyl integration formula is used and, to obtain the lower bound, a new quadratic global upper bound on the action is derived. We define gauge-invariant physical and scaled plaquette fields. Using periodic b.c. and the multi-reflection method, we bound the generating function of $r-$scaled plaquette correlations. A normalized generating function for the correlations of $r$ scaled fields is absolutely bounded, for any $L,a,g$, and location of the external fields. From the joint analyticity on the field sources, correlations are bounded. The bounds are new and we get $a^{-d}$ for the physical two-plaquette correlation at coincident points. Comparing with the $a\searrow 0$ singularity of the physical derivative massless scalar free field two-point correlation, this is a measure of ultraviolet asymptotic freedom in the context of a lattice QFT. Our methods are an alternative and complete the more traditional ones.


title: The Splendors and Miseries of Heavisidisation

abstract: Machine Learning (ML) is applicable to scientific problems, i.e. to those which have a well defined answer, only if this answer can be brought to a peculiar form ${\cal G}: X\longrightarrow Z$ with ${\cal G}(\vec x)$ expressed as a combination of iterated Heaviside functions. At present it is far from obvious, if and when such representations exist, what are the obstacles and, if they are absent, what are the ways to convert the known formulas into this form. This gives rise to a program of reformulation of ordinary science in such terms -- which sounds like a strong enhancement of the constructive mathematics approach, only this time it concerns all natural sciences. We describe the first steps on this long way.


title: Proximal MCMC for Bayesian Inference of Constrained and Regularized Estimation

abstract: This paper advocates proximal Markov Chain Monte Carlo (ProxMCMC) as a flexible and general Bayesian inference framework for constrained or regularized estimation. Originally introduced in the Bayesian imaging literature, ProxMCMC employs the Moreau-Yosida envelope for a smooth approximation of the total-variation regularization term, fixes variance and regularization strength parameters as constants, and uses the Langevin algorithm for the posterior sampling. We extend ProxMCMC to be fully Bayesian by providing data-adaptive estimation of all parameters including the regularization strength parameter. More powerful sampling algorithms such as Hamiltonian Monte Carlo are employed to scale ProxMCMC to high-dimensional problems. Analogous to the proximal algorithms in optimization, ProxMCMC offers a versatile and modularized procedure for conducting statistical inference on constrained and regularized problems. The power of ProxMCMC is illustrated on various statistical estimation and machine learning tasks, the inference of which is traditionally considered difficult from both frequentist and Bayesian perspectives.


title: Description of seismic sources in underground mines: Dynamic stress fracturing around tunnels and strainbursting

abstract: This paper considers dynamic fracturing of the rockmass surrounding a tunnel statically loaded by compressional stress as a possible source of seismic events in underground mines. This begins with two-dimensional dynamic modelling of failure for six plausible scenarios. In each case, the seismic source derived from these models has significant negative isotropic and negative compensated linear vector dipole components as well as a P-axis approximately aligned with the direction of maximum compressional principal stress. These features indicate that at wavelengths larger than the diameter of the tunnel and the extent of damage along it, seismic radiation is controlled by the elastic convergence of the surrounding rockmass rather than by rock fracturing. An analytical approximation of the source mechanism is suggested that is based solely on mechanical and geometric properties: the magnitudes $\sigma_{\mathrm{max}}$ and $\sigma_{\mathrm{min}}$ of the maximum and minimum principal stresses orthogonal to the tunnel's axis, the Poisson's ratio $\nu$ of the rockmass, the length $L_{3}$ of dynamic fracturing along the tunnel, the effective tunnel dimension $\bar{L_{A}}$, and the increase in depth of failure $\triangle d_{f}^{A}$ in the direction of $\sigma_{\mathrm{min}}$. Furthermore, it is shown that the scalar seismic moment can be approximated as $|\mathbf{M}|\approx2[(1-\nu)/(1-2\nu)]|\sigma_{max}|L_{3}\bar{L_{A}}\triangle d_{f}^{A}$. The suggested approximations are considered in the context of seismic data from a real underground mine. It is shown that many mechanisms inverted from observed waveforms are consistent with the suggested model and that the proposed source mechanism approximation can be used for the forensic analysis of damaging seismic events and quantitative monitoring of the evolution of fractured zones around tunnels.


title: Locating the Closest Singularity in a Polynomial Homotopy

abstract: A polynomial homotopy is a family of polynomial systems, where the systems in the family depend on one parameter. If for one value of the parameter we know a regular solution, then what is the nearest value of the parameter for which the solution in the polynomial homotopy is singular? For this problem we apply the ratio theorem of Fabry. Richardson extrapolation is effective to accelerate the convergence of the ratios of the coefficients of the series expansions of the solution paths defined by the homotopy. For numerical stability, we recondition the homotopy. To compute the coefficients of the series we propose the quaternion Fourier transform. We locate the closest singularity computing at a regular solution, avoiding numerical difficulties near a singularity.


title: SeqZero: Few-shot Compositional Semantic Parsing with Sequential Prompts and Zero-shot Models

abstract: Recent research showed promising results on combining pretrained language models (LMs) with canonical utterance for few-shot semantic parsing. The canonical utterance is often lengthy and complex due to the compositional structure of formal languages. Learning to generate such canonical utterance requires significant amount of data to reach high performance. Fine-tuning with only few-shot samples, the LMs can easily forget pretrained knowledge, overfit spurious biases, and suffer from compositionally out-of-distribution generalization errors. To tackle these issues, we propose a novel few-shot semantic parsing method -- SeqZero. SeqZero decomposes the problem into a sequence of sub-problems, which correspond to the sub-clauses of the formal language. Based on the decomposition, the LMs only need to generate short answers using prompts for predicting sub-clauses. Thus, SeqZero avoids generating a long canonical utterance at once. Moreover, SeqZero employs not only a few-shot model but also a zero-shot model to alleviate the overfitting. In particular, SeqZero brings out the merits from both models via ensemble equipped with our proposed constrained rescaling. SeqZero achieves SOTA performance of BART-based models on GeoQuery and EcommerceQuery, which are two few-shot datasets with compositional data split.


title: JT Gravity Coupled to Fermions

abstract: We argue that two-dimensional dilaton gravity models can all be derived from an analog of Jacobson's covariant version of the first law of thermodynamics. We then specialize to the JT gravity model and couple it to massless fermions. This model is exactly soluble in quantum field theory, and we present a new derivation of that result. The field theory model violates two principles one might want to impose on a quantum theory of gravity describing the near horizon region of an extremal charged black hole in four dimensions: finiteness of the entropy for finite causal diamonds, and the absence of global conservation laws. It preserves an infinite number of conservation laws that one would have expected to be violated, since the fermion state on each side of the $AdS_2$ wormhole is unavoidably thermal. We describe a cutoff version of the model, with extra interactions, which cures these difficulties. Our UV completion of the model depends on the AKK map of non-relativistic fermions in an inverted oscillator potential to Weyl fermions in Minkowski space. We argue that gauging the $Z_2$ symmetry of the oscillator model, using a density matrix with temperature that depends on the oscillator coordinates, and inserting chaotic interactions at (almost) infinite oscillator coordinate, we obtain a model with properties expected of quantum gravity in the near horizon region of an extremal charged black hole in four dimensions.


title: Isogeny complexes of superspecial abelian varieties

abstract: We consider the structures formed by isogenies of abelian varieties with polarizations that are not necessarily principal, specifically with the $[\ell]$-polarizations we have previously defined. Our primary interest is in superspecial abelian varieties, where the isogenies are related to quaternionic hermitian forms. We first consider isogeny graphs. We show that these $[\ell]$-isogeny graphs are a generalized Brandt graph and construct them entirely in terms of definite quaternion algebras. We prove that they are connected and give examples to show that the regular graphs obtained are sometimes Ramanujan and sometimes not. Isogenies of $[\ell]$-polarized abelian varieties can be closed under composition, with the consequence that such isogenies naturally form semi-simplicial complexes as introduced by Eilenberg and Zilber in 1950 (later also called $\Delta$-complexes) -- the higher-dimensional analogues of multigraphs. We show that these isogeny complexes can be constructed from the arithmetic of hermitian forms over definite quaternion algebras and that they are quotients of the Bruhat-Tits building of the symplectic group by the action of a quaternionic unitary group. Working with quaternions these isogeny graphs and complexes are amenable to machine computation and we include many examples, concluding with a detailed examination of the $[2]$-isogeny complexes of superspecial abelian surfaces in characteristic $7$.


title: Incorporating Prior Knowledge into Neural Networks through an Implicit Composite Kernel

abstract: It is challenging to guide neural network (NN) learning with prior knowledge. In contrast, many known properties, such as spatial smoothness or seasonality, are straightforward to model by choosing an appropriate kernel in a Gaussian process (GP). Many deep learning applications could be enhanced by modeling such known properties. For example, convolutional neural networks (CNNs) are frequently used in remote sensing, which is subject to strong seasonal effects. We propose to blend the strengths of deep learning and the clear modeling capabilities of GPs by using a composite kernel that combines a kernel implicitly defined by a neural network with a second kernel function chosen to model known properties (e.g., seasonality). We implement this idea by combining a deep network and an efficient mapping based on the Nystrom approximation, which we call Implicit Composite Kernel (ICK). We then adopt a sample-then-optimize approach to approximate the full GP posterior distribution. We demonstrate that ICK has superior performance and flexibility on both synthetic and real-world data sets. We believe that ICK framework can be used to include prior information into neural networks in many applications.


title: Market Impact: Empirical Evidence, Theory and Practice

abstract: We propose a theory of the market impact of metaorders based on a coarse-grained approach where the microscopic details of supply and demand is replaced by a single parameter $\rho \in [0,+\infty]$ shaping the supply-demand equilibrium and the market impact process during the execution of the metaorder. Our model provides an unified explanation of most of the empirical observations that have been reported and establishes a strong connection between the excess volatility puzzle and the order-driven view of the markets through the square-root law.


title: Bound states in the continuum (BIC) protected by self-sustained potential barriers in a flat band system

abstract: In this work, we investigate the bound states in the continuum (BIC) of a one-dimensional spin-1 flat band system. It is found that, when the potential is sufficiently strong, there exists an effective attractive potential well surrounded by infinitely high self-sustained barriers. Consequently, there exist some BIC in the effective potential well. These bound states are protected by the infinitely high potential barriers, which could not decay into the continuum.} Taking a long-ranged Coulomb potential and a short-ranged exponential potential as two examples, the bound state energies are obtained. For a Coulomb potential, there exists a series of critical potential strengths, near which the bound state energy can go to infinity. For a sufficiently strong exponential potential, there exists two different bound states with a same number of wave function nodes. The existence of BIC protected by the self-sustained potential barriers is quite a universal phenomenon in the flat band system under a strong potential. A necessary condition for the existence of BIC is that the maximum value of potential is larger than two times band gap.


title: Downstream Transformer Generation of Question-Answer Pairs with Preprocessing and Postprocessing Pipelines

abstract: We present a system called TP3 to perform a downstream task of transformers on generating question-answer pairs (QAPs) from a given article. TP3 first finetunes pretrained transformers on QAP datasets, then uses a preprocessing pipeline to select appropriate answers, feeds the relevant sentences and the answer to the finetuned transformer to generate candidate QAPs, and finally uses a postprocessing pipeline to filter inadequate QAPs. In particular, using pretrained T5 models as transformers and the SQuAD dataset as the finetruning dataset, we show that TP3 generates satisfactory number of QAPs with high qualities on the Gaokao-EN dataset.


title: Inference with Imputed Data: The Allure of Making Stuff Up

abstract: Incomplete observability of data generates an identification problem. There is no panacea for missing data. What one can learn about a population parameter depends on the assumptions one finds credible to maintain. The credibility of assumptions varies with the empirical setting. No specific assumptions can provide a realistic general solution to the problem of inference with missing data. Yet Rubin has promoted random multiple imputation (RMI) as a general way to deal with missing values in public-use data. This recommendation has been influential to empirical researchers who seek a simple fix to the nuisance of missing data. This paper adds to my earlier critiques of imputation. It provides a transparent assessment of the mix of Bayesian and frequentist thinking used by Rubin to argue for RMI. It evaluates random imputation to replace missing outcome or covariate data when the objective is to learn a conditional expectation. It considers steps that might help combat the allure of making stuff up.


title: Superfluid density and collective modes of fermion superfluid in dice lattice

abstract: The superfluid properties of attractive Hubbard model in dice lattice are investigated. It is found that three superfluid order parameters increase as the interaction increases. When the filling factor falls into the flat band, due to the infinite large density of states, the resultant superfluid order parameters are proportional to interaction strength, which is in striking contrast with the exponentially small counterparts in usual superfluid (or superconductor). When the interaction is weak, and the filling factor is near the bottom of the lowest band (or the top of highest band), the superfluid density is determined by the effective mass of the lowest (or highest) single-particle band. When the interaction is strong and filling factor is small, the superfluid density is inversely proportional to interaction strength, which is related to effective mass of tightly bound pairs. In the strong interaction limit and finite filling, the asymptotic behaviors of superfluid density can be captured by a parabolic function of filling factor. Furthermore, when the filling is in flat band, the superfluid density shows a logarithmic singularity as the interaction approaches zero. In addition, there exist three undamped collective modes for strong interactions. The lowest excitation is gapless phonon, which is characterized by the total density oscillations. The two others are gapped Leggett modes, which correspond relative density fluctuations between sublattices. The collective modes are also reflected in the two-particle spectral functions by sharp peaks. Furthermore, it is found that the two-particle spectral functions satisfy an exact sum-rule, which is directly related to the filling factor (or density of particle). The sum-rule of the spectral functions may be useful to distinguish between the hole-doped and particle-doped superfluid (superconductor) in experiments.


title: Learning Representations for New Sound Classes With Continual Self-Supervised Learning

abstract: In this paper, we work on a sound recognition system that continually incorporates new sound classes. Our main goal is to develop a framework where the model can be updated without relying on labeled data. For this purpose, we propose adopting representation learning, where an encoder is trained using unlabeled data. This learning framework enables the study and implementation of a practically relevant use case where only a small amount of the labels is available in a continual learning context. We also make the empirical observation that a similarity-based representation learning method within this framework is robust to forgetting even if no explicit mechanism against forgetting is employed. We show that this approach obtains similar performance compared to several distillation-based continual learning methods when employed on self-supervised representation learning methods.


title: Nonuniform $\mu$-dichotomy spectrum and kinematic similarity

abstract: For linear nonautonomous differential equations we introduce a new family of spectrums defined with general nonuniform dichotomies: for a given growth rate $\mu$ in a large family of growth rates, we consider a notion of spectrum, named nonuniform $\mu$-dichotomy spectrum. This family of spectrums contain the nonuniform dichotomy spectrum as the very particular case of exponential growth rates. For each growth rate $\mu$, we describe all possible forms of the nonuniform $\mu$-dichotomy spectrum, relate its connected components with adapted notions of Lyapunov exponents, and use it to obtain a reducibility result for nonautonomous linear differential equations. We also give an illustrative examples where the spectrum is obtained, including a situation where a normal form is obtained for polynomial behavior.


title: Saturation for Small Antichains

abstract: For a given positive integer $k$ we say that a family of subsets of $[n]$ is $k$-antichain saturated if it does not contain $k$ pairwise incomparable sets, but whenever we add to it a new set, we do find $k$ such sets. The size of the smallest such family is denoted by $\text{sat}^*(n, \mathcal A_{k})$. Ferrara, Kay, Kramer, Martin, Reiniger, Smith and Sullivan conjectured that $\text{sat}^*(n, \mathcal A_{k})=(k-1)n(1+o(1))$, and proved this for $k\leq 4$. In this paper we prove this conjecture for $k=5$ and $k=6$. Moreover, we give the exact value for $\text{sat}^*(n, \mathcal A_5)$ and $\text{sat}^*(n, \mathcal A_6)$. We also give some open problems inspired by our analysis.


title: Higher order time discretization for the stochastic semilinear wave equation with multiplicative noise

abstract: In this paper, a higher-order time-discretization scheme is proposed, where the iterates approximate the solution of the stochastic semilinear wave equation driven by multiplicative noise with general drift and diffusion. We employ a variational method for its error analysis and prove an improved convergence order of 3/2 for the approximates of the solution. The core of the analysis is Holder continuity in time and moment bounds for the solutions of the continuous and the discrete problem. Computational experiments are also presented.


title: Sibyl: Adaptive and Extensible Data Placement in Hybrid Storage Systems Using Online Reinforcement Learning

abstract: Hybrid storage systems (HSS) use multiple different storage devices to provide high and scalable storage capacity at high performance. Recent research proposes various techniques that aim to accurately identify performance-critical data to place it in a "best-fit" storage device. Unfortunately, most of these techniques are rigid, which (1) limits their adaptivity to perform well for a wide range of workloads and storage device configurations, and (2) makes it difficult for designers to extend these techniques to different storage system configurations (e.g., with a different number or different types of storage devices) than the configuration they are designed for. We introduce Sibyl, the first technique that uses reinforcement learning for data placement in hybrid storage systems. Sibyl observes different features of the running workload as well as the storage devices to make system-aware data placement decisions. For every decision it makes, Sibyl receives a reward from the system that it uses to evaluate the long-term performance impact of its decision and continuously optimizes its data placement policy online. We implement Sibyl on real systems with various HSS configurations. Our results show that Sibyl provides 21.6%/19.9% performance improvement in a performance-oriented/cost-oriented HSS configuration compared to the best previous data placement technique. Our evaluation using an HSS configuration with three different storage devices shows that Sibyl outperforms the state-of-the-art data placement policy by 23.9%-48.2%, while significantly reducing the system architect's burden in designing a data placement mechanism that can simultaneously incorporate three storage devices. We show that Sibyl achieves 80% of the performance of an oracle policy that has complete knowledge of future access patterns while incurring a very modest storage overhead of only 124.4 KiB.


title: Sociotechnical Specification for the Broader Impacts of Autonomous Vehicles

abstract: Autonomous Vehicles (AVs) will have a transformative impact on society. Beyond the local safety and efficiency of individual vehicles, these effects will also change how people interact with the entire transportation system. This will generate a diverse range of large and foreseeable effects on social outcomes, as well as how those outcomes are distributed. However, the ability to control both the individual behavior of AVs and the overall flow of traffic also provides new affordances that permit AVs to control these effects. This comprises a problem of sociotechnical specification: the need to distinguish which essential features of the transportation system are in or out of scope for AV development. We present this problem space in terms of technical, sociotechnical, and social problems, and illustrate examples of each for the transport system components of social mobility, public infrastructure, and environmental impacts. The resulting research methodology sketches a path for developers to incorporate and evaluate more transportation system features within AV system components over time.


title: Strictly positive definite non-isotropic kernels on two-point homogeneous manifolds: The asymptotic approach

abstract: We present sufficient condition for a family of positive definite kernels on a compact two-point homogeneous space to be strictly positive definite based on their representation as a series of spherical harmonics. The family analyzed is a generalization of the isotropic kernels and the case of a real sphere is analyzed in details.


title: Topological Superconductivity in Sn/Si(111) driven by non-local Coulomb interactions

abstract: Superconductivity was recently observed in boron-doped ($\sqrt{3}\times\sqrt{3}$)Sn/Si(111). The material can be described by an extended Hubbard model on a triangular lattice. Here, we use the random-phase approximation to investigate the charge and spin fluctuations as well as the superconducting properties of the system with respect to filling and the relative strength of the extended versus the on-site Hubbard interactions. Our calculations reveal that near half-filling and weak extended Hubbard interactions, the superconducting ground state exhibits chiral $d$-wave pairing. Far from half-filling and for stronger nearest-neighbor Coulomb interactions, the system shows chiral $p$-wave (hole-doping) and $f$-wave (electron-doping) pairings. The dependence of the pairing symmetry on the extended Hubbard interactions suggests that charge fluctuations play an important role in the formation of Cooper pairs. Finally, the temperature dependence of the Knight shift is calculated for all observed superconducting textures and put forward as an experimental method to examine the symmetry of the superconducting gap function.


title: Two Equivalent Families of Linear Fully Coupled Forward Backward Stochastic Differential Equations

abstract: In this paper, we investigate two families of fully coupled linear Forward-Backward Stochastic Differential Equations (FBSDE). Within these families, one could get the same well-posedness of FBSDEs with totally different structures. The first family of FBSDEs are proved to be equivalent with respect to the Unified Approach. Thus one could get the well-posedness of the whole family if one member exists a unique solution. Another equivalent family of FBSDEs are investigated by introducing a linear transformation method. By reason of the fully coupling structure between the forward and backward equations, it leads to a highly interdependence in solutions. We are able to lower the coupling of FBSDEs, by virtue of the idea of transformation, without losing the well-posedness. Moreover, owing to the non-degeneracy of the transformation matrix, the solution to original FBSDE is totally determined by solutions of FBSDE after transformation. In addition, an example of optimal Linear Quadratic (LQ) problem is presented to illustrate.


title: SuperWarp: Supervised Learning and Warping on U-Net for Invariant Subvoxel-Precise Registration

abstract: In recent years, learning-based image registration methods have gradually moved away from direct supervision with target warps to instead use self-supervision, with excellent results in several registration benchmarks. These approaches utilize a loss function that penalizes the intensity differences between the fixed and moving images, along with a suitable regularizer on the deformation. In this paper, we argue that the relative failure of supervised registration approaches can in part be blamed on the use of regular U-Nets, which are jointly tasked with feature extraction, feature matching, and estimation of deformation. We introduce one simple but crucial modification to the U-Net that disentangles feature extraction and matching from deformation prediction, allowing the U-Net to warp the features, across levels, as the deformation field is evolved. With this modification, direct supervision using target warps begins to outperform self-supervision approaches that require segmentations, presenting new directions for registration when images do not have segmentations. We hope that our findings in this preliminary workshop paper will re-ignite research interest in supervised image registration techniques. Our code is publicly available from https://github.com/balbasty/superwarp.


title: Reformulating the Value Restriction and the Not-Strict Value Restriction in Terms of Possibility Preference Map

abstract: In social choice theory, Sen's value restriction and Pattanaik's not-strict value restriction are both attractive conditions for testing social preference transitivity and/or non-empty social choice set existence. This article introduces a novel mathematical representation tool, called possibility preference map (PPM), for weak orderings, and then reformulates the value restriction and the not-strict value restriction in terms of PPM. The reformulations all appear elegant since they take the form of minmax.


title: Statistical Modeling and Forecasting of Automatic Generation Control Signals

abstract: The performance of frequency regulating units for automatic generation control (AGC) of power systems depends on their ability to track the AGC signal accurately. In addition, representative models and advanced analysis and analytics can yield forecasts of the AGC signal that aids in controller design. In this paper, time-series analyses are conducted on an AGC signal, specifically the PJM Reg-D, and using the results, a statistical model is derived that fairly accurately captures its second moments and saturated nature, as well as a time-series-based predictive model to provide forecasts. As an application, the predictive model is used in a model predictive control framework to ensure optimal tracking performance of a down ramp-limited distributed energy resource coordination scheme. The results provide valuable insight into the properties of the AGC signal and indicate the effectiveness of these models in replicating its behavior.


title: Physics-inspired Ising Computing with Ring Oscillator Activated p-bits

abstract: The nearing end of Moore's Law has been driving the development of domain-specific hardware tailored to solve a special set of problems. Along these lines, probabilistic computing with inherently stochastic building blocks (p-bits) have shown significant promise, particularly in the context of hard optimization and statistical sampling problems. p-bits have been proposed and demonstrated in different hardware substrates ranging from small-scale stochastic magnetic tunnel junctions (sMTJs) in asynchronous architectures to large-scale CMOS in synchronous architectures. Here, we design and implement a truly asynchronous and medium-scale p-computer (with $\approx$ 800 p-bits) that closely emulates the asynchronous dynamics of sMTJs in Field Programmable Gate Arrays (FPGAs). Using hard instances of the planted Ising glass problem on the Chimera lattice, we evaluate the performance of the asynchronous architecture against an ideal, synchronous design that performs parallelized (chromatic) exact Gibbs sampling. We find that despite the lack of any careful synchronization, the asynchronous design achieves parallelism with comparable algorithmic scaling in the ideal, carefully tuned and parallelized synchronous design. Our results highlight the promise of massively scaled p-computers with millions of free-running p-bits made out of nanoscale building blocks such as stochastic magnetic tunnel junctions.


title: PillarNet: Real-Time and High-Performance Pillar-based 3D Object Detection

abstract: Real-time and high-performance 3D object detection is of critical importance for autonomous driving. Recent top-performing 3D object detectors mainly rely on point-based or 3D voxel-based convolutions, which are both computationally inefficient for onboard deployment. In contrast, pillar-based methods use solely 2D convolutions, which consume less computation resources, but they lag far behind their voxel-based counterparts in detection accuracy. In this paper, by examining the primary performance gap between pillar- and voxel-based detectors, we develop a real-time and high-performance pillar-based detector, dubbed PillarNet.The proposed PillarNet consists of a powerful encoder network for effective pillar feature learning, a neck network for spatial-semantic feature fusion and the commonly used detect head. Using only 2D convolutions, PillarNet is flexible to an optional pillar size and compatible with classical 2D CNN backbones, such as VGGNet and ResNet. Additionally, PillarNet benefits from our designed orientation-decoupled IoU regression loss along with the IoU-aware prediction branch. Extensive experimental results on the large-scale nuScenes Dataset and Waymo Open Dataset demonstrate that the proposed PillarNet performs well over state-of-the-art 3D detectors in terms of effectiveness and efficiency. Code is available at \url{https://github.com/agent-sgs/PillarNet}.