title: Modelling, Analysis, Observability and Identifiability of Epidemic Dynamics with Reinfections

abstract: We consider in this paper a general SEIRS model describing the dynamics of an infectious disease including latency, waning immunity and infection-induced mortality. We derive an infinite system of differential equations that provides an image of the same infection process, but counting also the reinfections. Existence and uniqueness of the corresponding Cauchy problem is established in a suitable space of sequence valued functions, and the asymptotic behavior of the solutions is characterized, according to the value of the basic reproduction number. This allows to determine several mean numbers of reinfections related to the population at endemic equilibrium. We then show how using jointly measurement of the number of infected individuals and of the number of primo-infected provides observability and identifiability to a simple SIS model for which none of these two measures is sufficient to ensure on its own the same properties.


title: Ergodicity of supercritical SDEs driven by $\alpha$-stable processes and heavy-tailed sampling

abstract: Let $\alpha\in(0,2)$ and $d\in\mathbb{N}$. Consider the following stochastic differential equation (SDE) driven by $\alpha$-stable process in $\mathbb{R}^d$: $$ dX_t=b(X_t)dt+\sigma(X_{t-})d L^{\alpha}_t, \quad X_0=x\in\mathbb{R}^d, $$ where $b:\mathbb{R}^d\to\mathbb{R}^d$ and $\sigma:\mathbb{R}^d\to\mathbb{R}^d\otimes\mathbb{R}^d$ are locally $\gamma$-H\"older continuous with $\gamma\in(0\vee(1-\alpha)^+,1]$, $L^\alpha_t$ is a $d$-dimensional rotationally invariant $\alpha$-stable process. Under some dissipative and non-degenerate assumptions on $b,\sigma$, we show the $V$-uniformly exponential ergodicity for the semigroup $P_t$ associated with $(X_t(x),t\geq 0)$. Our proofs are mainly based on the heat kernel estimates recently established in \cite{MZ20} through showing the strong Feller property and the irreducibility of $P_t$. It is interesting that when $\alpha$ goes to zero, the diffusion coefficient $\sigma$ can grow faster than drift $b$. As applications, we put forward a new heavy-tailed sampling scheme.


title: Vacuum stability of conformally invariant scalar dark matter models

abstract: We discuss vacuum structure and vacuum stability in classically scale-invariant renormalizable models with a scalar dark matter multiplet of global O(N) symmetry together with an electroweak singlet scalar mediator. Our conformally invariant scalar potential generates the electroweak symmetry breaking via the Coleman-Weinberg mechanism, and the new scalar singlet mediator acquires its mass through radiative corrections of the scalar dark matters as well as of the standard model particles. Taking into account the present collider bounds, we find the region of parameter space where the scalar potential is stable and all the massless couplings are perturbative up to the Planck scale. With the obtained parameter sets satisfying the vacuum stability condition, we present the allowed region of new physics parameters satisfying the recent measurement of relic abundance, and predict the elastic scattering cross section of the new scalar multiplet into target nuclei for a direct detection of the dark matter. We also discuss the collider signatures and future discovery potentials of the new scalars.


title: Data-driven Mutation Analysis for Cyber-Physical Systems

abstract: Cyber-physical systems (CPSs) typically consist of a wide set of integrated, heterogeneous components; consequently, most of their critical failures relate to the interoperability of such components.Unfortunately, most CPS test automation techniques are preliminary and industry still heavily relies on manual testing. With potentially incomplete, manually-generated test suites, it is of paramount importance to assess their quality. Though mutation analysis has demonstrated to be an effective means to assess test suite quality in some specific contexts, we lack approaches for CPSs. Indeed, existing approaches do not target interoperability problems and cannot be executed in the presence of black-box or simulated components, a typical situation with CPSs. In this paper, we introduce data-driven mutation analysis, an approach that consists in assessing test suite quality by verifying if it detects interoperability faults simulated by mutating the data exchanged by software components. To this end, we describe a data-driven mutation analysis technique (DaMAT) that automatically alters the data exchanged through data buffers. Our technique is driven by fault models in tabular form where engineers specify how to mutate data items by selecting and configuring a set of mutation operators. We have evaluated DaMAT with CPSs in the space domain; specifically, the test suites for the software systems of a microsatellite and nanosatellites launched on orbit last year. Our results show that the approach effectively detects test suite shortcomings, is not affected by equivalent and redundant mutants, and entails acceptable costs.


title: Normal cones corresponding to credal sets of lower probabilities

abstract: Credal sets are one of the most important models for describing probabilistic uncertainty. They usually arise as convex sets of probabilistic models compatible with judgments provided in terms of coherent lower previsions or more specific models such as coherent lower probabilities or probability intervals. In finite spaces, credal sets usually take the form of convex polytopes. Many properties of convex polytopes can be derived from their normal cones, which form polyhedral complexes called normal fans. We analyze the properties of normal cones corresponding to credal sets of coherent lower probabilities. For two important classes of coherent lower probabilities, 2-monotone lower probabilities and probability intervals, we provide a detailed description of the normal fan structure. These structures are related to the structure of the extreme points of the credal sets. To arrive at our main results, we provide some general results on triangulated normal fans of convex polyhedra and their adjacency structure.


title: Semantically Video Coding: Instill Static-Dynamic Clues into Structured Bitstream for AI Tasks

abstract: Traditional media coding schemes typically encode image/video into a semantic-unknown binary stream, which fails to directly support downstream intelligent tasks at the bitstream level. Semantically Structured Image Coding (SSIC) framework makes the first attempt to enable decoding-free or partial-decoding image intelligent task analysis via a Semantically Structured Bitstream (SSB). However, the SSIC only considers image coding and its generated SSB only contains the static object information. In this paper, we extend the idea of semantically structured coding from video coding perspective and propose an advanced Semantically Structured Video Coding (SSVC) framework to support heterogeneous intelligent applications. Video signals contain more rich dynamic motion information and exist more redundancy due to the similarity between adjacent frames. Thus, we present a reformulation of semantically structured bitstream (SSB) in SSVC which contains both static object characteristics and dynamic motion clues. Specifically, we introduce optical flow to encode continuous motion information and reduce cross-frame redundancy via a predictive coding architecture, then the optical flow and residual information are reorganized into SSB, which enables the proposed SSVC could better adaptively support video-based downstream intelligent applications. Extensive experiments demonstrate that the proposed SSVC framework could directly support multiple intelligent tasks just depending on a partially decoded bitstream. This avoids the full bitstream decompression and thus significantly saves bitrate/bandwidth consumption for intelligent analytics. We verify this point on the tasks of image object detection, pose estimation, video action recognition, video object segmentation, etc.


title: Models for (super)conformal higher-spin fields on curved backgrounds

abstract: This thesis is devoted to the construction of theories describing the consistent propagation of (super)conformal higher-spin fields on curved three- and four-dimensional (super)spaces. In the first half of this thesis we systematically derive models for conformal fields of arbitrary rank on various types of curved spacetimes. On generic conformally-flat backgrounds in three $(3d)$ and four $(4d)$ dimensions, we obtain closed-form expressions for the actions which are manifestly gauge and Weyl invariant. Similar results are provided for generalised conformal fields, which have higher-depth gauge transformations. In three dimensions, conformally-flat spacetimes are the most general backgrounds allowing consistent propagation. In four dimensions, it is widely expected that gauge invariance can be extended to Bach-flat backgrounds, although no complete models for spin greater than two exist. We confirm these expectations for the first time by constructing a number of complete gauge-invariant models for conformal fields with higher spin. In the second half of this thesis we employ superspace techniques to extend the above results to conformal higher-spin theories possessing off-shell supersymmetry. Several novel applications of our results are also provided. In particular, transverse projection operators are constructed in $4d$ anti-de Sitter (AdS$_4$) space, and their poles are shown to be associated with partially-massless fields. This allows us to demonstrate that on such backgrounds, the (super)conformal higher-spin kinetic operator factorises into products of second order operators. Similar conclusions are drawn in AdS$_3$ (super)space. Finally, we make use of the (super)conformal higher-spin models in $3d$ Minkowski and AdS (super)space to build topologically massive gauge theories.


title: Investigating the impact of free energy based behavior on human in human-agent interaction

abstract: Humans communicate non-verbally by sharing physical rhythms, such as nodding and gestures, to involve each other. This sharing of physicality creates a sense of unity and makes humans feel involved with others. In this paper, we developed a new body motion generation system based on the free-energy principle (FEP), which not only responds passively but also prompts human actions. The proposed system consists of two modules, the sampling module, and the motion selection module. We conducted a subjective experiment to evaluate the "feeling of interacting with the agent" of the FEP based behavior. The results suggested that FEP based behaviors show more "feeling of interacting with the agent". Furthermore, we confirmed that the agent's gestures elicited subject gestures. This result not only reinforces the impression of feeling interaction but could also realization of agents that encourage people to change their behavior.


title: Enabling Synchronous Uplink NOMA in Wi-Fi Networks

abstract: Non-Orthogonal Multiple Access (NOMA) is a promising technology for future Wi-Fi. In uplink NOMA, stations with different channel conditions transmit simultaneously at the same frequency by splitting the signal by power level. Since Wi-Fi uses random access, the implementation of uplink NOMA in Wi- Fi faces many challenges. The paper presents a data transmission mechanism in Wi-Fi networks that enables synchronous uplink NOMA, where multiple stations start data transmission to the access point simultaneously. The developed mechanism can work with the legacy Enhanced Distributed Channel Access (EDCA) mechanism in Wi-Fi. With simulation, it is shown that the developed mechanism can double the total throughput and geometric mean throughput compared with the legacy EDCA.


title: Dense Pixel-Labeling for Reverse-Transfer and Diagnostic Learning on Lung Ultrasound for COVID-19 and Pneumonia Detection

abstract: We propose using a pre-trained segmentation model to perform diagnostic classification in order to achieve better generalization and interpretability, terming the technique reverse-transfer learning. We present an architecture to convert segmentation models to classification models. We compare and contrast dense vs sparse segmentation labeling and study its impact on diagnostic classification. We compare the performance of U-Net trained with dense and sparse labels to segment A-lines, B-lines, and Pleural lines on a custom dataset of lung ultrasound scans from 4 patients. Our experiments show that dense labels help reduce false positive detection. We study the classification capability of the dense and sparse trained U-Net and contrast it with a non-pretrained U-Net, to detect and differentiate COVID-19 and Pneumonia on a large ultrasound dataset of about 40k curvilinear and linear probe images. Our segmentation-based models perform better classification when using pretrained segmentation weights, with the dense-label pretrained U-Net performing the best.


title: Search for the decay $B^0\to\phi\mu^+\mu^-$

abstract: A search for the decay $B^0\to\phi\mu^+\mu^-$ is performed using proton-proton collisions at centre-of-mass energies of 7, 8, and 13 TeV collected by the LHCb experiment and corresponding to an integrated luminosity of 9 fb$^{-1}$. No evidence for the $B^0\to \phi \mu^+ \mu^-$ decay is found and an upper limit on the branching fraction, excluding the $\phi$ and charmonium regions in the dimuon spectrum, of $4.4 \times 10^{-3}$ at a 90$\%$ credibility level, relative to that of the $B^0_s \to \phi \mu^+ \mu^-$ decay, is established. Using the measured $B^0_s\to\phi\mu^+\mu^-$ branching fraction and assuming a phase-space model, the absolute branching fraction of the decay $B^0\to \phi \mu^+ \mu^-$ in the full $q^2$ range is determined to be less than $3.2 \times 10^{-9}$ at a 90$\%$ credibility level.


title: Explore-And-Match: Bridging Proposal-Based and Proposal-Free With Transformer for Sentence Grounding in Videos

abstract: Natural Language Video Grounding (NLVG) aims to localize time segments in an untrimmed video according to sentence queries. In this work, we present a new paradigm named Explore-And-Match for NLVG that seamlessly unifies the strengths of two streams of NLVG methods: proposal-free and proposal-based; the former explores the search space to find time segments directly, and the latter matches the predefined time segments with ground truths. To achieve this, we formulate NLVG as a set prediction problem and design an end-to-end trainable Language Video Transformer (LVTR) that can enjoy two favorable properties, which are rich contextualization power and parallel decoding. We train LVTR with two losses. First, temporal localization loss allows time segments of all queries to regress targets (explore). Second, set guidance loss couples every query with their respective target (match). To our surprise, we found that training schedule shows divide-and-conquer-like pattern: time segments are first diversified regardless of the target, then coupled with each target, and fine-tuned to the target again. Moreover, LVTR is highly efficient and effective: it infers faster than previous baselines (by 2X or more) and sets competitive results on two NLVG benchmarks (ActivityCaptions and Charades-STA). Codes are available at https://github.com/sangminwoo/Explore-And-Match.


title: Constraining the Fluctuating Gunn-Peterson Approximation Using Lyman-$\alpha$ Forest Tomography at $z=2$

abstract: The fluctuating Gunn-Peterson approximation (FGPA) is a commonly-used method to generate mock Lyman-$\alpha$ (Ly$\alpha$) forest absorption skewers at Cosmic Noon ($z\gtrsim 2$) from the matter-density field of $N$-body simulations without running expensive hydrodynamical simulations. Motivated by recent developments in 3D IGM tomography observations as well as matter density field reconstruction techniques applied to galaxy redshift samples at $z\sim 2$, we examine the possibility of observationally testing FGPA by directly examining the relationship between the Ly$\alpha$ transmission and the underlying matter density field. Specifically, we analyze the EAGLE, Illustris, IllustrisTNG and Nyx cosmological hydrodynamic simulations, that were run with different codes and sub-grid models. While the FGPA is an excellent description of the IGM in lower-density regions, the slope of the transmission-density distribution at higher densities is significantly affected by feedback processes causing the FGPA to break down in that regime. Even without added feedback, we find significant deviations caused by hydrodynamical effects arising from non-linear structure growth. We then proceed to make comparisons using realistic mock data assuming the sightline sampling and spectral properties of the recent CLAMATO survey, and find that it would be challenging to discern between the FGPA and hydrodynamical models with current data sets. However, the improved sightline sampling from future extremely large telescopes or large volumes from multiplexed spectroscopic surveys such as Subaru PFS should allow for stringent tests of the FGPA, and make it possible to detect the effect of galaxy feedback on the IGM.


title: Protocol for generating an arbitrary quantum state of the magnetization in cavity magnonics

abstract: We propose and numerically evaluate a protocol to generate an arbitrary quantum state of the magnetization in a magnet. The protocol involves repeatedly exciting a frequency-tunable superconducting transmon and transferring the excitations to the magnet via a microwave cavity. To avoid decay, the protocol must be much shorter than magnon lifetime. Speeding up the protocol by simply shortening the pulses leads to non-resonant leakage of excitations to higher levels of the transmon accompanied by higher decoherence. We discuss how to correct for such leakages by applying counter pulses to de-excite these higher levels. In our protocol, states with a maximum magnon occupation of up to $\sim9$ and average magnon number up to $\sim4$ can be generated with fidelity $>0.75$.


title: Weighted Parity-Check Codes for Channels with State and Asymmetric Channels

abstract: In this paper, we introduce a new class of codes, called weighted parity-check codes, where each parity-check bit has a weight that indicates its likelihood to be one (instead of fixing each parity-check bit to be zero). It is applicable to a wide range of settings, e.g. asymmetric channels, channels with state and/or cost constraints, and the Wyner-Ziv problem, and can provably achieve the capacity. For the channels with state (Gelfand-Pinsker) setting, the proposed coding scheme has two advantages compared to the nested linear code. First, it achieves the capacity of any channel with state (e.g. asymmetric channels). Second, simulation results show that the proposed code achieves a smaller error rate compared to the nested linear code. We also discuss a sparse construction where the belief propagation algorithm can be applied to improve the coding efficiency.


title: Baumslag-Solitar groups and residual nilpotence

abstract: For a Baumslag-Solitar group $G$ we calculate the intersection $\gamma_w(G)$ of all terms of the lower central sequence of $G$.Using this we are able to show that $[\gamma_w(G),G]=\gamma_w(G)$ thus answering a question of Bardakov and Neschadim. Finally we show that the quotient groups $\gamma_c(G)/\gamma_{c+1}(G)$ of the lower central series of $G$ are finite.


title: Modeling bid and ask price dynamics with an extended Hawkes process and its empirical applications for high-frequency stock market data

abstract: This study proposes a versatile model for the dynamics of the best bid and ask prices using an extended Hawkes process. The model incorporates the zero intensities of the spread-narrowing processes at the minimum bid-ask spread, spread-dependent intensities, possible negative excitement, and nonnegative intensities. We apply the model to high-frequency best bid and ask price data from US stock markets. The empirical findings demonstrate a spread-narrowing tendency, excitations of the intensities caused by previous events, the impact of flash crashes, characteristic trends in fast trading over time, and the different features of market participants in the various exchanges.


title: The energy level structure of the modified Schrodinger equation can be consistent with Lamb shift

abstract: In the literature of calculating atomic and molecular structures, most Schrodinger equations are described by Coulomb potential. However, there are also a few literatures that discuss some magnetic correction methods, such as Pauli and Shortley's early work. But in fact, the calculation accuracy of these Schrodinger equations is not consistent with Lamb shift. Therefore, in the traditional ab initio calculation of quantum mechanics, it is common and necessary to use Dirac theory or quantum electrodynamics (QED) to correct the energy level of Schrodinger equation. However, the calculation of Feynman diagram is a daunting problem, including the application of self-consistent field in relativity and density functional theory. So recently, we have noticed the simplicity of the modified Newtonian mechanics, and we think that quantum mechanics will have similar properties. Here, we state this and improve the correction function in our previous action potential. In addition, through the demonstration of hydrogen-like and helium-like systems here, it can be proved that this conclusion is a potential application, that is, the energy level structure of our modified Schrodinger equation is consistent with Lamb shift.


title: RFMask: A Simple Baseline for Human Silhouette Segmentation with Radio Signals

abstract: Human silhouette segmentation, which is originally defined in computer vision, has achieved promising results for understanding human activities. However, the physical limitation makes existing systems based on optical cameras suffer from severe performance degradation under low illumination, smoke, and/or opaque obstruction conditions. To overcome such limitations, in this paper, we propose to utilize the radio signals, which can traverse obstacles and are unaffected by the lighting conditions to achieve silhouette segmentation. The proposed RFMask framework is composed of three modules. It first transforms RF signals captured by millimeter wave radar on two planes into spatial domain and suppress interference with the signal processing module. Then, it locates human reflections on RF frames and extract features from surrounding signals with human detection module. Finally, the extracted features from RF frames are aggregated with an attention based mask generation module. To verify our proposed framework, we collect a dataset containing 804,760 radio frames and 402,380 camera frames with human activities under various scenes. Experimental results show that the proposed framework can achieve impressive human silhouette segmentation even under the challenging scenarios(such as low light and occlusion scenarios) where traditional optical-camera-based methods fail. To the best of our knowledge, this is the first investigation towards segmenting human silhouette based on millimeter wave signals. We hope that our work can serve as a baseline and inspire further research that perform vision tasks with radio signals. The dataset and codes will be made in public.


title: Activation cross section measurement of the 14N(p,gamma)15O astrophysical key reaction

abstract: 14N(p,gamma)15O is one of the key reactions of nuclear astrophysics playing a role in various stellar processes and influencing energy generation of stars, stellar evolution and nucleosynthesis. For a reliable reaction rate calculation the low energy cross section of 14N(p,gamma)15O must be known with high accuracy. Owing to the unmeasurable low cross sections, theoretical calculations are unavoidable. High precision experimental cross section data are needed in a wide energy range in order to provide the necessary basis for low energy extrapolations. In the present work the total 14N(p,gamma)15O cross section was measured with a method complementary to the available data sets. The cross section was measured with activation, based on the detection of the annihilation radiation following the beta+ decay of the reaction product 15O. This method, which provides directly the astrophysically important total cross section, was never used for the 14N(p,gamma)15O cross section measurement in the studied energy range. The non-resonant cross section was measured between 550 keV and 1400 keV center-of-mass energies with total uncertainty of about 10%. The results were compared with literature data using an R-matrix analysis. It is found that the cross sections measured in this work are in acceptable agreement with the two recent measurements only if the weak transitions - not measured in those works - are included. The present data set, being largely independent from the other available data, can be used to constrain the extrapolated cross sections to astrophysical energies and helps to make the astrophysical model calculations more reliable.


title: 40 km Fiber Transmission of Squeezed Light Measured with a Real Local Oscillator

abstract: We demonstrate the generation, 40 km fiber transmission, and homodyne detection of single-mode squeezed states of light at 1550 nm using real-time phase control of a locally generated local oscillator, often called a "real local oscillator" or "local local oscillator". The system was able to stably measure up to around 3.7 dB of noise suppression with a phase noise uncertainty of around 2.5$^\circ$, using only standard telecom-compatible components and a field-programmable gate array (FPGA). The compactness, low degree of complexity and efficacy of the implemented scheme makes it a relevant candidate for long distance quantum communication in future photonic quantum networks.


title: Correlation-enhanced electron-phonon coupling and superconductivity in (Ba,K)SbO$_3$ superconductors

abstract: The electronic structure, lattice dynamics, and electron-phonon coupling (EPC) of the newly discovered (Ba,K)SbO$_3$ superconductors are investigated by first-principles calculations. The EPC of (Ba,K)SbO$_3$ is significantly enhanced by considering non-local electronic correlation using the Heyd-Scuseria-Ernzerhof hybrid exchange-correlation functional (HSE06). The EPC strength {\lambda} of Ba$_{0.35}$K$_{0.65}$SbO$_3$ is strongly increased from 0.33 in local-density approximation calculations to 0.59 in HSE06 calculations, resulting in a superconducting transition temperature Tc of about 14.9 K, which is in excellent agreement with experimental value of ~ 15 K. Our findings suggest (Ba,K)SbO$_3$ are extraordinary conventional superconductors, where non-local electronic correlation expands the bandwidth, enhances the EPC, and boosts the Tc. Moreover, we find both {\lambda} and Tc depend crucially on the K-doping level for (Ba,K)SbO$_3$ and (Ba,K)SbO$_3$ compounds. (Ba,K)SbO$_3$ have stronger EPC strength and higher Tc than those of (Ba,K)SbO$_3$ at the same K-doping level.


title: Flexible skylines, regret minimization and skyline ranking: a comparison to know how to select the right approach

abstract: Recent studies pointed out some limitations about classic top-k queries and skyline queries. Ranking queries impose the user to provide a specific scoring function, which can lead to the exclusion of interesting results because of the inaccurate estimation of the assigned weights. The skyline approach makes it difficult to always retrieve an accurate result, in particular when the user has to deal with a dataset whose tuples are defined by semantically different attributes. Therefore, to improve the quality of the final solutions, new techniques have been developed and proposed: here we will discuss about the flexible skyline, regret minimization and skyline ranking approaches. We present a comparison between the three different operators, recalling their way of behaving and defining a guideline for the readers so that it is easier for them to decide which one, among these three, is the best technique to apply to solve their problem.


title: Real-time and -space visualization of excitations of the \nu = 1/3 fractional quantum Hall edge

abstract: We present scanning optical stroboscopic confocal microscopy and spectroscopy measurements wherein three degrees of freedom, namely energy, real-space, and real-time, are resolvable. The edge-state propagation is detected as a temporal change in the optical response in the downstream edge. We succeeded in visualizing the excited states of the most fundamental fractional quantum Hall (FQH) state and the collective excitations near the edge. The results verify the current understanding of the edge excitation and also point toward further dynamics outside the edge channel.


title: Single and double $K$-shell vacancy production in slow Xe$^\textrm{54+,53+}$-Xe collisions

abstract: We present an experimental and theoretical study of symmetric $\textrm{Xe}^{54+}+\textrm{Xe}$ collisions at 50, 30, and 15 MeV/u, corresponding to strong perturbations with $v_K/v_\text{p}$ = 1.20, 1.55, and 2.20, respectively ($v_K$: classical $K$-shell orbital velocity, $v_\text{p}$: projectile velocity), as well as $\textrm{Xe}^{53+}+\textrm{Xe}$ collisions at 15 MeV/u. For each of these systems, x-ray spectra were measured under a forward angle of $35^\circ$ with respect to the projectile beam. Target satellite and hypersatellite radiation, $K\alpha_{2,1}^\mathrm{s}$ and $K\alpha_{2,1}^\mathrm{hs}$, respectively, were analyzed and used to derive cross section ratios for double-to-single target $K$-shell vacancy production. We compare our experimental results to relativistic time-dependent two-center calculations.


title: Pre-Trained Language Transformers are Universal Image Classifiers

abstract: Facial images disclose many hidden personal traits such as age, gender, race, health, emotion, and psychology. Understanding these traits will help to classify the people in different attributes. In this paper, we have presented a novel method for classifying images using a pretrained transformer model. We apply the pretrained transformer for the binary classification of facial images in criminal and non-criminal classes. The pretrained transformer of GPT-2 is trained to generate text and then fine-tuned to classify facial images. During the finetuning process with images, most of the layers of GT-2 are frozen during backpropagation and the model is frozen pretrained transformer (FPT). The FPT acts as a universal image classifier, and this paper shows the application of FPT on facial images. We also use our FPT on encrypted images for classification. Our FPT shows high accuracy on both raw facial images and encrypted images. We hypothesize the meta-learning capacity FPT gained because of its large size and trained on a large size with theory and experiments. The GPT-2 trained to generate a single word token at a time, through the autoregressive process, forced to heavy-tail distribution. Then the FPT uses the heavy-tail property as its meta-learning capacity for classifying images. Our work shows one way to avoid bias during the machine classification of images.The FPT encodes worldly knowledge because of the pretraining of one text, which it uses during the classification. The statistical error of classification is reduced because of the added context gained from the text.Our paper shows the ethical dimension of using encrypted data for classification.Criminal images are sensitive to share across the boundary but encrypted largely evades ethical concern.FPT showing good classification accuracy on encrypted images shows promise for further research on privacy-preserving machine learning.


title: Static self-induced heterogeneity in glass-forming liquids: Overlap as a microscope

abstract: We propose and numerically implement a local probe of the static self-induced heterogeneity characterizing glass-forming liquids. The method relies on the equilibrium statistics of the overlap between pairs of configurations measured in mesoscopic cavities with unconstrained boundaries. By systematically changing the location of the probed cavity, we directly detect spatial variations of the overlap fluctuations. We provide a detailed analysis of the statistics of a local estimate of the configurational entropy and we infer an estimate of the surface tension between amorphous states, ingredients that are both at the basis of the random first-order transition theory of glass formation. Our results represent the first direct attempt to visualize and quantify the self-induced heterogeneity underpinning the thermodynamics of glass formation. They pave the way for the development of coarse-grained effective theories and for a direct assessment of the role of thermodynamics in the activated dynamics of deeply supercooled liquids.


title: Estimating the Direction and Radius of Pipe from GPR Image by Ellipse Inversion Model

abstract: Ground Penetrating Radar (GPR) is widely used as a non-destructive approach to estimate buried utilities. When the GPR's detecting direction is perpendicular to a pipeline, a hyperbolic characteristic would be formed on the GPR B-scan image. However, in real-world applications, the direction of pipelines on the existing pipeline map could be inaccurate, and it is hard to ensure the moving direction of GPR to be actually perpendicular to underground pipelines. In this paper, a novel model is proposed to estimate the direction and radius of pipeline and revise the existing pipeline map from GPR B-scan images. The model consists of two parts: GPR B-scan image processing and Ellipse Iterative Inversion Algorithm (EIIA). Firstly, the GPR B-scan image is processed with downward-opening point set extracted. The obtained point set is then iteratively inverted to the elliptical cross section of the buried pipeline, which is caused by the angle between the GPR's detecting direction and the pipeline's direction. By minimizing the sum of the algebraic distances from the extracted point set to the inverted ellipse, the most likely pipeline's direction and radius are determined. Experiments on real-world datasets are conducted, and the results demonstrate the effectiveness of the method.


title: Zero-Shot Sketch Based Image Retrieval using Graph Transformer

abstract: The performance of a zero-shot sketch-based image retrieval (ZS-SBIR) task is primarily affected by two challenges. The substantial domain gap between image and sketch features needs to be bridged, while at the same time the side information has to be chosen tactfully. Existing literature has shown that varying the semantic side information greatly affects the performance of ZS-SBIR. To this end, we propose a novel graph transformer based zero-shot sketch-based image retrieval (GTZSR) framework for solving ZS-SBIR tasks which uses a novel graph transformer to preserve the topology of the classes in the semantic space and propagates the context-graph of the classes within the embedding features of the visual space. To bridge the domain gap between the visual features, we propose minimizing the Wasserstein distance between images and sketches in a learned domain-shared space. We also propose a novel compatibility loss that further aligns the two visual domains by bridging the domain gap of one class with respect to the domain gap of all other classes in the training set. Experimental results obtained on the extended Sketchy, TU-Berlin, and QuickDraw datasets exhibit sharp improvements over the existing state-of-the-art methods in both ZS-SBIR and generalized ZS-SBIR.


title: Gesture-based Human-Machine Interaction: Taxonomy, Problem Definition, and Analysis

abstract: The possibility for humans to interact with physical or virtual systems using gestures has been vastly explored by researchers and designers in the last twenty years to provide new and intuitive interaction modalities. Unfortunately, the literature about gestural interaction is not homogeneous, and it is characterised by a lack of shared terminology. This leads to fragmented results and makes it difficult for research activities to build on top of state-of-the-art results and approaches. The analysis in this paper aims at creating a common conceptual design framework to enforce development efforts in gesture-based human-machine interaction. The main contributions of the paper can be summarised as follows: (i) we provide a broad definition for the notion of functional gesture in human-machine interaction, (ii) we design a flexible and expandable gesture taxonomy, and (iii) we put forward a detailed problem statement for gesture-based human-machine interaction. Finally, to support our main contribution, the paper presents, and analyses 83 most pertinent articles classified on the basis of our taxonomy and problem statement.


abstract: Dynamical realizations of the Lifshitz group are studied within the group-theoretic framework. A generalization of the 1d conformal mechanics is constructed, which involves an arbitrary dynamical exponent z. A similar generalization of the Ermakov-Milne-Pinney equation is proposed. Invariant derivative and field combinations are introduced, which enable one to construct a plethora of dynamical systems enjoying the Lifshitz symmetry. A metric of the Lorentzian signature in (d+2)-dimensional spacetime and the energy-momentum tensor are constructed, which lead to the generalized Ermakov-Milne-Pinney equation upon imposing the Einstein equations. The method of nonlinear realizations is used for building Lorentzian metrics with the Lifshitz isometry group. In particular, a (2d+2)-dimensional metric is constructed, which enjoys an extra invariance under the Galilei boosts.


title: Experimental test of Tsirelson's bound with a single photonic qubit

abstract: For many protocols, quantum strategies have advantages compared with their classical counter-partners, and these advantages have attracted many interests and applications. One of the famous examples is the Clauser-Horne-Shimony-Holt (CHSH) game, which recasts Bell's theorem~\cite{2} into the framework of a game. In the CHSH game, two space-like separated players, Alice and Bob are each assigned a classical bit $a$ and $b$ respectively. Then they return bits $x$ and $y$ according to some pre-agreed strategies. They will win the game when $x\oplus y= a\cdot b$. In the game, if the players use the classical strategies, the optimal success probability $w(\text{CHSH})=0.75$.However, if they add some quantum resources, the success probability will increase and up to maximal value $cos^2(\pi/8)$, which is know as the Tsirelson's bound. Moreover, Popescu and Rohrlich noted that the perfect success probability $1$ can also be achieved in a more general theory without violating the no-signaling assumption


title: A Hitchhiker's Guide to Anomaly Detection with Astronomaly

abstract: The next generation of telescopes such as the SKA and the Rubin Observatory will produce enormous data sets, requiring automated anomaly detection to enable scientific discovery. Here, we present an overview and friendly user guide to the Astronomaly framework for active anomaly detection in astronomical data. Astronomaly uses active learning to combine the raw processing power of machine learning with the intuition and experience of a human user, enabling personalised recommendations of interesting anomalies. It makes use of a Python backend to perform data processing, feature extraction and machine learning to detect anomalous objects; and a JavaScript frontend to allow interaction with the data, labelling of interesting anomalous and active learning. Astronomaly is designed to be modular, extendable and run on almost any type of astronomical data. In this paper, we detail the structure of the Astronomaly code and provide guidelines for basic usage.


title: Run-and-back stitch search: novel block synchronous decoding for streaming encoder-decoder ASR

abstract: A streaming style inference of encoder-decoder automatic speech recognition (ASR) system is important for reducing latency, which is essential for interactive use cases. To this end, we propose a novel blockwise synchronous decoding algorithm with a hybrid approach that combines endpoint prediction and endpoint post-determination. In the endpoint prediction, we compute the expectation of the number of tokens that are yet to be emitted in the encoder features of the current blocks using the CTC posterior. Based on the expectation value, the decoder predicts the endpoint to realize continuous block synchronization, as a running stitch. Meanwhile, endpoint post-determination probabilistically detects backward jump of the source-target attention, which is caused by the misprediction of endpoints. Then it resumes decoding by discarding those hypotheses, as back stitch. We combine these methods into a hybrid approach, namely run-and-back stitch search, which reduces the computational cost and latency. Evaluations of various ASR tasks show the efficiency of our proposed decoding algorithm, which achieves a latency reduction, for instance in the Librispeech test set from 1487 ms to 821 ms at the 90th percentile, while maintaining a high recognition accuracy.


title: $\kappa$-deformed complex scalar field: conserved charges, symmetries and their impact on physical observables

abstract: In this paper we revisit the model of $\kappa$-deformed complex scalar field. We find that this model possesses ten conserved Noether charges that form, under commutators, a representation of (undeformed) Poincar\'e algebra. It follows that the theory is relativistic and does not break Lorentz invariance. However the spacetime representation of boosts is not standard, and contains a non-local translation, different for positive and negative energy modes. It then follows that although the masses of particles and anti-particles are equal, the theory violates CPT symmetry in a subtle way. We explain why the Jost-Wightman-Greenberg theorem of equivalence of the Poincar\'e symmetry and CPT fails in our case. Finally, we discuss the phenomenological consequences of the theory and its possible observational signatures.


title: Potential energy barrier for proton transfer in compressed benzoic acid

abstract: Benzoic acid (BA) is a model system for studying proton transfer (PT) reactions. The properties of solid BA subject to high pressure (exceeding 1 kbar = 0.1 GPa) are of particular interest due to the possibility of compression-tuning of the PT barrier. Here we present a simulations aimed a evaluating the value of this barrier in solid BA in the 1 atm - 15 GPa pressure range. We find that pressure-induced shortening of the O...O contacts within the BA dimers leads to a decrease in PT barrier, and subsequent symmetrization of the hydrogen bond. However, this effect is obtained only after taking into account zero-point energy (ZPE) differences between BA tautomers and the transition state. The obtained results shed light on previous experiments on compressed benzoic acid, and indicate that a common scaling behavior with respect to O...O distance might be applicable for hydrogen-bond symmetrization in both organic and inorganic systems.


title: L-values of harmonic Maass forms

abstract: Bruinier, Funke, and Imamoglu have proved a formula for what can philosophically be called the "central $L$-value" of the modular $j$-invariant. Previously, this had been heuristically suggested by Zagier. Here, we interpret this "$L$-value" as the value of an actual $L$-series, and extend it to all integral arguments and to a large class of harmonic Maass forms which includes all weakly holomorphic cusp forms. The context and relation to previously defined $L$-series for weakly holomorphic and harmonic Maass forms are discussed. These formulas suggest possible arithmetic or geometric meaning of $L$-values in these situations. The key ingredient of the proof is to apply a recent theory of Lee, Raji, and the authors to describe harmonic Maass $L$-functions using test functions.


title: Tailoring the band structure of plexcitonic crystals by strong coupling

abstract: Transition-metal dichalcogenides with their exciton-dominated optical behavior emerge as promising materials for realizing strong light-matter interactions in the visible range and at ambient conditions. When these materials are combined with metals, the energy confining ability of plasmon polaritons in metals below the diffraction limit, allows for further enhancing and tailoring the light-matter interaction, due to the formation of plexcitons in hybrid metal-TMDC structures at the interface. Herein, we demonstrate that the coupling between quasi-propagating plasmons in plasmonic crystals and excitons in WSe2, provides a multi-oscillator playground for tailoring the band structure of plasmonic crystal structures and results in emerging flat bands. The cathodoluminescence spectroscopy and angle-resolved measurements combined with the numerically calculated photonic band structure confirm a strong exciton-plasmon coupling, leading to significant changes in the band diagram of the hybrid lattice and the ability to tailor the band diagram via strong coupling. The hybrid plexcitonic crystal structures investigated here sustain optical waves with remarkably low group velocities. These results could be used for designing tunable slow-light structures based on the strong-coupling effect and pave the way toward plexcitonic topological photonic structures.


title: Small Solitons and Multi-Solitons in Generalized Davey-Stewartson System

abstract: This paper is concerned with the generalized Davey-Stewarston system in two dimensional space. Existence and stability of small solitons are proved by solving two correlative constrained variational problems and spectrum analysis. In addition, multi-solitons with different speeds are constructed by bootstrap argument.


title: Pointwise Characterization of Besov and Triebel-Lizorkin Spaces on Spaces of Homogeneous Type

abstract: In this article, the authors establish the pointwise characterization of Besov and Triebel-Lizorkin spaces on spaces of homogeneous type via clarifying the relationship among Haj\l asz-Sobolev spaces, Haj\l asz-Besov and Haj\l asz-Triebel-Lizorkin spaces, grand Besov and Triebel-Lizorkin spaces, and Besov and Triebel-Lizorkin spaces. A major novelty of this article is that all results presented in this article get rid of both the dependence on the reverse doubling condition of the measure and the metric condition of the quasi-metric under consideration. Moreover, the pointwise characterization of the inhomogeneous version is new even when the underlying space is an RD-space.


title: Online Actuator Selection and Controller Design for Linear Quadratic Regulation with Unknown System Model

abstract: We study the simultaneous actuator selection and controller design problem for linear quadratic regulation with Gaussian noise over a finite horizon of length $T$ and unknown system model. We consider both episodic and non-episodic settings of the problem and propose online algorithms that specify both the sets of actuators to be utilized under a cardinality constraint and the controls corresponding to the sets of selected actuators. In the episodic setting, the interaction with the system breaks into $N$ episodes, each of which restarts from a given initial condition and has length $T$. In the non-episodic setting, the interaction goes on continuously. Our online algorithms leverage a multiarmed bandit algorithm to select the sets of actuators and a certainty equivalence approach to design the corresponding controls. We show that our online algorithms yield $\sqrt{N}$-regret for the episodic setting and $T^{2/3}$-regret for the non-episodic setting. We extend our algorithm design and analysis to show scalability with respect to both the total number of candidate actuators and the cardinality constraint. We numerically validate our theoretical results.


title: Improved Mispronunciation detection system using a hybrid CTC-ATT based approach for L2 English speakers

abstract: This report proposes state-of-the-art research in the field of Computer Assisted Language Learning (CALL). Mispronunciation detection is one of the core components of Computer Assisted Pronunciation Training (CAPT) systems which is a subset of CALL. Studies on automated pronunciation error detection began in the 1990s, but the development of fullfledged CAPTs has only accelerated in the last decade due to an increase in computing power and availability of mobile devices for recording speech required for pronunciation analysis. Detecting Pronunciation errors is a hard problem to solve as there is no formal definition of correct and incorrect pronunciation. As a result, typically prosodic and phoneme errors such as phoneme substitution, insertion, and deletion are detected. Also, it has been agreed upon that learning pronunciation should focus on speaker intelligibility rather than sounding like an L1 English speaker. Initially, methods were developed on posterior likelihood called Good of Pronunciation using Gaussian Mixture Model-Hidden Markov Model and Deep Neural Network-Hidden Markov Model approaches. These are complex systems to implement when compared with the recently proposed ASR based End-to-End mispronunciations detection systems. The purpose of this research is to create End-to-End (E2E) models using Connectionist Temporal Classification (CTC) and Attention-based sequence decoder. Recently, E2E models have shown considerable improvement in mispronunciation detection accuracy. This research will draw comparison amongst baseline models CNN-RNN-CTC, CNN-RNN-CTC with character sequence-based attention decoder, and CNN-RNN-CTC with phoneme-based decoder systems. This study will help us in deciding a better approach towards developing an efficient mispronunciation detection system.


title: Anomalous screening in narrow-gap carbon nanotubes

abstract: The screening of Coulomb interaction controls many-body physics in carbon nanotubes, as it tunes the range and strength of the force that acts on charge carriers and binds electron-hole pairs into excitons. In doped tubes, the effective Coulomb interaction drives the competition between Luttinger liquid and Wigner crystal, whereas in undoped narrow-gap tubes it dictates the Mott or excitonic nature of the correlated insulator observed at low temperature. Here, by computing the dielectric function of selected narrow- and zero-gap tubes from first principles, we show that the standard effective-mass model of screening systematically underestimates the interaction strength at long wavelength, hence missing the binding of low-energy excitons. The reason is that the model critically lacks the full three-dimensional topology of the tube, being adapted from graphene theory. As ab inito calculations are limited to small tubes, we develop a two-band model dielectric function based on the plane-wave expansion of Bloch states and the exact truncated Coulomb cutoff technique. We demonstrate that our -- computationally cheap -- approach provides the correct screening for narrow-gap tubes of any size and chirality. A striking result is that the screened interaction remains long-ranged even in gapless tubes, as an effect of the microscopic local fields generated by the electrons moving on the curved tube surface. As an application, we show that the effective electron-electron force that is felt at distances relevant to quantum transport experiments is super Coulombic.


title: The multiplicative complexity of interval checking

abstract: We determine the exact AND-gate cost of checking if $a\leq x < b$, where $a$ and $b$ are constant integers. Perhaps surprisingly, we find that the cost of interval checking never exceeds that of a single comparison and, in some cases, it is even lower.


title: Computing Weak Dominance Drawings with Minimum Number of Fips

abstract: A weak dominance drawing $\Gamma$ of a DAG $G=(V,E)$, is a $d$-dimensional drawing such that there is a directed path from a vertex $u$ to a vertex $v$ in $G$ if $D(u) <D(v)$ for every dimension $D$ of $\Gamma$. We have a \emph{falsely implied path (fip)} when $D(u) < D(v)$ for every dimension $D$ of~$\Gamma$, but there is no path from $u$ to $v$. Minimizing the number of fips is an important theoretical and practical problem, which is NP-hard. We show that it is an FPT~problem for parameter $k$, where $k$ is the maximum degree of a vertex of the \emph{modular~decomposition~tree} of~$G$. Namely, for any constant $d$, we present an $O(nm+ndk^2(k!)^d)$ time algorithm to compute a weak $d$-dimensional dominance drawing $\Gamma$ of a DAG $G$ having the minimum number of fips. An interesting implication of this result is that we can decide if a DAG has dominance dimension~$3$ (a well-known NP-complete problem) in time $O(nm+nk^2(k!)^3)$.


title: Solar system constraints of a polymer black hole in loop quantum gravity

abstract: A new polymer black hole solution in loop quantum gravity was proposed recently. The difference between the polymer black hole and Schwarzschild black hole is captured by a quantum parameter $A$. In order to get the constraints on parameter $A$, we consider the observational constraints imposed on $A$ by using the Solar System experiments and calculate the deflection of light, Shapiro time delay, perihelion precession and obtain the effects associated with parameter $A$. Moreover, the parameterized post-Newtonian approach of this loop quantum gravity black hole was also carried out. It turns out the tightest constraint on $A$ can be improved to $0<A<4.0\times10^{-6}$.


title: Self-Alignment of a Large-Area Dual-Atom-Interferometer Gyroscope Using Parameter Decoupled Phase Seeking Calibrations

abstract: We realize a Mach-Zehnder-type dual-atom-interferometer gyroscope with an interrogation arm of 40 cm length and the interference area up to 1.2 cm$^2$. The precise angular alignment of the large-scale separated Raman lasers is demonstrated by seeking the phase intersection of Ramsey-Bord$\acute{e}$ interferometers after the gravity effect is compensated and by decoupling the velocity dependent crosstalk phase shifts, and applied to build the Mach-Zehnder atom interferometer. Then a compact inertial rotation sensor is realized based on dual large-area Mach-Zehnder atom interferometers by precisely aligning the large-scale separated Raman lasers, in which the coherence is well preserved and the common noise is differentially suppressed. The sensor presents a sensitivity of $1.5\times10^{-7}$ rad/s/Hz$^{1/2}$, and a stability of $9.5\times10^{-10}$ rad/s at 23000 s. The absolute rotation measurement is carried out by adjusting the atomic velocity which corresponds to modulating the scale factor.


title: Fine structure of the singular set of area minimizing hypersurfaces modulo $p$

abstract: Consider an area minimizing current modulo $p$ of dimension $m$ in a smooth Riemannian manifold of dimension $m+1$. We prove that its interior singular set is, up to a relatively closed set of dimension at most $m-2$, a $C^{1,\alpha}$ submanifold of dimension $m-1$ at which, locally, $N\leq p$ regular sheets of the current join transversally, each sheet counted with a positive multiplicity $k_i$ so that $\sum_i k_i = p$. This completes the analysis of the structure of the singular set of area minimizing hypersurfaces modulo $p$, initiated by J. Taylor for $m=2$ and $p=3$ and extended by the authors to arbitrary $m$ and all odd $p$ in arXiv:2105.08135. We tackle the remaining case of even $p$ by showing that the set of singular points admitting a flat blow-up is of codimension at least two in the current. First, we prove a structural result for the singularities of minimizers in the linearized problem, by combining an epiperimetric inequality with an analysis of homogeneous minimizers to conclude that the corresponding degrees of homogeneity are always integers; second, we refine Almgren's blow-up procedure to prove that all flat singularities of the current persist as singularities of the $\mathrm{Dir}$-minimizing limit. An important ingredient of our analysis is the uniqueness of flat tangent cones at singular points, recently established by Minter and Wickramasekera in arXiv:2111.11202.


title: Self-adjoint extension schemes and modern applications to quantum Hamiltonians

abstract: This monograph contains revised and enlarged materials from previous lecture notes of undergraduate and graduate courses and seminars delivered by both authors over the last years on a subject that is central both in abstract operator theory and in applications to quantum mechanics: to decide whether a given densely defined and symmetric operator on Hilbert space admits a unique self-adjoint realisation, namely its operator closure, or whether instead it admits an infinite multiplicity of distinct self-adjoint extensions, and in the latter case to classify them and characterise their main features (operator and quadratic form domains, spectrum, etc.) This is at the same time a very classical, well established field, corresponding to the first part of the monograph, and a territory of novel, modern applications, a selection of which, obviously subjective to some extent, but also driven by a pedagogical criterion, is presented in depth in the second part. A number of models are discussed, which are receiving today new or renewed interest in mathematical physics, in particular from the point of view of realising certain operators of interests self-adjointly, classifying their self-adjoint extensions as actual quantum Hamiltonians, studying their spectral and scattering properties, and the like, but also from the point of view of intermediate technical questions that have theoretical interest per se, such as characterising the corresponding operator closures and adjoints.

categories: math-ph math.FA math.MP math.SP quant-ph


title: A fully adaptive explicit stabilized integrator for advection-diffusion-reaction problems

abstract: A novel second order family of explicit stabilized Runge-Kutta-Chebyshev methods for advection-diffusion-reaction equations is introduced. The new methods outperform existing schemes for relatively high Peclet number due to their favorable stability properties and explicitly available coefficients. The construction of the new schemes is based on stabilization using second kind Chebyshev polynomials first used in the construction of the stochastic integrator SK-ROCK. An adaptive algorithm to implement the new scheme is proposed. This algorithm is able to automatically select the suitable step size, number of stages, and damping parameter at each integration step. Numerical experiments that illustrate the efficiency of the new algorithm are presented.


title: SPIRAL: Self-supervised Perturbation-Invariant Representation Learning for Speech Pre-Training

abstract: We introduce a new approach for speech pre-training named SPIRAL which works by learning denoising representation of perturbed data in a teacher-student framework. Specifically, given a speech utterance, we first feed the utterance to a teacher network to obtain corresponding representation. Then the same utterance is perturbed and fed to a student network. The student network is trained to output representation resembling that of the teacher. At the same time, the teacher network is updated as moving average of student's weights over training steps. In order to prevent representation collapse, we apply an in-utterance contrastive loss as pre-training objective and impose position randomization on the input to the teacher. SPIRAL achieves competitive or better results compared to state-of-the-art speech pre-training method wav2vec 2.0, with significant reduction of training cost (80% for BASE model, 65% for LARGE model). Furthermore, we address the problem of noise-robustness that is critical to real-world speech applications. We propose multi-condition pre-training by perturbing the student's input with various types of additive noise. We demonstrate that multi-condition pre-trained SPIRAL models are more robust to noisy speech (9.0% - 13.3% relative word error rate reduction on real noisy test data), compared to applying multi-condition training solely in the fine-tuning stage. Source code is available at https://github.com/huawei-noah/Speech-Backbones/tree/main/SPIRAL.


title: Semi-Supervised Quantile Estimation: Robust and Efficient Inference in High Dimensional Settings

abstract: We consider quantile estimation in a semi-supervised setting, characterized by two available data sets: (i) a small or moderate sized labeled data set containing observations for a response and a set of possibly high dimensional covariates, and (ii) a much larger unlabeled data set where only the covariates are observed. We propose a family of semi-supervised estimators for the response quantile(s) based on the two data sets, to improve the estimation accuracy compared to the supervised estimator, i.e., the sample quantile from the labeled data. These estimators use a flexible imputation strategy applied to the estimating equation along with a debiasing step that allows for full robustness against misspecification of the imputation model. Further, a one-step update strategy is adopted to enable easy implementation of our method and handle the complexity from the non-linear nature of the quantile estimating equation. Under mild assumptions, our estimators are fully robust to the choice of the nuisance imputation model, in the sense of always maintaining root-n consistency and asymptotic normality, while having improved efficiency relative to the supervised estimator. They also attain semi-parametric optimality if the relation between the response and the covariates is correctly specified via the imputation model. As an illustration of estimating the nuisance imputation function, we consider kernel smoothing type estimators on lower dimensional and possibly estimated transformations of the high dimensional covariates, and we establish novel results on their uniform convergence rates in high dimensions, involving responses indexed by a function class and usage of dimension reduction techniques. These results may be of independent interest. Numerical results on both simulated and real data confirm our semi-supervised approach's improved performance, in terms of both estimation and inference.


title: Heisenberg models and Schur--Weyl duality

abstract: We present a detailed analysis of certain quantum spin systems with inhomogeneous (non-random) mean-field interactions. Examples include, but are not limited to, the interchange- and spin singlet projection interactions on complete bipartite graphs. Using two instances of the representation theoretic framework of Schur--Weyl duality, we can explicitly compute the free energy and other thermodynamic limits in the models we consider. This allows us to describe the phase-transition, the ground-state phase diagram, and the expected structure of extremal states.


title: Universal Generative Modeling for Calibration-free Parallel Mr Imaging

abstract: The integration of compressed sensing and parallel imaging (CS-PI) provides a robust mechanism for accelerating MRI acquisitions. However, most such strategies require the explicit formation of either coil sensitivity profiles or a cross-coil correlation operator, and as a result reconstruction corresponds to solving a challenging bilinear optimization problem. In this work, we present an unsupervised deep learning framework for calibration-free parallel MRI, coined universal generative modeling for parallel imaging (UGM-PI). More precisely, we make use of the merits of both wavelet transform and the adaptive iteration strategy in a unified framework. We train a powerful noise conditional score network by forming wavelet tensor as the network input at the training phase. Experimental results on both physical phantom and in vivo datasets implied that the proposed method is comparable and even superior to state-of-the-art CS-PI reconstruction approaches.


title: An active-set method for sparse approximations. Part I: Separable $\ell_1$ terms

abstract: In this paper we present an active-set method for the solution of $\ell_1$-regularized convex quadratic optimization problems. It is derived by combining a proximal method of multipliers (PMM) strategy with a standard semismooth Newton method (SSN). The resulting linear systems are solved using a Krylov-subspace method, accelerated by certain general-purpose preconditioners which are shown to be optimal with respect to the proximal parameters. Practical efficiency is further improved by warm-starting the algorithm using a proximal alternating direction method of multipliers. We show that the outer PMM achieves global convergence under mere feasibility assumptions. Under additional standard assumptions, the PMM scheme achieves global linear and local superlinear convergence. The SSN scheme is locally superlinearly convergent, assuming that its associated linear systems are solved accurately enough, and globally convergent under certain additional regularity assumptions. We provide numerical evidence to demonstrate the effectiveness of the approach by comparing it against OSQP and IP-PMM (an ADMM and a regularized IPM solver, respectively) on several elastic-net linear regression and $L^1$-regularized PDE-constrained optimization problems.


title: Feature Diversity Learning with Sample Dropout for Unsupervised Domain Adaptive Person Re-identification

abstract: Clustering-based approach has proved effective in dealing with unsupervised domain adaptive person re-identification (ReID) tasks. However, existing works along this approach still suffer from noisy pseudo labels and the unreliable generalization ability during the whole training process. To solve these problems, this paper proposes a new approach to learn the feature representation with better generalization ability through limiting noisy pseudo labels. At first, we propose a Sample Dropout (SD) method to prevent the training of the model from falling into the vicious circle caused by samples that are frequently assigned with noisy pseudo labels. In addition, we put forward a brand-new method referred as to Feature Diversity Learning (FDL) under the classic mutual-teaching architecture, which can significantly improve the generalization ability of the feature representation on the target domain. Experimental results show that our proposed FDL-SD achieves the state-of-the-art performance on multiple benchmark datasets.


title: Probabilistic Total Store Ordering

abstract: We present $\textit{Probabilistic Total Store Ordering (PTSO)}$ -- a probabilistic extension of the classical TSO semantics. For a given (finite-state) program, the operational semantics of PTSO induces an infinite-state Markov chain. We resolve the inherent non-determinism due to process schedulings and memory updates according to given probability distributions. We provide a comprehensive set of results showing the decidability of several properties for PTSO, namely (i) Almost-Sure (Repeated) Reachability: whether a run, starting from a given initial configuration, almost surely visits (resp. almost surely repeatedly visits) a given set of target configurations. (ii) Almost-Never (Repeated) Reachability: whether a run from the initial configuration, almost never visits (resp. almost never repeatedly visits) the target. (iii) Approximate Quantitative (Repeated) Reachability: to approximate, up to an arbitrary degree of precision, the measure of runs that start from the initial configuration and (repeatedly) visit the target. (iv) Expected Average Cost: to approximate, up to an arbitrary degree of precision, the expected average cost of a run from the initial configuration to the target. We derive our results through a nontrivial combination of results from the classical theory of (infinite-state) Markov chains, the theories of decisive and eager Markov chains, specific techniques from combinatorics, as well as, decidability and complexity results for the classical (non-probabilistic) TSO semantics. As far as we know, this is the first work that considers probabilistic verification of programs running on weak memory models.


title: Constructing the bulk at the critical point of three-dimensional large $N$ vector theories

abstract: In the context of the $AdS_{4}/CFT_{3}$ correspondence between higher spin fields and vector theories, we use the constructive bilocal fields based approach to this correspondence, to demonstrate, at the $IR$ critical point of the interacting vector theory and directly in the bulk, the removal of the $\Delta=1$ ($s=0$) state from the higher spins field spectrum, and to exhibit simple Klein-Gordon higher spin Hamiltonians. The bulk variables and higher spin fields are obtained in a simple manner from boundary bilocals, by the change of variables previously derived for the $UV$ critical point (in momentum space), together with a field redefinition.


title: Long-time prediction of nonlinear parametrized dynamical systems by deep learning-based reduced order models

abstract: Deep learning-based reduced order models (DL-ROMs) have been recently proposed to overcome common limitations shared by conventional ROMs - built, e.g., exclusively through proper orthogonal decomposition (POD) - when applied to nonlinear time-dependent parametrized PDEs. In particular, POD-DL-ROMs can achieve extreme efficiency in the training stage and faster than real-time performances at testing, thanks to a prior dimensionality reduction through POD and a DL-based prediction framework. Nonetheless, they share with conventional ROMs poor performances regarding time extrapolation tasks. This work aims at taking a further step towards the use of DL algorithms for the efficient numerical approximation of parametrized PDEs by introducing the $\mu t$-POD-LSTM-ROM framework. This novel technique extends the POD-DL-ROM framework by adding a two-fold architecture taking advantage of long short-term memory (LSTM) cells, ultimately allowing long-term prediction of complex systems' evolution, with respect to the training window, for unseen input parameter values. Numerical results show that this recurrent architecture enables the extrapolation for time windows up to 15 times larger than the training time domain, and achieves better testing time performances with respect to the already lightning-fast POD-DL-ROMs.


title: Complex vortex-antivortex dynamics in the magnetic superconductor EuFe$_{2}$(As$_{0.7}$P$_{0.3}$)$_{2}$

abstract: We report on the investigation of the magnetic superconductor EuFe$_{2}$(As$_{0.7}$P$_{0.3}$)$_{2}$ based on muon-spin spectroscopy and ac magnetic susceptibility ($\chi$) measurements. The dependence of the internal field at the muon site on temperature is indicative of a ferromagnetic ordering of Eu$^{2+}$ magnetic moments and only the conventional magnon scattering governs the longitudinal relaxation rate at low temperatures. At the same time, we observe a rich phenomenology for the imaginary component of the susceptibility $\chi^{\prime\prime}$ by means of both standard ac susceptibility and a novel technique based on a microwave coplanar waveguide resonator. In particular, we detect activated trends for several features in $\chi^{\prime\prime}$ over frequencies spanning ten orders of magnitude. We interpret our results in terms of the complex dynamics of vortices and antivortices influenced by the underlying structure of magnetic domains.


title: Poisson's CDF applied to Flexible Skylines

abstract: The evolution of skyline and ranking queries has created new archetypes like flexible skylines, which have proven to be an efficient method to select relevant data from large datasets using multi objective optimization. This paper aims to study the possible applications of Poisson distribution mass function as a monotonic scoring function in flexible skyline processes, especially those featuring schemas whose attributes can be translated to constant mean rates. Moreover, a method to express users's requirement by means of the F-dominant set of tuples will be proposed using parametrical variations in F[1], simultaneously, algorithm construction and potential applications will be studied.


title: Unitary-Precoded Single-Carrier Waveforms for High Mobility: Detection and Channel Estimation

abstract: This paper presents unitary-precoded single-carrier (USC) modulation as a family of waveforms based on multiplexing the information symbols on time domain unitary basis functions. The common property of these basis functions is that they span the entire time and frequency plane. The recently proposed orthogonal time frequency space (OTFS) and orthogonal time sequency multiplexing (OTSM) based on discrete Fourier transform (DFT) and Walsh Hadamard transform (WHT), respectively, fall in the general framework of USC waveforms. In this work, we present channel estimation and detection methods that work for any USC waveform and numerically show that any choice of unitary precoding results in the same error performance. Lastly, we implement some USC systems and compare their performance with OFDM in a real-time indoor setting using an SDR platform.


title: John-Nirenberg inequalities for noncommutative column BMO and Lipschitz martingales

abstract: In this paper, we continue the study of John-Nirenberg theorems for BMO/Lipschitz spaces in the noncommutative martingale setting. As conjectured from the classical case, a desired noncommutative ``stopping time" argument was discovered to obtain the distribution function inequality form of John-Nirenberg theorem. This not only provides another approach without using duality and interpolation to the results for spaces $\mathsf{bmo}^c(\mathcal M)$ and ${{\Lambda}^{{c}}_{\beta}}(\mathcal{M})$, but also allows us to find the desired version of John-Nirenberg inequalities for spaces $\mathcal{BMO}^c(\mathcal M)$ and ${\mathcal L^{{c}}_{\beta}}(\mathcal{M})$. And thus we solve two open questions after \cite{ref5, ref3}. As an application, we show that Lipschitz space is also the dual space of noncommutative Hardy space defined via symmetric atoms. Finally, our results for ${\mathcal L^{{c}}_{\beta}}(\mathcal{M})$ as well as the approach seem new even going back to the classical setting.


title: Fractal states of the Schwinger model

abstract: The lattice Schwinger model (SM), the discrete version of QED in 1+1 dimensions, is a well-studied test bench for lattice gauge theories. Here we study the fractal properties of the SM. We reveal the self-similarity of the ground state, which allows one to develop a recurrent procedure for finding the ground-state wave functions and predicting ground-state energies. We provide the results of recurrently calculating ground-state wave functions using the fractal ansatz and automized software package for fractal image processing. In certain parameter regimes, just a few terms are enough for our recurrent procedure to predict ground state energies close to the exact ones for several hundreds of sites. Our findings pave the way to understanding the complexity of calculating many-body wave functions in terms of their fractal properties as well as finding new links between condensed matter and high-energy lattice models.


title: Privacy of distributed optimality schemes in power networks

abstract: The increasing participation of local generation and controllable demand units within the power network motivates the use of distributed schemes for their control. Simultaneously, it raises two issues; achieving an optimal power allocation among these units, and securing the privacy of the generation/demand profiles. This study considers the problem of designing distributed optimality schemes that preserve the privacy of the generation and controllable demand units within the secondary frequency control timeframe. We propose a consensus scheme that includes the generation/demand profiles within its dynamics, keeping this information private when knowledge of its internal dynamics is not available. However, the prosumption profiles may be inferred using knowledge of its internal model. We resolve this by proposing a privacy-preserving scheme which ensures that the generation/demand cannot be inferred from the communicated signals. For both proposed schemes, we provide analytic stability, optimality and privacy guarantees and show that the secondary frequency control objectives are satisfied. The presented schemes are distributed, locally verifiable and applicable to arbitrary network topologies. Our analytic results are verified with simulations on a 140-bus system, where we demonstrate that the proposed schemes offer enhanced privacy properties, enable an optimal power allocation and preserve the stability of the power network.


title: Explanatory Learning: Beyond Empiricism in Neural Networks

abstract: We introduce Explanatory Learning (EL), a framework to let machines use existing knowledge buried in symbolic sequences -- e.g. explanations written in hieroglyphic -- by autonomously learning to interpret them. In EL, the burden of interpreting symbols is not left to humans or rigid human-coded compilers, as done in Program Synthesis. Rather, EL calls for a learned interpreter, built upon a limited collection of symbolic sequences paired with observations of several phenomena. This interpreter can be used to make predictions on a novel phenomenon given its explanation, and even to find that explanation using only a handful of observations, like human scientists do. We formulate the EL problem as a simple binary classification task, so that common end-to-end approaches aligned with the dominant empiricist view of machine learning could, in principle, solve it. To these models, we oppose Critical Rationalist Networks (CRNs), which instead embrace a rationalist view on the acquisition of knowledge. CRNs express several desired properties by construction, they are truly explainable, can adjust their processing at test-time for harder inferences, and can offer strong confidence guarantees on their predictions. As a final contribution, we introduce Odeen, a basic EL environment that simulates a small flatland-style universe full of phenomena to explain. Using Odeen as a testbed, we show how CRNs outperform empiricist end-to-end approaches of similar size and architecture (Transformers) in discovering explanations for novel phenomena.


title: Geodesic photon coupling and non-Hermitian exceptional point of microcavities on topologically curved space

abstract: Asymmetric microcavities supporting Whispering-gallery modes (WGMs) are of great significance for on-chip optical information processing. We define asymmetric microcavities on topologically curved surfaces, where the geodesic light trajectories completely reconstruct the cavity mode features. The quality factors of the lossy chaotic and island modes in flat cavities can be increased by up to ~200 times by the space curvature. Strong and weak coupling between modes of very different origins occur when the space curvature brings them into resonance, leading to a fine tailoring of the cavity photon energy and lifetime. Finally, we prove that by varying the overall loss, an exceptional point can be clearly observed at which both the cavity photon energy and lifetime become degenerate. Our work is at the crosspoint of optical chaotic dynamics, non-Hermitian physics and geodesic optical devices, and would open the novel area of geodesic microcavity photonics.


title: The Chv\'atal-Gomory Procedure for Integer SDPs with Applications in Combinatorial Optimization

abstract: In this paper we study the well-known Chv\'atal-Gomory (CG) procedure for the class of integer semidefinite programs (ISDPs). We prove several results regarding the hierarchy of relaxations obtained by iterating this procedure. We also study different formulations of the elementary closure of spectrahedra. A polyhedral description of the elementary closure for a specific type of spectrahedra is derived by exploiting total dual integrality for SDPs. Moreover, we show how to exploit (strengthened) CG cuts in a branch-and-cut framework for ISDPs. Different from existing algorithms in the literature, the separation routine in our approach exploits both the semidefinite and the integrality constraints. We provide separation routines for several common classes of binary SDPs resulting from combinatorial optimization problems. In the second part of the paper we present a comprehensive application of our approach to the quadratic traveling salesman problem (QTSP). Based on the algebraic connectivity of the directed Hamiltonian cycle, two ISDPs that model the QTSP are introduced. We show that the CG cuts resulting from these formulations contain several well-known families of cutting planes. Numerical results illustrate the practical strength of the CG cuts in our branch-and-cut algorithm, which outperforms alternative ISDP solvers and is able to solve large QTSP instances to optimality.


title: Quantization of derived cotangent stacks and gauge theory on directed graphs

abstract: We study the quantization of the canonical unshifted Poisson structure on the derived cotangent stack $T^\ast[X/G]$ of a quotient stack, where $X$ is a smooth affine scheme with an action of a (reductive) smooth affine group scheme $G$. This is achieved through an {\'e}tale resolution of $T^\ast[X/G]$ by stacky CDGAs that allows for an explicit description of the canonical Poisson structure on $T^\ast[X/G]$ and of the dg-category of modules quantizing it. These techniques are applied to construct a dg-category-valued prefactorization algebra that quantizes a gauge theory on directed graphs.


title: The DRAKE mission: finding the frequency of life in the Cosmos

abstract: In the search for life in the Universe, exoplanets represent numerous natural experiments in planet formation, evolution, and the emergence of life. This raises the fascinating prospect of evaluating cosmic life on a statistical basis. One key statistic is the occurrence rate of life-bearing worlds, $f_{\rm L}$, the 'frequency of life' term in the famous Drake Equation. Measuring $f_{\rm L}$ would give profound insight into how common life is and may help to constrain origin-of-life theories. I propose $f_{\rm L}$ as the goal for the DRAKE mission (Dedicated Research for Advancing Knowledge of Exobiology): a transit spectroscopy survey of M-dwarf habitable zone terrestrial planets. I investigate how the uncertainty on the observed value of $f_{\rm L}$ scales with sample size. I determine that sampling error dominates over observational error and that the uncertainty is a function of the observed $f_{\rm L}$ value. I show that even small sample sizes can provide significant constraints on $f_{\rm L}$, boding well for the transit spectroscopy approach. I perform a feasibility study of the DRAKE mission using a nominal instrument design and mission plan. Due to low observing efficiencies, DRAKE may need to be incorporated into a wider-ranging deep-space or lunar observatory. A 50-planet survey could constrain $f_{\rm L}$ to $\leq$ 0.06 (at 95% confidence) if the sample $f_{\rm L}$ = 0, or 0.03-0.2 if the sample $f_{\rm L}$ = 0.1. This can be achieved (on average) in 10 years using a 17-m telescope with an unrestricted field-of-regard. DRAKE is a viable approach to attempting the first experimental measurement of $f_{\rm L}$.


title: Cold Start Active Learning Strategies in the Context of Imbalanced Classification

abstract: We present novel active learning strategies dedicated to providing a solution to the cold start stage, i.e. initializing the classification of a large set of data with no attached labels. Moreover, proposed strategies are designed to handle an imbalanced context in which random selection is highly inefficient. Specifically, our active learning iterations address label scarcity and imbalance using element scores, combining information extracted from a clustering structure to a label propagation model. The strategy is illustrated by a case study on annotating Twitter content w.r.t. testimonies of a real flood event. We show that our method effectively copes with class imbalance, by boosting the recall of samples from the minority class.


title: Computing the logarithmic capacity of compact sets having (infinitely) many components with the Charge Simulation Method

abstract: We apply the Charge Simulation Method (CSM) in order to compute the logarithmic capacity of compact sets consisting of (infinitely) many "small" components. This application allows to use just a single charge point for each component. The resulting method therefore is significantly more efficient than methods based on discretizations of the boundaries (for example, our own method presented in [Liesen, S\`ete, Nasser, 2017]), while maintaining a very high level of accuracy. We study properties of the linear algebraic systems that arise in the CSM, and show how these systems can be solved efficiently using preconditioned iterative methods, where the matrix-vector products are computed using the Fast Multipole Method. We illustrate the use of the method on generalized Cantor sets and the Cantor dust.


title: Cohomology of the basic unramified PEL unitary Rapoport-Zink space of signature $(1,n-1)$

abstract: In this paper, we study the cohomology of the unitary unramified PEL Rapoport-Zink space of signature $(1,n-1)$ at maximal level. Our method revolves around the spectral sequence associated to the open cover by the analytical tubes of the closed Bruhat-Tits strata in the special fiber, which were constructed by Vollaard and Wedhorn. The cohomology of these strata, which are isomorphic to generalized Deligne-Lusztig varieties, has been computed in arXiv:2110.00614 [math.RT]. This spectral sequence allows us to prove the semisimplicity of the Frobenius action and to describe the inertial supports of the irreducible subquotients in the individual cohomology groups. In particular, when $n\geq 5$ no such subquotient is supercuspidal, but when $1\leq n \leq 4$ supercuspidal subquotients do occur. Moreover, we also prove that the cohomology groups need not be admissible in general. Via $p$-adic uniformization, we relate the cohomology of the Rapoport-Zink space to the cohomology of the basic stratum of a Shimura variety with no level at $p$. In the case $n=3$ or $4$, we give a complete description of the cohomology of the basic stratum in terms of automorphic representations. In particular, some automorphic representations occur with multiplicities dependent on $p$.


title: Toeplitz and related operators on polyanalytic Fock spaces

abstract: We give a characterization of compact and Fredholm operators on polyanalytic Fock spaces in terms of limit operators. As an application we obtain a generalization of the Bauer-Isralowitz theorem using a matrix valued Berezin type transform. We then apply this theorem to Toeplitz and Hankel operators to obtain necessary and sufficient conditions for compactness. As it turns out, whether or not a Toeplitz or Hankel operator is compact does not depend on the polyanalytic order. For Hankel operators this even holds on the true polyanalytic Fock spaces.


title: Size Effect of Local Current-Voltage Characteristics of MX$_2$ Nanoflakes: Local Density of States Reconstruction from Scanning Tunneling Microscopy Experiments

abstract: Local current-voltage characteristics for low-dimensional transition metal dichalcogenides (LD-TMD), as well as the reconstruction of their local density of states (LDOS) from scanning tunneling microscopy (STM) experiments is of fundamental interest and can be useful for advanced applications. Most of existing models are either hardly applicable for the LD-TMD of complex shape (e.g., those based on Simmons approach), or necessary for solving an ill-defined integral equation to deconvolute the unknown LDOS (e.g., those based on Tersoff approach). Using a serial expansion of Tersoff formulae, we propose a flexible method how to reconstruct the LDOS from local current-voltage characteristics measured in STM experiments. We established a set of key physical parameters, which characterize the tunneling current of a STM probe - sample contact and the sample LDOS expanded in Gaussian functions. Using a direct variational method coupled with a probabilistic analysis, we determine these parameters from the STM experiments for MoS2 nanoflakes with different number of layers. The main result is the reconstruction of the LDOS in a relatively wide energy range around a Fermi level, which allows insight in the local band structure of LD-TMDs. The reconstructed LDOS reveals pronounced size effects for the single-layer, bi-layer and three-layer MoS$_2$ nanoflakes, which we relate with low dimensionality and strong bending/corrugation of the nanoflakes. We hope that the proposed elaboration of the Tersoff approach allowing LDOS reconstruction will be of urgent interest for quantitative description of STM experiments, as well as useful for the microscopic physical understanding of the surface, strain and bending contribution to LD-TMDs electronic properties.


title: Learning Controllers from Data via Approximate Nonlinearity Cancellation

abstract: We introduce a method to deal with the data-driven control design of nonlinear systems. We derive conditions to design controllers via (approximate) nonlinearity cancellation. These conditions take the compact form of data-dependent semi-definite programs. The method returns controllers that can be certified to stabilize the system even when data are perturbed and disturbances affect the dynamics of the system during the execution of the control task, in which case an estimate of the robustly positively invariant set is provided.


title: A description of the minimal elements of Shi regions in classical Weyl Groups

abstract: In this extended abstract, we show how a bijection between parking functions and regions of the Shi arrangement from [Athanasiadis, Linusson '99] (in type $A_n$) and [Armstrong, Reiner, Rhoades '15] (in type $B_n, C_n, D_n$) allows for the computation of the minimal elements of the Shi regions. This gives a combinatorial interpretation of these minimal elements: they can be seen as counting non-crossing arcs in non-nesting arc diagrams.


title: Active polar flock with birth and death

abstract: We study a collection of self-propelled polar particles on a two-dimensional substrate with birth and death. We introduce a minimal lattice model for the system using active Ising spins, where each particle can have two possible orientations. The activity is modeled as a biased movement of the particle along its direction of orientation. The particles also align with their nearest neighbors using Metropolis Monte-Carlo algorithm. System shows a disorder-to-order transition by tuning the temperature of the system. Additionally, the birth and death of the particles is introduced through a birth and death rate $\gamma$. The system is studied near the disorder-to-order transition. The nature of disorder-to-order transition shows a crossover from first order, discontinuous to continuous type as we tune $\gamma$ from zero to finite values. We also write the effective free energy of the local order parameter using renormalised mean field theory and it confirms the dependence of the nature of phase transition on the birth and death rate parameter.


title: A Nested Error Regression Model with High Dimensional Parameter for Small Area Estimation

abstract: In this paper we propose a flexible nested error regression small area model with high dimensional parameter that incorporates heterogeneity in regression coefficients and variance components. We develop a new robust small area specific estimating equations method that allows appropriate pooling of a large number of areas in estimating small area specific model parameters. We propose a parametric bootstrap and jackknife method to estimate not only the mean squared errors but also other commonly used uncertainty measures such as standard errors and coefficients of variation. We conduct both modelbased and design-based simulation experiments and real-life data analysis to evaluate the proposed methodology


title: Bilevel Online Deep Learning in Non-stationary Environment

abstract: Recent years have witnessed enormous progress of online learning. However, a major challenge on the road to artificial agents is concept drift, that is, the data probability distribution would change where the data instance arrives sequentially in a stream fashion, which would lead to catastrophic forgetting and degrade the performance of the model. In this paper, we proposed a new Bilevel Online Deep Learning (BODL) framework, which combine bilevel optimization strategy and online ensemble classifier. In BODL algorithm, we use an ensemble classifier, which use the output of different hidden layers in deep neural network to build multiple base classifiers, the important weights of the base classifiers are updated according to exponential gradient descent method in an online manner. Besides, we apply the similar constraint to overcome the convergence problem of online ensemble framework. Then an effective concept drift detection mechanism utilizing the error rate of classifier is designed to monitor the change of the data probability distribution. When the concept drift is detected, our BODL algorithm can adaptively update the model parameters via bilevel optimization and then circumvent the large drift and encourage positive transfer. Finally, the extensive experiments and ablation studies are conducted on various datasets and the competitive numerical results illustrate that our BODL algorithm is a promising approach.


title: Multiscale machine-learning interatomic potentials for ferromagnetic and liquid iron

abstract: We develop and compare four interatomic potentials for iron: a simple machine-learned embedded atom method (EAM) potential, a potential with machine-learned two- and three-body-dependent terms, a potential with machine-learned EAM and three-body terms, and a Gaussian approximation potential with the SOAP descriptor. All potentials are trained to the same diverse database of body-centered cubic and liquid structures computed with density functional theory. The four presented potentials represent different levels of complexity and span three orders of magnitude in computational cost. The first three potentials are tabulated and evaluated efficiently using cubic spline interpolations, while the fourth one is implemented without additional optimization. We compare and discuss the advantages of each implementation, transferability and applicability in terms of the balance between required accuracy versus computational cost.


title: Accurate effective fluid approximation for ultralight axions

abstract: Ultralight axions are theoretically interesting and phenomenologically rich dark sector candidates, but they are difficult to track across cosmological timescales because of their fast oscillations. We resolve this problem by developing a novel method to evolve them efficiently and accurately. We first construct an exact effective fluid which at late times matches the axion but which evolves in a simple way. We then approximate this evolution with a carefully chosen equation of state and sound speed. With our scheme we find that we can obtain subpercent accuracy for the linear theory suppression of axion density fluctuations relative to that of cold dark matter without tracking even a single complete oscillation of the axion field. We use our technique to test other approximation schemes and to provide a fitting formula for the transfer function for the matter power spectrum in linear theory in axion models. Implementing our approach in existing cosmological axion codes is straightforward and will help unleash the potential of high-precision next-generation experiments.


title: Design choice and machine learning model performances

abstract: An increasing number of publications present the joint application of Design of Experiments (DOE) and machine learning (ML) as a methodology to collect and analyze data on a specific industrial phenomenon. However, the literature shows that the choice of the design for data collection and model for data analysis is often not driven by statistical or algorithmic advantages, thus there is a lack of studies which provide guidelines on what designs and ML models to jointly use for data collection and analysis. This article discusses the choice of design in relation to the ML model performances. A study is conducted that considers 12 experimental designs, 7 families of predictive models, 7 test functions that emulate physical processes, and 8 noise settings, both homoscedastic and heteroscedastic. The results of the research can have an immediate impact on the work of practitioners, providing guidelines for practical applications of DOE and ML.


title: Improving the fusion of acoustic and text representations in RNN-T

abstract: The recurrent neural network transducer (RNN-T) has recently become the mainstream end-to-end approach for streaming automatic speech recognition (ASR). To estimate the output distributions over subword units, RNN-T uses a fully connected layer as the joint network to fuse the acoustic representations extracted using the acoustic encoder with the text representations obtained using the prediction network based on the previous subword units. In this paper, we propose to use gating, bilinear pooling, and a combination of them in the joint network to produce more expressive representations to feed into the output layer. A regularisation method is also proposed to enable better acoustic encoder training by reducing the gradients back-propagated into the prediction network at the beginning of RNN-T training. Experimental results on a multilingual ASR setting for voice search over nine languages show that the joint use of the proposed methods can result in 4%--5% relative word error rate reductions with only a few million extra parameters.


title: Hydrodynamical behavior for the generalized symmetric exclusion with open boundary

abstract: We analyze the generalized symmetric exclusion process, which allows at most $\alpha$ particles per site, and we put it in contact with stochastic reservoirs whose strength is regulated by a parameter $\theta\in\mathbb R$. We prove that the hydrodynamic behavior is given by the heat equation and depending on the value of $\theta$, the equation is supplemented with different boundary conditions. Setting $\alpha = 1$ we find the results known in [1] for the symmetric simple exclusion process.