title: Happenstance: Utilizing Semantic Search to Track Russian State Media Narratives about the Russo-Ukrainian War On Reddit

abstract: In the buildup to and in the weeks following the Russian Federation's invasion of Ukraine, Russian state media outlets output torrents of misleading and outright false information. In this work, we study this coordinated information campaign in order to understand the most prominent state media narratives touted by the Russian government to English-speaking audiences. To do this, we first perform sentence-level topic analysis using the large-language model MPNet on articles published by ten different pro-Russian propaganda websites including the new Russian "fact-checking" website waronfakes.com. Within this ecosystem, we show that smaller websites like katehon.com were highly effective at publishing topics that were later echoed by other Russian sites. After analyzing this set of Russian information narratives, we then analyze their correspondence with narratives and topics of discussion on the r/Russia and 10 other political subreddits. Using MPNet and a semantic search algorithm, we map these subreddits' comments to the set of topics extracted from our set of Russian websites, finding that 39.6% of r/Russia comments corresponded to narratives from pro-Russian propaganda websites compared to 8.86% on r/politics.


title: Noise-Aware Statistical Inference with Differentially Private Synthetic Data

abstract: While generation of synthetic data under differential privacy (DP) has received a lot of attention in the data privacy community, analysis of synthetic data has received much less. Existing work has shown that simply analysing DP synthetic data as if it were real does not produce valid inferences of population-level quantities. For example, confidence intervals become too narrow, which we demonstrate with a simple experiment. We tackle this problem by combining synthetic data analysis techniques from the field of multiple imputation (MI), and synthetic data generation using noise-aware (NA) Bayesian modeling into a pipeline NA+MI that allows computing accurate uncertainty estimates for population-level quantities from DP synthetic data. To implement NA+MI for discrete data generation using the values of marginal queries, we develop a novel noise-aware synthetic data generation algorithm NAPSU-MQ using the principle of maximum entropy. Our experiments demonstrate that the pipeline is able to produce accurate confidence intervals from DP synthetic data. The intervals become wider with tighter privacy to accurately capture the additional uncertainty stemming from DP noise.


title: TRSM Benchmark Planes -- Snowmass White Paper

abstract: In this whitepaper, I briefly review the Benchmark Planes in the Two-Real-Singlet Model (TRSM), a model that enhances the Standard Model (SM) scalar sector by two real singlets that obey a $\mathbb{Z}_2\,\otimes\,\mathbb{Z}_2'$ symmetry. In this model, all fields acquire a vacuum expectation value, such that the model contains in total 3 CP-even neutral scalars that can interact with each other. All interactions with SM-like particles are inherited from the SM-like doublet via mixing. I remind the readers of the previously proposed benchmark planes, and briefly discuss possible production at future Higgs factories.


title: High-dimensional factor copula models with estimation of latent variables

abstract: Factor models are a parsimonious way to explain the dependence of variables using several latent variables. In Gaussian 1-factor and structural factor models (such as bi-factor, oblique factor) and their factor copula counterparts, factor scores or proxies are defined as conditional expectations of latent variables given the observed variables. With mild assumptions, the proxies are consistent for corresponding latent variables as the sample size and the number of observed variables linked to each latent variable go to infinity. When the bivariate copulas linking observed variables to latent variables are not assumed in advance, sequential procedures are used for latent variables estimation, copula family selection and parameter estimation. The use of proxy variables for factor copulas means that approximate log-likelihoods can be used to estimate copula parameters with less computational effort for numerical integration.


title: Norm inflation for the cubic nonlinear heat equation above the scaling critical regularity

abstract: We consider the ill-posedness issue for the cubic nonlinear heat equation and prove norm inflation with infinite loss of regularity in the H\"older-Besov space $\mathcal C^s = B^{s}_{\infty, \infty}$ for $ s \le -\frac 23$. In particular, our result includes the subcritical range $-1< s \le -\frac 23$, which is above the scaling critical regularity $s = -1$ with respect to the H\"older-Besov scale. In view of the well-posedness result in $\mathcal C^s$, $s > -\frac 23$, our ill-posedness result is sharp.


title: Eigenfunction maxima and spherical means

abstract: The eigenfunctions of the Laplacian are a central object from the realms of analytic number theory to geometric analysis. We prove that H\"ormander $L^2$-$L^{\infty}$ estimates are equivalent to restriction estimates to small geodesic spheres for a certain class of manifolds.


title: Quantum electrodynamics of non-demolition detection of single microwave photon by superconducting qubit array

abstract: By consistently applying the formalism of quantum electrodynamics we developed a comprehensive theoretical framework describing the interaction of single microwave photons with an array of superconducting transmon qubits in a wave guide cavity resonator. In particular, we analyze the effects of microwave photons on the arrays response to a weak probe signal exciting the resonator. The study reveals that a high quality factor cavities provide better spectral resolution of the response, while cavities with moderate quality factor allow better sensitivity for a single photon detection. Remarkably, our analysis showed that a single-photon signal can be detected by even a sole qubit in cavity under the realistic range of system parameters. We also discuss how quantum properties of the photons and electrodynamical properties of resonators affect the response of qubits array. Our results provide an efficient theoretical background for informing the development and design of quantum devices consisting of arrays of qubits, especially for those using a cavity where an explicit expression for the transmission or reflection is required.


title: Distribution symmetry of toral eigenfunctions

abstract: In this paper we study a number of conjectures on the behavior of the value distribution of eigenfunctions. On the two dimensional torus we observe that the symmetry conjecture holds in the strongest possible sense. On the other hand we provide a counterexample for higher dimensional tori, which relies on a computer assisted argument. Moreover we prove a theorem on the distribution symmetry of a certain class of trigonometric polynomials that might be of independent interest.


title: A New High-Performance Approach to Approximate Pattern-Matching for Plagiarism Detection in Blockchain-Based Non-Fungible Tokens (NFTs)

abstract: We are presenting a fast and innovative approach to performing approximate pattern-matching for plagiarism detection, using an NDFA-based approach that significantly enhances performance compared to other existing similarity measures. We outline the advantages of our approach in the context of blockchain-based non-fungible tokens (NFTs). We present, formalize, discuss and test our proposed approach in several real-world scenarios and with different similarity measures commonly used in plagiarism detection, and observe significant throughput enhancements throughout the entire spectrum of tests, with little to no compromises on the accuracy of the detection process overall. We conclude that our approach is suitable and adequate to perform approximate pattern-matching for plagiarism detection, and outline research directions for future improvements.


title: Sign equidistribution of Legendre polynomials

abstract: We prove {\em sign equidistribution} of Legendre polynomials: the ratio between the lengths of the regions in the interval $[-1, 1]$ where the Legendre polynomial assumes positive versus negative values, converges to one as the degree grows. The proof method also has application to the symmetry conjecture for a basis of eigenfunctions in the sphere.


title: Balls and Bins -- Simple Concentration Bounds

abstract: Concentration bounds are given for throwing balls into bins independently according to a distribution $p$. The probability of a $k$-loaded bin after $m$ balls is shown to be controlled on both sides by $\rho_{m,k} := m \|p\|_k / k$. This gives concentration inequalities for the maximum load as well as for the waiting time until a $k$-loaded bin.


title: Task-Agnostic Continual Reinforcement Learning: Gaining Insights and Overcoming Challenges

abstract: Continual learning (CL) enables the development of models and agents that learn from a sequence of tasks while addressing the limitations of standard deep learning approaches, such as catastrophic forgetting. In this work, we investigate the factors that contribute to the performance differences between task-agnostic CL and multi-task (MTL) agents. We pose two hypotheses: (1) task-agnostic methods might provide advantages in settings with limited data, computation, or high dimensionality, and (2) faster adaptation may be particularly beneficial in continual learning settings, helping to mitigate the effects of catastrophic forgetting. To investigate these hypotheses, we introduce a replay-based recurrent reinforcement learning (3RL) methodology for task-agnostic CL agents. We assess 3RL on a synthetic task and the Meta-World benchmark, which includes 50 unique manipulation tasks. Our results demonstrate that 3RL outperforms baseline methods and can even surpass its multi-task equivalent in challenging settings with high dimensionality. We also show that the recurrent task-agnostic agent consistently outperforms or matches the performance of its transformer-based counterpart. These findings provide insights into the advantages of task-agnostic CL over task-aware MTL approaches and highlight the potential of task-agnostic methods in resource-constrained, high-dimensional, and multi-task environments.


title: SuperVoice: Text-Independent Speaker Verification Using Ultrasound Energy in Human Speech

abstract: Voice-activated systems are integrated into a variety of desktop, mobile, and Internet-of-Things (IoT) devices. However, voice spoofing attacks, such as impersonation and replay attacks, in which malicious attackers synthesize the voice of a victim or simply replay it, have brought growing security concerns. Existing speaker verification techniques distinguish individual speakers via the spectrographic features extracted from an audible frequency range of voice commands. However, they often have high error rates and/or long delays. In this paper, we explore a new direction of human voice research by scrutinizing the unique characteristics of human speech at the ultrasound frequency band. Our research indicates that the high-frequency ultrasound components (e.g. speech fricatives) from 20 to 48 kHz can significantly enhance the security and accuracy of speaker verification. We propose a speaker verification system, SUPERVOICE that uses a two-stream DNN architecture with a feature fusion mechanism to generate distinctive speaker models. To test the system, we create a speech dataset with 12 hours of audio (8,950 voice samples) from 127 participants. In addition, we create a second spoofed voice dataset to evaluate its security. In order to balance between controlled recordings and real-world applications, the audio recordings are collected from two quiet rooms by 8 different recording devices, including 7 smartphones and an ultrasound microphone. Our evaluation shows that SUPERVOICE achieves 0.58% equal error rate in the speaker verification task, it only takes 120 ms for testing an incoming utterance, outperforming all existing speaker verification systems. Moreover, within 91 ms processing time, SUPERVOICE achieves 0% equal error rate in detecting replay attacks launched by 5 different loudspeakers.


title: BadDet: Backdoor Attacks on Object Detection

abstract: Deep learning models have been deployed in numerous real-world applications such as autonomous driving and surveillance. However, these models are vulnerable in adversarial environments. Backdoor attack is emerging as a severe security threat which injects a backdoor trigger into a small portion of training data such that the trained model behaves normally on benign inputs but gives incorrect predictions when the specific trigger appears. While most research in backdoor attacks focuses on image classification, backdoor attacks on object detection have not been explored but are of equal importance. Object detection has been adopted as an important module in various security-sensitive applications such as autonomous driving. Therefore, backdoor attacks on object detection could pose severe threats to human lives and properties. We propose four kinds of backdoor attacks for object detection task: 1) Object Generation Attack: a trigger can falsely generate an object of the target class; 2) Regional Misclassification Attack: a trigger can change the prediction of a surrounding object to the target class; 3) Global Misclassification Attack: a single trigger can change the predictions of all objects in an image to the target class; and 4) Object Disappearance Attack: a trigger can make the detector fail to detect the object of the target class. We develop appropriate metrics to evaluate the four backdoor attacks on object detection. We perform experiments using two typical object detection models -- Faster-RCNN and YOLOv3 on different datasets. More crucially, we demonstrate that even fine-tuning on another benign dataset cannot remove the backdoor hidden in the object detection model. To defend against these backdoor attacks, we propose Detector Cleanse, an entropy-based run-time detection framework to identify poisoned testing samples for any deployed object detector.


title: Towards a Security Stress-Test for Cloud Configurations

abstract: Securing cloud configurations is an elusive task, which is left up to system administrators who have to base their decisions on ``trial and error'' experimentations or by observing good practices (e.g., CIS Benchmarks). We propose a knowledge, AND/OR, graphs approach to model cloud deployment security objects and vulnerabilities. In this way, we can capture relationships between configurations, permissions (e.g., CAP\_SYS\_ADMIN), and security profiles (e.g., AppArmor and SecComp), as first-class citizens. Such an approach allows us to suggest alternative and safer configurations, support administrators in the study of what-if scenarios, and scale the analysis to large scale deployments. We present an initial validation and illustrate the approach with three real vulnerabilities from known sources.


title: What about high redshift sources in the Main Sequence of quasars?

abstract: Much effort has been done in order to better understand the active galactic nuclei mechanisms behind the relativistic jets observed in radio-loud sources. These phenomena are commonly seen in luminous objects with intermediate/high redshift such as quasars, so that the analysis of the spectroscopic properties of these sources may be a way to clarify this issue. Measurements are presented and contextualized taking advantage of the set of correlations associated with the quasar Main Sequence (MS), a parameter space that allows to connect observed properties to the relative relevance of radiative and gravitational forces. In the redshift range we consider, the low-ionization HI Balmer line H\b{eta} is shifted into the near infrared. Here we present first results of a sample of 22 high-luminosity quasars with redshift between 1.4 and 3.8. Observations covering the H\b{eta} spectral region were collected with the IR spectrometer ISAAC at ESO-VLT. Additional data were collected from SDSS in order to cover the UV region of our sources. The comparison between the strong C IV {\lambda}1549 high-ionization line and H\b{eta} in terms of line widths and shifts with respect to the rest-frame leads to an evaluation of the role of radiative forces in driving an accretion disk wind. While for non-jetted quasars the wind properties have been extensively characterized as a function of luminosity and other physical parameters, the situation is by far less clear for jetted sources. The overarching issue is the effect of the relativistic jets on the wind, and on the structure of the emitting region in general. We present results from our analysis of the optical and UV line profiles aimed to identifying the wind contribution to the line emission.


title: Optimal Decision Diagrams for Classification

abstract: Decision diagrams for classification have some notable advantages over decision trees, as their internal connections can be determined at training time and their width is not bound to grow exponentially with their depth. Accordingly, decision diagrams are usually less prone to data fragmentation in internal nodes. However, the inherent complexity of training these classifiers acted as a long-standing barrier to their widespread adoption. In this context, we study the training of optimal decision diagrams (ODDs) from a mathematical programming perspective. We introduce a novel mixed-integer linear programming model for training and demonstrate its applicability for many datasets of practical importance. Further, we show how this model can be easily extended for fairness, parsimony, and stability notions. We present numerical analyses showing that our model allows training ODDs in short computational times, and that ODDs achieve better accuracy than optimal decision trees, while allowing for improved stability without significant accuracy losses.


title: PO-ELIC: Perception-Oriented Efficient Learned Image Coding

abstract: In the past years, learned image compression (LIC) has achieved remarkable performance. The recent LIC methods outperform VVC in both PSNR and MS-SSIM. However, the low bit-rate reconstructions of LIC suffer from artifacts such as blurring, color drifting and texture missing. Moreover, those varied artifacts make image quality metrics correlate badly with human perceptual quality. In this paper, we propose PO-ELIC, i.e., Perception-Oriented Efficient Learned Image Coding. To be specific, we adapt ELIC, one of the state-of-the-art LIC models, with adversarial training techniques. We apply a mixture of losses including hinge-form adversarial loss, Charbonnier loss, and style loss, to finetune the model towards better perceptual quality. Experimental results demonstrate that our method achieves comparable perceptual quality with HiFiC with much lower bitrate.


title: Some decomposable continua and Whitney levels of their hyperspaces

abstract: We introduce the new class of continua; $D^{**}$-$continua$. The classes of Wilder continua and $D^{*}$-continua are strictly contained in the class of $D^{**}$-continua. Also, the class of $D$-continua is bigger than the class of $D^{**}$-continua. Using $D^{**}$-continua, we give the negative answer to a Question. Furthermore, we prove that being Wilder, being $D$, being $D^*$ and being $D^{**}$ are Whitney properties.


title: Towards Distributed 2-Approximation Steiner Minimal Trees in Billion-edge Graphs

abstract: Given an edge-weighted graph and a set of known seed vertices, a network scientist often desires to understand the graph relationships to explain connections between the seed vertices. When the seed set is 3 or larger Steiner minimal tree - min-weight acyclic connected subgraph (of the input graph) that contains all the seed vertices - is an attractive generalization of shortest weighted paths. In general, computing a Steiner minimal tree is NP-hard, but several polynomial-time algorithms have been designed and proven to yield Steiner trees whose total weight is bounded within 2 times the Steiner minimal tree. In this paper, we present a parallel 2-approximation Steiner minimal tree algorithm and its MPI-based distributed implementation. In place of distance computation between all pairs of seed vertices, an expensive phase in many algorithms, our solution exploits Voronoi cell computation. Also, this approach has higher parallel efficiency than others that involve minimum spanning tree computation on the entire graph. Furthermore, our distributed design exploits asynchronous processing and a message prioritization scheme to accelerate convergence of distance computation, and harnesses both vertex and edge centric processing to offer fast time-to-solution. We demonstrate scalability and performance of our solution using real-world graphs with up to 128 billion edges and 512 compute nodes (8K processes). We compare our solution with the state-of-the-art exact Steiner minimal tree solver, SCIP-Jack, and two serial algorithms. Our solution comfortably outperforms these related works on graphs with 10s million edges and offers decent strong scaling - up to 90% efficient. We empirically show that, on average, the total distance of the Steiner tree identified by our solution is 1.0527 times greater than the Steiner minimal tree - well within the theoretical bound of less than equal to 2.


title: Bayesian prediction via nonparametric transformation models

abstract: This article tackles the old problem of prediction via a nonparametric transformation model (NTM) in a new Bayesian way. Estimation of NTMs is known challenging due to model unidentifiability though appealing because of its robust prediction capability in survival analysis. Inspired by the uniqueness of the posterior predictive distribution, we achieve efficient prediction via the NTM aforementioned under the Bayesian paradigm. Our strategy is to assign weakly informative priors to nonparametric components rather than identify the model by adding complicated constraints in the existing literature. The Bayesian success pays tribute to i) a subtle cast of NTMs by an exponential transformation for the purpose of compressing spaces of infinite-dimensional parameters to positive quadrants considering non-negativity of the failure time; ii) a newly constructed weakly informative quantile-knots I-splines prior for the recast transformation function together with the Dirichlet process mixture model assigned to the error distribution. In addition, we provide a convenient and precise estimator for the identified parameter component subject to the general unit-norm restriction through posterior modification, enabling effective relative risks. Simulations and applications on real datasets reveal that our method is robust and outperforms the competing methods. An R package BuLTM is available to predict survival curves, estimate relative risks, and facilitate posterior checking.


title: Signatures of irreversibility in microscopic models of flocking

abstract: Flocking in $d=2$ is a genuine non-equilibrium phenomenon for which irreversibility is an essential ingredient. We study a class of minimal flocking models whose only source of irreversibility is self-propulsion and use the entropy production rate (EPR) to quantify the departure from equilibrium across their phase diagrams. The EPR is maximal in the vicinity of the order-disorder transition, where reshuffling of the interaction network is fast. We show that signatures of irreversibility come in the form of asymmetries in the steady state distribution of the flock's microstates. They occur as consequences of the time reversal symmetry breaking in the considered self-propelled systems, independently of the interaction details. In the case of metric pairwise forces, they reduce to local asymmetries in the distribution of pairs of particles. This study suggests a possible use of pair asymmetries both to quantify the departure from equilibrium and to learn relevant information about aligning interaction potentials from data.


title: Introducing Non-Linear Activations into Quantum Generative Models

abstract: Due to the linearity of quantum mechanics, it remains a challenge to design quantum generative machine learning models that embed non-linear activations into the evolution of the statevector. However, some of the most successful classical generative models, such as those based on neural networks, involve highly non-linear dynamics for quality training. In this paper, we explore the effect of these dynamics in quantum generative modeling by introducing a model that adds non-linear activations via a neural network structure onto the standard Born Machine framework - the Quantum Neuron Born Machine (QNBM). To achieve this, we utilize a previously introduced Quantum Neuron subroutine, which is a repeat-until-success circuit with mid-circuit measurements and classical control. After introducing the QNBM, we investigate how its performance depends on network size, by training a 3-layer QNBM with 4 output neurons and various input and hidden layer sizes. We then compare our non-linear QNBM to the linear Quantum Circuit Born Machine (QCBM). We allocate similar time and memory resources to each model, such that the only major difference is the qubit overhead required by the QNBM. With gradient-based training, we show that while both models can easily learn a trivial uniform probability distribution, on a more challenging class of distributions, the QNBM achieves an almost 3x smaller error rate than a QCBM with a similar number of tunable parameters. We therefore provide evidence that suggests that non-linearity is a useful resource in quantum generative models, and we put forth the QNBM as a new model with good generative performance and potential for quantum advantage.


title: HPC Extensions to the OpenKIM Processing Pipeline

abstract: The Open Knowledgebase of Interatomic Models (OpenKIM) is an NSF Science Gateway that archives fully functional computer implementations of interatomic models (potentials and force fields) and simulation codes that use them to compute material properties. Interatomic models are coupled with compatible simulation codes and executed in a fully automated manner by the OpenKIM processing pipeline, a cloud-based computation platform. The pipeline as previously introduced in the literature was insufficient to support the large-scale computations that have become necessary within the materials science community. Accordingly, we present extensions made to the pipeline that allow it to utilize High-Performance Computing (HPC) resources in an efficient and performant fashion.


title: Core-set Selection Using Metrics-based Explanations (CSUME) for multiclass ECG

abstract: The adoption of deep learning-based healthcare decision support systems such as the detection of irregular cardiac rhythm is hindered by challenges such as lack of access to quality data and the high costs associated with the collection and annotation of data. The collection and processing of large volumes of healthcare data is a continuous process. The performance of data-hungry Deep Learning models (DL) is highly dependent on the quantity and quality of the data. While the need for data quantity has been established through research adequately, we show how a selection of good quality data improves deep learning model performance. In this work, we take Electrocardiogram (ECG) data as a case study and propose a model performance improvement methodology for algorithm developers, that selects the most informative data samples from incoming streams of multi-class ECG data. Our Core-Set selection methodology uses metrics-based explanations to select the most informative ECG data samples. This also provides an understanding (for algorithm developers) as to why a sample was selected as more informative over others for the improvement of deep learning model performance. Our experimental results show a 9.67% and 8.69% precision and recall improvement with a significant training data volume reduction of 50%. Additionally, our proposed methodology asserts the quality and annotation of ECG samples from incoming data streams. It allows automatic detection of individual data samples that do not contribute to model learning thus minimizing possible negative effects on model performance. We further discuss the potential generalizability of our approach by experimenting with a different dataset and deep learning architecture.


title: Efficient sliding locomotion of three-link bodies with inertia

abstract: Many previous studies of sliding locomotion have assumed that body inertia is negligible. Here we optimize the kinematics of a three-link body for efficient locomotion and include among the kinematic parameters the temporal period of locomotion, or equivalently, the body inertia. The optimal inertia is non-negligible when the coefficient of friction for sliding transverse to the body axis is small. Inertia is also significant in a few cases with relatively large coefficients of friction for transverse and backward sliding, and here the optimal motions are less sensitive to the inertia parameter. The optimal motions seem to converge as the number of frequencies used is increased from one to four. For some of the optimal motions with significant inertia we find dramatic reductions in efficiency when the inertia parameter is decreased to zero. For the motions that are optimal with zero inertia, the efficiency decreases more gradually when we raise the inertia to moderate and large values.


title: Q-LIC: Quantizing Learned Image Compression with Channel Splitting

abstract: Learned image compression (LIC) has reached a comparable coding gain with traditional hand-crafted methods such as VVC intra. However, the large network complexity prohibits the usage of LIC on resource-limited embedded systems. Network quantization is an efficient way to reduce the network burden. This paper presents a quantized LIC (QLIC) by channel splitting. First, we explore that the influence of quantization error to the reconstruction error is different for various channels. Second, we split the channels whose quantization has larger influence to the reconstruction error. After the splitting, the dynamic range of channels is reduced so that the quantization error can be reduced. Finally, we prune several channels to keep the number of overall channels as origin. By using the proposal, in the case of 8-bit quantization for weight and activation of both main and hyper path, we can reduce the BD-rate by 0.61%-4.74% compared with the previous QLIC. Besides, we can reach better coding gain compared with the state-of-the-art network quantization method when quantizing MS-SSIM models. Moreover, our proposal can be combined with other network quantization methods to further improve the coding gain. The moderate coding loss caused by the quantization validates the feasibility of the hardware implementation for QLIC in the future.


title: Multiphase nonlinear electron plasma waves

abstract: We present a method for constructing multiphase excitations in the generally non-integrable system of warm fluid equations describing plasma oscillations. It is based on autoresonant excitation of nonlinear electron plasma waves by phase locking with small amplitude chirped-frequency ponderomotive drives. We demonstrate the excitation of these multiphase waves by performing fully nonlinear numerical simulations of the fluid equations. We develop a simplified model based on a weakly nonlinear analytical theory by applying Whitham's averaged Lagrangian procedure. The simplified model predictions are in good agreement with the results from the warm fluid simulations. Such autoresonantly excited multiphase waves form coherent quasicrystalline structures, which can potentially be used as plasma photonic or accelerating devices. Finally, we discuss the laser parameters required for the autoresonant excitation of nonlinear waves in a plasma.


title: EVIboost for the Estimation of Extreme Value Index under Heterogeneous Extremes

abstract: Modeling heterogeneity on heavy-tailed distributions under a regression framework is challenging, and classical statistical methodologies usually place conditions on the distribution models to facilitate the learning procedure. However, these conditions are likely to overlook the complex dependence structure between the heaviness of tails and the covariates. Moreover, data sparsity on tail regions also makes the inference method less stable, leading to largely biased estimates for extreme-related quantities. This paper proposes a gradient boosting algorithm to estimate a functional extreme value index with heterogeneous extremes. Our proposed algorithm is a data-driven procedure that captures complex and dynamic structures in tail distributions. We also conduct extensive simulation studies to show the prediction accuracy of the proposed algorithm. In addition, we apply our method to a real-world data set to illustrate the state-dependent and time-varying properties of heavy-tail phenomena in the financial industry.


title: Meson scattering in a Lorentz-violating scalar QED at finite temperature

abstract: This paper investigates how the nonzero temperature affects the differential cross-section for mesons scattering in a Lorentz-violating extension of the scalar electrodynamics. We initially discuss some features of the model and extract the zero temperature Feynman rules. Temperature effects are introduced using the Thermo Field Dynamics (TFD) formalism. It is shown that the corrections induced on the meson scattering are very large in the high-temperature regime. Furthermore, our results also suggest that temperature effects may contribute to new constraints on the Lorentz-violating parameters.


title: A Poincar\'e determinant on the torus

abstract: In this work we introduce a Poincar\'e determinant type for operators on the torus $\To^n$. As an application we establish the existence of nontrivial solutions for elliptic equations of the form $(-\Delta)^{\frac{\nu}{2}}u+Qu=0$ on $\To^n$ by using the Hill's method.


title: Additive Higher-Order Factorization Machines

abstract: In the age of big data and interpretable machine learning, approaches need to work at scale and at the same time allow for a clear mathematical understanding of the method's inner workings. While there exist inherently interpretable semi-parametric regression techniques for large-scale applications to account for non-linearity in the data, their model complexity is still often restricted. One of the main limitations are missing interactions in these models, which are not included for the sake of better interpretability, but also due to untenable computational costs. To address this shortcoming, we derive a scalable high-order tensor product spline model using a factorization approach. Our method allows to include all (higher-order) interactions of non-linear feature effects while having computational costs proportional to a model without interactions. We prove both theoretically and empirically that our methods scales notably better than existing approaches, derive meaningful penalization schemes and also discuss further theoretical aspects. We finally investigate predictive and estimation performance both with synthetic and real data.


title: Product and Coproduct on Fixed Point Floer Homology of Positive Dehn Twists

abstract: We compute the product and coproduct structures on the fixed point Floer homology of iterations on the single Dehn twist, subject to some mild topological restrictions. We show that the resulting product and coproduct structures are determined by the product and coproduct on Morse homology of the complement of the twist region, together with certain sectors of product and coproduct structures on the symplectic homology of $T^*S^1$. The computation is done via a direct enumeration of $J-$holomorphic sections: we use a local energy inequality to show that some of the putative holomorphic sections do not exist, and we use a gluing construction plus some Morse-Bott theory to construct the sections we could not rule out.


title: The Relationship between Digital RMB and Digital Economy in China

abstract: By comparing the historical patterns of currency development, this paper pointed out the inevitability of the development of digital currency and the relationship between digital currency and the digital economy. With the example of China, this paper predicts the future development trend of digital currency. In the context of the rapid development of private cryptocurrency, China launched the digital currency based on serving the digital economy and committed to the globalization of the digital renminbi (RMB) and the globalization of the digital economy. The global economy in 2022 ushered in stagnation, and China treats digital fiat currency and the digital economy development as a breakthrough to pursue economic transformation and new growth. It has become one of the forefront countries with numerous experiences that can be learned by countries around the world.


title: Sound propagation in a Bose-Fermi mixture: from weak to strong interactions

abstract: Particle-like excitations, or quasi-particles, emerging from interacting fermionic and bosonic quantum fields underlie many intriguing quantum phenomena in high energy and condensed matter systems. Computation of the properties of these excitations is frequently intractable in the strong interaction regime. Quantum degenerate Bose-Fermi mixtures offer promising prospects to elucidate the physics of such quasi-particles. In this work, we investigate phonon propagation in an atomic Bose-Einstein condensate immersed in a degenerate Fermi gas with interspecies scattering length $a_\text{BF}$ tuned by a Feshbach resonance. We observe sound mode softening with moderate attractive interactions. For even greater attraction, surprisingly, stable sound propagation re-emerges and persists across the resonance. The stability of phonons with resonant interactions opens up opportunities to investigate novel Bose-Fermi liquids and fermionic pairing in the strong interaction regime.


title: Online Learning with Bounded Recall

abstract: We study the problem of full-information online learning in the "bounded recall" setting popular in the study of repeated games. An online learning algorithm $\mathcal{A}$ is $M$-$\textit{bounded-recall}$ if its output at time $t$ can be written as a function of the $M$ previous rewards (and not e.g. any other internal state of $\mathcal{A}$). We first demonstrate that a natural approach to constructing bounded-recall algorithms from mean-based no-regret learning algorithms (e.g., running Hedge over the last $M$ rounds) fails, and that any such algorithm incurs constant regret per round. We then construct a stationary bounded-recall algorithm that achieves a per-round regret of $\Theta(1/\sqrt{M})$, which we complement with a tight lower bound. Finally, we show that unlike the perfect recall setting, any low regret bound bounded-recall algorithm must be aware of the ordering of the past $M$ losses -- any bounded-recall algorithm which plays a symmetric function of the past $M$ losses must incur constant regret per round.


title: Transfer Learning as a Method to Reproduce High-Fidelity NLTE Opacities in Simulations

abstract: Simulations of high-energy density physics often need non-local thermodynamic equilibrium (NLTE) opacity data. This data, however, is expensive to produce at relatively low-fidelity. It is even more so at high-fidelity such that the opacity calculations can contribute ninety-five percent of the total computation time. This proportion can even reach large proportions. Neural networks can be used to replace the standard calculations of low-fidelity data, and the neural networks can be trained to reproduce artificial, high-fidelity opacity spectra. In this work, it is demonstrated that a novel neural network architecture trained to reproduce high-fidelity krypton spectra through transfer learning can be used in simulations. Further, it is demonstrated that this can be done while achieving a relative percent error of the peak radiative temperature of the hohlraum of approximately 1\% to 4\% while achieving a 19.4x speed up.


title: Learning Non-Autoregressive Models from Search for Unsupervised Sentence Summarization

abstract: Text summarization aims to generate a short summary for an input text. In this work, we propose a Non-Autoregressive Unsupervised Summarization (NAUS) approach, which does not require parallel data for training. Our NAUS first performs edit-based search towards a heuristically defined score, and generates a summary as pseudo-groundtruth. Then, we train an encoder-only non-autoregressive Transformer based on the search result. We also propose a dynamic programming approach for length-control decoding, which is important for the summarization task. Experiments on two datasets show that NAUS achieves state-of-the-art performance for unsupervised summarization, yet largely improving inference efficiency. Further, our algorithm is able to perform explicit length-transfer summary generation.


title: A Character-Level Length-Control Algorithm for Non-Autoregressive Sentence Summarization

abstract: Sentence summarization aims at compressing a long sentence into a short one that keeps the main gist, and has extensive real-world applications such as headline generation. In previous work, researchers have developed various approaches to improve the ROUGE score, which is the main evaluation metric for summarization, whereas controlling the summary length has not drawn much attention. In our work, we address a new problem of explicit character-level length control for summarization, and propose a dynamic programming algorithm based on the Connectionist Temporal Classification (CTC) model. Results show that our approach not only achieves higher ROUGE scores but also yields more complete sentences.


title: Risk of Stochastic Systems for Temporal Logic Specifications

abstract: The wide availability of data coupled with the computational advances in artificial intelligence and machine learning promise to enable many future technologies such as autonomous driving. While there has been a variety of successful demonstrations of these technologies, critical system failures have repeatedly been reported. Even if rare, such system failures pose a serious barrier to adoption without a rigorous risk assessment. This paper presents a framework for the systematic and rigorous risk verification of systems. We consider a wide range of system specifications formulated in signal temporal logic (STL) and model the system as a stochastic process, permitting discrete-time and continuous-time stochastic processes. We then define the STL robustness risk as the risk of lacking robustness against failure. This definition is motivated as system failures are often caused by missing robustness to modeling errors, system disturbances, and distribution shifts in the underlying data generating process. Within the definition, we permit general classes of risk measures and focus on tail risk measures such as the value-at-risk and the conditional value-at-risk. While the STL robustness risk is in general hard to compute, we propose the approximate STL robustness risk as a more tractable notion that upper bounds the STL robustness risk. We show how the approximate STL robustness risk can accurately be estimated from system trajectory data. For discrete-time stochastic processes, we show under which conditions the approximate STL robustness risk can even be computed exactly. We illustrate our verification algorithm in the autonomous driving simulator CARLA and show how a least risky controller can be selected among four neural network lane keeping controllers for five meaningful system specifications.


title: Fast rotating non-homogeneous fluids in thin domains and the Ekman pumping effect

abstract: In this paper, we perform the fast rotation limit $\varepsilon\rightarrow0^+$ of the density-dependent incompressible Navier-Stokes-Coriolis system in a thin strip $\Omega_\varepsilon\,:=\,\mathbb{R}^2\times\,]-\ell_\varepsilon,\ell_\varepsilon[\,$, where $\varepsilon\in\,]0,1]$ is the size of the Rossby number and $\ell_\varepsilon>0$ for any $\varepsilon>0$. By letting $\ell_\varepsilon\longrightarrow0^+$ for $\varepsilon\rightarrow0^+$ and considering Navier-slip boundary conditions at the boundary of $\Omega_\varepsilon$, we give a rigorous justification of the phenomenon of the Ekman pumping in the context of non-homogeneous fluids. With respect to previous studies (performed for flows of contant density and for compressible fluids), our approach has the advantage of circumventing the complicated analysis of boundary layers. To the best of our knowledge, this is the first study dealing with the asymptotic analysis of fast rotating incompressible fluids with variable density in a $3$-D setting. In this respect, we remark that the case $\ell_\varepsilon\geq\ell>0$ for all $\varepsilon>0$ remains largely open at present.


title: The Generalized Law of Total Covariance

abstract: A generalization of the law of total covariance is presented and proved.


title: Group-wise Reinforcement Feature Generation for Optimal and Explainable Representation Space Reconstruction

abstract: Representation (feature) space is an environment where data points are vectorized, distances are computed, patterns are characterized, and geometric structures are embedded. Extracting a good representation space is critical to address the curse of dimensionality, improve model generalization, overcome data sparsity, and increase the availability of classic models. Existing literature, such as feature engineering and representation learning, is limited in achieving full automation (e.g., over heavy reliance on intensive labor and empirical experiences), explainable explicitness (e.g., traceable reconstruction process and explainable new features), and flexible optimal (e.g., optimal feature space reconstruction is not embedded into downstream tasks). Can we simultaneously address the automation, explicitness, and optimal challenges in representation space reconstruction for a machine learning task? To answer this question, we propose a group-wise reinforcement generation perspective. We reformulate representation space reconstruction into an interactive process of nested feature generation and selection, where feature generation is to generate new meaningful and explicit features, and feature selection is to eliminate redundant features to control feature sizes. We develop a cascading reinforcement learning method that leverages three cascading Markov Decision Processes to learn optimal generation policies to automate the selection of features and operations and the feature crossing. We design a group-wise generation strategy to cross a feature group, an operation, and another feature group to generate new features and find the strategy that can enhance exploration efficiency and augment reward signals of cascading agents. Finally, we present extensive experiments to demonstrate the effectiveness, efficiency, traceability, and explicitness of our system.


title: On the $p$-Schatten Energy of Bipartite Graphs

abstract: We give a Coulson integral formula and a Coulson-Jacobs formula for the $p$-Schatten energy. We use this formulas to compare the $p$-Schatten energy of different trees by using a quasiorder, and establish the maximality of paths among all trees.


title: Measuring the Monetary Value of Online Volunteer Work

abstract: Online volunteers are a crucial labor force that keeps many for-profit systems afloat (e.g. social media platforms and online review sites). Despite their substantial role in upholding highly valuable technological systems, online volunteers have no way of knowing the value of their work. This paper uses content moderation as a case study and measures its monetary value to make apparent volunteer labor's value. Using a novel dataset of private logs generated by moderators, we use linear mixed-effect regression and estimate that Reddit moderators worked a minimum of 466 hours per day in 2020. These hours amount to 3.4 million USD a year based on the median hourly wage for comparable content moderation services in the U.S. We discuss how this information may inform pathways to alleviate the one-sided relationship between technology companies and online volunteers.


title: All That's Happening behind the Scenes: Putting the Spotlight on Volunteer Moderator Labor in Reddit

abstract: Online volunteers are an uncompensated yet valuable labor force for many social platforms. For example, volunteer content moderators perform a vast amount of labor to maintain online communities. However, as social platforms like Reddit favor revenue generation and user engagement, moderators are under-supported to manage the expansion of online communities. To preserve these online communities, developers and researchers of social platforms must account for and support as much of this labor as possible. In this paper, we quantitatively characterize the publicly visible and invisible actions taken by moderators on Reddit, using a unique dataset of private moderator logs for 126 subreddits and over 900 moderators. Our analysis of this dataset reveals the heterogeneity of moderation work across both communities and moderators. Moreover, we find that analyzing only visible work - the dominant way that moderation work has been studied thus far - drastically underestimates the amount of human moderation labor on a subreddit. We discuss the implications of our results on content moderation research and social platforms.


title: QoE-Aware Resource Allocation for Semantic Communication Networks

abstract: With the aim of accomplishing intelligence tasks, semantic communications transmit task-related information only, yielding significant performance gains over conventional communications. To guarantee user requirements for different types of tasks, we perform the semantic-aware resource allocation in a multi-cell multi-task network in this paper. Specifically, an approximate measure of semantic entropy is first developed to quantify the semantic information for different tasks, based on which a novel quality-of-experience (QoE) model is proposed. We formulate the QoE-aware semantic resource allocation in terms of the number of transmitted semantic symbols, channel assignment, and power allocation. To solve this problem, we first decouple it into two independent subproblems. The first one is to optimize the number of transmitted semantic symbols with given channel assignment and power allocation, which is solved by the exhaustive searching method. The second one is the channel assignment and power allocation subproblem, which is modeled as a many-to-one matching game and solved by the proposed low-complexity matching algorithm. Simulation results demonstrate the effectiveness and superiority of the proposed method on the overall QoE.


title: Fair Division Algorithms for Electricity Distribution

abstract: In many developing countries, the total electricity demand is larger than the limited generation capacity of power stations. Many countries adopt the common practice of routine load shedding - disconnecting entire regions from the power supply - to maintain a balance between demand and supply. Load shedding results in inflicting hardship and discomfort on households, which is even worse and hence unfair to those whose need for electricity is higher than that of others during load shedding hours. Recently, Oluwasuji et al. [2020] presented this problem and suggested several heuristic solutions. In this work, we study the electricity distribution problem as a problem of fair division, model it using the related literature on cake-cutting problems, and discuss some insights on which parts of the time intervals are allocated to each household. We consider four cases: identical demand, uniform utilities; identical demand, additive utilities; different demand, uniform utilities; different demand, additive utilities. We provide the solution for the first two cases and discuss the novel concept of q-times bin packing in relation to the remaining cases. We also show how the fourth case is related to the consensus k-division problem. One can study objectives and constraints using utilitarian and egalitarian social welfare metrics, as well as trying to keep the number of cuts as small as possible. A secondary objective can be to minimize the maximum utility-difference between agents.


title: %CRTFASTGEEPWR: a SAS macro for power of the generalized estimating equations of multi-period cluster randomized trials with application to stepped wedge designs

abstract: Multi-period cluster randomized trials (CRTs) are increasingly used for the evaluation of interventions delivered at the group level. While generalized estimating equations (GEE) are commonly used to provide population-averaged inference in CRTs, there is a gap of general methods and statistical software tools for power calculation based on multi-parameter, within-cluster correlation structures suitable for multi-period CRTs that can accommodate both complete and incomplete designs. A computationally fast, non-simulation procedure for determining statistical power is described for the GEE analysis of complete and incomplete multi-period cluster randomized trials. The procedure is implemented via a SAS macro, \%CRTFASTGEEPWR, which is applicable to binary, count and continuous responses and several correlation structures in multi-period CRTs. The SAS macro is illustrated in the power calculation of two complete and two incomplete stepped wedge cluster randomized trial scenarios under different specifications of marginal mean model and within-cluster correlation structure. The proposed GEE power method is quite general as demonstrated in the SAS macro with numerous input options. The power procedure and macro can also be used in the planning of parallel and crossover CRTs in addition to cross-sectional and closed cohort stepped wedge trials.


title: Cofiniteness with respect to extension of Serre subcategories

abstract: Let $R$ be a commutative noetherian ring, $\frak a$ be an ideal of $R$, $\mathcal{S}$ be an arbitrary Serre subcategory of $R$-modules satisfying the condition $C_{\frak a}$ and let $\mathcal{N}$ be the subcategory of finitely generated $R$-modules. In this paper, we define and study $\mathcal{NS}$-$\frak a$-cofinite modules with respect to the extension subcategory $\mathcal{NS}$ as an generalization of the classical notion, namely $\frak a$-cofinite modules. For the lower dimensions, we show that the classical results of $\frak a$-cofiniteness hold for the new notion.


title: On partially observed jump diffusions II. The filtering density

abstract: A partially observed jump diffusion $Z=(X_t,Y_t)_{t\in[0,T]}$ given by a stochastic differential equation driven by Wiener processes and Poisson martingale measures is considered when the coefficients of the equation satisfy appropriate Lipschitz and growth conditions. Under general conditions it is shown that the conditional density of the unobserved component $X_t$ given the observations $(Y_s)_{s\in[0,T]}$ exists and belongs to $L_p$ if the conditional density of $X_0$ given $Y_0$ exists and belongs to $L_p$.


title: Cofiniteness with respect to extension of Serre subcategories at small dimensions

abstract: Let $R$ be a commutative noetherian ring, $\frak a$ be an ideal of $R$, $\cS$ be an arbitrary Serre subcategory of $R$-modules and let $\cN$ be the subcategory of finitely generated $R$-modules. In this paper, we study $\cN\cS$-$\frak a$-cofinite modules with respect to the extension subcategory $\cN\cS$ when $\dim R/\frak a\leq 2$. We also study $\frak a$-cofiniteness with respect to a new dimension.


title: Configurational microcanonical statistical mechanics from Riemannian geometry of equipotenital level sets

abstract: In the present work, we present a detailed discussion of a Riemannian metric structure originally introduced in [Gori et al., \textit{J. Stat. Mech.}, \textbf{9} 093204 (2018)] on the configuration space and on phase space allowing us to interpret the derivatives of the configurational microcanonical entropy and of the canonical entropy in terms of integrals of extrinsic geometrical quantities associated with the equipotential level sets.


title: Semiclassical estimates for eigenvalue means of Laplacians on spheres

abstract: We compute three-term semiclassical asymptotic expansions of counting functions and Riesz-means of the eigenvalues of the Laplacian on spheres and hemispheres, for both Dirichlet and Neumann boundary conditions. Specifically for Riesz-means we prove upper and lower bounds involving asymptotically sharp shift terms, and we extend them to domains of $\mathbb S^d$. We also prove a Berezin-Li-Yau inequality for domains contained in the hemisphere $\mathbb S^2_+$. Moreover, we consider polyharmonic operators for which we prove analogous results that highlight the role of dimension for P\'olya-type inequalities. Finally, we provide sum rules for Laplacian eigenvalues on spheres and compact two-point homogeneous spaces.


title: Sub-optimal Approaches to Heteroscedasticity in Silicon Strip Detectors: the Lucky Model and the Super-Lucky Model

abstract: The approach to heteroscedasticity of ref.1(Instruments 2022, 6(1), 10) contains a sketchy application of a sub-optimal method of very easy implementation: the lucky model. The supporting proof of this method could not be inserted in ref.1. The proof requires the analytical forms of the probability of ref.2 for the two strip center of gravity. However, those analytical forms suggest also a completion of the lucky-model for the absence of a scaling constant, relevant for combinations of different detector types. The advanced lucky-model (the super-lucky model) can be directly used for track fitting in trackers composed of non-identical detectors. The construction of the weights for the fits is very simple. Simulations of track fitting with this upgraded tool show resolution improvements also for combination of two types of very different detectors, near to the resolutions of the schematic model of ref.1.


title: Improving VAE-based Representation Learning

abstract: Latent variable models like the Variational Auto-Encoder (VAE) are commonly used to learn representations of images. However, for downstream tasks like semantic classification, the representations learned by VAE are less competitive than other non-latent variable models. This has led to some speculations that latent variable models may be fundamentally unsuitable for representation learning. In this work, we study what properties are required for good representations and how different VAE structure choices could affect the learned properties. We show that by using a decoder that prefers to learn local features, the remaining global features can be well captured by the latent, which significantly improves performance of a downstream classification task. We further apply the proposed model to semi-supervised learning tasks and demonstrate improvements in data efficiency.


title: SupMAE: Supervised Masked Autoencoders Are Efficient Vision Learners

abstract: Recently, self-supervised Masked Autoencoders (MAE) have attracted unprecedented attention for their impressive representation learning ability. However, the pretext task, Masked Image Modeling (MIM), reconstructs the missing local patches, lacking the global understanding of the image. This paper extends MAE to a fully supervised setting by adding a supervised classification branch, thereby enabling MAE to learn global features from golden labels effectively. The proposed Supervised MAE (SupMAE) only exploits a visible subset of image patches for classification, unlike the standard supervised pre-training where all image patches are used. Through experiments, we demonstrate that SupMAE is not only more training efficient but it also learns more robust and transferable features. Specifically, SupMAE achieves comparable performance with MAE using only 30% of compute when evaluated on ImageNet with the ViT-B/16 model. SupMAE's robustness on ImageNet variants and transfer learning performance outperforms MAE and standard supervised pre-training counterparts. Codes are available at https://github.com/enyac-group/supmae.


title: $\ell^{\infty}$ Poisson invariance principles from two classical Poisson limit theorems and extension to non-stationary independent sequences

abstract: The simple L\'evy Poisson process and scaled forms are explicitly constructed from partial sums of independent and identically distributed random variables and from sums of non-stationary independent random variables. For the latter, the weak limits are scaled Poisson processes. The method proposed here prepares generalizations to dependent data, to associated data in the first place.


title: How long can LBVs sleep? A long-term photometric vaiability and spectral study of the Galactic candidate luminous blue variable MN112

abstract: Luminous Blue Variables (LBVs) are massive stars that show strong spectral and photometric variability. The question of what evolutionary stages they represent and what exactly drives their instability is still open, and thus is it important to understand whether LBVs without significant ongoing activity exist, and for how long such dormant LBVs may ``sleep''. In this article we investigate the long-term variability properties of the LBV candidate MN112, by combining its optical and infrared spectral data covering 12 years with photometric data covering nearly a century acquired by both modern time-domain sky surveys and historical photographic plates. We analyze the spectra, derive physical properties of the star by modelling its atmosphere and use a new distance estimate from Gaia data release 3 (DR3) to determine the position of MN112 both inside the Galaxy and in the Hertzsprung--Russell diagram. Distance estimation increased in almost two times in comparison with Gaia DR2. Due to that MN112 moved in upper part of the diagram and according to our modeling it lies on evolutionary track for star with initial mass $M_*=70 M_\odot$ near Humphreys--Davidson limit. Given the absence of any significant variability we conclude that the star is a dormant LBV that has been inactive for at least a century now.


title: Spatial Locality and Granularity Change in Caching

abstract: Caches exploit temporal and spatial locality to allow a small memory to provide fast access to data stored in large, slow memory. The temporal aspect of locality is extremely well studied and understood, but the spatial aspect much less so. We seek to gain an increased understanding of spatial locality by defining and studying the Granularity-Change Caching Problem. This problem modifies the traditional caching setup by grouping data items into blocks, such that a cache can choose any subset of a block to load for the same cost as loading any individual item in the block. We show that modeling such spatial locality significantly changes the caching problem. This begins with a proof that Granularity-Change Caching is NP-Complete in the offline setting, even when all items have unit size and all blocks have unit load cost. In the online setting, we show a lower bound for competitive ratios of deterministic policies that is significantly worse than traditional caching. Moreover, we present a deterministic replacement policy called Item-Block Layered Partitioning and show that it obtains a competitive ratio close to that lower bound. Moreover, our bounds reveal a new issue arising in the Granularity-Change Caching Problem where the choice of offline cache size affects the competitiveness of different online algorithms relative to one another. To deal with this issue, we extend a prior (temporal) locality model to account for spatial locality, and provide a general lower bound in addition to an upper bound for Item-Block Layered Partitioning.


title: Temporal support vectors for spiking neuronal networks

abstract: When neural circuits learn to perform a task, it is often the case that there are many sets of synaptic connections that are consistent with the task. However, only a small number of possible solutions are robust to noise in the input and are capable of generalizing their performance of the task to new inputs. Finding such good solutions is an important goal of learning systems in general and neuronal circuits in particular. For systems operating with static inputs and outputs, a well known approach to the problem is the large margin methods such as Support Vector Machines (SVM). By maximizing the distance of the data vectors from the decision surface, these solutions enjoy increased robustness to noise and enhanced generalization abilities. Furthermore, the use of the kernel method enables SVMs to perform classification tasks that require nonlinear decision surfaces. However, for dynamical systems with event based outputs, such as spiking neural networks and other continuous time threshold crossing systems, this optimality criterion is inapplicable due to the strong temporal correlations in their input and output. We introduce a novel extension of the static SVMs - The Temporal Support Vector Machine (T-SVM). The T-SVM finds a solution that maximizes a new construct - the dynamical margin. We show that T-SVM and its kernel extensions generate robust synaptic weight vectors in spiking neurons and enable their learning of tasks that require nonlinear spatial integration of synaptic inputs. We propose T-SVM with nonlinear kernels as a new model of the computational role of the nonlinearities and extensive morphologies of neuronal dendritic trees.


title: Functional Linear Regression of Cumulative Distribution Functions

abstract: The estimation of cumulative distribution functions (CDF) is an important learning task with a great variety of downstream applications, such as risk assessments in predictions and decision making. In this paper, we study functional regression of contextual CDFs where each data point is sampled from a linear combination of context dependent CDF basis functions. We propose functional ridge-regression-based estimation methods that estimate CDFs accurately everywhere. In particular, given $n$ samples with $d$ basis functions, we show estimation error upper bounds of $\widetilde O(\sqrt{d/n})$ for fixed design, random design, and adversarial context cases. We also derive matching information theoretic lower bounds, establishing minimax optimality for CDF functional regression. Furthermore, we remove the burn-in time in the random design setting using an alternative penalized estimator. Then, we consider agnostic settings where there is a mismatch in the data generation process. We characterize the error of the proposed estimators in terms of the mismatched error, and show that the estimators are well-behaved under model mismatch. Moreover, to complete our study, we formalize infinite dimensional models where the parameter space is an infinite dimensional Hilbert space, and establish a self-normalized estimation error upper bound for this setting. Notably, the upper bound reduces to the $\widetilde O(\sqrt{d/n})$ bound when the parameter space is constrained to be $d$-dimensional. Our comprehensive numerical experiments validate the efficacy of our estimation methods in both synthetic and practical settings.


title: The Missing Invariance Principle Found -- the Reciprocal Twin of Invariant Risk Minimization

abstract: Machine learning models often generalize poorly to out-of-distribution (OOD) data as a result of relying on features that are spuriously correlated with the label during training. Recently, the technique of Invariant Risk Minimization (IRM) was proposed to learn predictors that only use invariant features by conserving the feature-conditioned label expectation $\mathbb{E}_e[y|f(x)]$ across environments. However, more recent studies have demonstrated that IRM-v1, a practical version of IRM, can fail in various settings. Here, we identify a fundamental flaw of IRM formulation that causes the failure. We then introduce a complementary notion of invariance, MRI, based on conserving the label-conditioned feature expectation $\mathbb{E}_e[f(x)|y]$, which is free of this flaw. Further, we introduce a simplified, practical version of the MRI formulation called MRI-v1. We prove that for general linear problems, MRI-v1 guarantees invariant predictors given sufficient number of environments. We also empirically demonstrate that MRI-v1 strongly out-performs IRM-v1 and consistently achieves near-optimal OOD generalization in image-based nonlinear problems.


title: Infrared multiple-angle incidence resolution spectrometry for vapor-deposited amorphous water

abstract: Infrared (IR) multiple-angle incidence resolution spectrometry (IR-MAIRS) is a recently developed spectroscopic technique that combines oblique incidence transmission measurements and chemometrics (multivariate analysis) to obtain both pure in-plane (IP) and out-of-plane (OP) vibration spectra for a thin sample. IR-MAIRS is established for analyzing the molecular orientation of organic thin films at atmospheric pressure, but it should also be powerful for the structural characterization of vapor-deposited thin samples prepared in a vacuum. The application of IR-MAIRS to vapor-deposited amorphous water is particularly interesting in the fields of physical and interstellar chemistry, because it is a representative model material for interstellar icy dust grains. We recently developed an experimental setup for in situ IR-MAIRS under low-temperature, ultra-high-vacuum conditions, which thus facilitates measurements of interstellar ice analogues such as vapor-deposited amorphous water. This review considers the theoretical framework of IR-MAIRS and our recent experimental results for vapor-deposited amorphous water. We present spectroscopic signatures for the perpendicular orientation of dangling OH bonds for three-coordinated water molecules at the surface of amorphous water at 90 K. The absolute absorption cross-section of the three-coordinated dangling OH bonds is quantitatively measured. As IR-MAIRS can essentially be conducted using only a Fourier-transform IR spectrometer and an angle-controllable linear polarizer, it is a useful, low-cost, and simple spectroscopic technique for studying laboratory analogues of interstellar ices including vapor-deposited amorphous water.

categories: astro-ph.IM astro-ph.EP astro-ph.GA physics.chem-ph


title: Image Super-resolution with An Enhanced Group Convolutional Neural Network

abstract: CNNs with strong learning abilities are widely chosen to resolve super-resolution problem. However, CNNs depend on deeper network architectures to improve performance of image super-resolution, which may increase computational cost in general. In this paper, we present an enhanced super-resolution group CNN (ESRGCNN) with a shallow architecture by fully fusing deep and wide channel features to extract more accurate low-frequency information in terms of correlations of different channels in single image super-resolution (SISR). Also, a signal enhancement operation in the ESRGCNN is useful to inherit more long-distance contextual information for resolving long-term dependency. An adaptive up-sampling operation is gathered into a CNN to obtain an image super-resolution model with low-resolution images of different sizes. Extensive experiments report that our ESRGCNN surpasses the state-of-the-arts in terms of SISR performance, complexity, execution speed, image quality evaluation and visual effect in SISR. Code is found at https://github.com/hellloxiaotian/ESRGCNN.


title: Asymmetric Local Information Privacy and the Watchdog Mechanism

abstract: This paper proposes a novel watchdog privatization scheme by generalizing local information privacy (LIP) to enhance data utility. To protect the sensitive features $S$ correlated with some useful data $X$, LIP restricts the lift, the ratio of the posterior belief to the prior on $S$ after and before accessing $X$. For each $x$, both maximum and minimum lift over sensitive features are measures of the privacy risk of publishing this symbol and should be restricted for the privacy-preserving purpose. Previous works enforce the same bound for both max-lift and min-lift. However, empirical observations show that the min-lift is usually much smaller than the max-lift. In this work, we generalize the LIP definition to consider the unequal values of max and min lift, i.e., considering different bounds for max-lift and min-lift. This new definition is applied to the watchdog privacy mechanism. We demonstrate that the utility is enhanced under a given privacy constraint on local differential privacy. At the same time, the resulting max-lift is lower and, therefore, tightly restricts other privacy leakages, e.g., mutual information, maximal leakage, and $\alpha$-leakage.


title: Machine Learning for Microcontroller-Class Hardware: A Review

abstract: The advancements in machine learning opened a new opportunity to bring intelligence to the low-end Internet-of-Things nodes such as microcontrollers. Conventional machine learning deployment has high memory and compute footprint hindering their direct deployment on ultra resource-constrained microcontrollers. This paper highlights the unique requirements of enabling onboard machine learning for microcontroller class devices. Researchers use a specialized model development workflow for resource-limited applications to ensure the compute and latency budget is within the device limits while still maintaining the desired performance. We characterize a closed-loop widely applicable workflow of machine learning model development for microcontroller class devices and show that several classes of applications adopt a specific instance of it. We present both qualitative and numerical insights into different stages of model development by showcasing several use cases. Finally, we identify the open research challenges and unsolved questions demanding careful considerations moving forward.


title: Exploration of the computational model and the focusing process with a Flat Multi-channel Plate and a Curved Multi-channel Plate in the MATLAB

abstract: By simulating the X-ray paths and the Chapman Model of a flat multi-channel plate and a curved multi-channel plate in the MATLAB, the field of view, local reflection efficiency, spherical aberration, point-spread function, collection efficiency of incident X-ray and peak-to-background ratio on the focal plane of the two devices were compared. At the same time, the advantages and disadvantages of the flat multi-channel plate and the curved multi-channel plate were compared.


title: Staggered Rollout Designs Enable Causal Inference Under Interference Without Network Knowledge

abstract: Randomized experiments are widely used to estimate causal effects across a variety of domains. However, classical causal inference approaches rely on critical independence assumptions that are violated by network interference, when the treatment of one individual influences the outcomes of others. All existing approaches require at least approximate knowledge of the network, which may be unavailable and costly to collect. We consider the task of estimating the total treatment effect (TTE), or the average difference between the outcomes when the whole population is treated versus when the whole population is untreated. By leveraging a staggered rollout design, in which treatment is incrementally given to random subsets of individuals, we derive unbiased estimators for TTE that do not rely on any prior structural knowledge of the network, as long as the network interference effects are constrained to low-degree interactions among neighbors of an individual. We derive bounds on the variance of the estimators, and we show in experiments that our estimator performs well against baselines on simulated data. Central to our theoretical contribution is a connection between staggered rollout observations and polynomial extrapolation.


title: Long-Tailed Learning Requires Feature Learning

abstract: We propose a simple data model inspired from natural data such as text or images, and use it to study the importance of learning features in order to achieve good generalization. Our data model follows a long-tailed distribution in the sense that some rare subcategories have few representatives in the training set. In this context we provide evidence that a learner succeeds if and only if it identifies the correct features, and moreover derive non-asymptotic generalization error bounds that precisely quantify the penalty that one must pay for not learning features.


title: The Shadow of Supertranslated Schwarzschild Black Hole

abstract: The supertranslated black hole proposed by Hawking, Perry, and Strominger might provide a resolution to the information paradox, which is usually defined by a complicated space-time metric with even less space-time symmetries compared to Kerr black hole. In this paper, we figure out the shadow for the supertranslated Schwarzschild black hole by making use of supertranslated 4-velocities and the trajectories of the light rays. Based on this approach, we find that the photon sphere gets distorted due to the supertranslation hairs and the position of the shadow on the projection plane is shifted by the supertranslation vector, but the size and shape of the shadow remain the same as those of Schwarzschild black hole.


title: Two New Piggybacking Designs with Lower Repair Bandwidth

abstract: Piggybacking codes are a special class of MDS array codes that can achieve small repair bandwidth with small sub-packetization by first creating some instances of an $(n,k)$ MDS code, such as a Reed-Solomon (RS) code, and then designing the piggyback function. In this paper, we propose a new piggybacking coding design which designs the piggyback function over some instances of both $(n,k)$ MDS code and $(n,k')$ MDS code, when $k\geq k'$. We show that our new piggybacking design can significantly reduce the repair bandwidth for single-node failures. When $k=k'$, we design piggybacking code that is MDS code and we show that the designed code has lower repair bandwidth for single-node failures than all existing piggybacking codes when the number of parity node $r=n-k\geq8$ and the sub-packetization $\alpha<r$. Moreover, we propose another piggybacking codes by designing $n$ piggyback functions of some instances of $(n,k)$ MDS code and adding the $n$ piggyback functions into the $n$ newly created empty entries with no data symbols. We show that our code can significantly reduce repair bandwidth for single-node failures at a cost of slightly more storage overhead. In addition, we show that our code can recover any $r+1$ node failures for some parameters. We also show that our code has lower repair bandwidth than locally repairable codes (LRCs) under the same fault-tolerance and redundancy for some parameters.


title: Tight bounds towards a conjecture of Gallai

abstract: We prove that for $n>k\geq 3$, if $G$ is an $n$-vertex graph with chromatic number $k$ but any its proper subgraph has smaller chromatic number, then $G$ contains at most $n-k+3$ copies of cliques of size $k-1$. This answers a problem of Abbott and Zhou and provides a tight bound on a conjecture of Gallai.


title: Frustratingly Easy Regularization on Representation Can Boost Deep Reinforcement Learning

abstract: Deep reinforcement learning (DRL) gives the promise that an agent learns good policy from high-dimensional information, whereas representation learning removes irrelevant and redundant information and retains pertinent information. In this work, we demonstrate that the learned representation of the $Q$-network and its target $Q$-network should, in theory, satisfy a favorable distinguishable representation property. Specifically, there exists an upper bound on the representation similarity of the value functions of two adjacent time steps in a typical DRL setting. However, through illustrative experiments, we show that the learned DRL agent may violate this property and lead to a sub-optimal policy. Therefore, we propose a simple yet effective regularizer called Policy Evaluation with Easy Regularization on Representation (PEER), which aims to maintain the distinguishable representation property via explicit regularization on internal representations. And we provide the convergence rate guarantee of PEER. Implementing PEER requires only one line of code. Our experiments demonstrate that incorporating PEER into DRL can significantly improve performance and sample efficiency. Comprehensive experiments show that PEER achieves state-of-the-art performance on all 4 environments on PyBullet, 9 out of 12 tasks on DMControl, and 19 out of 26 games on Atari. To the best of our knowledge, PEER is the first work to study the inherent representation property of Q-network and its target. Our code is available at https://sites.google.com/view/peer-cvpr2023/.


title: Exploiting Partial FDD Reciprocity for Beam Based Pilot Precoding and CSI Feedback in Deep Learning

abstract: Massive MIMO systems can achieve high spectrum and energy efficiency in downlink (DL) based on accurate estimate of channel state information (CSI). Existing works have developed learning-based DL CSI estimation that lowers uplink feedback overhead. One often overlooked problem is the limited number of DL pilots available for CSI estimation. One proposed solution leverages temporal CSI coherence by utilizing past CSI estimates and only sending CSI-reference symbols (CSI-RS) for partial arrays to preserve CSI recovery performance. Exploiting CSI correlations, FDD channel reciprocity is helpful to base stations with direct access to uplink CSI. In this work, we propose a new learning-based feedback architecture and a reconfigurable CSI-RS placement scheme to reduce DL CSI training overhead and to improve encoding efficiency of CSI feedback. Our results demonstrate superior performance in both indoor and outdoor scenarios by the proposed framework for CSI recovery at substantial reduction of computation power and storage requirements at UEs.


title: The Buffon's needle problem for random planar disk-like Cantor sets

abstract: We consider a model of randomness for self-similar Cantor sets of finite and positive $1$-Hausdorff measure. We find the sharp rate of decay of the probability that a Buffon needle lands $\delta$-close to a Cantor set of this particular randomness. Two quite different models of randomness for Cantor sets, by Peres and Solomyak, and by Shiwen Zhang, appear to have the same order of decay for the Buffon needle probability: $\frac{c}{\log\frac{1}{\delta}}$. In this note, we prove the same rate of decay for a third model of randomness, which asserts a vague feeling that any "reasonable" random Cantor set of positive and finite length will have Favard length of order $\frac{c}{\log\frac{1}{\delta}}$ for its $\delta$-neighbourhood. The estimate from below was obtained long ago by Mattila.


title: A well-balanced moving mesh discontinuous Galerkin method for the Ripa model on triangular meshes

abstract: A well-balanced moving mesh discontinuous Galerkin (DG) method is proposed for the numerical solution of the Ripa model -- a generalization of the shallow water equations that accounts for effects of water temperature variations. Thermodynamic processes are important particularly in the upper layers of the ocean where the variations of sea surface temperature play a fundamental role in climate change. The well-balance property which requires numerical schemes to preserve the lake-at-rest steady state is crucial to the simulation of perturbation waves over that steady state such as waves on a lake or tsunami waves in the deep ocean. To ensure the well-balance, positivity-preserving, and high-order properties, a DG-interpolation scheme (with or without scaling positivity-preserving limiter) and special treatments pertaining to the Ripa model are employed in the transfer of both the flow variables and bottom topography from the old mesh to the new one and in the TVB limiting process. Mesh adaptivity is realized using an MMPDE moving mesh approach and a metric tensor based on an equilibrium variable and water depth. A motivation is to adapt the mesh according to both the perturbations of the lake-at-rest steady state and the water depth distribution (bottom structure). Numerical examples in one and two dimensions are presented to demonstrate the well-balance, high-order accuracy, and positivity-preserving properties of the method and its ability to capture small perturbations of the lake-at-rest steady state.


title: Optimizing incompatible triple quantum measurements

abstract: We investigate the optimal approximation to triple incompatible quantum measurements within the framework of statistical distance and joint measurability. According to the lower bound of the uncertainty inequality presented in [Physical Review A 99, 312107 (2019)], we give the analytical expressions of the optimal jointly measurable approximation to two kinds of triple incompatible unbiased qubit measurements. We also obtain the corresponding states which give the minimal approximation errors in measuring process. The results give rise to plausible experimental verifications of such statistical distance based uncertainty relations.


title: Regularized Integrals on Elliptic Curves and Holomorphic Anomaly Equations

abstract: We derive residue formulas for the regularized integrals (introduced by Li-Zhou) on configuration spaces of elliptic curves. Based on these formulas, we prove that the regularized integrals satisfy holomorphic anomaly equations, providing a mathematical formulation of the so-called contact term singularities. We also discuss residue formulas for the ordered $A$-cycle integrals and establish their relations with those for the regularized integrals.

categories: math.DG hep-th math-ph math.CV math.MP math.NT


title: Prospect of detecting TeV halos with LHAASO: in the framework of the anisotropic diffusion model

abstract: The particle diffusion coefficients of three TeV pulsar halos observed so far are inferred to be significantly smaller than the typical value of the interstellar medium (ISM). The anisotropic diffusion model ascribes the slow diffusion to the cross-field diffusion assuming sub-Alfv{\'e}nic turbulence in the ISM around the pulsar if the viewing angle between the observer's line-of-sight (LOS) to the pulsar and the local mean field direction is small. In general, the TeV halo's morphology under this model highly depends on the viewing angle, and an elongated, asymmetric morphology is predicted if the LOS is not approximately aligned with the local mean field direction. While the specific requirement of a small viewing angle is supposedly established only for a small fraction of TeV halos, TeV halos with apparent asymmetric morphology has not been detected. In this paper we will study the expectation of TeV halos measured by the TeV-PeV gamma-ray detector LHAASO in the framework of anisotropic diffusion model, with a particular focus on the influence of the viewing angle on the detectability. We show that a TeV halo is more detectable with a smaller viewing angle and this selection effect may explain why the morphologies of all three detected TeV halos so far are consistent being spherical. We also demonstrate that LHAASO is capable of detecting asymmetric TeV halos after several-year operation with reasonable source parameters. This can serve as a critical test of the anisotropic diffusion model.


title: Anomalous wavefront control via nonlinear acoustic metasurface through second-harmonic tailoring and demultiplexing

abstract: We propose a nonlinear acoustic metasurface concept by exploiting the nonlinearity of the locally resonant unit cells formed by curved beams. The analytical model is established to explore the nonlinear phenomenon, specifically the second-harmonic generation (SHG) of the acoustic waveguide and validated through numerical and experimental studies. Novel nonlinear acoustic metasurfaces are developed to demultiplex different frequency components and achieve anomalous wavefront control of SHG in the transmitted region. To this end, we demonstrate wave steering, wave focusing, and self-bending propagation. Our results show that the proposed nonlinear metasurface provides an effective and efficient platform to achieve significant SHG, and separate different harmonic components for wavefront control of individual harmonics. Overall, this study offers new avenues to harness nonlinear effects for acoustic wavefront tailoring and develops new potential toward advanced technologies to manipulate acoustic waves.


title: Projection spaces and twisted Lie algebras

abstract: A projection space is a collection of spaces interrelated by the combinatorics of projection onto tensor factors in a symmetric monoidal background category. Examples include classical configuration spaces, orbit configuration spaces, the graphical configuration spaces of Eastwood--Huggett, the simplicial configuration spaces of Cooper--de Silva--Sazdanovic, the generalized configuration spaces of Petersen, and Stiefel manifolds. We show that, under natural assumptions on the background category, the homology of a projection space is calculated by the Chevalley--Eilenberg complex of a certain generalized Lie algebra. We identify conditions on this Lie algebra implying representation stability in the classical setting of finite sets and injections.


title: ProxyMix: Proxy-based Mixup Training with Label Refinery for Source-Free Domain Adaptation

abstract: Unsupervised domain adaptation (UDA) aims to transfer knowledge from a labeled source domain to an unlabeled target domain. Owing to privacy concerns and heavy data transmission, source-free UDA, exploiting the pre-trained source models instead of the raw source data for target learning, has been gaining popularity in recent years. Some works attempt to recover unseen source domains with generative models, however introducing additional network parameters. Other works propose to fine-tune the source model by pseudo labels, while noisy pseudo labels may misguide the decision boundary, leading to unsatisfied results. To tackle these issues, we propose an effective method named Proxy-based Mixup training with label refinery (ProxyMix). First of all, to avoid additional parameters and explore the information in the source model, ProxyMix defines the weights of the classifier as the class prototypes and then constructs a class-balanced proxy source domain by the nearest neighbors of the prototypes to bridge the unseen source domain and the target domain. To improve the reliability of pseudo labels, we further propose the frequency-weighted aggregation strategy to generate soft pseudo labels for unlabeled target data. The proposed strategy exploits the internal structure of target features, pulls target features to their semantic neighbors, and increases the weights of low-frequency classes samples during gradient updating. With the proxy domain and the reliable pseudo labels, we employ two kinds of mixup regularization, i.e., inter- and intra-domain mixup, in our framework, to align the proxy and the target domain, enforcing the consistency of predictions, thereby further mitigating the negative impacts of noisy labels. Experiments on three 2D image and one 3D point cloud object recognition benchmarks demonstrate that ProxyMix yields state-of-the-art performance for source-free UDA tasks.


title: Input-to-State Safety with Input Delay in Longitudinal Vehicle Control

abstract: Safe longitudinal control is discussed for a connected automated truck traveling behind a preceding connected vehicle. A controller is proposed based on control barrier function theory and predictor feedback for provably safe, collision-free behavior by taking into account the significant response time of the truck as input delay and the uncertainty of its dynamical model as input disturbance. The benefits of the proposed controller compared to control designs that neglect the delay or treat the delay as disturbance are shown by numerical simulations.


title: Conditionally Calibrated Predictive Distributions by Probability-Probability Map: Application to Galaxy Redshift Estimation and Probabilistic Forecasting

abstract: Uncertainty quantification is crucial for assessing the predictive ability of AI algorithms. Much research has been devoted to describing the predictive distribution (PD) $F(y|\mathbf{x})$ of a target variable $y \in \mathbb{R}$ given complex input features $\mathbf{x} \in \mathcal{X}$. However, off-the-shelf PDs (from, e.g., normalizing flows and Bayesian neural networks) often lack conditional calibration with the probability of occurrence of an event given input $\mathbf{x}$ being significantly different from the predicted probability. Current calibration methods do not fully assess and enforce conditionally calibrated PDs. Here we propose \texttt{Cal-PIT}, a method that addresses both PD diagnostics and recalibration by learning a single probability-probability map from calibration data. The key idea is to regress probability integral transform scores against $\mathbf{x}$. The estimated regression provides interpretable diagnostics of conditional coverage across the feature space. The same regression function morphs the misspecified PD to a re-calibrated PD for all $\mathbf{x}$. We benchmark our corrected prediction bands (a by-product of corrected PDs) against oracle bands and state-of-the-art predictive inference algorithms for synthetic data. We also provide results for two applications: (i) probabilistic nowcasting given sequences of satellite images, and (ii) conditional density estimation of galaxy distances given imaging data (so-called photometric redshift estimation). Our code is available as a Python package https://github.com/lee-group-cmu/Cal-PIT .


title: Magnon squeezing enhanced entanglement in a cavity magnomechanical system

abstract: We investigate the generation of the entanglement in a cavity magnomechanical system, which consists of three modes: a magnon mode, a microwave cavity mode and a mechanical vibration mode, the couplings of the magnon-photon and the magnon-phonon are achieved by the magnetic dipole interaction and the magnetostrictive interaction, respectively. By introducing a squeezing of the magnon mode, the magnon-photon and the magnon-phonon entanglements are significantly enhanced compared with the case without inserting the magnon squeezing. We find that an optimal parameter of the squeezing exists, which yields the maximum entanglement. This study provides a new idea for exploring the properties of quantum entanglement in the the cavity magnomechanical systems, and may have some potential applications in the quantum state engineering.


title: MiniDisc: Minimal Distillation Schedule for Language Model Compression

abstract: Recent studies have uncovered that language model distillation is less effective when facing a large capacity gap between the teacher and the student, and introduced teacher assistant-based distillation to bridge the gap. As a connection, the scale and the performance of the teacher assistant is of vital importance to bring the knowledge from the teacher to the student. However, existing teacher assistant-based methods require maximally many trials before scheduling an optimal teacher assistant. To this end, we propose a minimal distillation schedule (MiniDisc) for scheduling the optimal teacher assistant in minimally one trial. In particular, motivated by the finding that the performance of the student is positively correlated to the scale-performance tradeoff of the teacher assistant, MiniDisc is designed with a $\lambda$-tradeoff to measure the optimality of the teacher assistant without trial distillation to the student. MiniDisc then can schedule the optimal teacher assistant with the best $\lambda$-tradeoff in a sandwich framework. MiniDisc is evaluated with an extensive set of experiments on GLUE. Experimental results demonstrate the improved efficiency our MiniDisc compared to several state-of-the-art baselines. We further apply MiniDisc to a language model with billions of parameters and show its scalability.


title: Provable Benefits of Representational Transfer in Reinforcement Learning

abstract: We study the problem of representational transfer in RL, where an agent first pretrains in a number of source tasks to discover a shared representation, which is subsequently used to learn a good policy in a \emph{target task}. We propose a new notion of task relatedness between source and target tasks, and develop a novel approach for representational transfer under this assumption. Concretely, we show that given generative access to source tasks, we can discover a representation, using which subsequent linear RL techniques quickly converge to a near-optimal policy in the target task. The sample complexity is close to knowing the ground truth features in the target task, and comparable to prior representation learning results in the source tasks. We complement our positive results with lower bounds without generative access, and validate our findings with empirical evaluation on rich observation MDPs that require deep exploration. In our experiments, we observe a speed up in learning in the target by pre-training, and also validate the need for generative access in source tasks.


title: No-regret Learning in Repeated First-Price Auctions with Budget Constraints

abstract: Recently the online advertising market has exhibited a gradual shift from second-price auctions to first-price auctions. Although there has been a line of works concerning online bidding strategies in first-price auctions, it still remains open how to handle budget constraints in the problem. In the present paper, we initiate the study for a buyer with budgets to learn online bidding strategies in repeated first-price auctions. We propose an RL-based bidding algorithm against the optimal non-anticipating strategy under stationary competition. Our algorithm obtains $\widetilde O(\sqrt T)$-regret if the bids are all revealed at the end of each round. With the restriction that the buyer only sees the winning bid after each round, our modified algorithm obtains $\widetilde O(T^{\frac{7}{12}})$-regret by techniques developed from survival analysis. Our analysis extends to the more general scenario where the buyer has any bounded instantaneous utility function with regrets of the same order.