title: Stochastic Approximation Beyond Gradient for Signal Processing and Machine Learning

abstract: Stochastic Approximation (SA) is a classical algorithm that has had since the early days a huge impact on signal processing, and nowadays on machine learning, due to the necessity to deal with a large amount of data observed with uncertainties. An exemplar special case of SA pertains to the popular stochastic (sub)gradient algorithm which is the working horse behind many important applications. A lesser-known fact is that the SA scheme also extends to non-stochastic-gradient algorithms such as compressed stochastic gradient, stochastic expectation-maximization, and a number of reinforcement learning algorithms. The aim of this article is to overview and introduce the non-stochastic-gradient perspectives of SA to the signal processing and machine learning audiences through presenting a design guideline of SA algorithms backed by theories. Our central theme is to propose a general framework that unifies existing theories of SA, including its non-asymptotic and asymptotic convergence results, and demonstrate their applications on popular non-stochastic-gradient algorithms. We build our analysis framework based on classes of Lyapunov functions that satisfy a variety of mild conditions. We draw connections between non-stochastic-gradient algorithms and scenarios when the Lyapunov function is smooth, convex, or strongly convex. Using the said framework, we illustrate the convergence properties of the non-stochastic-gradient algorithms using concrete examples. Extensions to the emerging variance reduction techniques for improved sample complexity will also be discussed.


title: MGAB-V240: 23-min AM CVn star showing both 12-d supercycle and standstills

abstract: Using Zwicky Transient Facility (ZTF) data, I noticed that MGAB-V240 = PS1-3PI J185529.82+323017.8 showed two different states: regularly outbursting state with a cycle length of 12 d and standstills. I found that the regularly outbursting state was in fact a sequence of superoutburst and intervening normal outbursts comprising a 12 d supercycle. During one of the superoutbursts, superhumps with a period of 0.015824(9) d (=22.79 min) were detected in the ZTF time-resolved data. This period and behavior have confirmed that MGAB-V240 is an AM CVn-type object with the shortest known supercycle and the second known AM CVn star showing genuine standstills. The standstills in this system were interrupted by short drops and the system often brightened after these drops. This phenomenon can be explained by the accumulation of the transferred matter in the outer part of the disk during the drops. This phenomenon favors a constant mass-transfer from the secondary combined with the difficulty in maintaining the hot state in a helium disk rather than a temporary decrease of the mass-transfer rate as the cause of these drops. MGAB-V240 should be close to the border of the thermal instability of a helium disk, and the observed superhump period agrees very well with the activity sequence expected by the disk instability theory and the evolutionary sequence of AM CVn stars.


title: Multiscale Sampling for the Inverse Modeling of Partial Differential Equations

abstract: We are concerned with a novel Bayesian statistical framework for the characterization of natural subsurface formations, a very challenging task. Because of the large dimension of the stochastic space of the prior distribution in the framework, typically a dimensional reduction method, such as a Karhunen-Leove expansion (KLE), needs to be applied to the prior distribution to make the characterization computationally tractable. Due to the large variability of properties of subsurface formations (such as permeability and porosity) it may be of value to localize the sampling strategy so that it can better adapt to large local variability of rock properties. In this paper, we introduce the concept of multiscale sampling to localize the search in the stochastic space. We combine the simplicity of a preconditioned Markov Chain Monte Carlo method with a new algorithm to decompose the stochastic space into orthogonal subspaces, through a one-to-one mapping of the subspaces to subdomains of a non-overlapping domain decomposition of the region of interest. The localization of the search is performed by a multiscale blocking strategy within Gibbs sampling: we apply a KL expansion locally, at the subdomain level. Within each subdomain, blocking is applied again, for the sampling of the KLE random coefficients. The effectiveness of the proposed framework is tested in the solution of inverse problems related to elliptic partial differential equations arising in porous media flows. We use multi-chain studies in a multi-GPU cluster to show that the new algorithm clearly improves the convergence rate of the preconditioned MCMC method. Moreover, we illustrate the importance of a few conditioning points to further improve the convergence of the proposed method.


title: Microusity: A testing tool for Backends for Frontends (BFF) Microservice Systems

abstract: The microservice software architecture is more scalable and efficient than its monolithic predecessor. Despite its increasing adoption, microservices might expose security concerns and issues that are distinct from those associated with monolithic designs. We propose Microusity, a tool that performs RESTful API testing on a specific type of microservice pattern called back end for front end (BFF). We design a novel approach to trace BFF requests using the port mapping between requests to BFF and the sub-requests sent to back-end microservices. Furthermore, our tool can pinpoint which of the back end service causing the internal server error, which may lead to unhandled errors or vulnerabilities. Microusity provides an error report and a graph visualization that reveal the source of the error and supports developers in comprehension and debugging of the errors. The evaluation of eight software practitioners shows that Microusity and its security test reports are useful for investigating and understanding problems in BFF systems. The prototype tool and the video demo of the tool can be found at https://github.com/MUICT-SERU/MICROUSITY.


title: Improved Coresets for Clustering with Capacity and Fairness Constraints

abstract: We study coresets for clustering with capacity and fairness constraints. Our main result is a near-linear time algorithm to construct $\tilde{O}(k^2\varepsilon^{-2z-2})$-sized $\varepsilon$-coresets for capacitated $(k,z)$-clustering which improves a recent $\tilde{O}(k^3\varepsilon^{-3z-2})$ bound by [BCAJ+22, HJLW23]. As a corollary, we also save a factor of $k \varepsilon^{-z}$ on the coreset size for fair $(k,z)$-clustering compared to them. We fundamentally improve the hierarchical uniform sampling framework of [BCAJ+22] by adaptively selecting sample size on each ring instance, proportional to its clustering cost to an optimal solution. Our analysis relies on a key geometric observation that reduces the number of total ``effective centers" from [BCAJ+22]'s $\tilde{O}(k^2\varepsilon^{-z})$ to merely $O(k\log \varepsilon^{-1})$ by being able to ``ignore'' all center points that are too far or too close to the ring center.


title: Multi-Message Shuffled Privacy in Federated Learning

abstract: We study differentially private distributed optimization under communication constraints. A server using SGD for optimization aggregates the client-side local gradients for model updates using distributed mean estimation (DME). We develop a communication-efficient private DME, using the recently developed multi-message shuffled (MMS) privacy framework. We analyze our proposed DME scheme to show that it achieves the order-optimal privacy-communication-performance tradeoff resolving an open question in [1], whether the shuffled models can improve the tradeoff obtained in Secure Aggregation. This also resolves an open question on the optimal trade-off for private vector sum in the MMS model. We achieve it through a novel privacy mechanism that non-uniformly allocates privacy at different resolutions of the local gradient vectors. These results are directly applied to give guarantees on private distributed learning algorithms using this for private gradient aggregation iteratively. We also numerically evaluate the private DME algorithms.


title: Remarks on the Daugavet Property for Complex Banach Spaces

abstract: In this article, we study the Daugavet property and the diametral diameter two properties in complex Banach spaces. The characterizations for both Daugavet and $\Delta$-points are revisited in the context of complex Banach spaces. We also provide relationships between some variants of alternative convexity and smoothness, nonsquareness, and the Daugavet property. As a consequence, every strongly locally uniformly alternatively convex or smooth (sluacs) Banach space does not contain $\Delta$-points from the fact that such spaces are locally uniformly nonsquare. We also study the convex diametral local diameter two property (convex-DLD2P) and the polynomial Daugavet property in the vector-valued function space $A(K, X)$. From an explicit computation of the polynomial Daugavetian index of $A(K, X)$, we show that the space $A(K, X)$ has the polynomial Daugavet property if and only if either the base algebra $A$ or the range space $X$ has the polynomial Daugavet property. Consequently, we obtain that the polynomial Daugavet property, the Daugavet property, the diameteral diameter two properties, and the property ($\mathcal{D}$) are equivalent for infinite-dimensional uniform algebras.


title: Open-domain Visual Entity Recognition: Towards Recognizing Millions of Wikipedia Entities

abstract: Large-scale multi-modal pre-training models such as CLIP and PaLI exhibit strong generalization on various visual domains and tasks. However, existing image classification benchmarks often evaluate recognition on a specific domain (e.g., outdoor images) or a specific task (e.g., classifying plant species), which falls short of evaluating whether pre-trained foundational models are universal visual recognizers. To address this, we formally present the task of Open-domain Visual Entity recognitioN (OVEN), where a model need to link an image onto a Wikipedia entity with respect to a text query. We construct OVEN-Wiki by re-purposing 14 existing datasets with all labels grounded onto one single label space: Wikipedia entities. OVEN challenges models to select among six million possible Wikipedia entities, making it a general visual recognition benchmark with the largest number of labels. Our study on state-of-the-art pre-trained models reveals large headroom in generalizing to the massive-scale label space. We show that a PaLI-based auto-regressive visual recognition model performs surprisingly well, even on Wikipedia entities that have never been seen during fine-tuning. We also find existing pretrained models yield different strengths: while PaLI-based models obtain higher overall performance, CLIP-based models are better at recognizing tail entities.


title: Solitary wave solutions of a generalization of the mKdV equation

abstract: We consider a generalization of the mKdV equation, which contains dissipation terms similar to those contained in both the Benjamin-Bona-Mahoney equation and the famous Camassa-Holm and Degasperis-Procesi equations. Our objective is the construction of classical (solitons) and non-classical (peakons and cuspons) solitary wave solutions of this equation.


title: Multi-Objective Personalization in Multi-Stakeholder Organizational Bulk E-mail: A Field Experiment

abstract: Bulk email is often used in organizations to communicate ``important-to-organization'' messages such as policy changes, organizational plans, and administrative updates. However, normal employees may prefer messages more relevant to their jobs or interests. Organizations face the challenge of balancing prioritizing the messages they prefer employees to know (tactical goals) while maintaining employees' positive experiences with these bulk emails, then they continue to read these emails in the future (strategic goals). Could personalization help organizations achieve these tactical and strategic goals? In an 8-week field experiment with a university newsletter, we implemented a 4x5x5 factorial design on personalizing subject lines, top news, and message order based on both the employees' and the organization's preferences. We measured these designs' influences on the open/interest/recognition/read-in-detail rate of the whole newsletter and the single messages within it. We found that ``important-to-organization'' messages only got higher recognition rates when being put on subject lines / top news (tactical goal). Mixing them with employee-preferred messages in top news did not bring further improvement to their own recognition rates but could improve the whole newsletter's recognition rate. Only when the top news solely contained the employee-preferred messages were the employees slightly more interested in the newsletter (strategic goal). We further analyze on which topics the employees and the organization's preferences conflicted. Finally, we discuss the design suggestions on personalization and recommendation for organizational bulk email.


title: FiNER: Financial Named Entity Recognition Dataset and Weak-Supervision Model

abstract: The development of annotated datasets over the 21st century has helped us truly realize the power of deep learning. Most of the datasets created for the named-entity-recognition (NER) task are not domain specific. Finance domain presents specific challenges to the NER task and a domain specific dataset would help push the boundaries of finance research. In our work, we develop the first high-quality NER dataset for the finance domain. To set the benchmark for the dataset, we develop and test a weak-supervision-based framework for the NER task. We extend the current weak-supervision framework to make it employable for span-level classification. Our weak-ner framework and the dataset are publicly available on GitHub and Hugging Face.


title: A search for transients in the Reionization Lensing Cluster Survey (RELICS): Three new supernovae

abstract: The Reionization Cluster Survey (RELICS) imaged 41 galaxy clusters with the Hubble Space Telescope (HST), in order to detect lensed and high-redshift galaxies. Each cluster was imaged to about 26.5 AB mag in three optical and four near-infrared bands, taken in two distinct visits separated by varying time intervals. We make use of the multiple near-infrared epochs to search for transient sources in the cluster fields, with the primary motivation of building statistics for bright caustic crossing events in gravitational arcs. Over the whole sample, we do not find any significant ($\gtrsim5 \sigma$) caustic crossing events, in line with expectations from semi-analytic calculations but in contrast to what may be naively expected from previous detections of some bright events, or from deeper transient surveys that do find high rates of such events. Nevertheless, we find six prominent supernova (SN) candidates over the 41 fields: three of them were previously reported and three are new ones reported here for the first time. Out of the six candidates, four are likely core-collapse (CC) SNe -- three in cluster galaxies, and among which only one was known before, and one slightly behind the cluster at $z\sim0.6-0.7$. The other two are likely Ia -- both of them previously known, one probably in a cluster galaxy, and one behind it at $z\simeq2$. Our study supplies empirical bounds for the rate of caustic crossing events in galaxy cluster fields to typical HST magnitudes, and lays the groundwork for a future SN rate study.


title: BUAA_BIGSCity: Spatial-Temporal Graph Neural Network for Wind Power Forecasting in Baidu KDD CUP 2022

abstract: In this technical report, we present our solution for the Baidu KDD Cup 2022 Spatial Dynamic Wind Power Forecasting Challenge. Wind power is a rapidly growing source of clean energy. Accurate wind power forecasting is essential for grid stability and the security of supply. Therefore, organizers provide a wind power dataset containing historical data from 134 wind turbines and launch the Baidu KDD Cup 2022 to examine the limitations of current methods for wind power forecasting. The average of RMSE (Root Mean Square Error) and MAE (Mean Absolute Error) is used as the evaluation score. We adopt two spatial-temporal graph neural network models, i.e., AGCRN and MTGNN, as our basic models. We train AGCRN by 5-fold cross-validation and additionally train MTGNN directly on the training and validation sets. Finally, we ensemble the two models based on the loss values of the validation set as our final submission. Using our method, our team \team achieves -45.36026 on the test set. We release our codes on Github (https://github.com/BUAABIGSCity/KDDCUP2022) for reproduction.


title: Proof of the Ginzburg-Kazhdan conjecture

abstract: We prove that the affine closure of the cotangent bundle of the basic affine space of a complex semisimple group has conical symplectic singularities, which confirms a conjecture of Ginzburg and Kazhdan. We also show that this variety is $\mathbb{Q}$-factorial and has terminal singularities.


title: Observation of Traveling Breathers and Their Scattering in a Two-Fluid System

abstract: The observation of traveling breathers (TBs) with large-amplitude oscillatory tails realizes an almost 50-year-old theoretical prediction (Kuznetsov 1975) and generalizes the notion of a breather. Two strongly nonlinear TB families are created in a core-annular flow by interacting a soliton and a nonlinear periodic (cnoidal) carrier. Bright and dark TBs are observed to move faster or slower, respectively, than the carrier while imparting a phase shift. Agreement with model equations is achieved. Scattering of the TBs are observed to be physically elastic. The observed TBs generalize to many continuum and discrete systems.


title: Sparse, Geometric Autoencoder Models of V1

abstract: The classical sparse coding model represents visual stimuli as a linear combination of a handful of learned basis functions that are Gabor-like when trained on natural image data. However, the Gabor-like filters learned by classical sparse coding far overpredict well-tuned simple cell receptive field (SCRF) profiles. A number of subsequent models have either discarded the sparse dictionary learning framework entirely or have yet to take advantage of the surge in unrolled, neural dictionary learning architectures. A key missing theme of these updates is a stronger notion of \emph{structured sparsity}. We propose an autoencoder architecture whose latent representations are implicitly, locally organized for spectral clustering, which begets artificial neurons better matched to observed primate data. The weighted-$\ell_1$ (WL) constraint in the autoencoder objective function maintains core ideas of the sparse coding framework, yet also offers a promising path to describe the differentiation of receptive fields in terms of a discriminative hierarchy in future work.


title: The sub-critical illusion: synthetic Zeeman effect observations from galactic zoom-in simulations

abstract: Mass-to-flux ratios measured via the Zeeman effect suggest the existence of a transition from a magnetically sub-critical state in HI clouds to a super-critical state in molecular clouds. However, due to projection, chemical, and excitation effects, Zeeman measurements are subject to a number of biases, and may not reflect the true relations between gravitational and magnetic energies. In this paper, we carry out simulations of the formation of magnetised molecular clouds, zooming in from an entire galaxy to sub-pc scales, which we post-process to produce synthetic HI and OH Zeeman measurements. The mass-to-flux ratios we recover from the simulated observations show a transition in magnetic criticality that closely matches observations, but we find that the gravitational-magnetic energy ratios on corresponding scales are mostly super-critical, even in the HI regime. We conclude that HI clouds in the process of assembling to form molecular clouds are already super-critical even before H_2 forms, and that the apparent transition from sub- to super-criticality between HI and H_2 is primarily an illusion created by chemical and excitation biases affecting the Zeeman measurements.


title: The influence of adatom diffusion on the formation of skyrmion lattice in sub-monolayer Fe on Ir(111)

abstract: Room temperature grown Fe monolayer (ML) on the Ir(111) single crystal substrate has attracted great research interests as nano-skyrmion lattice can form under proper growth conditions. The formation of the nanoscale skyrmion, however, appears to be greatly affected by the diffusion length of the Fe adatoms on the Ir(111) surface. We made this observation by employing spin-polarized scanning tunneling microscopy to study skyrmion formation upon systematically changing the impurity density on the substrate surface prior to Fe deposition. Since the substrate surface impurities serve as pinning centers for Fe adatoms, the eventual size and shape of the Fe islands exhibit a direct correlation with the impurity density, which in turn determines whether skyrmion can be formed. Our observation indicates that skyrmion only forms when the impurity density is below 0.006/nm2, i.e., 12 nm averaged spacing between the neighboring defects. We verify the significance of Fe diffusion length by growing Fe on clean Ir(111) substrate at low temperature of 30 K, where no skyrmion was observed to form. Our findings signify the importance of diffusion of Fe atoms on the Ir(111) substrate, which affects the size, shape and lattice perfection of the Fe islands and thus the formation of skyrmion lattice.


title: DNG: Taxonomy Expansion by Exploring the Intrinsic Directed Structure on Non-gaussian Space

abstract: Taxonomy expansion is the process of incorporating a large number of additional nodes (i.e., "queries") into an existing taxonomy (i.e., "seed"), with the most important step being the selection of appropriate positions for each query. Enormous efforts have been made by exploring the seed's structure. However, existing approaches are deficient in their mining of structural information in two ways: poor modeling of the hierarchical semantics and failure to capture directionality of is-a relation. This paper seeks to address these issues by explicitly denoting each node as the combination of inherited feature (i.e., structural part) and incremental feature (i.e., supplementary part). Specifically, the inherited feature originates from "parent" nodes and is weighted by an inheritance factor. With this node representation, the hierarchy of semantics in taxonomies (i.e., the inheritance and accumulation of features from "parent" to "child") could be embodied. Additionally, based on this representation, the directionality of is-a relation could be easily translated into the irreversible inheritance of features. Inspired by the Darmois-Skitovich Theorem, we implement this irreversibility by a non-Gaussian constraint on the supplementary feature. A log-likelihood learning objective is further utilized to optimize the proposed model (dubbed DNG), whereby the required non-Gaussianity is also theoretically ensured. Extensive experimental results on two real-world datasets verify the superiority of DNG relative to several strong baselines.


title: Characterizing the Conditional Galaxy Property Distribution using Gaussian Mixture Models

abstract: Line-intensity mapping (LIM) is a promising technique to constrain the global distribution of galaxy properties. To combine LIM experiments probing different tracers with traditional galaxy surveys and fully exploit the scientific potential of these observations, it is necessary to have a physically motivated modeling framework. As part of developing such a framework, in this work we introduce and model the conditional galaxy property distribution (CGPD), i.e. the distribution of galaxy properties conditioned on the host halo mass and redshift. We consider five galaxy properties, including the galaxy stellar mass, molecular gas mass, galaxy radius, gas phase metallicity and star formation rate (SFR), which are important for predicting the emission lines of interest. The CGPD represents the full distribution of galaxies in the five dimensional property space; many important galaxy distribution functions and scaling relations, such as the stellar mass function and SFR main sequence, can be derived from integrating and projecting it. We utilize two different kinds of cosmological galaxy simulations, a semi-analytic model and the IllustrisTNG hydrodynamic simulation, to characterize the CGPD and explore how well it can be represented using a Gaussian mixture model (GMM). We find that with just a few ($\sim 3$) Gaussian components, a GMM can describe the CGPD of the simulated galaxies to high accuracy for both simulations. The CGPD can be mapped to LIM or other observables by constructing the appropriate relationship between galaxy properties and the relevant observable tracers.


title: Fluctuations of atomic energy levels due to axion dark matter

abstract: The amplitude of the pseudoscalar (axion) or scalar field fluctuates on a time scale of order of million field oscillation periods which is a typical coherence time in the virialized axion galactic dark matter halo model. This causes fluctuations of frequencies of atomic clocks on the same time scale. We show that this effect may be employed to search for the axion and scalar field dark matter with atomic and nuclear clocks. We re-purpose the results of the atomic clocks experiments comparing the variations of frequencies of hyperfine transitions in Rb and Cs atoms as well as in hydrogen atom vs cavity frequency fluctuations, and extract new limits on the axion coupling constant $f_a$ for masses in the range $2.4\times 10^{-17}\text{ eV}\lesssim m \lesssim 10^{-13}\text{ eV}$. We also show that similar energy shifts arise in the second-order perturbation theory with linear in the pseudoscalar field interaction. These shifts may be potentially measured with nuclear clocks based on the low-energy transition in $^{229}$Th nucleus. We propose a procedure which could, in principle, help determine the axion mass if the axion dark matter signal is present in experimental data sets.

categories: hep-ph astro-ph.CO nucl-th physics.atom-ph


title: Influence of Gender Composition in Pedestrian Single-File Experiments

abstract: Various studies address the question of what factors are relevant to the course of the fundamental diagram in single-file experiments. Some indicate that there are differences due to group composition when gender is taken into account. For this reason, further single-file experiments with homogeneous and heterogeneous group compositions were conducted. A Tukey HSD test was performed to investigate whether there are differences between the mean of velocity in different density ranges. A comparison of different group compositions shows that the effect of gender can only be seen, if at all, in a small density interval. Regression analyses were also conducted to determine whether, at high densities, the distance between individuals depends on the gender of the neighboring pedestrians and to establish what human factors have an effect on the velocity. An analysis of the distances between individuals at high densities indicates that there is no effect of the gender of the neighboring pedestrians. Taking into account additional human factors in a regression analysis does not improve the model.


title: Quantum sensing and imaging with spin defects in hexagonal boron nitride

abstract: Color centers in hexagonal boron nitride (hBN) have recently emerged as promising candidates for a new wave of quantum applications. Thanks to hBN's high stability and 2-dimensional (2D) layered structure, color centers in hBN can serve as robust quantum emitters that can be readily integrated into nanophotonic and plasmonic structures on a chip. More importantly, the recently discovered optically addressable spin defects in hBN provide a quantum interface between photons and electron spins for quantum sensing applications. The most well-studied hBN spin defects, the negatively charged boron vacancy ($V_B^-$) spin defects, have been used for quantum sensing of static magnetic fields, magnetic noise, temperature, strain, nuclear spins, paramagnetic spins in liquids, RF signals, and beyond. In particular, hBN nanosheets with spin defects can form van der Waals (vdW) heterostructures with 2D magnetic or other materials for in situ quantum sensing and imaging. This review summarizes the rapidly evolving field of nanoscale and microscale quantum sensing with spin defects in hBN. We introduce basic properties of hBN spin defects, quantum sensing protocols, and recent experimental demonstrations of quantum sensing and imaging with hBN spin defects. We also discuss methods to enhance their sensitivity. Finally, we envision some potential developments and applications of hBN spin defects.


title: Linear maps preserving matrices annihilated by a fixed polynomial

abstract: Let ${\bf M}_n(\mathbb{F})$ be the algebra of $n\times n$ matrices over an arbitrary field $\mathbb{F}$. We consider linear maps $\Phi: {\bf M}_n(\mathbb{F}) \rightarrow {\bf M}_r(\mathbb{F})$ preserving matrices annihilated by a fixed polynomial $f(x) = (x-a_1)\cdots (x-a_m)$ with $m\ge 2$ distinct zeroes $a_1, a_2, \ldots, a_m \in \mathbb{F}$; namely, $$ f(\Phi(A)) = 0\quad\text{whenever} \quad f(A) = 0. $$ Suppose that $f(0)=0$, and the zero set $Z(f) =\{a_1, \dots, a_m\}$ is not an additive group. Then $\Phi$ assumes the form \begin{align}\label{eq:standard} A \mapsto S\begin{pmatrix} A \otimes D_1 &&\cr & A^{T} \otimes D_2& \cr && 0_s\cr\end{pmatrix}S^{-1}, \tag{$\dagger$} \end{align} for some invertible matrix $S\in {\bf M}_r(\mathbb{F})$, invertible diagonal matrices $D_1\in {\bf M}_p(\mathbb{F})$ and $D_2\in {\bf M}_q(\mathbb{F})$, where $s=r-np-nq\geq 0$. The diagonal entries $\lambda$ in $D_1$ and $D_2$, as well as $0$ in the zero matrix $0_s$, are zero multipliers of $f(x)$ in the sense that $\lambda Z(f) \subseteq Z(f)$. In general, assume that $Z(f) - a_1$ is not an additive group. If $\Phi(I_n)$ commutes with $\Phi(A)$ for all $A\in {\bf M}_n(\mathbb{F})$, or if $f(x)$ has a unique zero multiplier $\lambda=1$, then $\Phi$ assumes the form \eqref{eq:standard}. The above assertions follow from the special case when $f(x) = x(x-1)=x^2-x$, for which the problem reduces to the study of linear idempotent preservers. It is shown that a linear map $\Phi: {\bf M}_n(\mathbb{F}) \rightarrow {\bf M}_r(\mathbb{F})$ sending disjoint rank one idempotents to disjoint idempotents always assume the above form \eqref{eq:standard} with $D_1=I_p$ and $D_2=I_q$, unless ${\bf M}_n(\mathbb{F}) = {\bf M}_2(\mathbb{Z}_2)$.


title: Flexoelectricity-stabilized ferroelectric phase with enhanced reliability in ultrathin La:HfO2 films

abstract: Doped HfO2 thin films exhibit robust ferroelectric properties even for nanometric thicknesses, are compatible with current Si technology and thus have great potential for the revival of integrated ferroelectrics. Phase control and reliability are core issues for their applications. Here we show that, in (111)-oriented 5%La:HfO2 (HLO) epitaxial thin films deposited on (La0.3Sr0.7)(Al0.65Ta0.35)O3 substrates, the flexoelectric effect, arising from the strain gradient along the films normal, induces a rhombohedral distortion in the otherwise Pca21 orthorhombic structure. Density functional calculations reveal that the distorted structure is indeed more stable than the pure Pca21 structure, when applying an electric field mimicking the flexoelectric field. This rhombohedral distortion greatly improves the fatigue endurance of HLO thin films by further stabilizing the metastable ferroelectric phase against the transition to the thermodynamically stable non-polar monoclinic phase during repetitive cycling. Our results demonstrate that the flexoelectric effect, though negligibly weak in bulk, is crucial to optimize the structure and properties of doped HfO2 thin films with nanometric thicknesses for integrated ferroelectric applications.


title: Impact of a Batter in ODI Cricket Implementing Regression Models from Match Commentary

abstract: Cricket, "a Gentleman's Game", is a prominent sport rising worldwide. Due to the rising competitiveness of the sport, players and team management have become more professional with their approach. Prior studies predicted individual performance or chose the best team but did not highlight the batter's potential. On the other hand, our research aims to evaluate a player's impact while considering his control in various circumstances. This paper seeks to understand the conundrum behind this impactful performance by determining how much control a player has over the circumstances and generating the "Effective Runs",a new measure we propose. We first gathered the fundamental cricket data from open-source datasets; however, variables like pitch, weather, and control were not readily available for all matches. As a result, we compiled our corpus data by analyzing the commentary of the match summaries. This gave us an insight into the particular game's weather and pitch conditions. Furthermore, ball-by-ball inspection from the commentary led us to determine the control of the shots played by the batter. We collected data for the entire One Day International career, up to February 2022, of 3 prominent cricket players: Rohit G Sharma, David A Warner, and Kane S Williamson. Lastly, to prepare the dataset, we encoded, scaled, and split the dataset to train and test Machine Learning Algorithms. We used Multiple Linear Regression (MLR), Polynomial Regression, Support Vector Regression (SVR), Decision Tree Regression, and Random Forest Regression on each player's data individually to train them and predict the Impact the player will have on the game. Multiple Linear Regression and Random Forest give the best predictions accuracy of 90.16 percent and 87.12 percent, respectively.


title: VI-DGP: A variational inference method with deep generative prior for solving high-dimensional inverse problems

abstract: Solving high-dimensional Bayesian inverse problems (BIPs) with the variational inference (VI) method is promising but still challenging. The main difficulties arise from two aspects. First, VI methods approximate the posterior distribution using a simple and analytic variational distribution, which makes it difficult to estimate complex spatially-varying parameters in practice. Second, VI methods typically rely on gradient-based optimization, which can be computationally expensive or intractable when applied to BIPs involving partial differential equations (PDEs). To address these challenges, we propose a novel approximation method for estimating the high-dimensional posterior distribution. This approach leverages a deep generative model to learn a prior model capable of generating spatially-varying parameters. This enables posterior approximation over the latent variable instead of the complex parameters, thus improving estimation accuracy. Moreover, to accelerate gradient computation, we employ a differentiable physics-constrained surrogate model to replace the adjoint method. The proposed method can be fully implemented in an automatic differentiation manner. Numerical examples demonstrate two types of log-permeability estimation for flow in heterogeneous media. The results show the validity, accuracy, and high efficiency of the proposed method.


title: Error Estimation for Random Fourier Features

abstract: Random Fourier Features (RFF) is among the most popular and broadly applicable approaches for scaling up kernel methods. In essence, RFF allows the user to avoid costly computations on a large kernel matrix via a fast randomized approximation. However, a pervasive difficulty in applying RFF is that the user does not know the actual error of the approximation, or how this error will propagate into downstream learning tasks. Up to now, the RFF literature has primarily dealt with these uncertainties using theoretical error bounds, but from a user's standpoint, such results are typically impractical -- either because they are highly conservative or involve unknown quantities. To tackle these general issues in a data-driven way, this paper develops a bootstrap approach to numerically estimate the errors of RFF approximations. Three key advantages of this approach are: (1) The error estimates are specific to the problem at hand, avoiding the pessimism of worst-case bounds. (2) The approach is flexible with respect to different uses of RFF, and can even estimate errors in downstream learning tasks. (3) The approach enables adaptive computation, so that the user can quickly inspect the error of a rough initial kernel approximation and then predict how much extra work is needed. Lastly, in exchange for all of these benefits, the error estimates can be obtained at a modest computational cost.


title: Twisted Alexander matrices of quandles associated with a certain Alexander pair

abstract: Ishii and Oshiro introduced the notion of an $f$-twisted Alexander matrix, which is a quandle version of a twisted Alexander matrix and defined an invariant of finitely presented quandles. In this paper, we study $f$-twisted Alexander matrices of certain quandles with the Alexander pair obtained from a quandle 2-cocycle. We show that the 0-th elementary ideal of $f$-twisted Alexander matrix of the knot quandle of a surface knot with the Alexander pair obtained from a quandle 2-cocycle can be described with the Carter-Saito-Satoh's invariant. We also discuss a relationship between $f$-twisted Alexander matrices of connected quandles with the Alexander pair obtained from a quandle 2-cocycle and quandle homology groups.


title: Spatio-temporal non-localities in a solar-like mean-field dynamo

abstract: The scale separation approximation, which is in the base of the solar mean field dynamo models, can be hardly justified both by observations and theoretical applications to astrophysical dynamos.{ The general expression for the mean turbulent electromotive force can be written in integral form with convolution of the turbulent effects and mean magnetic field variations over scales of the turbulent flows and global scales of the mean field dynamo. Following results of DNS, which had been reported earlier, we take the Lorentzian form of the integral convolution kernels as an experimental fact. }It allows us to approximate the governing equation for the mean electromotive force by the reaction--diffusion type equation. Solution of the eigenvalue problem reveals a few curious properties of the dynamo model with the nonlocal mean electromotive force. We find a decrease of the critical dynamo instability threshold, and an increase the dynamo periods of the unstable modes, as reported in earlier studies. Simultaneously, the nonlocal model shows substantially lower growth rate of the unstable dynamo modes in proximity of the critical threshold than the model which employ the scale separation approximation. We verify these findings using the nonlinear solar dynamo model. For the supercritical regime, when the $\alpha$ effect magnitude is about twice of the instability threshold, the model shows the Parker's dynamo wave solutions with the wave propagating from the mid latitude at the bottom of the convection zone toward the solar equator at the surface. In the weakly nonlinear regime, when the $\alpha$ effect magnitude is near the instability threshold, the interference of the dynamo modes of different spatial localization shows the Grand activity cycles of a period about 300 years.


title: The key role of non-local screening in the environment-insensitive exciton fine structures of transition-metal dichalcogenide monolayers

abstract: In this work, we present a comprehensive theoretical and computational investigation of exciton fine structures of WSe$_2$-monolayers, one of the best known two-dimensional (2D) transition-metal dichalcogenides (TMD's), in various dielectric-layer environments by solving the first-principles-based Bethe-Salpeter equation. While the physical and electronic properties of atomically thin nano-materials are normally sensitive to the variation of surrounding environment, our studies reveal that the influence of dielectric environment on the exciton fine structures of TMD-ML's is surprisingly limited. We point out that the non-locality of Coulomb screening plays a key role to suppress the factor of dielectric environment and drastically shrink the fine structure splittings between bright exciton (BX) states and various dark exciton (DX) states of TMD-ML's. The intriguing non-locality of screening in 2D materials can be manifested by the measurable {\it non-linear} correlation between the BX-DX splittings and exciton binding energies with varying the surrounding dielectric environments. The revealed environment-insensitive exciton fine structures of TMD-ML's suggest the robustness of prospective dark-exciton-based opto-electronics against the inevitable variation of inhomogeneous dielectric environment.


title: IRS: An Incentive-compatible Reward Scheme for Algorand

abstract: Founded in 2017, Algorand is one of the world's first carbon-negative, public blockchains inspired by proof of stake. Algorand uses a Byzantine agreement protocol to add new blocks to the blockchain. The protocol can tolerate malicious users as long as a supermajority of the stake is controlled by non-malicious users. The protocol achieves about 100x more throughput compared to Bitcoin and can be easily scaled to millions of nodes. Despite its impressive features, Algorand lacks a reward-distribution scheme that can effectively incentivize nodes to participate in the protocol. In this work, we study the incentive issue in Algorand through the lens of game theory. We model the Algorand protocol as a Bayesian game and propose a novel reward scheme to address the incentive issue in Algorand. We derive necessary conditions to ensure that participation in the protocol is a Bayesian Nash equilibrium under our proposed reward scheme even in the presence of a malicious adversary. We also present quantitative analysis of our proposed reward scheme by applying it to two real-world deployment scenarios. We estimate the costs of running an Algorand node and simulate the protocol to measure the overheads in terms of computation, storage, and networking.


title: Cyclic Delay-Doppler Shift: A Simple Transmit Diversity Technique for Delay-Doppler Waveforms in Doubly Selective Channels

abstract: Delay-Doppler waveform design has been considered as a promising solution to achieve reliable communication under high-mobility channels for the space-air-ground-integrated networks (SAGIN). In this paper, we introduce the cyclic delay-Doppler shift (CDDS) technique for delay-Doppler waveforms to extract transmit diversity in doubly selective channels. Two simple CDDS schemes, named time-domain CDDS (TD-CDDS) and modulation-domain CDDS (MD-CDDS), are proposed in the setting of multiple-input multiple-output (MIMO). We demonstrate the applications of CDDS on two representative delay-Doppler waveforms, namely orthogonal time frequency space (OTFS) and affine frequency division multiplexing (AFDM), by deriving their corresponding CDDS matrices. Furthermore, we prove theoretically and experimentally that CDDS can provide OTFS and AFDM with full transmit diversity gain on most occasions.


title: DISCO: Distributed Inference with Sparse Communications

abstract: Deep neural networks (DNNs) have great potential to solve many real-world problems, but they usually require an extensive amount of computation and memory. It is of great difficulty to deploy a large DNN model to a single resource-limited device with small memory capacity. Distributed computing is a common approach to reduce single-node memory consumption and to accelerate the inference of DNN models. In this paper, we explore the "within-layer model parallelism", which distributes the inference of each layer into multiple nodes. In this way, the memory requirement can be distributed to many nodes, making it possible to use several edge devices to infer a large DNN model. Due to the dependency within each layer, data communications between nodes during this parallel inference can be a bottleneck when the communication bandwidth is limited. We propose a framework to train DNN models for Distributed Inference with Sparse Communications (DISCO). We convert the problem of selecting which subset of data to transmit between nodes into a model optimization problem, and derive models with both computation and communication reduction when each layer is inferred on multiple nodes. We show the benefit of the DISCO framework on a variety of CV tasks such as image classification, object detection, semantic segmentation, and image super resolution. The corresponding models include important DNN building blocks such as convolutions and transformers. For example, each layer of a ResNet-50 model can be distributively inferred across two nodes with five times less data communications, almost half overall computations and half memory requirement for a single node, and achieve comparable accuracy to the original ResNet-50 model. This also results in 4.7 times overall inference speedup.


title: A Subgeometric Convergence Formula for Total-variation Error of the Level-increment Truncation Approximation of M/G/1-type Markov Chains

abstract: This paper considers the level-increment (LI) truncation approximation of M/G/1-type Markov chains. The LI truncation approximation is usually used to implement Ramaswami's recursion for the stationary distribution in M/G/1-type Markov chains. The main result of this paper is a subgeometric convergence formula for the total-variation distance between the stationary distribution and its LI truncation approximation.


title: When Combinatorial Thompson Sampling meets Approximation Regret

abstract: We study the Combinatorial Thompson Sampling policy (CTS) for combinatorial multi-armed bandit problems (CMAB), within an approximation regret setting. Although CTS has attracted a lot of interest, it has a drawback that other usual CMAB policies do not have when considering non-exact oracles: for some oracles, CTS has a poor approximation regret (scaling linearly with the time horizon $T$) [Wang and Chen, 2018]. A study is then necessary to discriminate the oracles on which CTS could learn. This study was started by Kong et al. [2021]: they gave the first approximation regret analysis of CTS for the greedy oracle, obtaining an upper bound of order $\mathcal{O}(\log(T)/\Delta^2)$, where $\Delta$ is some minimal reward gap. In this paper, our objective is to push this study further than the simple case of the greedy oracle. We provide the first $\mathcal{O}(\log(T)/\Delta)$ approximation regret upper bound for CTS, obtained under a specific condition on the approximation oracle, allowing a reduction to the exact oracle analysis. We thus term this condition REDUCE2EXACT, and observe that it is satisfied in many concrete examples. Moreover, it can be extended to the probabilistically triggered arms setting, thus capturing even more problems, such as online influence maximization.


title: Quark and lepton hierarchies from $S_4^\prime$ modular flavor symmetry

abstract: We propose models in which the hierarchical structures of the masses and mixing in both quark and lepton sectors are explained by the $S_4^\prime$ modular flavor symmetry near the fixed point $\tau \sim i\infty$. The model provides the first explicit example which explains hierarchies of both quarks and leptons. The hierarchies are realized by powers of $\epsilon = e^{2\pi i \tau/4} = \mathcal{O}(0.01)$ and $2\,\mathrm{Im}\,\tau \sim 5$, where $\tau$ being the modulus. The small parameter $\epsilon$ plays a role of flavon in the Froggatt-Nielsen mechanism under the residual $Z_4^T$ symmetry, and powers of $2\,\mathrm{Im}\,\tau$ in the Yukawa couplings are controlled by modular weights via the canonical normalization. The doublet quarks are identified to a $S_4^\prime$ triplet to explain the hierarchical structure of the quark mixing angles, while the doublet leptons are composed of three singlets for the large mixing angles in the lepton sector. We show that the $S_4^\prime$ modular symmetry alone can explain the hierarchies in both quark and lepton sectors by $\mathcal{O}(1)$ coefficients.


title: A residual dense vision transformer for medical image super-resolution with segmentation-based perceptual loss fine-tuning

abstract: Super-resolution plays an essential role in medical imaging because it provides an alternative way to achieve high spatial resolutions and image quality with no extra acquisition costs. In the past few decades, the rapid development of deep neural networks has promoted super-resolution performance with novel network architectures, loss functions and evaluation metrics. Specifically, vision transformers dominate a broad range of computer vision tasks, but challenges still exist when applying them to low-level medical image processing tasks. This paper proposes an efficient vision transformer with residual dense connections and local feature fusion to achieve efficient single-image super-resolution (SISR) of medical modalities. Moreover, we implement a general-purpose perceptual loss with manual control for image quality improvements of desired aspects by incorporating prior knowledge of medical image segmentation. Compared with state-of-the-art methods on four public medical image datasets, the proposed method achieves the best PSNR scores of 6 modalities among seven modalities. It leads to an average improvement of $+0.09$ dB PSNR with only 38\% parameters of SwinIR. On the other hand, the segmentation-based perceptual loss increases $+0.14$ dB PSNR on average for SOTA methods, including CNNs and vision transformers. Additionally, we conduct comprehensive ablation studies to discuss potential factors for the superior performance of vision transformers over CNNs and the impacts of network and loss function components. The code will be released on GitHub with the paper published.


title: Quantum annealing with inequality constraints: the set cover problem

abstract: This paper presents two novel approaches for solving the set cover problem (SCP) with multiple inequality constraints on quantum annealers. The first method uses the augmented Lagrangian approach to represent the constraints, while the second method employs a higher-order binary optimization (HUBO) formulation. Our experimental analysis demonstrate that both approaches outperform the standard approach with slack variables for solving problems with inequality constraints on D-Wave quantum annealers. The results show that the augmented Lagrangian method can be successfully used to implement a large number of inequality constraints, making it applicable to a wide range of constrained problems beyond the SCP. The HUBO formulation performs slightly better than the augmented Lagrangian method in solving the SCP, but it is less scalable in terms of embeddability in the quantum chip. These findings could impact the use of quantum annealers for solving constrained optimization problems.


title: UML: A Universal Monolingual Output Layer for Multilingual ASR

abstract: Word-piece models (WPMs) are commonly used subword units in state-of-the-art end-to-end automatic speech recognition (ASR) systems. For multilingual ASR, due to the differences in written scripts across languages, multilingual WPMs bring the challenges of having overly large output layers and scaling to more languages. In this work, we propose a universal monolingual output layer (UML) to address such problems. Instead of one output node for only one WPM, UML re-associates each output node with multiple WPMs, one for each language, and results in a smaller monolingual output layer shared across languages. Consequently, the UML enables to switch in the interpretation of each output node depending on the language of the input speech. Experimental results on an 11-language voice search task demonstrated the feasibility of using UML for high-quality and high-efficiency multilingual streaming ASR.


title: Debiased Distillation by Transplanting the Last Layer

abstract: Deep models are susceptible to learning spurious correlations, even during the post-processing. We take a closer look at the knowledge distillation -- a popular post-processing technique for model compression -- and find that distilling with biased training data gives rise to a biased student, even when the teacher is debiased. To address this issue, we propose a simple knowledge distillation algorithm, coined DeTT (Debiasing by Teacher Transplanting). Inspired by a recent observation that the last neural net layer plays an overwhelmingly important role in debiasing, DeTT directly transplants the teacher's last layer to the student. Remaining layers are distilled by matching the feature map outputs of the student and the teacher, where the samples are reweighted to mitigate the dataset bias. Importantly, DeTT does not rely on the availability of extensive annotations on the bias-related attribute, which is typically not available during the post-processing phase. Throughout our experiments, DeTT successfully debiases the student model, consistently outperforming the baselines in terms of the worst-group accuracy.


title: What Are Effective Labels for Augmented Data? Improving Calibration and Robustness with AutoLabel

abstract: A wide breadth of research has devised data augmentation approaches that can improve both accuracy and generalization performance for neural networks. However, augmented data can end up being far from the clean training data and what is the appropriate label is less clear. Despite this, most existing work simply uses one-hot labels for augmented data. In this paper, we show re-using one-hot labels for highly distorted data might run the risk of adding noise and degrading accuracy and calibration. To mitigate this, we propose a generic method AutoLabel to automatically learn the confidence in the labels for augmented data, based on the transformation distance between the clean distribution and augmented distribution. AutoLabel is built on label smoothing and is guided by the calibration-performance over a hold-out validation set. We successfully apply AutoLabel to three different data augmentation techniques: the state-of-the-art RandAug, AugMix, and adversarial training. Experiments on CIFAR-10, CIFAR-100 and ImageNet show that AutoLabel significantly improves existing data augmentation techniques over models' calibration and accuracy, especially under distributional shift.


title: Topological classes of BTZ black holes

abstract: In the recent paper [Phys. Rev. Lett. 129, 191101 (2022)], the black holes were viewed as topological thermodynamic defects by using the generalized off-shell free energy. Their work indicates that all black hole solutions in the pure Einstein-Maxwell gravity theory could be classified into three different topological classes for four and higher spacetime dimensions. In this paper, we investigate the topological number of BTZ black holes with different charges $(Q)$ and rotational $(J)$ parameters. By using generalized free energy and Duan's $\phi$-mapping topological current theory, we interestingly found only two topological classes for BTZ spacetime. Particularly, for $Q=J=0$ BTZ black hole, there has only one zero point and therefore the total topological number is 1. While for rotating or charged cases, there are always two zero points and the global topological number is zero.


title: A Hitting Time Analysis for Stochastic Time-Varying Functions with Applications to Adversarial Attacks on Computation of Markov Decision Processes

abstract: Stochastic time-varying optimization is an integral part of learning in which the shape of the function changes over time in a non-deterministic manner. This paper considers multiple models of stochastic time variation and analyzes the corresponding notion of hitting time for each model, i.e., the period after which optimizing the stochastic time-varying function reveals informative statistics on the optimization of the target function. The studied models of time variation are motivated by adversarial attacks on the computation of value iteration in Markov decision processes. In this application, the hitting time quantifies the extent that the computation is robust to adversarial disturbance. We develop upper bounds on the hitting time by analyzing the contraction-expansion transformation appeared in the time-variation models. We prove that the hitting time of the value function in the value iteration with a probabilistic contraction-expansion transformation is logarithmic in terms of the inverse of a desired precision. In addition, the hitting time is analyzed for optimization of unknown continuous or discrete time-varying functions whose noisy evaluations are revealed over time. The upper bound for a continuous function is super-quadratic (but sub-cubic) in terms of the inverse of a desired precision and the upper bound for a discrete function is logarithmic in terms of the cardinality of the function domain. Improved bounds for convex functions are obtained and we show that such functions are learned faster than non-convex functions. Finally, we study a time-varying linear model with additive noise, where hitting time is bounded with the notion of shape dominance.


title: On the Emulation of Synchronous Machine Dynamics by Converter-Interfaced Generators

abstract: This paper discusses the conditions that a device needs to satisfy to replicate the behavior of a conventional synchronous machine (SM) connected to a power network. The conditions pertain to the device's stored energy, time scale of response, oscillation damping, and behavior during short-circuits. Relevant remarks for devices that do/don't satisfy these conditions are discussed through an illustrative numerical example as well as through simulation results based on a modified version of the well-known WSCC 9-bus test system.


title: Improving Contextual Spelling Correction by External Acoustics Attention and Semantic Aware Data Augmentation

abstract: We previously proposed contextual spelling correction (CSC) to correct the output of end-to-end (E2E) automatic speech recognition (ASR) models with contextual information such as name, place, etc. Although CSC has achieved reasonable improvement in the biasing problem, there are still two drawbacks for further accuracy improvement. First, due to information limitation in text only hypothesis or weak performance of ASR model on rare domains, the CSC model may fail to correct phrases with similar pronunciation or anti-context cases where all biasing phrases are not present in the utterance. Second, there is a discrepancy between the training and inference of CSC. The bias list in training is randomly selected but in inference there may be more similarity between ground truth phrase and other phrases. To solve above limitations, in this paper we propose an improved non-autoregressive (NAR) spelling correction model for contextual biasing in E2E neural transducer-based ASR systems to improve the previous CSC model from two perspectives: Firstly, we incorporate acoustics information with an external attention as well as text hypotheses into CSC to better distinguish target phrase from dissimilar or irrelevant phrases. Secondly, we design a semantic aware data augmentation schema in training phrase to reduce the mismatch between training and inference to further boost the biasing accuracy. Experiments show that the improved method outperforms the baseline ASR+Biasing system by as much as 20.3% relative name recall gain and achieves stable improvement compared to the previous CSC method over different bias list name coverage ratio.


title: Manifestation of pairing modes in nuclear collisions

abstract: We discuss the possible manifestation of pairing dynamics in nuclear collisions beyond the standard quasi-static treatment of pairing correlations. These involve solitonic excitations induced by pairing phase difference of colliding nuclei and pairing dynamic enhancement in the di-nuclear system formed by merging nuclei.


title: Ultra Narrow Linewidth Frequency Reference via Measurement and Feedback

abstract: The generation of very narrow linewidth light sources is of great importance in modern science. One such source is the superradiant laser, which relies on collectively interacting ultra long lived dipoles driven by incoherent light. Here we discuss a different way of generating spectrally pure light by coherently driving such dipoles inside an optical QED cavity. The light exiting the cavity carries information about the detuning between the driving light and the atomic transition, but is also affected by the noise originating from all the decoherence processes that act on the combined atom-cavity system. We calculate these effects to obtain fundamental limits for frequency estimation and stabilization across a range of values of input light intensities and atom-light interaction strengths, estimate these limits in state-of-the-art cavity experiments with alkaline-earth atoms and identify favorable operating conditions. We find that the achievable linewidths are comparable to those of the superradiant laser.


title: Prediction of single well production rate in water-flooding oil fields driven by the fusion of static, temporal and spatial information

abstract: It is very difficult to forecast the production rate of oil wells as the output of a single well is sensitive to various uncertain factors, which implicitly or explicitly show the influence of the static, temporal and spatial properties on the oil well production. In this study, a novel machine learning model is constructed to fuse the static geological information, dynamic well production history, and spatial information of the adjacent water injection wells. There are 3 basic modules in this stacking model, which are regarded as the encoders to extract the features from different types of data. One is Multi-Layer Perceptron, which is to analyze the static geological properties of the reservoir that might influence the well production rate. The other two are both LSTMs, which have the input in the form of two matrices rather than vectors, standing for the temporal and the spatial information of the target well. The difference of the two modules is that in the spatial information processing module we take into consideration the time delay of water flooding response, from the injection well to the target well. In addition, we use Symbolic Transfer Entropy to prove the superiorities of the stacking model from the perspective of Causality Discovery. It is proved theoretically and practically that the presented model can make full use of the model structure to integrate the characteristics of the data and the experts' knowledge into the process of machine learning, greatly improving the accuracy and generalization ability of prediction.


title: Invariant Target Detection in Images through the Normalized 2-D Correlation Technique

abstract: The normalized 2-D correlation technique is a robust method for detecting targets in images due to its ability to remain invariant under rotation, translation, and scaling. This paper examines the impact of translation, and scaling on target identification in images. The results indicate a high level of accuracy in detecting targets, even when they are exhibit variations in location and size. The results indicate that the similarity between the image and the two used targets improves as the resize ratio increases. All statistical estimators demonstrate a strong similarity between the original and extracted targets. The elapsed time for all scenarios falls within the range (44.75-44.85), (37.48-37.73) seconds for bird and children targets respectively, and the correlation coefficient displays stable relationships with values that fall within the range of (0.90-0.98) and (0.87-0.93) for bird and children targets respectively.


title: Quantized Low-Rank Multivariate Regression with Random Dithering

abstract: Low-rank multivariate regression (LRMR) is an important statistical learning model that combines highly correlated tasks as a multiresponse regression problem with low-rank priori on the coefficient matrix. In this paper, we study quantized LRMR, a practical setting where the responses and/or the covariates are discretized to finite precision. We focus on the estimation of the underlying coefficient matrix. To make consistent estimator that could achieve arbitrarily small error possible, we employ uniform quantization with random dithering, i.e., we add appropriate random noise to the data before quantization. Specifically, uniform dither and triangular dither are used for responses and covariates, respectively. Based on the quantized data, we propose the constrained Lasso and regularized Lasso estimators, and derive the non-asymptotic error bounds. With the aid of dithering, the estimators achieve minimax optimal rate, while quantization only slightly worsens the multiplicative factor in the error rate. Moreover, we extend our results to a low-rank regression model with matrix responses. We corroborate and demonstrate our theoretical results via simulations on synthetic data or image restoration.


title: Estimating Stellar Parameters and Identifying Very Metal-poor Stars Using Convolutional Neural Networks for Low-resolution Spectra (R~200)

abstract: Very metal-poor (VMP, [Fe/H]<-2.0) stars offer a wealth of information on the nature and evolution of elemental production in the early galaxy and universe. The upcoming China Space Station Telescope (CSST) will provide us with a large amount of spectroscopic data that may contain plenty of VMP stars, and thus it is crucial to determine the stellar atmospheric parameters ($T_{eff}$, $\log g$, and [Fe/H]) for low-resolution spectra similar to the CSST spectra (R~200). In this paper, a two-dimensional Convolutional Neural Network (CNN) model with three convolutional layers and two fully connected layers is constructed. The principal aim of this work is to measure the ability of this model to estimate stellar parameters on low-resolution (R~200) spectra and to identify VMP stars so that we can better search for VMP stars in the spectra observed by CSST.We mainly use 10,008 observed spectra of VMP stars from LAMOST DR3, and 16,638 spectra of common stars ([Fe/H]>-2.0) from LAMOST DR8 for the experiment and make comparisons. All spectra are reduced to R~200 to match the resolution of the CSST and are preprocessed and collapsed into two-dimensional spectra for input to the CNN model. The results show that the MAE values are 99.40 K for $T_{eff}$, 0.22 dex for $\log g$, 0.14 dex for [Fe/H], and 0.26 dex for [C/Fe], respectively. Besides, the CNN model efficiently identifies VMP stars with a precision of 94.77%. The validation and practicality of this model are also tested on the MARCS synthetic spectra. This paper powerfully demonstrates the effectiveness of the proposed CNN model in estimating stellar parameters for low-resolution spectra (R~200) and recognizing VMP stars that are of interest for stellar population and galactic evolution work.


title: Few-Shot Structured Policy Learning for Multi-Domain and Multi-Task Dialogues

abstract: Reinforcement learning has been widely adopted to model dialogue managers in task-oriented dialogues. However, the user simulator provided by state-of-the-art dialogue frameworks are only rough approximations of human behaviour. The ability to learn from a small number of human interactions is hence crucial, especially on multi-domain and multi-task environments where the action space is large. We therefore propose to use structured policies to improve sample efficiency when learning on these kinds of environments. We also evaluate the impact of learning from human vs simulated experts. Among the different levels of structure that we tested, the graph neural networks (GNNs) show a remarkable superiority by reaching a success rate above 80% with only 50 dialogues, when learning from simulated experts. They also show superiority when learning from human experts, although a performance drop was observed, indicating a possible difficulty in capturing the variability of human strategies. We therefore suggest to concentrate future research efforts on bridging the gap between human data, simulators and automatic evaluators in dialogue frameworks.


title: Semi-Supervised Segmentation of Multi-vendor and Multi-center Cardiac MRI using Histogram Matching

abstract: Automatic segmentation of the heart cavity is an essential task for the diagnosis of cardiac diseases. In this paper, we propose a semi-supervised segmentation setup for leveraging unlabeled data to segment Left-ventricle, Right-ventricle, and Myocardium. We utilize an enhanced version of residual U-Net architecture on a large-scale cardiac MRI dataset. Handling the class imbalanced data issue using dice loss, the enhanced supervised model is able to achieve better dice scores in comparison with a vanilla U-Net model. We applied several augmentation techniques including histogram matching to increase the performance of our model in other domains. Also, we introduce a simple but efficient semi-supervised segmentation method to improve segmentation results without the need for large labeled data. Finally, we applied our method on two benchmark datasets, STACOM2018, and M\&Ms 2020 challenges, to show the potency of the proposed model. The effectiveness of our proposed model is demonstrated by the quantitative results. The model achieves average dice scores of 0.921, 0.926, and 0.891 for Left-ventricle, Right-ventricle, and Myocardium respectively.


title: Coherence in scattering of massive weakly interacting neutral particles off nuclei

abstract: The paper presents a novel approach to the description of the nonrelativistic weak interaction of a massive neutral particle (lepton) and a nucleus, in which the latter retains its integrity. The cross section of such a process is a sum of the elastic (or coherent) contribution, when the nucleus remains in its original state, and the inelastic (incoherent) contribution, when the nucleus is in an excited state. Smooth transition from elastic scattering to inelastic scattering is governed by the dependence of the nuclear form factors on the momentum transferred to the nucleus. The intensity of the weak interaction is set by the parameters that determine the contributions to the probability amplitude from the scalar products of the leptonic and nucleon currents. The resulting expressions are of interest, at least in the problem of direct detection of neutral massive weakly interacting particles of dark matter, since in this case, in contrast to the generally accepted approach, both elastic and inelastic processes are simultaneously considered. It is shown that the presence of the inelastic contribution accompanied by emission of characteristic radiation (photons) from the deexcitation of the nucleus turns out to be decisive when the coherent cross section is strongly suppressed or cannot be detected. Therefore in order to extract maximum information about dark matter particles, one should plan experiments aimed at the direct detection of dark matter particles in a setting that allows one to detect both the recoil energy of the nucleus and the gamma quanta from the deexcitation of the nucleus.


title: On stable-projective and injective-costable decompositions of modules

abstract: It is proved that, for a left hereditary ring, an arbitrary left module has a representation in the form of the direct sum of a stable left module and indecomposable projective left modules (if and only if an arbitrary left module has a representation in the form of the direct sum of a stable left module and a projective left module) if and only if the ring is left perfect and right coherent. In that case, the above-mentioned representations are unique up to isomorphism; the latter representation is also functorial. The essential ingredient in the proofs of the above-mentioned statements is a certain purely categorical result. These statements, in particular, imply that, for any principal ideal domain that is not a field, the fundamental theorem on finitely generated modules over it can not be generalized to the case of all modules. Moreover, with the aid of the above-mentioned categorical approach, we give a new proof of the Zheng-Xu He's result asserting that any module of a ring has a unique up to isomorphism injective-costable decomposition if and only if the ring is left hereditary and left Noetherian. The above-mentioned statements, in particular, imply that if the category of left modules over a left hereditary ring is Krull-Schmidt, then the ring is left Artinian. Yet another criterion for a ring to be left hereditary, left perfect and right coherent (resp. left hereditary left Noetherian) found in the paper requires that the pair $(Stable$ $modules$, $Projective$ $modules)$ (resp. $(Injective$ $Modules, Costable$ $ Modules)$) of module classes be a pre-torsion theory. This implies that the pair $(Stable$ $modules$, $Projective$ $modules)$ is a torsion theory if and only if the ring is left hereditary and the injective envelope of the ring, viewed as a left module over itself, is projective.


title: mmAlert: mmWave Link Blockage Prediction via Passive Sensing

abstract: In this letter, the mmAlert system, predicting millimeter wave (mmWave) link blockage during data communication, is elaborated and demonstrated. The passive sensing method is adopted for mobile blocker detection, where two receive beams with separated radio frequency (RF) chains are equipped at the data communication receiver. One receive beam is aligned to the direction of line-of-sight (LoS) path, and the other one periodically sweeps the region close to the LoS path. By comparing the signals received by the above two beams, the Doppler frequencies of the signal scattered from the mobile blocker can be detected. Furthermore, by tracking the Doppler frequencies and the angle-of-arrivals (AoAs) of the scattered signals, the trajectory of the mobile blocker can be estimated, such that the potential link blockage can be predicted by assuming consistent mobile velocity. It is demonstrated via experiments that the mmAlert system can always detect the motions of the walking person close to the LoS path, and predict 90\% of the LoS blockage with sensing time of 1.4 seconds.


title: Lattice All-Pass Filter based Precoder Adaptation for MIMO Wireless Channels

abstract: Modern 5G communication systems employ multiple-input multiple-output (MIMO) in conjunction with orthogonal frequency division multiplexing (OFDM) to enhance data rates, particularly for wideband millimetre wave (mmW) applications. Since these systems use a large number of subcarriers, feeding back the estimated precoder for even a subset of subcarriers from the receiver to the transmitter is prohibitive. Moreover, such frequency domain approaches also do not exploit the predominant line-of-sight component that is present in such channels to reduce feedback. In this work, we view the precoder in the time domain as a matrix all-pass filter, and model the discrete-time precoder filter using a matrix-lattice structure that aids in reducing the overall feedback while still maintaining the desired frequency-phase delay profile. This provides an efficient precoder representation across the subcarriers using fewer coefficients, and is amenable to tracking over time with much lower feedback than past approaches. Compared to frequency domain geodesic interpolation, Givens rotation based parameterisation, and the angle-delay domain approach that depends on approximate discrete-time representation, the proposed approach yields higher achievable rates with a much lower feedback burden. Via extensive simulations over mmW channel models, we confirm the effectiveness of our claims, and show that the proposed approach can reduce the feedback burden by up to 70%.


title: Contrastive Representation Learning for Acoustic Parameter Estimation

abstract: A study is presented in which a contrastive learning approach is used to extract low-dimensional representations of the acoustic environment from single-channel, reverberant speech signals. Convolution of room impulse responses (RIRs) with anechoic source signals is leveraged as a data augmentation technique that offers considerable flexibility in the design of the upstream task. We evaluate the embeddings across three different downstream tasks, which include the regression of acoustic parameters reverberation time RT60 and clarity index C50, and the classification into small and large rooms. We demonstrate that the learned representations generalize well to unseen data and perform similarly to a fully-supervised baseline.


title: Critical analysis on efficiency and noise reduction methodologies of a switch mode power supply using LISN topology

abstract: This critical analysis offers a comprehensive overview of the efficiency and noise reduction methodologies applied in switch mode power supplies (SMPSs) and the emerging trends in the field. The study acknowledges that power supplies are an essential element in most electronic devices, and the recent developments have placed a greater emphasis on precision, miniaturization, and effectiveness of these components. The research focuses on SMPSs in comparison with other power supply methodologies and investigates the identification and mitigation of internal and external noise in DC Buck converter design through simulations. The study explores the latest and established technologies employed in improving SMPSs' power supply units and achieving maximum performance. The paper highlights the use of a Linear Impedance Stabilization Network (LISN) topology and filter topologies to stabilize and eliminate noises in non-ideal scenarios, starting from an ideal buck converter. The research also emphasizes the design, analysis, and implementation of energy-efficient switch mode isolated converters commonly used in everyday life. Therefore, the study concludes that the integration of the LISN methodology in SMPSs design can play a crucial role in achieving maximum performance and efficiency.


title: Improved Deterministic Leader Election in Diameter-Two Networks

abstract: In this paper, we investigate the leader election problem in diameter-two networks. Recently, Chatterjee et al. [DC 2020] studied the leader election in diameter-two networks. They presented a $O(\log n)$-round deterministic {implicit} leader election algorithm which incurs optimal $O(n\log n)$ messages, but a drawback of their algorithm is that it requires knowledge of $n$. An important question -- whether it is possible to remove the assumption on the knowledge of $n$ was left open in their paper. Another interesting open question raised in their paper is whether {\em explicit} leader election can be solved in $\tilde{O}(n)$ messages deterministically. In this paper, we give an affirmative answer to them. Further, we solve the {\em broadcast problem}, another fundamental problem in distributed computing, deterministically in diameter-two networks with $\tilde{O}(n)$ messages and $\tilde{O}(1)$ rounds without the knowledge of $n$. In fact, we address all the open questions raised by Chatterjee et al. for the deterministic leader election problem in diameter-two networks. To the best of our knowledge, this is the first $\tilde{O}(n)$ deterministic result for the explicit leader election in the diameter-two networks, that too without the knowledge of $n$.


title: KS-DETR: Knowledge Sharing in Attention Learning for Detection Transformer

abstract: Scaled dot-product attention applies a softmax function on the scaled dot-product of queries and keys to calculate weights and then multiplies the weights and values. In this work, we study how to improve the learning of scaled dot-product attention to improve the accuracy of DETR. Our method is based on the following observations: using ground truth foreground-background mask (GT Fg-Bg Mask) as additional cues in the weights/values learning enables learning much better weights/values; with better weights/values, better values/weights can be learned. We propose a triple-attention module in which the first attention is a plain scaled dot-product attention, the second/third attention generates high-quality weights/values (with the assistance of GT Fg-Bg Mask) and shares the values/weights with the first attention to improve the quality of values/weights. The second and third attentions are removed during inference. We call our method knowledge-sharing DETR (KS-DETR), which is an extension of knowledge distillation (KD) in the way that the improved weights and values of the teachers (the second and third attentions) are directly shared, instead of mimicked, by the student (the first attention) to enable more efficient knowledge transfer from the teachers to the student. Experiments on various DETR-like methods show consistent improvements over the baseline methods on the MS COCO benchmark. Code is available at https://github.com/edocanonymous/KS-DETR.


title: Nonasymptotic Performance Analysis of Direct-Augmentation and Spatial-Smoothing ESPRIT for Localization of More Sources Than Sensors Using Sparse Arrays

abstract: Direction augmentation (DA) and spatial smoothing (SS), followed by a subspace method such as ESPRIT or MUSIC, are two simple and successful approaches that enable localization of more uncorrelated sources than sensors with a proper sparse array. In this paper, we carry out nonasymptotic performance analyses of DA-ESPRIT and SS-ESPRIT in the practical finite-snapshot regime. We show that their absolute localization errors are bounded from above by $C_1\frac{\max\{\sigma^2, C_2\}}{\sqrt{L}}$ with overwhelming probability, where $L$ is the snapshot number, $\sigma^2$ is the Gaussian noise power, and $C_1,C_2$ are constants independent of $L$ and $\sigma^2$, if and only if they can do exact source localization with infinitely many snapshots. We also show that their resolution increases with the snapshot number, without a substantial limit. Numerical results corroborating our analysis are provided.


title: The Axion-Instanton Weak Gravity Conjecture and Scalar Fields

abstract: We study the Weak Gravity Conjecture in the presence of scalar fields. The Weak Gravity Conjecture is a consistency condition for a theory of quantum gravity asserting that for a U(1) gauge field, there is a particle charged under this field whose mass is bounded by its charge. It was extended to a statement about any canonical pair of (p - 1)-dimensional object and p-form coupling to it, in particular to axion-instanton pairs. The gauge-scalar Weak Gravity Conjecture is a modification of this bound that includes scalar interactions. We propose a similar extension to cases where scalar fields are present for the axion-instanton Weak Gravity Conjecture and provide evidence from Type IIA supergravity.


title: Distributionally Robust Recourse Action

abstract: A recourse action aims to explain a particular algorithmic decision by showing one specific way in which the instance could be modified to receive an alternate outcome. Existing recourse generation methods often assume that the machine learning model does not change over time. However, this assumption does not always hold in practice because of data distribution shifts, and in this case, the recourse action may become invalid. To redress this shortcoming, we propose the Distributionally Robust Recourse Action (DiRRAc) framework, which generates a recourse action that has a high probability of being valid under a mixture of model shifts. We formulate the robustified recourse setup as a min-max optimization problem, where the max problem is specified by Gelbrich distance over an ambiguity set around the distribution of model parameters. Then we suggest a projected gradient descent algorithm to find a robust recourse according to the min-max objective. We show that our DiRRAc framework can be extended to hedge against the misspecification of the mixture weights. Numerical experiments with both synthetic and three real-world datasets demonstrate the benefits of our proposed framework over state-of-the-art recourse methods.


title: Simple Analytics of the Government Investment Multiplier

abstract: What are the effects of investing in public infrastructure? We answer this question with a New Keynesian model. We recast the model as a Markov chain and develop a general solution method that nests existing ones inside/outside the zero lower bound as special cases. Our framework delivers a simple expression for the contribution of public infrastructure. We show that it provides a unified framework to study the effects of public investment in three scenarios: $(i)$ normal times $(ii)$ short-lived liquidity trap $(iii)$ long-lived liquidity trap. We find that calibrations commonly used lead to multipliers that diverge with the duration of the trap.


title: Feasible Recourse Plan via Diverse Interpolation

abstract: Explaining algorithmic decisions and recommending actionable feedback is increasingly important for machine learning applications. Recently, significant efforts have been invested in finding a diverse set of recourses to cover the wide spectrum of users' preferences. However, existing works often neglect the requirement that the recourses should be close to the data manifold; hence, the constructed recourses might be implausible and unsatisfying to users. To address these issues, we propose a novel approach that explicitly directs the diverse set of actionable recourses towards the data manifold. We first find a diverse set of prototypes in the favorable class that balances the trade-off between diversity and proximity. We demonstrate two specific methods to find these prototypes: either by finding the maximum a posteriori estimate of a determinantal point process or by solving a quadratic binary program. To ensure the actionability constraints, we construct an actionability graph in which the nodes represent the training samples and the edges indicate the feasible action between two instances. We then find a feasible path to each prototype, and this path demonstrates the feasible actions for each recourse in the plan. The experimental results show that our method produces a set of recourses that are close to the data manifold while delivering a better cost-diversity trade-off than existing approaches.


title: From Sheared Annular Centrifugal Rayleigh-B\'enard Convection to Radially Heated Taylor-Couette Flow: Exploring the Impact of Buoyancy and Shear on Heat Transfer and Flow Structure

abstract: We investigate the coupling effect of buoyancy and shear based on an annular centrifugal Rayleigh-B\'enard convection (ACRBC) system in which two cylinders rotate with an angular velocity difference. Direct numerical simulations are performed in a Rayleigh number range 10^6 \le Ra \le 10^8, at fixed Prandtl number Pr=4.3, inversed Rossby number Ro^{-1}=20 and radius ratio \eta=0.5. The shear, represented by the non-dimensional rotational speed difference \Omega, varies from 0 to 10, corresponding to an ACRBC without shear and a radially heated Taylor-Couette flow with only the inner cylinder rotating, respectively. A stable regime is found in the middle part of the interval of \Omega, and divides the whole parameter space into three regimes: buoyancy-dominated regime, stable regime, and shear-dominated regime. Clear boundaries between the regimes are given by linear stability analysis. In the buoyancy-dominated regime, the flow is a quasi-two-dimensional flow on the r\varphi plane; as shear increases, both the growth rate of instability and the heat transfer is depressed. In the shear-dominated regime, the flow is mainly on the rz plane, and the heat transfer in this regime is greatly enhanced. The study shows shear can stabilize buoyancy-driven convection and reveals the complex coupling mechanism of shear and buoyancy, which may have implications for fundamental studies and industrial designs.


title: Energy-Based Test Sample Adaptation for Domain Generalization

abstract: In this paper, we propose energy-based sample adaptation at test time for domain generalization. Where previous works adapt their models to target domains, we adapt the unseen target samples to source-trained models. To this end, we design a discriminative energy-based model, which is trained on source domains to jointly model the conditional distribution for classification and data distribution for sample adaptation. The model is optimized to simultaneously learn a classifier and an energy function. To adapt target samples to source distributions, we iteratively update the samples by energy minimization with stochastic gradient Langevin dynamics. Moreover, to preserve the categorical information in the sample during adaptation, we introduce a categorical latent variable into the energy-based model. The latent variable is learned from the original sample before adaptation by variational inference and fixed as a condition to guide the sample update. Experiments on six benchmarks for classification of images and microblog threads demonstrate the effectiveness of our proposal.


title: A New Method for the Calculation of Functional and Path Integrals

abstract: Functional integrals are central to modern theories ranging from quantum mechanics and statistical thermodynamics to biology, chemistry, and finance. In this work we present a new method for calculating functional integrals based on a finite-element formulation. This approach is far more robust, versatile, and powerful than existing methods, thus allowing for more sophisticated computations and the study of problems that could not previously be tackled. Importantly, existing procedures, element libraries and shape functions, which have been developed throughout the years in the context of engineering analysis and partial differential equations, may be directly employed for this purpose.


title: Connecting Vision and Language with Video Localized Narratives

abstract: We propose Video Localized Narratives, a new form of multimodal video annotations connecting vision and language. In the original Localized Narratives, annotators speak and move their mouse simultaneously on an image, thus grounding each word with a mouse trace segment. However, this is challenging on a video. Our new protocol empowers annotators to tell the story of a video with Localized Narratives, capturing even complex events involving multiple actors interacting with each other and with several passive objects. We annotated 20k videos of the OVIS, UVO, and Oops datasets, totalling 1.7M words. Based on this data, we also construct new benchmarks for the video narrative grounding and video question answering tasks, and provide reference results from strong baseline models. Our annotations are available at https://google.github.io/video-localized-narratives/.


title: Retour d'exp{\'e}rience : Int{\'e}grer des applications transverses (Physique et Chimie) de l'enseignement de l'Alg{\`e}bre

abstract: As a Physicist and a Chemist , we have had the opportunity to teach Algebra in our engineering school in Aix-en-Provence. The article deals with the interactions made between Physics, Chemistry and Algebra.


title: Deformable registration with intensity correction for CESM monitoring response to Neoadjuvant Chemotherapy

abstract: This paper proposes a robust longitudinal registration method for Contrast Enhanced Spectral Mammography in monitoring neoadjuvant chemotherapy. Because breast texture intensity changes with the treatment, a non-rigid registration procedure with local intensity compensations is developed. The approach allows registering the low energy images of the exams acquired before and after the chemotherapy. The measured motion is then applied to the corresponding recombined images. The difference of registered images, called residual, makes vanishing the breast texture that did not changed between the two exams. Consequently, this registered residual allows identifying local density and iodine changes, especially in the lesion area. The method is validated with a synthetic NAC case where ground truths are available. Then the procedure is applied to 51 patients with 208 CESM image pairs acquired before and after the chemotherapy treatment. The proposed registration converged in all 208 cases. The intensity-compensated registration approach is evaluated with different mathematical metrics and through the repositioning of clinical landmarks (RMSE: 5.9 mm) and outperforms state-of-the-art registration techniques.


title: Deep Kernel Principal Component Analysis for Multi-level Feature Learning

abstract: Principal Component Analysis (PCA) and its nonlinear extension Kernel PCA (KPCA) are widely used across science and industry for data analysis and dimensionality reduction. Modern deep learning tools have achieved great empirical success, but a framework for deep principal component analysis is still lacking. Here we develop a deep kernel PCA methodology (DKPCA) to extract multiple levels of the most informative components of the data. Our scheme can effectively identify new hierarchical variables, called deep principal components, capturing the main characteristics of high-dimensional data through a simple and interpretable numerical optimization. We couple the principal components of multiple KPCA levels, theoretically showing that DKPCA creates both forward and backward dependency across levels, which has not been explored in kernel methods and yet is crucial to extract more informative features. Various experimental evaluations on multiple data types show that DKPCA finds more efficient and disentangled representations with higher explained variance in fewer principal components, compared to the shallow KPCA. We demonstrate that our method allows for effective hierarchical data exploration, with the ability to separate the key generative factors of the input data both for large datasets and when few training samples are available. Overall, DKPCA can facilitate the extraction of useful patterns from high-dimensional data by learning more informative features organized in different levels, giving diversified aspects to explore the variation factors in the data, while maintaining a simple mathematical formulation.


title: A q-analog of certain symmetric functions and one of its specializations

abstract: Let the symmetric functions be defined for the pair of integers $\left( n,r\right) $, $n\geq r\geq 1$, by $p_{n}^{\left( r\right) }=\sum m_{\lambda }$ where $m_{\lambda }$ are the monomial symmetric functions, the sum being over the partitions $\lambda $ of the integer $n$ with length $r$. We introduce by a generating function, a $q$-analog of $p_{n}^{\left( r\right) }$ and give some of its properties. This $q$-analog is related to its the classical form using the $q$-Stirling numbers. We also start with the same procedure the study of a $p,q$-analog of $p_{n}^{\left( r\right) }$. By specialization of this $q$-analog in the series $\sum\nolimits_{n=0}^{ \infty }q^{\binom{n}{2}}t^{n}/n!$, we recover in a purely formal way$\ $a class of polynomials $J_{n}^{\left( r\right) }$ historically introduced as combinatorial enumerators, in particular of tree inversions. This also results in a new linear recurrence for those polynomials whose triangular table can be constructed, row by row, from the initial conditions $ J_{r}^{\left( r\right) }=1$. The form of this recurrence is also given for the reciprocal polynomials of $J_{n}^{\left( r\right) }$, known to be the sum enumerators of parking functions. Explicit formulas for $J_{n}^{\left( r\right) }$ and their reciprocals are deduced, leading inversely to new representations of these polynomials as forest statistics.


title: Source-Function Weighted-Transfer Learning for Nonparametric Regression with Seemingly Similar Sources

abstract: The homogeneity, or more generally, the similarity between source domains and a target domain seems to be essential to a positive transfer learning. In practice, however, the similarity condition is difficult to check and is often violated. In this paper, instead of the popularly used similarity condition, a seeming similarity is introduced, which is defined by a non-orthogonality together with a smoothness. Such a condition is naturally satisfied under common situations and even implies the dissimilarity in some sense. Based on the seeming similarity together with an $L_2$-adjustment, a source-function weighted-transfer learning estimation (sw-TLE) is constructed. By source-function weighting, an adaptive transfer learning is achieved in the sense that it is applied to similar and dissimilar scenarios with a relatively high estimation efficiency. Particularly, under the case with homogenous source and target models, the sw-TLE even can be competitive with the full data estimator. The hidden relationship between the source-function weighting estimator and the James-Stein estimator is established as well, which reveals the structural reasonability of our methodology. Moreover, the strategy does apply to nonparametric and semiparametric models. The comprehensive simulation studies and real data analysis can illustrate that the new strategy is significantly better than the competitors.


title: Deep Generative Symbolic Regression with Monte-Carlo-Tree-Search

abstract: Symbolic regression (SR) is the problem of learning a symbolic expression from numerical data. Recently, deep neural models trained on procedurally-generated synthetic datasets showed competitive performance compared to more classical Genetic Programming (GP) algorithms. Unlike their GP counterparts, these neural approaches are trained to generate expressions from datasets given as context. This allows them to produce accurate expressions in a single forward pass at test time. However, they usually do not benefit from search abilities, which result in low performance compared to GP on out-of-distribution datasets. In this paper, we propose a novel method which provides the best of both worlds, based on a Monte-Carlo Tree Search procedure using a context-aware neural mutation model, which is initially pre-trained to learn promising mutations, and further refined from successful experiences in an online fashion. The approach demonstrates state-of-the-art performance on the well-known \texttt{SRBench} benchmark.