title: 3/2 magic-angle quantization rule of flat bands in twisted bilayer graphene and relationship with the Quantum Hall effect

abstract: Flat band electronic modes in twisted graphene bilayers are responsible for superconducting and other highly correlated electron-electron phases. Although some hints were known of a possible connection between the quantum Hall effect and zero flat band modes, it was not clear how such connection appears. Here the electronic behavior in twisted bilayer graphene is studied using the chiral model Hamiltonian. As a result, it is proved that for high-order magic angles, the zero flat band modes converge into coherent Landau states with a dispersion $\sigma^2=1/3\alpha$, where $\alpha$ is a coupling parameter that incorporates the twist angle and energetic scales. Then it is proved that the square of the hamiltonian, which is a $2\times 2$ matrix operator, turns out to be equivalent to a two-dimensional quantum harmonic oscillator. The interlayer currents between graphene's bipartite lattices are identified with the angular momentum term while the confinement potential is an effective quadratic potential. From there it is proved a limiting quantization rule for high-order magic angles, i.e., $\alpha_{m+1}-\alpha_{m}=3/2$ where $m$ is the order of the angle. All these results are in very good agreement with numerical calculations.


title: Regression-Based Elastic Metric Learning on Shape Spaces of Elastic Curves

abstract: We propose a metric learning paradigm, Regression-based Elastic Metric Learning (REML), which optimizes the elastic metric for geodesic regression on the manifold of discrete curves. Geodesic regression is most accurate when the chosen metric models the data trajectory close to a geodesic on the discrete curve manifold. When tested on cell shape trajectories, regression with REML's learned metric has better predictive power than with the conventionally used square-root-velocity (SRV) metric.


title: PreprintMatch: a tool for preprint publication detection applied to analyze global inequities in scientific publishing

abstract: Preprints, versions of scientific manuscripts that precede peer review, are growing in popularity. They offer an opportunity to democratize and accelerate research, as they have no publication costs or a lengthy peer review process. Preprints are often later published in peer-reviewed venues, but these publications and the original preprints are frequently not linked in any way. To this end, we developed a tool, PreprintMatch, to find matches between preprints and their corresponding published papers, if they exist. This tool outperforms existing techniques to match preprints and papers, both on matching performance and speed. PreprintMatch was applied to search for matches between preprints (from bioRxiv and medRxiv), and PubMed. The preliminary nature of preprints offers a unique perspective into scientific projects at a relatively early stage, and with better matching between preprint and paper, we explored questions related to research inequity. We found that preprints from low income countries are published as peer-reviewed papers at a lower rate than high income countries (39.6\% and 61.1\%, respectively), and our data is consistent with previous work that cite a lack of resources, lack of stability, and policy choices to explain this discrepancy. Preprints from low income countries were also found to be published quicker (178 vs 203 days) and with less title, abstract, and author similarity to the published version compared to high income countries. Low income countries add more authors from the preprint to the published version than high income countries (0.42 authors vs 0.32, respectively), a practice that is significantly more frequent in China compared to similar countries. Finally, we find that some publishers publish work with authors from lower income countries more frequently than others. PreprintMatch is available at \url{https://github.com/PeterEckmann1/preprint-match}.


title: Collective transport of droplets through porous media

abstract: The flow of deformable particles, such as droplets, dragged by a fluid, through a network of narrow pores inside rocks or other porous media is key in a range of applications, from enhanced oil recovery and water filtration to lab on a chip sorting of cells. The collective dynamics and its impact on the flow are poorly understood. Here, using droplets as a prototype, we show that collective transport can occur for conditions under which a single particle would get trapped at a pore channel. When a series of droplets gets trapped, the fluids flow is affected significantly, leading to an increase of the pressure difference across the pore channels, which in turn squeezes the particles through the channels. We analyze the conditions for a single droplet to flow through one pore and derive the corresponding Bond number. We also obtain a rule for the collective flow of droplets in porous media.


title: Evolution of Ion Wake Characteristics with Experimental Conditions

abstract: Two-dimensional microparticle crystals can be formed in the sheath of a gas discharge plasma. Ions from the bulk plasma are accelerated in the sheath electric field, flowing past the grains to create a positive ion wake downstream from the grains. Interaction between the ion wake and neighboring grains creates additional coupling between oscillation modes and can trigger mode-coupling instability (MCI). Recent experiments have shown that at a fixed discharge power there are threshold pressures above and below which the monolayer always crystallizes or melts, respectively. The melting is due to MCI being triggered in the crystal monolayer, while the crystallization is due to the suppression of MCI by neutral damping in the fluid monolayer. The relationship between the discharge parameters and ion wake characteristics is unknown. A molecular dynamics simulation of ion dynamics and dust charging is used to self-consistently determine the dust charge and ion wake characteristics for different experimental conditions. It is found that the ion wake is strongly dependent on discharge pressure but not affected much by the discharge power.


title: When and why vision-language models behave like bags-of-words, and what to do about it?

abstract: Despite the success of large vision and language models (VLMs) in many downstream applications, it is unclear how well they encode compositional information. Here, we create the Attribution, Relation, and Order (ARO) benchmark to systematically evaluate the ability of VLMs to understand different types of relationships, attributes, and order. ARO consists of Visual Genome Attribution, to test the understanding of objects' properties; Visual Genome Relation, to test for relational understanding; and COCO & Flickr30k-Order, to test for order sensitivity. ARO is orders of magnitude larger than previous benchmarks of compositionality, with more than 50,000 test cases. We show where state-of-the-art VLMs have poor relational understanding, can blunder when linking objects to their attributes, and demonstrate a severe lack of order sensitivity. VLMs are predominantly trained and evaluated on large datasets with rich compositional structure in the images and captions. Yet, training on these datasets has not been enough to address the lack of compositional understanding, and evaluating on these datasets has failed to surface this deficiency. To understand why these limitations emerge and are not represented in the standard tests, we zoom into the evaluation and training procedures. We demonstrate that it is possible to perform well on retrieval over existing datasets without using the composition and order information. Given that contrastive pretraining optimizes for retrieval on datasets with similar shortcuts, we hypothesize that this can explain why the models do not need to learn to represent compositional information. This finding suggests a natural solution: composition-aware hard negative mining. We show that a simple-to-implement modification of contrastive learning significantly improves the performance on tasks requiring understanding of order and compositionality.


title: A catalog of candidate double and lensed quasars from Gaia and WISE data

abstract: Making use of strong correlations between closely separated multiple or double sources and photometric and astrometric metadata in Gaia EDR3, we generate a catalog of candidate double and multiply imaged lensed quasars and AGNs, comprising 3140 systems. It includes two partially overlapping parts, a sample of distant (redshifts mostly greater than 1) sources with perturbed data, and systems resolved into separate components by Gaia at separations less than $2\arcsec$. For the first part, which is roughly one third of the published catalog, we synthesized 0.617 million redshifts by multiple machine learning prediction and classification methods, using independent photometric and astrometric data from Gaia EDR3 and WISE with accurate spectroscopic redshifts from SDSS as a training set. Using these synthetic redshifts, we estimate a rate of 4.9\% of interlopers with spectroscopic redshift below 1 in this part of the catalog. Unresolved candidate double and dual AGNs and quasars are selected as sources with marginally high BP/RP excess factor (phot_bp_rp_excess_factor), which is sensitive to source extent, limiting our search to high-redshift quasars. For the second part of the catalog, additional filters on measured parallax and near-neighbor statistics are applied to diminish the propagation of remaining stellar contaminants. The estimated rate of positives (double or multiple sources) is 98\%, and the estimated rate of dual (physically related quasars) is greater than 54\%. A few dozen serendipitously found objects of interest are discussed in more detail, including known and new lensed images, planetary nebulae and young infrared stars of peculiar morphology, and quasars with catastrophic redshift errors in SDSS.


title: Probability of Causation with Sample Selection: A Reanalysis of the Impacts of J\'ovenes en Acci\'on on Formality

abstract: This paper identifies the probability of causation when there is sample selection. We show that the probability of causation is partially identified for individuals who are always observed regardless of treatment status and derive sharp bounds under three increasingly restrictive sets of assumptions. The first set imposes an exogenous treatment and a monotone sample selection mechanism. To tighten these bounds, the second set also imposes the monotone treatment response assumption, while the third set additionally imposes a stochastic dominance assumption. Finally, we use experimental data from the Colombian job training program J\'ovenes en Acci\'on to empirically illustrate our approach's usefulness. We find that, among always-employed women, at least 10.2% and at most 13.4% transitioned to the formal labor market because of the program. However, our 90%-confidence region does not reject the null hypothesis that the lower bound is equal to zero.


title: Curvelet-based Model for the Generation of Anisotropic Fractional Brownian Fields

abstract: We propose a curvelet-based model for the generation of Anisotropic Fractional Brownian Fields, that are suited to model systems with orientation-dependent self-similar properties. The synthesis procedure consists of generating coefficients in the curvelet space with zero-mean Gaussian distribution. This approach allows the representation of natural systems having stochastic behavior in some degree and also obeying to a given angular distribution of correlations. Examples of such systems are found in heterogeneous geological structures, in anisotropic materials and in complex disordered media.


title: On the Robustness of Deep Clustering Models: Adversarial Attacks and Defenses

abstract: Clustering models constitute a class of unsupervised machine learning methods which are used in a number of application pipelines, and play a vital role in modern data science. With recent advancements in deep learning -- deep clustering models have emerged as the current state-of-the-art over traditional clustering approaches, especially for high-dimensional image datasets. While traditional clustering approaches have been analyzed from a robustness perspective, no prior work has investigated adversarial attacks and robustness for deep clustering models in a principled manner. To bridge this gap, we propose a blackbox attack using Generative Adversarial Networks (GANs) where the adversary does not know which deep clustering model is being used, but can query it for outputs. We analyze our attack against multiple state-of-the-art deep clustering models and real-world datasets, and find that it is highly successful. We then employ some natural unsupervised defense approaches, but find that these are unable to mitigate our attack. Finally, we attack Face++, a production-level face clustering API service, and find that we can significantly reduce its performance as well. Through this work, we thus aim to motivate the need for truly robust deep clustering models.


title: SIMPLE: A Gradient Estimator for $k$-Subset Sampling

abstract: $k$-subset sampling is ubiquitous in machine learning, enabling regularization and interpretability through sparsity. The challenge lies in rendering $k$-subset sampling amenable to end-to-end learning. This has typically involved relaxing the reparameterized samples to allow for backpropagation, with the risk of introducing high bias and high variance. In this work, we fall back to discrete $k$-subset sampling on the forward pass. This is coupled with using the gradient with respect to the exact marginals, computed efficiently, as a proxy for the true gradient. We show that our gradient estimator, SIMPLE, exhibits lower bias and variance compared to state-of-the-art estimators, including the straight-through Gumbel estimator when $k = 1$. Empirical results show improved performance on learning to explain and sparse linear regression. We provide an algorithm for computing the exact ELBO for the $k$-subset distribution, obtaining significantly lower loss compared to SOTA.


title: IGNiteR: News Recommendation in Microblogging Applications (Extended Version)

abstract: News recommendation is one of the most challenging tasks in recommender systems, mainly due to the ephemeral relevance of news to users. As social media, and particularly microblogging applications like Twitter or Weibo, gains popularity as platforms for news dissemination, personalized news recommendation in this context becomes a significant challenge. We revisit news recommendation in the microblogging scenario, by taking into consideration social interactions and observations tracing how the information that is up for recommendation spreads in an underlying network. We propose a deep-learning based approach that is diffusion and influence-aware, called Influence-Graph News Recommender (IGNiteR). It is a content-based deep recommendation model that jointly exploits all the data facets that may impact adoption decisions, namely semantics, diffusion-related features pertaining to local and global influence among users, temporal attractiveness, and timeliness, as well as dynamic user preferences. To represent the news, a multi-level attention-based encoder is used to reveal the different interests of users. This news encoder relies on a CNN for the news content and on an attentive LSTM for the diffusion traces. For the latter, by exploiting previously observed news diffusions (cascades) in the microblogging medium, users are mapped to a latent space that captures potential influence on others or susceptibility of being influenced for news adoptions. Similarly, a time-sensitive user encoder enables us to capture the dynamic preferences of users with an attention-based bidirectional LSTM. We perform extensive experiments on two real-world datasets, showing that IGNiteR outperforms the state-of-the-art deep-learning based news recommendation methods.


title: The dichotomy spectrum approach for a global nonuniform asymptotic stability problem: Triangular case via uniformization

abstract: By considering the nonuniform exponential dichotomy spectrum, we introduce a global asymptotic nonuniform stability conjecture for nonautonomous differential systems, whose restriction to the autonomous case is related to the classical Markus--Yamabe Conjecture: we prove that the conjecture is verified for a family of triangular systems of nonautonomous differential equations satisfying boundedness assumptions. An essential tool to carry out the proof is a necessary and sufficient condition ensuring the property of nonuniform exponential dichotomy for upper block triangular linear differential systems. We also obtain some byproducts having interest on itself, such as, the diagonal significance property in terms on the above mentioned spectrum.


title: A Framework for Large Scale Synthetic Graph Dataset Generation

abstract: Recently there has been increasing interest in developing and deploying deep graph learning algorithms for many tasks, such as fraud detection and recommender systems. Albeit, there is a limited number of publicly available graph-structured datasets, most of which are tiny compared to production-sized applications or are limited in their application domain. This work tackles this shortcoming by proposing a scalable synthetic graph generation tool to scale the datasets to production-size graphs with trillions of edges and billions of nodes. The tool learns a series of parametric models from proprietary datasets that can be released to researchers to study various graph methods on the synthetic data increasing prototype development and novel applications. We demonstrate the generalizability of the framework across a series of datasets, mimicking structural and feature distributions as well as the ability to scale them across varying sizes demonstrating their usefulness for benchmarking and model development. Code can be found on https://github.com/NVIDIA/DeepLearningExamples/tree/master/Tools/DGLPyTorch/SyntheticGraphGeneration.


title: Rigidity results for shrinking and expanding Ricci solitons

abstract: In this paper, we prove some rigidity results for both shrinking and expanding Ricci solitons. First, we prove that compact shrinking Ricci solitons are Einstein if we control the maximum value of the potential function. Then, we prove some rigidity results for non-compact gradient expanding and shrinking Ricci solitons with pinched Ricci and scalar curvatures, assuming an asymptotic condition on the scalar curvature at infinity.


title: Affection: Learning Affective Explanations for Real-World Visual Data

abstract: In this work, we explore the emotional reactions that real-world images tend to induce by using natural language as the medium to express the rationale behind an affective response to a given visual stimulus. To embark on this journey, we introduce and share with the research community a large-scale dataset that contains emotional reactions and free-form textual explanations for 85,007 publicly available images, analyzed by 6,283 annotators who were asked to indicate and explain how and why they felt in a particular way when observing a specific image, producing a total of 526,749 responses. Even though emotional reactions are subjective and sensitive to context (personal mood, social status, past experiences) - we show that there is significant common ground to capture potentially plausible emotional responses with a large support in the subject population. In light of this crucial observation, we ask the following questions: i) Can we develop multi-modal neural networks that provide reasonable affective responses to real-world visual data, explained with language? ii) Can we steer such methods towards producing explanations with varying degrees of pragmatic language or justifying different emotional reactions while adapting to the underlying visual stimulus? Finally, iii) How can we evaluate the performance of such methods for this novel task? With this work, we take the first steps in addressing all of these questions, thus paving the way for richer, more human-centric, and emotionally-aware image analysis systems. Our introduced dataset and all developed methods are available on https://affective-explanations.org


title: Non-simple flow behavior in a polar van der Waals liquid: structural relaxation under scope

abstract: The non-exponential character of the structural relaxation is considered one of the hallmarks of the glassy dynamics and in this context, the singular shape observed by dielectric techniques has attracted the attention of the community for long time. Particularly, the exceptionally narrow dielectric response of polar glass formers has been attributed so far to dipolar cross correlations. Here we show that dipole interactions can couple to shear stress and modify the flow behavior preventing the occurrence of the simple liquid behavior. We discuss our findings in the general framework of the glassy dynamics and the role of intermolecular interactions.


title: Game-theoretic statistics and safe anytime-valid inference

abstract: Safe anytime-valid inference (SAVI) provides measures of statistical evidence and certainty -- e-processes for testing and confidence sequences for estimation -- that remain valid at all stopping times, accommodating continuous monitoring and analysis of accumulating data and optional stopping or continuation for any reason. These measures crucially rely on test martingales, which are nonnegative martingales starting at one. Since a test martingale is the wealth process of a player in a betting game, SAVI centrally employs game-theoretic intuition, language and mathematics. We summarize the SAVI goals and philosophy, and report recent advances in testing composite hypotheses and estimating functionals in nonparametric settings.

categories: math.ST cs.GT cs.IT math.IT stat.ME stat.TH


title: On Complex Analytic tools, and the Holomorphic Rotation methods

abstract: We describe recent nonlinear analytic approximation tools in the classical setting of Hardy spaces in the upper half plane and show how to transfer them to the higher dimensional real setting of harmonic functions in upper half spaces. It is known [6] that all harmonic functions in higher dimensions are combinations of holomorphic functions on 2 dimensional planes, extended as, constant in normal directions. We derive representation theorems, with corresponding isometries, opening the door for applications in higher dimensions, to the processing of highly oscillatory multidimensional signals.


title: TriSol: a major upgrade of the TwinSol RNB facility

abstract: We report here on the recent upgrade of the TwinSol radioactive nuclear beam (RNB) facility at the University of Notre Dame. The new TriSol system includes a magnetic dipole to provide a second beamline and a third solenoid which acts to reduce the size of the radioactive beam on target.


title: Finite-Blocklength Results for the A-channel: Applications to Unsourced Random Access and Group Testing

abstract: We present finite-blocklength achievability bounds for the unsourced A-channel. In this multiple-access channel, users noiselessly transmit codewords picked from a common codebook with entries generated from a $q$-ary alphabet. At each channel use, the receiver observes the set of different transmitted symbols but not their multiplicity. We show that the A-channel finds applications in unsourced random-access (URA) and group testing. Leveraging the insights provided by the finite-blocklength bounds and the connection between URA and non-adaptive group testing through the A-channel, we propose improved decoding methods for state-of-the-art A-channel codes and we showcase how A-channel codes provide a new class of structured group testing matrices. The developed bounds allow to evaluate the achievable error probabilities of group testing matrices based on random A-channel codes for arbitrary numbers of tests, items and defectives. We show that such a construction asymptotically achieves the optimal number of tests. In addition, every efficiently decodable A-channel code can be used to construct a group testing matrix with sub-linear recovery time.


title: Validity of path thermodynamic description of reactive systems: Microscopic simulations

abstract: Traditional stochastic modeling of reactive systems limits the domain of applicability of the associated path thermodynamics to systems involving a single elementary reaction at the origin of each observed change in composition. An alternative stochastic modeling has recently been proposed to overcome this limitation. These two ways of modeling reactive systems are in principle incompatible. The question thus arises about choosing the appropriate type of modeling to be used in practical situations. In the absence of sufficiently accurate experimental results, one way to address this issue is through the microscopic simulation of reactive fluids, usually based on hard-sphere dynamics in the Boltzmann limit. In this paper, we show that results obtained through such simulations unambiguously confirm the predictions of traditional stochastic modeling, invalidating a recently proposed alternative.


title: Robust Fair Clustering: A Novel Fairness Attack and Defense Framework

abstract: Clustering algorithms are widely used in many societal resource allocation applications, such as loan approvals and candidate recruitment, among others, and hence, biased or unfair model outputs can adversely impact individuals that rely on these applications. To this end, many fair clustering approaches have been recently proposed to counteract this issue. Due to the potential for significant harm, it is essential to ensure that fair clustering algorithms provide consistently fair outputs even under adversarial influence. However, fair clustering algorithms have not been studied from an adversarial attack perspective. In contrast to previous research, we seek to bridge this gap and conduct a robustness analysis against fair clustering by proposing a novel black-box fairness attack. Through comprehensive experiments, we find that state-of-the-art models are highly susceptible to our attack as it can reduce their fairness performance significantly. Finally, we propose Consensus Fair Clustering (CFC), the first robust fair clustering approach that transforms consensus clustering into a fair graph partitioning problem, and iteratively learns to generate fair cluster outputs. Experimentally, we observe that CFC is highly robust to the proposed attack and is thus a truly robust fair clustering alternative.


title: Ruler Rolling

abstract: At CCCG '21 O'Rourke proposed a variant of Hopcroft, Josephs and Whitesides' (1985) NP-complete problem {\sc Ruler Folding}, which he called {\sc Ruler Wrapping} and for which all folds must be 180 degrees in the same direction. Gagie, Saeidi and Sapucaia (2023) noted that if the last straight section of the ruler must be longest, then {\sc Ruler Wrapping} is equivalent to partitioning a string of positive integers into substrings whose sums are increasing such that the last substring sums to at most a given amount. They gave linear-time algorithms for the versions of {\sc Ruler Wrapping} both with and without this assumption. In real life we cannot repeatedly fold a carpenter's ruler 180 degrees in the same direction. In this paper we propose the more realistic problem of {\sc Ruler Rolling}, in which we repeatedly fold the segments 90 degrees in the same direction and thus fold the ruler into a rectangle instead of into an interval. We should report all the Pareto-optimal rollings. We note that if the last straight section of the ruler must be longer than the third to last -- analogously to Gagie et al.'s assumption -- then {\sc Ruler Rolling} is equivalent to partitioning a string of positive integers into substrings such that the sums of the even substrings are increasing, as are the sums of the odd substrings. We give a simple dynamic-programming algorithm that reports all the Pareto-optimal rollings in quadratic time under this assumption. Our algorithm still works even without the assumption, but then we are left with a quadratic number of two-dimensional feasible solutions, so finding the Pareto-optimal ones and increases our running time by a logarithmic factor. If we have a nice objective function, however, we still use quadratic time.


title: Learning Dynamic Abstract Representations for Sample-Efficient Reinforcement Learning

abstract: In many real-world problems, the learning agent needs to learn a problem's abstractions and solution simultaneously. However, most such abstractions need to be designed and refined by hand for different problems and domains of application. This paper presents a novel top-down approach for constructing state abstractions while carrying out reinforcement learning. Starting with state variables and a simulator, it presents a novel domain-independent approach for dynamically computing an abstraction based on the dispersion of Q-values in abstract states as the agent continues acting and learning. Extensive empirical evaluation on multiple domains and problems shows that this approach automatically learns abstractions that are finely-tuned to the problem, yield powerful sample efficiency, and result in the RL agent significantly outperforming existing approaches.


title: Congruity of genomic and epidemiological data in modeling of local cholera outbreaks

abstract: Cholera continues to be a global health threat. Understanding how cholera spreads between locations is fundamental to the rational, evidence-based design of intervention and control efforts. Traditionally, cholera transmission models have utilized cholera case count data. More recently, whole genome sequence data has qualitatively described cholera transmission. Integrating these data streams may provide much more accurate models of cholera spread, however no systematic analyses have been performed so far to compare traditional case-count models to the phylodynamic models from genomic data for cholera transmission. Here, we use high-fidelity case count and whole genome sequencing data from the 1991-1998 cholera epidemic in Argentina to directly compare the epidemiological model parameters estimated from these two data sources. We find that phylodynamic methods applied to cholera genomics data provide comparable estimates that are in line with established methods. Our methodology represents a critical step in building a framework for integrating case-count and genomic data sources for cholera epidemiology and other bacterial pathogens.


title: Towards an Artificial-Intelligence-Based Optical Scintillometer: Scaling Issue

abstract: Atmospheric turbulence strength (Cn2 parameter) sensing based on processing of intensity scintillation patterns with deep neural network (DNN) is considered. It is shown that DNN re-training with propagation distance change can be avoided by scaling of Cn2 values obtained using a DNN trained for a nominal distance L0 . The required Cn2 scaling factor can be obtained using either an analytical expression derived from the Kolmogorov turbulence theory (theory-based scaling), or through wave-optics numerical modeling and simulations (M&S-based scaling).


title: Calibrating Data Mismatches in Deep Learning-Based Quantitative Ultrasound Using Setting Transfer Functions

abstract: Deep learning (DL) can fail when there are data mismatches between training and testing data. Due to its operator-dependent nature, acquisition-related data mismatches, caused by different scanner settings, can occur in ultrasound imaging. Therefore, mitigating effects of such data mismatches is essential for wider clinical adoption of DL powered ultrasound imaging. To mitigate the effects, ideally we need to collect a large training set at each scanner setting. However, acquiring such training sets is expensive. Another approach could be training on a subset of imaging settings, which makes the data generation less expensive. However, there will still be generalization issues. As an alternative approach that is inexpensive and generalizable, we propose to collect a large training set at a single setting and a small calibration set at each scanner setting. Then, the calibration set will be used to calibrate data mismatches by using a signals and systems perspective. We tested the proposed solution to classify two phantoms. To investigate generalizability of the proposed solution, we calibrated three types of data mismatches: pulse frequency, focus and output power mismatches. To calibrate the setting mismatches, we calculated the setting transfer functions. The CNN trained with no calibration resulted in mean classification accuracies of 55.3%, 64.4% and 70.3% for pulse frequency, focus and output power mismatches, respectively. By using the setting transfer functions, which allowed a matching of the training and testing domains, we obtained mean accuracies of 95.3%, 92.99% and 99.32%, respectively. Therefore, the incorporation of the setting transfer functions between scanner settings can provide an economical means of generalizing a DL model for specific classification tasks where scanner settings are not fixed by the operator.


title: Detect, Retrieve, Comprehend: A Flexible Framework for Zero-Shot Document-Level Question Answering

abstract: Researchers produce thousands of scholarly documents containing valuable technical knowledge. The community faces the laborious task of reading these documents to identify, extract, and synthesize information. To automate information gathering, document-level question answering (QA) offers a flexible framework where human-posed questions can be adapted to extract diverse knowledge. Finetuning QA systems requires access to labeled data (tuples of context, question and answer). However, data curation for document QA is uniquely challenging because the context (i.e. answer evidence passage) needs to be retrieved from potentially long, ill-formatted documents. Existing QA datasets sidestep this challenge by providing short, well-defined contexts that are unrealistic in real-world applications. We present a three-stage document QA approach: (1) text extraction from PDF; (2) evidence retrieval from extracted texts to form well-posed contexts; (3) QA to extract knowledge from contexts to return high-quality answers -- extractive, abstractive, or Boolean. Using QASPER for evaluation, our detect-retrieve-comprehend (DRC) system achieves a +7.19 improvement in Answer-F1 over existing baselines while delivering superior context selection. Our results demonstrate that DRC holds tremendous promise as a flexible framework for practical scientific document QA.


title: Solvable Polynomials over the Gaussian Field Q(i)

abstract: In this paper, we describe a congruence property of solvable polynomials with coefficients in the Gaussian field Q(i).


title: Split Federated Learning on Micro-controllers: A Keyword Spotting Showcase

abstract: Nowadays, AI companies improve service quality by aggressively collecting users' data generated by edge devices, which jeopardizes data privacy. To prevent this, Federated Learning is proposed as a private learning scheme, using which users can locally train the model without collecting users' raw data to servers. However, for machine-learning applications on edge devices that have hard memory constraints, implementing a large model using FL is infeasible. To meet the memory requirement, a recent collaborative learning scheme named split federal learning is a potential solution since it keeps a small model on the device and keeps the rest of the model on the server. In this work, we implement a simply SFL framework on the Arduino board and verify its correctness on the Chinese digits audio dataset for keyword spotting application with over 90% accuracy. Furthermore, on the English digits audio dataset, our SFL implementation achieves 13.89% higher accuracy compared to a state-of-the-art FL implementation.


title: Duoidal Structures for Compositional Dependence

abstract: We provide a categorical framework for mathematical objects for which there is both a sort of "independent" and "dependent" composition. Namely we model them as duoidal categories in which both monoidal structures share a unit and the first is symmetric. We construct the free such category and observe that it is a full subcategory of the category of finite posets. Indeed each algebraic expression in the two monoidal operators corresponds to the poset built by taking disjoint unions and joins of the singleton poset. We characterize these "expressible" posets as precisely those which contain no "zig-zags." We then move on to describe categories equipped with $n$-ary operations for each $n$-element finite poset; we refer to them as "dependence categories" since they allow for combinations of objects based on any network of dependencies between them. These structures model various sorts of dependence including the space-like and time-like juxtaposition of weighted probability distributions in relativistic spacetime, which we model using polynomial endofunctors on the category of sets, as well as the runtimes for multiple computer programs run in parallel and series, which we model using the tropical semiring structure on nonnegative real numbers. With these examples in mind, we conclude by describing ways in which morphisms in a partial monoidal category can be "decorated" in a coherent manner by objects in a dependence category, such as labeling a network of parallel programs with their runtimes.


title: COMPS: Conceptual Minimal Pair Sentences for testing Robust Property Knowledge and its Inheritance in Pre-trained Language Models

abstract: A characteristic feature of human semantic cognition is its ability to not only store and retrieve the properties of concepts observed through experience, but to also facilitate the inheritance of properties (can breathe) from superordinate concepts (animal) to their subordinates (dog) -- i.e. demonstrate property inheritance. In this paper, we present COMPS, a collection of minimal pair sentences that jointly tests pre-trained language models (PLMs) on their ability to attribute properties to concepts and their ability to demonstrate property inheritance behavior. Analyses of 22 different PLMs on COMPS reveal that they can easily distinguish between concepts on the basis of a property when they are trivially different, but find it relatively difficult when concepts are related on the basis of nuanced knowledge representations. Furthermore, we find that PLMs can demonstrate behavior consistent with property inheritance to a great extent, but fail in the presence of distracting information, which decreases the performance of many models, sometimes even below chance. This lack of robustness in demonstrating simple reasoning raises important questions about PLMs' capacity to make correct inferences even when they appear to possess the prerequisite knowledge.


title: The Calibration Generalization Gap

abstract: Calibration is a fundamental property of a good predictive model: it requires that the model predicts correctly in proportion to its confidence. Modern neural networks, however, provide no strong guarantees on their calibration -- and can be either poorly calibrated or well-calibrated depending on the setting. It is currently unclear which factors contribute to good calibration (architecture, data augmentation, overparameterization, etc), though various claims exist in the literature. We propose a systematic way to study the calibration error: by decomposing it into (1) calibration error on the train set, and (2) the calibration generalization gap. This mirrors the fundamental decomposition of generalization. We then investigate each of these terms, and give empirical evidence that (1) DNNs are typically always calibrated on their train set, and (2) the calibration generalization gap is upper-bounded by the standard generalization gap. Taken together, this implies that models with small generalization gap (|Test Error - Train Error|) are well-calibrated. This perspective unifies many results in the literature, and suggests that interventions which reduce the generalization gap (such as adding data, using heavy augmentation, or smaller model size) also improve calibration. We thus hope our initial study lays the groundwork for a more systematic and comprehensive understanding of the relation between calibration, generalization, and optimization.


title: A note on the control of processes exhibiting input multiplicity

abstract: Steady state multiplicity can occur in nonlinear systems, and this presents challenges to feedback control. Input multiplicity arises when the same steady state output values can be reached with system inputs at different values. Dynamic systems with input multiplicities equipped with controllers with integral action have multiple stationary points, which may be locally stable or not. This is undesirable for operation. For a 2x2 example system with three stationary points we demonstrate how to design a set of two single loop controllers such that only one of the stationary points is locally stable, thus effectively eliminating the "input multiplicity problem" for control. We also show that when MPC is used for the example system, all three closed-loop stationary points are stable. Depending on the initial value of the input variables, the closed loop system under MPC may converge to different steady state input instances (but the same output steady state). Therefore we computationally explore the basin boundaries of this closed loop system. It is not clear how MPC or other modern nonlinear controllers could be designed so that only specific equilibrium points are stable.


title: Joint Reconfigurable Intelligent Surface Location and Passive Beamforming Optimization for Maximizing the Secrecy-Rate

abstract: The physical layer security (PLS) is investigated for reconfigurable intelligent surface (RIS) assisted wireless networks, where a source transmits its confidential information to a legitimate destination with the aid of a single small RIS in the presence of a malicious eavesdropper. A new joint RIS location and passive beamforming (J-LPB) optimization scheme is proposed for the sake of maximizing the secrecy rate under the RIS location constraint and the constraint that the modulus of the reflecting coefficient at each RIS's unit is not larger than 1. Specifically, we analyze the optimal location of the RIS, and conclude that the product involving the source-RIS distance and the RIS-destination distance should be minimized. Since the product minimization problem is nonconvex, we then propose a two-tier optimization algorithm for solving it. Based on the near-optimal RIS 3D location obtained, we further formulate the passive beamforming optimization problem, and then propose to apply the Charnes-Cooper transformation along with the sequential rank-one constraint relaxation (SROCR) algorithm to solve it. Our numerical results show that the secrecy rate of the proposed J-LPB optimization scheme is higher than that of the benchmarks. Explicitly, we use the following benchmarks: the near-source-based RIS location and passive beamforming (NSB-LPB) optimization scheme, the near-destination-based RIS location and passive beamforming (NDB-LPB) optimization scheme, and the random RIS location and passive beamforming (R-LPB) optimization scheme. Finally, the benefits of our J-LPB scheme are further increased with the number of RIS units.


title: In vivo three- and four-photon fluorescence microscopy using a 1.8 $\mu$m femtosecond fiber laser system

abstract: Multiphoton microscopy has enabled us to image cellular dynamics in vivo. However, the excitation wavelength for imaging with commercially available lasers is mostly limited between 650-1040 nm. Here we develop a femtosecond fiber laser system that produces $\sim$150 fs pulses at 1.8 $\mu$m. Our system starts from an erbium-doped silica fiber laser, and its wavelength is converted to 1.8 $\mu$m using a Raman shift fiber. The 1.8 $\mu$m pulses are amplified with a two-stage Tm:ZBLAN fiber amplifier. The final pulse energy is $\sim$1 $\mu$J, sufficient for in vivo imaging.


title: Generic Maximum-Valence Model for Fluid Polyamorphism

abstract: Recently, maximal valence model has been proposed to model liquid-liquid phase transition induced by polymerization in sulfur. In this paper we present a simple generic model to describe liquid polyamorphism in single-component fluids using a maximum-valence approach for any arbitrary coordination number. The model contains three types of interactions: i) atoms attract each other by van der Waals forces that generate a liquid-gas transition at low pressures, ii) atoms may form covalent bonds that induce association, and iii) additional repulsive forces between atoms with maximal valence and atoms with any valence. This additional repulsion generates liquid-liquid phase separation and the region of negative heat expansion coefficient (density anomaly) on a P-T phase diagram. We show the existence of liquid-liquid phase transitions for dimerization, polymerization, gelation and network formation for corresponding coordination numbers z = 1, 2, ..6 and discuss the limits of this generic model for producing fluid polyamorphism.


title: Option-Aware Adversarial Inverse Reinforcement Learning for Robotic Control

abstract: Hierarchical Imitation Learning (HIL) has been proposed to recover highly-complex behaviors in long-horizon tasks from expert demonstrations by modeling the task hierarchy with the option framework. Existing methods either overlook the causal relationship between the subtask and its corresponding policy or cannot learn the policy in an end-to-end fashion, which leads to suboptimality. In this work, we develop a novel HIL algorithm based on Adversarial Inverse Reinforcement Learning and adapt it with the Expectation-Maximization algorithm in order to directly recover a hierarchical policy from the unannotated demonstrations. Further, we introduce a directed information term to the objective function to enhance the causality and propose a Variational Autoencoder framework for learning with our objectives in an end-to-end fashion. Theoretical justifications and evaluations on challenging robotic control tasks are provided to show the superiority of our algorithm. The codes are available at https://github.com/LucasCJYSDL/HierAIRL.


title: Evaluate & Evaluation on the Hub: Better Best Practices for Data and Model Measurements

abstract: Evaluation is a key part of machine learning (ML), yet there is a lack of support and tooling to enable its informed and systematic practice. We introduce Evaluate and Evaluation on the Hub --a set of tools to facilitate the evaluation of models and datasets in ML. Evaluate is a library to support best practices for measurements, metrics, and comparisons of data and models. Its goal is to support reproducibility of evaluation, centralize and document the evaluation process, and broaden evaluation to cover more facets of model performance. It includes over 50 efficient canonical implementations for a variety of domains and scenarios, interactive documentation, and the ability to easily share implementations and outcomes. The library is available at https://github.com/huggingface/evaluate. In addition, we introduce Evaluation on the Hub, a platform that enables the large-scale evaluation of over 75,000 models and 11,000 datasets on the Hugging Face Hub, for free, at the click of a button. Evaluation on the Hub is available at https://huggingface.co/autoevaluate.


title: Towards Efficient Modularity in Industrial Drying: A Combinatorial Optimization Viewpoint

abstract: The industrial drying process consumes approximately 12% of the total energy used in manufacturing, with the potential for a 40% reduction in energy usage through improved process controls and the development of new drying technologies. To achieve cost-efficient and high-performing drying, multiple drying technologies can be combined in a modular fashion with optimal sequencing and control parameters for each. This paper presents a mathematical formulation of this optimization problem and proposes a framework based on the Maximum Entropy Principle (MEP) to simultaneously solve for both optimal values of control parameters and optimal sequence. The proposed algorithm addresses the combinatorial optimization problem with a non-convex cost function riddled with multiple poor local minima. Simulation results on drying distillers dried grain (DDG) products show up to 12% improvement in energy consumption compared to the most efficient single-stage drying process. The proposed algorithm converges to local minima and is designed heuristically to reach the global minimum.


title: "Down to Earth" Limits on Unidentified Aerial Phenomena in Ukraine (Comment on arXiv:2208.11215)

abstract: A recent report by astronomers about Unidentified Aerial Phenomena (UAP) in Ukraine (arXiv:2208.11215) suggests dark phantom objects of size 3-12 meters, moving at speeds of up to 15 km/s at a distance of up to 10-12 km with no optical emission. I show that the friction of such objects with the surrounding air would have generated a bright optical fireball. Reducing their inferred distance by a factor of ten is fully consistent with the size and speed of artillery shells.


title: Meta-Ensemble Parameter Learning

abstract: Ensemble of machine learning models yields improved performance as well as robustness. However, their memory requirements and inference costs can be prohibitively high. Knowledge distillation is an approach that allows a single model to efficiently capture the approximate performance of an ensemble while showing poor scalability as demand for re-training when introducing new teacher models. In this paper, we study if we can utilize the meta-learning strategy to directly predict the parameters of a single model with comparable performance of an ensemble. Hereto, we introduce WeightFormer, a Transformer-based model that can predict student network weights layer by layer in a forward pass, according to the teacher model parameters. The proprieties of WeightFormer are investigated on the CIFAR-10, CIFAR-100, and ImageNet datasets for model structures of VGGNet-11, ResNet-50, and ViT-B/32, where it demonstrates that our method can achieve approximate classification performance of an ensemble and outperforms both the single network and standard knowledge distillation. More encouragingly, we show that WeightFormer results can further exceeds average ensemble with minor fine-tuning. Importantly, our task along with the model and results can potentially lead to a new, more efficient, and scalable paradigm of ensemble networks parameter learning.


title: Towards Prototype-Based Self-Explainable Graph Neural Network

abstract: Graph Neural Networks (GNNs) have shown great ability in modeling graph-structured data for various domains. However, GNNs are known as black-box models that lack interpretability. Without understanding their inner working, we cannot fully trust them, which largely limits their adoption in high-stake scenarios. Though some initial efforts have been taken to interpret the predictions of GNNs, they mainly focus on providing post-hoc explanations using an additional explainer, which could misrepresent the true inner working mechanism of the target GNN. The works on self-explainable GNNs are rather limited. Therefore, we study a novel problem of learning prototype-based self-explainable GNNs that can simultaneously give accurate predictions and prototype-based explanations on predictions. We design a framework which can learn prototype graphs that capture representative patterns of each class as class-level explanations. The learned prototypes are also used to simultaneously make prediction for for a test instance and provide instance-level explanation. Extensive experiments on real-world and synthetic datasets show the effectiveness of the proposed framework for both prediction accuracy and explanation quality.


title: Scattering variability detected from the circumsource medium of FRB 20190520B

abstract: Fast radio bursts (FRBs) are millisecond-timescale radio transients, the origins of which are predominantly extragalactic and likely involve highly magnetized compact objects. FRBs undergo multipath propagation, or scattering, from electron density fluctuations on sub-parsec scales in ionized gas along the line-of-sight. Scattering observations have located plasma structures within FRB host galaxies, probed Galactic and extragalactic turbulence, and constrained FRB redshifts. Scattering also inhibits FRB detection and biases the observed FRB population. We report the detection of scattering times from the repeating FRB 20190520B that vary by up to a factor of two or more on minutes to days-long timescales. In one notable case, the scattering time varied from $7.9\pm0.4$ ms to less than 3.1 ms ($95\%$ confidence) over 2.9 minutes at 1.45 GHz. The scattering times appear to be uncorrelated between bursts or with dispersion and rotation measure variations. Scattering variations are attributable to dynamic, inhomogeneous plasma in the circumsource medium, and analogous variations have been observed from the Crab pulsar. Under such circumstances, the frequency dependence of scattering can deviate from the typical power-law used to measure scattering. Similar variations may therefore be detectable from other FRBs, even those with inconspicuous scattering, providing a unique probe of small-scale processes within FRB environments.


title: An extended version of the Cayley-Hamilton-Ziebur Theorem

abstract: The aim of this paper is to prove a Cayley-Hamilton-Ziebur Theorem for non-autonomous semilinear matrix differential equations. Moreover, we show the applicability of results like these to ODE theory.


title: Energy and Time Based Topology Control Approach to Enhance the Lifetime of WSN in an economic zone

abstract: An economic zone requires continuous monitoring and controlling by an autonomous surveillance system for heightening its production competency and security. Wireless sensor network (WSN) has swiftly grown popularity over the world for uninterruptedly monitoring and controlling a system. Sensor devices, the main elements of WSN, are given limited amount of energy, which leads the network to limited lifespan. Therefore, the most significant challenge is to increase the lifespan of a WSN system. Topology control mechanism (TCM) is a renowned method to enhance the lifespan of WSN. This paper proposes an approach to extend the lifetime of WSN for an economic area, targeting an economic zone in Bangladesh. Observations are made on the performance of the network lifetime considering the individual combinations of the TCM protocols and comparative investigation between the time and energy triggering strategy of TCM protocols. Results reveal the network makes a better performance in the case of A3 protocol while using the topology maintenance protocols with both time and energy triggering methods. Moreover, the performance of the A3 and DGETRec is superior to the other combinations of TCM protocols. Hence, the WSN system can be able to serve better connectivity coverage in the target economic zone.


title: Control Synthesis for Stability and Safety by Differential Complementarity Problem

abstract: This paper develops a novel control synthesis method for safe stabilization of control-affine systems as a Differential Complementarity Problem (DCP). Our design uses a control Lyapunov function (CLF) and a control barrier function (CBF) to define complementarity constraints in the DCP formulation to certify stability and safety, respectively. The CLF-CBF-DCP controller imposes stability as a soft constraint, which is automatically relaxed when the safety constraint is active, without the need for parameter tuning or optimization. We study the closed-loop system behavior with the CLF-CBF-DCP controller and identify conditions on the existence of local equilibria. Although in certain cases the controller yields undesirable local equilibria, those can be confined to a small subset of the safe set boundary by proper choice of the control parameters. Then, our method can avoid undesirable equilibria that CLF-CBF quadratic programming techniques encounter.


title: GAPX: Generalized Autoregressive Paraphrase-Identification X

abstract: Paraphrase Identification is a fundamental task in Natural Language Processing. While much progress has been made in the field, the performance of many state-of-the-art models often suffer from distribution shift during inference time. We verify that a major source of this performance drop comes from biases introduced by negative examples. To overcome these biases, we propose in this paper to train two separate models, one that only utilizes the positive pairs and the other the negative pairs. This enables us the option of deciding how much to utilize the negative model, for which we introduce a perplexity based out-of-distribution metric that we show can effectively and automatically determine how much weight it should be given during inference. We support our findings with strong empirical results.


title: Robust Estimation of Loss-Based Measures of Model Performance under Covariate Shift

abstract: We present methods for estimating loss-based measures of the performance of a prediction model in a target population that differs from the source population in which the model was developed, in settings where outcome and covariate data are available from the source population but only covariate data are available on a simple random sample from the target population. Prior work adjusting for differences between the two populations has used various weighting estimators with inverse odds or density ratio weights. Here, we develop more robust estimators for the target population risk (expected loss) that can be used with data-adaptive (e.g., machine learning-based) estimation of nuisance parameters. We examine the large-sample properties of the estimators and evaluate finite sample performance in simulations. Last, we apply the methods to data from lung cancer screening using nationally representative data from the National Health and Nutrition Examination Survey (NHANES) and extend our methods to account for the complex survey design of the NHANES.


title: Cloud removal Using Atmosphere Model

abstract: Cloud removal is an essential task in remote sensing data analysis. As the image sensors are distant from the earth ground, it is likely that part of the area of interests is covered by cloud. Moreover, the atmosphere in between creates a constant haze layer upon the acquired images. To recover the ground image, we propose to use scattering model for temporal sequence of images of any scene in the framework of low rank and sparse models. We further develop its variant, which is much faster and yet more accurate. To measure the performance of different methods {\em objectively}, we develop a semi-realistic simulation method to produce cloud cover so that various methods can be quantitatively analysed, which enables detailed study of many aspects of cloud removal algorithms, including verifying the effectiveness of proposed models in comparison with the state-of-the-arts, including deep learning models, and addressing the long standing problem of the determination of regularisation parameters. The latter is companioned with theoretic analysis on the range of the sparsity regularisation parameter and verified numerically.


title: The correlation between WISE 12 $\mu$m emission and molecular gas tracers on sub-kpc scales in nearby star-forming galaxies

abstract: We complement the MALATANG sample of dense gas in nearby galaxies with archival observations of $^{12}\rm CO$ and its isotopologues to determine scaling relations between Wide-field Infrared Survey Explorer (WISE) 12 $\mu$m emission and molecular gas tracers at sub-kiloparsec scales. We find that 12 $\mu$m luminosity is more tightly correlated with $^{12}\rm CO$ than it is with $^{13}\rm CO$ or dense gas tracers. Residuals between predicted and observed $^{12}\rm CO$ are only weakly correlated with molecular gas mass surface density ($\Sigma_{\rm mol}$) in regions where $\Sigma_{\rm mol}$ is very low ($\sim 10~{\rm M_{\odot}~pc^{-2}}$). Above this limit, the $^{12}\rm CO$ residuals show no correlations with physical conditions of molecular gas, while $^{13}\rm CO$ residuals depend on the gas optical depth and temperature. By analyzing differences from galaxy to galaxy, we confirm that the $^{12}\rm CO$-12 $\mu$m relation is strong and statistically robust with respect to star forming galaxies and AGN hosts. These results suggest that WISE 12 $\mu$m emission can be used to trace total molecular gas instead of dense molecular gas, likely because polycyclic aromatic hydrocarbons (PAHs, a major contributor to WISE 12 $\mu$m~emission) may be well-mixed with the gas that is traced by $^{12}\rm CO$. We propose that WISE 12 $\mu$m luminosity can be used to estimate molecular gas surface density for statistical analyses of the star formation process in galaxies.


title: Selective coupling of coherent optical phonons in YBa$_2$Cu$_3$O$_{7-\delta}$ with electronic transitions

abstract: We investigate coherent lattice dynamics in optimally doped YBa$_2$Cu$_3$O$_{7-\delta}$ driven by ultrashort ($\sim$ 12 fs) near infrared (NIR) and near ultraviolet (NUV) pulses. Transient reflectivity experiments, performed at room temperature and under moderate ($<$0.1 mJ/cm$^2$) excitation fluence, reveal $A_g$-symmetry phonon modes related to the O(2,3) bending in the CuO$_2$ planes and to the apical O(4) stretching at frequencies between 10 and 15 THz, in addition to the previously reported Ba and Cu(2) vibrations at 3.5 and 4.5 THz. The relative coherent phonon amplitudes are in stark contrast to the relative phonon intensities in the spontaneous Raman scattering spectrum excited at the same wavelength. This contrast indicates mode-dependent contributions of the Raman and non-Raman mechanisms to the coherent phonon generation. We show that the particularly intense coherent Cu(2) phonon, together with its initial phase, supports its generation predominately via a displacive mechanism, possibly involving the charge transfer within the CuO$_2$ planes. The small amplitude of the coherent out-of-phase O(2,3) bending mode at 10 THz also suggests the involvement of non-Raman generation mechanism. The generation of the other coherent phonons can in principle be explained within the framework of Raman mechanism. When the pump light has the polarization component perpendicular to the CuO$_2$ plane, the coherent O(4) mode at 15 THz is strongly enhanced compared to the in-plane excitation, corresponding to the large polarizability component associated with the hopping between the apical and the chain oxygens, O(4) and O(1).


title: Manipulation and Peer Mechanisms: A Survey

abstract: In peer mechanisms, the competitors for a prize also determine who wins. Each competitor may be asked to rank, grade, or nominate peers for the prize. Since the prize can be valuable, such as financial aid, course grades, or an award at a conference, competitors may be tempted to manipulate the mechanism. We survey approaches to prevent or discourage the manipulation of peer mechanisms. We conclude our survey by identifying several important research challenges.


title: A Multi-Stage Automated Online Network Data Stream Analytics Framework for IIoT Systems

abstract: Industry 5.0 aims at maximizing the collaboration between humans and machines. Machines are capable of automating repetitive jobs, while humans handle creative tasks. As a critical component of Industrial Internet of Things (IIoT) systems for service delivery, network data stream analytics often encounter concept drift issues due to dynamic IIoT environments, causing performance degradation and automation difficulties. In this paper, we propose a novel Multi-Stage Automated Network Analytics (MSANA) framework for concept drift adaptation in IIoT systems, consisting of dynamic data pre-processing, the proposed Drift-based Dynamic Feature Selection (DD-FS) method, dynamic model learning & selection, and the proposed Window-based Performance Weighted Probability Averaging Ensemble (W-PWPAE) model. It is a complete automated data stream analytics framework that enables automatic, effective, and efficient data analytics for IIoT systems in Industry 5.0. Experimental results on two public IoT datasets demonstrate that the proposed framework outperforms state-of-the-art methods for IIoT data stream analytics.


title: MAtt: A Manifold Attention Network for EEG Decoding

abstract: Recognition of electroencephalographic (EEG) signals highly affect the efficiency of non-invasive brain-computer interfaces (BCIs). While recent advances of deep-learning (DL)-based EEG decoders offer improved performances, the development of geometric learning (GL) has attracted much attention for offering exceptional robustness in decoding noisy EEG data. However, there is a lack of studies on the merged use of deep neural networks (DNNs) and geometric learning for EEG decoding. We herein propose a manifold attention network (mAtt), a novel geometric deep learning (GDL)-based model, featuring a manifold attention mechanism that characterizes spatiotemporal representations of EEG data fully on a Riemannian symmetric positive definite (SPD) manifold. The evaluation of the proposed MAtt on both time-synchronous and -asyncronous EEG datasets suggests its superiority over other leading DL methods for general EEG decoding. Furthermore, analysis of model interpretation reveals the capability of MAtt in capturing informative EEG features and handling the non-stationarity of brain dynamics.


title: ImpressLearn: Continual Learning via Combined Task Impressions

abstract: This work proposes a new method to sequentially train deep neural networks on multiple tasks without suffering catastrophic forgetting, while endowing it with the capability to quickly adapt to unseen tasks. Starting from existing work on network masking (Wortsman et al., 2020), we show that simply learning a linear combination of a small number of task-specific supermasks (impressions) on a randomly initialized backbone network is sufficient to both retain accuracy on previously learned tasks, as well as achieve high accuracy on unseen tasks. In contrast to previous methods, we do not require to generate dedicated masks or contexts for each new task, instead leveraging transfer learning to keep per-task parameter overhead small. Our work illustrates the power of linearly combining individual impressions, each of which fares poorly in isolation, to achieve performance comparable to a dedicated mask. Moreover, even repeated impressions from the same task (homogeneous masks), when combined, can approach the performance of heterogeneous combinations if sufficiently many impressions are used. Our approach scales more efficiently than existing methods, often requiring orders of magnitude fewer parameters and can function without modification even when task identity is missing. In addition, in the setting where task labels are not given at inference, our algorithm gives an often favorable alternative to the one-shot procedure used by Wortsman et al., 2020. We evaluate our method on a number of well-known image classification datasets and network architectures.


title: Bicoptor: Two-round Secure Three-party Non-linear Computation without Preprocessing for Privacy-preserving Machine Learning

abstract: The overhead of non-linear functions dominates the performance of the secure multiparty computation (MPC) based privacy-preserving machine learning (PPML). This work introduces a family of novel secure three-party computation (3PC) protocols, Bicoptor, which improve the efficiency of evaluating non-linear functions. The basis of Bicoptor is a new sign determination protocol, which relies on a clever use of the truncation protocol proposed in SecureML (S\&P 2017). Our 3PC sign determination protocol only requires two communication rounds, and does not involve any preprocessing. Such sign determination protocol is well-suited for computing non-linear functions in PPML, e.g. the activation function ReLU, Maxpool, and their variants. We develop suitable protocols for these non-linear functions, which form a family of GPU-friendly protocols, Bicoptor. All Bicoptor protocols only require two communication rounds without preprocessing. We evaluate Bicoptor under a 3-party LAN network over a public cloud, and achieve more than 370,000 DReLU/ReLU or 41,000 Maxpool (find the maximum value of nine inputs) operations per second. Under the same settings and environment, our ReLU protocol has a one or even two orders of magnitude improvement to the state-of-the-art works, Falcon (PETS 2021) or Edabits (CRYPTO 2020), respectively without batch processing.


title: WavSpA: Wavelet Space Attention for Boosting Transformers' Long Sequence Learning Ability

abstract: Transformer and its variants are fundamental neural architectures in deep learning. Recent works show that learning attention in the Fourier space can improve the long sequence learning capability of Transformers. We argue that wavelet transform shall be a better choice because it captures both position and frequency information with linear time complexity. Therefore, in this paper, we systematically study the synergy between wavelet transform and Transformers. We propose Wavelet Space Attention (WavSpA) that facilitates attention learning in a learnable wavelet coefficient space which replaces the attention in Transformers by (1) applying forward wavelet transform to project the input sequences to multi-resolution bases, (2) conducting attention learning in the wavelet coefficient space, and (3) reconstructing the representation in input space via backward wavelet transform. Extensive experiments on the Long Range Arena demonstrate that learning attention in the wavelet space using either fixed or adaptive wavelets can consistently improve Transformer's performance and also significantly outperform learning in Fourier space. We further show our method can enhance Transformer's reasoning extrapolation capability over distance on the LEGO chain-of-reasoning task.


title: The eigenvalues and eigenvectors of the 5D discrete Fourier transform number operator revisited

abstract: A systematic analytic approach to the evaluation of the eigenvalues and eigenvectors of the 5D discrete number operator is formulated. This approach is essentially based on the use of the symmetricity of 5D discrete Fourier transform operator with respect to the discrete reflection operator.


title: Tunneling-current-induced local excitonic luminescence in p-doped WSe$_2$ monolayers

abstract: We have studied the excitonic properties of exfoliated tungsten diselenide (WSe$_2$) monolayers transferred to gold substrates using the tunneling current in a Scanning Tunneling Microscope (STM) operated in air to excite the light emission locally. In obtained spectra, emission energies are independent of the applied bias voltage and resemble photoluminescence (PL) results, indicating that, in both cases, the light emission is due to neutral and charged exciton recombination. Interestingly, the electron injection rate, that is, the tunneling current, can be used to control the ratio of charged to neutral exciton emission. The obtained quantum yield in the transition metal dichalcogenide (TMD) is $~5x10^{-7}$ photons per electron. The proposed excitation mechanism is the direct injection of carriers into the conduction band. The monolayer WSe$_2$ presents bright and dark defects spotted by STM images performed under UHV. STS confirms the sample as p-doped, possibly as a net result of the observed defects. The presence of an interfacial water layer decouples the monolayer from the gold support and allows excitonic emission from the WSe$_2$ monolayer. The creation of a water layer is an inherent feature of the sample transferring process due to the ubiquitous air moisture. Consequently, vacuum thermal annealing, which removes the water layer, quenches excitonic luminescence from the TMD. The tunneling current can locally displace water molecules leading to excitonic emission quenching and to plasmonic emission due to the gold substrate. The present findings extend the use and the understanding of STM induced light emission (STM-LE) on semiconducting TMDs to probe exciton emission and dynamics with high spatial resolution.


title: Capturing the dynamics of a two orifice silo with the {\mu}(I) model and extensions

abstract: Granular material in a silo with two openings can display a `flow rate dip', where a non-monotonic relationship between flow rate and orifice separation occurs. In this paper we study continuum modelling of the silo with two openings. We find that the $\mu(I)$ rheology can capture the flow rate dip if physically relevant friction parameters are used. We also extend the model by accounting for wall friction, dilatancy, and non-local effects. We find that accounting for the wall friction using a Hele-Shaw model better replicates the qualitative characteristics of the flow rate dip seen in experimental data, while dilatancy and non-local effects have very little effect on the qualitative characteristics of the mass flow rate dip. However, we find that all three of these factors have a significant impact on the mass flow rate, indicating that a continuum model which accurately predicts flow rate will need to account for these effects.


title: Inverse mass ordering of light scalar mesons in the Nambu Jona-Lasinio model

abstract: The masses of the low-lying scalar mesons are investigated in the three-flavor Nambu Jona-Lasinio (NJL) model by treating the scalar mesons as composite objects of a quark and an antiquark. It is known that a simple $\bar qq$ picture fails to reproduce so-called inverse mass ordering for the scalar mesons. Recently a new mechanism to reproduce the observed mass spectrum of the scalar mesons was proposed in a linear sigma model by introducing flavor symmetry breaking induced by the U(1) axial anomaly. Motivated by this proposal, we examine whether this new mechanism works also in the NJL model. By calculating the scalar meson masses, we find that the NJL model reproduces the observed mass ordering with sufficient strength of the new term. With this mechanism, it turns out that the constituent strange quark mass gets degenerate to that of the up and down quark if the inverse mass ordering is reproduced. We also discuss the scalar diquark masses to check the consistency of the degeneracy of the constituent quark masses with the light baryon masses.


title: Analysis of the contribution of the quantum anomaly energy to the proton mass

abstract: Inspired by the recent Hall C and GlueX measurements of $J/\psi$ photoproduction, a systematic analysis of the contribution of quantum anomalous energy (QAE) to the proton mass is carried out under the framework of the vector meson dominance model. The results show that the effective Pomeron model and the parametrized two gluon exchange model can explain the cross section of $J/\psi$ photoproduction well. Based on the predicted cross section values given by the two models, the distribution of the QAE contribution with the energy is extracted for the first time. Finally, the average value of the QAE contribution is estimated to be (3.50$\pm$0.70)$\%$, which suggests that the QAE contribution to the proton mass is small. Accordingly, we compared this result with those of other groups and explored the causes for the differences.


title: Measurement of branching fractions of $\Lambda_c^+\to{}pK_S^0K_S^0$ and $\Lambda_c^+\to{}pK_S^0\eta$ at Belle

abstract: We present a study of a singly Cabibbo-suppressed decay $\Lambda_c^+\to{}pK_S^0K_S^0$ and a Cabibbo-favored decay $\Lambda_c^+\to{}pK_S^0\eta$ based on 980 $\rm fb^{-1}$ of data collected by the Belle detector, operating at the KEKB energy-asymmetric $e^+e^-$ collider. We measure their branching fractions relative to $\Lambda_c^+\to{}pK_S^0$: $\mathcal{B}(\Lambda_c^+\to{}pK_S^0K_S^0)/\mathcal{B}(\Lambda_c^+\to{}pK_S^0)={(1.48 \pm 0.08 \pm 0.04)\times 10^{-2}}$ and $\mathcal{B}(\Lambda_c^+\to{}pK_S^0\eta)/\mathcal{B}(\Lambda_c^+\to{}pK_S^0)={(2.73\pm 0.06\pm 0.13)\times 10^{-1}}$. Combining with the world average $\mathcal{B}(\Lambda_c^+\to{}pK_S^0)$, we have the absolute branching fractions: $\mathcal{B}(\Lambda_c^+\to{}pK_S^0K_S^0) = {(2.35\pm 0.12\pm 0.07 \pm 0.12 )\times 10^{-4}}$ and $\mathcal{B}(\Lambda_c^+\to{}pK_S^0\eta) = {(4.35\pm 0.10\pm 0.20 \pm 0.22 )\times 10^{-3}}$. The first and second uncertainties are statistical and systematic, respectively, while the third ones arise from the uncertainty on $\mathcal{B}(\Lambda_c^+\to{}pK_S^0)$. The mode $\Lambda_c^+\to{}pK_S^0K_S^0$ is observed for the first time and has a statistical significance of $>\!10\sigma$. The branching fraction of $\Lambda_c^+\to{}pK_S^0\eta$ has been measured with a threefold improvement in precision over previous results and is found to be consistent with the world average.


title: A quantum spin liquid phase in the Kitaev-Hubbard model

abstract: The quantum spin liquid (QSL) state has been searched intensively in Kitaev-like materials, such as the Iridium oxides $A_2$IrO$_3$ and $\alpha$-RuCl$_3$. The half-filled Kitaev-Hubbard model with bond dependent hopping terms is used to describe the Kitaev-like materials, which is calculated using the state-of-the-art fermionic projected entangled pair states (fPEPS) method. We find a QSL phase near the Mott insulator transition, which has a strong first-order transition to the semi-metal phase with the decrease of Hubbard $U$. We suggest that a promising routine to find the QSL is to find the Iridium oxides that are near the Mott insulator transitions.


title: Partial Equilibration Scenario in 3D athermal martensites quenched below first-order transition temperatures

abstract: To test a Partial Equilibration Scenario (PES) of Ritort and colleagues, we do Monte Carlo simulations of discretized-strain spin models, for four 3D martensitic structural transitions under quenches to a bath temperature $T <T_0$ below a first-order transition. The ageing system faces entropy barriers, in {\it searches} for energy-lowering passages between quasi-microcanonical energy shells. We confirm the PES signature of an exponential-tail distribution of intermittent heat releases to the bath, scaled in an effective temperature, that in our case, depends on the quench. When its inverse $\beta_{eff} (T) \equiv 1/T_{eff} (T) $ vanishes below a `martensite start' temperature $T_1$ of avalanche conversions, then entropy barriers vanish. When this search temperature $T_{eff} (T)$ vanishes, PES cooling is arrested, as entropy barriers diverge. We find a {\it linear} vanishing of $T_{eff}(T)\sim T_d -T$, below a delay-divergence temperature $T_d$ in between, $T_1 < T_d < T_0$. Martensitic conversion delays $e^{1/T_{eff}} \sim e^{1/(T_d -T)}$ thus have Vogel-Fulcher-Tammann like divergences. Post-quench delay data extracted from simulations and athermal martensitic alloys, are both consistent with predictions.


title: Paradoxical constitutive law between donor O-H bond length and its stretching frequency in water dimer

abstract: The constitutive laws of hydrogen bonds (H-bonds) are central to understanding microphysical processes not precisely observed, especially in terms of structural properties. Previous experiences in water H-bonding revealed that as the intermolecular O...O distance shortens, the O-H stretching frequency redshifts; thus, an elongated O-H bond length can be empirically inferred, which is described as the constitutive law under the cooperative effect. Here, using the high-precision CCSD(T) method, we report a violation of the conventional constitutive law in water dimer. That is, when the variation in the O...O distance changes from stretching by 0.06 to contracting by -0.15 angstrom compared to the equilibrium position, the donor O-H bond length decreases from 0.9724 to 0.9717 angstrom, and the O-H stretching frequency redshifts from 3715 to 3708 cm-1. Our work highlights that the O-H bond length decreases simultaneously with its stretching frequency, which is clearly inconsistent with the previously recognized constitutive law.


title: Locally finite infinity-modules and weak Loday-Pirashvili modules over differential graded Lie algebras

abstract: Motivated by recent developments of $\infty$-categorical theories related to differential graded (dg for short) Lie algebras, we develop a general framework for locally finite $\infty$-$\mathfrak{g}$-modules over a dg Lie algebra $\mathfrak{g}$. We show that the category of such locally finite $\infty$-$\mathfrak{g}$-modules is almost a model category in the sense of Vallette. As a homotopy theoretical generalization of Loday and Pirashvili's Lie algebra objects in the tensor category of linear maps, we further study weak Loday-Pirashvili modules consisting of $\infty$-morphisms from locally finite $\infty$-$\mathfrak{g}$-modules to the adjoint module $\mathfrak{g}$. From the category of such weak Loday-Pirashvili modules over $\mathfrak{g}$, we find a functor that maps to the category of Leibniz$_\infty$ algebras enriched over the Chevalley-Eilenberg dg algebra of $\mathfrak{g}$. This functor can be regarded as the homotopy lifting of Loday and Pirashvili's original method to realize Leibniz algebras from Lie algebra objects in the category of linear maps.


title: Finding Top-k Longest Palindromes in Substrings

abstract: Palindromes are strings that read the same forward and backward. Problems of computing palindromic structures in strings have been studied for many years with a motivation of their application to biology. The longest palindrome problem is one of the most important and classical problems regarding palindromic structures, that is, to compute the longest palindrome appearing in a string $T$ of length $n$. The problem can be solved in $O(n)$ time by the famous algorithm of Manacher [Journal of the ACM, 1975]. This paper generalizes the longest palindrome problem to the problem of finding top-$k$ longest palindromes in an arbitrary substring, including the input string $T$ itself. The internal top-$k$ longest palindrome query is, given a substring $T[i..j]$ of $T$ and a positive integer $k$ as a query, to compute the top-$k$ longest palindromes appearing in $T[i.. j]$. This paper proposes a linear-size data structure that can answer internal top-$k$ longest palindromes query in optimal $O(k)$ time. Also, given the input string $T$, our data structure can be constructed in $O(n\log n)$ time. For $k = 1$, the construction time is reduced to $O(n)$.


title: Intersection numbers on fibrations and Catalan numbers

abstract: On an elliptic surface or threefold, Catalan numbers appear when one tries to compute the autoequivalence group action on the Bridgeland stability manifold. We explain why this happens by identifying a class of equations in the Chow ring of a fibration, where the solutions always involve Catalan numbers.


title: Factor Augmented Sparse Throughput Deep ReLU Neural Networks for High Dimensional Regression

abstract: This paper introduces a Factor Augmented Sparse Throughput (FAST) model that utilizes both latent factors and sparse idiosyncratic components for nonparametric regression. The FAST model bridges factor models on one end and sparse nonparametric models on the other end. It encompasses structured nonparametric models such as factor augmented additive models and sparse low-dimensional nonparametric interaction models and covers the cases where the covariates do not admit factor structures. Via diversified projections as estimation of latent factor space, we employ truncated deep ReLU networks to nonparametric factor regression without regularization and to a more general FAST model using nonconvex regularization, resulting in factor augmented regression using neural network (FAR-NN) and FAST-NN estimators respectively. We show that FAR-NN and FAST-NN estimators adapt to the unknown low-dimensional structure using hierarchical composition models in nonasymptotic minimax rates. We also study statistical learning for the factor augmented sparse additive model using a more specific neural network architecture. Our results are applicable to the weak dependent cases without factor structures. In proving the main technical result for FAST-NN, we establish a new deep ReLU network approximation result that contributes to the foundation of neural network theory. Our theory and methods are further supported by simulation studies and an application to macroeconomic data.


title: A general method for obtaining degenerate solutions to the Dirac and Weyl equations and a discussion on the experimental detection of degenerate states

abstract: In this work we describe a general method for obtaining degenerate solutions to the Dirac equation, corresponding to an infinite number of electromagnetic 4-potentials and fields, which are explicitly calculated. In more detail, using four arbitrary real functions, one can automatically construct a spinor which is solution to the Dirac equation for an infinite number of electromagnetic 4-potentials, defined by those functions. An interesting characteristic of these solutions is that, in the case of Dirac particles with non-zero mass, the degenerate spinors should be localized, both in space and time. Our method is also extended to the cases of massless Dirac and Weyl particles, where the localization of the spinors is no longer required. Finally, we propose two experimental methods for detecting the presence of degenerate states.


title: Systematic calculations of cluster radioactivity half-lives in trans-lead nuclei

abstract: In the present work, based on Wentzel-Kramers-Brillouin (WKB) theory, considering the cluster preformation probability (Pc), we systematically investigate the cluster radioactivity half-lives of 22 trans-lead nuclei ranging from 221Fr to 242Cm. As for Pc, when the mass number of the emitted cluster Ac<28, it is obtained by the exponential relationship of Pc to the alpha decay preformation probability Pa proposed by R.Blendowskeis et al. [Phys. Rev. Lett. 61, 1930 (1988)], while Pa is calculated through cluster-formation model (CFM). Whereas Ac >= 28, it is achieved through the charge-number dependence of Pc on the decay products proposed by Ren et al. [Phys. Rev. C 70, 034304 (2004)]. The half-lives of cluster radioactivity have been calculated by the density-dependent cluster model [Phys. Rev. C 70, 034304 (2004)] and by the unified formula of half-lives for alpha decay and cluster radioactivity [Phys. Rev. C 78, 044310 (2008)]. For comparison, a universal decay law (UDL) proposed by Qi et al. [Phys. Rev. C 80, 044326 (2009)], a semi-empirical model for both alpha decay and cluster radioactivity proposed by Santhosh [J. Phys. G: Nucl. Part. Phys. 35, 085102 (2008)] and a unified formula of half-lives for alpha decay and cluster radioactivity [Phys. Rev. C 78, 044310 (2008)] are also used. The calculated results in our work, Ni's formula as well as UDL can well reproduce the experimental data and are better than those in Santhosh's model. In addition, we extend this model to predict the half-lives for 51 nuclei, whose cluster radioactivity is energetically allowed or observed but yet not quantified in NUBASE2020.


title: Possible realization of three-dimensional quantum spin liquid behavior in HoVO4

abstract: The study of geometrically frustrated magnetic systems with unusual crystal field ground states offers a possibility of realizing the new aspects of physics of disordered systems. In this study, we report our results of structural, magnetic susceptibility, heat capacity measurements, along with density functional theory calculations on HoVO4; a compound in which the presence of a distorted kind of HoO8 polyhedral leads to multiple magnetic interaction paths. The observed broad maximum below 10 K in the temperature response of DC susceptibility curves implies the presence of short-range correlations. AC susceptibility rules out the possibility of any kind of spin freezing. Temperature dependent heat capacity measurement at zero field indicate towards the absence of long-range ordering, along with the presence of a broad maximum centered around 14 K. The residual heat capacity exhibits a characteristic power-law (T{\alpha}) behavior with the exponent {\alpha} nearly equal to 2, which is analogous to that observed for other 3D quantum spin liquid systems. The density functional theory calculations signify the presence of dominant second and third nearest neighbor interactions, which in turn lead to magnetic frustration in our system. Our investigations suggest that HoVO4 can be a candidate for realizing a 3D quantum spin liquid state.


title: Restricted phase space thermodynamics of Einstein-power-Yang-Mills AdS black hole

abstract: We consider the thermodynamics of the Einstein-Power-Yang-Mills AdS black holes in the context of the gauge-gravity duality. Under this framework, the Newton's gravitational constant and the cosmological constant are varied in the system. We rewrite the thermodynamical first law in a more extended form containing both the pressure and the central charge of the dual conformal field theory, i.e., the restricted phase transition formula. A novel phenomena arises: the dual quantity of pressure is the effective volume, not the geometric one. That is leading to a new behavior of the Van de Waals-like phase transition for this system with the fixed central charge: the supercritical phase transition. From the Ehrenfest's scheme perspective, we check out the second-order phase transition of the EPYM AdS black hole. Furthermore the effect of non-linear Yang-Mills parameter on these thermodynamical properties is also investigated.


title: Van Vleck paramagnetism and enhancement of effective moment with magnetic field in rare earth orthovanadate EuVO4

abstract: The 4f^6 systems were hypothesized to possess non-magnetic (J = 0) ground state. However, all such systems have distinctly shown the presence of non-zero effective moment. In this context, a rare earth orthovanadate EuVO4, which in spite of having J = 0 ground state, possess non-zero magnetic moment. Our studies reveal three different regions in this compound, boundaries of which are demarcated from susceptibility data. The high temperature susceptibility exhibits linear dependence on temperature which arises due to tetragonal crystal field, followed by a temperature independent plateau like region, ascribed to Van Vleck paramagnetism. At low temperatures, Curie-Weiss like behaviour is observed, which arise due to magnetic Eu2+ moments and results in non-zero effective moment. Our analysis reveals that the separation ({\lambda}) between the J = 0 and J = 1 states decreases on increasing the external magnetic field which leads to an enhanced effective moment at higher fields.


title: Quantizable functions on K\"ahler manifolds and non-formal quantization

abstract: Applying the Fedosov connections constructed in our previous work, we find a (dense) subsheaf of smooth functions on a K\"ahler manifold $X$ which admits a non-formal deformation quantization. When $X$ is prequantizable and the Fedosov connection satisfies an integrality condition, we prove that this subsheaf of functions can be quantized to a sheaf of twisted differential operators (TDO), which is isomorphic to that associated to the prequantum line bundle. We also show that examples of such quantizable functions are given by images of quantum moment maps.


title: Multi-Camera Collaborative Depth Prediction via Consistent Structure Estimation

abstract: Depth map estimation from images is an important task in robotic systems. Existing methods can be categorized into two groups including multi-view stereo and monocular depth estimation. The former requires cameras to have large overlapping areas and sufficient baseline between cameras, while the latter that processes each image independently can hardly guarantee the structure consistency between cameras. In this paper, we propose a novel multi-camera collaborative depth prediction method that does not require large overlapping areas while maintaining structure consistency between cameras. Specifically, we formulate the depth estimation as a weighted combination of depth basis, in which the weights are updated iteratively by a refinement network driven by the proposed consistency loss. During the iterative update, the results of depth estimation are compared across cameras and the information of overlapping areas is propagated to the whole depth maps with the help of basis formulation. Experimental results on DDAD and NuScenes datasets demonstrate the superior performance of our method.


title: A novel $\sqrt{19}\times\sqrt{19}$ superstructure in epitaxially grown 1T-TaTe$_2$

abstract: The spontaneous formation of electronic orders is a crucial element for understanding complex quantum states and engineering heterostructures in two-dimensional materials. We report a novel $\sqrt{19}\times\sqrt{19}$ charge order in few-layer thick 1T-TaTe$_2$ transition metal dichalcogenide films grown by molecular beam epitaxy, which has not been realized. Our photoemission and scanning probe measurements demonstrate that monolayer 1T-TaTe$_2$ exhibits a variety of metastable charge density wave orders, including the $\sqrt{19}\times\sqrt{19}$ superstructure, which can be selectively stabilized by controlling the post-growth annealing temperature. Moreover, we find that only the $\sqrt{19}\times\sqrt{19}$ order persists in 1T-TaTe$_2$ films thicker than a monolayer, up to 8 layers. Our findings identify the previously unrealized novel electronic order in a much-studied transition metal dichalcogenide and provide a viable route to control it within the epitaxial growth process.


title: Threshold cascade dynamics on signed random networks

abstract: Relationships between individuals in a social network, genes in biological systems, and spins in magnetic systems often reflect a mixture of positive (friendly) and negative (antagonistic) interactions. However, most studies of complex networks have focused on networks consisting of solely positive interactions. Here, we study threshold cascades on signed networks composed of both positive and negative connections, focusing on when a pair of nodes connected by a negative link can only be activated exclusively to each other. We found that the negative interactions not only suppress global cascades, but also induce the heterogeneity in activation patterns manifesting from single-node to network levels. Our results suggest that negative interactions may be an important source of the variability in cascading dynamics.


title: Mass function of a young cluster in a low-metallicity environment. Sh 2-209

abstract: We present deep near-infrared (NIR) imaging of Sh 2-209 (S209), a low-metallicity (${\rm [O/H]} = - 0.5$ dex) HII region in the Galaxy. From the NIR images, combined with astrometric data from Gaia EDR3, we estimate the distance to S209 to be 2.5 kpc. This is close enough to enable us to resolve cluster members clearly ($\simeq$1000 AU separation) down to a mass-detection limit of $\simeq$0.1 $M_\odot$, and we have identified two star-forming clusters in S209, with individual cluster scales $\sim$1 pc. We employ a set of model luminosity functions to derive the underlying initial mass functions (IMFs) and ages for both clusters. The IMFs we obtained for both clusters exhibit slightly flat high-mass slopes ($\Gamma \simeq -1.0$) compared to the Salpeter IMF ($\Gamma = -1.35$), and their break mass of $\simeq$0.1 $M_\odot$ is lower than those generally seen in the solar neighborhood ($\sim$0.3 $M_\odot$). In particular, because the S209 main cluster is a star-forming cluster with a larger number of members ($\sim$1500) than the number ($\sim$100) in regions previously studied in such environments, it is possible for the first time to derive the IMF in a low-metallicity environment with high accuracy over the wide mass range 0.1--20 $M_\odot$.


title: Explicit reciprocity laws and Iwasawa theory for modular forms

abstract: We prove that the Mazur-Tate elements of an eigenform $f$ sit inside the Fitting ideals of the corresponding dual Selmer groups along the cyclotomic $\mathbb Z_p$-extension (up to scaling by a single constant). Our method begins with the construction of local cohomology classes built via the $p$-adic local Langlands correspondence. From these classes, we build algebraic analogues of the Mazur-Tate elements which we directly verify sit in the appropriate Fitting ideals. Using Kato's Euler system and explicit reciprocity laws, we prove that these algebraic elements divide the corresponding Mazur-Tate elements, implying our theorem.


title: Doubly Robust Proximal Synthetic Controls

abstract: To infer the treatment effect for a single treated unit using panel data, synthetic control methods construct a linear combination of control units' outcomes that mimics the treated unit's pre-treatment outcome trajectory. This linear combination is subsequently used to impute the counterfactual outcomes of the treated unit had it not been treated in the post-treatment period, and used to estimate the treatment effect. Existing synthetic control methods rely on correctly modeling certain aspects of the counterfactual outcome generating mechanism and may require near-perfect matching of the pre-treatment trajectory. Inspired by proximal causal inference, we obtain two novel nonparametric identifying formulas for the average treatment effect for the treated unit: one is based on weighting, and the other combines models for the counterfactual outcome and the weighting function. We introduce the concept of covariate shift to synthetic controls to obtain these identification results conditional on the treatment assignment. We also develop two treatment effect estimators based on these two formulas and the generalized method of moments. One new estimator is doubly robust: it is consistent and asymptotically normal if at least one of the outcome and weighting models is correctly specified. We demonstrate the performance of the methods via simulations and apply them to evaluate the effectiveness of a Pneumococcal conjugate vaccine on the risk of all-cause pneumonia in Brazil.