title: High-order exponential time differencing multi-resolution alternative finite difference WENO methods for nonlinear degenerate parabolic equations

abstract: In this paper, we focus on the finite difference approximation of nonlinear degenerate parabolic equations, a special class of parabolic equations where the viscous term vanishes in certain regions. This vanishing gives rise to additional challenges in capturing sharp fronts, beyond the restrictive CFL conditions commonly encountered with explicit time discretization in parabolic equations. To resolve the sharp front, we adopt the high-order multi-resolution alternative finite difference WENO (A-WENO) methods for the spatial discretization. To alleviate the time step restriction from the nonlinear stiff diffusion terms, we employ the exponential time differencing Runge-Kutta (ETD-RK) methods, a class of efficient and accurate exponential integrators, for the time discretization. However, for highly nonlinear spatial discretizations such as high-order WENO schemes, it is a challenging problem how to efficiently form the linear stiff part in applying the exponential integrators, since direct computation of a Jacobian matrix for high-order WENO discretizations of the nonlinear diffusion terms is very complicated and expensive. Here we propose a novel and effective approach of replacing the exact Jacobian of high-order multi-resolution A-WENO scheme with that of the corresponding high-order linear scheme in the ETD-RK time marching, based on the fact that in smooth regions the nonlinear weights closely approximate the optimal linear weights, while in non-smooth regions the stiff diffusion degenerates. The algorithm is described in detail, and numerous numerical experiments are conducted to demonstrate the effectiveness of such a treatment and the good performance of our method. The stiffness of the nonlinear parabolic partial differential equations (PDEs) is resolved well, and large time-step size computations are achieved.


title: A thermo-hygro computational model to determine the factors dictating cold joint formation in 3D printed concrete

abstract: Cold joints in extruded concrete structures form once the exposed surface of a deposited filament dries prematurely and gets sequentially covered by a layer of fresh concrete. This creates a material heterogeneity which lowers the structural durability and shortens the designed service life. Many factors concurrently affect cold joint formation, yet a suitable tool for their categorization is missing. Here, we present a computational model that simulates the drying kinetics at the exposed structural surface, accounting for cement hydration and the resulting microstructural development. The model provides a time estimate for cold joint formation as a result. It allows us to assess the drying severity for a given structure's geometry, its interaction with the environment, and ambient conditions. We evaluate the assessed factors and provide generalized recommendations for cold joint mitigation.


title: Risk-Aware Finite-Horizon Social Optimal Control of Mean-Field Coupled Linear-Quadratic Subsystems

abstract: We formulate and solve an optimal control problem with cooperative, mean-field coupled linear-quadratic subsystems and additional risk-aware costs depending on the covariance and skew of the disturbance. This problem quantifies the variability of the subsystem state energy rather than merely its expectation. In contrast to related work, we develop an alternative approach that illuminates a family of matrices with many analytical properties, which are useful for effectively extracting the mean-field coupled solution from a standard LQR solution.


title: A General Track Fit based on Triplets

abstract: This work presents an analytical solution for a general three-dimensional track fit based on hit triplets. Input to the fit are triplet parameters, which contain information about the triplet geometry (hit positions), the radiation length of the material and the magnetic field. The general fit considers spatial hit and multiple Coulomb scattering uncertainties, and can also be extended to include energy losses. The output of the fit, which is given by an analytical closed-form solution, contains the total momentum and the hit residuals, including the full covariance matrix, thus allowing for easy software alignment of the detector. The fit qualities are calculated for the global track fit as well as for the local hit triplets. This feature allows filtering out triplets with poor fit quality at an early stage of track reconstruction. The fit of local triplets is fully parallelizable, enabling accelerated computation with parallel hardware architectures. The triplet track fit is detector-independent, making it possible to use the same fitting code for all tracking detectors. Only the detector-specific triplet parameters (fit input) depend on the triplet geometries and the magnetic field. Formulas for the calculation of the triplet parameters are given for the most common tracking detector setups, namely a homogeneous magnetic field and a spectrometer using a dipole magnet. Furthermore, an algorithm is presented to calculate tracking parameters for an arbitrary magnetic field configuration. Moreover, this work includes a discussion of track fit biases and presents an extension of the fit to include energy losses. Last but not least, it is proposed to use triplet-based scale parameters that characterize different tracking regimes to accelerate track fits and to optimize the design of future tracking detectors.

categories: physics.ins-det hep-ex nucl-ex physics.data-an


title: Recursive Landau Analysis

abstract: We propose a recursive method that makes use of the basic principle of unitarity to calculate the Landau singularities of n-point scattering amplitudes directly in kinematic space. For a vast class of Feynman diagrams, the method enables rapid analytic computation of Landau singularities beyond current state-of-the-art technology. This includes new predictions relevant for two- and higher-loop processes in the Standard Model involving both massive quarks and electroweak particles.


title: Markov chain Monte Carlo without evaluating the target: an auxiliary variable approach

abstract: In sampling tasks, it is common for target distributions to be known up to a normalizing constant. However, in many situations, evaluating even the unnormalized distribution can be costly or infeasible. This issue arises in scenarios such as sampling from the Bayesian posterior for tall datasets and the `doubly-intractable' distributions. In this paper, we begin by observing that seemingly different Markov chain Monte Carlo (MCMC) algorithms, such as the exchange algorithm, PoissonMH, and TunaMH, can be unified under a simple common procedure. We then extend this procedure into a novel framework that allows the use of auxiliary variables in both the proposal and acceptance-rejection steps. We develop the theory of the new framework, applying it to existing algorithms to simplify and extend their results. Several new algorithms emerge from this framework, with improved performance demonstrated on both synthetic and real datasets.


title: MARTINI Coarse-grained Force Field for Thermoplastic Starch Nanocomposites

abstract: Thermoplastic starch (TPS) is an excellent film-forming material, and adding fillers such as tetramethylammonium-montmorillonite (TMA-MMT) clay has significantly expanded its use in packaging applications. We first used all-atom (AA) simulation to predict several macroscopic (Young modulus, glass transition temperature, density) and microscopic (conformation along 1-4 and 1-6 glycosidic linkages, composite morphology) properties of TPS melt and TPS-TMA-MMT composite. The interplay of polymer-surface, plasticizer-surface, and polymer-plasticizer interactions leads to conformational and dynamic properties distinct from those in systems with either attractive or repulsive polymer-surface interactions. A subset of AA properties was used to parameterize the MARTINI coarse-grained (CG) force field (FF) for the melt and composite systems. Specifically, we determined the missing bonded parameters of amylose and amylopectin and rationalized the bead types for 1-4 and 1-6 linked alpha-D glucose using two-body excess entropy, density, and bond and angle distributions in AA TPS melt. The MARTINI CG model for TPS was combined with an existing parameter set for TMA-MMT. The liquid-liquid partitioning-based MARTINI-2 FF shows freezing and compaction of polymer chains near the sheet surface, further accentuated by lowering of dispersive interactions between pairs of high covalent coordination ring units of TPS polymers and MMT sheet. A rescaling of the dispersive component of TPS MMT cross-interactions was used to optimize the FF for the composite system, with structural, thermodynamic, and dynamic properties obtained from long AA simulations forming the constraints for optimization. The obtained CG FF parameters provided excellent estimates for several other properties of the melt and composite systems not used in parameter estimation, thus establishing the robustness of the developed model.


title: A comprehensive approach to incorporating intermolecular dispersion into the openCOSMO-RS model. Part 1: Halocarbons

abstract: The COSMO-RS (Conductor-like Screening Model for Real Solvents) is a predictive thermodynamic model that has found diverse applications in various domains like chemical engineering, environmental chemistry, nanotechnology, material science, and biotechnology. Its core concept involves calculating the screening charge density on the surface of each molecule and letting these surface patches interact with each other to calculate thermodynamic properties. In this study, we aim to enhance the performance of the open-source implementation openCOSMO-RS by incorporating dispersive interactions between the paired segments. Several parametrizations were systematically evaluated through the extensive regression analysis using a comprehensive database of Vapor-Liquid Equilibrium (VLE), Liquid-Liquid Equilibrium (LLE) and Infinite Dilution Activity Coefficients (IDACs). Furthermore, the influence of different combinatorial terms on the model performance was investigated. Our findings indicate that incorporating dispersive interactions significantly improves the accuracy of phase equilibrium predictions for halocarbons and refrigerant mixtures.


title: Games on Graphs: A Time-Efficient Algorithm for Solving Finite Reachability and Safety Games

abstract: In recent years, there has been a growing interest in games on graphs within the research community, fueled by their relevance in applications such as economics, politics, and epidemiology. This paper aims to comprehensively detail the design decisions involved in developing a time-efficient algorithm for solving finite reachability and safety games on graphs. The primary contribution of this work is the introduction of a novel algorithm that effectively addresses both reachability and safety games by exploiting their inherent duality. The performance of the proposed algorithm is rigorously evaluated against traditional methods using a randomized testing framework. The paper is organized as follows: first, we provide the reader with a theoretical overview of reachability and safety games, followed by an in-depth discussion on the construction of the playing arena. A formal definition of reachability and safety games and a review of traditional algorithms for their resolution are then presented. Subsequently, the multiple-perspective algorithm is introduced along with its optimizations. The paper concludes with an extensive set of experiments and a comprehensive discussion of their results.


title: Blended Bots: Infiltration through Identity Deception on Social Media

abstract: Bots are automated social media users that can be used to amplify (mis)information and sow harmful discourse. In order to effectively influence users, bots can be generated to reproduce human user behavior. Indeed, people tend to trust information coming from users with profiles that fit roles they expect to exist, such as users with gender role stereotypes. In this work, we examine differences in the types of identities in profiles of human and bot accounts with a focus on combinations of identities that represent gender role stereotypes. We find that some types of identities differentiate between human and bot profiles, confirming this approach can be a useful in distinguishing between human and bot accounts on social media. However, contrary to our expectations, we reveal that gender bias is expressed more in human accounts than bots overall. Despite having less gender bias overall, we provide examples of identities with strong associations with gender identities in bot profiles, such as those related to technology, finance, sports, and horoscopes. Finally, we discuss implications for designing constructive social media bot detection training materials.


title: Measuring Fairness in Large-Scale Recommendation Systems with Missing Labels

abstract: In large-scale recommendation systems, the vast array of items makes it infeasible to obtain accurate user preferences for each product, resulting in a common issue of missing labels. Typically, only items previously recommended to users have associated ground truth data. Although there is extensive research on fairness concerning fully observed user-item interactions, the challenge of fairness in scenarios with missing labels remains underexplored. Previous methods often treat these samples missing labels as negative, which can significantly deviate from the ground truth fairness metrics. Our study addresses this gap by proposing a novel method employing a small randomized traffic to estimate fairness metrics accurately. We present theoretical bounds for the estimation error of our fairness metric and support our findings with empirical evidence on real data. Our numerical experiments on synthetic and TikTok's real-world data validate our theory and show the efficiency and effectiveness of our novel methods. To the best of our knowledge, we are the first to emphasize the necessity of random traffic in dataset collection for recommendation fairness, the first to publish a fairness-related dataset from TikTok and to provide reliable estimates of fairness metrics in the context of large-scale recommendation systems with missing labels.


title: Processing, evaluating and understanding FMRI data with afni_proc.py

abstract: FMRI data are noisy, complicated to acquire, and typically go through many steps of processing before they are used in a study or clinical practice. Being able to visualize and understand the data from the start through the completion of processing, while being confident that each intermediate step was successful, is challenging. AFNI's "afni_proc.py" is a tool to create and run a processing pipeline for FMRI data. With its flexible features, "afni_proc.py" allows users to both control and evaluate their processing at a detailed level. It has been designed to keep users informed about all processing steps: it does not just process the data, but first outputs a fully commented processing script that the users can read, query, interpret and refer back to. Having this full provenance is important for being able to understand each step of processing; it also promotes transparency and reproducibility by keeping the record of individual-level processing and modeling specifics in a single, shareable place. Additionally, "afni_proc.py" creates pipelines that contain several automatic self-checks for potential problems during runtime. The output directory contains a dictionary of relevant quantities that can be programmatically queried for potential issues and a systematic, interactive quality control (QC) HTML. All of these features help users evaluate and understand their data and processing in detail. We describe these and other aspects of "afni_proc.py" here using a set of task-based and resting state FMRI example commands.


title: A Language Model-Guided Framework for Mining Time Series with Distributional Shifts

abstract: Effective utilization of time series data is often constrained by the scarcity of data quantity that reflects complex dynamics, especially under the condition of distributional shifts. Existing datasets may not encompass the full range of statistical properties required for robust and comprehensive analysis. And privacy concerns can further limit their accessibility in domains such as finance and healthcare. This paper presents an approach that utilizes large language models and data source interfaces to explore and collect time series datasets. While obtained from external sources, the collected data share critical statistical properties with primary time series datasets, making it possible to model and adapt to various scenarios. This method enlarges the data quantity when the original data is limited or lacks essential properties. It suggests that collected datasets can effectively supplement existing datasets, especially involving changes in data distribution. We demonstrate the effectiveness of the collected datasets through practical examples and show how time series forecasting foundation models fine-tuned on these datasets achieve comparable performance to those models without fine-tuning.


title: LLM-Enhanced Bayesian Optimization for Efficient Analog Layout Constraint Generation

abstract: Analog layout synthesis faces significant challenges due to its dependence on manual processes, considerable time requirements, and performance instability. Current Bayesian Optimization (BO)-based techniques for analog layout synthesis, despite their potential for automation, suffer from slow convergence and extensive data needs, limiting their practical application. This paper presents the \texttt{LLANA} framework, a novel approach that leverages Large Language Models (LLMs) to enhance BO by exploiting the few-shot learning abilities of LLMs for more efficient generation of analog design-dependent parameter constraints. Experimental results demonstrate that \texttt{LLANA} not only achieves performance comparable to state-of-the-art (SOTA) BO methods but also enables a more effective exploration of the analog circuit design space, thanks to LLM's superior contextual understanding and learning efficiency. The code is available at https://github.com/dekura/LLANA.


title: Automated Trustworthiness Testing for Machine Learning Classifiers

abstract: Machine Learning (ML) has become an integral part of our society, commonly used in critical domains such as finance, healthcare, and transportation. Therefore, it is crucial to evaluate not only whether ML models make correct predictions but also whether they do so for the correct reasons, ensuring our trust that will perform well on unseen data. This concept is known as trustworthiness in ML. Recently, explainable techniques (e.g., LIME, SHAP) have been developed to interpret the decision-making processes of ML models, providing explanations for their predictions (e.g., words in the input that influenced the prediction the most). Assessing the plausibility of these explanations can enhance our confidence in the models' trustworthiness. However, current approaches typically rely on human judgment to determine the plausibility of these explanations. This paper proposes TOWER, the first technique to automatically create trustworthiness oracles that determine whether text classifier predictions are trustworthy. It leverages word embeddings to automatically evaluate the trustworthiness of a model-agnostic text classifiers based on the outputs of explanatory techniques. Our hypothesis is that a prediction is trustworthy if the words in its explanation are semantically related to the predicted class. We perform unsupervised learning with untrustworthy models obtained from noisy data to find the optimal configuration of TOWER. We then evaluated TOWER on a human-labeled trustworthiness dataset that we created. The results show that TOWER can detect a decrease in trustworthiness as noise increases, but is not effective when evaluated against the human-labeled dataset. Our initial experiments suggest that our hypothesis is valid and promising, but further research is needed to better understand the relationship between explanations and trustworthiness issues.


title: Long distance propagation of light in random media with partially coherent sources

abstract: Optical beam propagation in random media is characterized by familiar speckle patterns generated by intricate interference effects. Such patterns may be modified and possibly attenuated for partially coherent incident beam profiles. In the weak-coupling regime of the It\^o-Schr\"odinger paraxial model of wave propagation, we show how the spatio-temporal statistics of the partially coherent beams interact with the statistics of the random medium to enhance or suppress scintillation effects.

categories: math.AP math-ph math.MP math.PR physics.optics


title: Global Surface Warming Caused by Shorter-term Radiative Forcings of Aerosols and Ozone in the Last Two Decades

abstract: Conventional climate models have predicted continuous warming on the Earth's surface and cooling in the upper stratosphere. Here we report observations of regional and global upper stratosphere temperature (UST) and surface temperature and of various climate drivers including greenhouse gases (GHGs), ozone, aerosols, solar variability, snow cover extent, and sea ice extent (SIE), combined with calculations of global mean surface temperature (GMST) by a conceptual physics model. We strikingly found warming trends of 0.8(+/-0.6) and 0.7(+/-0.2) K/decade in UST at altitudes of 35-40 km in the Arctic and Antarctic respectively and no significant trends over non-polar regions since 2002. According to the well-recognized climate models, these UST trends provide fingerprints of decreasing (no significant trends) in total GHG effect in polar (non-polar) regions. Correspondingly, we made the first observation of both surface cooling trends in the Antarctic since 2002 and the Arctic since 2016 once the SIE started to recover. But surface warming remains at mid-latitudes, which caused the recent rise in GMST. The latter is quantitatively explained by the positive short-term radiative forcings of aerosols and ozone due to improved air quality. The observed GMST changes agree well with calculated results by the physics model based on halogen-containing GHGs, whose destruction is consistent with the characteristics of the cosmic-ray-driven reaction mechanism with larger rates at higher latitudes. With observations of rapidly lowered aerosol loading, projected halogenated GHGs and stopped Arctic amplification, we predict to observe an emerging long-term GMST reversal that started at the end of 2023.


title: A Simple and Optimal Sublinear Algorithm for Mean Estimation

abstract: We study the sublinear mean estimation problem. Specifically, we aim to output a point minimizing the sum of squared Euclidean distances. We show that a multiplicative $(1+\varepsilon)$ approximation can be found with probability $1-\delta$ using $O(\varepsilon^{-1}\log \delta^{-1})$ many independent random samples. We also provide a matching lower bound.


title: Generative Explore-Exploit: Training-free Optimization of Generative Recommender Systems using LLM Optimizers

abstract: Recommender systems are widely used to suggest engaging content, and Large Language Models (LLMs) have given rise to generative recommenders. Such systems can directly generate items, including for open-set tasks like question suggestion. While the world knowledge of LLMs enable good recommendations, improving the generated content through user feedback is challenging as continuously fine-tuning LLMs is prohibitively expensive. We present a training-free approach for optimizing generative recommenders by connecting user feedback loops to LLM-based optimizers. We propose a generative explore-exploit method that can not only exploit generated items with known high engagement, but also actively explore and discover hidden population preferences to improve recommendation quality. We evaluate our approach on question generation in two domains (e-commerce and general knowledge), and model user feedback with Click Through Rate (CTR). Experiments show our LLM-based explore-exploit approach can iteratively improve recommendations, and consistently increase CTR. Ablation analysis shows that generative exploration is key to learning user preferences, avoiding the pitfalls of greedy exploit-only approaches. A human evaluation strongly supports our quantitative findings.


title: Distributionally Risk-Receptive and Robust Multistage Stochastic Integer Programs and Two-player Interdiction Games with(out) Decision-Dependent Uncertainty

abstract: In this paper, we study distributionally risk-receptive and distributionally robust (or risk-averse) multistage stochastic mixed-integer programs (denoted by DRR- and DRA-MSIPs). These frameworks are useful for optimization problems under uncertainty where the focus is on analyzing outcomes based on multiple decision-makers' differing perspectives, such as interdiction problems that are attacker-defender games having non-cooperative players. We present cutting plane-based and reformulation-based approaches for solving DRR- and DRA-MSIPs without and with decision-dependent uncertainty to optimality. We show that these approaches are finitely convergent with probability one. Furthermore, we introduce generalizations of DRR- and DRA-MSIPs by presenting multistage stochastic disjunctive programs and algorithms for solving them. To assess the performance of the algorithms for DRR- and DRA-MSIPs, we consider instances of distributionally ambiguous multistage maximum flow and facility location interdiction problems that are important in their own right. Based on our computational results, we observe that the cutting plane-based approaches are 2800% and 2410% (on average) faster than the reformulation-based approaches for the foregoing instances with distributional risk-aversion and risk-receptiveness, respectively. Additionally, we conducted out-of-sample tests to showcase the significance of the DRR framework in revealing network vulnerabilities and also in mitigating the impact of data corruption.


title: Efficient Differentially Private Fine-Tuning of Diffusion Models

abstract: The recent developments of Diffusion Models (DMs) enable generation of astonishingly high-quality synthetic samples. Recent work showed that the synthetic samples generated by the diffusion model, which is pre-trained on public data and fully fine-tuned with differential privacy on private data, can train a downstream classifier, while achieving a good privacy-utility tradeoff. However, fully fine-tuning such large diffusion models with DP-SGD can be very resource-demanding in terms of memory usage and computation. In this work, we investigate Parameter-Efficient Fine-Tuning (PEFT) of diffusion models using Low-Dimensional Adaptation (LoDA) with Differential Privacy. We evaluate the proposed method with the MNIST and CIFAR-10 datasets and demonstrate that such efficient fine-tuning can also generate useful synthetic samples for training downstream classifiers, with guaranteed privacy protection of fine-tuning data. Our source code will be made available on GitHub.


title: Advances in Machine Learning, Statistical Methods, and AI for Single-Cell RNA Annotation Using Raw Count Matrices in scRNA-seq Data

abstract: Single-cell RNA sequencing (scRNA-seq) has revolutionized our ability to analyze gene expression at the resolution of individual cells, providing unprecedented insights into cellular heterogeneity and complex biological systems. This paper reviews various advanced computational and machine learning techniques tailored for the analysis of scRNA-seq data, emphasizing their roles in different stages of the data processing pipeline.


title: A model of early word acquisition based on realistic-scale audiovisual naming events

abstract: Infants gradually learn to parse continuous speech into words and connect names with objects, yet the mechanisms behind development of early word perception skills remain unknown. We studied the extent to which early words can be acquired through statistical learning from regularities in audiovisual sensory input. We simulated word learning in infants up to 12 months of age in a realistic setting, using a model that solely learns from statistical regularities in unannotated raw speech and pixel-level visual input. Crucially, the quantity of object naming events was carefully designed to match that accessible to infants of comparable ages. Results show that the model effectively learns to recognize words and associate them with corresponding visual objects, with a vocabulary growth rate comparable to that observed in infants. The findings support the viability of general statistical learning for early word perception, demonstrating how learning can operate without assuming any prior linguistic capabilities.


title: Generative modeling of density regression through tree flows

abstract: A common objective in the analysis of tabular data is estimating the conditional distribution (in contrast to only producing predictions) of a set of "outcome" variables given a set of "covariates", which is sometimes referred to as the "density regression" problem. Beyond estimation on the conditional distribution, the generative ability of drawing synthetic samples from the learned conditional distribution is also desired as it further widens the range of applications. We propose a flow-based generative model tailored for the density regression task on tabular data. Our flow applies a sequence of tree-based piecewise-linear transforms on initial uniform noise to eventually generate samples from complex conditional densities of (univariate or multivariate) outcomes given the covariates and allows efficient analytical evaluation of the fitted conditional density on any point in the sample space. We introduce a training algorithm for fitting the tree-based transforms using a divide-and-conquer strategy that transforms maximum likelihood training of the tree-flow into training a collection of binary classifiers--one at each tree split--under cross-entropy loss. We assess the performance of our method under out-of-sample likelihood evaluation and compare it with a variety of state-of-the-art conditional density learners on a range of simulated and real benchmark tabular datasets. Our method consistently achieves comparable or superior performance at a fraction of the training and sampling budget. Finally, we demonstrate the utility of our method's generative ability through an application to generating synthetic longitudinal microbiome compositional data based on training our flow on a publicly available microbiome study.


title: Split-and-Fit: Learning B-Reps via Structure-Aware Voronoi Partitioning

abstract: We introduce a novel method for acquiring boundary representations (B-Reps) of 3D CAD models which involves a two-step process: it first applies a spatial partitioning, referred to as the ``split``, followed by a ``fit`` operation to derive a single primitive within each partition. Specifically, our partitioning aims to produce the classical Voronoi diagram of the set of ground-truth (GT) B-Rep primitives. In contrast to prior B-Rep constructions which were bottom-up, either via direct primitive fitting or point clustering, our Split-and-Fit approach is top-down and structure-aware, since a Voronoi partition explicitly reveals both the number of and the connections between the primitives. We design a neural network to predict the Voronoi diagram from an input point cloud or distance field via a binary classification. We show that our network, coined NVD-Net for neural Voronoi diagrams, can effectively learn Voronoi partitions for CAD models from training data and exhibits superior generalization capabilities. Extensive experiments and evaluation demonstrate that the resulting B-Reps, consisting of parametric surfaces, curves, and vertices, are more plausible than those obtained by existing alternatives, with significant improvements in reconstruction quality. Code will be released on https://github.com/yilinliu77/NVDNet.


title: A Three-groups Non-local Model for Combining Heterogeneous Data Sources to Identify Genes Associated with Parkinson's Disease

abstract: We seek to identify genes involved in Parkinson's Disease (PD) by combining information across different experiment types. Each experiment, taken individually, may contain too little information to distinguish some important genes from incidental ones. However, when experiments are combined using the proposed statistical framework, additional power emerges. The fundamental building block of the family of statistical models that we propose is a hierarchical three-group mixture of distributions. Each gene is modeled probabilistically as belonging to either a null group that is unassociated with PD, a deleterious group, or a beneficial group. This three-group formalism has two key features. By apportioning prior probability of group assignments with a Dirichlet distribution, the resultant posterior group probabilities automatically account for the multiplicity inherent in analyzing many genes simultaneously. By building models for experimental outcomes conditionally on the group labels, any number of data modalities may be combined in a single coherent probability model, allowing information sharing across experiment types. These two features result in parsimonious inference with few false positives, while simultaneously enhancing power to detect signals. Simulations show that our three-groups approach performs at least as well as commonly-used tools for GWAS and RNA-seq, and in some cases it performs better. We apply our proposed approach to publicly-available GWAS and RNA-seq datasets, discovering novel genes that are potential therapeutic targets.


title: Charged Aggregation

abstract: We introduce an aggregation process that begins with equal concentrations of positively and negatively `charged' monomers. Oppositely charged monomers merge to form neutral dimers. These dimers are the seeds for subsequent aggregation events in which neutral clusters of necessarily even mass join irreversibly to form neutral aggregates of ever-increasing size. In the mean-field approximation with mass independent reaction rates, we solve for the reaction kinetics and show that the concentration of clusters of mass $k$, $c_k(t)$, asymptotically scales as $A_k/t$, with $A_k$ having a non-trivial dependence on $k$. We also investigate the phenomenon of gelation in charged aggregation when the reaction rate equals the product of the two incident cluster masses. Finally, we generalize our model to the case of three and more types of monomers.


title: "Minus-One" Data Prediction Generates Synthetic Census Data with Good Crosstabulation Fidelity

abstract: We propose to capture relevant statistical associations in a dataset of categorical survey responses by a method, here termed MODP, that "learns" a probabilistic prediction function L. Specifically, L predicts each question's response based on the same respondent's answers to all the other questions. Draws from the resulting probability distribution become synthetic responses. Applying this methodology to the PUMS subset of Census ACS data, and with a learned L akin to multiple parallel logistic regression, we generate synthetic responses whose crosstabulations (two-point conditionals) are found to have a median accuracy of ~5% across all crosstabulation cells, with cell counts ranging over four orders of magnitude. We investigate and attempt to quantify the degree to which the privacy of the original data is protected.


title: TLEX: An Efficient Method for Extracting Exact Timelines from TimeML Temporal Graphs

abstract: A timeline provides a total ordering of events and times, and is useful for a number of natural language understanding tasks. However, qualitative temporal graphs that can be derived directly from text -- such as TimeML annotations -- usually explicitly reveal only partial orderings of events and times. In this work, we apply prior work on solving point algebra problems to the task of extracting timelines from TimeML annotated texts, and develop an exact, end-to-end solution which we call TLEX (TimeLine EXtraction). TLEX transforms TimeML annotations into a collection of timelines arranged in a trunk-and-branch structure. Like what has been done in prior work, TLEX checks the consistency of the temporal graph and solves it; however, it adds two novel functionalities. First, it identifies specific relations involved in an inconsistency (which could then be manually corrected) and, second, TLEX performs a novel identification of sections of the timelines that have indeterminate order, information critical for downstream tasks such as aligning events from different timelines. We provide detailed descriptions and analysis of the algorithmic components in TLEX, and conduct experimental evaluations by applying TLEX to 385 TimeML annotated texts from four corpora. We show that 123 of the texts are inconsistent, 181 of them have more than one ``real world'' or main timeline, and there are 2,541 indeterminate sections across all four corpora. A sampling evaluation showed that TLEX is 98--100% accurate with 95% confidence along five dimensions: the ordering of time-points, the number of main timelines, the placement of time-points on main versus subordinate timelines, the connecting point of branch timelines, and the location of the indeterminate sections. We provide a reference implementation of TLEX, the extracted timelines for all texts, and the manual corrections of the inconsistent texts.


title: Signatures of Bulk Neutrinos in the Early Universe

abstract: Neutrino masses and quantum gravity are strong reasons to extend the standard model of particle physics. A large extra dimension can be motivated by quantum gravity and can explain the small neutrino masses with new singlet states that propagate in the bulk. In such a case, a Kaluza-Klein tower of sterile neutrinos emerges. We revisit constraints on towers of sterile neutrinos that come from cosmological observables such as the effective number of noninteracting relativistic species and the dark matter density. These limits generically rule out micron-sized extra dimensions. We explore the weakening of these constraints to accommodate an extra dimension close to the micron size by assuming that the universe reheated after inflation to a low temperature. We discuss how such a possibility can be distinguished in the event of a positive signal in a cosmological observable.


title: Characterizing the nuclear models informed by PREX and CREX: a view from Bayesian inference

abstract: New measurements of the weak charge density distributions of $^{48}$Ca and $^{208}$Pb challenge existing nuclear models. In the post-PREX-CREX era, it is unclear if current models can simultaneously describe weak charge distributions along with accurate measurements of binding energy and charge radii. In this letter, we explore the parameter space of relativistic and non-relativistic models to study the differences between the form factors of the electric and weak charge distributions, $\Delta F=F_{ch}-F_{w}$, in $^{48}$Ca and $^{208}$Pb. We show, for the first time, the parts of the mean-field models that are the most important in determining the relative magnitude of the neutron skin in lead and calcium nuclei. We carefully disentangle the tension between the PREX/CREX constraints and the ability of the RMF and Skyrme models to accurately describe binding energies and charge radii. We find that the nuclear symmetry energy coefficient $S_\mathrm{V}$ and the isovector spin-orbit coefficient $b'_4$ play different roles in determining $\Delta F$ of $^{48}$Ca and $^{208}$Pb. Consequently, adjusting $S_\mathrm{V}$ or $b'_4$ shifts predicted $\Delta F$ values toward or away from PREX/CREX measurements. Additionally, $S_\mathrm{V}$ and the slope L are marginally correlated given the constraints of our Bayesian inference, allowing us to infer them separately from PREX and CREX data.


title: On Differential and Riemannian Calculus on Wasserstein Spaces

abstract: In this paper we develop an intrinsic formalism to study the topology, smooth structure, and Riemannian geometry of the Wasserstein space of a closed Riemannian manifold. Our formalism allows for a new characterisation of the Weak topology via convergent sequences of the subjacent space. Applying it we also provide a new proof that Wasserstein spaces of closed manifolds are geodesically convex. Our framework is particularly handy to address the Wasserstein spaces of compact Lie groups, where we refine our formalism and present an explicit example.


title: Fast assessment of non-Gaussian inputs in structural dynamics exploiting modal solutions

abstract: In various technical applications, assessing the impact of non-Gaussian processes on responses of dynamic systems is crucial. While simulating time-domain realizations offers an efficient solution for linear dynamic systems, this method proves time-consuming for finite element (FE) models, which may contain thousands to millions of degrees-of-freedom (DOF). Given the central role of kurtosis in describing non-Gaussianity - owing to its concise, parametric-free and easily interpretable nature - this paper introduces a highly efficient approach for deriving response kurtosis and other related statistical descriptions. This approach makes use of the modal solution of dynamic systems, which allows to reduce DOFs and responses analysis to a minimum number in the modal domain. This computational advantage enables fast assessments of non-Gaussian effects for entire FE models. Our approach is illustrated using a simple FE model that has found regular use in the field of random vibration fatigue.


title: fastMRI Breast: A publicly available radial k-space dataset of breast dynamic contrast-enhanced MRI

abstract: This data curation work introduces the first large-scale dataset of radial k-space and DICOM data for breast DCE-MRI acquired in diagnostic breast MRI exams. Our dataset includes case-level labels indicating patient age, menopause status, lesion status (negative, benign, and malignant), and lesion type for each case. The public availability of this dataset and accompanying reconstruction code will support research and development of fast and quantitative breast image reconstruction and machine learning methods.


title: USE: Universal Segment Embeddings for Open-Vocabulary Image Segmentation

abstract: The open-vocabulary image segmentation task involves partitioning images into semantically meaningful segments and classifying them with flexible text-defined categories. The recent vision-based foundation models such as the Segment Anything Model (SAM) have shown superior performance in generating class-agnostic image segments. The main challenge in open-vocabulary image segmentation now lies in accurately classifying these segments into text-defined categories. In this paper, we introduce the Universal Segment Embedding (USE) framework to address this challenge. This framework is comprised of two key components: 1) a data pipeline designed to efficiently curate a large amount of segment-text pairs at various granularities, and 2) a universal segment embedding model that enables precise segment classification into a vast range of text-defined categories. The USE model can not only help open-vocabulary image segmentation but also facilitate other downstream tasks (e.g., querying and ranking). Through comprehensive experimental studies on semantic segmentation and part segmentation benchmarks, we demonstrate that the USE framework outperforms state-of-the-art open-vocabulary segmentation methods.


title: Homological mirror symmetry for Batyrev mirror pairs

abstract: We prove Kontsevich's homological mirror symmetry conjecture for a large class of mirror pairs of Calabi--Yau hypersurfaces in toric varieties. These mirror pairs were constructed by Batyrev from dual reflexive polytopes. The theorem holds in characteristic zero and in all but finitely many positive characteristics.


title: High-precision measurements of the atomic mass and electron-capture decay $Q$ value of $^{95}$Tc

abstract: A direct measurement of the ground-state-to-ground-state electron-capture decay $Q$ value of $^{95}$Tc has been performed utilizing the double Penning trap mass spectrometer JYFLTRAP. The $Q$ value was determined to be 1695.92(13) keV by taking advantage of the high resolving power of the phase-imaging ion-cyclotron-resonance technique to resolve the low-lying isomeric state of $^{95}$Tc (excitation energy of 38.910(40) keV) from the ground state. The mass excess of $^{95}$Tc was measured to be $-$86015.95(18) keV/c$^2$, exhibiting a precision of about 28 times higher and in agreement with the value from the newest Atomic Mass Evaluation (AME2020). Combined with the nuclear energy-level data for the decay-daughter $^{95}$Mo, two potential ultra-low $Q$-value transitions are identified for future long-term neutrino-mass determination experiments. The atomic self-consistent many-electron Dirac--Hartree--Fock--Slater method and the nuclear shell model have been used to predict the partial half-lives and energy-release distributions for the two transitions. The dominant correction terms related to those processes are considered, including the exchange and overlap corrections, and the shake-up and shake-off effects. The normalized distribution of the released energy in the electron-capture decay of $^{95}$Tc to excited states of $^{95}$Mo is compared to that of $^{163}$Ho currently being used for electron-neutrino-mass determination.


title: Behavior Structformer: Learning Players Representations with Structured Tokenization

abstract: In this paper, we introduce the Behavior Structformer, a method for modeling user behavior using structured tokenization within a Transformer-based architecture. By converting tracking events into dense tokens, this approach enhances model training efficiency and effectiveness. We demonstrate its superior performance through ablation studies and benchmarking against traditional tabular and semi-structured baselines. The results indicate that structured tokenization with sequential processing significantly improves behavior modeling.


title: The Effect of Grain Size Distribution on the Defect Generation Mechanism of 0201 Passives

abstract: The recent advancements in electronics manufacturing has necessitated the demand for miniaturization of electronic components. In particular, the product sizes for passive components have evolved from 1005 (1.0x0.5mm) which is roughly the size of a grain of sand to 0201 (0.25x0.125mm) which is 1/16th the size of a grain of sand. Grain size distribution and composition play a vital role in tailoring the demands for reliably shrinking dimension of passives. The study focuses on analyzing the effect of grain size and composition, which plays a significant role in maintaining high yield output during the manufacturing processes. The objective of this study is to compare the grain morphology and its effect on defect generation mechanism for 0201 resistors. The experimental setup was prepared to evaluate the grain structure as per ASTM E112-3 test standards. The 0201 resistor samples from three different vendors were assembled on test vehicle PCB (Printed Circuit Board). The resulting observations of the study showed that tombstoning defect was observed during the reflow process for Vendor A. Scanning Electron Microscope (SEM) results showed the presence of microstructural difference in the tin grain size of resistors. The tin grain size for Vendor A was observed to be 2 microns, whereas the grain size for Vendors B and C were 4 and 5 microns, respectively. Furthermore, the results of grain size measurements performed using the intercept method showed that a grain size number of 13 and 13.6 was observed for Vendors B and C, whereas a grain size number of 15 was observed for Vendor A. The second phase of the study focuses on techniques for improving the grain size number to mitigate the tombstoning defect. It was observed that using an alternate plating solution during the manufacturing of passives resulted in decreased grain size number while containing the tombstoning issue.


title: VTrans: Accelerating Transformer Compression with Variational Information Bottleneck based Pruning

abstract: In recent years, there has been a growing emphasis on compressing large pre-trained transformer models for resource-constrained devices. However, traditional pruning methods often leave the embedding layer untouched, leading to model over-parameterization. Additionally, they require extensive compression time with large datasets to maintain performance in pruned models. To address these challenges, we propose VTrans, an iterative pruning framework guided by the Variational Information Bottleneck (VIB) principle. Our method compresses all structural components, including embeddings, attention heads, and layers using VIB-trained masks. This approach retains only essential weights in each layer, ensuring compliance with specified model size or computational constraints. Notably, our method achieves upto 70% more compression than prior state-of-the-art approaches, both task-agnostic and task-specific. We further propose faster variants of our method: Fast-VTrans utilizing only 3% of the data and Faster-VTrans, a time efficient alternative that involves exclusive finetuning of VIB masks, accelerating compression by upto 25 times with minimal performance loss compared to previous methods. Extensive experiments on BERT, ROBERTa, and GPT-2 models substantiate the efficacy of our method. Moreover, our method demonstrates scalability in compressing large models such as LLaMA-2-7B, achieving superior performance compared to previous pruning methods. Additionally, we use attention-based probing to qualitatively assess model redundancy and interpret the efficiency of our approach. Notably, our method considers heads with high attention to special and current tokens in un-pruned model as foremost candidates for pruning while retained heads are observed to attend more to task-critical keywords.


title: A model of thermodynamic stabilization of nanocrystalline grain boundaries in alloy systems

abstract: Nanocrystalline (NC) materials are intrinsically unstable against grain growth. Significant research efforts have been dedicated to suppressing the grain growth by solute segregation, including the pursuit of a special NC structure that minimizes the total free energy and completely eliminates the driving force for grain growth. This fully stabilized state has been predicted theoretically and by simulations but is yet to be confirmed experimentally. To better understand the nature of the full stabilization, we propose a simple two-dimensional model capturing the coupled processes of grain boundary (GB) migration and solute diffusion. Kinetic Monte Carlo simulations based on this model reproduce the fully stabilized polycrystalline state and link it to the condition of zero GB free energy. The simulations demonstrate the emergence of a fully stabilized state by the divergence of capillary wave amplitudes on planar GBs and by fragmentation of a large grain into a stable ensemble of smaller grains. The role of solute diffusion in the full stabilization is examined. Possible extensions of the model are discussed.


title: Modelling effects of moisture on mechanical properties of crosslinked polyurethane adhesives

abstract: Crosslinked polyurethane adhesives show large deformation viscoelastic behaviour and age under the moisture influence because of their hygroscopic behaviour. The viscoelastic behaviour of the material is modelled with the micromechanical network model. The micromechanical model considers the shorter and longer chains with a probability distribution function. The network evolution concept is used to model softening of material due to the breakage of the shorter chains with an increase in deformation. The moisture diffusion in the polyurethane adhesive is behaviour, therefore Langmuir-type diffusion model is used to model moisture diffusion. The transported moisture in the material leads to an exponential decay in the mechanical properties causing the ageing of the material. The micromechanical model needs to be coupled with the Langmuir-type diffusion model to analyse the ageing process, where the mechanical properties are considered as the function of the local moisture concentration.


title: SuperPos-Prompt: Enhancing Soft Prompt Tuning of Language Models with Superposition of Multi Token Embeddings

abstract: Soft prompt tuning techniques have recently gained traction as an effective strategy for the parameter-efficient tuning of pretrained language models, particularly minimizing the required adjustment of model parameters. Despite their growing use, achieving optimal tuning with soft prompts, especially for smaller datasets, remains a substantial challenge. This study makes two contributions in this domain: (i) we introduce SuperPos-Prompt, a new reparameterization technique employing the superposition of multiple pretrained vocabulary embeddings to improve the learning of soft prompts. Our experiments across several GLUE and SuperGLUE benchmarks consistently highlight SuperPos-Prompt's superiority over Residual Prompt tuning, exhibiting an average score increase of $+6.4$ in T5-Small and $+5.0$ in T5-Base along with a faster convergence. Remarkably, SuperPos-Prompt occasionally outperforms even full fine-tuning methods. (ii) Additionally, we demonstrate enhanced performance and rapid convergence by omitting dropouts from the frozen network, yielding consistent improvements across various scenarios and tuning methods.


title: Instability of singular equilibria of a wave kinetic equation

abstract: We consider the singular Rayleigh-Jeans equilibrium of the $4$-waves kinetic turbulence equation for the three dimensional Schr\"{o}dinger equation. We first show the formation in finite time of a Dirac measure at zero frequency in the solution of the wave kinetic equation when the initial data has the form of Rayleigh-Jeans, truncated at large values of the energy. The initial value problem for the linearization around the singular Rayleigh-Jeans equilibria is then solved in several functional spaces. Then, long time convergence to a Dirac measure at the origin is described in detail for some of the solutions. This determines a basin of attraction of the Dirac measure.


title: Lessons from the Cruise Robotaxi Pedestrian Dragging Mishap

abstract: A robotaxi dragged a pedestrian 20 feet down a San Francisco street on the evening of October 2, 2023, coming to rest with its rear wheel on that woman's legs. The mishap was complex, involving a first impact by a different, human-driven vehicle. The following weeks saw Cruise stand down its road operations amid allegations of withholding crucial mishap information from regulators. The pedestrian has survived her severe injuries, but the robotaxi industry is still wrestling with the aftermath. Key observations include that the robotaxi had multiple possible ways available to avoid initial impact with the pedestrian. Limitations to the computer driver's programming prevented it from recognizing a pedestrian was about to be hit in an adjacent lane, caused the robotaxi to lose tracking of and then in essence forget a pedestrian who was hit by an adjacent vehicle, and forget that the robotaxi had just run over a presumed pedestrian when beginning a subsequent repositioning maneuver. The computer driver was unable to detect the pedestrian being dragged even though her legs were partially in view of a robotaxi camera. Moreover, more conservative operational approaches could have avoided the dragging portion of the mishap entirely, such as waiting for remote confirmation before moving after a crash with a pedestrian, or operating the still-developing robotaxi technology with an in-vehicle safety driver rather than prioritizing driver-out deployment.


title: Scalable and Programmable Look-Up Table based Neural Acceleration (LUT-NA) for Extreme Energy Efficiency

abstract: Traditional digital implementations of neural accelerators are limited by high power and area overheads, while analog and non-CMOS implementations suffer from noise, device mismatch, and reliability issues. This paper introduces a CMOS Look-Up Table (LUT)-based Neural Accelerator (LUT-NA) framework that reduces the power, latency, and area consumption of traditional digital accelerators through pre-computed, faster look-ups while avoiding noise and mismatch of analog circuits. To solve the scalability issues of conventional LUT-based computation, we split the high-precision multiply and accumulate (MAC) operations into lower-precision MACs using a divide-and-conquer-based approach. We show that LUT-NA achieves up to $29.54\times$ lower area with $3.34\times$ lower energy per inference task than traditional LUT-based techniques and up to $1.23\times$ lower area with $1.80\times$ lower energy per inference task than conventional digital MAC-based techniques (Wallace Tree/Array Multipliers) without retraining and without affecting accuracy, even on lottery ticket pruned (LTP) models that already reduce the number of required MAC operations by up to 98%. Finally, we introduce mixed precision analysis in LUT-NA framework for various LTP models (VGG11, VGG19, Resnet18, Resnet34, GoogleNet) that achieved up to $32.22\times$-$50.95\times$ lower area across models with $3.68\times$-$6.25\times$ lower energy per inference than traditional LUT-based techniques, and up to $1.35\times$-$2.14\times$ lower area requirement with $1.99\times$-$3.38\times$ lower energy per inference across models as compared to conventional digital MAC-based techniques with $\sim$1% accuracy loss.


title: Differential Test Performance and Peer Effects

abstract: We use variation of test scores measuring closely related skills to isolate peer effects. The intuition for our identification strategy is that the difference in closely related scores eliminates factors common to the performance in either test while retaining idiosyncratic test specific variation. Common factors include unobserved teacher and group effects as well as test invariant ability and factors relevant for peer group formation. Peer effects work through idiosyncratic shocks which have the interpretation of individual and test specific ability or effort. We use education production functions as well as restrictions on the information content of unobserved test taking ability to formalize our approach. An important implication of our identifying assumptions is that we do not need to rely on randomized group assignment. We show that our model restrictions are sufficient for the formulation of linear and quadratic moment conditions that identify the peer effects parameter of interest. We use Project STAR data to empirically measure peer effects in kindergarten through third grade classes. We find evidence of highly significant peer effects with magnitudes that are at the lower end of the range of estimates found in the literature.


title: Anisotropy of the Hydrostatic Stress for Hall Droplets with in-plane Magnetic Field

abstract: We examine the hydrostatic stress of electrons strongly confined in a quasi-2D quantum well in the presence of a strong perpendicular and weak in-plane magnetic field. This introduces anisotropy into the stress tensor which is inconsistent with the notion of the quantum Hall droplet as a simple two-dimensional electron fluid. We show that the breaking of rotational symmetry is a necessary but not a sufficient condition for an anisotropic ground state stress tensor, and that the anisotropic stress originates primarily from quantum effects. We demonstrate this by decomposing the semiclassical trajectories of electrons in the system onto planes in phase space which must be rotated relative to the plane of the fluid to decouple the Hamiltonian.


title: VISTA3D: Versatile Imaging SegmenTation and Annotation model for 3D Computed Tomography

abstract: Segmentation foundation models have attracted great interest, however, none of them are adequate enough for the use cases in 3D computed tomography scans (CT) images. Existing works finetune on medical images with 2D foundation models trained on natural images, but interactive segmentation, especially in 2D, is too time-consuming for 3D scans and less useful for large cohort analysis. Models that can perform out-of-the-box automatic segmentation are more desirable. However, the model trained in this way lacks the ability to perform segmentation on unseen objects like novel tumors. Thus for 3D medical image analysis, an ideal segmentation solution might expect two features: accurate out-of-the-box performance covering major organ classes, and effective adaptation or zero-shot ability to novel structures. In this paper, we discuss what features a 3D CT segmentation foundation model should have, and introduce VISTA3D, Versatile Imaging SegmenTation and Annotation model. The model is trained systematically on 11454 volumes encompassing 127 types of human anatomical structures and various lesions and provides accurate out-of-the-box segmentation. The model's design also achieves state-of-the-art zero-shot interactive segmentation in 3D. The novel model design and training recipe represent a promising step toward developing a versatile medical image foundation model. Code and model weights will be released shortly. The early version of online demo can be tried on https://build.nvidia.com/nvidia/vista-3d.


title: Signal processing algorithm effective for sound quality of hearing loss simulators

abstract: Hearing loss (HL) simulators, which allow normal hearing (NH) listeners to experience HL, have been used in speech intelligibility experiments, but not in sound quality experiments due to perceptible distortion. If they produced less distortion, they might be useful for NH listeners to evaluate the sound quality of, for example, hearing aids. We conducted perceptual sound quality experiments to compare the Cambridge version of HL simulator (CamHLS) and the Wakayama version of the HL simulator (WHIS), which has the two algorithms of filterbank analysis synthesis (FBAS) and direct time-varying filter (DTVF). The experimental results showed that WHIS with DTVF produces less perceptible distortion in speech sounds than CamHLS and WHIS with FBAS, even when the nonlinear process is working. This advantage is mainly due to the use of the DTVF algorithm, which could be applied to various signal synthesis applications with filterbank analysis.


title: Group-wise oracle-efficient algorithms for online multi-group learning

abstract: We study the problem of online multi-group learning, a learning model in which an online learner must simultaneously achieve small prediction regret on a large collection of (possibly overlapping) subsequences corresponding to a family of groups. Groups are subsets of the context space, and in fairness applications, they may correspond to subpopulations defined by expressive functions of demographic attributes. In contrast to previous work on this learning model, we consider scenarios in which the family of groups is too large to explicitly enumerate, and hence we seek algorithms that only access groups via an optimization oracle. In this paper, we design such oracle-efficient algorithms with sublinear regret under a variety of settings, including: (i) the i.i.d. setting, (ii) the adversarial setting with smoothed context distributions, and (iii) the adversarial transductive setting.


title: Optimal Eye Surgeon: Finding Image Priors through Sparse Generators at Initialization

abstract: We introduce Optimal Eye Surgeon (OES), a framework for pruning and training deep image generator networks. Typically, untrained deep convolutional networks, which include image sampling operations, serve as effective image priors (Ulyanov et al., 2018). However, they tend to overfit to noise in image restoration tasks due to being overparameterized. OES addresses this by adaptively pruning networks at random initialization to a level of underparameterization. This process effectively captures low-frequency image components even without training, by just masking. When trained to fit noisy images, these pruned subnetworks, which we term Sparse-DIP, resist overfitting to noise. This benefit arises from underparameterization and the regularization effect of masking, constraining them in the manifold of image priors. We demonstrate that subnetworks pruned through OES surpass other leading pruning methods, such as the Lottery Ticket Hypothesis, which is known to be suboptimal for image recovery tasks (Wu et al., 2023). Our extensive experiments demonstrate the transferability of OES-masks and the characteristics of sparse-subnetworks for image generation. Code is available at https://github.com/Avra98/Optimal-Eye-Surgeon.git.


title: Bistability in the sunspot cycle

abstract: A direct dynamical test of the sunspot-cycle is carried out which indicates that a stochastically forced non-linear oscillator characterizes its dynamics. The sunspot series is then decomposed into its eigen time-delay coordinates. The analysis of these coordinates reveals that the sunspot series exhibits bistability, and suggests the possibility of modeling the solar cycle as a stochastically and periodically forced bistable oscillator, accounting for the Poloidal and Toroidal modes of the solar magnetic field. Such a representation of the sunspot series in terms of stochastic bistable dynamical system enables us to conjecture stochastic resonance as the key mechanism in amplifying the planetary influence of Jupiter on the sun, and that extreme events, due to turbulent convection noise inside the sun, dictate crucial phases of the sunspot cycle, such as the Maunder minimum.


title: Extremization to Fine Tune Physics Informed Neural Networks for Solving Boundary Value Problems

abstract: We propose a novel method for fast and accurate training of physics-informed neural networks (PINNs) to find solutions to boundary value problems (BVPs) and initial boundary value problems (IBVPs). By combining the methods of training deep neural networks (DNNs) and Extreme Learning Machines (ELMs), we develop a model which has the expressivity of DNNs with the fine-tuning ability of ELMs. We showcase the superiority of our proposed method by solving several BVPs and IBVPs which include linear and non-linear ordinary differential equations (ODEs), partial differential equations (PDEs) and coupled PDEs. The examples we consider include a stiff coupled ODE system where traditional numerical methods fail, a 3+1D non-linear PDE, Kovasznay flow and Taylor-Green vortex solutions to incompressible Navier-Stokes equations and pure advection solution of 1+1 D compressible Euler equation. The Theory of Functional Connections (TFC) is used to exactly impose initial and boundary conditions (IBCs) of (I)BVPs on PINNs. We propose a modification to the TFC framework named Reduced TFC and show a significant improvement in the training and inference time of PINNs compared to IBCs imposed using TFC. Furthermore, Reduced TFC is shown to be able to generalize to more complex boundary geometries which is not possible with TFC. We also introduce a method of applying boundary conditions at infinity for BVPs and numerically solve the pure advection in 1+1 D Euler equations using these boundary conditions.

categories: cs.LG cs.CE cs.NA math.NA physics.comp-ph


title: Entanglement with neutral atoms in the simulation of nonequilibrium dynamics of one-dimensional spin models

abstract: Quantum entanglement is a key ingredient for quantum information processing with capabilities beyond that of classical computation. We study the generation and role of entanglement in the dynamics of spin-1/2 models, both for the design of quantum gates for general-purpose quantum computation and for quantum simulation of interacting spin models. We introduce the neutral atom M{\o}lmer-S{\o}rensen gate, involving rapid adiabatic Rydberg dressing interleaved in a spin-echo sequence. We show its robustness to quasi-static experimental imperfections and favorable scaling with the time-energy scales of Rydberg-mediated entanglement generation. In quantum simulation, we consider critical behavior in quench dynamics of transverse field Ising models. Using matrix product states to calculate the dynamics, we find that order parameters, critical point, and critical exponents can be estimated using modest bond dimensions. Considering the role of chaos and equilibration in quenches, we find that local observables are well approximated either due to low global entanglement or the proximity of local marginals to the maximally mixed state. These findings highlight the challenge of identifying relevant quantum phenomena that remain inaccessible to classical descriptions. Understanding the regimes where classical descriptions fail but remain accessible to pre-fault tolerant quantum hardware will help inform the design of future quantum information processors


title: Josephson dynamics and localization revivals in ultradilute quantum liquids

abstract: A Josephson junction of an ultradilute quantum liquid is studied in a double-well potential. We analyze the dynamics as a function of the interaction strength and compare the results to the standard bosonic Josephson junction. It is found that the beyond-mean-field effects alter the dynamics, particularly in the regime, where the beyond-mean-field corrections dominate over the residual mean-field interaction. In that case, we observe non-linear dynamics describing localization revivals instead of regular Josephson oscillations. In the regime where the ultradilute quantum liquids perform the regular Josephson oscillations, their frequency is also significantly changed in comparison with the regular Josephson junction. These results provide experimental characteristics of the ultradilute quantum liquids that contrast with the Josephson oscillations of a regular Bose-Einstein condensate.


title: Ubiquitous Flat Bands in a Cr-based Kagome Superconductor

abstract: In the quest for novel quantum states driven by topology and correlation, kagome lattice materials have garnered significant interest due to their distinctive electronic band structures, featuring flat bands (FBs) arising from the quantum destructive interference of the electronic wave function. The tuning of the FBs to the chemical potential would lead to the possibility of liberating electronic instabilities that lead to emergent electronic orders. Despite extensive studies, direct evidence of FBs tuned to the chemical potential and their participation in emergent electronic orders have been lacking in bulk quantum materials. Here using a combination of Angle-Resolved Photoemission Spectroscopy (ARPES) and Density Functional Theory (DFT), we reveal that the low-energy electronic structure of the recently discovered Cr-based kagome metal superconductor CsCr3Sb5 is dominated by a pervasive FB in close proximity to, and below the Fermi level. A comparative analysis with orbital-projected DFT and polarization dependence measurement uncovers that an orbital-selective renormalization mechanism is needed to reconcile the discrepancy with the DFT calculations, which predict the FB to appear 200 meV above the Fermi level. Furthermore, we observe the FB to shift away from the Fermi level by 20 meV in the low-temperature density wave-ordered phase, highlighting the role of the FB in the emergent electronic order. Our results reveal CsCr3Sb5 to stand out as a promising platform for further exploration into the effects of FBs near the Fermi level on kagome lattices, and their role in emergent orders in bulk quantum materials.


title: Residue Number System (RNS) based Distributed Quantum Addition

abstract: Quantum Arithmetic faces limitations such as noise and resource constraints in the current Noisy Intermediate Scale Quantum (NISQ) era quantum computers. We propose using Distributed Quantum Computing (DQC) to overcome these limitations by substituting a higher depth quantum addition circuit with Residue Number System (RNS) based quantum modulo adders. The RNS-based distributed quantum addition circuits possess lower depth and are distributed across multiple quantum computers/jobs, resulting in higher noise resilience. We propose the Quantum Superior Modulo Addition based on RNS Tool (QSMART), which can generate RNS sets of quantum adders based on multiple factors such as depth, range, and efficiency. We also propose a novel design of Quantum Diminished-1 Modulo (2n + 1) Adder (QDMA), which forms a crucial part of RNS-based distributed quantum addition and the QSMART tool. We demonstrate the higher noise resilience of the Residue Number System (RNS) based distributed quantum addition by conducting simulations modeling Quantinuum's H1 ion trap-based quantum computer. Our simulations demonstrate that RNS-based distributed quantum addition has 11.36% to 133.15% higher output probability over 6-bit to 10-bit non-distributed quantum full adders, indicating higher noise fidelity. Furthermore, we present a scalable way of achieving distributed quantum addition higher than limited otherwise by the 20-qubit range of Quantinuum H1.


title: Information Geometry of Evolution of Neural Network Parameters While Training

abstract: Artificial neural networks (ANNs) are powerful tools capable of approximating any arbitrary mathematical function, but their interpretability remains limited, rendering them as black box models. To address this issue, numerous methods have been proposed to enhance the explainability and interpretability of ANNs. In this study, we introduce the application of information geometric framework to investigate phase transition-like behavior during the training of ANNs and relate these transitions to overfitting in certain models. The evolution of ANNs during training is studied by looking at the probability distribution of its parameters. Information geometry utilizing the principles of differential geometry, offers a unique perspective on probability and statistics by considering probability density functions as points on a Riemannian manifold. We create this manifold using a metric based on Fisher information to define a distance and a velocity. By parameterizing this distance and velocity with training steps, we study how the ANN evolves as training progresses. Utilizing standard datasets like MNIST, FMNIST and CIFAR-10, we observe a transition in the motion on the manifold while training the ANN and this transition is identified with over-fitting in the ANN models considered. The information geometric transitions observed is shown to be mathematically similar to the phase transitions in physics. Preliminary results showing finite-size scaling behavior is also provided. This work contributes to the development of robust tools for improving the explainability and interpretability of ANNs, aiding in our understanding of the variability of the parameters these complex models exhibit during training.


title: Chaotic magnetization dynamics driven by feedback magnetic field

abstract: An excitation of highly nonlinear, complex magnetization dynamics in a ferromagnet, for example chaos, is a new research target in spintronics. This technology is applied to practical applications such as random number generator and information processing systems. One way to induce complex dynamics is applying feedback effect to the ferromagnet. The role of the feedback electric current on the magnetization dynamics was studied in the past. However, there is another way to apply feedback effect to the ferromagnet, namely feedback magnetic field. In this paper, we developed both numerical and theoretical analyses on the role of the feedback magnetic field causing complex magnetization dynamics. The numerical simulation indicates the change of the dynamical behavior from a simple oscillation with a unique frequency to complex dynamics such as amplitude modulation and chaos. The theoretical analyses on the equation of motion qualitatively explain several features found in the numerical simulations, exemplified as an appearance of multipeak structure in the Fourier spectra. The difference of the role of the feedback electric current and magnetic field is also revealed from the theoretical analyses.


title: X-ray Afterglow limits on the viewing angles of short gamma-ray bursts

abstract: The observed behavior of a short gamma-ray burst (sGRB) afterglow lightcurve can reveal the angular structure of the relativistic jet and constrain the observer's viewing angle $\theta_\textrm{obs}$. Regardless of viewing angle, the afterglow emission is produced by the interaction between the relativistic jet and its surrounding environment. However, the observed deceleration time of the jet, and, therefore, the time of the afterglow peak, depends on the observer's viewing angle. A larger viewing angle leads to a later peak of the afterglow and a lower flux at peak. We use the the earliest X-ray afterglow detections of 58 cosmological sGRBs detected with the Neil Gehrels Swift Observatory X-ray Telescope to set an upper limit on the ratio of the viewing angle $\theta_\textrm{obs}$ to the jet's half-opening angle $\theta_\textrm{c}$. We adopt a power-law angular jet structure in both energy $E(\theta)\propto\theta^{-a}$ and Lorentz factor $\Gamma(\theta)\propto\theta^{-b}$ beyond the core. For this structured jet scenario we find that either sGRBs are viewed within $\theta_\textrm{obs}/\theta_\textrm{c}<1$ or the initial Lorentz factor of material in their jet's core is extremely high ($\Gamma_0>500$). If we consider a tophat jet structure, we constrain 90% of our sample to be viewed within $\theta_\textrm{obs}/\theta_\textrm{c}<1.06$ and 1.15 for our canonical and conservative afterglow scenarios. For a subset of events with measurements of the jet break, under the assumption that they on-axis we can constrain $\Gamma_0\theta_\textrm{c}\gtrsim 30$. This confirmation that cosmological sGRBs are viewed either on-axis or very close to their jet's core has significant implications for the nature of the prompt gamma-ray production mechanism and for the rate of future sGRB detections coincident with gravitational waves (GWs), implying that they are extremely rare.


title: Spectral Codecs: Spectrogram-Based Audio Codecs for High Quality Speech Synthesis

abstract: Historically, most speech models in machine-learning have used the mel-spectrogram as a speech representation. Recently, discrete audio tokens produced by neural audio codecs have become a popular alternate speech representation for speech synthesis tasks such as text-to-speech (TTS). However, the data distribution produced by such codecs is too complex for some TTS models to predict, hence requiring large autoregressive models to get reasonable quality. Typical audio codecs compress and reconstruct the time-domain audio signal. We propose a spectral codec which compresses the mel-spectrogram and reconstructs the time-domain audio signal. A study of objective audio quality metrics suggests that our spectral codec has comparable perceptual quality to equivalent audio codecs. Furthermore, non-autoregressive TTS models trained with the proposed spectral codec generate audio with significantly higher quality than when trained with mel-spectrograms or audio codecs.


title: Learning about informativeness

abstract: We study whether individuals can learn the informativeness of their information technology through social learning. As in the classic sequential social learning model, rational agents arrive in order and make decisions based on the past actions of others and their private signals. There is uncertainty regarding the informativeness of the common signal-generating process. We show that learning in this setting is not guaranteed, and depends crucially on the relative tail distributions of private beliefs induced by uninformative and informative signals. We identify the phenomenon of perpetual disagreement as the cause of learning and characterize learning in the canonical Gaussian environment.


title: Harnessing Multimodal Sensing for Multi-user Beamforming in mmWave Systems

abstract: Sensor-aided beamforming reduces the overheads associated with beam training in millimeter-wave (mmWave) multi-input-multi-output (MIMO) communication systems. Most prior work, though, neglects the challenges associated with establishing multi-user (MU) communication links in mmWave MIMO systems. In this paper, we propose a new framework for sensor-aided beam training in MU mmWave MIMO system. We leverage the beamspace representation of the channel that contains only the angles-of-departure (AoDs) of the channel's significant multipath components. We show that a deep neural network (DNN)-based multimodal sensor fusion framework can estimate the beamspace representation of the channel using sensor data. To aid the DNN training, we introduce a novel supervised soft-contrastive loss (SSCL) function that leverages the inherent similarity between channels to extract similar features from the sensor data for similar channels. Finally, we design an MU beamforming strategy that uses the estimated beamspaces of the channels to select analog precoders for all users in a way that prevents transmission to multiple users over the same directions. Compared to the baseline, our approach achieves more than 4$\times$ improvement in the median sum-spectral efficiency (SE) at 42 dBm equivalent isotropic radiated power (EIRP) with 4 active users. This demonstrates that sensor data can provide more channel information than previously explored, with significant implications for machine learning (ML)-based communication and sensing systems.


title: Active Islanding Detection Using Pulse Compression Probing

abstract: An islanding detection scheme is developed using pulse compression probing (PCP). A state space system realization is taken from the probing output. The nu-gap metric is applied to compare the measured system to fully intact system and classify it as islanded, or grid-connected. The designed detector displays fast operation, accurate islanding detection results under varying grid condition, and is physically implementable at the terminals of an inverter. The method is verified via electro-magnetic transient (EMT) simulation on a modified IEEE 34 bus test system with randomized loads and simultaneous probing at three independent solar plants, with the probing signal directly implemented into the logic of a switching inverter model.


title: On a question of Blecher, Pisier, Shlyakhtenko

abstract: We show the failure of a matricial version of Grothendieck's theorem for operator spaces, thereby resolving a long-standing open question in the field. Moreover, by showing that such a counterexample can occur in the simplest context of commutative $C^*$-algebras, we address some other open questions in operator algebras. Our constructions, completely explicit and fairly simple, are inspired by some techniques in quantum information theory.


title: Beyond Efficiency: Scaling AI Sustainably

abstract: Barroso's seminal contributions in energy-proportional warehouse-scale computing launched an era where modern datacenters have become more energy efficient and cost effective than ever before. At the same time, modern AI applications have driven ever-increasing demands in computing, highlighting the importance of optimizing efficiency across the entire deep learning model development cycle. This paper characterizes the carbon impact of AI, including both operational carbon emissions from training and inference as well as embodied carbon emissions from datacenter construction and hardware manufacturing. We highlight key efficiency optimization opportunities for cutting-edge AI technologies, from deep learning recommendation models to multi-modal generative AI tasks. To scale AI sustainably, we must also go beyond efficiency and optimize across the life cycle of computing infrastructures, from hardware manufacturing to datacenter operations and end-of-life processing for the hardware.


title: Polytomous Explanatory Item Response Models for Item Discrimination: Assessing Negative-Framing Effects in Social-Emotional Learning Surveys

abstract: Modeling item parameters as a function of item characteristics has a long history but has generally focused on models for item location. Explanatory item response models for item discrimination are available but rarely used. In this study, we extend existing approaches for modeling item discrimination from dichotomous to polytomous item responses. We illustrate our proposed approach with an application to four social-emotional learning surveys of preschool children to investigate how item discrimination depends on whether an item is positively or negatively framed. Negative framing predicts significantly lower item discrimination on two of the four surveys, and a plausibly causal estimate from a regression discontinuity analysis shows that negative framing reduces discrimination by about 30\% on one survey. We conclude with a discussion of potential applications of explanatory models for item discrimination.


title: YouTube SFV+HDR Quality Dataset

abstract: The popularity of Short form videos (SFV) has grown dramatically in the past few years, and has become a phenomenal video category with billions of viewers. Meanwhile, High Dynamic Range (HDR) as an advanced feature also becomes more and more popular on video sharing platforms. As a hot topic with huge impact, SFV and HDR bring new questions to video quality research: 1) is SFV+HDR quality assessment significantly different from traditional User Generated Content (UGC) quality assessment? 2) do objective quality metrics designed for traditional UGC still work well for SFV+HDR? To answer the above questions, we created the first large scale SFV+HDR dataset with reliable subjective quality scores, covering 10 popular content categories. Further, we also introduce a general sampling framework to maximize the representativeness of the dataset. We provided a comprehensive analysis of subjective quality scores for Short form SDR and HDR videos, and discuss the reliability of state-of-the-art UGC quality metrics and potential improvements.


title: Detection of New Galaxy Candidates at $z\ >$ 11 in the JADES Field Using JWST NIRCam

abstract: We report the detection of seven new galaxy candidates with redshift $z$ $>$ 11 within the JWST Advanced Deep Extragalactic Survey (JADES) GOODS-S and GOODS-N fields. These new candidates are detected through meticulous analysis of NIRCam photometry in eight filters spanning a wavelength range of 0.8-5.0 $\mu$m. Photometric redshifts of these galaxy candidates are independently measured utilizing spectral energy distribution (SED) fitting techniques using \texttt{EAZY} and \texttt{BAGPIPES} codes, followed by visual scrutiny. Two of these galaxy candidates are located in GOODS-S field, while the remaining five galaxies are located in GOODS-N field. Our analysis reveals that the stellar masses of these galaxies typically range from log $M_{\ast}$/$M_{\odot}$ = 7.75--8.75. Futhermore, these galaxies are typically young with their mass-weighted ages spanning from 80 to 240 Myr. Their specific star formation rates (sSFR), quantified as $\log (\text{sSFR}/\text{Gyr}$), are measured to vary between $\sim 0.95$ to 1.46. These new galaxy candidates offer a robust sample for probing the physical properties of galaxies within the first few hundred Myr of the history of the Universe. We also analyze the relationship between star formation rate (SFR) and stellar mass ($M_\ast$) within our sample. Using linear regression, our analysis yields a slope of $0.71 \pm 0.12$, which we then compare with results from previous studies. Continued investigation through spectroscopic analysis using JWST/NIRSpec is needed to spectroscopically confirm these high-redshift galaxy candidates and investigate further into their physical properties. We plan to follow up on these candidates with future NIRSpec observations.


title: DeviceBERT: Applied Transfer Learning With Targeted Annotations and Vocabulary Enrichment to Identify Medical Device and Component Terminology in FDA Recall Summaries

abstract: FDA Medical Device recalls are critical and time-sensitive events, requiring swift identification of impacted devices to inform the public of a recall event and ensure patient safety. The OpenFDA device recall dataset contains valuable information about ongoing device recall actions, but manually extracting relevant device information from the recall action summaries is a time-consuming task. Named Entity Recognition (NER) is a task in Natural Language Processing (NLP) that involves identifying and categorizing named entities in unstructured text. Existing NER models, including domain-specific models like BioBERT, struggle to correctly identify medical device trade names, part numbers and component terms within these summaries. To address this, we propose DeviceBERT, a medical device annotation, pre-processing and enrichment pipeline, which builds on BioBERT to identify and label medical device terminology in the device recall summaries with improved accuracy. Furthermore, we demonstrate that our approach can be applied effectively for performing entity recognition tasks where training data is limited or sparse.


title: Weakly Supervised Set-Consistency Learning Improves Morphological Profiling of Single-Cell Images

abstract: Optical Pooled Screening (OPS) is a powerful tool combining high-content microscopy with genetic engineering to investigate gene function in disease. The characterization of high-content images remains an active area of research and is currently undergoing rapid innovation through the application of self-supervised learning and vision transformers. In this study, we propose a set-level consistency learning algorithm, Set-DINO, that combines self-supervised learning with weak supervision to improve learned representations of perturbation effects in single-cell images. Our method leverages the replicate structure of OPS experiments (i.e., cells undergoing the same genetic perturbation, both within and across batches) as a form of weak supervision. We conduct extensive experiments on a large-scale OPS dataset with more than 5000 genetic perturbations, and demonstrate that Set-DINO helps mitigate the impact of confounders and encodes more biologically meaningful information. In particular, Set-DINO recalls known biological relationships with higher accuracy compared to commonly used methods for morphological profiling, suggesting that it can generate more reliable insights from drug target discovery campaigns leveraging OPS.


title: CoBL-Diffusion: Diffusion-Based Conditional Robot Planning in Dynamic Environments Using Control Barrier and Lyapunov Functions

abstract: Equipping autonomous robots with the ability to navigate safely and efficiently around humans is a crucial step toward achieving trusted robot autonomy. However, generating robot plans while ensuring safety in dynamic multi-agent environments remains a key challenge. Building upon recent work on leveraging deep generative models for robot planning in static environments, this paper proposes CoBL-Diffusion, a novel diffusion-based safe robot planner for dynamic environments. CoBL-Diffusion uses Control Barrier and Lyapunov functions to guide the denoising process of a diffusion model, iteratively refining the robot control sequence to satisfy the safety and stability constraints. We demonstrate the effectiveness of the proposed model using two settings: a synthetic single-agent environment and a real-world pedestrian dataset. Our results show that CoBL-Diffusion generates smooth trajectories that enable the robot to reach goal locations while maintaining a low collision rate with dynamic obstacles.


title: COOKIEGUARD: Characterizing and Isolating the First-Party Cookie Jar

abstract: As third-party cookies are going away, first-party cookies are increasingly being used for tracking. Prior research has shown that third-party scripts write (or \textit{ghost-write}) first-party cookies in the browser's cookie jar because they are included in the website's main frame. What is more is that a third-party script is able to access all first-party cookies, both the actual first-party cookies as well as the ghost-written first-party cookies by different third-party scripts. Existing isolation mechanisms in the web browser such as SOP and CSP are not designed to address this lack of isolation between first-party cookies written by different third-parties. We conduct a comprehensive analysis of cross-domain first-party cookie retrieval, exfiltration, and modification on top-10K websites. Most notably, we find 18\% and 4\% of the first-party cookies are exfiltrated and overwritten, respectively, by cross-domain third-party scripts. We propose \name to introduce isolation between first-party cookies set by different third-party scripts in the main frame. To this end, \name intercepts cookie get and set operations between third-party scripts and the browser's cookie jar to enforce strict isolation between first-party cookies set by different third-party domains. Our evaluation of \name shows that it effectively blocks all cross-domain cookie read/write operations to provide a fully isolated cookie jar. While it generally does not impact appearance, navigation, or other website functionality, the strict isolation policy disrupts Single Sign-On (SSO) on just 11\% of websites that rely on first-party cookies for session management. Our work demonstrates the feasibility of isolating first-party cookies.


title: A quantum Murnaghan--Nakayama rule for the flag manifold

abstract: In this paper, we give a rule for the multiplication of a Schubert class by a tautological class in the (small) quantum cohomology ring of the flag manifold. As an intermediate step, we establish a formula for the multiplication of a Schubert class by a quantum Schur polynomial indexed by a hook partition. This entails a detailed analysis of chains and intervals in the quantum Bruhat order. This analysis allows us to use results of Leung--Li and of Postnikov to reduce quantum products by hook Schur polynomials to the (known) classical product.


title: Deep convolutional demosaicking network for multispectral polarization filter array

abstract: To address the demosaicking problem in multispectral polarization filter array (MSPFA) imaging, we propose a multispectral polarization demosaicking network (MSPDNet) that improves image reconstruction accuracy. Imaging with a multispectral polarization filter array acquires multispectral polarization information in a snapshot. The full-resolution multispectral polarization image must be reconstructed from a mosaic image. In the proposed method, a sparse image in which pixel values of the same channel are extracted from a mosaic image is used as input to MSPDNet. Missing pixels are interpolated by learning spatial and wavelength correlations from the observed pixels in the mosaic image. Moreover, by using 3D convolution, features are extracted at each convolution layer, and by deepening the network, even detailed features of the multispectral polarization image can be learned. Experimental results show that MSPDNet can reconstruct multi-wavelength and multi-polarization angle information with high accuracy in terms of peak signal-to-noise ratio (PSNR) evaluation and visual quality, indicating the effectiveness of the proposed method compared to other methods.


title: Traversing Mars: Cooperative Informative Path Planning to Efficiently Navigate Unknown Scenes

abstract: The ability to traverse an unknown environment is crucial for autonomous robot operations. However, due to the limited sensing capabilities and system constraints, approaching this problem with a single robot agent can be slow, costly, and unsafe. For example, in planetary exploration missions, the wear on the wheels of a rover from abrasive terrain should be minimized at all costs as reparations are infeasible. On the other hand, utilizing a scouting robot such as a micro aerial vehicle (MAV) has the potential to reduce wear and time costs and increasing safety of a follower robot. This work proposes a novel cooperative IPP framework that allows a scout (e.g., an MAV) to efficiently explore the minimum-cost-path for a follower (e.g., a rover) to reach the goal. We derive theoretic guarantees for our algorithm, and prove that the algorithm always terminates, always finds the optimal path if it exists, and terminates early when the found path is shown to be optimal or infeasible. We show in thorough experimental evaluation that the guarantees hold in practice, and that our algorithm is 22.5% quicker to find the optimal path and 15% quicker to terminate compared to existing methods.


title: Relational Proxy Loss for Audio-Text based Keyword Spotting

abstract: In recent years, there has been an increasing focus on user convenience, leading to increased interest in text-based keyword enrollment systems for keyword spotting (KWS). Since the system utilizes text input during the enrollment phase and audio input during actual usage, we call this task audio-text based KWS. To enable this task, both acoustic and text encoders are typically trained using deep metric learning loss functions, such as triplet- and proxy-based losses. This study aims to improve existing methods by leveraging the structural relations within acoustic embeddings and within text embeddings. Unlike previous studies that only compare acoustic and text embeddings on a point-to-point basis, our approach focuses on the relational structures within the embedding space by introducing the concept of Relational Proxy Loss (RPL). By incorporating RPL, we demonstrated improved performance on the Wall Street Journal (WSJ) corpus.