title: HeLIOS: The Superfluid Helium Ultralight Dark Matter Detector

abstract: The absence of a breakthrough in directly observing dark matter (DM) through prominent large-scale detectors motivates the development of novel tabletop experiments probing more exotic regions of the parameter space. If DM contains ultralight bosonic particles, they would behave as a classical wave and could manifest through an oscillating force on baryonic matter that is coherent over $\sim 10^6$ periods. Our Helium ultraLIght dark matter Optomechanical Sensor (HeLIOS) uses the high-$Q$ acoustic modes of superfluid helium-4 to resonantly amplify this signal. A superconducting re-entrant microwave cavity enables sensitive optomechanical readout ultimately limited by thermal motion at millikelvin temperatures. Pressurizing the helium allows for the unique possibility of tuning the mechanical frequency to effectively broaden the DM detection bandwidth. We demonstrate the working principle of our prototype HeLIOS detector and show that future generations of HeLIOS could explore unconstrained parameter space for both scalar and vector ultralight DM after just an hour of integration time.

categories: astro-ph.IM astro-ph.CO cond-mat.other physics.ins-det quant-ph


title: Efficient online update of model predictive control in embedded systems using first-order methods

abstract: Model Predictive Control (MPC) is typically characterized for being computationally demanding, as it requires solving optimization problems online; a particularly relevant point when considering its implementation in embedded systems. To reduce the computational burden of the optimization algorithm, most solvers perform as many offline operations as possible, typically performing the computation and factorization of its expensive matrices offline and then storing them in the embedded system. This improves the efficiency of the solver, with the disadvantage that online changes on some of the ingredients of the MPC formulation require performing these expensive computations online. This article presents an efficient algorithm for the factorization of the key matrix used in several first-order optimization methods applied to linear MPC formulations, allowing its prediction model and cost function matrices to be updated online at the expense of a small computational cost. We show results comparing the proposed approach with other solvers from the literature applied to a linear time-varying system.


title: First principle prediction of structural distortions in the cuprates and their impact on the electronic structure

abstract: Materials-realistic microscopic theoretical descriptions of copper-based superconductors are challenging due to their complex crystal structures combined with strong electron interactions. Here, we demonstrate how density functional theory can accurately describe key structural, electronic, and magnetic properties of the normal state of the prototypical cuprate Bi$_2$Sr$_2$CaCu$_2$O$_{8+x}$ (Bi-2212). We emphasize the importance of accounting for energy-lowering structural distortions, which then allows us to: (a) accurately describe the insulating antiferromagnetic (AFM) ground state of the undoped parent compound (in contrast to the metallic state predicted by previous {\it ab initio} studies); (b) identify numerous low-energy competing spin and charge stripe orders in the hole-overdoped material nearly degenerate in energy with the AFM ordered state, indicating strong spin fluctuations; (c) predict the lowest-energy hole-doped crystal structure including its long-range structural distortions and oxygen dopant positions that match high-resolution scanning microscopy measurements; and (d) describe electronic bands near the Fermi energy with flat antinodal dispersions and Fermi surfaces that in agreement with angle-resolved photoemission spectroscopy (ARPES) measurements and provide a clear explanation for the structural origins of the so-called ``shadow bands''. We also show how one must go beyond band theory and include fully dynamic spin fluctuations via a many-body approach when aiming to make quantitative predictions to measure the ARPES spectra in the overdoped material.


title: Exploring the Impact of Human Evaluator Group on Chat-Oriented Dialogue Evaluation

abstract: Human evaluation has been widely accepted as the standard for evaluating chat-oriented dialogue systems. However, there is a significant variation in previous work regarding who gets recruited as evaluators. Evaluator groups such as domain experts, university students, and professional annotators have been used to assess and compare dialogue systems, although it is unclear to what extent the choice of an evaluator group can affect results. This paper analyzes the evaluator group impact on dialogue system evaluation by testing 4 state-of-the-art dialogue systems using 4 distinct evaluator groups. Our analysis reveals a robustness towards evaluator groups for Likert evaluations that is not seen for Pairwise, with only minor differences observed when changing evaluator groups. Furthermore, two notable limitations to this robustness are observed, which reveal discrepancies between evaluators with different levels of chatbot expertise and indicate that evaluator objectivity is beneficial for certain dialogue metrics.


title: The Dependence of Gamma-Ray Burst Jet Collimation on Black Hole Spin

abstract: Gamma-Ray Bursts are the most luminous events in the Universe, and are excellent laboratories to study extreme physical phenomena in the cosmos. Despite a long trajectory of progress in understanding these highly energetic events, there are still many observed features that are yet to be fully explained. Observations of the jet opening angle of long gamma-ray bursts (LGRBs) suggest that LGRB jets are narrower for those GRBs at higher redshift. This phenomenon has been explained in the context of collimation by the stellar envelope, with denser (lower metallicity) stars at higher redshifts able to collimate the jet more effectively. However, until now, the dependence of jet opening angle on the properties of the central engine has not been explored. We investigate the effect of black hole spin on the jet collimation angle for a magnetically launched jet, using the General Relativistic Radiation Magnetohydrodynamical (GRRMHD) code \nubhlight. We present 3D results for a range of spin values. The simulations show that higher spinning black holes tend to create narrower jets. If indeed LGRB progenitors in the early universe are able to produce black hole central engines with higher spin, this could account for at least some of the observed jet opening angle-redshift correlation.


title: A joint modeling approach to study the association between subject-level longitudinal marker variabilities and repeated outcomes

abstract: Women are at increased risk of bone loss during the menopausal transition; in fact, nearly 50\% of women's lifetime bone loss occurs during this time. The longitudinal relationships between estradiol (E2) and follicle-stimulating hormone (FSH), two hormones that change have characteristic changes during the menopausal transition, and bone health outcomes are complex. However, in addition to level and rate of change in E2 and FSH, variability in these hormones across the menopausal transition may be an important predictor of bone health, but this question has yet to be well explored. We introduce a joint model that characterizes individual mean estradiol (E2) trajectories and the individual residual variances and links these variances to bone health trajectories. In our application, we found that higher FSH variability was associated with declines in bone mineral density (BMD) before menopause, but this association was moderated over time after the menopausal transition. Additionally, higher mean E2, but not E2 variability, was associated with slower decreases in during the menopausal transition. We also include a simulation study that shows that naive two-stage methods often fail to propagate uncertainty in the individual-level variance estimates, resulting in estimation bias and invalid interval coverage


title: Almost Sure Convergence of Liouville First Passage Percolation

abstract: Liouville first passage percolation (LFPP) with parameter $\xi > 0$ is the family of random distance functions (metrics) $(D_h^{\epsilon})_{\epsilon > 0}$ on $\mathbb{C}$ obtained heuristically by integrating $e^{\xi h}$ along paths, where $h$ is a variant of the Gaussian free field. There is a critical value $\xi_{\text{crit}} \approx 0.41$ such that for $\xi \in (0, \xi_{\text{crit}})$, appropriately rescaled LFPP converges in probability uniformly on compact subsets of $\mathbb{C}$ to a limiting metric $D_h$ on $\gamma$-Liouville quantum gravity with $\gamma = \gamma(\xi) \in (0,2)$. We show that the convergence is almost sure, giving an affirmative answer to a question posed by Gwynne and Miller (2019).


title: HIVE: Scalable Hardware-Firmware Co-Verification using Scenario-based Decomposition and Automated Hint Extraction

abstract: Hardware-firmware co-verification is critical to design trustworthy systems. While formal methods can provide verification guarantees, due to the complexity of firmware and hardware, it can lead to state space explosion. There are promising avenues to reduce the state space during firmware verification through manual abstraction of hardware or manual generation of hints. Manual development of abstraction or hints requires domain expertise and can be time-consuming and error-prone, leading to incorrect proofs or inaccurate results. In this paper, we effectively combine the scalability of simulation-based validation and the completeness of formal verification. Our proposed approach is applicable to actual firmware and hardware implementations without requiring any manual intervention during formal model generation or hint extraction. To reduce the state space complexity, we utilize both static module-level analysis and dynamic execution of verification scenarios to automatically generate system-level hints. These hints guide the underlying solver to perform scalable equivalence checking using proofs. The extracted hints are validated against the implementation before using them in the proofs. Experimental evaluation on RISC-V based systems demonstrates that our proposed framework is scalable due to scenario-based decomposition and automated hint extraction. Moreover, our fully automated framework can identify complex bugs in actual firmware-hardware implementations.


title: Generalized Decomposition of Multivariate Information

abstract: Since its introduction, the partial information decomposition (PID) has emerged as a powerful, information-theoretic technique useful for studying the structure of (potentially higher-order) interactions in complex systems. Despite its utility, the applicability of the PID is restricted by the need to assign elements as either inputs or targets, as well as the specific structure of the mutual information itself. Here, we introduce a generalized information decomposition that relaxes the source/target distinction while still satisfying the basic intuitions about information. This approach is based on the decomposition of the Kullback-Leibler divergence, and consequently allows for the analysis of any information gained when updating from an arbitrary prior to an arbitrary posterior. Consequently, any information-theoretic measure that can be written in as a Kullback-Leibler divergence admits a decomposition in the style of Williams and Beer, including the total correlation, the negentropy, and the mutual information as special cases. In this paper, we explore how the generalized information decomposition can reveal novel insights into existing measures, as well as the nature of higher-order synergies. We show that synergistic information is intimately related to the well-known Tononi-Sporns-Edelman (TSE) complexity, and that synergistic information requires a similar integration/segregation balance as a high TSE complexity. Finally, we end with a discussion of how this approach fits into other attempts to generalize the PID and the possibilities for empirical applications.


title: Commensal Transient Searches in Eight Short Gamma Ray Burst Fields

abstract: A new generation of radio telescopes with excellent sensitivity, instantaneous {\it uv} coverage, and large fields of view, are providing unprecedented opportunities for performing commensal transient searches. Here we present such a commensal search in deep observations of short gamma-ray burst fields carried out with the MeerKAT radio telescope in South Africa at 1.3 GHz. These four hour observations of eight different fields span survey lengths of weeks to months. We also carry out transient searches in time slices of the full observations, at timescales of 15 minutes, and 8 seconds. We find 122 variable sources on the long timescales, of which 52 are likely active galactic nuclei, but there are likely also some radio flaring stars. While the variability is intrinsic in at least two cases, most of it is consistent with interstellar scintillation. In this study, we also place constraints on transient rates based on state-of-the-art transient simulations codes. We place an upper limit of $2\times10^{-4}$ transients per day per square degree for transients with peak flux of 5 mJy, and an upper limit of $2.5\times10^{-2}$ transients per day per square degree for transients with a fluence of 10 Jy ms, the minimum detectable fluence of our survey.


title: Efficient Face Detection with Audio-Based Region Proposals for Human-Robot Interactions

abstract: Efficient face detection is critical to provide natural human-robot interactions. However, computer vision tends to involve a large computational load due to the amount of data (i.e. pixels) that needs to be processed in a short amount of time. This is undesirable on robotics platforms where multiple processes need to run in parallel and where the processing power is limited by portability constraints. Existing solutions often involve reducing image quality which can negatively impact processing. The literature also reports methods to generate regions of interest in images from pixel data. Although it is a promising idea, these methods often involve heavy vision algorithms. In this paper, we evaluate how audio can be used to generate regions of interest in optical images to reduce the number of pixels to process with computer vision. Thereby, we propose a unique attention mechanism to localize a speech source and evaluate its impact on an existing face detection algorithm. Our results show that the attention mechanism reduces the computational load and offers an interesting trade-off between speed and accuracy. The proposed pipeline is flexible and can be easily adapted to other applications such as robot surveillance, video conferences or smart glasses.


title: Facial Kinship Verification from remote photoplethysmography

abstract: Facial Kinship Verification (FKV) aims at automatically determining whether two subjects have a kinship relation based on human faces. It has potential applications in finding missing children and social media analysis. Traditional FKV faces challenges as it is vulnerable to spoof attacks and raises privacy issues. In this paper, we explore for the first time the FKV with vital bio-signals, focusing on remote Photoplethysmography (rPPG). rPPG signals are extracted from facial videos, resulting in a one-dimensional signal that measures the changes in visible light reflection emitted to and detected from the skin caused by the heartbeat. Specifically, in this paper, we employed a straightforward one-dimensional Convolutional Neural Network (1DCNN) with a 1DCNN-Attention module and kinship contrastive loss to learn the kin similarity from rPPGs. The network takes multiple rPPG signals extracted from various facial Regions of Interest (ROIs) as inputs. Additionally, the 1DCNN attention module is designed to learn and capture the discriminative kin features from feature embeddings. Finally, we demonstrate the feasibility of rPPG to detect kinship with the experiment evaluation on the UvANEMO Smile Database from different kin relations.


title: DiariST: Streaming Speech Translation with Speaker Diarization

abstract: End-to-end speech translation (ST) for conversation recordings involves several under-explored challenges such as speaker diarization (SD) without accurate word time stamps and handling of overlapping speech in a streaming fashion. In this work, we propose DiariST, the first streaming ST and SD solution. It is built upon a neural transducer-based streaming ST system and integrates token-level serialized output training and t-vector, which were originally developed for multi-talker speech recognition. Due to the absence of evaluation benchmarks in this area, we develop a new evaluation dataset, DiariST-AliMeeting, by translating the reference Chinese transcriptions of the AliMeeting corpus into English. We also propose new metrics, called speaker-agnostic BLEU and speaker-attributed BLEU, to measure the ST quality while taking SD accuracy into account. Our system achieves a strong ST and SD capability compared to offline systems based on Whisper, while performing streaming inference for overlapping speech. To facilitate the research in this new direction, we release the evaluation data, the offline baseline systems, and the evaluation code.


title: An Empirical Evaluation of Prompting Strategies for Large Language Models in Zero-Shot Clinical Natural Language Processing

abstract: Large language models (LLMs) have shown remarkable capabilities in Natural Language Processing (NLP), especially in domains where labeled data is scarce or expensive, such as clinical domain. However, to unlock the clinical knowledge hidden in these LLMs, we need to design effective prompts that can guide them to perform specific clinical NLP tasks without any task-specific training data. This is known as in-context learning, which is an art and science that requires understanding the strengths and weaknesses of different LLMs and prompt engineering approaches. In this paper, we present a comprehensive and systematic experimental study on prompt engineering for five clinical NLP tasks: Clinical Sense Disambiguation, Biomedical Evidence Extraction, Coreference Resolution, Medication Status Extraction, and Medication Attribute Extraction. We assessed the prompts proposed in recent literature, including simple prefix, simple cloze, chain of thought, and anticipatory prompts, and introduced two new types of prompts, namely heuristic prompting and ensemble prompting. We evaluated the performance of these prompts on three state-of-the-art LLMs: GPT-3.5, BARD, and LLAMA2. We also contrasted zero-shot prompting with few-shot prompting, and provide novel insights and guidelines for prompt engineering for LLMs in clinical NLP. To the best of our knowledge, this is one of the first works on the empirical evaluation of different prompt engineering approaches for clinical NLP in this era of generative AI, and we hope that it will inspire and inform future research in this area.


title: Measuring the Quality of Text-to-Video Model Outputs: Metrics and Dataset

abstract: Evaluating the quality of videos generated from text-to-video (T2V) models is important if they are to produce plausible outputs that convince a viewer of their authenticity. We examine some of the metrics used in this area and highlight their limitations. The paper presents a dataset of more than 1,000 generated videos from 5 very recent T2V models on which some of those commonly used quality metrics are applied. We also include extensive human quality evaluations on those videos, allowing the relative strengths and weaknesses of metrics, including human assessment, to be compared. The contribution is an assessment of commonly used quality metrics, and a comparison of their performances and the performance of human evaluations on an open dataset of T2V videos. Our conclusion is that naturalness and semantic matching with the text prompt used to generate the T2V output are important but there is no single measure to capture these subtleties in assessing T2V model output.


title: Malicious Cyber Activity Detection Using Zigzag Persistence

abstract: In this study we synthesize zigzag persistence from topological data analysis with autoencoder-based approaches to detect malicious cyber activity and derive analytic insights. Cybersecurity aims to safeguard computers, networks, and servers from various forms of malicious attacks, including network damage, data theft, and activity monitoring. Here we focus on the detection of malicious activity using log data. To do this we consider the dynamics of the data by exploring the changing topology of a hypergraph representation gaining insights into the underlying activity. Hypergraphs provide a natural representation of cyber log data by capturing complex interactions between processes. To study the changing topology we use zigzag persistence which captures how topological features persist at multiple dimensions over time. We observe that the resulting barcodes represent malicious activity differently than benign activity. To automate this detection we implement an autoencoder trained on a vectorization of the resulting zigzag persistence barcodes. Our experimental results demonstrate the effectiveness of the autoencoder in detecting malicious activity in comparison to standard summary statistics. Overall, this study highlights the potential of zigzag persistence and its combination with temporal hypergraphs for analyzing cybersecurity log data and detecting malicious behavior.


title: A Subspace Framework for ${\mathcal L}_\infty$ Model Reduction

abstract: We consider the problem of locating a nearest descriptor system of prescribed reduced order to a descriptor system with large order with respect to the ${\mathcal L}_\infty$ norm. Widely employed approaches such as the balanced truncation and best Hankel norm approximation for this ${\mathcal L}_\infty$ model reduction problem are usually expensive and yield solutions that are not optimal, not even locally. We propose approaches based on the minimization of the ${\mathcal L}_\infty$ objective by means of smooth optimization techniques. As we illustrate, direct applications of smooth optimization techniques are not feasible, since the optimization techniques converge at best at a linear rate requiring too many evaluations of the costly ${\mathcal L}_\infty$-norm objective to be practical. We replace the original large-scale system with a system of smaller order that interpolates the original system at points on the imaginary axis, and minimize the ${\mathcal L}_\infty$ objective after this replacement. The smaller system is refined by interpolating at additional imaginary points determined based on the local minimizer of the ${\mathcal L}_\infty$ objective, and the optimization is repeated. We argue the framework converges at a quadratic rate under smoothness and nondegeneracy assumptions, and describe how asymptotic stability constraints on the reduced system sought can be incorporated into our approach. The numerical experiments on benchmark examples illustrate that the approach leads to locally optimal solutions to the ${\mathcal L}_\infty$ model reduction problem, and the convergence occurs quickly for descriptors systems of order a few ten thousands.


title: HUVECs-encapsulation via Millimeter-sized Alginate Droplets

abstract: Droplet microfluidics are a powerful approach for hydrogel cell encapsulations. Much of the field has focused on single-cell encapsulations with pico-nanoliter droplet volumes necessary for single-cell sequencing or high-throughput screening. These small volumes, however, limit the use of hydrogel droplets for tissue engineering or cell therapies. We describe simple droplet microfluidics to generate millimeter-sized alginate droplets and demonstrate their use for cell encapsulations. This effort builds on our recent efforts, specifically by replacing the glass slide forming the bottom layer of the chamber with a more hydrophobic acrylic (PMMA) layer to improve the alginate-in-oil droplet formation. Using glass layer and PMMA layer devices, we characterized the tunable production of water-in-oil droplets (average droplet lengths ranged from 0.8 to 3.7 mm). Next, PMMA layer devices were used to demonstrate the tunable generation of alginate-in-oil droplets (average droplet lengths ranged from 3-6 mm). Increasing the flow ratio (Q.ratio = Q.oil/Q.alginate) led to more uniform droplets as measured by the coefficient of variance, which was approximately 5%. Finally, a proof-of-use experiment used HUVEC-encapsulated alginate droplets as part of a scratch-healing assay. Specifically, HUVEC-encapsulated droplets (AH droplets) led to the recovery of 3T3 fibroblast monolayers compared to no droplets or cell-free droplets (A droplets). Our results extended the use of simple microfluidics to generate and retrieve millimeter-sized alginate droplets for effective cell encapsulations.


title: Symmetry Reduction and Rotation Numbers for Poncelet maps

abstract: Poncelet maps are circle maps constructed geometrically for a pair of nested ellipses; they are related to the classic billiard map on an elliptical domain when the orbit has an elliptical caustic. Here we show how the rotation number of the elliptical billiard map can be obtained from a symmetry generated from the flow of a pendulum Hamiltonian system. When such a symmetry flow has a global cross section, we previously showed that there are coordinates in which the map takes a reduced, skew-product form on a covering space. In particular, for elliptic billiard map this gives an explicit form for the rotation number of each orbit. We show that the family Poncelet maps on a pencil of ellipses is conjugate to a corresponding family of billiard maps, and thus the Poncelet maps inherit the one-parameter family of continuous symmetries. Such a pencil has a single parameter, the pencil eccentricity, which becomes the modulus of the Jacobi elliptic functions used to construct a covering space that simultaneously simplifies all of the Poncelet maps. The rotation number of the Poncelet map for any element of a pencil can then be written in terms of elliptic functions as well. An implication is that the rotation number of the pencil has a monotonicity property: it is monotone increasing as the caustic ellipse shrinks. The resulting expression for the rotation number gives an explicit condition for Poncelet porisms, the parameters for which the rotation number is rational. For such parameters, an orbit of the corresponding Poncelet map is periodic: it forms a polygon for any initial point. These universal parameters also solve the inverse problem: given a rotation number, which member of a pencil has a Poncelet map with that rotation number? Explicit conditions are given for a general rotation numbers and we see how they are related to Cayley's classic porism theorem.


title: A div-curl inequality for orthonormal functions

abstract: We prove a bound on the sum of the product of curl-free and divergence-free vector fields. Under appropriate orthonormality conditions our bound scales sublinearly in the number of terms, similar in spirit to Lieb--Thirring inequalities.


title: Curved vortex surfaces in four-dimensional superfluids: I. Unequal-frequency double rotations

abstract: The study of superfluid quantum vortices has long been an important area of research, with previous work naturally focusing on two-dimensional and three-dimensional systems, where rotation stabilises point vortices and line vortices respectively. Interestingly, this physics generalises for a hypothetical four-dimensional (4D) superfluid to include vortex planes, which can have a much richer phenomenology. In this paper, we study the possibility of skewed and curved vortex planes, which have no direct analogue in lower dimensions. By analytically and numerically studying the 4D Gross-Pitaevskii equation, we show that such vortex surfaces can be stabilised and favoured by double rotation with unequal rotation frequencies. Our work raises open questions for further research into the physics of these vortex surfaces and suggests interesting future extensions to tilted vortex surfaces under equal-frequency double rotation and to more realistic 4D models.


title: Curved vortex surfaces in four-dimensional superfluids: II. Equal-frequency double rotations

abstract: As is well-known, two-dimensional and three-dimensional superfluids under rotation can support topological excitations such as quantized point vortices and line vortices respectively. Recently, we have studied how, in a hypothetical four-dimensional (4D) superfluid, such excitations can be generalised to vortex planes and surfaces. In this paper, we continue our analysis of skewed and curved vortex surfaces based on the 4D Gross-Pitaevskii equation, and show that certain types of such states can be stabilised by equal-frequency double rotations for suitable parameters. This work extends the rich phenomenology of vortex surfaces in 4D, and raises interesting questions about vortex reconnections and the competition between various vortex structures which have no direct analogue in lower dimensions.


title: Diffeomorphism covariance of the canonical Barbero-Immirzi-Holst triad theory

abstract: The vanishing phase space generator of the full four-dimensional diffeomorphism-related symmetry group in the context of the Barbero-Immirzi-Holst Lagrangian is derived directly for the first time from Noether's second theorem. Its applicability in the construction of classical diffeomorphism invariants is reviewed.


title: The Effect of Smoothing on the Interpretation of Time Series Data: A COVID-19 Case Study

abstract: We conduct a controlled crowd-sourced experiment of COVID-19 case data visualization to study if and how different plotting methods, time windows, and the nature of the data influence people's interpretation of real-world COVID-19 data and people's prediction of how the data will evolve in the future. We find that a 7-day backward average smoothed line successfully reduces the distraction of periodic data patterns compared to just unsmoothed bar data. Additionally, we find that the presence of a smoothed line helps readers form a consensus on how the data will evolve in the future. We also find that the fixed 7-day smoothing window size leads to different amounts of perceived recurring patterns in the data depending on the time period plotted -- this suggests that varying the smoothing window size together with the plot window size might be a promising strategy to influence the perception of spurious patterns in the plot.


title: CRYPTO-MINE: Cryptanalysis via Mutual Information Neural Estimation

abstract: The use of Mutual Information (MI) as a measure to evaluate the efficiency of cryptosystems has an extensive history. However, estimating MI between unknown random variables in a high-dimensional space is challenging. Recent advances in machine learning have enabled progress in estimating MI using neural networks. This work presents a novel application of MI estimation in the field of cryptography. We propose applying this methodology directly to estimate the MI between plaintext and ciphertext in a chosen plaintext attack. The leaked information, if any, from the encryption could potentially be exploited by adversaries to compromise the computational security of the cryptosystem. We evaluate the efficiency of our approach by empirically analyzing multiple encryption schemes and baseline approaches. Furthermore, we extend the analysis to novel network coding-based cryptosystems that provide individual secrecy and study the relationship between information leakage and input distribution.


title: Temporal-aware Hierarchical Mask Classification for Video Semantic Segmentation

abstract: Modern approaches have proved the huge potential of addressing semantic segmentation as a mask classification task which is widely used in instance-level segmentation. This paradigm trains models by assigning part of object queries to ground truths via conventional one-to-one matching. However, we observe that the popular video semantic segmentation (VSS) dataset has limited categories per video, meaning less than 10% of queries could be matched to receive meaningful gradient updates during VSS training. This inefficiency limits the full expressive potential of all queries.Thus, we present a novel solution THE-Mask for VSS, which introduces temporal-aware hierarchical object queries for the first time. Specifically, we propose to use a simple two-round matching mechanism to involve more queries matched with minimal cost during training while without any extra cost during inference. To support our more-to-one assignment, in terms of the matching results, we further design a hierarchical loss to train queries with their corresponding hierarchy of primary or secondary. Moreover, to effectively capture temporal information across frames, we propose a temporal aggregation decoder that fits seamlessly into the mask-classification paradigm for VSS. Utilizing temporal-sensitive multi-level queries, our method achieves state-of-the-art performance on the latest challenging VSS benchmark VSPW without bells and whistles.


title: Vision-based Analysis of Driver Activity and Driving Performance Under the Influence of Alcohol

abstract: About 30% of all traffic crash fatalities in the United States involve drunk drivers, making the prevention of drunk driving paramount to vehicle safety in the US and other locations which have a high prevalence of driving while under the influence of alcohol. Driving impairment can be monitored through active use of sensors (when drivers are asked to engage in providing breath samples to a vehicle instrument or when pulled over by a police officer), but a more passive and robust mechanism of sensing may allow for wider adoption and benefit of intelligent systems that reduce drunk driving accidents. This could assist in identifying impaired drivers before they drive, or early in the driving process (before a crash or detection by law enforcement). In this research, we introduce a study which adopts a multi-modal ensemble of visual, thermal, audio, and chemical sensors to (1) examine the impact of acute alcohol administration on driving performance in a driving simulator, and (2) identify data-driven methods for detecting driving under the influence of alcohol. We describe computer vision and machine learning models for analyzing the driver's face in thermal imagery, and introduce a pipeline for training models on data collected from drivers with a range of breath-alcohol content levels, including discussion of relevant machine learning phenomena which can help in future experiment design for related studies.


title: Empowering Visually Impaired Individuals: A Novel Use of Apple Live Photos and Android Motion Photos

abstract: Numerous applications have been developed to assist visually impaired individuals that employ a machine learning unit to process visual input. However, a critical challenge with these applications is the sub-optimal quality of images captured by the users. Given the complexity of operating a camera for visually impaired individuals, we advocate for the use of Apple Live Photos and Android Motion Photos technologies. In this study, we introduce a straightforward methodology to evaluate and contrast the efficacy of Live/Motion Photos against traditional image-based approaches. Our findings reveal that both Live Photos and Motion Photos outperform single-frame images in common visual assisting tasks, specifically in object classification and VideoQA. We validate our results through extensive experiments on the ORBIT dataset, which consists of videos collected by visually impaired individuals. Furthermore, we conduct a series of ablation studies to delve deeper into the impact of deblurring and longer temporal crops.


title: USM-SCD: Multilingual Speaker Change Detection Based on Large Pretrained Foundation Models

abstract: We introduce a multilingual speaker change detection model (USM-SCD) that can simultaneously detect speaker turns and perform ASR for 96 languages. This model is adapted from a speech foundation model trained on a large quantity of supervised and unsupervised data, demonstrating the utility of fine-tuning from a large generic foundation model for a downstream task. We analyze the performance of this multilingual speaker change detection model through a series of ablation studies. We show that the USM-SCD model can achieve more than 75% average speaker change detection F1 score across a test set that consists of data from 96 languages. On American English, the USM-SCD model can achieve an 85.8% speaker change detection F1 score across various public and internal test sets, beating the previous monolingual baseline model by 21% relative. We also show that we only need to fine-tune one-quarter of the trainable model parameters to achieve the best model performance. The USM-SCD model exhibits state-of-the-art ASR quality compared with a strong public ASR baseline, making it suitable to handle both tasks with negligible additional computational cost.


title: On the dual representations of Laplace transforms of Markov processes

abstract: We provide a general framework for dual representations of Laplace transforms of Markov processes. Such representations state that the Laplace transform of a finite-dimensional distribution of a Markov process can be expressed in terms of a Laplace transform involving another Markov process, but with coefficients in the Laplace transform and time indices of the process interchanged. Dual representations of Laplace transforms have been used recently to study open ASEP and to describe stationary measures of the open KPZ equation. Our framework covers both recently discovered examples in the literature as well as several new ones, involving general L\'evy processes and certain birth-and-death processes.


title: A linearization map for genuine equivariant algebraic $K$-theory

abstract: We introduce a version of algebraic $K$-theory for coefficient systems of rings which is valued in genuine $G$-spectra for a finite group $G$. We use this construction to build a genuine $G$-spectrum $K_G(\underline{\mathbb{Z}[\pi_1(X)]})$ associated to a $G$-space $X$, which provides a home for equivariant versions of classical invariants like the Wall finiteness obstruction. We provide a comparison between our $K$-theory spectrum and the equivariant $A$-theory of Malkiewich--Merling via a genuine equivariant linearization map.


title: Determinants of successful mitigation in coupled social-climate dynamics

abstract: Understanding the impact of human behavior is crucial for successful mitigation of climate change across the globe. To shed light onto this issue, here we couple the forest dieback model with human behaviors. Using evolutionary game theory, we build a time-delay system where forest growth is impacted by both temperature and human mitigation choices, the latter being informed by temperature forecasts. Simulations of the coupled system over 200 years show us the varying outcomes: forest dies out and no one is a mitigator, forest dies out and everyone is a mitigator, or the forest survives and everyone is a mitigator. There exist rare cases where no one is a mitigator and yet the forest survives, but with a low coverage. We also find occasional oscillations where the proportion of mitigators vary between 0 and 1. Our results are based on simple models but have profound insights into determinants of behavior changes desired in social-climate dynamics.


title: Comparative Assessment of Markov Models and Recurrent Neural Networks for Jazz Music Generation

abstract: As generative models have risen in popularity, a domain that has risen alongside is generative models for music. Our study aims to compare the performance of a simple Markov chain model and a recurrent neural network (RNN) model, two popular models for sequence generating tasks, in jazz music improvisation. While music, especially jazz, remains subjective in telling whether a composition is "good" or "bad", we aim to quantify our results using metrics of groove pattern similarity and pitch class histogram entropy. We trained both models using transcriptions of jazz blues choruses from professional jazz players, and also fed musical jazz seeds to help give our model some context in beginning the generation. Our results show that the RNN outperforms the Markov model on both of our metrics, indicating better rhythmic consistency and tonal stability in the generated music. Through the use of music21 library, we tokenized our jazz dataset into pitches and durations that our model could interpret and train on. Our findings contribute to the growing field of AI-generated music, highlighting the important use of metrics to assess generation quality. Future work includes expanding the dataset of MIDI files to a larger scale, conducting human surveys for subjective evaluations, and incorporating additional metrics to address the challenge of subjectivity in music evaluation. Our study provides valuable insight into the use of recurrent neural networks for sequential based tasks like generating music.


title: Properties of stable ensembles of Euclidean random matrices

abstract: We study the spectrum of a system of coupled disordered harmonic oscillators in the thermodynamic limit. This Euclidean random matrix ensemble has been suggested as model for the low-temperature vibrational properties of glass. Exact numerical diagonalization is performed in three and two spatial dimensions, which is accompanied by a detailed finite size analysis. It reveals a low-frequency regime of sound waves that are damped by Rayleigh scattering. At large frequencies localized modes exist. In between, the central peak in the vibrational density of states is well described by Wigner's semicircle law for not too large disorder, as is expected for simple random matrix systems. We compare our results with predictions from two recent self-consistent field theories.


title: Uniform Distribution Technique for Neutrino Beam Scan Simulation

abstract: In Fermilab's neutrino facilities such as the Neutrinos at the Main Injector (NuMI) and the upcoming Long Baseline Neutrino Facility (LBNF), a proton beam strikes high-power target, producing positively and negatively charged pions and kaons. There is a need for detailed simulations in order to capture all particle interactions and beam propagation from protons on target to short-lived mesons decaying into muons and neutrinos. The generation of individual beam simulations is a resource-intensive and time-consuming process. In this paper, we describe a method through which many simulation samples with high statistics can be generated to study the effects of beam scan across a target for given beam configurations.


title: AV2Wav: Diffusion-Based Re-synthesis from Continuous Self-supervised Features for Audio-Visual Speech Enhancement

abstract: Speech enhancement systems are typically trained using pairs of clean and noisy speech. In audio-visual speech enhancement (AVSE), there is not as much ground-truth clean data available; most audio-visual datasets are collected in real-world environments with background noise and reverberation, hampering the development of AVSE. In this work, we introduce AV2Wav, a resynthesis-based audio-visual speech enhancement approach that can generate clean speech despite the challenges of real-world training data. We obtain a subset of nearly clean speech from an audio-visual corpus using a neural quality estimator, and then train a diffusion model on this subset to generate waveforms conditioned on continuous speech representations from AV-HuBERT with noise-robust training. We use continuous rather than discrete representations to retain prosody and speaker information. With this vocoding task alone, the model can perform speech enhancement better than a masking-based baseline. We further fine-tune the diffusion model on clean/noisy utterance pairs to improve the performance. Our approach outperforms a masking-based baseline in terms of both automatic metrics and a human listening test and is close in quality to the target speech in the listening test. Audio samples can be found at https://home.ttic.edu/~jcchou/demo/avse/avse_demo.html.


title: All-dielectric high-Q dynamically tunable transmissive metasurfaces

abstract: Active metasurfaces, which are arrays of actively tunable resonant elements, can dynamically control the wavefront of the scattered light at a subwavelength scale. To date, most active metasurfaces that enable dynamic wavefront shaping operate in reflection. On the other hand, active metasurfaces operating in transmission are of considerable interest as they can readily be integrated with chip-scale light sources, yielding ultra-compact wavefront shaping devices. Here, we report designs for all-dielectric low-loss active metasurfaces which can dynamically manipulate the transmitted light wavefront in the near-infrared wavelength range. Our active metasurfaces feature an array of amorphous silicon (a-Si) pillars on a silica substate, which support resonances with quality factors (Q-factors) as high as 9800, as well as other lower-Q resonances. First, we demonstrate that high-Q resonance dips observed in transmission can be transformed into a transmission resonance peak by positioning a-Si pillar resonators at a prescribed distance from a crystalline Si substrate, defined by a silica spacer layer. Next, we report the design of metasurface geometry with realistic interconnect architectures that enable thermo-optic dynamic beam switching with switching times as low as 7.3 {\mu}s. Beam switching is observed for refractive index differences between neighboring metasurface elements as low as 0.0026. Finally, we demonstrate that metasurface structures with both high-Q and lower-Q modes and realistic interconnect architectures can be used for dynamic beam steering.


title: A substitutional quantum defect in WS$_2$ discovered by high-throughput computational screening and fabricated by site-selective STM manipulation

abstract: Point defects in two-dimensional materials are of key interest for quantum information science. However, the space of possible defects is immense, making the identification of high-performance quantum defects extremely challenging. Here, we perform high-throughput (HT) first-principles computational screening to search for promising quantum defects within WS$_2$, which present localized levels in the band gap that can lead to bright optical transitions in the visible or telecom regime. Our computed database spans more than 700 charged defects formed through substitution on the tungsten or sulfur site. We found that sulfur substitutions enable the most promising quantum defects. We computationally identify the neutral cobalt substitution to sulfur (Co$_{\rm S}^{0}$) as very promising and fabricate it with scanning tunneling microscopy (STM). The Co$_{\rm S}^{0}$ electronic structure measured by STM agrees with first principles and showcases an attractive new quantum defect. Our work shows how HT computational screening and novel defect synthesis routes can be combined to design new quantum defects.


title: Depth Estimation from a Single Optical Encoded Image using a Learned Colored-Coded Aperture

abstract: Depth estimation from a single image of a conventional camera is a challenging task since depth cues are lost during the acquisition process. State-of-the-art approaches improve the discrimination between different depths by introducing a binary-coded aperture (CA) in the lens aperture that generates different coded blur patterns at different depths. Color-coded apertures (CCA) can also produce color misalignment in the captured image which can be utilized to estimate disparity. Leveraging advances in deep learning, more recent works have explored the data-driven design of a diffractive optical element (DOE) for encoding depth information through chromatic aberrations. However, compared with binary CA or CCA, DOEs are more expensive to fabricate and require high-precision devices. Different from previous CCA-based approaches that employ few basic colors, in this work we propose a CCA with a greater number of color filters and richer spectral information to optically encode relevant depth information in a single snapshot. Furthermore, we propose to jointly learn the color-coded aperture (CCA) pattern and a convolutional neural network (CNN) to retrieve depth information by using an end-to-end optimization approach. We demonstrate through different experiments on three different data sets that the designed color-encoding has the potential to remove depth ambiguities and provides better depth estimates compared to state-of-the-art approaches. Additionally, we build a low-cost prototype of our CCA using a photographic film and validate the proposed approach in real scenarios.


title: Improved Small-Signal L2 Gain Analysis for Nonlinear Systems

abstract: The L2-gain characterizes a dynamical system's input-output properties and is used for important control methods, like H-infinity control. However, gain can be difficult to determine for nonlinear systems. Previous work designed a nonconvex optimization problem to simultaneously search for a continuous piecewise affine (CPA) storage function and an upper bound on the small-signal L2-gain of a dynamical system over a triangulated region about the origin. This work improves upon those results to establish a tighter upper-bound on a system's gain through a convex optimization problem. By reformulating the relationship between the Hamilton-Jacobi equations and gain as a linear matrix inequality (LMI) and then developing novel LMI error bounds for a triangulation, tighter gain bounds are derived and computed more efficiently. Numerical results demonstrate the less conservative upper bound on a dynamical system's gain.


title: Interpretability-Aware Vision Transformer

abstract: Vision Transformers (ViTs) have become prominent models for solving various vision tasks. However, the interpretability of ViTs has not kept pace with their promising performance. While there has been a surge of interest in developing {\it post hoc} solutions to explain ViTs' outputs, these methods do not generalize to different downstream tasks and various transformer architectures. Furthermore, if ViTs are not properly trained with the given data and do not prioritize the region of interest, the {\it post hoc} methods would be less effective. Instead of developing another {\it post hoc} approach, we introduce a novel training procedure that inherently enhances model interpretability. Our interpretability-aware ViT (IA-ViT) draws inspiration from a fresh insight: both the class patch and image patches consistently generate predicted distributions and attention maps. IA-ViT is composed of a feature extractor, a predictor, and an interpreter, which are trained jointly with an interpretability-aware training objective. Consequently, the interpreter simulates the behavior of the predictor and provides a faithful explanation through its single-head self-attention mechanism. Our comprehensive experimental results demonstrate the effectiveness of IA-ViT in several image classification tasks, with both qualitative and quantitative evaluations of model performance and interpretability. Source code is available from: https://github.com/qiangyao1988/IA-ViT.


title: BEA: Revisiting anchor-based object detection DNN using Budding Ensemble Architecture

abstract: This paper introduces the Budding Ensemble Architecture (BEA), a novel reduced ensemble architecture for anchor-based object detection models. Object detection models are crucial in vision-based tasks, particularly in autonomous systems. They should provide precise bounding box detections while also calibrating their predicted confidence scores, leading to higher-quality uncertainty estimates. However, current models may make erroneous decisions due to false positives receiving high scores or true positives being discarded due to low scores. BEA aims to address these issues. The proposed loss functions in BEA improve the confidence score calibration and lower the uncertainty error, which results in a better distinction of true and false positives and, eventually, higher accuracy of the object detection models. Both Base-YOLOv3 and SSD models were enhanced using the BEA method and its proposed loss functions. The BEA on Base-YOLOv3 trained on the KITTI dataset results in a 6% and 3.7% increase in mAP and AP50, respectively. Utilizing a well-balanced uncertainty estimation threshold to discard samples in real-time even leads to a 9.6% higher AP50 than its base model. This is attributed to a 40% increase in the area under the AP50-based retention curve used to measure the quality of calibration of confidence scores. Furthermore, BEA-YOLOV3 trained on KITTI provides superior out-of-distribution detection on Citypersons, BDD100K, and COCO datasets compared to the ensembles and vanilla models of YOLOv3 and Gaussian-YOLOv3.


title: Gain and Phase: Decentralized Stability Conditions for Power Electronics-Dominated Power Systems

abstract: This paper proposes decentralized stability conditions for multi-converter systems based on the combination of the small gain theorem and the small phase theorem. Instead of directly computing the closed-loop dynamics, e.g., eigenvalues of the state-space matrix, or using the generalized Nyquist stability criterion, the proposed stability conditions are more scalable and computationally lighter, which aim at evaluating the closed-loop system stability by comparing the individual converter dynamics with the network dynamics in a decentralized and open-loop manner. Moreover, our approach can handle heterogeneous converters' dynamics and is suitable to analyze large-scale multi-converter power systems that contain grid-following (GFL), grid-forming (GFM) converters, and synchronous generators. Compared with other decentralized stability conditions, e.g., passivity-based stability conditions, the proposed conditions are significantly less conservative and can be generally satisfied in practice across the whole frequency range.


title: Efficient Rotating Synthetic Aperture Radar Imaging via Robust Sparse Array Synthesis

abstract: Rotating Synthetic Aperture Radar (ROSAR) can generate a 360$^\circ$ image of its surrounding environment using the collected data from a single moving track. Due to its non-linear track, the Back-Projection Algorithm (BPA) is commonly used to generate SAR images in ROSAR. Despite its superior imaging performance, BPA suffers from high computation complexity, restricting its application in real-time systems. In this paper, we propose an efficient imaging method based on robust sparse array synthesis. It first conducts range-dimension matched filtering, followed by azimuth-dimension matched filtering using a selected sparse aperture and filtering weights. The aperture and weights are computed offline in advance to ensure robustness to array manifold errors induced by the imperfect radar rotation. We introduce robust constraints on the main-lobe and sidelobe levels of filter design. The resultant robust sparse array synthesis problem is a non-convex optimization problem with quadratic constraints. An algorithm based on feasible point pursuit and successive convex approximation is devised to solve the optimization problem. Extensive simulation study and experimental evaluations using a real-world hardware platform demonstrate that the proposed algorithm can achieve image quality comparable to that of BPA, but with a substantial reduction in computational time up to 90%.


title: Flexible Functional Treatment Effect Estimation

abstract: We study treatment effect estimation with functional treatments where the average potential outcome functional is a function of functions, in contrast to continuous treatment effect estimation where the target is a function of real numbers. By considering a flexible scalar-on-function marginal structural model, a weight-modified kernel ridge regression (WMKRR) is adopted for estimation. The weights are constructed by directly minimizing the uniform balancing error resulting from a decomposition of the WMKRR estimator, instead of being estimated under a particular treatment selection model. Despite the complex structure of the uniform balancing error derived under WMKRR, finite-dimensional convex algorithms can be applied to efficiently solve for the proposed weights thanks to a representer theorem. The optimal convergence rate is shown to be attainable by the proposed WMKRR estimator without any smoothness assumption on the true weight function. Corresponding empirical performance is demonstrated by a simulation study and a real data application.


title: Gradient based Grasp Pose Optimization on a NeRF that Approximates Grasp Success

abstract: Current robotic grasping methods often rely on estimating the pose of the target object, explicitly predicting grasp poses, or implicitly estimating grasp success probabilities. In this work, we propose a novel approach that directly maps gripper poses to their corresponding grasp success values, without considering objectness. Specifically, we leverage a Neural Radiance Field (NeRF) architecture to learn a scene representation and use it to train a grasp success estimator that maps each pose in the robot's task space to a grasp success value. We employ this learned estimator to tune its inputs, i.e., grasp poses, by gradient-based optimization to obtain successful grasp poses. Contrary to other NeRF-based methods which enhance existing grasp pose estimation approaches by relying on NeRF's rendering capabilities or directly estimate grasp poses in a discretized space using NeRF's scene representation capabilities, our approach uniquely sidesteps both the need for rendering and the limitation of discretization. We demonstrate the effectiveness of our approach on four simulated 3DoF (Degree of Freedom) robotic grasping tasks and show that it can generalize to novel objects. Our best model achieves an average translation error of 3mm from valid grasp poses. This work opens the door for future research to apply our approach to higher DoF grasps and real-world scenarios.


title: Continuous-variable quantum key distribution over multispan links employing phase-insensitive and phase-sensitive amplifiers

abstract: Transmission losses through optical fibers are one of the main obstacles preventing both long-distance quantum communications and continuous-variable quantum key distribution. Optical amplification provides a tool to obtain, at least partially, signal restoration. In this work, we address a key distribution protocol over a multispan link employing either phase-insensitive or phase-sensitive amplifiers, considering Gaussian modulation of coherent states followed by homodyne detection at the receiver's side. We perform the security analysis under both unconditional and composable security frameworks by assuming in the latter case only a single span of the whole communication link to be untrusted. We compare the resulting key generation rate for both kinds of amplified links with the no-amplifier protocol, identifying the enhancement introduced by optical amplification.


title: Towards Large-scale Building Attribute Mapping using Crowdsourced Images: Scene Text Recognition on Flickr and Problems to be Solved

abstract: Crowdsourced platforms provide huge amounts of street-view images that contain valuable building information. This work addresses the challenges in applying Scene Text Recognition (STR) in crowdsourced street-view images for building attribute mapping. We use Flickr images, particularly examining texts on building facades. A Berlin Flickr dataset is created, and pre-trained STR models are used for text detection and recognition. Manual checking on a subset of STR-recognized images demonstrates high accuracy. We examined the correlation between STR results and building functions, and analysed instances where texts were recognized on residential buildings but not on commercial ones. Further investigation revealed significant challenges associated with this task, including small text regions in street-view images, the absence of ground truth labels, and mismatches in buildings in Flickr images and building footprints in OpenStreetMap (OSM). To develop city-wide mapping beyond urban hotspot locations, we suggest differentiating the scenarios where STR proves effective while developing appropriate algorithms or bringing in additional data for handling other cases. Furthermore, interdisciplinary collaboration should be undertaken to understand the motivation behind building photography and labeling. The STR-on-Flickr results are publicly available at https://github.com/ya0-sun/STR-Berlin.


title: On Prediction Feature Assignment in the Heckman Selection Model

abstract: Under missing-not-at-random (MNAR) sample selection bias, the performance of a prediction model is often degraded. This paper focuses on one classic instance of MNAR sample selection bias where a subset of samples have non-randomly missing outcomes. The Heckman selection model and its variants have commonly been used to handle this type of sample selection bias. The Heckman model uses two separate equations to model the prediction and selection of samples, where the selection features include all prediction features. When using the Heckman model, the prediction features must be properly chosen from the set of selection features. However, choosing the proper prediction features is a challenging task for the Heckman model. This is especially the case when the number of selection features is large. Existing approaches that use the Heckman model often provide a manually chosen set of prediction features. In this paper, we propose Heckman-FA as a novel data-driven framework for obtaining prediction features for the Heckman model. Heckman-FA first trains an assignment function that determines whether or not a selection feature is assigned as a prediction feature. Using the parameters of the trained function, the framework extracts a suitable set of prediction features based on the goodness-of-fit of the prediction model given the chosen prediction features and the correlation between noise terms of the prediction and selection equations. Experimental results on real-world datasets show that Heckman-FA produces a robust regression model under MNAR sample selection bias.


title: How many Neurons do we need? A refined Analysis for Shallow Networks trained with Gradient Descent

abstract: We analyze the generalization properties of two-layer neural networks in the neural tangent kernel (NTK) regime, trained with gradient descent (GD). For early stopped GD we derive fast rates of convergence that are known to be minimax optimal in the framework of non-parametric regression in reproducing kernel Hilbert spaces. On our way, we precisely keep track of the number of hidden neurons required for generalization and improve over existing results. We further show that the weights during training remain in a vicinity around initialization, the radius being dependent on structural assumptions such as degree of smoothness of the regression function and eigenvalue decay of the integral operator associated to the NTK.


title: Traveling Waves Encode the Recent Past and Enhance Sequence Learning

abstract: Traveling waves of neural activity have been observed throughout the brain at a diversity of regions and scales; however, their precise computational role is still debated. One physically inspired hypothesis suggests that the cortical sheet may act like a wave-propagating system capable of invertibly storing a short-term memory of sequential stimuli through induced waves traveling across the cortical surface, and indeed many experimental results from neuroscience correlate wave activity with memory tasks. To date, however, the computational implications of this idea have remained hypothetical due to the lack of a simple recurrent neural network architecture capable of exhibiting such waves. In this work, we introduce a model to fill this gap, which we denote the Wave-RNN (wRNN), and demonstrate how such an architecture indeed efficiently encodes the recent past through a suite of synthetic memory tasks where wRNNs learn faster and reach significantly lower error than wave-free counterparts. We further explore the implications of this memory storage system on more complex sequence modeling tasks such as sequential image classification and find that wave-based models not only again outperform comparable wave-free RNNs while using significantly fewer parameters, but additionally perform comparably to more complex gated architectures such as LSTMs and GRUs.


title: Studying the Equilibrium Points of the Modified Circular Restricted Three-Body Problem: the Case of Sun-Haumea System

abstract: We intend to study a modified version of the planar Circular Restricted Three-Body Problem (CRTBP) by incorporating several perturbing parameters. We consider the bigger primary as an oblate spheroid and emitting radiation while the small primary has an elongated body. We also consider the perturbation from a disk-like structure encompassing this three-body system. First, we develop a mathematical model of this modified CRTBP. We have found there exist five equilibrium points in this modified CRTBP model, where three of them are collinear and the other two are non-collinear. Second, we apply our modified CRTBP model to the Sun-Haumea system by considering several values of each perturbing parameter. Through our numerical investigation, we have discovered that the incorporation of perturbing parameters has resulted in a shift in the equilibrium point positions of the Sun-Haumea system compared to their positions in the classical CRTBP. The stability of equilibrium points is investigated. We have shown that the collinear equilibrium points are unstable and the stability of non-collinear equilibrium points depends on the mass parameter $\mu$ of the system. Unlike the classical case, non-collinear equilibrium points have both a maximum and minimum limit of $\mu$ for achieving stability. We remark that the stability range of $\mu$ in non-collinear equilibrium points depends on the perturbing parameters. In context of the Sun-Haumea system, we have found that the non-collinear equilibrium points are stable.


title: Bias in News Summarization: Measures, Pitfalls and Corpora

abstract: Summarization is an important application of large language models (LLMs). Most previous evaluation of summarization models has focused on their content selection, faithfulness, grammaticality and coherence. However, it is well known that LLMs can reproduce and reinforce harmful social biases. This raises the question: Do biases affect model outputs in a constrained setting like summarization? To help answer this question, we first motivate and introduce a number of definitions for biased behaviours in summarization models, along with practical operationalizations. Since we find that biases inherent to input documents can confound bias analysis in summaries, we propose a method to generate input documents with carefully controlled demographic attributes. This allows us to study summarizer behavior in a controlled setting, while still working with realistic input documents. We measure gender bias in English summaries generated by both purpose-built summarization models and general purpose chat models as a case study. We find content selection in single document summarization to be largely unaffected by gender bias, while hallucinations exhibit evidence of bias. To demonstrate the generality of our approach, we additionally investigate racial bias, including intersectional settings.


title: Padding Aware Neurons

abstract: Convolutional layers are a fundamental component of most image-related models. These layers often implement by default a static padding policy (\eg zero padding), to control the scale of the internal representations, and to allow kernel activations centered on the border regions. In this work we identify Padding Aware Neurons (PANs), a type of filter that is found in most (if not all) convolutional models trained with static padding. PANs focus on the characterization and recognition of input border location, introducing a spatial inductive bias into the model (e.g., how close to the input's border a pattern typically is). We propose a method to identify PANs through their activations, and explore their presence in several popular pre-trained models, finding PANs on all models explored, from dozens to hundreds. We discuss and illustrate different types of PANs, their kernels and behaviour. To understand their relevance, we test their impact on model performance, and find padding and PANs to induce strong and characteristic biases in the data. Finally, we discuss whether or not PANs are desirable, as well as the potential side effects of their presence in the context of model performance, generalisation, efficiency and safety.


title: VoicePAT: An Efficient Open-source Evaluation Toolkit for Voice Privacy Research

abstract: Speaker anonymization is the task of modifying a speech recording such that the original speaker cannot be identified anymore. Since the first Voice Privacy Challenge in 2020, along with the release of a framework, the popularity of this research topic is continually increasing. However, the comparison and combination of different anonymization approaches remains challenging due to the complexity of evaluation and the absence of user-friendly research frameworks. We therefore propose an efficient speaker anonymization and evaluation framework based on a modular and easily extendable structure, almost fully in Python. The framework facilitates the orchestration of several anonymization approaches in parallel and allows for interfacing between different techniques. Furthermore, we propose modifications to common evaluation methods which improves the quality of the evaluation and reduces their computation time by 65 to 95%, depending on the metric. Our code is fully open source.


title: Robust Control Barrier Functions for Sampled-Data Systems

abstract: This paper studies the problem of safe control of sampled-data systems under bounded disturbance and measurement errors with piecewise-constant controllers. To achieve this, we first propose the High-Order Doubly Robust Control Barrier Function (HO-DRCBF) for continuous-time systems where the safety enforcing constraint is of relative degree 1 or higher. We then extend this formulation to sampled-data systems with piecewise-constant controllers by bounding the evolution of the system state over the sampling period given a state estimate at the beginning of the sampling period. We demonstrate the proposed approach on a kinematic obstacle avoidance problem for wheeled robots using a unicycle model. We verify that with the proposed approach, the system does not violate the safety constraints in the presence of bounded disturbance and measurement errors.


title: Retrieval-Augmented Text-to-Audio Generation

abstract: Despite recent progress in text-to-audio (TTA) generation, we show that the state-of-the-art models, such as AudioLDM, trained on datasets with an imbalanced class distribution, such as AudioCaps, are biased in their generation performance. Specifically, they excel in generating common audio classes while underperforming in the rare ones, thus degrading the overall generation performance. We refer to this problem as long-tailed text-to-audio generation. To address this issue, we propose a simple retrieval-augmented approach for TTA models. Specifically, given an input text prompt, we first leverage a Contrastive Language Audio Pretraining (CLAP) model to retrieve relevant text-audio pairs. The features of the retrieved audio-text data are then used as additional conditions to guide the learning of TTA models. We enhance AudioLDM with our proposed approach and denote the resulting augmented system as Re-AudioLDM. On the AudioCaps dataset, Re-AudioLDM achieves a state-of-the-art Frechet Audio Distance (FAD) of 1.37, outperforming the existing approaches by a large margin. Furthermore, we show that Re-AudioLDM can generate realistic audio for complex scenes, rare audio classes, and even unseen audio types, indicating its potential in TTA tasks.


title: A Bayesian approach to breaking things: efficiently predicting and repairing failure modes via sampling

abstract: Before autonomous systems can be deployed in safety-critical applications, we must be able to understand and verify the safety of these systems. For cases where the risk or cost of real-world testing is prohibitive, we propose a simulation-based framework for a) predicting ways in which an autonomous system is likely to fail and b) automatically adjusting the system's design to preemptively mitigate those failures. We frame this problem through the lens of approximate Bayesian inference and use differentiable simulation for efficient failure case prediction and repair. We apply our approach on a range of robotics and control problems, including optimizing search patterns for robot swarms and reducing the severity of outages in power transmission networks. Compared to optimization-based falsification techniques, our method predicts a more diverse, representative set of failure modes, and we also find that our use of differentiable simulation yields solutions that have up to 10x lower cost and requires up to 2x fewer iterations to converge relative to gradient-free techniques. Code and videos can be found at https://mit-realm.github.io/breaking-things/


title: High-fidelity 3D Reconstruction of Solar Coronal Physics with the Updated CROBAR Method

abstract: We present an extension of the Coronal Reconstruction Onto B-Aligned Regions (CROBAR) method to Linear Force Free Field (LFFF) extrapolations, and apply it to the reconstruction of a set of AIA, MDI, and STEREO EUVI data. The results demonstrate that CROBAR can not only reconstruct coronal emission structures, but also that it can help constrain the coronal field extrapolations via the LFFF's helicity $\alpha$ parameter. They also provide a real-world example of how CROBAR can easily incorporate information from multiple perspectives to improve its reconstructions, and we also use the additional perspectives to help validate the reconstructions. We furthermore touch on the use of real-world emission passbands rather than idealized power-law type ones using DEMs. We conclude with a comparison of CROBAR generated emission to observed emission and those produced with idealized DEM based power-laws. These results further illustrate the promise of CROBAR for real-world applications, and we make available a preliminary release of the software available for download.


title: Permutation Capacity Region of Adder Multiple-Access Channels

abstract: Point-to-point permutation channels are useful models of communication networks and biological storage mechanisms and have received theoretical attention in recent years. Propelled by relevant advances in this area, we analyze the permutation adder multiple-access channel (PAMAC) in this work. In the PAMAC network model, $d$ senders communicate with a single receiver by transmitting $p$-ary codewords through an adder multiple-access channel whose output is subsequently shuffled by a random permutation block. We define a suitable notion of permutation capacity region $\mathcal{C}_\mathsf{perm}$ for this model, and establish that $\mathcal{C}_\mathsf{perm}$ is the simplex consisting of all rate $d$-tuples that sum to $d(p - 1) / 2$ or less. We achieve this sum-rate by encoding messages as i.i.d. samples from categorical distributions with carefully chosen parameters, and we derive an inner bound on $\mathcal{C}_\mathsf{perm}$ by extending the concept of time sharing to the permutation channel setting. Our proof notably illuminates various connections between mixed-radix numerical systems and coding schemes for multiple-access channels. Furthermore, we derive an alternative inner bound on $\mathcal{C}_\mathsf{perm}$ for the binary PAMAC by analyzing the root stability of the probability generating function of the adder's output distribution. Using eigenvalue perturbation results, we obtain error bounds on the spectrum of the probability generating function's companion matrix, providing quantitative estimates of decoding performance. Finally, we obtain a converse bound on $\mathcal{C}_\mathsf{perm}$ matching our achievability result.


title: Asymptotics of maximum distance minimizers

abstract: We study the limiting behavior of $r$-maximum distance minimizers and the asymptotics of their $1$-dimensional Hausdorff measures as $r$ tends to zero in several contexts, including situations involving objects of fractal nature.


title: Exact Foldy-Wouthuysen transformation for a Dirac equation describing the interaction of spin-1/2 relativistic particles with an external electromagnetic field

abstract: The Thomas-Bargmann-Michel-Telegdi (T-BMT) equation is derived using the Exact Foldy-Wouthuysen transformation. Extra new terms were found, and we discuss their possible physical applications. The main point of this work is to detail the procedure to get the general result. We explicitly present the choice of parametrization we used on the initial Hamiltonian and the motivations to take it. We emphasize that the final equations can depend on this choice, and it is possible to prevent the manipulations of the quadratic Hamiltonian become extremely cumbersome. More importantly, it is done in such a way that the transformed equations allow the direct separation into mass, kinetic, and interaction correction terms to the original T-BMT equation.


title: Mean values of long Dirichlet polynomials with divisor coefficients

abstract: In this article, we prove an asymptotic formula for the mean value of long smoothed Dirichlet polynomials with divisor coefficients. Our result has a main term that includes all lower order terms and a power saving error term. This is derived from a more general theorem on mean values of long smoothed Dirichlet polynomials that was previously established by the second and third authors. We thus establish a stronger form of a conjecture of Conrey and Gonek in the case of divisor functions.


title: Unleashing the Adversarial Facet of Software Debloating

abstract: Software debloating techniques are applied to craft a specialized version of the program based on the user's requirements and remove irrelevant code accordingly. The debloated programs presumably maintain better performance and reduce the attack surface in contrast to the original programs. This work unleashes the effectiveness of applying software debloating techniques on the robustness of machine learning systems in the malware classification domain. We empirically study how an adversarial can leverage software debloating techniques to mislead machine learning malware classification models. We apply software debloating techniques to generate adversarial examples and demonstrate these adversarial examples can reduce the detection rate of VirusTotal. Our study opens new directions for research into adversarial machine learning not only in malware detection/classification but also in other software domains.


title: Cellular automata in $d$ dimensions and ground states of spin models in $(d+1)$ dimensions

abstract: We show how the trajectories of $d$-dimensional cellular automata (CA) can be used to determine the ground states of $(d+1)$-dimensional classical spin models, and we characterise their quantum phase transition, when in the presence of a transverse magnetic field. For each of the 256 one-dimensional elementary CA we explicitly construct the simplest local two-dimensional classical spin model associated to the given CA, and we also describe this method for $d>1$ through selected examples. We illustrate our general observations with detailed studies of: (i) the $d=1$ CA Rule 150 and its $d=2$ four-body plaquette spin model, (ii) the $d=2$ CA whose associated model is the $d=3$ square-pyramid plaquette model, and (iii) two counter-propagating $d=1$ Rule 60 CA that correspond to the two-dimensional Baxter-Wu spin model. For the quantum spin models, we show that the connection to CAs implies a sensitivity on the approach to the thermodynamic limit via finite size scaling for their quantum phase transitions.


title: DDSP-SFX: Acoustically-guided sound effects generation with differentiable digital signal processing

abstract: Controlling the variations of sound effects using neural audio synthesis models has been a difficult task. Differentiable digital signal processing (DDSP) provides a lightweight solution that achieves high-quality sound synthesis while enabling deterministic acoustic attribute control by incorporating pre-processed audio features and digital synthesizers. In this research, we introduce DDSP-SFX, a model based on the DDSP architecture capable of synthesizing high-quality sound effects while enabling users to control the timbre variations easily. We propose a transient modelling technique with higher objective evaluation scores and subjective ratings over impulsive signals (footsteps, gunshots). We propose a simple method that achieves timbre variation control while also allowing deterministic attribute control. We further qualitatively show the timbre transfer performance using voice as the guiding sound.


title: Density Analysis for coupled forward-backward SDEs with non-Lipschitz drifts and Applications

abstract: We explore the existence of a continuous marginal law with respect to the Lebesgue measure for each component $(X,Y,Z)$ of the solution to coupled quadratic forward-backward stochastic differential equations (QFBSDEs) {for which the drift coefficient of the forward component is either bounded and measurable or H\"older continuous. Our approach relies on a combination of the existence of a weak {\it decoupling field} (see \cite{Delarue2}), the integration with respect to space time local time (see \cite{Ein2006}), the analysis of the backward Kolmogorov equation associated to the forward component along with an It\^o-Tanaka trick (see \cite{FlanGubiPrio10})}. The framework of this paper is beyond all existing papers on density analysis for Markovian BSDEs and constitutes a major refinement of the existing results. We also derive a comonotonicity theorem for the control variable in this frame and thus extending the works \cite{ChenKulWei05}, \cite{DosDos13}. As applications of our results, we first analyse the regularity of densities of solution to coupled FBSDEs. In the second example, we consider a regime switching term structure interest rate models (see for e.g., \cite{ChenMaYin17}) for which the corresponding FBSDE has discontinuous drift. Our results enables us to: firstly study classical and Malliavin differentiability of the solutions for such models, secondly the existence of density of such solutions. Lastly we consider a pricing and hedging problem of contingent claims on non-tradable underlying, when the dynamic of the latter is given by a regime switching SDE (i.e., the drift coefficient is allowed to be discontinuous). We obtain a representation of the derivative hedge as the weak derivative of the indifference price function, thus extending the result in \cite{ArImDR10}.


title: Using quantitative magneto-optical imaging to reveal why the ac susceptibility of superconducting films is history-independent

abstract: Measurements of the temperature-dependent ac magnetic susceptibility of superconducting films reveal reversible responses, i.e., irrespective of the magnetic and thermal history of the sample. This experimental fact is observed even in the presence of stochastic and certainly irreversible magnetic flux avalanches which, in principle, should randomly affect the results. In this work, we explain such an apparent contradiction by exploring the spatial resolution of magneto-optical imaging. To achieve this, we successfully compare standard frequency-independent first harmonic ac magnetic susceptibility results for a superconducting thin film with those obtained by ac-emulating magneto-optical imaging (acMOI). A quantitative analysis also provides information regarding flux avalanches, reveals the presence of a vortex-antivortex annihilation zone in the region in which a smooth flux front interacts with pre-established avalanches, and demonstrates that the major impact on the flux distribution within the superconductor happens during the first ac cycle. Our results establish acMOI as a reliable approach for studying frequency-independent ac field effects in superconducting thin films while capturing local aspects of flux dynamics, otherwise inaccessible via global magnetometry techniques.


title: Approximate co-sufficient sampling with regularization

abstract: In this work, we consider the problem of goodness-of-fit (GoF) testing for parametric models -- for example, testing whether observed data follows a logistic regression model. This testing problem involves a composite null hypothesis, due to the unknown values of the model parameters. In some special cases, co-sufficient sampling (CSS) can remove the influence of these unknown parameters via conditioning on a sufficient statistic -- often, the maximum likelihood estimator (MLE) of the unknown parameters. However, many common parametric settings (including logistic regression) do not permit this approach, since conditioning on a sufficient statistic leads to a powerless test. The recent approximate co-sufficient sampling (aCSS) framework of Barber and Janson (2022) offers an alternative, replacing sufficiency with an approximately sufficient statistic (namely, a noisy version of the MLE). This approach recovers power in a range of settings where CSS cannot be applied, but can only be applied in settings where the unconstrained MLE is well-defined and well-behaved, which implicitly assumes a low-dimensional regime. In this work, we extend aCSS to the setting of constrained and penalized maximum likelihood estimation, so that more complex estimation problems can now be handled within the aCSS framework, including examples such as mixtures-of-Gaussians (where the unconstrained MLE is not well-defined due to degeneracy) and high-dimensional Gaussian linear models (where the MLE can perform well under regularization, such as an $\ell_1$ penalty or a shape constraint).


title: Mathematical modeling of heterogeneous stem cell regeneration: from cell division to Waddington's epigenetic landscape

abstract: Stem cell regeneration is a crucial biological process for most self-renewing tissues during the development and maintenance of tissue homeostasis. In developing the mathematical models of stem cell regeneration and tissue development, cell division is the core process connecting different scale biological processes and leading to changes in cell population number and the epigenetic state of cells. This chapter focuses on the primary strategies for modeling cell division in biological systems. The Lagrange coordinate modeling approach considers gene network dynamics within each cell and random changes in cell states and model parameters during cell division. In contrast, the Euler coordinate modeling approach formulates the evolution of cell population numbers with the same epigenetic state via a differential-integral equation. These strategies focus on different scale dynamics, respectively, and result in two methods of modeling Waddington's epigenetic landscape: the Fokker-Planck equation and the differential-integral equation approaches. The differential-integral equation approach formulates the evolution of cell population density based on simple assumptions in cell proliferation, apoptosis, differentiation, and epigenetic state transitions during cell division. Moreover, machine learning methods can establish low-dimensional macroscopic measurements of a cell based on single-cell RNA sequencing data. The low dimensional measurements can quantify the epigenetic state of cells and become connections between static single-cell RNA sequencing data with dynamic equations for tissue development processes. The differential-integral equation presented in this chapter provides a reasonable approach to understanding the complex biological processes of tissue development and tumor progression.


title: Explosive synchronization in a turbulent reactive flow system

abstract: The occurrence of abrupt dynamical transitions in the macroscopic state of a system has received growing attention. We present experimental evidence for abrupt transition via explosive synchronization in a real-world complex system, namely a turbulent reactive flow system. In contrast to the paradigmatic continuous transition to a synchronized state from an initially desynchronized state, the system exhibits a discontinuous synchronization transition with a hysteresis. We consider the fluctuating heat release rate from the turbulent flames at each spatial location as locally coupled oscillators that are coupled to the global acoustic field in the confined system. We analyze the synchronization between these two subsystems during the transition to a state of oscillatory instability and discover that explosive synchronization occurs at the onset of oscillatory instability. Further, we explore the underlying mechanism of interaction between the subsystems and construct a mathematical model of the same.


title: Morphologically-Aware Consensus Computation via Heuristics-based IterATive Optimization (MACCHIatO)

abstract: The extraction of consensus segmentations from several binary or probabilistic masks is important to solve various tasks such as the analysis of inter-rater variability or the fusion of several neural network outputs. One of the most widely used methods to obtain such a consensus segmentation is the STAPLE algorithm. In this paper, we first demonstrate that the output of that algorithm is heavily impacted by the background size of images and the choice of the prior. We then propose a new method to construct a binary or a probabilistic consensus segmentation based on the Fr\'{e}chet means of carefully chosen distances which makes it totally independent of the image background size. We provide a heuristic approach to optimize this criterion such that a voxel's class is fully determined by its voxel-wise distance to the different masks, the connected component it belongs to and the group of raters who segmented it. We compared extensively our method on several datasets with the STAPLE method and the naive segmentation averaging method, showing that it leads to binary consensus masks of intermediate size between Majority Voting and STAPLE and to different posterior probabilities than Mask Averaging and STAPLE methods. Our code is available at https://gitlab.inria.fr/dhamzaou/jaccardmap .


title: Evaluating Direct RF Sampling Performance for RFSoC-based Radio-frequency Astronomy Receivers

abstract: As the maximum RF input and output frequencies of the integrated data converters in RFSoC increase, it becomes practical to digitize and synthesize RF signals in the majority of C band directly without analogue up and down mixing circuits. The elimination of the mixer circuits can significantly simplify the architecture of the receivers or readouts for radio astronomy telescopes. For the systems with large bandwidth or high channel counts, direct sampling can dramatically reduce the size and cost of overall system. This paper with focus on summarising part of the preliminary characterization results for direct sampling with RFSoC data converters in higher order Nyquist zones.


title: A Comparison of Two Lattice Boltzmann Models for Electrodynamics

abstract: In recent years, various Lattice Boltzmann models for electrodynamics have been developed as alternatives to classical methods such as Finite Difference Time Domain (FDTD) and Finite Element Methods (FEM). However, there has been a lack of systematic comparisons between these models. This paper addresses this gap by comparing two specific Lattice Boltzmann models, published by Mendoza and Mu\~noz (MM), and Hauser and Verhey (HV), respectively. To compare the models, we utilize time and memory as indicators, considering the same achieved error, in four standard tests: a dielectric pulse traveling through two interfaces, the skin effect, the Hertz dipole, and a dielectric pulse traveling through several interfaces. The results indicate that both methods accurately simulate the tests and exhibit convergence as the mesh is refined. However, the MM method outperforms the HV method regarding time, while its memory efficiency was lower. The modified Hauser-Verhey model demonstrates itself to be a promising alternative to the Mendoza-Mu\~noz model. These findings contribute to the ongoing development and optimization of numerical methods for electromagnetics simulations.


title: Connecting the Dots in News Analysis: Bridging the Cross-Disciplinary Disparities in Media Bias and Framing

abstract: The manifestation and effect of bias in news reporting have been central topics in the social sciences for decades, and have received increasing attention in the NLP community recently. While NLP can help to scale up analyses or contribute automatic procedures to investigate the impact of biased news in society, we argue that methodologies that are currently dominant fall short of addressing the complex questions and effects addressed in theoretical media studies. In this survey paper, we review social science approaches and draw a comparison with typical task formulations, methods, and evaluation metrics used in the analysis of media bias in NLP. We discuss open questions and suggest possible directions to close identified gaps between theory and predictive models, and their evaluation. These include model transparency, considering document-external information, and cross-document reasoning rather than single-label assignment.


title: Exploration into Optimal State Estimation with Event-triggered Communication

abstract: This paper deals with the problem of remote estimation of the state of a discrete-time stochastic linear system observed by a sensor with computational capacity to calculate local estimates. We design an event-triggered communication (ETC) scheme and a remote state estimator to optimally calibrate the tradeoff between system performance and limited communication resources. The novel communication scheme is the time-varying thresholding version for the cumulative innovation-driven communication scheme in [1], and its transmission probability is given. We derive the corresponding remote minimum mean square error (MMSE) estimator and present a tight upper bound for its MSE matrices. We also show that by employing a couple of weak assumptions, the optimality problem becomes (asymptotically) exact and can be addressed in an Markov Decision Process (MDP) framework, which delivers optimal policy and cost in an algorithmic procedure. The simulation results illustrate the effectiveness of our approach.


title: Magnetic equilibria of relativistic axisymmetric stars: The impact of flow constants

abstract: Symmetries and conservation laws associated with the ideal Einstein-Euler system, for stationary and axisymmetric stars, can be utilized to define a set of flow constants. These quantities are conserved along flow lines in the sense that their gradients are orthogonal to the four-velocity. They are also conserved along surfaces of constant magnetic flux, making them powerful tools to identify general features of neutron star equilibria. One important corollary of their existence is that mixed poloidal-toroidal fields are inconsistent with the absence of meridional flows except in some singular sense, a surprising but powerful result first proven by Bekenstein and Oron. In this work, we revisit the flow constant formalism to rederive this result together with several new ones concerning both nonlinear and perturbative magnetic equilibria. Our investigation is supplemented by some numerical solutions for multipolar magnetic fields on top of a Tolman-VII background, where strict power-counting of the flow constants is used to ensure a self-consistent treatment.


title: SSL-Net: A Synergistic Spectral and Learning-based Network for Efficient Bird Sound Classification

abstract: Efficient and accurate bird sound classification is of important for ecology, habitat protection and scientific research, as it plays a central role in monitoring the distribution and abundance of species. However, prevailing methods typically demand extensively labeled audio datasets and have highly customized frameworks, imposing substantial computational and annotation loads. In this study, we present an efficient and general framework called SSL-Net, which combines spectral and learned features to identify different bird sounds. Encouraging empirical results gleaned from a standard field-collected bird audio dataset validate the efficacy of our method in extracting features efficiently and achieving heightened performance in bird sound classification, even when working with limited sample sizes. Furthermore, we present three feature fusion strategies, aiding engineers and researchers in their selection through quantitative analysis.


title: Fermi surface and light quasi particles in hourglass nodal chain metal \b{eta}-ReO2

abstract: Quantum oscillations in magnetic torque and electrical resistivity were measured to investigate the electronic structure of \b{eta}-ReO2, a candidate hourglass nodal chain metal (Dirac loop chain metal). All the de Haas-van Alphen oscillation branches measured at 30 mK in magnetic fields of up to 17.5 T were consistent with first-principles calculations predicting four Fermi surfaces (FSs). The small-electron FS of the four FSs exhibited a very small cyclotron mass, 0.059 times that of the free electrons, which is likely to be related to the linear dispersion of the energy band. The consistency between the quantum oscillation results and band calculations indicates the presence of the hourglass nodal chain predicted for \b{eta}-ReO2 in the vicinity of the Fermi energy.