title: 3D Arterial Segmentation via Single 2D Projections and Depth Supervision in Contrast-Enhanced CT Images

abstract: Automated segmentation of the blood vessels in 3D volumes is an essential step for the quantitative diagnosis and treatment of many vascular diseases. 3D vessel segmentation is being actively investigated in existing works, mostly in deep learning approaches. However, training 3D deep networks requires large amounts of manual 3D annotations from experts, which are laborious to obtain. This is especially the case for 3D vessel segmentation, as vessels are sparse yet spread out over many slices and disconnected when visualized in 2D slices. In this work, we propose a novel method to segment the 3D peripancreatic arteries solely from one annotated 2D projection per training image with depth supervision. We perform extensive experiments on the segmentation of peripancreatic arteries on 3D contrast-enhanced CT images and demonstrate how well we capture the rich depth information from 2D projections. We demonstrate that by annotating a single, randomly chosen projection for each training sample, we obtain comparable performance to annotating multiple 2D projections, thereby reducing the annotation effort. Furthermore, by mapping the 2D labels to the 3D space using depth information and incorporating this into training, we almost close the performance gap between 3D supervision and 2D supervision. Our code is available at: https://github.com/alinafdima/3Dseg-mip-depth.


title: YCB-Ev: Event-vision dataset for 6DoF object pose estimation

abstract: Our work introduces the YCB-Ev dataset, which contains synchronized RGB-D frames and event data that enables evaluating 6DoF object pose estimation algorithms using these modalities. This dataset provides ground truth 6DoF object poses for the same 21 YCB objects \cite{calli2017yale} that were used in the YCB-Video (YCB-V) dataset, enabling the evaluation of algorithm performance when transferred across datasets. The dataset consists of 21 synchronized event and RGB-D sequences, amounting to a total of 7:43 minutes of video. Notably, 12 of these sequences feature the same object arrangement as the YCB-V subset used in the BOP challenge. Our dataset is the first to provide ground truth 6DoF pose data for event streams. Furthermore, we evaluate the generalization capabilities of two state-of-the-art algorithms, which were pre-trained for the BOP challenge, using our novel YCB-V sequences. The proposed dataset is available at https://github.com/paroj/ycbev.


title: Groups elementary equivalent to finitely generated free metabelian

abstract: We describe groups elementarily equivalent to a free metabelian group with n generators.


title: Fokker-Planck approach to wave turbulence

abstract: The Kolmogorov-Zakharov stationary states for weak wave turbulence involve solving a leading-order kinetic equation. Recent calculations of higher-order corrections to this kinetic equation using the Martin-Siggia-Rose path integral are reconsidered in terms of stationary states of a Fokker-Planck Hamiltonian. A non-perturbative relation closely related to the quantum mechanical Ehrenfest theorem is introduced and used to express the kinetic equation in terms of divergences of two-point expectation values in the limit of zero dissipation. Similar equations are associated to divergences in higher-order cumulants. It is additionally shown that the ordinary thermal equilibrium state is not actually a stationary state of the Fokker-Planck Hamiltonian, and a non-linear modification of dissipation is considered to remedy this.

categories: cond-mat.stat-mech hep-th nlin.CD physics.flu-dyn


title: XFedHunter: An Explainable Federated Learning Framework for Advanced Persistent Threat Detection in SDN

abstract: Advanced Persistent Threat (APT) attacks are highly sophisticated and employ a multitude of advanced methods and techniques to target organizations and steal sensitive and confidential information. APT attacks consist of multiple stages and have a defined strategy, utilizing new and innovative techniques and technologies developed by hackers to evade security software monitoring. To effectively protect against APTs, detecting and predicting APT indicators with an explanation from Machine Learning (ML) prediction is crucial to reveal the characteristics of attackers lurking in the network system. Meanwhile, Federated Learning (FL) has emerged as a promising approach for building intelligent applications without compromising privacy. This is particularly important in cybersecurity, where sensitive data and high-quality labeling play a critical role in constructing effective machine learning models for detecting cyber threats. Therefore, this work proposes XFedHunter, an explainable federated learning framework for APT detection in Software-Defined Networking (SDN) leveraging local cyber threat knowledge from many training collaborators. In XFedHunter, Graph Neural Network (GNN) and Deep Learning model are utilized to reveal the malicious events effectively in the large number of normal ones in the network system. The experimental results on NF-ToN-IoT and DARPA TCE3 datasets indicate that our framework can enhance the trust and accountability of ML-based systems utilized for cybersecurity purposes without privacy leakage.


title: Diffuse-illumination holographic optical coherence tomography

abstract: Holographic optical coherence tomography (OCT) is a powerful imaging technique, but its ability to reveal low-reflectivity features is limited. In this study, we performed holographic OCT by incoherently averaging volumes with changing diffuse illumination of numerical aperture (NA) equal to the detection NA. While the reduction of speckle from singly scattered light is only modest, we discovered that speckle from multiply scattered light can be arbitrarily reduced, resulting in substantial improvements in image quality. This technique also offers the advantage of suppressing noises arising from spatial coherence, and can be implemented with a partially spatially incoherent light source for further mitigation of multiple scattering. Finally, we show that although holographic reconstruction capabilities are increasingly lost with decreasing spatial coherence, they can be retained over an axial range sufficient to standard OCT applications.


title: Cooperative quantum-optical planar arrays of atoms

abstract: Atomic planar arrays offer a novel emerging quantum-optical many-body system in which light mediates strong interactions between the atoms. The regular lattice structure provides a cooperatively enhanced light-matter coupling and allows for increased control and harnessing of these interactions. In subwavelength arrays, coherent scattering of incident light beams can be highly collimated in the forward and backward direction, resembling one-dimensional light propagation without the need for waveguides, fibers, or resonators. The atomic planar arrays share common features with fabricated metasurfaces, formed by thin nanostructured films that have shown great promise in manipulating and structuring classical light. Here we describe theoretical methods commonly employed to analyze the cooperative responses of atomic arrays and explore some recent developments and potential future applications of planar arrays as versatile quantum interfaces between light and matter.

categories: quant-ph cond-mat.quant-gas physics.atom-ph physics.optics


title: A Random Graph-based Autoregressive Model for Networked Time Series

abstract: Contemporary time series data often feature objects connected by a social network that naturally induces temporal dependence involving connected neighbours. The network vector autoregressive model is useful for describing the influence of linked neighbours, while recent generalizations aim to separate influence and homophily. Existing approaches, however, require either correct specification of a time series model or accurate estimation of a network model or both, and rely exclusively on least-squares for parameter estimation. This paper proposes a new autoregressive model incorporating a flexible form for latent variables used to depict homophily. We develop a first-order differencing method for the estimation of influence requiring only the influence part of the model to be correctly specified. When the part including homophily is correctly specified admitting a semiparametric form, we leverage and generalize the recent notion of neighbour smoothing for parameter estimation, bypassing the need to specify the generative mechanism of the network. We develop new theory to show that all the estimated parameters are consistent and asymptotically normal. The efficacy of our approach is confirmed via extensive simulations and an analysis of a social media dataset.


title: Towards Word-Level End-to-End Neural Speaker Diarization with Auxiliary Network

abstract: While standard speaker diarization attempts to answer the question "who spoken when", most of relevant applications in reality are more interested in determining "who spoken what". Whether it is the conventional modularized approach or the more recent end-to-end neural diarization (EEND), an additional automatic speech recognition (ASR) model and an orchestration algorithm are required to associate the speaker labels with recognized words. In this paper, we propose Word-level End-to-End Neural Diarization (WEEND) with auxiliary network, a multi-task learning algorithm that performs end-to-end ASR and speaker diarization in the same neural architecture. That is, while speech is being recognized, speaker labels are predicted simultaneously for each recognized word. Experimental results demonstrate that WEEND outperforms the turn-based diarization baseline system on all 2-speaker short-form scenarios and has the capability to generalize to audio lengths of 5 minutes. Although 3+speaker conversations are harder, we find that with enough in-domain training data, WEEND has the potential to deliver high quality diarized text.


title: Bessel Periods on $U(2,1) \times U(1,1)$, Relative Trace Formula and Non-Vanishing of Central $L$-values

abstract: In this paper we calculate the asymptotics of the second moment of the Bessel periods associated to certain holomorphic cuspidal representations $(\pi, \pi')$ of $U(2,1) \times U(1,1)$ of regular infinity type (averaged over $\pi$). Using these, we obtain quantitative non-vanishing results for the Rankin-Selberg central $L$-values $L(1/2, \pi \times \pi')$, which are of degree twelve over $\mathbb{Q}$, with concomitant difficulty in applying standard methods, especially since we are in a `conductor dropping' situation. We use the relative trace formula, and the orbital integrals are evaluated rather than compared with others. Besides their intrinsic interest, non-vanishing of these critical values also lead, by known results, to deducing certain associated Selmer groups have rank zero.


title: Using Large Language Models for Knowledge Engineering (LLMKE): A Case Study on Wikidata

abstract: In this work, we explore the use of Large Language Models (LLMs) for knowledge engineering tasks in the context of the ISWC 2023 LM-KBC Challenge. For this task, given subject and relation pairs sourced from Wikidata, we utilize pre-trained LLMs to produce the relevant objects in string format and link them to their respective Wikidata QIDs. We developed a pipeline using LLMs for Knowledge Engineering (LLMKE), combining knowledge probing and Wikidata entity mapping. The method achieved a macro-averaged F1-score of 0.701 across the properties, with the scores varying from 1.00 to 0.328. These results demonstrate that the knowledge of LLMs varies significantly depending on the domain and that further experimentation is required to determine the circumstances under which LLMs can be used for automatic Knowledge Base (e.g., Wikidata) completion and correction. The investigation of the results also suggests the promising contribution of LLMs in collaborative knowledge engineering. LLMKE won Track 2 of the challenge. The implementation is available at https://github.com/bohuizhang/LLMKE.


title: Emergence of {\pi}-Magnetism in Fused Aza-Triangulenes: Symmetry and Charge Transfer Effects

abstract: On-surface synthesis has paved the way towards the fabrication and characterization of conjugated carbon-based molecular materials that exhibit {\pi}-magnetism such as triangulenes. Aza-triangulene, a nitrogen-substituted derivative, was recently shown to display rich on-surface chemistry, offering an ideal platform to investigate structure-property relations regarding spin-selective charge transfer and magnetic fingerprints. Herein, we study electronic changes upon fusing single molecules into larger dimeric derivatives. We show that the closed-shell structure of aza-triangulene on Ag(111) leads to closed-shell dimers covalently coupled through sterically accessible carbon atoms. Meanwhile, its open-shell structure on Au(111) leads to coupling via atoms displaying high spin density, resulting in symmetric or asymmetric dimer products. Interestingly, whereas all fused products on Au(111) exhibit similar charge transfer properties, only asymmetric dimers show magnetic fingerprints. We rationalize this in terms of molecular bonding structure and {\pi}-conjugation: in contrast to the symmetric and highly conjugated dimer, asymmetric dimers display more localized orbitals, which result in a larger Coulomb repulsion and thus promote single electron occupancies with associated spin density and {\pi}-magnetism. These results expose a clear relationship between molecular symmetry, charge transfer, and spin states in {\pi}-conjugated carbon-based nanostructures.


title: Evidence for a luminosity-decay correlation in GRB GeV light curves

abstract: Correlations between intrinsic properties of gamma-ray burst (GRB) light curves provide clues to the nature of the central engine, the jet, and a possible means to standardise GRBs for cosmological use. Here we report on the discovery of a correlation between the intrinsic early time luminosity, $L_{G,\rm 10s}$, measured at rest frame 10s, and the average decay rate measured from rest frame 10s onward, $\alpha_{G,\rm avg>10s}$, in a sample of 13 Fermi Large Array Telescope (LAT) long GRB light curves. We note that our selection criteria, in particular the requirement for a redshift to construct luminosity light curves, naturally limits our sample to energetic GRBs. A Spearman's rank correlation gives a coefficient of -0.74, corresponding to a confidence level of 99.6%, indicating that brighter afterglows decay faster than less luminous ones. Assuming a linear relation with $\log(L_{G,\rm 10s})$, we find $\alpha_{G,\rm avg>10s} = -0.31_{-0.09}^{+0.12}\log(L_{G,\rm 10s}) + 14.43_{-5.97}^{+4.55}$. The slope of -0.31 is consistent at $1\sigma$ with previously identified correlations in the optical/UV and X-ray light curves. We speculate that differences in the rate at which energy is released by the central engine or differences in observer viewing angle may be responsible for the correlation.


title: Modeling Data Analytic Iteration With Probabilistic Outcome Sets

abstract: In 1977 John Tukey described how in exploratory data analysis, data analysts use tools, such as data visualizations, to separate their expectations from what they observe. In contrast to statistical theory, an underappreciated aspect of data analysis is that a data analyst must make decisions by comparing the observed data or output from a statistical tool to what the analyst previously expected from the data. However, there is little formal guidance for how to make these data analytic decisions as statistical theory generally omits a discussion of who is using these statistical methods. In this paper, we propose a model for the iterative process of data analysis based on the analyst's expectations, using what we refer to as expected and anomaly probabilistic outcome sets, and the concept of statistical information gain. Here, we extend the basic idea of comparing an analyst's expectations to what is observed in a data visualization to more general analytic situations. Our model posits that the analyst's goal is to increase the amount of information the analyst has relative to what the analyst already knows, through successive analytic iterations. We introduce two criteria--expected information gain and anomaly information gain--to provide guidance about analytic decision-making and ultimately to improve the practice of data analysis. Finally, we show how our framework can be used to characterize common situations in practical data analysis.


title: Blow-up for the incompressible 3D-Euler equations with uniform $C^{1,\frac{1}{2}-\epsilon}\cap L^2$ force

abstract: This paper presents a novel approach to establish a blow-up mechanism for the forced 3D incompressible Euler equations, with a specific focus on non-axisymmetric solutions. We construct solutions on $\mathbb{R}^3$ within the function space $C^{3,\frac12}\cap L^2$ for the time interval $[0, T)$, where $T > 0$ is finite, subject to a uniform force in $C^{1,\frac12 -\epsilon}\cap L^2$. Remarkably, our methodology results in a blow-up: as the time $t$ approaches the blow-up moment $T$, the integral $\int_0^t |\nabla u| ds$ tends to infinity, all while preserving the solution's smoothness throughout, except at the origin. In the process of our blow-up construction, self-similar coordinates are not utilized and we are able to treat solutions beyond the $C^{1,\frac13+}$ threshold regularity of axy-symmetric solutions without swirl.


title: Particle Dynamics on Test Papapetrou Fields of Vacuum Spacetimes

abstract: In this paper we examine the dynamics of particles subjected to test Papapetrou fields of vacuum spacetimes. The staring point of our analysis is based on fundamental electrodynamics which emerge from spacetime isometries of a Kerr and Schwarzschild black holes. Taking into account Killing vectors which satisfy Maxwell equations we evaluate the corresponding electric and magnetic fields -- Papapetrou fields -- by fixing proper frames of reference in each spacetime. A timelike observer is considered for the case of a Schwarzschild spacetime while a locally non-rotating (LNR) frame of reference is fixed for a Kerr black hole. In order to probe for the effect of such electromagnetic fields we study the motion of charged test particles in the equatorial plane of both spacetimes. For the case of a Schwarzschild black hole we show that massive/charged test particles may populate the unstable photon sphere for a given domain of the parametric space. Restricting ourselves to orbits with LNR initial conditions for the case of a Kerr black hole we show that there is an explicit deviation between orbits of neutral and charged particles in the case of repulsive configurations. For critical charge-mass ratios $\zeta_*$ test particles can be found in the Kerr retrograde photon sphere thus assigning a physical signature to Papapetrou fields.


title: Statistical anisotropy of primordial gravitational waves from generalized $\delta N$ formalism

abstract: In this letter, we demonstrate how to use the generalized $\delta N$ formalism, which enables us to compute all the large scale fluctuations, including the gravitational waves, solely by solving the evolution of the background homogeneous Universe. Using the Noether charge density, we derive an analytic formula which describes the mapping between the fluctuations at the horizon crossing and the sourced gravitational waves at the end of inflation. This formula can apply also to an inflation model with an anisotropic background.


title: Mapping polariton Bose--Einstein condensate onto vibrational degrees of freedom

abstract: We demonstrate a macro-coherent regime in molecular exciton-polariton systems, where nonequilibrium polariton Bose--Einstein condensation coexists with macroscopically occupied vibrational states. Strong vibronic coupling in molecules induces an effective optomechanical interaction between cavity polaritons and vibrational degrees of freedom of molecules, leading to vibrational amplification in a resonant blue-detuned configuration. This interaction maps out properties of the condensate to vibrational states, offering a novel approach to achieve vibrational condensation with potential applications in cavity-controlled chemistry, nonlinear and quantum optics.


title: POCKET: Pruning Random Convolution Kernels for Time Series Classification from a Feature Selection Perspective

abstract: In recent years, two competitive time series classification models, namely, ROCKET and MINIROCKET, have garnered considerable attention due to their low training cost and high accuracy. However, they require a large number of random 1-D convolutional kernels to comprehensively capture features, which is incompatible with resource-constrained devices. Despite the development of heuristic algorithms designed to recognize and prune redundant kernels, the inherent time-consuming nature of evolutionary algorithms hinders efficient evaluation. To effectively prune models, this paper removes redundant random kernels from a feature selection perspective by eliminating associating connections in the sequential classifier. Two innovative algorithms are proposed, where the first ADMM-based algorithm formulates the pruning challenge as a group elastic net classification problem, and the second core algorithm named POCKET greatly accelerates the first one by bifurcating the problem into two sequential stages. Stage 1 of POCKET introduces dynamically varying penalties to efficiently implement group-level regularization to delete redundant kernels, and Stage 2 employs element-level regularization on the remaining features to refit a linear classifier for better performance. Experimental results on diverse time series datasets show that POCKET prunes up to 60% of kernels without a significant reduction in accuracy and performs 11 times faster than its counterparts. Our code is publicly available at https://github.com/ShaowuChen/POCKET.


title: Deep-learning-powered data analysis in plankton ecology

abstract: The implementation of deep learning algorithms has brought new perspectives to plankton ecology. Emerging as an alternative approach to established methods, deep learning offers objective schemes to investigate plankton organisms in diverse environments. We provide an overview of deep-learning-based methods including detection and classification of phyto- and zooplankton images, foraging and swimming behaviour analysis, and finally ecological modelling. Deep learning has the potential to speed up the analysis and reduce the human experimental bias, thus enabling data acquisition at relevant temporal and spatial scales with improved reproducibility. We also discuss shortcomings and show how deep learning architectures have evolved to mitigate imprecise readouts. Finally, we suggest opportunities where deep learning is particularly likely to catalyze plankton research. The examples are accompanied by detailed tutorials and code samples that allow readers to apply the methods described in this review to their own data.

categories: physics.bio-ph cond-mat.soft cs.LG q-bio.QM


title: Nonlinear Quasi-Normal Modes: Uniform Approximation

abstract: Recent works have suggested that nonlinear (quadratic) effects in black hole perturbation theory may be important for describing a black hole ringdown. We show that the technique of uniform approximations can be used to accurately compute 1) nonlinear amplitudes at large distances in terms of the linear ones, 2) linear (and nonlinear) quasi-normal mode frequencies, 3) the wavefunction for both linear and nonlinear modes. Our method can be seen as a generalization of the WKB approximation, with the advantages of not losing accuracy at large overtone number and not requiring matching conditions. To illustrate the effectiveness of this method we consider a simplified source for the second-order Zerilli equation, which we use to numerically compute the amplitude of nonlinear modes for a range of values of the angular momentum number.


title: Irreducibility via location of zeros

abstract: In this paper, we obtain several new classes of irreducible polynomials having integer coefficients whose zeros lie inside an open disk around the origin or outside a closed annular region in the complex plane. Such irreducible polynomials are devised by imposing Perron--type sufficiency conditions on their coefficients.


title: HealthFC: Verifying Health Claims with Evidence-Based Medical Fact-Checking

abstract: In the digital age, seeking health advice on the Internet has become a common practice. At the same time, determining the trustworthiness of online medical content is increasingly challenging. Fact-checking has emerged as an approach to assess the veracity of factual claims using evidence from credible knowledge sources. To help advance automated Natural Language Processing (NLP) solutions for this task, in this paper we introduce a novel dataset HealthFC. It consists of 750 health-related claims in German and English, labeled for veracity by medical experts and backed with evidence from systematic reviews and clinical trials. We provide an analysis of the dataset, highlighting its characteristics and challenges. The dataset can be used for NLP tasks related to automated fact-checking, such as evidence retrieval, claim verification, or explanation generation. For testing purposes, we provide baseline systems based on different approaches, examine their performance, and discuss the findings. We show that the dataset is a challenging test bed with a high potential for future use.


title: OccupancyDETR: Using DETR for Mixed Dense-sparse 3D Occupancy Prediction

abstract: Visual-based 3D semantic occupancy perception is a key technology for robotics, including autonomous vehicles, offering an enhanced understanding of the environment by 3D. This approach, however, typically requires more computational resources than BEV or 2D methods. We propose a novel 3D semantic occupancy perception method, OccupancyDETR, which utilizes a DETR-like object detection, a mixed dense-sparse 3D occupancy decoder. Our approach distinguishes between foreground and background within a scene. Initially, foreground objects are detected using the DETR-like object detection. Subsequently, queries for both foreground and background objects are fed into the mixed dense-sparse 3D occupancy decoder, performing upsampling in dense and sparse methods, respectively. Finally, a MaskFormer is utilized to infer the semantics of the background voxels. Our approach strikes a balance between efficiency and accuracy, achieving faster inference times, lower resource consumption, and improved performance for small object detection. We demonstrate the effectiveness of our proposed method on the SemanticKITTI dataset, showcasing an mIoU of 14 and a processing speed of 10 FPS, thereby presenting a promising solution for real-time 3D semantic occupancy perception.


title: Super Slowly Spinning Stars in Close Binaries

abstract: Stars in short-period binaries typically have spins that are aligned and synchronized with the orbit of their companion. In triple systems, however, the combination of spin and orbital precession can cause the star's rotation to evolve to a highly misaligned and sub-synchronous equilibrium known as a Cassini state. We identify a population of recently discovered stars that exhibit these characteristics and which are already known to have tertiary companions. These third bodies have a suitable orbital period to allow the inner binary to evolve into the sub-synchronous Cassini state, which we confirm with orbital evolution models. We also compute the expected stellar obliquity and spin period, showing that the observed rotation rates are often slower than expected from equilibrium tidal models. However, we show that tidal dissipation via inertial waves can alter the expected spin-orbit misalignment angle and rotation rate, potentially creating the very slow rotation rates in some systems. Finally, we show how additional discoveries of such systems can be used to constrain the tidal physics and orbital evolution histories of stellar systems.


title: Slowly Rotating Close Binary Stars in Cassini States

abstract: Recent asteroseismic measurements have revealed a small population of stars in close binaries, containing primaries with extremely slow rotation rates. Such stars defy the standard expectation of tidal synchronization in such systems, but they can potentially be explained if they are trapped in a spin-orbit equilibrium known as Cassini state 2 (CS2). This state is maintained by orbital precession due to an outer tertiary star, and it typically results in a very sub-synchronous rotation rate and high degree of spin-orbit misalignment. We examine how CS2 is affected by magnetic braking and different types of tidal dissipation. Magnetic braking results in a slower equilibrium rotation rate, while tidal dissipation via gravity waves can result in a slightly higher rotation rate than predicted by equilibrium tidal theory, and dissipation via inertial waves can result in much slower rotation rates. For seven binary systems with slowly rotating primaries, we predict the location of the outer tertiary predicted by the CS2 theory. In five of these systems, a tertiary companion has already been detected, although it closer than expected in three of these, potentially indicating tidal dissipation via inertial waves. We also identify a few new candidate systems among a population of eclipsing binaries with rotation measurements via spot modulation.


title: Accelerating proton arc therapy delivery through dosimetry-guided energy layer filtering

abstract: Proton arc therapy has emerged as a promising approach for faster treatment delivery in comparison to conventional proton treatments. However, unexpected prolonged treatment times in several proton arc planning studies have raised concerns. In this study, we aim to address the challenge of minimizing delivery time through dosimetry-guided energy layer filtering, comparing its performance to a baseline approach without filtering. We developed three methods of energy layer (EL) filtering: unrestricted, switch-up (SU), and switch-up gap (SU gap) filtering. The unrestricted method filters the lowest weighted EL while the SU gap filtering removes in priority the EL around a new SU to minimize the gantry rotation braking. The SU filtering removes the lowest weighted group of EL that includes a SU. These post-processing filters were used in conjunction with the RayStation dynamic proton arc optimization framework (ELSA). Four bilateral oropharyngeal cancer patients' data were used for evaluation. Objective function values, target coverage robustness, organ-at-risk doses and NTCP evaluations, as well as comparisons to IMPT plans, were used to assess plan quality. The SU gap filtering algorithm performed best in three out of the four cases, maintaining plan quality within tolerance while significantly reducing beam delivery time. It achieved up to approximately 22% reduction in delivery time. The unrestricted filtering algorithm followed closely. In contrast, the SU filtering showed limited improvement, suppressing hardly a few SU without substantial delivery time shortening. Robust target coverage was kept within 1% of variation compared to the ELSA baseline plan while OAR doses slighlty decreased in all four patients. Both arc plans present large reductions in NTCP values for dysphagia and xerostomia compared to the reference IMPT plan.


title: MOSAIC: Learning Unified Multi-Sensory Object Property Representations for Robot Learning via Interactive Perception

abstract: A holistic understanding of object properties across diverse sensory modalities (e.g., visual, audio, and haptic) is essential for tasks ranging from object categorization to complex manipulation. Drawing inspiration from cognitive science studies that emphasize the significance of multi-sensory integration in human perception, we introduce MOSAIC (Multimodal Object property learning with Self-Attention and Interactive Comprehension), a novel framework designed to facilitate the learning of unified multi-sensory object property representations. While it is undeniable that visual information plays a prominent role, we acknowledge that many fundamental object properties extend beyond the visual domain to encompass attributes like texture, mass distribution, or sounds, which significantly influence how we interact with objects. In MOSAIC, we leverage this profound insight by distilling knowledge from multimodal foundation models and aligning these representations not only across vision but also haptic and auditory sensory modalities. Through extensive experiments on a dataset where a humanoid robot interacts with 100 objects across 10 exploratory behaviors, we demonstrate the versatility of MOSAIC in two task families: object categorization and object-fetching tasks. Our results underscore the efficacy of MOSAIC's unified representations, showing competitive performance in category recognition through a simple linear probe setup and excelling in the fetch object task under zero-shot transfer conditions. This work pioneers the application of sensory grounding in foundation models for robotics, promising a significant leap in multi-sensory perception capabilities for autonomous systems. We have released the code, datasets, and additional results: https://github.com/gtatiya/MOSAIC.


title: Stability conditions for line bundles on nodal curves

abstract: We introduce the abstract notion of a \emph{smoothable fine compactified Jacobian} of a nodal curve, and of a family of nodal curves whose general element is smooth. Then we introduce the notion of a combinatorial stability condition for line bundles and their degenerations. We prove that smoothable fine compactified Jacobians are in bijection with these stability conditions. We then turn our attention to \emph{fine compactified universal Jacobians}, that is, fine compactified Jacobians for the moduli space $\overline{\mathcal{M}}_g$ of stable curves (without marked points). We prove that every fine compactified universal Jacobian is isomorphic to the one first constructed by Caporaso, Pandharipande and Simpson in the nineties. In particular, without marked points, there exists no fine compactified universal Jacobian unless $\gcd(d+1-g, 2g-2)=1$.


title: Differences between quantum and classical adiabatic evolution

abstract: Adiabatic evolution is an emergent design principle for time modulated metamaterials, often inspired by insights from topological quantum computing such as Majorana fermions and braiding operations. However, the pursuit of classical adiabatic metamaterials is rooted on the assumption that classical and quantum adiabatic evolution are equivalent. We show that this is not the case; and some instances of quantum adiabatic evolution, such as those containing zero modes, cannot be reproduced in classical systems. This is because mode coupling is fundamentally different in classical mechanics. We derive classical conditions to ensure adiabaticity and demonstrate that only under these, from quantum mechanics distinct conditions the Berry phase and Wilczek-Zee matrix emerge as meaningful quantities encoding the geometry of classical adiabatic evolution.


title: Generalised Diffusion Probabilistic Scale-Spaces

abstract: Diffusion probabilistic models excel at sampling new images from learned distributions. Originally motivated by drift-diffusion concepts from physics, they apply image perturbations such as noise and blur in a forward process that results in a tractable probability distribution. A corresponding learned reverse process generates images and can be conditioned on side information, which leads to a wide variety of practical applications. Most of the research focus currently lies on practice-oriented extensions. In contrast, the theoretical background remains largely unexplored, in particular the relations to drift-diffusion. In order to shed light on these connections to classical image filtering, we propose a generalised scale-space theory for diffusion probabilistic models. Moreover, we show conceptual and empirical connections to diffusion and osmosis filters.


title: Eventual conjugacy of free inert $G$-SFTs

abstract: The action of a finite group $G$ on a subshift of finite type $X$ is called free, if every point has trivial stabilizer, and it is called inert, if the induced action on the dimension group of $X$ is trivial. We show that any two free inert actions of a finite group $G$ on an SFT are conjugate by an automorphism of any sufficiently high power of the shift space. This partially answers a question posed by Fiebig. As a consequence we obtain that every two free elements of the stabilized automorphism group of a full shift are conjugate in this group. In addition, we generalize a result of Boyle, Carlsen and Eilers concerning the flow equivalence of $G$-SFTs.


title: SCT: A Simple Baseline for Parameter-Efficient Fine-Tuning via Salient Channels

abstract: Pre-trained vision transformers have strong representation benefits to various downstream tasks. Recently, many parameter-efficient fine-tuning (PEFT) methods have been proposed, and their experiments demonstrate that tuning only 1\% extra parameters could surpass full fine-tuning in low-data resource scenarios. However, these methods overlook the task-specific information when fine-tuning diverse downstream tasks. In this paper, we propose a simple yet effective method called "Salient Channel Tuning" (SCT) to leverage the task-specific information by forwarding the model with the task images to select partial channels in a feature map that enables us to tune only 1/8 channels leading to significantly lower parameter costs. Experiments on 19 visual transfer learning downstream tasks demonstrate that our SCT outperforms full fine-tuning on 18 out of 19 tasks by adding only 0.11M parameters of the ViT-B, which is 780$\times$ fewer than its full fine-tuning counterpart. Furthermore, experiments on domain generalization and few-shot classification further demonstrate the effectiveness and generic of our approach. The code is available at https://github.com/showlab/SCT.


title: On the rna number of powers of cycles

abstract: A signed graph $(G,\sigma)$ on $n$ vertices is called a \textit{parity signed graph} if there is a bijective mapping $f \colon V(G) \rightarrow \{1,\ldots,n\}$ such that $f(u)$ and $f(v)$ have same parity if $\sigma(uv)=1$, and opposite parities if $\sigma(uv)=-1$ for each edge $uv$ in $G$. The \emph{rna} number $\sigma^{-}(G)$ of $G$ is the least number of negative edges among all possible parity signed graphs over $G$. In other words, $\sigma^{-}(G)$ is the smallest size of an edge-cut of $G$ such that the sizes of two sides differ at most one. Let $C_n^{d}$ be the $d\text{th}$ power of a cycle of order $n$. Recently, Acharya, Kureethara and Zaslavsky proved that the \emph{rna} number of a cycle $C_n$ on $n$ vertices is $2$. In this paper, we show for $2 \leq d < \lfloor \frac{n}{2} \rfloor$ that $2d \leq \sigma^{-}(C_n^{d}) \leq d(d+1)$. Moreover, we prove that the graphs $C_n^{2}$ and $C_n^{3}$ achieve the upper bound of $d(d+1)$.


title: MIDIS: JWST NIRCam and MIRI unveil the stellar population properties of Ly$\alpha$-emitters and Lyman-Break galaxies at z ~ 3-7

abstract: We study the stellar population properties of 182 spectroscopically-confirmed (MUSE/VLT) Lyman-$\alpha$ emitters (LAEs) and 450 photometrically-selected Lyman-Break galaxies (LBGs) at z = 2.8 - 6.7 in the Hubble eXtreme Deep Field (XDF). Leveraging the combined power of HST and JWST NIRCam and MIRI observations, we analyse their rest-frame UV-through-near-IR spectral energy distributions (SEDs) with MIRI playing a crucial role in robustly assessing the LAE's stellar mass and ages. Our LAEs are low-mass objects (log$_{10}$(M$_\star$[M$_\odot$]) ~ 7.5), with little or no dust extinction (E(B - V) ~ 0.1) and a blue UV continuum slope ($\beta$ ~ -2.2). While 75% of our LAEs are young (< 100 Myr), the remaining 25% have significantly older stellar populations (> 100 Myr). These old LAEs are statistically more massive, less extinct and have lower specific star formation rate (sSFR) compared to young LAEs. Besides, they populate the M$_\star$ - SFR plane along the main-sequence (MS) of star-forming galaxies, while young LAEs populate the starburst region. The comparison between the LAEs properties to those of a stellar-mass matched sample of LBGs shows no statistical difference between these objects, except for the LBGs redder UV continuum slope and marginally larger E(B - V) values. Interestingly, 48% of the LBGs have ages < 10 Myr and are classified as starbursts, but lack detectable Ly$\alpha$ emission. This is likely due to HI resonant scattering and/or selective dust extinction. Overall, we find that JWST observations are crucial in determining the properties of LAEs and shedding light on the properties and similarities between LAEs and LBGs.


title: Using Monte Carlo Tree Search to Calculate Mutual Information in High Dimensions

abstract: Mutual information is an important measure of the dependence among variables. It has become widely used in statistics, machine learning, biology, etc. However, the standard techniques for estimating it often perform poorly in higher dimensions or with noisy variables. Here we significantly improve one of the standard methods for calculating mutual information by combining it with a modified Monte Carlo Tree Search. We present results which show that our method gives accurate results where the standard methods fail. We also describe the software implementation of our method and give details on the publicly-available code.


title: On the Forgetting of Particle Filters

abstract: We study the forgetting properties of the particle filter when its state - the collection of particles - is regarded as a Markov chain. Under a strong mixing assumption on the particle filter's underlying Feynman-Kac model, we find that the particle filter is exponentially mixing, and forgets its initial state in $O(\log N )$ `time', where $N$ is the number of particles and time refers to the number of particle filter algorithm steps, each comprising a selection (or resampling) and mutation (or prediction) operation. We present an example which suggests that this rate is optimal. In contrast to our result, available results to-date are extremely conservative, suggesting $O(\alpha^N)$ time steps are needed, for some $\alpha>1$, for the particle filter to forget its initialisation. We also study the conditional particle filter (CPF) and extend our forgetting result to this context. We establish a similar conclusion, namely, CPF is exponentially mixing and forgets its initial state in $O(\log N )$ time. To support this analysis, we establish new time-uniform $L^p$ error estimates for CPF, which can be of independent interest.


title: A generalization of the dual immaculate quasisymmetric functions in partially commutative variables

abstract: We define a new pair of dual bases that generalize the immaculate and dual immaculate bases to the colored algebras $QSym_A$ and $NSym_A$. The colored dual immaculate functions are defined combinatorially via tableaux, and we present results on their Hopf algebra structure, expansions to and from other bases, and skew functions. For the colored immaculate functions, defined using creation operators, we study expansions to and from other bases and provide a right Pieri rule. This includes a combinatorial method for expanding colored immaculate functions into the colored ribbon basis that specializes to a new analogous result in the uncolored case. We use the same methods to define colored generalizations of the row-strict immaculate and row-strict dual immaculate functions with similar results.


title: Exploiting ambipolarity in graphene field-effect transistors for novel designs on high-frequency analog electronics

abstract: Exploiting ambipolar electrical conductivity based on graphene field-effect transistors has raised enormous interest for high-frequency (HF) analog electronics. Controlling the device polarity, by biasing the graphene transistor around the vertex of the V-shaped transfer curve, enables to redesign and highly simplify conventional analog circuits, and simultaneously to seek for multifunctionalities specially in the HF domain. We present, here, new insights for the design of different HF applications such as power amplifiers, mixers, frequency multipliers, phase shifters, and modulators that specifically leverage the inherent ambipolarity of graphene-based transistors.


title: Scaling Laws for Sparsely-Connected Foundation Models

abstract: We explore the impact of parameter sparsity on the scaling behavior of Transformers trained on massive datasets (i.e., "foundation models"), in both vision and language domains. In this setting, we identify the first scaling law describing the relationship between weight sparsity, number of non-zero parameters, and amount of training data, which we validate empirically across model and data scales; on ViT/JFT-4B and T5/C4. These results allow us to characterize the "optimal sparsity", the sparsity level which yields the best performance for a given effective model size and training budget. For a fixed number of non-zero parameters, we identify that the optimal sparsity increases with the amount of data used for training. We also extend our study to different sparsity structures (such as the hardware-friendly n:m pattern) and strategies (such as starting from a pretrained dense model). Our findings shed light on the power and limitations of weight sparsity across various parameter and computational settings, offering both theoretical understanding and practical implications for leveraging sparsity towards computational efficiency improvements.


title: Uncertainties too large to predict tipping times of major Earth system components

abstract: Observations are increasingly used to detect critical slowing down (CSD) in potentially multistable components of the Earth system in order to warn of forthcoming critical transitions in these components. In addition, it has been suggested to use the statistical changes in these historical observations to extrapolate into the future and predict the tipping time. Here we argue that this extrapolation is too sensitive to uncertainties to give robust results. In particular, we raise concerns regarding (1) the modelling assumptions underlying the approaches to extrapolate results obtained from analyzing historical data into the future, (2) the representativeness of individual time series representing the variability of the respective Earth system components, and (3) the effect of uncertainties and preprocessing of the employed observational datasets, with focus on non-stationary observational coverage and the way gaps are filled. We explore these uncertainties both qualitatively and quantitatively for the Atlantic Meridional Overturning Circulation (AMOC). We argue that even under the assumption that these natural systems have a tipping point that they are getting closer to, the different uncertainties are too large to be able to estimate the time of tipping based on extrapolation from historical data.


title: Primes in arithmetic progressions to large moduli, and Goldbach beyond the square-root barrier

abstract: We show the primes have level of distribution $66/107\approx 0.617$ using triply well-factorable weights. This gives the highest level of distribution for primes in any setting, improving on the prior record level $3/5=0.60$ of Maynard. We also extend this level to $5/8=0.625$, assuming Selberg's eigenvalue conjecture. As applications of the method, we obtain new upper bounds for twin primes and for Goldbach representations of even numbers $a$. For the Goldbach problem, this is the first use of a level of distribution beyond the square-root barrier, and leads to the greatest improvement on the problem since Bombieri-Davenport from 1966. Our proof optimizes the Deshouillers-Iwaniec spectral large sieve estimates, both in the exceptional spectrum and uniformity in the residue $a$, refining Drappeau-Pratt-Radziwill and Assing-Blomer-Li.


title: Breathing New Life into 3D Assets with Generative Repainting

abstract: Diffusion-based text-to-image models ignited immense attention from the vision community, artists, and content creators. Broad adoption of these models is due to significant improvement in the quality of generations and efficient conditioning on various modalities, not just text. However, lifting the rich generative priors of these 2D models into 3D is challenging. Recent works have proposed various pipelines powered by the entanglement of diffusion models and neural fields. We explore the power of pretrained 2D diffusion models and standard 3D neural radiance fields as independent, standalone tools and demonstrate their ability to work together in a non-learned fashion. Such modularity has the intrinsic advantage of eased partial upgrades, which became an important property in such a fast-paced domain. Our pipeline accepts any legacy renderable geometry, such as textured or untextured meshes, orchestrates the interaction between 2D generative refinement and 3D consistency enforcement tools, and outputs a painted input geometry in several formats. We conduct a large-scale study on a wide range of objects and categories from the ShapeNetSem dataset and demonstrate the advantages of our approach, both qualitatively and quantitatively. Project page: https://www.obukhov.ai/repainting_3d_assets


title: Multi-orbital Kondo screening in strongly correlated polyradical nanographenes

abstract: We discuss coexistence of Kondo and spin excitation signals in tunneling spectroscopy in strongly correlated polyradical $\pi$-magnetic nanographenes on a metal surface. The Kondo signal is rationalized by a multi-orbital Kondo screening of the unpaired electrons. The fundamental processes are spin-flips of antiferromagnetic (AFM) order involving charged molecular multiplets. We introduce a~perturbative model, which provides simple rules to identify the presence of AFM channels responsible for Kondo screening. The Kondo regime is confirmed by numerical renormalization group calculations. This framework can be applied to similar strongly correlated open-shell systems.


title: Solution of one-dimensional Kondo lattice model, ground state calculation

abstract: The ground state of the Kondo chain model is calculated taking into account the formation of local singlet states of electrons and moments. Singlets are entangled local states of electrons and moments arranged chaotically and varying in time. For two-particle singlet states, the scattering matrix is calculated using the Bethe Ansatz. It is shown that electrons do not hybridize with local moments, and a lattice with a double cell is not formed. In the case of strong interaction, the gap in the Kondo insulator is determined by single-particle energy of singlets, for weak interaction by correlations.


title: Robust IRS-Element Activation for Energy Efficiency Optimization in IRS-Assisted Communication Systems With Imperfect CSI

abstract: In this paper, we study an intelligent reflecting surface (IRS)-aided communication system with single-antenna transmitter and receiver, under imperfect channel state information (CSI). More specifically, we deal with the robust selection of binary (on/off) states of the IRS elements in order to maximize the worst-case energy efficiency (EE), given a bounded CSI uncertainty, while satisfying a minimum signal-to-noise ratio (SNR). In addition, we consider not only continuous but also discrete IRS phase shifts. First, we derive closed-form expressions of the worst-case SNRs, and then formulate the robust (discrete) optimization problems for each case. In the case of continuous phase shifts, we design a dynamic programming (DP) algorithm that is theoretically guaranteed to achieve the global maximum with polynomial complexity $O(L\,{\log L})$, where $L$ is the number of IRS elements. In the case of discrete phase shifts, we develop a convex-relaxation-based method (CRBM) to obtain a feasible (sub-optimal) solution in polynomial time $O(L^{3.5})$, with a posteriori performance guarantee. Furthermore, numerical simulations provide useful insights and confirm the theoretical results. In particular, the proposed algorithms are several orders of magnitude faster than the exhaustive search when $L$ is large, thus being highly scalable and suitable for practical applications. Moreover, both algorithms outperform a baseline scheme, namely, the activation of all IRS elements.


title: Nondestructive detection and quantification of localized corrosion rates by electrochemical tomography

abstract: Localized corrosion is one of the most common causes of early degradation of engineering structures. To non-destructively determine the location, size and rate of localized corrosion in porous media, a new technique, electrochemical tomography (ECT), has been theoretically and numerically formulated. The current work shows the application of ECT to measure corrosion rates in a controlled laboratory setup, with a stable electrolyte and well-defined macro-cell. The results show that ECT is able to replicate the corrosion size and location and can give a good estimation of the corrosion rate. Moreover, the validation of ECT on a well defined localized corrosion system, brings the technique closer to future field applications.


title: The Weil bound for generalized Kloosterman sums of half-integral weight

abstract: Let $L$ be an even lattice of odd rank with discriminant group $L'/L$, and let $\alpha,\beta \in L'/L$. We prove the Weil bound for the Kloosterman sums $S_{\alpha,\beta}(m,n,c)$ of half-integral weight for the Weil Representation attached to $L$. We obtain this bound by proving an identity that relates a divisor sum of Kloosterman sums to a sparse exponential sum. This identity generalizes Kohnen's identity for plus space Kloosterman sums with the theta multiplier system.


title: Dynamical correlations and order in magic-angle twisted bilayer graphene

abstract: In magic angle twisted bilayer graphene, transport, thermodynamic and spectroscopic experiments pinpoint at a competition between distinct low-energy states with and without electronic order, as well as a competition between localized and delocalized charge carriers. In this study, we utilize Dynamical Mean Field Theory (DMFT) on the topological heavy Fermion (THF) model of twisted bilayer graphene to investigate the emergence of electronic correlations and long-range order in the absence of strain. We explain the nature of emergent insulating and correlated metallic states, as well as transitions between them driven by three central phenomena: (i) the formation of local spin and valley isospin moments around 100K, (ii) the ordering of the local isospin moments around 10K, and (iii) a cascadic redistribution of charge between localized and delocalized electronic states upon doping. At integer fillings, we find that low energy spectral weight is depleted in the symmetric phase, while we find insulating states with gaps enhanced by exchange coupling in the zero-strain ordered phases. Doping away from integer filling results in distinct metallic states: a "bad metal" above the ordering temperature, where coherence of the low-energy electronic excitations is suppressed by scattering off the disordered local moments, and a "good metal" in the ordered states with coherence of quasiparticles facilitated by isospin order. Upon doping, there is charge transfer between the localized and delocalized orbitals of the THF model such that they get periodically filled and emptied in between integer fillings. This charge reshuffling manifests itself in cascades of doping-induced Lifshitz transitions, local spectral weight redistributions and periodic variations of the electronic compressibility ranging from nearly incompressible to negative.


title: From Hubble to Bubble

abstract: The detection of a stochastic Gravitational Wave (GW) background sourced by a cosmological phase transition would allow us to see the early Universe from a completely new perspective, illuminating aspects of Beyond the Standard Model (BSM) physics and inflationary cosmology. In this study, we investigate whether the evolution of the scalar potential of a minimal SM extension after inflation can lead to a strong first-order phase transition. In particular, we focus on a BSM spectator scalar field that is non-minimally coupled to gravity and has a dynamical double-well potential. As inflation ends, the potential barrier diminishes due to the evolution of the curvature scalar. Therefore, a phase transition can proceed through the nucleation of true-vacuum bubbles that collide as they fill the Universe and produce GWs. We consider high and low scales of inflation, while also taking into account a kination period between inflation and the onset of radiation domination. With this prescription, we showcase a proof-of-concept study of a new triggering mechanism for BSM phase transitions in the early Universe, whose GW signatures could potentially be probed with future detectors.


title: Towards Practical and Efficient Image-to-Speech Captioning with Vision-Language Pre-training and Multi-modal Tokens

abstract: In this paper, we propose methods to build a powerful and efficient Image-to-Speech captioning (Im2Sp) model. To this end, we start with importing the rich knowledge related to image comprehension and language modeling from a large-scale pre-trained vision-language model into Im2Sp. We set the output of the proposed Im2Sp as discretized speech units, i.e., the quantized speech features of a self-supervised speech model. The speech units mainly contain linguistic information while suppressing other characteristics of speech. This allows us to incorporate the language modeling capability of the pre-trained vision-language model into the spoken language modeling of Im2Sp. With the vision-language pre-training strategy, we set new state-of-the-art Im2Sp performances on two widely used benchmark databases, COCO and Flickr8k. Then, we further improve the efficiency of the Im2Sp model. Similar to the speech unit case, we convert the original image into image units, which are derived through vector quantization of the raw image. With these image units, we can drastically reduce the required data storage for saving image data to just 0.8% when compared to the original image data in terms of bits. Demo page: https://ms-dot-k.github.io/Image-to-Speech-Captioning.


title: Connecting Large Language Models with Evolutionary Algorithms Yields Powerful Prompt Optimizers

abstract: Large Language Models (LLMs) excel in various tasks, but they rely on carefully crafted prompts that often demand substantial human effort. To automate this process, in this paper, we propose a novel framework for discrete prompt optimization, called EvoPrompt, which borrows the idea of evolutionary algorithms (EAs) as they exhibit good performance and fast convergence. To enable EAs to work on discrete prompts, which are natural language expressions that need to be coherent and human-readable, we connect LLMs with EAs. This approach allows us to simultaneously leverage the powerful language processing capabilities of LLMs and the efficient optimization performance of EAs. Specifically, abstaining from any gradients or parameters, EvoPrompt starts from a population of prompts and iteratively generates new prompts with LLMs based on the evolutionary operators, improving the population based on the development set. We optimize prompts for both closed- and open-source LLMs including GPT-3.5 and Alpaca, on 31 datasets covering language understanding, generation tasks, as well as BIG-Bench Hard (BBH) tasks. EvoPrompt significantly outperforms human-engineered prompts and existing methods for automatic prompt generation (e.g., up to 25% on BBH). Furthermore, EvoPrompt demonstrates that connecting LLMs with EAs creates synergies, which could inspire further research on the combination of LLMs and conventional algorithms.


title: Automated dermatoscopic pattern discovery by clustering neural network output for human-computer interaction

abstract: Background: As available medical image datasets increase in size, it becomes infeasible for clinicians to review content manually for knowledge extraction. The objective of this study was to create an automated clustering resulting in human-interpretable pattern discovery. Methods: Images from the public HAM10000 dataset, including 7 common pigmented skin lesion diagnoses, were tiled into 29420 tiles and clustered via k-means using neural network-extracted image features. The final number of clusters per diagnosis was chosen by either the elbow method or a compactness metric balancing intra-lesion variance and cluster numbers. The amount of resulting non-informative clusters, defined as those containing less than six image tiles, was compared between the two methods. Results: Applying k-means, the optimal elbow cutoff resulted in a mean of 24.7 (95%-CI: 16.4-33) clusters for every included diagnosis, including 14.9% (95% CI: 0.8-29.0) non-informative clusters. The optimal cutoff, as estimated by the compactness metric, resulted in significantly fewer clusters (13.4; 95%-CI 11.8-15.1; p=0.03) and less non-informative ones (7.5%; 95% CI: 0-19.5; p=0.017). The majority of clusters (93.6%) from the compactness metric could be manually mapped to previously described dermatoscopic diagnostic patterns. Conclusions: Automatically constraining unsupervised clustering can produce an automated extraction of diagnostically relevant and human-interpretable clusters of visual patterns from a large image dataset.


title: Towards Last-layer Retraining for Group Robustness with Fewer Annotations

abstract: Empirical risk minimization (ERM) of neural networks is prone to over-reliance on spurious correlations and poor generalization on minority groups. The recent deep feature reweighting (DFR) technique achieves state-of-the-art group robustness via simple last-layer retraining, but it requires held-out group and class annotations to construct a group-balanced reweighting dataset. In this work, we examine this impractical requirement and find that last-layer retraining can be surprisingly effective with no group annotations (other than for model selection) and only a handful of class annotations. We first show that last-layer retraining can greatly improve worst-group accuracy even when the reweighting dataset has only a small proportion of worst-group data. This implies a "free lunch" where holding out a subset of training data to retrain the last layer can substantially outperform ERM on the entire dataset with no additional data or annotations. To further improve group robustness, we introduce a lightweight method called selective last-layer finetuning (SELF), which constructs the reweighting dataset using misclassifications or disagreements. Our empirical and theoretical results present the first evidence that model disagreement upsamples worst-group data, enabling SELF to nearly match DFR on four well-established benchmarks across vision and language tasks with no group annotations and less than 3% of the held-out class annotations. Our code is available at https://github.com/tmlabonte/last-layer-retraining.


title: Visual Speech Recognition for Languages with Limited Labeled Data using Automatic Labels from Whisper

abstract: This paper proposes a powerful Visual Speech Recognition (VSR) method for multiple languages, especially for low-resource languages that have a limited number of labeled data. Different from previous methods that tried to improve the VSR performance for the target language by using knowledge learned from other languages, we explore whether we can increase the amount of training data itself for the different languages without human intervention. To this end, we employ a Whisper model which can conduct both language identification and audio-based speech recognition. It serves to filter data of the desired languages and transcribe labels from the unannotated, multilingual audio-visual data pool. By comparing the performances of VSR models trained on automatic labels and the human-annotated labels, we show that we can achieve similar VSR performance to that of human-annotated labels even without utilizing human annotations. Through the automated labeling process, we label large-scale unlabeled multilingual databases, VoxCeleb2 and AVSpeech, producing 1,002 hours of data for four low VSR resource languages, French, Italian, Spanish, and Portuguese. With the automatic labels, we achieve new state-of-the-art performance on mTEDx in four languages, significantly surpassing the previous methods. The automatic labels are available online: https://github.com/JeongHun0716/Visual-Speech-Recognition-for-Low-Resource-Languages


title: Gravitational wave oscillations in bimetric cosmology

abstract: Unlike general relativity, in bimetric gravity linear gravitational waves do not evolve as free fields. In this theory there are two types of tensor perturbations, whose interactions are inherited from non-trivial couplings between two dynamical metric tensor fields in the Hassan-Rosen action, and are responsible for the phenomenon of bigravity oscillations. In this work, we analyze the dynamics of cosmological tensor modes in bimetric gravity on sub-horizon scales and close to the general relativity limit. In this limit, the system has a characteristic length scale $L$ that is strictly contained within the comoving Hubble radius. Thus, depending on the magnitude of the comoving wavelength $\lambda$ relative to $L$, we identify two regimes of interest where the system can be studied analytically: (i) deep sub-horizon modes with $\lambda\ll L$, whose dynamics can be studied using multiple scale analysis and are characterized by small and slowly evolving super-imposed perturbations; (ii) sub-horizon modes with $\lambda\gg L$, where the dynamics is characterized by fast super-imposed oscillations that can be studied using asymptotic techniques for highly oscillatory problems. Furthermore, our analysis represents a substantial improvement compared to previous analyses based on a generalization of the WKB method, which, as we show, is ill-suited to study the system at hand.


title: Operational Integration Potential of Regional Uncrewed Aircraft Systems into the Airspace System

abstract: As part of newly developing aviation markets, fixed-wing Uncrewed Aircraft Systems (UAS) are projected to impact airspace systems and conventional air traffic in the future. The initial introduction of fixed-wing cargo UAS for regional operations is anticipated to occur at smaller under-utilized airports. Therefore, this paper assesses the integration potential of regional fixed-wing cargo UAS into the airspace system. A baseline is established to identify potential airports for cargo UAS operations in different areas. Additionally, using 2022 data, regional aircraft eligible for future cargo UAS operations are investigated. Finally, the accessibility of these regional aircraft at the identified airports was analysed. Based on the availability of current certified landing systems needed for initial UAS operations, potential airports in the areas Germany, Texas, and California for UAS operations are compared. Additionally, based on the maximum takeoff weight allowances of airport runways, current air transport operations at airports, and airspace classes, individual airports with a high potential for the introduction of initial cargo UAS operations with and without the availability of landing systems needed for UAS are identified and compared among the investigated areas. Despite a total of 173 identified airports for potential UAS operations in Germany, 376 in Texas, and 231 in California, only eleven of these airports currently have the certified landing systems needed for initial UAS operations. However, other landing system technologies that are currently under development, such as vision-based landing systems, might support UAS accessibility at the identified airports for potential UAS operations in the future.


title: Jittering and Clustering: Strategies for the Construction of Robust Designs

abstract: We discuss, and give examples of, methods for randomly implementing some minimax robust designs from the literature. These have the advantage, over their deterministic counterparts, of having bounded maximum loss in large and very rich neighbourhoods of the, almost certainly inexact, response model fitted by the experimenter. Their maximum loss rivals that of the theoretically best possible, but not implementable, minimax designs. The procedures are then extended to more general robust designs. For two-dimensional designs we sample from contractions of Voronoi tessellations, generated by selected basis points, which partition the design space. These ideas are then extended to $k$-dimensional designs for general k.


title: On the size of Bruhat intervals

abstract: For affine Weyl groups and elements associated to dominant coweights, we present a convex geometry formula for the size of the corresponding lower Bruhat intervals. Extensive computer calculations for these groups have led us to believe that a similar formula exists for all lower Bruhat intervals.


title: Non-equilibrium effects on stability of hybrid stars with first-order phase transitions

abstract: The stability of hybrid stars with first-order phase transitions as determined by calculating fundamental radial oscillation modes is known to differ from the predictions of the widely-used Bardeen--Thorne--Meltzer criterion. We consider the effects of out-of-chemical-equilibrium physics on the radial modes and hence stability of these objects. For a barotropic equation of state, this is done by allowing the adiabatic sound speed to differ from the equilibrium sound speed. We show that doing so extends the stable branches of stellar models, allowing stars with rapid phase transitions to support stable higher-order stellar multiplets similarly to stars with multiple slow phase transitions. We also derive a new junction condition to impose on the oscillation modes at the phase transition. Termed the reactive condition, it is physically motivated, consistent with the generalized junction conditions between two phases, and has the common rapid and slow conditions as limiting cases. Unlike the two common cases, it can only be applied to nonbarotropic stars. We apply this junction condition to hybrid stellar models generated using a two-phase equation of state consisting of nuclear matter with unpaired quark matter at high densities joined by a first-order phase transition and show that like in the slow limiting case, stars that are classically unstable are stabilized by a finite chemical reaction speed.


title: When do Generative Query and Document Expansions Fail? A Comprehensive Study Across Methods, Retrievers, and Datasets

abstract: Using large language models (LMs) for query or document expansion can improve generalization in information retrieval. However, it is unknown whether these techniques are universally beneficial or only effective in specific settings, such as for particular retrieval models, dataset domains, or query types. To answer this, we conduct the first comprehensive analysis of LM-based expansion. We find that there exists a strong negative correlation between retriever performance and gains from expansion: expansion improves scores for weaker models, but generally harms stronger models. We show this trend holds across a set of eleven expansion techniques, twelve datasets with diverse distribution shifts, and twenty-four retrieval models. Through qualitative error analysis, we hypothesize that although expansions provide extra information (potentially improving recall), they add additional noise that makes it difficult to discern between the top relevant documents (thus introducing false positives). Our results suggest the following recipe: use expansions for weaker models or when the target dataset significantly differs from training corpus in format; otherwise, avoid expansions to keep the relevance signal clear.


title: Generalized Ginsparg-Wilson relations

abstract: We give a general derivation of Ginsparg-Wilson relations for both Dirac and Majorana fermions in any dimension. These relations encode continuous and discrete chiral, parity and time reversal anomalies and will apply to the various classes of free fermion topological insulators and superconductors (in the framework of a relativistic quantum field theory in Euclidean spacetime). We show how to formulate the exact symmetries of the lattice action and the relevant index theorems for the anomalies.


title: Fisher's combined probability test for cross-sectional independence in panel data models with serial correlation

abstract: Testing cross-sectional independence in panel data models is of fundamental importance in econometric analysis with high-dimensional panels. Recently, econometricians began to turn their attention to the problem in the presence of serial dependence. The existing procedure for testing cross-sectional independence with serial correlation is based on the sum of the sample cross-sectional correlations, which generally performs well when the alternative has dense cross-sectional correlations, but suffers from low power against sparse alternatives. To deal with sparse alternatives, we propose a test based on the maximum of the squared sample cross-sectional correlations. Furthermore, we propose a combined test to combine the p-values of the max based and sum based tests, which performs well under both dense and sparse alternatives. The combined test relies on the asymptotic independence of the max based and sum based test statistics, which we show rigorously. We show that the proposed max based and combined tests have attractive theoretical properties and demonstrate the superior performance via extensive simulation results. We apply the two new tests to analyze the weekly returns on the securities in the S\&P 500 index under the Fama-French three-factor model, and confirm the usefulness of the proposed combined test in detecting cross-sectional independence.


title: Quadcopter Trajectory Time Minimization and Robust Collision Avoidance via Optimal Time Allocation

abstract: Autonomous navigation requires robots to generate trajectories for collision avoidance efficiently. Although plenty of previous works have proven successful in generating smooth and spatially collision-free trajectories, their solutions often suffer from suboptimal time efficiency and potential unsafety, particularly when accounting for uncertainties in robot perception and control. To address this issue, this paper presents the Robust Optimal Time Allocation (ROTA) framework. This framework is designed to optimize the time progress of the trajectories temporally, serving as a post-processing tool to enhance trajectory time efficiency and safety under uncertainties. In this study, we begin by formulating a non-convex optimization problem aimed at minimizing trajectory execution time while incorporating constraints on collision probability as the robot approaches obstacles. Subsequently, we introduce the concept of the trajectory braking zone and adopt the chance-constrained formulation for robust collision avoidance in the braking zones. Finally, the non-convex optimization problem is reformulated into a second-order cone programming problem to achieve real-time performance. Through simulations and physical flight experiments, we demonstrate that the proposed approach effectively reduces trajectory execution time while enabling robust collision avoidance in complex environments.


title: Efficient and robust Sensor Placement in Complex Environments

abstract: We address the problem of efficient and unobstructed surveillance or communication in complex environments. On one hand, one wishes to use a minimal number of sensors to cover the environment. On the other hand, it is often important to consider solutions that are robust against sensor failure or adversarial attacks. This paper addresses these challenges of designing minimal sensor sets that achieve multi-coverage constraints -- every point in the environment is covered by a prescribed number of sensors. We propose a greedy algorithm to achieve the objective. Further, we explore deep learning techniques to accelerate the evaluation of the objective function formulated in the greedy algorithm. The training of the neural network reveals that the geometric properties of the data significantly impact the network's performance, particularly at the end stage. By taking into account these properties, we discuss the differences in using greedy and $\epsilon$-greedy algorithms to generate data and their impact on the robustness of the network.


title: Towards Robust Continual Learning with Bayesian Adaptive Moment Regularization

abstract: The pursuit of long-term autonomy mandates that robotic agents must continuously adapt to their changing environments and learn to solve new tasks. Continual learning seeks to overcome the challenge of catastrophic forgetting, where learning to solve new tasks causes a model to forget previously learnt information. Prior-based continual learning methods are appealing for robotic applications as they are space efficient and typically do not increase in computational complexity as the number of tasks grows. Despite these desirable properties, prior-based approaches typically fail on important benchmarks and consequently are limited in their potential applications compared to their memory-based counterparts. We introduce Bayesian adaptive moment regularization (BAdam), a novel prior-based method that better constrains parameter growth, leading to lower catastrophic forgetting. Our method boasts a range of desirable properties for robotic applications such as being lightweight and task label-free, converging quickly, and offering calibrated uncertainty that is important for safe real-world deployment. Results show that BAdam achieves state-of-the-art performance for prior-based methods on challenging single-headed class-incremental experiments such as Split MNIST and Split FashionMNIST, and does so without relying on task labels or discrete task boundaries.


title: Complex localization mechanisms in networks of coupled oscillators: two case studies

abstract: Localized phenomena abound in nature and throughout the physical sciences. Some universal mechanisms for localization have been characterized, such as in the snaking bifurcations of localized steady states in pattern-forming partial differential equations. While much of this understanding has been targeted at steady states, recent studies have noted complex dynamical localization phenomena in systems of coupled oscillators. These localized states can come in the form of symmetry-breaking chimera patterns that exhibit a coexistence of coherence and incoherence in symmetric networks of coupled oscillators and gap solitons emerging in the band gap of parametrically driven networks of oscillators. Here, we report detailed numerical continuations of localized time-periodic states in systems of coupled oscillators, while also documenting the numerous bifurcations they give way to. We find novel routes to localization involving bifurcations of heteroclinic cycles in networks of Janus oscillators and strange bifurcation diagrams resembling chaotic tangles in a parametrically driven array of coupled pendula. We highlight the important role of discrete symmetries and the symmetric branch points that emerge in symmetric models.


title: On the maximum second eigenvalue of outerplanar graphs

abstract: For a fixed integer $k$ and a graph $G$, let $\lambda_k(G)$ denote the $k$-th largest eigenvalue of the adjacency matrix of $G$. In 2017, Tait and Tobin proved that the maximum $\lambda_1(G)$ among all connected outerplanar graphs on $n$ vertices is achieved by the fan graph $K_1\vee P_{n-1}$. In this paper, we consider a similar problem of determining the maximum $\lambda_2$ among all connected outerplanar graphs on $n$ vertices. For $n$ even and sufficiently large, we prove that the maximum $\lambda_2$ is uniquely achieved by the graph $(K_1\vee P_{n/2-1})\!\!-\!\!(K_1\vee P_{n/2-1})$, which is obtained by connecting two disjoint copies of $(K_1\vee P_{n/2-1})$ through a new edge at their ends. When $n$ is odd and sufficiently large, the extremal graphs are not unique. The extremal graphs are those graphs $G$ that contains a cut vertex $u$ such that $G\setminus \{u\}$ is isomorphic to $2(K_1\vee P_{n/2-1})$. We also determine the maximum $\lambda_2$ among all 2-connected outerplanar graphs and asymptotically determine the maximum of $\lambda_k(G)$ among all connected outerplanar graphs for general $k$.


title: HINT: Healthy Influential-Noise based Training to Defend against Data Poisoning Attacks

abstract: While numerous defense methods have been proposed to prohibit potential poisoning attacks from untrusted data sources, most research works only defend against specific attacks, which leaves many avenues for an adversary to exploit. In this work, we propose an efficient and robust training approach to defend against data poisoning attacks based on influence functions, named Healthy Influential-Noise based Training. Using influence functions, we craft healthy noise that helps to harden the classification model against poisoning attacks without significantly affecting the generalization ability on test data. In addition, our method can perform effectively when only a subset of the training data is modified, instead of the current method of adding noise to all examples that has been used in several previous works. We conduct comprehensive evaluations over two image datasets with state-of-the-art poisoning attacks under different realistic attack scenarios. Our empirical results show that HINT can efficiently protect deep learning models against the effect of both untargeted and targeted poisoning attacks.


title: Variational and stability properties of coupled NLS equations on the star graph

abstract: We consider variational and stability properties of a system of two coupled nonlinear Schr\"{o}dinger equations on the star graph $\Gamma$ with the $\delta$ coupling at the vertex of $\Gamma$. The first part is devoted to the proof of an existence of the ground state as the minimizer of the constrained energy in the cubic case. This result extends the one obtained recently for the coupled NLS equations on the line. In the second part, we study stability properties of several families of standing waves in the case of a general power nonlinearity. In particular, we study one-component standing waves $e^{i\omega t}(\Phi_1(x), 0)$ and $e^{i\omega t}(0, \Phi_2(x))$. Moreover, we study two-component standing waves $e^{i\omega t}(\Phi(x), \Phi(x))$ for the case of power nonlinearity depending on a unique power parameter $p$. To our knowledge, these are the first results on variational and stability properties of coupled NLS equations on graphs.


title: Augmenting conformers with structured state-space sequence models for online speech recognition

abstract: Online speech recognition, where the model only accesses context to the left, is an important and challenging use case for ASR systems. In this work, we investigate augmenting neural encoders for online ASR by incorporating structured state-space sequence models (S4), a family of models that provide a parameter-efficient way of accessing arbitrarily long left context. We performed systematic ablation studies to compare variants of S4 models and propose two novel approaches that combine them with convolutions. We found that the most effective design is to stack a small S4 using real-valued recurrent weights with a local convolution, allowing them to work complementarily. Our best model achieves WERs of 4.01%/8.53% on test sets from Librispeech, outperforming Conformers with extensively tuned convolution.


title: Scattering of surface waves by inhomogeneities in crystalline structures

abstract: In current scientific and technological scenario, studies of transmittance of surface waves across structured interfaces have gained some wind amidst applications to metasurfaces, electronic edge-waves, crystal grain boundaries, etc. The results presented in the present article shed a light on the influence of material inhomogeneities on propagation of surface waves. Within the framework of classical mechanics, an analog of Gurtin-Murdoch model is employed where elastic properties on surface are assumed to be distinct from bulk. Restricting to scalar waves on prototype square lattice half-plane, particles on considered structured surface have piecewise-constant mass and surface force-constants across an interfacial point. Particles in bulk lattice interact with nearest neighbours in a way that involves unequal force-constants parallel to surface versus normal to it. A surface wave band exists for such lattice structure wherein the waveform decays exponentially inside half-plane. A formula for surface wave transmittance is given based on an exact solution on half-plane, and, thus, previous work of Sharma & Eremeyev 2019 Int. J. Eng. Sci. 143, 33-38 is extended. An explicit expression for fraction of energy influx leaked via bulk waves is a highlight. Included are graphical results for several illustrative values of surface structure parameters.


title: Update on Sidon-Ramsey numbers

abstract: We provide two new exact Sidon-Ramsey numbers to the list known so far. We also improve the upper bounds of the next two Sidon-Ramsey numbers. In doing so, we comment on the tendencies we found on the Sidon-Ramsey partitions that were studied to obtain these results.


title: General Parallel Cosmology

abstract: General (tele)parallel Relativity, G$_\parallel$R, is the relativistic completion of Einstein's theories of gravity. The focus of this article is the derivation of the homogeneous and isotropic solution in G$_\parallel$R. The first-principles derivation, based on a non-trivial realisation of the symmetry, supersedes and unifies previous constructions of Riemannian and teleparallel cosmologies, and establishes the uniqueness of the physical solution. The constitutive law and the form of the material and inertial source currents is presented in the tensor (Palatini) formalism and adapted to the cosmological background, which exhibits novel features absent in the previously studied, static solutions to the theory. The results are contrasted with those in some incomplete theories, such as sitting at the three corners of the geometrical trinity and corresponding to particular reference frames in G$_\parallel$R.


title: Enhancing scientific exploration of the deep sea through shared autonomy in remote manipulation

abstract: Shared autonomy enables novice remote users to conduct deep-ocean science operations with robotic manipulators.


title: High-Dimensional Bernstein Von-Mises Theorems for Covariance and Precision Matrices

abstract: This paper aims to examine the characteristics of the posterior distribution of covariance/precision matrices in a "large $p$, large $n$" scenario, where $p$ represents the number of variables and $n$ is the sample size. Our analysis focuses on establishing asymptotic normality of the posterior distribution of the entire covariance/precision matrices under specific growth restrictions on $p_n$ and other mild assumptions. In particular, the limiting distribution turns out to be a symmetric matrix variate normal distribution whose parameters depend on the maximum likelihood estimate. Our results hold for a wide class of prior distributions which includes standard choices used by practitioners. Next, we consider Gaussian graphical models which induce sparsity in the precision matrix. Asymptotic normality of the corresponding posterior distribution is established under mild assumptions on the prior and true data-generating mechanism.


title: The thermodynamic cost of choosing

abstract: Choice can be defined in thermodynamical terms and be shown to have a thermodynamic cost: choosing between a binary alternative at temperature T dissipates an energy E > kT ln 2.


title: A modern approach to transition analysis and process mining with Markov models: A tutorial with R

abstract: This chapter presents an introduction to Markovian modeling for the analysis of sequence data. Contrary to the deterministic approach seen in the previous sequence analysis chapters, Markovian models are probabilistic models, focusing on the transitions between states instead of studying sequences as a whole. The chapter provides an introduction to this method and differentiates between its most common variations: first-order Markov models, hidden Markov models, mixture Markov models, and mixture hidden Markov models. In addition to a thorough explanation and contextualization within the existing literature, the chapter provides a step-by-step tutorial on how to implement each type of Markovian model using the R package seqHMM. The chaper also provides a complete guide to performing stochastic process mining with Markovian models as well as plotting, comparing and clustering different process models.


title: Towards reliable predictive analytics: a generalized calibration framework

abstract: Calibration is a pivotal aspect in predictive modeling, as it ensures that the predictions closely correspond with what we observe empirically. The contemporary calibration framework, however, is predominantly focused on prediction models where the outcome is a binary variable. We extend the logistic calibration framework to the generalized calibration framework which includes all members of the exponential family of distributions. We propose two different methods to estimate the calibration curve in this setting, a generalized linear model and a non-parametric smoother. In addition, we define two measures that summarize the calibration performance. The generalized calibration slope which quantifies the amount of over- or underfitting and the generalized calibration slope or calibration-in-the-large that measures the agreement between the global empirical average and the average predicted value. We provide an illustrative example using a simulated data set and hereby show how we can utilize the generalized calibration framework to assess the calibration of different types of prediction models.


title: Deep Reinforcement Learning for Efficient and Fair Allocation of Health Care Resources

abstract: Scarcity of health care resources could result in the unavoidable consequence of rationing. For example, ventilators are often limited in supply, especially during public health emergencies or in resource-constrained health care settings, such as amid the pandemic of COVID-19. Currently, there is no universally accepted standard for health care resource allocation protocols, resulting in different governments prioritizing patients based on various criteria and heuristic-based protocols. In this study, we investigate the use of reinforcement learning for critical care resource allocation policy optimization to fairly and effectively ration resources. We propose a transformer-based deep Q-network to integrate the disease progression of individual patients and the interaction effects among patients during the critical care resource allocation. We aim to improve both fairness of allocation and overall patient outcomes. Our experiments demonstrate that our method significantly reduces excess deaths and achieves a more equitable distribution under different levels of ventilator shortage, when compared to existing severity-based and comorbidity-based methods in use by different governments. Our source code is included in the supplement and will be released on Github upon publication.


title: Open-vocabulary Keyword-spotting with Adaptive Instance Normalization

abstract: Open vocabulary keyword spotting is a crucial and challenging task in automatic speech recognition (ASR) that focuses on detecting user-defined keywords within a spoken utterance. Keyword spotting methods commonly map the audio utterance and keyword into a joint embedding space to obtain some affinity score. In this work, we propose AdaKWS, a novel method for keyword spotting in which a text encoder is trained to output keyword-conditioned normalization parameters. These parameters are used to process the auditory input. We provide an extensive evaluation using challenging and diverse multi-lingual benchmarks and show significant improvements over recent keyword spotting and ASR baselines. Furthermore, we study the effectiveness of our approach on low-resource languages that were unseen during the training. The results demonstrate a substantial performance improvement compared to baseline methods.


title: Model Calibration and Validation From A Statistical Inference Perspective

abstract: Despite the general consensus in transport research community that model calibration and validation are necessary to enhance model predictive performance, there exist significant inconsistencies in the literature. This is primarily due to a lack of consistent definitions, and a unified and statistically sound framework. In this paper, we provide a general and rigorous formulation of the model calibration and validation problem, and highlight its relation to statistical inference. We also conduct a comprehensive review of the steps and challenges involved, as well as point out inconsistencies, before providing suggestions on improving the current practices. This paper is intended to help the practitioners better understand the nature of model calibration and validation, and to promote statistically rigorous and correct practices. Although the examples are drawn from a transport research background - and that is our target audience - the content in this paper is equally applicable to other modelling contexts.


title: Thermal conductivity tensor of $\beta$-HMX as a function of pressure and temperature from equilibrium molecular dynamics simulations

abstract: We apply the Green-Kubo (G-K) approach to obtain the thermal conductivity tensor of $\beta$-1,3,5,7-tetranitro-1,3,5,7-tetrazocane ($\beta$-HMX) as a function of pressure and temperature from equilibrium molecular dynamics (MD) simulations. Direct application of the G-K formula exhibits slow convergence of the integrated thermal conductivity values even for long (120 ns) accumulated simulation times. To partially mitigate this slow convergence, we apply a recently implemented numerical procedure [Int. J. Heat Mass Trans. 188, 122647 (2022)] that involves physically justified filtering of the MD-calculated G-K heat current and fitting the integrated time-dependent thermal conductivity to a physically motivated double-exponential function. The thermal conductivity tensor was determined for pressures 1 atm $ \leq P \leq $ 30 GPa and temperatures 300 K $\leq T \leq$ 900 K. The thermal conductivity ${\kappa}^{\alpha \beta} (T,P)$ increases with increasing pressure, by approximately an order of magnitude over the interval considered, and decreases with increasing temperature. The MD predictions are compared to experimental and other theoretically determined values for the thermal conductivity of ${\beta}$-HMX. A simple, semi-empirical fitting form is proposed that captures the behavior of $\kappa^{\alpha \alpha} (T,P)$ over the pressure and temperature intervals studied.


title: The Impact of Different Backbone Architecture on Autonomous Vehicle Dataset

abstract: Object detection is a crucial component of autonomous driving, and many detection applications have been developed to address this task. These applications often rely on backbone architectures, which extract representation features from inputs to perform the object detection task. The quality of the features extracted by the backbone architecture can have a significant impact on the overall detection performance. Many researchers have focused on developing new and improved backbone architectures to enhance the efficiency and accuracy of object detection applications. While these backbone architectures have shown state-of-the-art performance on generic object detection datasets like MS-COCO and PASCAL-VOC, evaluating their performance under an autonomous driving environment has not been previously explored. To address this, our study evaluates three well-known autonomous vehicle datasets, namely KITTI, NuScenes, and BDD, to compare the performance of different backbone architectures on object detection tasks.


title: How Transferable are Attribute Controllers on Pretrained Multilingual Translation Models?

abstract: Customizing machine translation models to comply with desired attributes (e.g., formality or grammatical gender) is a well-studied topic. However, most current approaches rely on (semi-)supervised data with attribute annotations. This data scarcity bottlenecks democratizing such customization possibilities to a wider range of languages, particularly lower-resource ones. This gap is out of sync with recent progress in pretrained massively multilingual translation models. In response, we transfer the attribute controlling capabilities to languages without attribute-annotated data with an NLLB-200 model as a foundation. Inspired by techniques from controllable generation, we employ a gradient-based inference-time controller to steer the pretrained model. The controller transfers well to zero-shot conditions, as it operates on pretrained multilingual representations and is attribute -- rather than language-specific. With a comprehensive comparison to finetuning-based control, we demonstrate that, despite finetuning's clear dominance in supervised settings, the gap to inference-time control closes when moving to zero-shot conditions, especially with new and distant target languages. The latter also shows stronger domain robustness. We further show that our inference-time control complements finetuning. A human evaluation on a real low-resource language, Bengali, confirms our findings. Our code is https://github.com/dannigt/attribute-controller-transfer


title: Sharp higher order Admas' inequality with exact growth condition on weighted Sobolev spaces

abstract: This paper introduces a novel higher order Adams inequality that incorporates an exact growth condition for a class of weighted Sobolev spaces. Our rigorous proof confirms the validity of this inequality and provides insights into the optimal nature of the critical constant and the exponent within the denominator. Furthermore, we apply this inequality to study a class of ordinary differential equations (ODEs), where we successfully derive both a concept of the weak solution and a comprehensive regularity theory.