title: Individual Causation with Biased Data

abstract: We consider the problem of assessing whether, in an individual case, there is a causal relationship between an observed exposure and a response variable. When data are available on similar individuals we may be able to estimate prospective probabilities, but even under ideal conditions these are typically inadequate to identify the "probability of causation": instead we can only derive bounds for this. These bounds can be improved or amended when we have information on additional variables, such as mediators or covariates. When a covariate is unobserved or ignored, this will typically lead to biased inferences. We show by examples how serious such biases can be.


title: MCMC to address model misspecification in Deep Learning classification of Radio Galaxies

abstract: The radio astronomy community is adopting deep learning techniques to deal with the huge data volumes expected from the next-generation of radio observatories. Bayesian neural networks (BNNs) provide a principled way to model uncertainty in the predictions made by deep learning models and will play an important role in extracting well-calibrated uncertainty estimates from the outputs of these models. However, most commonly used approximate Bayesian inference techniques such as variational inference and MCMC-based algorithms experience a "cold posterior effect (CPE)", according to which the posterior must be down-weighted in order to get good predictive performance. The CPE has been linked to several factors such as data augmentation or dataset curation leading to a misspecified likelihood and prior misspecification. In this work we use MCMC sampling to show that a Gaussian parametric family is a poor variational approximation to the true posterior and gives rise to the CPE previously observed in morphological classification of radio galaxies using variational inference based BNNs.


title: Language and Sketching: An LLM-driven Interactive Multimodal Multitask Robot Navigation Framework

abstract: The socially-aware navigation system has evolved to adeptly avoid various obstacles while performing multiple tasks, such as point-to-point navigation, human-following, and -guiding. However, a prominent gap persists: in Human-Robot Interaction (HRI), the procedure of communicating commands to robots demands intricate mathematical formulations. Furthermore, the transition between tasks does not quite possess the intuitive control and user-centric interactivity that one would desire. In this work, we propose an LLM-driven interactive multimodal multitask robot navigation framework, termed LIM2N, to solve the above new challenge in the navigation field. We achieve this by first introducing a multimodal interaction framework where language and hand-drawn inputs can serve as navigation constraints and control objectives. Next, a reinforcement learning agent is built to handle multiple tasks with the received information. Crucially, LIM2N creates smooth cooperation among the reasoning of multimodal input, multitask planning, and adaptation and processing of the intelligent sensing modules in the complicated system. Extensive experiments are conducted in both simulation and the real world demonstrating that LIM2N has superior user needs understanding, alongside an enhanced interactive experience.


title: TENT: Connect Language Models with IoT Sensors for Zero-Shot Activity Recognition

abstract: Recent achievements in language models have showcased their extraordinary capabilities in bridging visual information with semantic language understanding. This leads us to a novel question: can language models connect textual semantics with IoT sensory signals to perform recognition tasks, e.g., Human Activity Recognition (HAR)? If so, an intelligent HAR system with human-like cognition can be built, capable of adapting to new environments and unseen categories. This paper explores its feasibility with an innovative approach, IoT-sEnsors-language alignmEnt pre-Training (TENT), which jointly aligns textual embeddings with IoT sensor signals, including camera video, LiDAR, and mmWave. Through the IoT-language contrastive learning, we derive a unified semantic feature space that aligns multi-modal features with language embeddings, so that the IoT data corresponds to specific words that describe the IoT data. To enhance the connection between textual categories and their IoT data, we propose supplementary descriptions and learnable prompts that bring more semantic information into the joint feature space. TENT can not only recognize actions that have been seen but also ``guess'' the unseen action by the closest textual words from the feature space. We demonstrate TENT achieves state-of-the-art performance on zero-shot HAR tasks using different modalities, improving the best vision-language models by over 12%.


title: A calculation method to estimate thermal conductivity of high entropy ceramic for thermal barrier coatings

abstract: High entropy ceramics are highly promising as next generation thermal barrier coatings due to their unique disorder structure, which imparts ultra-low thermal conductivity and good high temperature stability. Unlike traditional ceramic materials, the thermal resistance in high entropy ceramics predominantly arises from phonon-disorder scattering rather than phonon-phonon interactions. In this study, we propose a calculation method based on the supercell phonon unfolding (SPU) technique to predict the thermal conductivity of high entropy ceramics, specially focusing on rocksalt oxides structures. Our prediction method relies on using the reciprocal value of SPU phonon spectra linewidth as an indicator of phonon lifetime. The obtained results demonstrate a strong agreement between the predicted thermal conductivities and the experimental measurements, validating the feasibility of our calculation method. Furthermore, we extensively investigate and discuss the atomic relaxation and lattice distortion effects in 5-dopants and 6-dopants rocksalt structures during the process.


title: The enigmatic multiple star VV Ori

abstract: New photometry, including TESS data, have been combined with recent spectroscopic observations of the Orion Ib pulsating triple-star system VV Ori. This yields a revised set of absolute parameters with increased precision. Two different programs were utilized for the light curve analysis, with results in predictably close agreement. The agreement promotes confidence in the analysis procedures. The spectra were analysed using the {\sc FDBinary} program. The main parameters are as follows: $M_1 = 11.6 \pm 0.14$ and $M_2 = 4.8 \pm 0.06$ (M$_\odot$). We estimate an approximate mass of the wide companion as $M_3 = 2.0 \pm 0.3$ M$_\odot$. Similarly, $R_{1} = 5.11 \pm 0.03$, $R_2 = 2.51 \pm 0.02$, $R_3 = 1.8 \pm 0.1$ (R$_\odot$); $T_{\rm e 1} = 26600 \pm 300$, $T_{\rm e 2} = 16300 \pm 400$ and $T_{\rm e 3} = 10000 \pm 1000$ (K). The close binary's orbital separation is $a= 13.91$ (R$_\odot$); its age is $8 \pm 2$ (Myr) and its photometric distance is $396 \pm 7$ pc. The primary's $\beta$ Cep type oscillations support these properties and confirm our understanding of its evolutionary status. Examination of the well-defined $\lambda$6678 He I profiles reveals the primary to have a significantly low projected rotation: some 80\% of the synchronous value. This can be explained on the basis of the precession of an unaligned spin axis. This proposal can resolve also observed variations of the apparent inclination and address other longer-term irregularities of the system reported in the literature. This topic invites further observations and follow-up theoretical study of the dynamics of this intriguing young multiple star.


title: Bichromatic phase-control of interfering Autler-Townes spectra

abstract: We propose a new scheme to control the shape of the Autler-Townes (AT) doublet in the photoelectron spectrum from atomic resonance-enhanced multiphoton ionization (REMPI). The scheme is based on the interference of two AT doublets created by ionization of the strongly driven atom from the ground and the resonantly excited state using tailored bichromatic femtosecond (fs) laser pulses. In this scheme, the quantum phase of the photoelectrons is crucial for the manipulation of the AT doublet. The laser polarization state and the relative optical phase between the two colors are used to manipulate the interference pattern. We develop an analytical model to describe the bichromatic REMPI process and provide a physical picture of the control mechanism. To validate the model, the results are compared to an ab initio calculation based on the solution of the 2D time-dependent Schr\"odinger equation for the non-perturbative interaction of an atom with intense polarization-shaped bichromatic fs-laser pulses. Our results indicate that the control mechanism is robust with respect to the laser intensity facilitating its experimental observation.


title: On Using Distribution-Based Compositionality Assessment to Evaluate Compositional Generalisation in Machine Translation

abstract: Compositional generalisation (CG), in NLP and in machine learning more generally, has been assessed mostly using artificial datasets. It is important to develop benchmarks to assess CG also in real-world natural language tasks in order to understand the abilities and limitations of systems deployed in the wild. To this end, our GenBench Collaborative Benchmarking Task submission utilises the distribution-based compositionality assessment (DBCA) framework to split the Europarl translation corpus into a training and a test set in such a way that the test set requires compositional generalisation capacity. Specifically, the training and test sets have divergent distributions of dependency relations, testing NMT systems' capability of translating dependencies that they have not been trained on. This is a fully-automated procedure to create natural language compositionality benchmarks, making it simple and inexpensive to apply it further to other datasets and languages. The code and data for the experiments is available at https://github.com/aalto-speech/dbca.


title: Audit fees in auditor switching

abstract: The auditor work is examining that a company's financial statements faithfully reflect its financial situation. His wage, the audit fees, are not fixed among all companies, but can be affected by the financial and structural characteristics of the company, as well as the characteristics of the firm he belongs to. Another factor that may affect his wage in an auditor switching, which can be resulted from changes in the company that may influence the fees. This paper examines the effect nature of the auditor switching on his wage, and the factors of the company characteristics and the economy data which determine the wage at switching. A product of the research are tools for predicting and evaluating the auditor wage at switching. These tools are important for the auditor himself, but also for the company manager to correctly determine the wage due to the possibility that the quality of the audit work depends on its fees. Two main results are obtained. First, the direction of the wage change in the switching year depends on the economic stability of the economy. Second, the switching effect on the direction and the change size in wage depends on the change size in the company characteristics before and after switching - a large change versus a stable one. We get that forecasting the change size in wage for companies with a larger change is their characteristics is paralleled to forecasting a wage increasing. And vice versa, forecasting the change size in wage for companies with a stable change in their characteristics is paralleled to forecasting a wage decreasing. But, whereas the former can be achieved based on the company characteristics and macroeconomics factors, the predictably of these characteristics and factors is negligible for the letter.


title: Heavy quark dominance in orbital excitation of singly and doubly heavy baryons

abstract: A mechanism of the heavy quark dominance in the orbital excitation is proposed in this paper which is testified to be reasonable for singly and doubly heavy baryons. In the relativistic quark model, an analysis of the Hamiltonian figures out the mechanism that the excitation mode with lower energy levels is always associated with the heavy quark(s), and the splitting of the energy levels is suppressed by the heavy quark(s). So, the heavy quarks dominate the orbital excitation of singly and doubly heavy baryons. Furthermore, a physical understanding of this mechanism is given in a semi-classical way. Accordingly, the predicted mass spectra of singly and doubly heavy baryons confirm the rationality of this mechanism. In addition, an interesting consequence of this mechanism is that a heavy-light meson is more likely to be produced in the strong decay of the high-orbital excited states, which is supported by experiments. This mechanism is rooted in the breakdown of the mass symmetry. Therefore, it may be also valid for other multi-quark systems, such as the tetraquarks Qqqq and QQqq, or the pentaquarks Qqqqq and QQqqq.


title: REST: Retrieval-Based Speculative Decoding

abstract: We introduce Retrieval-Based Speculative Decoding (REST), a novel algorithm designed to speed up language model generation. The key insight driving the development of REST is the observation that the process of text generation often includes certain common phases and patterns. Unlike previous methods that rely on a draft language model for speculative decoding, REST harnesses the power of retrieval to generate draft tokens. This method draws from the reservoir of existing knowledge, retrieving and employing relevant tokens based on the current context. Its plug-and-play nature allows for seamless integration and acceleration of any language models, all without necessitating additional training. When benchmarked on 7B and 13B language models in a single-batch setting, REST achieves a significant speedup of 1.62X to 2.36X on code or text generation. The code of REST is available at https://github.com/FasterDecoding/REST.


title: The Impact of Dust on Cepheid and Type Ia Supernova Distances

abstract: Milky-Way and intergalactic dust extinction and reddening must be accounted for in measurements of distances throughout the universe. This work provides a comprehensive review of the various impacts of cosmic dust focusing specifically on its effects on two key distance indicators used in the distance ladder: Cepheid variable stars and Type Ia supernovae. We review the formalism used for computing and accounting for dust extinction and reddening as a function of wavelength. We also detail the current state of the art knowledge of dust properties in the Milky Way and in host galaxies. We discuss how dust has been accounted for in both the Cepheid and SN distance measurements. Finally, we show how current uncertainties on dust modeling impact the inferred luminosities and distances, but that measurements of the Hubble constant remain robust to these uncertainties.


title: Identifiable and interpretable nonparametric factor analysis

abstract: Factor models have been widely used to summarize the variability of high-dimensional data through a set of factors with much lower dimensionality. Gaussian linear factor models have been particularly popular due to their interpretability and ease of computation. However, in practice, data often violate the multivariate Gaussian assumption. To characterize higher-order dependence and nonlinearity, models that include factors as predictors in flexible multivariate regression are popular, with GP-LVMs using Gaussian process (GP) priors for the regression function and VAEs using deep neural networks. Unfortunately, such approaches lack identifiability and interpretability and tend to produce brittle and non-reproducible results. To address these problems by simplifying the nonparametric factor model while maintaining flexibility, we propose the NIFTY framework, which parsimoniously transforms uniform latent variables using one-dimensional nonlinear mappings and then applies a linear generative model. The induced multivariate distribution falls into a flexible class while maintaining simple computation and interpretation. We prove that this model is identifiable and empirically study NIFTY using simulated data, observing good performance in density estimation and data visualization. We then apply NIFTY to bird song data in an environmental monitoring application.


title: Neural Dynamics of Delayed Feedback in Robot Teleoperation: Insights from fNIRS Analysis

abstract: As robot teleoperation increasingly becomes integral in executing tasks in distant, hazardous, or inaccessible environments, the challenge of operational delays remains a significant obstacle. These delays are inherent in signal transmission and processing and can adversely affect the operators performance, particularly in tasks requiring precision and timeliness. While current research has made strides in mitigating these delays through advanced control strategies and training methods, a crucial gap persists in understanding the neurofunctional impacts of these delays and the efficacy of countermeasures from a cognitive perspective. Our study narrows this gap by leveraging functional Near-Infrared Spectroscopy (fNIRS) to examine the neurofunctional implications of simulated haptic feedback on cognitive activity and motor coordination under delayed conditions. In a human-subject experiment (N=41), we manipulated sensory feedback to observe its influences on various brain regions of interest (ROIs) response during teleoperation tasks. The fNIRS data provided a detailed assessment of cerebral activity, particularly in ROIs implicated in time perception and the execution of precise movements. Our results reveal that certain conditions, which provided immediate simulated haptic feedback, significantly optimized neural functions related to time perception and motor coordination, and improved motor performance. These findings provide empirical evidence about the neurofunctional basis of the enhanced motor performance with simulated synthetic force feedback in the presence of teleoperation delays.


title: Consensus and Disagreement: Information Aggregation under (not so) Naive Learning

abstract: We explore a model of non-Bayesian information aggregation in networks. Agents non-cooperatively choose among Friedkin-Johnsen type aggregation rules to maximize payoffs. The DeGroot rule is chosen in equilibrium if and only if there is noiseless information transmission, leading to consensus. With noisy transmission, while some disagreement is inevitable, the optimal choice of rule amplifies the disagreement: even with little noise, individuals place substantial weight on their own initial opinion in every period, exacerbating the disagreement. We use this framework to think about equilibrium versus socially efficient choice of rules and its connection to polarization of opinions across groups.


title: Temperature Dependence of Spin Pumping in Ni81Fe19/NbN Bilayer Thin Films

abstract: We present a comprehensive study of broadband spin pumping utilizing the inverse spin Hall effect phenomena in bilayer samples comprising Ni81Fe19 (15 nm) and NbN (with NbN thickness varying from 20 nm to 140 nm), conducted over a temperature and frequency range spanning from 300 K to 4 K and 2 GHz to 12 GHz, respectively. Our investigations reveal a systematic shift in ferromagnetic resonance fields, amplitude, and line widths as functions of both frequency and temperature. Notably, we observed a temperature-dependent increase in the spin Hall angle value, surpassing previously reported values. Furthermore, our results demonstrate a pronounced temperature dependence in the inverse spin Hall effect voltage, exhibiting a significant reduction below the Tc. This reduction in inverse spin Hall effect voltage is accompanied by an increase in the linewidth of the ferromagnetic resonance mode.


title: Unprecedented reach and rich online journeys drive hate and extremism globally

abstract: Hate and extremism cannot be controlled globally without understanding how they operate at scale. Both have escalated dramatically during the Israel-Hamas and Ukraine-Russia wars. Here we show how the online hate-extremism system is now operating at unprecedented scale across 26 social media platforms of all sizes, audience demographics, and geographic locations; and we analyze individuals' journeys through it. This new picture contradicts notions of rabbit-hole activity at the fringe of the Internet. Instead, it shows that hate-extremism support now enjoys a direct link to more than a billion of the general global population, and that newcomers now enjoy a rich variety of online journey experiences during which they get to mingle with experienced violent actors, discuss topics from diverse news sources, and learn to collectively adapt in order to bypass platform shutdowns. Our results mean that law enforcement must expect future mass shooters to have increasingly hard-to-understand online journeys; that new E.U. laws will fall short because the combined impact of many smaller, lesser-known platforms outstrips larger ones like Twitter; and that the current global hate-extremism infrastructure will become increasingly robust in 2024 and beyond. Fortunately, it also reveals a new opportunity for system-wide control akin to adaptive vs. extinction treatments for cancer.


title: High-rate tests on Resistive Plate Chambers operated with eco-friendly gas mixtures

abstract: Results obtained by the RPC ECOgas@GIF++ Collaboration, using Resistive Plate Chambers operated with new, eco-friendly gas mixtures, based on Tetrafluoropropene and carbon dioxide, are shown and discussed in this paper. Tests aimed to assess the performance of this kind of detectors in high-irradiation conditions, analogous to the ones foreseen for the coming years at the Large Hadron Collider experiments, were performed, and demonstrate a performance basically similar to the one obtained with the gas mixtures currently in use, based on Tetrafluoroethane, which is being progressively phased out for its possible contribution to the greenhouse effect. Long term aging tests are also being carried out, with the goal to demonstrate the possibility of using these eco-friendly gas mixtures during the whole High Luminosity phase of the Large Hadron Collider.


title: Radioactive Decay of Specific Heavy Elements as an Energy Source for Late-Time Kilonovae and Potential JWST Observations

abstract: Revealing the temporal evolution of individual heavy elements synthesized in the merger ejecta from binary neutron star mergers not only improves our understanding of the origin of heavy elements beyond iron but also clarifies the energy sources of kilonovae. In this work, we present a comprehensive analysis of the temporal evolution of the energy fraction of each nuclide based on the $r$-process nucleosynthesis simulations. The heavy elements dominating the kilonova emission within $\sim100$~days are identified, including $^{127}$Sb, $^{128}$Sb, $^{129}$Sb, $^{130}$Sb, $^{129}$Te, $^{132}$I, $^{222}$Rn, $^{223}$Ra, $^{224}$Ra, and $^{225}$Ac. It is found that the late-time kilonova light curve ($t\gtrsim20$~days) is highly sensitive to the presence of the heavy element $^{225}$Ac (with a half-life of 10.0~days). Our analysis shows that the James Webb Space Telescope (JWST), with its high sensitivity in the near-infrared band, is a powerful instrument for the identification of these specific heavy elements.


title: Translation of Gulmanelli's seminar notes "On a theory of isotopic spin" (1954)

abstract: An integral translation of Paolo Gulmanelli's seminar notes "Su una teoria dello spin isotopico" (Casa Editrice, Milano, 1957) is presented. This is the only exposition that contains all elements of Pauli's attempt at a non-Abelian Kaluza-Klein theory in 1953.


title: Effects of heterogeneous opinion interactions in many-agent systems for epidemic dynamics

abstract: In this work we define a kinetic model for understanding the impact of heterogeneous opinion formation dynamics on epidemics. The considered many-agent system is characterized by nonsymmetric interactions which define a coupled system of kinetic equations for the evolution of the opinion density in each compartment. In the quasi-invariant limit we may show positivity and uniqueness of the solution of the problem together with its convergence towards an equilibrium distribution exhibiting bimodal shape. The tendency of the system towards opinion clusters is further analyzed by means of numerical methods, which confirm the consistency of the kinetic model with its moment system whose evolution is approximated in several regimes of parameters.


title: Fast Chain-of-Thought: A Glance of Future from Parallel Decoding Leads to Answers Faster

abstract: In this work, we propose FastCoT, a model-agnostic framework based on parallel decoding without any further training of an auxiliary model or modification to the LLM itself. FastCoT uses a size-varying context window whose size changes with position to conduct parallel decoding and auto-regressive decoding simultaneously, thus fully utilizing GPU computation resources. In FastCoT, the parallel decoding part provides the LLM with a quick glance of the future composed of approximate tokens, which could lead to faster answers compared to regular autoregressive decoding used by causal transformers. We also provide an implementation of parallel decoding within LLM, which supports KV-cache generation and batch processing. Through extensive experiments, we demonstrate that FastCoT saves inference time by nearly 20% with only a negligible performance drop compared to the regular approach. Additionally, we show that the context window size exhibits considerable robustness for different tasks.


title: Dissipative dynamics for infinite lattice systems

abstract: We study dissipative dynamics constructed by means of non-commutative Dirichlet forms for various lattice systems with multiparticle interactions associated to CCR algebras. We give a number of explicit examples of such models. Using an idea of quasi-invariance of a state, we show how one can construct unitary representations of various groups. Moreover in models with locally conserved quantities associated to an infinite lattice we show that there is no spectral gap and the corresponding dissipative dynamics decay to equilibrium polynomially in time.


title: On The Relationship Between Universal Adversarial Attacks And Sparse Representations

abstract: The prominent success of neural networks, mainly in computer vision tasks, is increasingly shadowed by their sensitivity to small, barely perceivable adversarial perturbations in image input. In this work, we aim at explaining this vulnerability through the framework of sparsity. We show the connection between adversarial attacks and sparse representations, with a focus on explaining the universality and transferability of adversarial examples in neural networks. To this end, we show that sparse coding algorithms, and the neural network-based learned iterative shrinkage thresholding algorithm (LISTA) among them, suffer from this sensitivity, and that common attacks on neural networks can be expressed as attacks on the sparse representation of the input image. The phenomenon that we observe holds true also when the network is agnostic to the sparse representation and dictionary, and thus can provide a possible explanation for the universality and transferability of adversarial attacks. The code is available at https://github.com/danawr/adversarial_attacks_and_sparse_representations.


title: Kilometric type II radio emissions in Wind/WAVES TNR data and association with interplanetary structures near Earth

abstract: Type II radio bursts arise as a consequence of shocks typically driven by coronal mass ejections (CMEs). When these shocks propagate outward from the Sun, their associated radio emissions drift down in frequency as excited particles emit at the local plasma frequency, creating the usual Type II patterns. In this work, we use dynamic spectra from the Wind/WAVES Thermal Noise Receiver (TNR) to identify Type II radio emissions in the kilometric wavelength range (kmTIIs, f < 300 kHz) between 1 January 2000 and 31 December 2012, i.e. over a solar cycle. We identified 134 kmTII events and compiled various characteristics for each of them. Of particular importance is the finding of 45 kmTII events not reported by the official Wind/WAVES catalog (based on RAD1 and RAD2 data). We search for associations with interplanetary structures and analyze their main characteristics, in order to reveal distinctive attributes that may correlate with the occurrence of kmTII emission. We find that the fraction of interplanetary coronal mass ejections (ICMEs) classified as magnetic clouds (MCs) that are associated with kmTIIs is roughly similar to that of MCs not associated with kmTIIs. Conversely, the fraction of ICMEs with bidirectional electrons is significantly larger for those ICMEs associated with kmTIIs (74% vs. 48%). Likewise, ICMEs associated with kmTIIs are on average 23% faster. The disturbance storm time (DsT) mean value is almost twice as large for kmTII-associated ICMEs, indicating that they tend to produce intense geomagnetic storms. In addition, the proportion of ICMEs producing moderate to intense geomagnetic storms is twice as large for the kmTII-associated ICMEs. After this investigation, TNR data prove to be valuable not only as complementary data for the analysis of kmTII events but also for forecasting the arrival of shocks at Earth.


title: Odd non-linear conductivity under spatial inversion in chiral Tellurium

abstract: Electrical transport in non-centrosymmetric materials departs from the well-established phenomenological Ohm's law. Instead of a linear relation between current and electric field, a non-linear conductivity emerges along specific crystallographic directions. This non-linear transport is fundamentally related to the lack of spatial inversion symmetry. However, the experimental implications of an inversion symmetry operation on the non-linear conductivity remain to be explored. Here, we report on a large, non-linear conductivity in chiral Tellurium. By measuring samples with opposite handedness, we demonstrate that the non-linear transport is odd under spatial inversion. Furthermore, by applying an electrostatic gate, we modulate the non-linear output by a factor of 300, reaching the highest reported value excluding engineered heterostructures. Our results establish chiral Te as an ideal compound not just to study the fundamental interplay between crystal structure, symmetry operations and non-linear transport, but also to develop wireless rectifiers and energy-harvesting chiral devices.


title: A Wolf in Sheep's Clothing: Generalized Nested Jailbreak Prompts can Fool Large Language Models Easily

abstract: Large Language Models (LLMs), such as ChatGPT and GPT-4, are designed to provide useful and safe responses. However, adversarial prompts known as 'jailbreaks' can circumvent safeguards, leading LLMs to generate potentially harmful content. Exploring jailbreak prompts can help to better reveal the weaknesses of LLMs and further steer us to secure them. Unfortunately, existing jailbreak methods either suffer from intricate manual design or require optimization on other white-box models, which compromises either generalization or efficiency. In this paper, we generalize jailbreak prompt attacks into two aspects: (1) Prompt Rewriting and (2) Scenario Nesting. Based on this, we propose ReNeLLM, an automatic framework that leverages LLMs themselves to generate effective jailbreak prompts. Extensive experiments demonstrate that ReNeLLM significantly improves the attack success rate while greatly reducing the time cost compared to existing baselines. Our study also reveals the inadequacy of current defense methods in safeguarding LLMs. Finally, we analyze the failure of LLMs defense from the perspective of prompt execution priority, and propose corresponding defense strategies. We hope that our research can catalyze both the academic community and LLMs developers towards the provision of safer and more regulated LLMs. The code is available at https://github.com/NJUNLP/ReNeLLM.


title: Defining the boundaries: challenges and advances in identifying cells in microscopy images

abstract: Segmentation, or the outlining of objects within images, is a critical step in the measurement and analysis of cells within microscopy images. While improvements continue to be made in tools that rely on classical methods for segmentation, deep learning-based tools increasingly dominate advances in the technology. Specialist models such as Cellpose continue to improve in accuracy and user-friendliness, and segmentation challenges such as the Multi-Modality Cell Segmentation Challenge continue to push innovation in accuracy across widely-varying test data as well as efficiency and usability. Increased attention on documentation, sharing, and evaluation standards are leading to increased user-friendliness and acceleration towards the goal of a truly universal method.


title: A consensus-based algorithm for non-convex multiplayer games

abstract: In this paper, we present a novel consensus-based zeroth-order algorithm tailored for non-convex multiplayer games. The proposed method leverages a metaheuristic approach using concepts from swarm intelligence to reliably identify global Nash equilibria. We utilize a group of interacting particles, each agreeing on a specific consensus point, asymptotically converging to the corresponding optimal strategy. This paradigm permits a passage to the mean-field limit, allowing us to establish convergence guarantees under appropriate assumptions regarding initialization and objective functions. Finally, we conduct a series of numerical experiments to unveil the dependency of the proposed method on its parameters and apply it to solve a nonlinear Cournot oligopoly game involving multiple goods.


title: Mobility-Induced Graph Learning for WiFi Positioning

abstract: A smartphone-based user mobility tracking could be effective in finding his/her location, while the unpredictable error therein due to low specification of built-in inertial measurement units (IMUs) rejects its standalone usage but demands the integration to another positioning technique like WiFi positioning. This paper aims to propose a novel integration technique using a graph neural network called Mobility-INduced Graph LEarning (MINGLE), which is designed based on two types of graphs made by capturing different user mobility features. Specifically, considering sequential measurement points (MPs) as nodes, a user's regular mobility pattern allows us to connect neighbor MPs as edges, called time-driven mobility graph (TMG). Second, a user's relatively straight transition at a constant pace when moving from one position to another can be captured by connecting the nodes on each path, called a direction-driven mobility graph (DMG). Then, we can design graph convolution network (GCN)-based cross-graph learning, where two different GCN models for TMG and DMG are jointly trained by feeding different input features created by WiFi RTTs yet sharing their weights. Besides, the loss function includes a mobility regularization term such that the differences between adjacent location estimates should be less variant due to the user's stable moving pace. Noting that the regularization term does not require ground-truth location, MINGLE can be designed under semi- and self-supervised learning frameworks. The proposed MINGLE's effectiveness is extensively verified through field experiments, showing a better positioning accuracy than benchmarks, say root mean square errors (RMSEs) being 1.398 (m) and 1.073 (m) for self- and semi-supervised learning cases, respectively.


title: Mixed Attention Network for Cross-domain Sequential Recommendation

abstract: In modern recommender systems, sequential recommendation leverages chronological user behaviors to make effective next-item suggestions, which suffers from data sparsity issues, especially for new users. One promising line of work is the cross-domain recommendation, which trains models with data across multiple domains to improve the performance in data-scarce domains. Recent proposed cross-domain sequential recommendation models such as PiNet and DASL have a common drawback relying heavily on overlapped users in different domains, which limits their usage in practical recommender systems. In this paper, we propose a Mixed Attention Network (MAN) with local and global attention modules to extract the domain-specific and cross-domain information. Firstly, we propose a local/global encoding layer to capture the domain-specific/cross-domain sequential pattern. Then we propose a mixed attention layer with item similarity attention, sequence-fusion attention, and group-prototype attention to capture the local/global item similarity, fuse the local/global item sequence, and extract the user groups across different domains, respectively. Finally, we propose a local/global prediction layer to further evolve and combine the domain-specific and cross-domain interests. Experimental results on two real-world datasets (each with two domains) demonstrate the superiority of our proposed model. Further study also illustrates that our proposed method and components are model-agnostic and effective, respectively. The code and data are available at https://github.com/Guanyu-Lin/MAN.


title: Examining Modularity in Multilingual LMs via Language-Specialized Subnetworks

abstract: Recent work has proposed explicitly inducing language-wise modularity in multilingual LMs via sparse fine-tuning (SFT) on per-language subnetworks as a means of better guiding cross-lingual sharing. In this work, we investigate (1) the degree to which language-wise modularity naturally arises within models with no special modularity interventions, and (2) how cross-lingual sharing and interference differ between such models and those with explicit SFT-guided subnetwork modularity. To quantify language specialization and cross-lingual interaction, we use a Training Data Attribution method that estimates the degree to which a model's predictions are influenced by in-language or cross-language training examples. Our results show that language-specialized subnetworks do naturally arise, and that SFT, rather than always increasing modularity, can decrease language specialization of subnetworks in favor of more cross-lingual sharing.


title: Laccolith: Hypervisor-Based Adversary Emulation with Anti-Detection

abstract: Advanced Persistent Threats (APTs) represent the most threatening form of attack nowadays since they can stay undetected for a long time. Adversary emulation is a proactive approach for preparing against these attacks. However, adversary emulation tools lack the anti-detection abilities of APTs. We introduce Laccolith, a hypervisor-based solution for adversary emulation with anti-detection to fill this gap. We also present an experimental study to compare Laccolith with MITRE CALDERA, a state-of-the-art solution for adversary emulation, against five popular anti-virus products. We found that CALDERA cannot evade detection, limiting the realism of emulated attacks, even when combined with a state-of-the-art anti-detection framework. Our experiments show that Laccolith can hide its activities from all the tested anti-virus products, thus making it suitable for realistic emulations.


title: Non-Volatile Control of Valley Polarized Emission in 2D WSe2-AlScN Heterostructures

abstract: Achieving robust and electrically controlled valley polarization in monolayer transition metal dichalcogenides (ML-TMDs) is a frontier challenge for realistic valleytronic applications. Theoretical investigations show that integration of 2D materials with ferroelectrics is a promising strategy; however, its experimental demonstration has remained elusive. Here, we fabricate ferroelectric field-effect transistors using a ML-WSe2 channel and a AlScN ferroelectric dielectric, and experimentally demonstrate efficient tuning as well as non-volatile control of valley polarization. We measured a large array of transistors and obtained a maximum valley polarization of ~27% at 80 K with stable retention up to 5400 secs. The enhancement in the valley polarization was ascribed to the efficient exciton-to-trion (X-T) conversion and its coupling with an out-of-plane electric field, viz. the quantum-confined Stark effect. This changes the valley depolarization pathway from strong exchange interactions to slow spin-flip intervalley scattering. Our research demonstrates a promising approach for achieving non-volatile control over valley polarization and suggests new design principles for practical valleytronic devices.


title: Electrical Manipulation of Telecom Color Centers in Silicon

abstract: Silicon color centers have recently emerged as promising candidates for commercial quantum technology, yet their interaction with electric fields has yet to be investigated. In this paper, we demonstrate electrical manipulation of telecom silicon color centers by fabricating lateral electrical diodes with an integrated G center ensemble in a commercial silicon on insulator wafer. The ensemble optical response is characterized under application of a reverse-biased DC electric field, observing both 100% modulation of fluorescence signal, and wavelength redshift of approximately 1.4 GHz/V above a threshold voltage. Finally, we use G center fluorescence to directly image the electric field distribution within the devices, obtaining insight into the spatial and voltage-dependent variation of the junction depletion region and the associated mediating effects on the ensemble. Strong correlation between emitter-field coupling and generated photocurrent is observed. Our demonstration enables electrical control and stabilization of semiconductor quantum emitters.


title: Dynamical evolution of spinodal decomposition in holographic superfluids

abstract: We study the nonlinear dynamical evolution of spinodal decomposition in a first-order superfluid phase transition using a simple holographic model in the probe limit. We first confirm the linear stability analysis based on quasinormal modes and verify the existence of a critical length scale related to a gradient instability -- negative speed of sound squared -- of the superfluid sound mode, which is a consequence of a negative thermodynamic charge susceptibility. We present a comparison between our case and the standard Cahn-Hilliard equation for spinodal instability, in which a critical length scale can be also derived based on a diffusive instability. We then perform several numerical tests which include the nonlinear time evolution directly from an unstable state and fast quenches from a stable to an unstable state in the spinodal region. Our numerical results provide a real time description of spinodal decomposition and phase separation in one and two spatial dimensions. We reveal the existence of four different stages in the dynamical evolution, and characterize their main properties. Finally, we investigate the strength of dynamical heterogeneity using the spatial variance of the local chemical potential and we correlate the latter to other features of the dynamical evolution.


title: ARTEMIS: Using GANs with Multiple Discriminators to Generate Art

abstract: We propose a novel method for generating abstract art. First an autoencoder is trained to encode and decode the style representations of images, which are extracted from source images with a pretrained VGG network. Then, the decoder component of the autoencoder is extracted and used as a generator in a GAN. The generator works with an ensemble of discriminators. Each discriminator takes different style representations of the same images, and the generator is trained to create images that create convincing style representations in order to deceive all of the generators. The generator is also trained to maximize a diversity term. The resulting images had a surreal, geometric quality. We call our approach ARTEMIS (ARTistic Encoder- Multi- Discriminators Including Self-Attention), as it uses the self-attention layers and an encoder-decoder architecture.


title: Physics-informed laboratory estimation of Sargassum windage

abstract: A recent Maxey--Riley theory for \sarg raft motion, which models a raft as a network of elastically interacting finite-size, buoyant particles, predicts the carrying flow velocity to be given by the weighted sum of the water and air velocities $(1-\alpha)\mathbf{v} + \alpha \mathbf w$. The theory provides a closed formula for parameter $\alpha$, referred to as \emph{windage}, depending on water-to-particle-density ratio or buoyancy ($\delta$). From a series of laboratory experiments in an air--water stream flume facility under controlled conditions, we estimate $\alpha$ ranging from 0.02 to 0.96\pct. On average, our windage estimates can be up to 9 times smaller than considered in conventional \emph{Sargassum} raft transport modeling, wherein it is customary to add a fraction of $\mathbf w$ to $\mathbf{v}$ chosen in an ad-hoc piecemeal manner. Using the formula provided by the Maxey--Riley theory, we estimate $\delta$ ranging from 1.00 to 1.49. This is consistent with direct $\delta$ measurements, ranging from 0.9 to 1.25, which provide support for our $\alpha$ estimation.


title: Optimising non-Newtonian fluids for impact protection of laminates

abstract: Non-Newtonian fluids can be used for the protection of flexible laminates. Understanding the coupling between the flow of the protecting fluid and the deformation of the protected solids is necessary in order to optimise this functionality. We present a scaling analysis of the problem based on a single coupling variable, the effective width of a squeeze flow between flat rigid plates, and predict that impact protection for laminates is optimised by using shear-thinning, and not shear-thickening, fluids. The prediction is verified experimentally by measuring the velocity and pressure in impact experiments. Our scaling analysis should be generically applicable for non-Newtonian fluid-solid interactions in diverse applications.


title: Fast Dynamics of Vortices in Superconductors

abstract: The last decade has been marked by great interest in the dynamics of vortices moving at high ($>$10\,km/s) velocities in superconductors. However, the flux-flow instability (FFI) prevents its exploration and sets practical limits for the use of vortices in various applications. Even so, FFI has turned into a valuable tool for studying the quasiparticle energy relaxation in superconductors, with the view of enhancement of the single-photon detection capability of micrometer-wide strips operated at large bias currents. In this context, the failure of ``global'' FFI models for materials with strong intrinsic and edge vortex pinning has urged the elaboration of ``local'' FFI models. This chapter outlines the recent advances in the research on FFI and highlights superconductors with perfect edges and weak volume pinning as prospective materials for studying fast vortex dynamics and nonequilibrium superconductivity. This manuscript is based on the author-prepared version of the review published in Encyclopedia of Condensed Matter Physics, vol. 2 (2024) 735--754.


title: New results from the Muon g-2 Experiment

abstract: The Muon g-2 experiment at Fermilab has published the first result on Run-1 dataset in 2021 showing a good agreement with the previous experimental result at Brookhaven National Laboratory at comparable precision (0.46 ppm). In August 2023 we released our new result from Run-2 and Run-3 datasets which allowed to measure $a_\mu$ to 0.21 ppm, a more than two-fold improved precision respect to Run-1, and which allowed to reach a precision of 0.20 ppm when combined with the Run-1 result. We will discuss the improvements of the Run-2/3 analysis respect to Run-1, the current status of the theory prediction, and the future prospects.


title: Nonadaptive Noise-Resilient Group Testing with Order-Optimal Tests and Fast-and-Reliable Decoding

abstract: Group testing (GT) is the Boolean version of spare signal recovery and, due to its simplicity, a marketplace for ideas that can be brought to bear upon related problems, such as heavy hitters, compressed sensing, and multiple access channels. The definition of a "good" GT varies from one buyer to another, but it generally includes (i) usage of nonadaptive tests, (ii) limiting to $O(k \log n)$ tests, (iii) resiliency to test noise, (iv) $O(k \mathrm{poly}(\log n))$ decoding time, and (v) lack of mistakes. In this paper, we propose $Gacha~GT$. Gacha is an elementary and self-contained, versatile and unified scheme that, for the first time, satisfies all criteria for a fairly large region of parameters, namely when $\log k < \log(n)^{1-1/O(1)}$. Outside this parameter region, Gacha can be specialized to outperform the state-of-the-art partial-recovery GTs, exact-recovery GTs, and worst-case GTs. The new idea Gacha brings to the market is a redesigned Reed--Solomon code for probabilistic list-decoding at diminishing code rates over reasonably-large alphabets. Normally, list-decoding a vanilla Reed--Solomon code is equivalent to the nontrivial task of identifying the subsets of points that fit low-degree polynomials. In this paper, we explicitly tell the decoder which points belong to the same polynomial, thus reducing the complexity and enabling the improvement on GT.


title: Level Set KSVD

abstract: We present a new algorithm for image segmentation - Level-set KSVD. Level-set KSVD merges the methods of sparse dictionary learning for feature extraction and variational level-set method for image segmentation. Specifically, we use a generalization of the Chan-Vese functional with features learned by KSVD. The motivation for this model is agriculture based. Aerial images are taken in order to detect the spread of fungi in various crops. Our model is tested on such images of cotton fields. The results are compared to other methods.


title: Energy-minimizing Mappings of Complex Projective Spaces

abstract: We determine the infimum of the energy in any homotopy class of mappings from complex projective space to a Riemannian manifold, by showing that it is proportional to the infimal area in the homotopy class of mappings of the 2-sphere represented by its action on the second homotopy group. We then establish a family of optimal lower bounds, for mappings from real and complex projective spaces to Riemannian manifolds, for a larger class of energy functionals. We also give a new proof of a theorem of Ohnita that stable harmonic mappings of complex projective spaces are pluriharmonic and establish several properties of these maps.


title: Monitoring broad emission-line components in spectra of the two low-metallicity dwarf compact star-forming galaxies SBS 1420+540 and J1444+4840

abstract: We report the discovery of broad components with P-Cygni profiles of the hydrogen and helium emission lines in the two low-redshift low-metallicity dwarf compact star-forming galaxies (SFG), SBS 1420+540 and J1444+4840. We found small stellar masses of 10^{6.24} and 10^{6.59} M$_\odot$, low oxygen abundances 12+log O/H of 7.75 and 7.45, high velocity dispersions reaching $\sigma$ ~700 and ~1200km/s, high terminal velocities of the stellar wind of ~1000 and ~1000-1700km/s, respectively, and large EW(H$\beta$) of ~300A for both. For SBS 1420+540, we succeeded in capturing an eruption phase by monitoring the variations of the broad-to-narrow component flux ratio. We observe a sharp increase of that ratio by a factor 4 in 2017 and a decrease by about an order of magnitude in 2023. The peak luminosity of ~10^{40}ergs/s of the broad component in $L$(H$\alpha$) lasted for about 6 years out of a three-decades monitoring. This leads us to conclude that there is probably a LBV candidate (LBVc) in this galaxy. As for J1444+4840, its very high $L$(H$\alpha$) of about 10^{41}ergs/s, close to values observed in active galactic nuclei (AGNs) and Type IIn Supernovae (SNe), and the variability of no more than 20 per cent of the broad-to-narrow flux ratio of the hydrogen and helium emission lines over a 8-year monitoring do not allow us to definitively conclude that it contains a LBVc. On the other hand, the possibility that the line variations are due to a long-lived stellar transient of type LBV/SNIIn cannot be ruled out.


title: How Well Do Large Language Models Understand Syntax? An Evaluation by Asking Natural Language Questions

abstract: While recent advancements in large language models (LLMs) bring us closer to achieving artificial general intelligence, the question persists: Do LLMs truly understand language, or do they merely mimic comprehension through pattern recognition? This study seeks to explore this question through the lens of syntax, a crucial component of sentence comprehension. Adopting a natural language question-answering (Q&A) scheme, we craft questions targeting nine syntactic knowledge points that are most closely related to sentence comprehension. Experiments conducted on 24 LLMs suggest that most have a limited grasp of syntactic knowledge, exhibiting notable discrepancies across different syntactic knowledge points. In particular, questions involving prepositional phrase attachment pose the greatest challenge, whereas those concerning adjectival modifier and indirect object are relatively easier for LLMs to handle. Furthermore, a case study on the training dynamics of the LLMs reveals that the majority of syntactic knowledge is learned during the initial stages of training, hinting that simply increasing the number of training tokens may not be the `silver bullet' for improving the comprehension ability of LLMs.


title: Nontrivial $t$-designs in polar spaces exist for all $t$

abstract: A finite classical polar space of rank $n$ consists of the totally isotropic subspaces of a finite vector space over $\mathbb{F}_p$ equipped with a nondegenerate form such that $n$ is the maximal dimension of such a subspace. A $t$-$(n,k,\lambda)$ design in a finite classical polar space of rank $n$ is a collection $Y$ of totally isotropic $k$-spaces such that each totally isotropic $t$-space is contained in exactly $\lambda$ members of $Y$. Nontrivial examples are currently only known for $t\leq 2$. We show that $t$-$(n,k,\lambda)$ designs in polar spaces exist for all $t$ and $p$ provided that $k>\frac{21}{2}t$ and $n$ is sufficiently large enough. The proof is based on a probabilistic method by Kuperberg, Lovett, and Peled, and it is thus nonconstructive.


title: Path-dependent PDEs for volatility derivatives

abstract: We regard options on VIX and Realised Variance as solutions to path-dependent partial differential equations (PDEs) in a continuous stochastic volatility model. The modeling assumption specifies that the instantaneous variance is a $C^3$ function of a multidimensional Gaussian Volterra process; this includes a large class of models suggested for the purpose of VIX option pricing, either rough, or not, or mixed. We unveil the path-dependence of those volatility derivatives and, under a regularity hypothesis on the payoff function, we prove the well-posedness of the associated PDE. The latter is of heat type, because of the Gaussian assumption, and the terminal condition is also path-dependent. Furthermore, formulae for the greeks are provided, the implied volatility is shown to satisfy a quasi-linear path-dependent PDE and, in Markovian models, finite-dimensional pricing PDEs are obtained for VIX options.


title: On-Policy Policy Gradient Reinforcement Learning Without On-Policy Sampling

abstract: On-policy reinforcement learning (RL) algorithms perform policy updates using i.i.d. trajectories collected by the current policy. However, after observing only a finite number of trajectories, on-policy sampling may produce data that fails to match the expected on-policy data distribution. This sampling error leads to noisy updates and data inefficient on-policy learning. Recent work in the policy evaluation setting has shown that non-i.i.d., off-policy sampling can produce data with lower sampling error than on-policy sampling can produce. Motivated by this observation, we introduce an adaptive, off-policy sampling method to improve the data efficiency of on-policy policy gradient algorithms. Our method, Proximal Robust On-Policy Sampling (PROPS), reduces sampling error by collecting data with a behavior policy that increases the probability of sampling actions that are under-sampled with respect to the current policy. Rather than discarding data from old policies -- as is commonly done in on-policy algorithms -- PROPS uses data collection to adjust the distribution of previously collected data to be approximately on-policy. We empirically evaluate PROPS on both continuous-action MuJoCo benchmark tasks as well as discrete-action tasks and demonstrate that (1) PROPS decreases sampling error throughout training and (2) improves the data efficiency of on-policy policy gradient algorithms. Our work improves the RL community's understanding of a nuance in the on-policy vs off-policy dichotomy: on-policy learning requires on-policy data, not on-policy sampling.


title: Distribution of quantum gravity induced entanglement in many-body systems

abstract: Recently, it was shown that two distant test masses, each prepared in a spatially superposed quantum state, become entangled through their mutual gravitational interaction. This entanglement, it was argued, is a signature of the quantum nature of gravity. We extend this treatment to a many-body system in a general setup and study the entanglement properties of the time-evolved state. We exactly compute the time-dependent I-concurrence for every bipartition and obtain the necessary and sufficient condition for the creation of genuine many-body entanglement. We further show that this entanglement is of generalised GHZ type when certain conditions are met. We also evaluate the amount of multipartite entanglement in the system using a set of generalised Meyer-Wallach measures.


title: Photoproduction of fully-charmed tetraquark at electron-ion colliders

abstract: In this work we investigate the inclusive photoproduction of the $C$-odd $S$-wave fully-charmed tetraquark at electron-ion colliders within the nonrelativistic QCD (NRQCD) factorization framework, at the lowest order in velocity and $\alpha_s$. The value of the NRQCD long-distance matrix element is estimated from two phenomenological potential models. Our studies reveal that the photoproduction of $1^{+-}$ fully-charmed tetraquark may be difficult to observe at HERA and EicC, nevertheless its observation prospect at EIC appears to be bright.


title: Towards a full NNLO Monte Carlo generator for low energy $e^+e^-$ data into leptons and hadrons

abstract: During the last 15 years the Radio MonteCarLow Working Group has been providing valuable support to the development of radiative corrections and Monte Carlo event generators for low energy $e^+e^-$ data and $\tau$-lepton decays. While the working group has been operating for more than 15 years without a formal basis for funding, parts of our program have recently been included as a Joint Research Initiative in the group application of the European hadron physics community, STRONG2020, to the European Union, with a more specific goal of creating an annotated database for low-energy hadronic cross sections in $e^+e^-$ collisions. In parallel the theory community is continuing its effort towards the realization of improved Monte Carlo generators with for low energy $e^+e^-$ data into hadrons. Full NNLO corrections in the leptonic sector are to be combined with an improved treatment of radiative corrections involving pions. This is of relevance for the precise determination of the leading hadronic contribution to the muon g-2. We will report on these initiatives.


title: Evidence of Hot Carrier Extraction in Metal Halide Perovskite Solar Cells

abstract: The presence of hot carriers is presented in the operational properties of an (FA,Cs)Pb(I, Br, Cl)3 solar cell at ambient temperatures and under practical solar concentration. At 100 K, clear evidence of hot carriers is observed in both the high energy tail of the photoluminescence spectra and from the appearance of a non-equilibrium photocurrent at higher fluence in light J-V measurements. At room temperature, however, the presence of hot carriers in the emission at elevated laser fluence are shown to compete with a gradual red shift in the PL peak energy as photo induced halide segregation begins to occur at higher lattice temperature. The effects of thermionic emission of hot carriers and the presence of a non-equilibrium carrier distribution are also shown to be distinct from simple lattice heating. This results in large unsaturated photocurrents at high powers as the Fermi distribution exceeds that of the heterointerface controlling carrier transport and rectification.


title: A postgraduate laboratory experiment to set up a single-photon detector using MKIDs

abstract: This paper presents a laboratory activity aimed at developing knowledge and expertise in microwave applications at cryogenic temperatures. The experience focuses on the detection of single infrared photons through Microwave Kinetic Inductance Detectors (MKIDs). The experimental setup, theoretical concepts, and activities involved are detailed, highlighting the skills and knowledge gained through the experience. This experiment is designed for postgraduate students in the field of quantum technologies.


title: Maximum Eigenvalue Detection based Spectrum Sensing in RIS-aided System with Correlated Fading

abstract: Robust spectrum sensing is crucial for facilitating opportunistic spectrum utilization for secondary users (SU) in the absense of primary users (PU). However, propagation environment factors such as multi-path fading, shadowing, and lack of line of sight (LoS) often adversely affect detection performance. To deal with these issues, this paper focuses on utilizing reconfigurable intelligent surfaces (RIS) to improve spectrum sensing in the scenario wherein both the multi-path fading and noise are correlated. In particular, to leverage the spatially correlated fading, we propose to use maximum eigenvalue detection (MED) for spectrum sensing. We first derive exact distributions of test statistics, i.e., the largest eigenvalue of the sample covariance matrix, observed under the null and signal present hypothesis. Next, utilizing these results, we present the exact closed-form expressions for the false alarm and detection probabilities. In addition, we also optimally configure the phase shift matrix of RIS such that the mean of the test statistics is maximized, thus improving the detection performance. Our numerical analysis demonstrates that the MED's receiving operating characteristic (ROC) curve improves with increased RIS elements, SNR, and the utilization of statistically optimal configured RIS.


title: The scale invariant scotogenic model: CDF-II $W$-boson mass and the 95 GeV excesses

abstract: The anomalies observed in the $W$ mass measurements at the CDF-II experiments and the excesses seen around 95~GeV at the Large Hadron Collider (LHC) motivate this work, in which we investigate and constrain the parameter space of the Scale Invariant Scotogenic Model with a Majorana dark matter candidate. The scanned parameters are chosen to be consistent with the dark matter relic density and the observed excesses at $\sim95$~GeV signal strength rates in different channels. We found that significant part of the viable space addresses the excess in the channel $\gamma\gamma$, while a tight part can address the excess in both $\gamma\gamma$ and $b\bar{b}$ channels. Furthermore, the model's viable parameters can be probed in both the LHC and future $e^{+}e^{-}$ colliders for di-Higgs production.


title: A Survey of Confidence Estimation and Calibration in Large Language Models

abstract: Large language models (LLMs) have demonstrated remarkable capabilities across a wide range of tasks in various domains. Despite their impressive performance, they can be unreliable due to factual errors in their generations. Assessing their confidence and calibrating them across different tasks can help mitigate risks and enable LLMs to produce better generations. There has been a lot of recent research aiming to address this, but there has been no comprehensive overview to organize it and outline the main lessons learned. The present survey aims to bridge this gap. In particular, we outline the challenges and we summarize recent technical advancements for LLM confidence estimation and calibration. We further discuss their applications and suggest promising directions for future work.


title: VERVE: Template-based ReflectiVE Rewriting for MotiVational IntErviewing

abstract: Reflective listening is a fundamental skill that counselors must acquire to achieve proficiency in motivational interviewing (MI). It involves responding in a manner that acknowledges and explores the meaning of what the client has expressed in the conversation. In this work, we introduce the task of counseling response rewriting, which transforms non-reflective statements into reflective responses. We introduce VERVE, a template-based rewriting system with paraphrase-augmented training and adaptive template updating. VERVE first creates a template by identifying and filtering out tokens that are not relevant to reflections and constructs a reflective response using the template. Paraphrase-augmented training allows the model to learn less-strict fillings of masked spans, and adaptive template updating helps discover effective templates for rewriting without significantly removing the original content. Using both automatic and human evaluations, we compare our method against text rewriting baselines and show that our framework is effective in turning non-reflective statements into more reflective responses while achieving a good content preservation-reflection style trade-off.


title: Workflow-Guided Response Generation for Task-Oriented Dialogue

abstract: Task-oriented dialogue (TOD) systems aim to achieve specific goals through interactive dialogue. Such tasks usually involve following specific workflows, i.e. executing a sequence of actions in a particular order. While prior work has focused on supervised learning methods to condition on past actions, they do not explicitly optimize for compliance to a desired workflow. In this paper, we propose a novel framework based on reinforcement learning (RL) to generate dialogue responses that are aligned with a given workflow. Our framework consists of ComplianceScorer, a metric designed to evaluate how well a generated response executes the specified action, combined with an RL opimization process that utilizes an interactive sampling technique. We evaluate our approach on two TOD datasets, Action-Based Conversations Dataset (ABCD) (Chen et al., 2021a) and MultiWOZ 2.2 (Zang et al., 2020) on a range of automated and human evaluation metrics. Our findings indicate that our RL-based framework outperforms baselines and is effective at enerating responses that both comply with the intended workflows while being expressed in a natural and fluent manner.


title: Controlling collisional loss and scattering lengths of ultracold dipolar molecules with static electric fields

abstract: Trapped samples of ultracold molecules are often short-lived, because close collisions between them result in trap loss. We investigate the use of shielding with static electric fields to create repulsive barriers between polar molecules to prevent such loss. Shielding is very effective even for RbCs, with a relatively low dipole moment, and even more effective for molecules such as NaK, NaRb and NaCs, with progressively larger dipoles. Varying the electric field allows substantial control over the scattering length, which will be crucial for the stability or collapse of molecular Bose-Einstein condensates. This arises because the dipole-dipole interaction creates a long-range attraction that is tunable with electric field. For RbCs, the scattering length is positive across the range where shielding is effective, because the repulsion responsible for shielding dominates. For NaK, the scattering length can be tuned across zero to negative values. For NaRb and NaCs, the attraction is strong enough to support tetraatomic bound states, and the scattering length passes through resonant poles where these states cross threshold. For KAg and CsAg, there are multiple bound states and multiple poles. For each molecule, we calculate the variation of scattering length with field and comment on the possibilities for exploring new physics.


title: Inverse Learning with Extremely Sparse Feedback for Recommendation

abstract: Modern personalized recommendation services often rely on user feedback, either explicit or implicit, to improve the quality of services. Explicit feedback refers to behaviors like ratings, while implicit feedback refers to behaviors like user clicks. However, in the scenario of full-screen video viewing experiences like Tiktok and Reels, the click action is absent, resulting in unclear feedback from users, hence introducing noises in modeling training. Existing approaches on de-noising recommendation mainly focus on positive instances while ignoring the noise in a large amount of sampled negative feedback. In this paper, we propose a meta-learning method to annotate the unlabeled data from loss and gradient perspectives, which considers the noises in both positive and negative instances. Specifically, we first propose an Inverse Dual Loss (IDL) to boost the true label learning and prevent the false label learning. Then we further propose an Inverse Gradient (IG) method to explore the correct updating gradient and adjust the updating based on meta-learning. Finally, we conduct extensive experiments on both benchmark and industrial datasets where our proposed method can significantly improve AUC by 9.25% against state-of-the-art methods. Further analysis verifies the proposed inverse learning framework is model-agnostic and can improve a variety of recommendation backbones. The source code, along with the best hyper-parameter settings, is available at this link: https://github.com/Guanyu-Lin/InverseLearning.


title: Extrinsically-Focused Evaluation of Omissions in Medical Summarization

abstract: The goal of automated summarization techniques (Paice, 1990; Kupiec et al, 1995) is to condense text by focusing on the most critical information. Generative large language models (LLMs) have shown to be robust summarizers, yet traditional metrics struggle to capture resulting performance (Goyal et al, 2022) in more powerful LLMs. In safety-critical domains such as medicine, more rigorous evaluation is required, especially given the potential for LLMs to omit important information in the resulting summary. We propose MED-OMIT, a new omission benchmark for medical summarization. Given a doctor-patient conversation and a generated summary, MED-OMIT categorizes the chat into a set of facts and identifies which are omitted from the summary. We further propose to determine fact importance by simulating the impact of each fact on a downstream clinical task: differential diagnosis (DDx) generation. MED-OMIT leverages LLM prompt-based approaches which categorize the importance of facts and cluster them as supporting or negating evidence to the diagnosis. We evaluate MED-OMIT on a publicly-released dataset of patient-doctor conversations and find that MED-OMIT captures omissions better than alternative metrics.


title: Quasinormal ringing of Bardeen spacetime

abstract: We review recent calculations of quasinormal modes and asymptotic tails of the Bardeen spacetime interpreted as a quantum corrected Schwarzschild-like black holes. Massless electromagnetic and Dirac fields and massive scalar field are considered. The first few overtones are much more sensitive to the change of the quantum correction parameter than the fundamental mode, because such correction deforms the black hole geometry near the event horizon. While the asymptotic tails of massless fields are identical to those for the Schwarzschild case, the tails for a massive field differs from the Schwarzschild limit at both intermediate and asymptotic times.


title: Optimally Managing the Impacts of Convergence Tolerance for Distributed Optimal Power Flow

abstract: The future power grid may rely on distributed optimization to determine the set-points for huge numbers of distributed energy resources. There has been significant work on applying distributed algorithms to optimal power flow (OPF) problems, which require separate computing agents to agree on shared boundary variable values. Looser tolerances for the mismatches in these shared variables generally yield faster convergence at the expense of exacerbating constraint violations, but there is little quantitative understanding of how the convergence tolerance affects solution quality. To address this gap, we first quantify how convergence tolerance impacts constraint violations when the distributed OPF generator dispatch is applied to the power system. Using insights from this analysis, we then develop a bound tightening algorithm which guarantees that operating points from distributed OPF algorithms will not result in violations despite the possibility of shared variable mismatches within the convergence tolerance. We also explore how bounding the cumulative shared variable mismatches can prevent unnecessary conservativeness in the bound tightening. The proposed approach enables control of the trade-off between computational speed, which improves as the convergence tolerance increases, and distributed OPF solution cost, which increases with convergence tolerance due to tightened constraints, while ensuring feasibility.


title: On-the-Fly Fusion of Large Language Models and Machine Translation

abstract: We propose the on-the-fly ensembling of a machine translation model with an LLM, prompted on the same task and input. We perform experiments on 4 language pairs (both directions) with varying data amounts. We find that a slightly weaker-at-translation LLM can improve translations of a NMT model, and ensembling with an LLM can produce better translations than ensembling two stronger MT models. We combine our method with various techniques from LLM prompting, such as in context learning and translation context.


title: Polarization angle accuracy for future CMB experiments. The COSMOCal project and its prototype in the 1mm band

abstract: The Cosmic Microwave Background (CMB) radiation offers a unique window into the early Universe, facilitating precise examinations of fundamental cosmological theories. However, the quest for detecting B-modes in the CMB, predicted by theoretical models of inflation, faces substantial challenges in terms of calibration and foreground modeling. The COSMOCal (COsmic Survey of Millimeter wavelengths Objects for CMB experiments Calibration) project aims at enhancing the accuracy of the absolute calibration of the polarization angle $\psi$ of current and future CMB experiments. The concept includes the build of a very well known artificial source emitting in the frequency range [20-350] GHz that would act as an absolute calibrator for several polarization facilities on Earth. A feasibility study to place the artificial source in geostationary orbit, in the far field for all the telescopes on Earth, is ongoing. In the meanwhile ongoing hardware work is dedicated to build a prototype to test the technology, the precision and the stability of the polarization recovering in the 1 mm band (220-300 GHz). High-resolution experiments as the NIKA2 camera at the IRAM 30m telescope will be deployed for such use. Once carefully calibrated ($\Delta\psi$ < 0.1 degrees) it will be used to observe astrophysical sources such as the Crab nebula, which is the best candidate in the sky for the absolute calibration of CMB experiments.


title: The Heat is On: Thermal Facial Landmark Tracking

abstract: Facial landmark tracking for thermal images requires tracking certain important regions of subjects' faces, using images from thermal images, which omit lighting and shading, but show the temperatures of their subjects. The fluctuations of heat in particular places reflect physiological changes like bloodflow and perspiration, which can be used to remotely gauge things like anxiety and excitement. Past work in this domain has been limited to only a very limited set of architectures and techniques. This work goes further by trying a comprehensive suit of various models with different components, such as residual connections, channel and feature-wise attention, as well as the practice of ensembling components of the network to work in parallel. The best model integrated convolutional and residual layers followed by a channel-wise self-attention layer, requiring less than 100K parameters.


title: Introducing an Improved Information-Theoretic Measure of Predictive Uncertainty

abstract: Applying a machine learning model for decision-making in the real world requires to distinguish what the model knows from what it does not. A critical factor in assessing the knowledge of a model is to quantify its predictive uncertainty. Predictive uncertainty is commonly measured by the entropy of the Bayesian model average (BMA) predictive distribution. Yet, the properness of this current measure of predictive uncertainty was recently questioned. We provide new insights regarding those limitations. Our analyses show that the current measure erroneously assumes that the BMA predictive distribution is equivalent to the predictive distribution of the true model that generated the dataset. Consequently, we introduce a theoretically grounded measure to overcome these limitations. We experimentally verify the benefits of our introduced measure of predictive uncertainty. We find that our introduced measure behaves more reasonably in controlled synthetic tasks. Moreover, our evaluations on ImageNet demonstrate that our introduced measure is advantageous in real-world applications utilizing predictive uncertainty.


title: Brownian Fluctuations of a non-confining potential

abstract: Brownian fluctuations arise for any quantity that depends on the stochastic variables of a Brownian particle. In this study, we explore the Brownian fluctuations of a bidimensional quadratic potential that exhibits two regimes: a confining regime and a non-confining regime. We divide the total potential into two contributions and analyze the mean, variance, skewness, excess kurtosis, and their distributions for each contribution as well as for the total potential. Our analysis offers an understanding into the statistical behavior of each quantity.


title: Ghost-Free Electroweak Symmetry Breaking with Weakly Nonlocal Interactions

abstract: Weakly nonlocal (WNL) Quantum Field Theories (QFT's) may define a new class of UV-completions in particle physics and gravity, without introducing any new elementary particle. One problematic issue is how to realize spontaneous symmetry breaking without introducing an infinite tower of ghosts in the perturbative spectrum. In this article, a WNL extension of the Standard Model (SM) is proposed: the Fuzzy Standard Model (FSM). It is a smooth deformation of the SM based on covariant star-products of fields. This new formalism realizes electroweak symmetry breaking without ghosts at tree-level. We give evidences that the FSM exhibit Vainshtein screening, aka classicalization, in the deep-UV. This could solve the electroweak hierarchy problem if it occurs at the TeV-scale.


title: Exchange gap in GdPtBi probed by magneto-optics

abstract: We measured the magneto-reflectivity spectra (4 - 90 meV, 0 - 16 T) of the triple-point semimetal GdPtBi and found them to demonstrate two unusual broad features emerging in field. The electronic bands of GdPtBi are expected to experience large exchange-mediated shifts, which lends itself to a description via effective Zeeman splittings with a large g factor. Based on this approach, along with an ab initio band structure analysis, we propose a model Hamiltonian that describes our observations well and allows us to estimate the effective g factor, g* = 95. We conclude that we directly observe the exchange-induced $\Gamma_{8}$ band inversion in GdPtBi by means of infrared spectroscopy.


title: On the Fast Track to Full Gold Open Access

abstract: The world of scientific publishing is changing; the days of an old type of subscription-based earnings for publishers seem over, and we are entering a new era. It seems as if an ever-increasing number of journals from disparate publishers are going Gold, Open Access that is, yet have we rigorously ascertained the issue in its entirety, or are we touting the strengths and forgetting about constructive criticism and careful weighing of evidence? We will therefore present the current state of the art, in a compact review/bibliometrics style, of this more relevant than ever hot topic, including challenges and potential solutions that are most likely to be acceptable to all parties. Suggested solutions, as per the performed analysis, at least for the time being, represent an inclusive publishing environment where multiple publishing models are competing for a piece of the pie and thus inhibiting each other's flaws. The performed analysis also shows that there seems to be a link between trends in scientific publishing and tumultuous world events, which in turn has a special significance for the publishing environment in the current world stage -- implying that academy publishing has potentially now found itself at a tipping point of change.


title: Convolutional Neural Networks Exploiting Attributes of Biological Neurons

abstract: In this era of artificial intelligence, deep neural networks like Convolutional Neural Networks (CNNs) have emerged as front-runners, often surpassing human capabilities. These deep networks are often perceived as the panacea for all challenges. Unfortunately, a common downside of these networks is their ''black-box'' character, which does not necessarily mirror the operation of biological neural systems. Some even have millions/billions of learnable (tunable) parameters, and their training demands extensive data and time. Here, we integrate the principles of biological neurons in certain layer(s) of CNNs. Specifically, we explore the use of neuro-science-inspired computational models of the Lateral Geniculate Nucleus (LGN) and simple cells of the primary visual cortex. By leveraging such models, we aim to extract image features to use as input to CNNs, hoping to enhance training efficiency and achieve better accuracy. We aspire to enable shallow networks with a Push-Pull Combination of Receptive Fields (PP-CORF) model of simple cells as the foundation layer of CNNs to enhance their learning process and performance. To achieve this, we propose a two-tower CNN, one shallow tower and the other as ResNet 18. Rather than extracting the features blindly, it seeks to mimic how the brain perceives and extracts features. The proposed system exhibits a noticeable improvement in the performance (on an average of $5\%-10\%$) on CIFAR-10, CIFAR-100, and ImageNet-100 datasets compared to ResNet-18. We also check the efficiency of only the Push-Pull tower of the network.


title: Total Empiricism: Learning from Data

abstract: Statistical analysis is an important tool to distinguish systematic from chance findings. Current statistical analyses rely on distributional assumptions reflecting the structure of some underlying model, which if not met lead to problems in the analysis and interpretation of the results. Instead of trying to fix the model or "correct" the data, we here describe a totally empirical statistical approach that does not rely on ad hoc distributional assumptions in order to overcome many problems in contemporary statistics. Starting from elementary combinatorics, we motivate an information-guided formalism to quantify knowledge extracted from the given data. Subsequently, we derive model-agnostic methods to identify patterns that are solely evidenced by the data based on our prior knowledge. The data-centric character of empiricism allows for its universal applicability, particularly as sample size grows larger. In this comprehensive framework, we re-interpret and extend model distributions, scores and statistical tests used in different schools of statistics.


title: CholeskyQR with Randomization and Pivoting for Tall Matrices (CQRRPT)

abstract: This paper develops and analyzes a new algorithm for QR decomposition with column pivoting (QRCP) of rectangular matrices with large row counts. The algorithm combines methods from randomized numerical linear algebra in a particularly careful way in order to accelerate both pivot decisions for the input matrix and the process of decomposing the pivoted matrix into the QR form. The source of the latter acceleration is a use of randomized preconditioning and CholeskyQR. Comprehensive analysis is provided in both exact and finite-precision arithmetic to characterize the algorithm's rank-revealing properties and its numerical stability granted probabilistic assumptions of the sketching operator. An implementation of the proposed algorithm is described and made available inside the open-source RandLAPACK library, which itself relies on RandBLAS - also available in open-source format. Experiments with this implementation on an Intel Xeon Gold 6248R CPU demonstrate order-of-magnitude speedups relative to LAPACK's standard function for QRCP, and comparable performance to a specialized algorithm for unpivoted QR of tall matrices, which lacks the strong rank-revealing properties of the proposed method.


title: Are sunspot cycles connected to the Earth and Jupiter?

abstract: The sunspot number observations over the past three centuries measure solar activity. These numbers repeat the solar cycle of about eleven years. The solar dynamo converts convective motion and internal differential rotation into electric-magnetic energy that sustains the solar magnetic field. This field concentrates on sunspots on the surface of the Sun. The mainstream dynamo models predict that the sunspot cycle is stochastic. The official Solar Cycle Prediction Panel forecasts only the ongoing sunspot cycle because any forecast beyond one cycle is considered impossible. We apply the Discrete Chi-square Method (DCM) to the monthly and yearly sunspot data. DCM can detect many periodic signals superimposed on an arbitrary trend. The sunspot data fulfil four criteria. (1) DCM consistently detects the same periods in the yearly and monthly data. (2) We divide each sunspot data sample into the longer predictive data sample and the shorter predicted data sample. DCM models for the predictive data can predict the predicted data. (3) DCM models can predict the past prolonged Dalton and Maunder activity minima. Our predictions are longer and more accurate than the official Solar Cycle Prediction Panel forecast. We predict that during the next half a century the Sun will no longer help us to cope with climate change. (4) DCM detects planetary signal candidates. The solar cycle is deterministic, not stochastic, if the Earth and Jupiter cause the strongest detected, very clear 10, 11 and 11.86 year signals shown in our Figure 5. If the Earth's signal dominates over Jupiter's signal, the planetary gravitational tidal forcing does not cause the sunspot cycle. The Earth's and Jupiter's dipole magnetic fields may interact with the solar magnetic field. The geomagnetic field may even be the main cause of the sunspot cycle, if our results in Table 14 are correct.


title: Electromagnetically Induced Transparency (EIT) aided cooling of strontium atoms

abstract: The presence of ultra-narrow inter-combination spectroscopic lines in alkaline earth elements places them as promising candidates for optical atomic clocks, quantum computation, and for probing fundmental physics. Doppler cooling of these atoms is typically achieved through two subsequent stages: the initial cooling is on the 1s0-1p1 transition followed by cooling using the narrow-line 1s0-3p1 transition. However, due to significantly lower linewidth of the second stage cooling transition, efficient transfer of atoms into the second stage becomes technically challenging. The velocity distribution of the atoms after the first stage of cooling is too broad for atoms to be captured efficiently in the second stage cooling. As a result, the capture efficiency of atoms into the second stage Magneto-Optical Trap is low, even if the linewidth of the second stage cooling laser is artificially broadened.


title: Resource Efficient Over-the-Air Fronthaul Signaling for Uplink Cell-Free Massive MIMO Systems

abstract: We propose a novel resource efficient analog over-the-air (OTA) computation framework to address the demanding requirements of the uplink (UL) fronthaul between the access points (APs) and the central processing unit (CPU) in cell-free massive multiple-input multiple-output (MIMO) systems. We discuss the drawbacks of the wired and wireless fronthaul solutions, and show that our proposed mechanism is efficient and scalable as the number of APs increases. We present the transmit precoding and two-phase power assignment strategies at the APs to coherently combine the signals OTA in a spectrally efficient manner. We derive the statistics of the APs locally available signals which enable us to to obtain the analytical expressions for the Bayesian and classical estimators of the OTA combined signals. We empirically evaluate the normalized mean square error (NMSE), symbol error rate (SER), and the coded bit error rate (BER) of our developed solution and benchmark against the state-of-the-art wired fronthaul based system


title: CV32RT: Enabling Fast Interrupt and Context Switching for RISC-V Microcontrollers

abstract: Processors using the open RISC-V ISA are finding increasing adoption in the embedded world. Many embedded use cases have real-time constraints and require flexible, predictable, and fast reactive handling of incoming events. However, RISC- V processors are still lagging in this area compared to more mature proprietary architectures, such as ARM Cortex-M and TriCore, which have been tuned for years. The default interrupt controller standardized by RISC-V, the Core Local Interruptor (CLINT), lacks configurability in prioritization and preemption of interrupts. The RISC-V Core Local Interrupt Controller (CLIC) specification addresses this concern by enabling pre-emptible, low-latency vectored interrupts while also envisioning optional extensions to improve interrupt latency. In this work, we implement a CLIC for the CV32E40P, an industrially supported open-source 32-bit MCU-class RISC-V core, and enhance it with fastirq: a custom extension that provides interrupt latency as low as 6 cycles. We call CV32RT our enhanced core. To the best of our knowledge, CV32RT is the first fully open-source RV32 core with competitive interrupt-handling features compared to the Arm Cortex-M series and TriCore. The proposed extensions are also demonstrated to improve task context switching in real-time operating systems.


title: Peak Estimation of Rational Systems using Convex Optimization

abstract: This paper presents algorithms that upper-bound the peak value of a state function along trajectories of a continuous-time system with rational dynamics. The finite-dimensional but nonconvex peak estimation problem is cast as a convex infinite-dimensional linear program in occupation measures. This infinite-dimensional program is then truncated into finite-dimensions using the moment-Sum-of-Squares (SOS) hierarchy of semidefinite programs. Prior work on treating rational dynamics using the moment-SOS approach involves clearing dynamics to common denominators or adding lifting variables to handle reciprocal terms under new equality constraints. Our solution method uses a sum-of-rational method based on absolute continuity of measures. The Moment-SOS truncations of our program possess lower computational complexity and (empirically demonstrated) higher accuracy of upper bounds on example systems as compared to prior approaches.


title: GT4Py: High Performance Stencils for Weather and Climate Applications using Python

abstract: All major weather and climate applications are currently developed using languages such as Fortran or C++. This is typical in the domain of high performance computing (HPC), where efficient execution is an important concern. Unfortunately, this approach leads to implementations that intermix optimizations for specific hardware architectures with the high-level numerical methods that are typical for the domain. This leads to code that is verbose, difficult to extend and maintain, and difficult to port to different hardware architectures. Here, we propose a different strategy based on GT4Py (GridTools for Python). GT4Py is a Python framework to write weather and climate applications that includes a high-level embedded domain specific language (DSL) to write stencil computations. The toolchain integrated in GT4Py enables automatic code-generation,to obtain the performance of state-of-the-art C++ and CUDA implementations. The separation of concerns between the mathematical definitions and the actual implementations allows for performance portability of the computations on a wide range of computing architectures, while being embedded in Python allows easy access to the tools of the Python ecosystem to enhance the productivity of the scientists and facilitate integration in complex workflows. Here, the initial release of GT4Py is described, providing an overview of the current state of the framework and performance results showing how GT4Py can outperform pure Python implementations by orders of magnitude.


title: The taste of IPA: Towards open-vocabulary keyword spotting and forced alignment in any language

abstract: In this project, we demonstrate that phoneme-based models for speech processing can achieve strong crosslinguistic generalizability to unseen languages. We curated the IPAPACK, a massively multilingual speech corpora with phonemic transcriptions, encompassing more than 115 languages from diverse language families, selectively checked by linguists. Based on the IPAPACK, we propose CLAP-IPA, a multi-lingual phoneme-speech contrastive embedding model capable of open-vocabulary matching between arbitrary speech signals and phonemic sequences. The proposed model was tested on 95 unseen languages, showing strong generalizability across languages. Temporal alignments between phonemes and speech signals also emerged from contrastive training, enabling zeroshot forced alignment in unseen languages. We further introduced a neural forced aligner IPA-ALIGNER by finetuning CLAP-IPA with the Forward-Sum loss to learn better phone-to-audio alignment. Evaluation results suggest that IPA-ALIGNER can generalize to unseen languages without adaptation.


title: Anti-LM Decoding for Zero-shot In-context Machine Translation

abstract: Zero-shot In-context learning is the phenomenon where models can perform the task simply given the instructions. However, pre-trained large language models are known to be poorly calibrated for this task. One of the most effective approaches to handling this bias is to adopt a contrastive decoding objective, which accounts for the prior probability of generating the next token by conditioning on some context. This work introduces an Anti-Language Model objective with a decay factor designed to address the weaknesses of In-context Machine Translation. We conduct our experiments across 3 model types and sizes, 3 language directions, and for both greedy decoding and beam search ($B=5$). The proposed method outperforms other state-of-art decoding objectives, with up to $20$ BLEU point improvement from the default objective observed in some settings.


title: Protecting the Future of Information: LOCO Coding With Error Detection for DNA Data Storage

abstract: DNA strands serve as a storage medium for $4$-ary data over the alphabet $\{A,T,G,C\}$. DNA data storage promises formidable information density, long-term durability, and ease of replicability. However, information in this intriguing storage technology might be corrupted. Experiments have revealed that DNA sequences with long homopolymers and/or with low $GC$-content are notably more subject to errors upon storage. This paper investigates the utilization of the recently-introduced method for designing lexicographically-ordered constrained (LOCO) codes in DNA data storage. This paper introduces DNA LOCO (D-LOCO) codes, over the alphabet $\{A,T,G,C\}$ with limited runs of identical symbols. These codes come with an encoding-decoding rule we derive, which provides affordable encoding-decoding algorithms. In terms of storage overhead, the proposed encoding-decoding algorithms outperform those in the existing literature. Our algorithms are readily reconfigurable. D-LOCO codes are intrinsically balanced, which allows us to achieve balancing over the entire DNA strand with minimal rate penalty. Moreover, we propose four schemes to bridge consecutive codewords, three of which guarantee single substitution error detection per codeword. We examine the probability of undetecting errors. We also show that D-LOCO codes are capacity-achieving and that they offer remarkably high rates at moderate lengths.