title: 3D EAGAN: 3D edge-aware attention generative adversarial network for prostate segmentation in transrectal ultrasound images

abstract: Automatic prostate segmentation in TRUS images has always been a challenging problem, since prostates in TRUS images have ambiguous boundaries and inhomogeneous intensity distribution. Although many prostate segmentation methods have been proposed, they still need to be improved due to the lack of sensibility to edge information. Consequently, the objective of this study is to devise a highly effective prostate segmentation method that overcomes these limitations and achieves accurate segmentation of prostates in TRUS images. A 3D edge-aware attention generative adversarial network (3D EAGAN)-based prostate segmentation method is proposed in this paper, which consists of an edge-aware segmentation network (EASNet) that performs the prostate segmentation and a discriminator network that distinguishes predicted prostates from real prostates. The proposed EASNet is composed of an encoder-decoder-based U-Net backbone network, a detail compensation module, four 3D spatial and channel attention modules, an edge enhance module, and a global feature extractor. The detail compensation module is proposed to compensate for the loss of detailed information caused by the down-sampling process of the encoder. The features of the detail compensation module are selectively enhanced by the 3D spatial and channel attention module. Furthermore, an edge enhance module is proposed to guide shallow layers in the EASNet to focus on contour and edge information in prostates. Finally, features from shallow layers and hierarchical features from the decoder module are fused through the global feature extractor to predict the segmentation prostates.


title: Topological Interpretation of Black Hole Phase Transition in Gauss-Bonnet Gravity

abstract: Phase transitions of Einstein-Gauss-Bonnet black holes are studied using Duan's $\phi-$ field topological current theory, where black holes are treated as topological defects in the thermodynamic parameter space. The kinetics of thermodynamic defects are studied using Duan's bifurcation theory. In this picture, a first-order phase transition between small/large black hole phases is interpreted as the interchange of winding numbers between the defects as a result of some action at a distance.We observe a first-order phase transition between small/large black holes for $D=5$ Gauss-Bonnet theory similar to Reissner-Nordstr\"{o}m black holes in AdS space. This implies that these black hole solutions share the same topology and phase structure. We have also studied the phase transition of neutral black holes in $D\geq 6$ and found a transition between unstable small and large stable black hole phases similar to the case of neutral black holes in AdS space. Recently, it has been conjectured that black holes with similar topological structure exhibit the same thermodynamic properties. Our results strengthen the conjecture by connecting the topological nature of black holes to phase transitions.


title: Optical drive of amplitude and phase modes in excitonic insulators

abstract: Motivated by recent interests in exploring excitonic condensate as the ground state of some narrow-bandgap semiconductors such as transition metal dichalcogenides and layered chalcogenide material Ta$_2$NiSe$_5$, in this work we theoretically study the dynamics of condensate in response to periodically driven laser fields with different polarizations and intensities. In particular, we consider laser light beams with bicircular and circular polarizations breaking the time-revesal symmetry, and linear polarization. We show that the amplitude of the condensate oscillates in time during irradiating by light with a magnitude depending on the light intensity. The dynamics survives even after the light is switched off. The phase mode however changes linearly with time for a condensate originating from purely electronic correlations. We further show that in the presence of electron-phonon coupling the linear-in-time behavior is replaced by a harmonically oscillating behavior, a manifestation of gapped phase modes due to relative band charge symmetry breaking. Furthermore, we show that the primarily electronic and primarily lattice cases corresponding to strong and weak electron-phonon coupling, respectively, reveal distinct dynamics of the condensate, an observation which can modify the optical response of an excitonic insulator by stimulating amplitude and phase modes in the former case.


title: Generative Structural Design Integrating BIM and Diffusion Model

abstract: Intelligent structural design using AI can effectively reduce time overhead and increase efficiency. It has potential to become the new design paradigm in the future to assist and even replace engineers, and so it has become a research hotspot in the academic community. However, current methods have some limitations to be addressed, whether in terms of application scope, visual quality of generated results, or evaluation metrics of results. This study proposes a comprehensive solution. Firstly, we introduce building information modeling (BIM) into intelligent structural design and establishes a structural design pipeline integrating BIM and generative AI, which is a powerful supplement to the previous frameworks that only considered CAD drawings. In order to improve the perceptual quality and details of generations, this study makes 3 contributions. Firstly, in terms of generation framework, inspired by the process of human drawing, a novel 2-stage generation framework is proposed to replace the traditional end-to-end framework to reduce the generation difficulty for AI models. Secondly, in terms of generative AI tools adopted, diffusion models (DMs) are introduced to replace widely used generative adversarial network (GAN)-based models, and a novel physics-based conditional diffusion model (PCDM) is proposed to consider different design prerequisites. Thirdly, in terms of neural networks, an attention block (AB) consisting of a self-attention block (SAB) and a parallel cross-attention block (PCAB) is designed to facilitate cross-domain data fusion. The quantitative and qualitative results demonstrate the powerful generation and representation capabilities of PCDM. Necessary ablation studies are conducted to examine the validity of the methods. This study also shows that DMs have the potential to replace GANs and become the new benchmark for generative problems in civil engineering.


title: Comparing Latency and Power Consumption: Quantum vs. Classical Preprocessing

abstract: Low latency and low power consumption are the main goals for our future networks. Fiber optics are already widely used for their faster speed. We want to investigate if optical decoding has further advantages to reaching future goals. We have investigated and compared the decoding latency and power consumption of an optical chip and its electronic counterpart built with MOSFETs. We have found that optical processing has a speed and power consumption benefit. For future networks and real-time applications, this can bring huge advantages over our current electronic processors.


title: Holographic renormalization of Horndeski gravity

abstract: We study the renormalization of a particular sector of Horndeski theory. In particular, we focus on the nonminimal coupling of a scalar field to the Gauss-Bonnet term and its kinetic coupling to the Einstein tensor. Adopting a power expansion on the scalar function that couples the Gauss-Bonnet term, we find specific conditions on their coefficients such that the action and charges are finite. To accomplish the latter, we add a finite set of intrinsic boundary terms. The contribution of the nonminimal coupling generates an effective scalar mass, allowing us to recover a modified Breitenlohner-Freedman bound. Furthermore, we compute the holographic 1-point functions and Ward identities associated with the scalar field and the metric. We constrain the parameter space of the theory by taking into account the preservation of scaling symmetry at the boundary.


title: Feature Space Renormalization for Semi-supervised Learning

abstract: Semi-supervised learning (SSL) has been proven to be a powerful method for leveraging unlabelled data to alleviate models' dependence on large labelled datasets. The common framework among recent approaches is to train the model on a large amount of unlabelled data with consistency regularization to constrain the model predictions to be invariant to input perturbation. However, the existing SSL frameworks still have room for improvement in the consistency regularization method. Instead of regularizing category predictions in the label space as in existing frameworks, this paper proposes a feature space renormalization (FSR) mechanism for SSL. First, we propose a feature space renormalization mechanism to substitute for the commonly used consistency regularization mechanism to learn better discriminative features. To apply this mechanism, we start by building a basic model and an empirical model and then introduce our mechanism to renormalize the feature learning of the basic model with the guidance of the empirical model. Second, we combine the proposed mechanism with pseudo-labelling to obtain a novel effective SSL model named FreMatch. The experimental results show that our method can achieve better performance on a variety of standard SSL benchmark datasets, and the proposed feature space renormalization mechanism can also enhance the performance of other SSL approaches.


title: Multi-View Causal Representation Learning with Partial Observability

abstract: We present a unified framework for studying the identifiability of representations learned from simultaneously observed views, such as different data modalities. We allow a partially observed setting in which each view constitutes a nonlinear mixture of a subset of underlying latent variables, which can be causally related. We prove that the information shared across all subsets of any number of views can be learned up to a smooth bijection using contrastive learning and a single encoder per view. We also provide graphical criteria indicating which latent variables can be identified through a simple set of rules, which we refer to as identifiability algebra. Our general framework and theoretical results unify and extend several previous works on multi-view nonlinear ICA, disentanglement, and causal representation learning. We experimentally validate our claims on numerical, image, and multi-modal data sets. Further, we demonstrate that the performance of prior methods is recovered in different special cases of our setup. Overall, we find that access to multiple partial views enables us to identify a more fine-grained representation, under the generally milder assumption of partial observability.


title: Finite permutation groups of rank $3$

abstract: The classification of the finite primitive permutation groups of rank $3$ was completed in the 1980s and this landmark achievement has found a wide range of applications. In the general transitive setting, a classical result of Higman shows that every finite imprimitive rank $3$ permutation group $G$ has a unique non-trivial block system $\mathcal{B}$ and this provides a natural way to partition the analysis of these groups. Indeed, the induced permutation group $G^{\mathcal{B}}$ is $2$-transitive and one can also show that the action induced on each block in $\mathcal{B}$ is also $2$-transitive (and so both induced groups are either affine or almost simple). In this paper, we make progress towards a classification of the rank $3$ imprimitive groups by studying the case where the induced action of $G$ on a block in $\mathcal{B}$ is of affine type. Our main theorem divides these rank $3$ groups into four classes, which are defined in terms of the kernel of the action of $G$ on $\mathcal{B}$. In particular, we completely determine the rank $3$ semiprimitive groups for which $G^{\mathcal{B}}$ is almost simple, extending recent work of Baykalov, Devillers and Praeger. We also prove that if $G$ is rank $3$ semiprimitive and $G^{\mathcal{B}}$ is affine, then $G$ has a regular normal subgroup which is a special $p$-group for some prime $p$.


title: mmFUSION: Multimodal Fusion for 3D Objects Detection

abstract: Multi-sensor fusion is essential for accurate 3D object detection in self-driving systems. Camera and LiDAR are the most commonly used sensors, and usually, their fusion happens at the early or late stages of 3D detectors with the help of regions of interest (RoIs). On the other hand, fusion at the intermediate level is more adaptive because it does not need RoIs from modalities but is complex as the features of both modalities are presented from different points of view. In this paper, we propose a new intermediate-level multi-modal fusion (mmFUSION) approach to overcome these challenges. First, the mmFUSION uses separate encoders for each modality to compute features at a desired lower space volume. Second, these features are fused through cross-modality and multi-modality attention mechanisms proposed in mmFUSION. The mmFUSION framework preserves multi-modal information and learns to complement modalities' deficiencies through attention weights. The strong multi-modal features from the mmFUSION framework are fed to a simple 3D detection head for 3D predictions. We evaluate mmFUSION on the KITTI and NuScenes dataset where it performs better than available early, intermediate, late, and even two-stage based fusion schemes. The code with the mmdetection3D project plugin will be publicly available soon.


title: Over-the-Air Computation Empowered Federated Learning: A Joint Uplink-Downlink Design

abstract: In this paper, we investigate the communication designs of over-the-air computation (AirComp) empowered federated learning (FL) systems considering uplink model aggregation and downlink model dissemination jointly. We first derive an upper bound on the expected difference between the training loss and the optimal loss, which reveals that optimizing the FL performance is equivalent to minimizing the distortion in the received global gradient vector at each edge node. As such, we jointly optimize each edge node transmit and receive equalization coefficients along with the edge server forwarding matrix to minimize the maximum gradient distortion across all edge nodes. We further utilize the MNIST dataset to evaluate the performance of the considered FL system in the context of the handwritten digit recognition task. Experiment results show that deploying multiple antennas at the edge server significantly reduces the distortion in the received global gradient vector, leading to a notable improvement in recognition accuracy compared to the single antenna case.


title: Estimator-Coupled Reinforcement Learning for Robust Purely Tactile In-Hand Manipulation

abstract: This paper identifies and addresses the problems with naively combining (reinforcement) learning-based controllers and state estimators for robotic in-hand manipulation. Specifically, we tackle the challenging task of purely tactile, goal-conditioned, dextrous in-hand reorientation with the hand pointing downwards. Due to the limited sensing available, many control strategies that are feasible in simulation when having full knowledge of the object's state do not allow for accurate state estimation. Hence, separately training the controller and the estimator and combining the two at test time leads to poor performance. We solve this problem by coupling the control policy to the state estimator already during training in simulation. This approach leads to more robust state estimation and overall higher performance on the task while maintaining an interpretability advantage over end-to-end policy learning. With our GPU-accelerated implementation, learning from scratch takes a median training time of only 6.5 hours on a single, low-cost GPU. In simulation experiments with the DLR-Hand II and for four significantly different object shapes, we provide an in-depth analysis of the performance of our approach. We demonstrate the successful sim2real transfer by rotating the four objects to all 24 orientations in the $\pi/2$ discretization of SO(3), which has never been achieved for such a diverse set of shapes. Finally, our method can reorient a cube consecutively to nine goals (median), which was beyond the reach of previous methods in this challenging setting.


title: Neural Yarn-Level Appearance Model for Cloth Rendering

abstract: The realistic rendering of woven and knitted fabrics has posed significant challenges throughout many years. Previously, fiber-based micro-appearance models have achieved considerable success in attaining high levels of realism. However, rendering such models remains complex due to the intricate internal scatterings of hundreds or thousands of fibers within a yarn, requiring vast amounts of memory and time to render. In this paper, we introduce a novel framework to capture yarn-level appearance by tracing and aggregating many light paths through the underlying fiber geometry. We then employ lightweight neural networks to accurately model the aggregated BSDF, which allows for the precise modeling of a diverse array of materials while offering substantial improvements in speed and reductions in memory. Furthermore, we introduce a novel importance sampling scheme to further speed up the rate of convergence. We validate the efficacy and versatility of our framework through comparisons with preceding fiber-based shading models and by replicating various real-world fabrics. Our proposed model's enhanced performance and adaptability make it especially beneficial for film and video game production applications.


title: The flavor of a minimal composite $S_1$ leptoquark and the $b\to c\tau\bar\nu$ anomaly

abstract: Several experiments have measured a deviation in $B\to D^{(*)}$ semileptonic decays, that point to new physics at the TeV scale violating lepton flavor universality. A scalar leptoquark $S_1$, with a suitable structure of couplings in flavor space, is known to be able to solve this anomaly modifying $b\to c\tau\bar\nu$. In the context of composite Higgs models, we consider a theory containing $H$ and $S_1$ as Nambu-Goldstone bosons (NGBs) of a new strongly interacting sector, with ordinary resonances at a scale ${\cal O}(10)$ TeV. Assuming anarchic partial compositeness of the Standard Model (SM) fermions we calculate the potential of the NGBs that is dominated by the fermions of the third generation, we compute $R_{D^{(*)}}$ and estimate the corrections to flavor observables by the presence of $S_1$. We find that the SM spectrum and $m_{S_1}\sim$ TeV can be obtained with a NGB decay constant of order $\sim 5$ TeV. We obtain a robust correlation between the main corrections to $R_{D^{(*)}}$, $B_{K^{(*)}\nu\nu}$ and $g_\tau/g_\mu$, that leads to a sever bound on $R_{D^{(*)}}$, roughly $2\sigma$ below the experimental value. Besides the bounds on the flavor observables $g_\tau^W$, BR$(\tau\to\mu\gamma)$ and $\Delta m_{B_s}$ are saturated, with the first one requiring a coupling between resonances $g_*\lesssim 2$, whereas the second one demands $m_{S_1}\gtrsim 1.7$ TeV, up to corrections of ${\cal O}(1)$.


title: News in the CODE Catalogue

abstract: We describe here updates and new elements of the Catalogue of Cometary Orbits and their Dynamical Evolution (CODE) that, in its original 2020 version, has been introduced by Kr\'olikowska & Dybczy\'nski (2020). Currently, the CODE Catalogue offers rich sets of orbital solutions for almost a complete sample of Oort spike comets discovered between 1900 and 2021. We often offer several orbital solutions based on different nongravitational force models or different observational material treatments. An important novelty is that the `previous` (at previous perihelion or at 120,000 au from the Sun in the past) and `next` (at next perihelion or 120,000 au after leaving the planetary zone) orbits are given in two variants. One with the dynamical model restricted only to the full Galactic tide (with all individual stars omitted) and the second one, where all currently known stellar perturbers are also taken into account. Calculations of the previous and next orbits were performed using the up-to-date StePPeD database of potential stellar perturbers.


title: KPI Extraction from Maintenance Work Orders -- A Comparison of Expert Labeling, Text Classification and AI-Assisted Tagging for Computing Failure Rates of Wind Turbines

abstract: Maintenance work orders are commonly used to document information about wind turbine operation and maintenance. This includes details about proactive and reactive wind turbine downtimes, such as preventative and corrective maintenance. However, the information contained in maintenance work orders is often unstructured and difficult to analyze, presenting challenges for decision-makers wishing to use it for optimizing operation and maintenance. To address this issue, this work compares three different approaches to calculate reliability by performance indicators from maintenance work orders. The first approach involves manual labeling of the maintenance work orders by domain experts, using the schema defined in an industrial guideline to assign the label accordingly. The second approach involves the development of a model that automatically labels the maintenance work orders using text classification methods. Through this method, we are able to achieve macro average and weighted average F1-Scores of 0.75 and 0.85 respectively. The third technique uses an AI-assisted tagging tool to tag and structure the raw maintenance information, together with a novel rule-based approach for extracting relevant maintenance work orders for failure rate calculation. In our experiments the AI-assisted tool leads to a 88% drop in tagging time in comparison to the other two approaches, while expert labeling and text classification are more accurate in KPI extraction. Overall, our findings make extracting maintenance information from maintenance work orders more efficient, enable the assessment of reliability key performance indicators and therefore support the optimization of wind turbine operation and maintenance.


title: A Study of the One-Dimensional Heat-Conduction Equation with Radiation

abstract: We consider a boundary value problem (BVP) modelling one-dimensional heat-conduction with radiation, which is derived from the Stefan-Boltzmann law. The problem strongly depends on the parameters, making difficult to estimate the solution. We use an analytical approach to determine upper and lower bounds to the exact solution of the BVP, which allows estimating the latter. Finally, we support our theoretical arguments with numerical data, by implementing them into the MAPLE computer program.


title: Can CLIP Help Sound Source Localization?

abstract: Large-scale pre-trained image-text models demonstrate remarkable versatility across diverse tasks, benefiting from their robust representational capabilities and effective multimodal alignment. We extend the application of these models, specifically CLIP, to the domain of sound source localization. Unlike conventional approaches, we employ the pre-trained CLIP model without explicit text input, relying solely on the audio-visual correspondence. To this end, we introduce a framework that translates audio signals into tokens compatible with CLIP's text encoder, yielding audio-driven embeddings. By directly using these embeddings, our method generates audio-grounded masks for the provided audio, extracts audio-grounded image features from the highlighted regions, and aligns them with the audio-driven embeddings using the audio-visual correspondence objective. Our findings suggest that utilizing pre-trained image-text models enable our model to generate more complete and compact localization maps for the sounding objects. Extensive experiments show that our method outperforms state-of-the-art approaches by a significant margin.


title: Multitask Multimodal Prompted Training for Interactive Embodied Task Completion

abstract: Interactive and embodied tasks pose at least two fundamental challenges to existing Vision & Language (VL) models, including 1) grounding language in trajectories of actions and observations, and 2) referential disambiguation. To tackle these challenges, we propose an Embodied MultiModal Agent (EMMA): a unified encoder-decoder model that reasons over images and trajectories, and casts action prediction as multimodal text generation. By unifying all tasks as text generation, EMMA learns a language of actions which facilitates transfer across tasks. Different to previous modular approaches with independently trained components, we use a single multitask model where each task contributes to goal completion. EMMA performs on par with similar models on several VL benchmarks and sets a new state-of-the-art performance (36.81% success rate) on the Dialog-guided Task Completion (DTC), a benchmark to evaluate dialog-guided agents in the Alexa Arena


title: A new connectivity bound for a tournament to be highly linked

abstract: A digraph $D$ is $k$-linked if for any pair of two disjoint sets $\{x_{1},x_{2},\ldots,x_{k}\}$ and $\{y_{1},y_{2},\ldots,y_{k}\}$ of vertices in $D$, there exist vertex disjoint dipaths $P_{1},P_{2},\ldots,P_{k}$ such that $P_{i}$ is a dipath from $x_{i}$ to $y_{i}$ for each $i\in[k]$. Pokrovskiy (JCTB, 2015) confirmed a conjecture of K\"{u}hn et al. (Proc. Lond. Math. Soc., 2014) by verifying that every $452k$-connected tournament is $k$-linked. Meng et al. (Eur. J. Comb., 2021) improved this upper bound by showing that any $(40k-31)$-connected tournament is $k$-linked. In this paper, we show a better upper bound by proving that every $\lceil 12.5k-6\rceil$-connected tournament with minimum out-degree at least $21k-14$ is $k$-linked. Furthermore, we improve a key lemma that was first introduced by Pokrovskiy (JCTB, 2015) and later enhanced by Meng et al. (Eur. J. Comb., 2021).


title: LISBET: a self-supervised Transformer model for the automatic segmentation of social behavior motifs

abstract: Social behavior, defined as the process by which individuals act and react in response to others, is crucial for the function of societies and holds profound implications for mental health. To fully grasp the intricacies of social behavior and identify potential therapeutic targets for addressing social deficits, it is essential to understand its core principles. Although machine learning algorithms have made it easier to study specific aspects of complex behavior, current methodologies tend to focus primarily on single-animal behavior. In this study, we introduce LISBET (seLf-supervIsed Social BEhavioral Transformer), a model designed to detect and segment social interactions. Our model eliminates the need for feature selection and extensive human annotation by using self-supervised learning to detect and quantify social behaviors from dynamic body parts tracking data. LISBET can be used in hypothesis-driven mode to automate behavior classification using supervised finetuning, and in discovery-driven mode to segment social behavior motifs using unsupervised learning. We found that motifs recognized using the discovery-driven approach not only closely match the human annotations but also correlate with the electrophysiological activity of dopaminergic neurons in the Ventral Tegmental Area (VTA). We hope LISBET will help the community improve our understanding of social behaviors and their neural underpinnings.


title: On the Post-Lie Structure in SISO Affine Feedback Control Systems

abstract: The main objective of this work is to show that the single-input, single-output (SISO) affine feedback group, a transformation group in the context of the affine feedback interconnection of Chen-Fliess series, is a post-group in the sense of Bai, Guo, Sheng and Tang.


title: Energy-Calibrated VAE with Test Time Free Lunch

abstract: In this paper, we propose a novel generative model that utilizes a conditional Energy-Based Model (EBM) for enhancing Variational Autoencoder (VAE), termed Energy-Calibrated VAE (EC-VAE). Specifically, VAEs often suffer from blurry generated samples due to the lack of a tailored training on the samples generated in the generative direction. On the other hand, EBMs can generate high-quality samples but require expensive Markov Chain Monte Carlo (MCMC) sampling. To address these issues, we introduce a conditional EBM for calibrating the generative direction of VAE during training, without requiring it for the generation at test time. In particular, we train EC-VAE upon both the input data and the calibrated samples with adaptive weight to enhance efficacy while avoiding MCMC sampling at test time. Furthermore, we extend the calibration idea of EC-VAE to variational learning and normalizing flows, and apply EC-VAE to an additional application of zero-shot image restoration via neural transport prior and range-null theory. We evaluate the proposed method with two applications, including image generation and zero-shot image restoration, and the experimental results show that our method achieves competitive performance over single-step non-adversarial generation. Our code is available at https://github.com/DJ-LYH/EC-VAE.


title: Beyond Imitation: Leveraging Fine-grained Quality Signals for Alignment

abstract: Alignment with human preference is a desired property of large language models (LLMs). Currently, the main alignment approach is based on reinforcement learning from human feedback (RLHF). Despite the effectiveness of RLHF, it is intricate to implement and train, thus recent studies explore how to develop alternative alignment approaches based on supervised fine-tuning (SFT). A major limitation of SFT is that it essentially does imitation learning, which cannot fully understand what are the expected behaviors. To address this issue, we propose an improved alignment approach named FIGA. Different from prior methods, we incorporate fine-grained (i.e., token or phrase level) quality signals that are derived by contrasting good and bad responses. Our approach has made two major contributions. Firstly, we curate a refined alignment dataset that pairs initial responses and the corresponding revised ones. Secondly, we devise a new loss function can leverage fine-grained quality signals to instruct the learning of LLMs for alignment. Extensive experiments have demonstrated the effectiveness of our approaches by comparing a number of competitive baselines.


title: Debiased Fixed Effects Estimation of Binary Logit Models with Three-Dimensional Panel Data

abstract: Naive maximum likelihood estimation of binary logit models with fixed effects leads to unreliable inference due to the incidental parameter problem. We study the case of three-dimensional panel data, where the model includes three sets of additive and overlapping unobserved effects. This encompasses models for network panel data, where senders and receivers maintain bilateral relationships over time, and fixed effects account for unobserved heterogeneity at the sender-time, receiver-time, and sender-receiver levels. In an asymptotic framework, where all three panel dimensions grow large at constant relative rates, we characterize the leading bias of the naive estimator. The inference problem we identify is particularly severe, as it is not possible to balance the order of the bias and the standard deviation. As a consequence, the naive estimator has a degenerating asymptotic distribution, which exacerbates the inference problem relative to other fixed effects estimators studied in the literature. To resolve the inference problem, we derive explicit expressions to debias the fixed effects estimator.


title: Keldysh field theory of dynamical exciton condensation transitions in nonequilibrium electron-hole bilayers

abstract: Recent experiments have realized steady-state electrical injection of interlayer excitons in electron-hole bilayers subject to a large bias voltage. In the ideal case in which interlayer tunneling is negligibly weak, the system is in quasi-equilibrium with a reduced effective band gap. Interlayer tunneling introduces a current and drives the system out of equilibrium. In this work we derive a nonequilibrium field theory description of interlayer excitons in biased electron-hole bilayers. In the large bias limit, we find that p-wave interlayer tunneling reduces the effective band gap and increases the effective temperature for intervalley excitons. We discuss possible experimental implications for InAs/GaSb quantum wells and transition metal dichalcogenide bilayers.


title: General relativistic dynamical tides in binary inspirals, without modes

abstract: A neutron star in an inspiraling binary system is tidally deformed by its companion, and the effect leaves a measurable imprint on the emitted gravitational waves. While the tidal interaction falls within the regime of static tides during the early stages of inspiral, a regime of dynamical tides takes over in the later stages. The description of dynamical tides found in the literature makes integral use of a spectral representation of the tidal deformation, in which it is expressed as a sum over the star's normal modes of vibration. This description is deeply rooted in Newtonian fluid mechanics and gravitation, and we point out that considerable obstacles manifest themselves in an extension to general relativity. To remedy this we propose an alternative, mode-less description of dynamical tides that can be formulated in both Newtonian and relativistic mechanics. Our description is based on a time-derivative expansion of the tidal dynamics. The tidal deformation is characterized by two sets of Love numbers: the static Love numbers $k_\ell$ and the dynamic Love numbers $\ddot{k}_\ell$. These are computed here for polytropic stellar models in both Newtonian gravity and general relativity. The time-derivative expansion of the tidal dynamics seems to preclude any attempt to capture an approach to resonance, which occurs when the frequency of the tidal field becomes equal to a normal-mode frequency. To overcome this limitation we propose a pragmatic extension of the time-derivative expansion which does capture an approach to resonance. We demonstrate that with this extension, our formulation of dynamical tides should be just as accurate as the $f$-mode truncation of the mode representation, in which the sum over modes is truncated to a single term involving the star's fundamental mode of vibration.


title: Do LLMs exhibit human-like response biases? A case study in survey design

abstract: As large language models (LLMs) become more capable, there is growing excitement about the possibility of using LLMs as proxies for humans in real-world tasks where subjective labels are desired, such as in surveys and opinion polling. One widely-cited barrier to the adoption of LLMs as proxies for humans in subjective tasks is their sensitivity to prompt wording - but interestingly, humans also display sensitivities to instruction changes in the form of response biases. We investigate the extent to which LLMs reflect human response biases, if at all. We look to survey design, where human response biases caused by changes in the wordings of "prompts" have been extensively explored in social psychology literature. Drawing from these works, we design a dataset and framework to evaluate whether LLMs exhibit human-like response biases in survey questionnaires. Our comprehensive evaluation of nine models shows that popular open and commercial LLMs generally fail to reflect human-like behavior, particularly in models that have undergone RLHF. Furthermore, even if a model shows a significant change in the same direction as humans, we find that they are sensitive to perturbations that do not elicit significant changes in humans. These results highlight the pitfalls of using LLMs as human proxies, and underscore the need for finer-grained characterizations of model behavior. Our code, dataset, and collected samples are available at https://github.com/lindiatjuatja/BiasMonkey


title: Deep Neural Network based Optimal Control of Greenhouses

abstract: Automatic control of greenhouse crop production is of great interest owing to the increasing energy and labor costs. In this work, we use two-level control, where the upper level generates suitable reference trajectories for states and control inputs based on day-ahead predictions. These references are tracked in the lower level using Nonlinear Model Predictive Control (NMPC). In order to apply NMPC, a model of the greenhouse dynamics is essential. However, the complex nature of the underlying model including discontinuities and nonlinearities results in intractable computational complexity and long sampling times. As a remedy, we employ NMPC as a data generator to learn the tracking control policy using deep neural networks. Then, the references are tracked using the trained Deep Neural Network (DNN) to reduce the computational burden. The efficiency of our approach under real-time disturbances is demonstrated by means of a simulation study.


title: A Lightweight and Secure PUF-Based Authentication and Key-exchange Protocol for IoT Devices

abstract: The Internet of Things (IoT) has improved people's lives by seamlessly integrating into many facets of modern life and facilitating information sharing across platforms. Device Authentication and Key exchange are major challenges for the IoT. High computational resource requirements for cryptographic primitives and message transmission during Authentication make the existing methods like PKI and IBE not suitable for these resource constrained devices. PUF appears to offer a practical and economical security mechanism in place of typically sophisticated cryptosystems like PKI and IBE. PUF provides an unclonable and tamper sensitive unique signature based on the PUF chip by using manufacturing process variability. Therefore, in this study, we use lightweight bitwise XOR, hash function, and PUF to Authenticate IoT devices. Despite several studies employing the PUF to authenticate communication between IoT devices, to the authors' knowledge, existing solutions require intermediary gateway and internet capabilities by the IoT device to directly interact with a Server for Authentication and hence, are not scalable when the IoT device works on different technologies like BLE, Zigbee, etc. To address the aforementioned issue, we present a system in which the IoT device does not require a continuous active internet connection to communicate with the server in order to Authenticate itself. The results of a thorough security study are validated against adversarial attacks and PUF modeling attacks. For formal security validation, the AVISPA verification tool is also used. Performance study recommends this protocol's lightweight characteristics. The proposed protocol's acceptability and defenses against adversarial assaults are supported by a prototype developed with ESP32.


title: Augmenting Lane Perception and Topology Understanding with Standard Definition Navigation Maps

abstract: Autonomous driving has traditionally relied heavily on costly and labor-intensive High Definition (HD) maps, hindering scalability. In contrast, Standard Definition (SD) maps are more affordable and have worldwide coverage, offering a scalable alternative. In this work, we systematically explore the effect of SD maps for real-time lane-topology understanding. We propose a novel framework to integrate SD maps into online map prediction and propose a Transformer-based encoder, SD Map Encoder Representations from transFormers, to leverage priors in SD maps for the lane-topology prediction task. This enhancement consistently and significantly boosts (by up to 60%) lane detection and topology prediction on current state-of-the-art online map prediction methods without bells and whistles and can be immediately incorporated into any Transformer-based lane-topology method. Code is available at https://github.com/NVlabs/SMERF.


title: Revisiting Loop Corrections in Single Field USR Inflation

abstract: We revisit the one-loop corrections on CMB scale perturbations induced from small scale modes in single field models which undergo a phase of ultra slow-roll inflation. There were concerns that large loop corrections are against the notion of the decoupling of scales and they are cancelled out once the boundary terms are included in Hamiltonian. We highlight that the non-linear coupling between the long and short modes and the modulation of the short mode power spectrum by the long mode are the key physical reasons behind the large loop corrections. In particular, in order for the modulation by the long mode to be significant there should be a strong scale-dependent enhancement in power spectrum of the short mode which is the hallmark of the USR inflation. We highlight the important roles played by the would-be decaying mode which were not taken into account properly in recent works claiming the loop cancellation. We confirm the original conclusion that the loop corrections are genuine and they can be dangerous for PBHs formation unless the transition to the final attractor phase is mild.


title: Learning Super-Resolution Ultrasound Localization Microscopy from Radio-Frequency Data

abstract: Ultrasound Localization Microscopy (ULM) enables imaging of vascular structures in the micrometer range by accumulating contrast agent particle locations over time. Precise and efficient target localization accuracy remains an active research topic in the ULM field to further push the boundaries of this promising medical imaging technology. Existing work incorporates Delay-And-Sum (DAS) beamforming into particle localization pipelines, which ultimately determines the ULM image resolution capability. In this paper we propose to feed unprocessed Radio-Frequency (RF) data into a super-resolution network while bypassing DAS beamforming and its limitations. To facilitate this, we demonstrate label projection and inverse point transformation between B-mode and RF coordinate space as required by our approach. We assess our method against state-of-the-art techniques based on a public dataset featuring in silico and in vivo data. Results from our RF-trained network suggest that excluding DAS beamforming offers a great potential to optimize on the ULM resolution performance.


title: Time-Efficient Reinforcement Learning with Stochastic Stateful Policies

abstract: Stateful policies play an important role in reinforcement learning, such as handling partially observable environments, enhancing robustness, or imposing an inductive bias directly into the policy structure. The conventional method for training stateful policies is Backpropagation Through Time (BPTT), which comes with significant drawbacks, such as slow training due to sequential gradient propagation and the occurrence of vanishing or exploding gradients. The gradient is often truncated to address these issues, resulting in a biased policy update. We present a novel approach for training stateful policies by decomposing the latter into a stochastic internal state kernel and a stateless policy, jointly optimized by following the stateful policy gradient. We introduce different versions of the stateful policy gradient theorem, enabling us to easily instantiate stateful variants of popular reinforcement learning and imitation learning algorithms. Furthermore, we provide a theoretical analysis of our new gradient estimator and compare it with BPTT. We evaluate our approach on complex continuous control tasks, e.g., humanoid locomotion, and demonstrate that our gradient estimator scales effectively with task complexity while offering a faster and simpler alternative to BPTT.


title: Formulating and Heuristic Solving of Contact Problems in Hybrid Data-Driven Computational Mechanics

abstract: In this work we consider the hybrid Data-Driven Computational Mechanics (DDCM) approach, in which a smooth constitutive manifold is reconstructed to obtain a well-behaved nonlinear optimization problem (NLP) rather than the much harder discrete-continous NLP (DCNLP) of the direct DDCM approach. The key focus is on the addition of geometric inequality constraints to the hybrid DDCM formulation. Therein, the required constraint force leads to a contact problem in the form of a mathematical program with complementarity constraints (MPCC), a problem class that is still less complex than the DCNLP. For this MPCC we propose a heuristic quick-shot solution approach, which can produce verifiable solutions by solving up to four NLPs. We perform various numerical experiments on three different contact problems of increasing difficulty to demonstrate the potential and limitations of this approach.


title: Minimax Sequential Testing for Poisson Processes

abstract: Suppose we observe a Poisson process in real time for which the intensity may take on two possible values $\lambda_0$ and $\lambda_1$. Suppose further that the priori probability of the true intensity is not given. We solve a minimax version of Bayesian problem of sequential testing of two simple hypotheses to minimize a linear combination of the probability of wrong detection and the expected waiting time in the worst scenario of all possible priori distributions. An equivalent characterization for the least favorable distributions is derived and a sufficient condition for the existence is concluded.


title: A Categorical Model for Retrosynthetic Reaction Analysis

abstract: We introduce a mathematical framework for retrosynthetic analysis, an important research method in synthetic chemistry. Our approach represents molecules and their interaction using string diagrams in layered props - a recently introduced categorical model for partial explanations in scientific reasoning. Such principled approach allows one to model features currently not available in automated retrosynthesis tools, such as chirality, reaction environment and protection-deprotection steps.


title: Covering of triples by quadruples in bipartite and tripartite settings

abstract: Let $A$ and $B$ be disjoint sets of sizes $a$ and $b$, respectively. Let $f(a,b)$ denote the minimum number of quadruples needed to cover all triples $T \subseteq A \cup B$ such that $|T \cap A| \geq 2$. We prove upper and lower bounds on $f(a,b)$ and use them to derive upper bounds for the $(n,4,3,4)$-lottery problem.


title: Spin-Flavor Oscillations of Relic Neutrinos in Primordial Magnetic Field

abstract: The neutrino magnetic moment operator clasps a tiny but non-zero value within the standard model (SM) of particle physics and rather enhanced values in various new physics models. This generation of the magnetic moment ($\mu_\nu$) is through quantum loop corrections which can exhibit spin-flavor oscillations in the presence of an external magnetic field. Also, several studies predict the existence of a primordial magnetic field (PMF) in the early universe, extending back to the era of Big Bang Nucleosynthesis (BBN) and before. The recent NANOGrav measurement can be considered as a strong indication of the presence of these PMFs. In this work, we consider the effect of the PMF on the flux of relic neutrinos. For Dirac neutrinos, we show that half of the active relic neutrinos can become sterile due to spin-flavor oscillations well before becoming non-relativistic owing to the expansion of the Universe and also before the timeline of the formation of galaxies and hence intergalactic fields, subject to the constraints on the combined value of $\mu_\nu$ and the cosmic magnetic field at the time of neutrino decoupling. For the upper limit of PMF allowed by the BBN, this can be true even if the experimental bounds on $\mu_{\nu}$ approaches a few times its SM value.


title: Personality Style Recognition via Machine Learning: Identifying Anaclitic and Introjective Personality Styles from Patients' Speech

abstract: In disentangling the heterogeneity observed in psychopathology, personality of the patients is considered crucial. While it has been demonstrated that personality traits are reflected in the language used by a patient, we hypothesize that this enables automatic inference of the personality type directly from speech utterances, potentially more accurately than through a traditional questionnaire-based approach explicitly designed for personality classification. To validate this hypothesis, we adopt natural language processing (NLP) and standard machine learning tools for classification. We test this on a dataset of recorded clinical diagnostic interviews (CDI) on a sample of 79 patients diagnosed with major depressive disorder (MDD) -- a condition for which differentiated treatment based on personality styles has been advocated -- and classified into anaclitic and introjective personality styles. We start by analyzing the interviews to see which linguistic features are associated with each style, in order to gain a better understanding of the styles. Then, we develop automatic classifiers based on (a) standardized questionnaire responses; (b) basic text features, i.e., TF-IDF scores of words and word sequences; (c) more advanced text features, using LIWC (linguistic inquiry and word count) and context-aware features using BERT (bidirectional encoder representations from transformers); (d) audio features. We find that automated classification with language-derived features (i.e., based on LIWC) significantly outperforms questionnaire-based classification models. Furthermore, the best performance is achieved by combining LIWC with the questionnaire features. This suggests that more work should be put into developing linguistically based automated techniques for characterizing personality, however questionnaires still to some extent complement such methods.


title: First measurement of the low-energy direct capture in 20Ne(p, {\gamma})21Na and improved energy and strength of the Ecm = 368 keV resonance

abstract: The $\mathrm{^{20}Ne(p, \gamma)^{21}Na}$ reaction is the slowest in the NeNa cycle and directly affects the abundances of the Ne and Na isotopes in a variety of astrophysical sites. Here we report the measurement of its direct capture contribution, for the first time below $E\rm_{cm} = 352$~keV, and of the contribution from the $E^{\rm }_{cm} = 368$~keV resonance, which dominates the reaction rate at $T=0.03-1.00$~GK. The experiment was performed deep underground at the Laboratory for Underground Nuclear Astrophysics, using a high-intensity proton beam and a windowless neon gas target. Prompt $\gamma$ rays from the reaction were detected with two high-purity germanium detectors. We obtain a resonance strength $\omega \gamma~=~(0.112 \pm 0.002_{\rm stat}~\pm~0.005_{\rm sys})$~meV, with an uncertainty a factor of $3$ smaller than previous values. Our revised reaction rate is 20\% lower than previously adopted at $T < 0.1$~GK and agrees with previous estimates at temperatures $T \geq 0.1$~GK. Initial astrophysical implications are presented.


title: Enhanced power spectra from multi-field inflation

abstract: We investigate the enhancement of the power spectra in models with multiple scalar fields large enough to produce primordial black holes. We present analytic solutions for the perturbations in the case of constant turns without the need for an effective field theory for the first time and clarify the role of the Hubble friction that has been overlooked previously. For an arbitrary number of fields we derive the criteria that can lead to an exponential amplification of the curvature perturbation on subhorizon scales, while leaving the perturbations stable on superhorizon scales. Finally, we apply our results on a three-field generalization of the "ultra-light" scenario and show how the presence of field-space torsion can yield distinct observables compared to the two-field case.


title: Proceedings of the 5th International Workshop on Reading Music Systems

abstract: The International Workshop on Reading Music Systems (WoRMS) is a workshop that tries to connect researchers who develop systems for reading music, such as in the field of Optical Music Recognition, with other researchers and practitioners that could benefit from such systems, like librarians or musicologists. The relevant topics of interest for the workshop include, but are not limited to: Music reading systems; Optical music recognition; Datasets and performance evaluation; Image processing on music scores; Writer identification; Authoring, editing, storing and presentation systems for music scores; Multi-modal systems; Novel input-methods for music to produce written music; Web-based Music Information Retrieval services; Applications and projects; Use-cases related to written music. These are the proceedings of the 5th International Workshop on Reading Music Systems, held in Milan, Italy on Nov. 4th 2023.


title: Solvable Polynomial Ideals: The Ideal Reflection for Program Analysis

abstract: This paper presents a program analysis method that generates program summaries involving polynomial arithmetic. Our approach builds on prior techniques that use solvable polynomial maps for summarizing loops. These techniques are able to generate all polynomial invariants for a restricted class of programs, but cannot be applied to programs outside of this class -- for instance, programs with nested loops, conditional branching, unstructured control flow, etc. There currently lacks approaches to apply these prior methods to the case of general programs. This paper bridges that gap. Instead of restricting the kinds of programs we can handle, our method abstracts every loop into a model that can be solved with prior techniques, bringing to bear prior work on solvable polynomial maps to general programs. While no method can generate all polynomial invariants for arbitrary programs, our method establishes its merit through a monotonicty result. We have implemented our techniques, and tested them on a suite of benchmarks from the literature. Our experiments indicate our techniques show promise on challenging verification tasks requiring non-linear reasoning.


title: Krylov complexity is not a measure of distance between states or operators

abstract: We ask whether Krylov complexity is mutually compatible with the circuit and Nielsen definitions of complexity. We show that the Krylov complexities between three states fail to satisfy the triangle inequality and so cannot be a measure of distance: there is no possible metric for which Krylov complexity is the length of the shortest path to the target state or operator. We show this explicitly in the simplest example, a single qubit, and in general.


title: Magnetism in AV3Sb5 (Cs, Rb, K): Origin and Consequences for the Strongly Correlated Phases

abstract: The V-based kagome systems AV3Sb5 (A = Cs, Rb and K) are unique by virtue of the intricate interplay of non-trivial electronic structure, topology and intriguing fermiology, rendering them to be a playground of many mutually dependent exotic phases like charge-order and superconductivity. Despite numerous recent studies, the interconnection of magnetism and other complex collective phenomena in these systems has yet not arrived at any conclusion. Using first-principles tools, we demonstrate that their electronic structures, complex fermiologies and phonon dispersions are strongly influenced by the interplay of dynamic electron correlations, non-trivial spin-polarization and spin-orbit coupling. An investigation of the first-principles-derived inter-site magnetic exchanges with the complementary analysis of q-dependence of the electronic response functions and the electron-phonon coupling indicate that the system conforms as a frustrated spin-cluster, where the occurrence of the charge-order phase is intimately related to the mechanism of electron-phonon coupling, rather than the Fermi-surface nesting.


title: Image-Pointcloud Fusion based Anomaly Detection using PD-REAL Dataset

abstract: We present PD-REAL, a novel large-scale dataset for unsupervised anomaly detection (AD) in the 3D domain. It is motivated by the fact that 2D-only representations in the AD task may fail to capture the geometric structures of anomalies due to uncertainty in lighting conditions or shooting angles. PD-REAL consists entirely of Play-Doh models for 15 object categories and focuses on the analysis of potential benefits from 3D information in a controlled environment. Specifically, objects are first created with six types of anomalies, such as dent, crack, or perforation, and then photographed under different lighting conditions to mimic real-world inspection scenarios. To demonstrate the usefulness of 3D information, we use a commercially available RealSense camera to capture RGB and depth images. Compared to the existing 3D dataset for AD tasks, the data acquisition of PD-REAL is significantly cheaper, easily scalable and easier to control variables. Extensive evaluations with state-of-the-art AD algorithms on our dataset demonstrate the benefits as well as challenges of using 3D information. Our dataset can be downloaded from https://github.com/Andy-cs008/PD-REAL


title: Imitation learning for sim-to-real transfer of robotic cutting policies based on residual Gaussian process disturbance force model

abstract: Robotic cutting, or milling, plays a significant role in applications such as disassembly, decommissioning, and demolition. Planning and control of cutting in real-world scenarios in uncertain environments is a complex task, with the potential to benefit from simulated training environments. This letter focuses on sim-to-real transfer for robotic cutting policies, addressing the need for effective policy transfer from simulation to practical implementation. We extend our previous domain generalisation approach to learning cutting tasks based on a mechanistic model-based simulation framework, by proposing a hybrid approach for sim-to-real transfer based on a milling process force model and residual Gaussian process (GP) force model, learned from either single or multiple real-world cutting force examples. We demonstrate successful sim-to-real transfer of a robotic cutting policy without the need for fine-tuning on the real robot setup. The proposed approach autonomously adapts to materials with differing structural and mechanical properties. Furthermore, we demonstrate the proposed method outperforms fine-tuning or re-training alone.


title: Exact fluctuation and long-range correlations in a single-file model under resetting

abstract: Resetting is a renewal mechanism in which a process is intermittently repeated after a random or fixed time. This simple act of stop and repeat profoundly influences the behaviour of a system as exemplified by the emergence of non-equilibrium properties and expedition of search processes. Herein, we explore the ramifications of stochastic resetting in the context of a single-file system called random average process (RAP) in one dimension. In particular, we focus on the dynamics of tracer particles and analytically compute the variance, equal time correlation, autocorrelation and unequal time correlation between the positions of different tracer particles. Our study unveils that resetting gives rise to rather different behaviours depending on whether the particles move symmetrically or asymmetrically. For the asymmetric case, the system for instance exhibits a long-range correlation which is not seen in absence of the resetting. Similarly, in contrast to the reset-free RAP, the variance shows distinct scalings for symmetric and asymmetric cases. While for the symmetric case, it decays (towards its steady value) as $\sim e^{-r t} / \sqrt{t}$, we find $\sim t e^{-r t}$ decay for the asymmetric case ($r$ being the resetting rate). Finally, we examine the autocorrelation and unequal time correlation in the steady state and demonstrate that they obey interesting scaling forms at late times. All our analytical results are substantiated by extensive numerical simulations.


title: DeepPatent2: A Large-Scale Benchmarking Corpus for Technical Drawing Understanding

abstract: Recent advances in computer vision (CV) and natural language processing have been driven by exploiting big data on practical applications. However, these research fields are still limited by the sheer volume, versatility, and diversity of the available datasets. CV tasks, such as image captioning, which has primarily been carried out on natural images, still struggle to produce accurate and meaningful captions on sketched images often included in scientific and technical documents. The advancement of other tasks such as 3D reconstruction from 2D images requires larger datasets with multiple viewpoints. We introduce DeepPatent2, a large-scale dataset, providing more than 2.7 million technical drawings with 132,890 object names and 22,394 viewpoints extracted from 14 years of US design patent documents. We demonstrate the usefulness of DeepPatent2 with conceptual captioning. We further provide the potential usefulness of our dataset to facilitate other research areas such as 3D image reconstruction and image retrieval.


title: Magnetism in AV3Sb5 (A = Cs, Rb, K): Complex Landscape of the Dynamical Magnetic Textures

abstract: We have investigated the dynamical magnetic properties of the V-based kagome stibnite compounds by combining the ab-initio calculated magnetic parameters of a spin Hamiltonian like inter-site exchange parameters, magnetocrystalline anisotropy and site projected magnetic moments, with full-fledged simulations of atomistic spin-dynamics. Our calculations reveal that in addition to a ferromagnetic order along the [001] direction, the system hosts a complex landscape of magnetic configurations comprised of commensurate and incommensurate spin-spirals along the [010] direction. The presence of such chiral magnetic textures may be the key to solve the mystery about the origin of the experimentally observed inherent breaking of the C6 rotational symmetry- and the time-reversal symmetry.


title: Graph-controlled Permutation Mixers in QAOA for the Flexible Job-Shop Problem

abstract: One of the most promising attempts towards solving optimization problems with quantum computers in the noisy intermediate scale era of quantum computing are variational quantum algorithms. The Quantum Alternating Operator Ansatz provides an algorithmic framework for constrained, combinatorial optimization problems. As opposed to the better known standard QAOA protocol, the constraints of the optimization problem are built into the mixing layers of the ansatz circuit, thereby limiting the search to the much smaller Hilbert space of feasible solutions. In this work we develop mixing operators for a wide range of scheduling problems including the flexible job shop problem. These mixing operators are based on a special control scheme defined by a constraint graph model. After describing an explicit construction of those mixing operators, they are proven to be feasibility preserving, as well as exploring the feasible subspace.


title: Quantum correction to a new Wilson line-based action for Gluodynamics

abstract: We discuss a new classical action that enables efficient computation of the gluonic tree amplitudes but does not contain any triple point vertices. This new formulation is obtained via a canonical transformation of the light-cone Yang-Mills action, with the field transformations based on Wilson line functionals. In addition to MHV vertices, the action contains also $\mathrm{N}^k\mathrm{MHV}$ vertices, where $1 \leq k \leq (n - 4)$, and $n$ is the number of external legs. We computed tree-level amplitudes up to 8 gluons and found agreement with standard results. The classical action is however not sufficient to obtain rational parts of amplitudes, in particular the finite amplitudes with all same helicity gluons. In order to systematically develop quantum corrections to this new action, we derive the one-loop effective action, in such a way there are no quantum contributions missing at one loop.


title: Non-adiabatic polariton condensation in annular optical traps

abstract: We explore formation and dynamics of nonequilibrium bosonic exciton-polariton condensates in annular optically induced traps. For the vicinity of condensation pumping threshold, we develop the two-mode model, accounting for counter-rotating quantized vortices and corresponding angular harmonics in the incoherent excitonic reservoir density. Identifying the range of parameter, in which adiabatic elimination of the reservoir is valid, we extend the analytic model beyond the adiabatic approximation. In the circularly symmetric case, we predict a neutral equilibrium phase due to spontaneous breaking of the continuous symmetry, condensate multistability and limit cycle dynamics. We also account for weak trap asymmetry to show that non-adiabaticity of the coupled condensate-reservoir system prevents formation of giant vortices and outline experimental conditions for their observation.


title: Joint modelling of recurrent and terminal events with discretely-distributed non-parametric frailty: application on re-hospitalizations and death in heart failure patients

abstract: In the context of clinical and biomedical studies, joint frailty models have been developed to study the joint temporal evolution of recurrent and terminal events, capturing both the heterogeneous susceptibility to experiencing a new episode and the dependence between the two processes. While discretely-distributed frailty is usually more exploitable by clinicians and healthcare providers, existing literature on joint frailty models predominantly assumes continuous distributions for the random effects. In this article, we present a novel joint frailty model that assumes bivariate discretely-distributed non-parametric frailties, with an unknown finite number of mass points. This approach facilitates the identification of latent structures among subjects, grouping them into sub-populations defined by a shared frailty value. We propose an estimation routine via Expectation-Maximization algorithm, which not only estimates the number of subgroups but also serves as an unsupervised classification tool. This work is motivated by a study of patients with Heart Failure (HF) receiving ACE inhibitors treatment in the Lombardia region of Italy. Recurrent events of interest are hospitalizations due to HF and terminal event is death for any cause.


title: A counterexample to the Hermite ring conjecture

abstract: We show that there exists a stably free module over a polynomial ring which is not extended from the ground ring. This provides a counterexample to the Hermite ring conjecture.


title: Strong relaxation limit and uniform time asymptotics of the Jin-Xin model in the $L^{p}$ framework

abstract: We investigate the diffusive relaxation limit and the time-asymptotic stability of the Jin-Xin model toward viscous conservation laws in $\mathbb{R}^d$ with $d\geq1$. First, we establish uniform regularity estimates with respect to both the time and the relaxation parameter $\varepsilon>0$, for initial data in hybrid Besov spaces based on general $L^{p}$-norms. This uniformity enables us to derive $\mathcal{O}(\varepsilon)$ bounds on the difference between solutions of the viscous conservation law and its associated Jin-Xin approximation, thus justifying the strong convergence of the Jin-Xin hyperbolic relaxation. Furthermore, under an additional condition on the initial data, for instance, that the low frequencies belong to $L^{p/2}(\mathbb{R}^{d})$, we show that the $L^{p}(\mathbb{R}^d)$-norm of the solution to the Jin-Xin model decays at the optimal rate $(1+t)^{-d/{2p}}$ while the $L^{p}(\mathbb{R}^d)$-norm of its difference with the solution of the associated viscous conservation law decays at the enhanced rate $\varepsilon(1+t)^{-d/{2p}-1/2}$.


title: SPIRAL: An Efficient Algorithm for the Integration of the Equation of Rotational Motion

abstract: We introduce Spiral, a third-order integration algorithm for the rotational motion of extended bodies. It requires only one force calculation per time step, does not require quaternion normalization at each time step, and can be formulated for both leapfrog and synchronous integration schemes, making it compatible with many particle simulation codes. The stability and precision of Spiral exceed those of state-of-the-art algorithms currently used in popular DEM codes such as Yade, MercuryDPM, LIGGGHTS, PFC, and more, at only slightly higher computational cost. Also, beyond DEM, we see potential applications in all numerical simulations that involve the 3D rotation of extended bodies.


title: Interactive Semantic Map Representation for Skill-based Visual Object Navigation

abstract: Visual object navigation using learning methods is one of the key tasks in mobile robotics. This paper introduces a new representation of a scene semantic map formed during the embodied agent interaction with the indoor environment. It is based on a neural network method that adjusts the weights of the segmentation model with backpropagation of the predicted fusion loss values during inference on a regular (backward) or delayed (forward) image sequence. We have implemented this representation into a full-fledged navigation approach called SkillTron, which can select robot skills from end-to-end policies based on reinforcement learning and classic map-based planning methods. The proposed approach makes it possible to form both intermediate goals for robot exploration and the final goal for object navigation. We conducted intensive experiments with the proposed approach in the Habitat environment, which showed a significant superiority in navigation quality metrics compared to state-of-the-art approaches. The developed code and used custom datasets are publicly available at github.com/AIRI-Institute/skill-fusion.


title: The Early Microbenchmark Catches the Bug -- Studying Performance Issues Using Micro- and Application Benchmarks

abstract: An application's performance regressions can be detected by both application or microbenchmarks. While application benchmarks stress the system under test by sending synthetic but realistic requests which, e.g., simulate real user traffic, microbenchmarks evaluate the performance on a subroutine level by calling the function under test repeatedly. In this paper, we use a testbed microservice application which includes three performance issues to study the detection capabilities of both approaches. In extensive benchmarking experiments, we increase the severity of each performance issue stepwise, run both an application benchmark and the microbenchmark suite, and check at which point each benchmark detects the performance issue. Our results show that microbenchmarks detect all three issues earlier, some even at the lowest severity level. Application benchmarks, however, raised false positive alarms, wrongly detected performance improvements, and detected the performance issues later.


title: Do Language Models Learn Semantics of Code? A Case Study in Vulnerability Detection

abstract: Recently, pretrained language models have shown state-of-the-art performance on the vulnerability detection task. These models are pretrained on a large corpus of source code, then fine-tuned on a smaller supervised vulnerability dataset. Due to the different training objectives and the performance of the models, it is interesting to consider whether the models have learned the semantics of code relevant to vulnerability detection, namely bug semantics, and if so, how the alignment to bug semantics relates to model performance. In this paper, we analyze the models using three distinct methods: interpretability tools, attention analysis, and interaction matrix analysis. We compare the models' influential feature sets with the bug semantic features which define the causes of bugs, including buggy paths and Potentially Vulnerable Statements (PVS). We find that (1) better-performing models also aligned better with PVS, (2) the models failed to align strongly to PVS, and (3) the models failed to align at all to buggy paths. Based on our analysis, we developed two annotation methods which highlight the bug semantics inside the model's inputs. We evaluated our approach on four distinct transformer models and four vulnerability datasets and found that our annotations improved the models' performance in the majority of settings - 11 out of 16, with up to 9.57 points improvement in F1 score compared to conventional fine-tuning. We further found that with our annotations, the models aligned up to 232% better to potentially vulnerable statements. Our findings indicate that it is helpful to provide the model with information of the bug semantics, that the model can attend to it, and motivate future work in learning more complex path-based bug semantics. Our code and data are available at https://figshare.com/s/4a16a528d6874aad51a0.


title: Elliptic units for complex cubic fields

abstract: We propose a conjecture extending the classical construction of elliptic units to complex cubic number fields $K$. The conjecture concerns special values of the elliptic gamma function, a holomorphic function of three complex variables arising in mathematical physics whose transformation properties under $\mathrm{SL}_3(\mathbf{Z})$ were studied by Felder and Varchenko in the early 2000s. Using this function we construct complex numbers that we conjecture to be units in narrow ray class fields of $K$. We also propose a reciprocity law for the action of the Galois group on these units in the style of Shimura. To support our conjecture we offer numerical evidence and also prove a new type of Kronecker limit formula relating the logarithm of the modulus of these complex numbers to the derivatives at $s = 0$ of partial zeta functions of $K$. Our constructions unveil the role played by the elliptic gamma function in Hilbert's twelfth problem for complex cubic fields.


title: Smooth equivalence of families of strongly pseudoconvex domains

abstract: We establish a smoothness result for families of biholomorphisms between smooth families of strongly pseudoconvex domains, each with trivial biholomorphism group. This is accomplished by considering the Riemannian geometry of their Bergman metrics and proving a result about the smoothness of families of isometries between smooth families of Riemannian manifolds.


title: Carroll geodesics

abstract: Using effective field theory methods, we derive the Carrollian analog of the geodesic action. We find that it contains both `electric' and `magnetic' contributions that are in general coupled to each other. The equations of motion descending from this action are the Carrollian pendant of geodesics, allowing surprisingly rich dynamics. As an example, we derive Carrollian geodesics on a Carroll-Schwarzschild background and discover an effective potential similar to the one appearing in geodesics on Schwarzschild backgrounds. However, the Newton term in the potential turns out to depend on the Carroll particle's energy. As a consequence, there is only one circular orbit localized at the Carroll extremal surface, and this orbit is unstable. For large impact parameters, the deflection angle is half the value of the general relativistic light-bending result. For impact parameters slightly bigger than the Schwarzschild radius, orbits wind around the Carroll extremal surface. For small impact parameters, geodesics get reflected by the Carroll black hole, which acts as a perfect mirror.


title: Dynamics of Carrollian Scalar Fields

abstract: Adopting an intrinsic Carrollian viewpoint, we show that the generic Carrollian scalar field action is a combination of electric and magnetic actions, found in the literature by taking the Carrollian limit of the relativistic scalar field. This leads to non-trivial dynamics: even a single particle with non-vanishing energy can move in Carrollian physics.


title: Dynamics and Scaling of Internally Cooled Convection

abstract: Our goal is to investigate fundamental properties of the system of internally cooled convection. The system consists of an upward thermal flux at the lower boundary, a mean temperature lapse-rate and a constant cooling term in the bulk with the bulk cooling in thermal equilibrium with the input heat flux. This simple model represents idealised dry convection in the atmospheric boundary layer, where the cooling mimics the radiative cooling to space notably through longwave radiation. We perform linear stability analysis of the model for different values of the mean stratification to derive the critical forcing above which the fluid is convectively unstable to small perturbations. The dynamic behaviour of the fluid system is described and the scaling of various important measured quantities such as the total vertical convective heat flux and the upward mass flux is measured. We introduce a lapse-rate dependent dimensionless Rayleigh-number $Ra_\gamma$ that determines the behaviour of the system, finding that the convective heat-flux and mass-flux scale scale approximately as $Ra_\gamma^{0.5}$ and $Ra_\gamma^{0.7}$ respectively. The area-fraction of the domain that is occupied by upward and downward moving fluid and the skewness of the vertical velocity are studied to understand the asymmetry inherent in the system. We conclude with a short discussion on the relevance to atmospheric convection and the scope for further investigations of atmospheric convection using similar simplified approaches.


title: Guts determine the leading coefficients of $L^2$-Alexander torsions

abstract: For 3-manifolds, the leading coefficient of the $L^2$-Alexander torsion is a numerical invariant of a real first cohomology class. We show that the leading coefficient equals the relative $L^2$-torsion of the manifold cut up along a norm-minimizing surface dual to the cohomology class. Furthermore, the leading coefficient equals the relative $L^2$-torsion of the guts associated to the cohomology class. Finally, we prove that the leading coefficient is constant on any open Thurston cone. The main ingredients are a new criterion for the convergence of Fuglede-Kadison determinants and the work of Agol and Zhang on guts of 3-manifolds.


title: Improved Topological Preservation in 3D Axon Segmentation and Centerline Detection using Geometric Assessment-driven Topological Smoothing (GATS)

abstract: Automated axon tracing via fully supervised learning requires large amounts of 3D brain imagery, which is time consuming and laborious to obtain. It also requires expertise. Thus, there is a need for more efficient segmentation and centerline detection techniques to use in conjunction with automated annotation tools. Topology-preserving methods ensure that segmented components maintain geometric connectivity, which is especially meaningful for applications where volumetric data is used, and these methods often make use of morphological thinning algorithms as the thinned outputs can be useful for both segmentation and centerline detection of curvilinear structures. Current morphological thinning approaches used in conjunction with topology-preserving methods are prone to over-thinning and require manual configuration of hyperparameters. We propose an automated approach for morphological smoothing using geometric assessment of the radius of tubular structures in brain microscopy volumes, and apply average pooling to prevent over-thinning. We use this approach to formulate a loss function, which we call Geo-metric Assessment-driven Topological Smoothing loss, or GATS. Our approach increased segmentation and center-line detection evaluation metrics by 2%-5% across multiple datasets, and improved the Betti error rates by 9%. Our ablation study showed that geometric assessment of tubular structures achieved higher segmentation and centerline detection scores, and using average pooling for morphological smoothing in place of thinning algorithms reduced the Betti errors. We observed increased topological preservation during automated annotation of 3D axons volumes from models trained with GATS.


title: Hilbert Direct Integrals of Monotone Operators

abstract: Finite Cartesian products of operators play a central role in monotone operator theory and its applications. Extending such products to arbitrary families of operators acting on different Hilbert spaces is an open problem, which we address by introducing the Hilbert direct integral of a family of monotone operators. The properties of this construct are studied and conditions under which the direct integral inherits the properties of the factor operators are provided. The question of determining whether the Hilbert direct integral of a family of subdifferentials of convex functions is itself a subdifferential leads us to introducing the Hilbert direct integral of a family of functions. We establish explicit expressions for evaluating the Legendre conjugate, subdifferential, recession function, Moreau envelope, and proximity operator of such integrals. Next, we propose a duality framework for monotone inclusion problems involving integrals of linearly composed monotone operators and show its pertinence towards the development of numerical solution methods. Applications to inclusion and variational problems are discussed.


title: Realisation of linear algebraic groups as automorphism groups

abstract: Let $G$ be a linear algebraic group, over a field $F$. We show that $G$ is isomorphic to the automorphism group scheme of a smooth projective $F$-variety, defined as the blow-up of a projective space, along a suitable smooth subvariety.


title: Computability in Dynamical Systems

abstract: In this paper we present an introduction to the area of computability in dynamical systems. This is a fairly new field which has received quite some attention in recent years. One of the central questions in this area is if relevant dynamical objects can be algorithmically presented by a Turing machine. After providing an overview of the relevant objects we discuss recent results concerning the computability of the entropy for symbolic systems and the computability of Julia sets as well as their Brolin-Lyubich measures.


title: Lagrangian chaos and turbulence in fluid dynamics

abstract: Randomization of the Lagrangian chaos in fluid dynamics has been analyzed using results of direct numerical simulations, laboratory measurements, and oceanic observations. The notion of distributed chaos has been used in order to quantify this phenomenon (the main dimensionless parameter of distributed chaos has been used as a measure of randomization). The analysis includes isotropic homogeneous fluid motion, buoyancy-driven flows, particle-laden flows, magnetohydrodynamic flows, and subsurface oceanic mixing. The role of the dissipative Birkhoff-Saffman and Loitsyanskii invariants as well as the invariants related to the spontaneous breaking of the local reflectional symmetry (in particular, the Levich-Tsinober invariant) in the randomization phenomenon has been also investigated.


title: Observation of the distribution of nuclear magnetization in a molecule

abstract: Rapid progress in the experimental control and interrogation of molecules, combined with developments in precise calculations of their structure, are enabling new opportunities in the investigation of nuclear and particle physics phenomena. Molecules containing heavy, octupole-deformed nuclei such as radium are of particular interest for such studies, offering an enhanced sensitivity to the properties of fundamental particles and interactions. Here, we report precision laser spectroscopy measurements and theoretical calculations of the structure of the radioactive radium monofluoride molecule, $^{225}$Ra$^{19}$F. Our results allow fine details of the short-range electron-nucleus interaction to be revealed, indicating the high sensitivity of this molecule to the distribution of magnetization, currently a poorly constrained nuclear property, within the radium nucleus. These results provide a direct and stringent test of the description of the electronic wavefunction inside the nuclear volume, highlighting the suitability of these molecules to investigate subatomic phenomena.

categories: nucl-ex physics.atom-ph physics.chem-ph physics.comp-ph


title: Fine-tuning convergence model in Bengali speech recognition

abstract: Research on speech recognition has attracted considerable interest due to the difficult task of segmenting uninterrupted speech. Among various languages, Bengali features distinct rhythmic patterns and tones, making it particularly difficult to recognize and lacking an efficient commercial recognition method. In order to improve the automatic speech recognition model for Bengali, our team has chosen to utilize the wave2vec 2.0 pre-trained model, which has undergone convergence for fine-tuning. Regarding Word Error Rate (WER), the learning rate and dropout parameters were fine-tuned, and after the model training was stable, attempts were made to enlarge the training set ratio, which improved the model's performance. Consequently, there was a notable enhancement in the WER from 0.508 to 0.437 on the test set of the publicly listed official dataset. Afterwards, the training and validation sets were merged, creating a comprehensive dataset that was used as the training set, achieving a remarkable WER of 0.436.


title: Characterization of Singular Arcs in Spacecraft Trajectory Optimization

abstract: Low-thrust engines for interplanetary spacecraft transfers allow cost-effective space missions with flexible launch and arrival dates. To find fuel-optimal trajectories, an optimal control problem is to be solved. Pontryagin's Maximum Principle shows that the structure of the optimal control is bang-bang with the possibility of singular arcs. Even though the latter have been heuristically shown to rarely appear in practical applications, a full theoretical characterization does not exist in the literature. As a growing number of missions are expected to adopt low-thrust engines in the near future, such study is required to have a comprehensive understanding of the problem. This work presents analytical necessary conditions for the existence of singular arcs that only depend on three physical variables and not on the costates. Moreover, it provides an analytical expression of the singular control that depends on a limited set of physical variables. This is a fundamental feature, as simple evaluation of the necessary condition and of the singular control can be performed. Finally, it provides insightful information on the reasons why singular arcs are rare and it quantifies the possibility of their occurrence.


title: Unveiling Safety Vulnerabilities of Large Language Models

abstract: As large language models become more prevalent, their possible harmful or inappropriate responses are a cause for concern. This paper introduces a unique dataset containing adversarial examples in the form of questions, which we call AttaQ, designed to provoke such harmful or inappropriate responses. We assess the efficacy of our dataset by analyzing the vulnerabilities of various models when subjected to it. Additionally, we introduce a novel automatic approach for identifying and naming vulnerable semantic regions - input semantic areas for which the model is likely to produce harmful outputs. This is achieved through the application of specialized clustering techniques that consider both the semantic similarity of the input attacks and the harmfulness of the model's responses. Automatically identifying vulnerable semantic regions enhances the evaluation of model weaknesses, facilitating targeted improvements to its safety mechanisms and overall reliability.


title: New bounds in the Bogolyubov-Ruzsa lemma

abstract: We establish new bounds in the Bogolyubov-Ruzsa lemma, demonstrating that if A is a subset of a finite abelian group with density alpha, then 3A-3A contains a Bohr set of rank O(log^2 (2/alpha)) and radius Omega(log^{-2} (2/alpha)). The Bogolyubov-Ruzsa lemma is one of the deepest results in additive combinatorics, with a plethora of important consequences. In particular, we obtain new results toward the Polynomial Freiman-Ruzsa conjecture and improved bounds in Freiman's theorem.


title: From Diagram to Deployment: Translating BPMN Collaborations into X-Klaim for Efficient Multi-Robot System Programming

abstract: This paper introduces a novel method for translating Business Process Model and Notation (BPMN) diagrams into executable X-Klaim code for Multi-Robot Systems (MRSs). Merging the clarity of BPMN with the operational strength of X-Klaim, we enable the design and execution of complex robotic interactions without requiring in-depth knowledge of the underlying programming language from the users. Our approach maintains the BPMN model's core design principles and logic in the translation to X-Klaim, thus enhancing the readability and maintainability of MRS applications. We offer a series of translated examples, address optimization strategies, and introduce the B2XKLAIM tool, which automates the conversion process. This method aims to streamline MRS programming and improve collaboration between roboticists and domain experts throughout the design and implementation stages.


title: Precision Measurement of Sub-Continuum Gas Conduction within Micro-Confinements

abstract: Sub-continuum gas conduction is an essentially important phenomenon in disparate fields of applications ranging from aerospace vehicles to biomedical sensors, and has been the focus of many computational studies over the past decades. These studies predicted that the energy exchange mechanisms are driven by gas-surface interactions, strongly dependent on the gas and surface characteristics. Despite its fundamental and practical importance, thermal transport via gas conduction at non-continuum regimes mostly remains experimentally unverified. Here, we report precision measurements of sub-continuum gas conduction within parallel micro-cavities and elucidate its dependence on the gas and surface characteristics. More importantly, we demonstrate a systematic approach for extracting the energy accommodation coefficient (EAC), which is necessary to establish gas-surface scattering kernels or develop diffusive-specular solutions to the Boltzmann transport equation. EACs are also required for calculating the temperature jump coefficient in near-continuum conditions to solve classical hydrodynamical equations. For the first time, we show a correction to the kinetic theory in the transition to near-continuum regimes (particularly for non-monatomic gases) by extracting a physical parameter representing the intermolecular collisions within the Knudsen layer. Our results agree well with the kinetic theory predictions and are expected to inform the development of technologies such as thermal switches, gas sensors, and light-driven actuators.


title: Generative learning for nonlinear dynamics

abstract: Modern generative machine learning models demonstrate surprising ability to create realistic outputs far beyond their training data, such as photorealistic artwork, accurate protein structures, or conversational text. These successes suggest that generative models learn to effectively parametrize and sample arbitrarily complex distributions. Beginning half a century ago, foundational works in nonlinear dynamics used tools from information theory to infer properties of chaotic attractors from time series, motivating the development of algorithms for parametrizing chaos in real datasets. In this perspective, we aim to connect these classical works to emerging themes in large-scale generative statistical learning. We first consider classical attractor reconstruction, which mirrors constraints on latent representations learned by state space models of time series. We next revisit early efforts to use symbolic approximations to compare minimal discrete generators underlying complex processes, a problem relevant to modern efforts to distill and interpret black-box statistical models. Emerging interdisciplinary works bridge nonlinear dynamics and learning theory, such as operator-theoretic methods for complex fluid flows, or detection of broken detailed balance in biological datasets. We anticipate that future machine learning techniques may revisit other classical concepts from nonlinear dynamics, such as transinformation decay and complexity-entropy tradeoffs.


title: Purcell modified Doppler cooling of quantum emitters inside optical cavities

abstract: Standard cavity cooling of atoms or dielectric particles is based on the action of dispersive optical forces in high-finesse cavities. We investigate here a complementary regime characterized by large cavity losses, resembling the standard Doppler cooling technique. For a single two-level emitter a modification of the cooling rate is obtained from the Purcell enhancement of spontaneous emission in the large cooperativity limit. This mechanism is aimed at cooling of quantum emitters without closed transitions, which is the case for molecular systems, where the Purcell effect can mitigate the loss of population from the cooling cycle. We extend our analytical formulation to the many particle case governed by weak individual coupling but exhibiting collective strong Purcell enhancement to a cavity mode.


title: The Baker-Coon-Romans $N$-point amplitude and an exact field theory limit of the Coon amplitude

abstract: We study the $N$-point Coon amplitude discovered first by Baker and Coon in the 1970s and then again independently by Romans in the 1980s. This Baker-Coon-Romans (BCR) amplitude retains several properties of tree-level string amplitudes, namely duality and factorization, with a $q$-deformed version of the string spectrum. Although the formula for the $N$-point BCR amplitude is only valid for ${q > 1}$, the four-point case admits a straightforward extension to all ${q \geq 0}$ which reproduces the usual expression for the four-point Coon amplitude. At five points, there are inconsistencies with factorization when pushing ${q < 1}$. Despite these issues, we find a new relation between the five-point BCR amplitude and Cheung and Remmen's four-point basic hypergeometric amplitude, placing the latter within the broader family of Coon amplitudes. Finally, we compute the $q \to \infty$ limit of the $N$-point BCR amplitudes and discover an exact correspondence between these amplitudes and the field theory amplitudes of a scalar transforming in the adjoint representation of a global symmetry group with an infinite set of non-derivative single-trace interaction terms. This correspondence at $q = \infty$ is the first definitive realization of the Coon amplitude (in any limit) from a field theory described by an explicit Lagrangian.


title: Interpreting Shared Circuits for Ordered Sequence Prediction in a Large Language Model

abstract: While transformer models exhibit strong capabilities on linguistic tasks, their complex architectures make them difficult to interpret. Recent work has aimed to reverse engineer transformer models into human-readable representations called circuits that implement algorithmic functions. We extend this research by analyzing and comparing circuits for similar sequence continuation tasks, which include increasing sequences of digits, number words, and months. Through the application of circuit analysis techniques, we identify key sub-circuits responsible for detecting sequence members and for predicting the next member in a sequence. Our analysis reveals that semantically related sequences rely on shared circuit subgraphs with analogous roles. Overall, documenting shared computational structures enables better prediction of model behaviors, identification of errors, and safer editing procedures. This mechanistic understanding of transformers is a critical step towards building more robust, aligned, and interpretable language models.


title: Homotopy groups of symmetric products

abstract: In this paper we prove that, taking $X$ a Hausdorff topological space, the homotopy groups of the spaces $SP_{m}(X)$ and $F_{m}(X)$, both called symmetric products, are monomorphic. We also introduce a new algebraic tool in topology: the discontinuous homotopy groups.


title: Simple Bundles of Complex Networks

abstract: Complex networks can be used to represent and model an ample diversity of abstract and real-world systems and structures. A good deal of the research on these structures has focused on specific topological properties, including node degree, shortest paths, and modularity. In the present work, we develop an approach aimed at identifying and characterizing simple bundles of interconnections between pairs of nodes (source and destination) in complex networks. More specifically, simple bundles can be understood as corresponding to the bundle of paths obtained while traveling through successive neighborhoods after departing from a given source node. Because no node appears more than once along a given bundle, these structures have been said to be simple, in analogy to the concept of a simple path. In addition to describing simple bundles and providing a possible methodology for their identification, we also consider how their respective effective width can be estimated in terms of diffusion flow and exponential entropy of transition probabilities. The potential of the concepts and methods described in this work is then illustrated respectively to the characterization and analysis of model-theoretic networks, with several interesting results.


title: Centralizers of non-elliptic univalent self-maps and the embeddability problem in the unit disc

abstract: The embeddability problem is a very old and hard problem in discrete holomorphic iteration which deals with determining general conditions on a given univalent self-map $\varphi$ of the unit disc $\mathbb D$ in order to be contained in a continuous one-parameter semigroup. In this paper, we tackle this embedding problem by establishing different dichotomy results about the centralizer of $\varphi$ (i.e. the set of all univalent self-maps commuting with $\varphi$) which depend strongly on the dynamical character of $\varphi$. Our approach is, in part, based on a new technique to obtain simultaneous linearizations of two non-elliptic univalent self-maps of the unit disc, which might be interesting on their own. We also introduce and study several closed additive subsemigroups of the complex plane that collect the main features of the centralizer of $\varphi$ and which play a prominent position in those dichotomy results.