title: Self-organisation of auto-phoretic suspensions in confined shear flows

abstract: Janus phoretic particles exploit chemical energy stored in their environment to self-propel. These active particles modify and respond to their hydrodynamic and chemical environments, thus giving them a sensibility to external flows and other particles. Furthermore, experimental observations and analysis on biological or synthetic active suspensions indicate that hydro-chemical interparticle interactions lead to non-trivial collective behaviour (e.g., cluster formation of phoretic particles or bacterial swarming) and that the response of the suspensions to shear flows is non-trivial. In fact, it can lead to significant reductions in viscosity due to the energy conversion at microscopic scales. In this work, using simulations of a continuum kinetic model, we analyse the dynamics and response to shear and confinement of dilute suspensions of chemotactic phoretic particles that reorient and drift toward the chemical solutes released by their neighbours. We show that a 1D transient steady distribution driven by the effect of confinement is a common feature considered and analyse its stability for varying confinement strength and shear rate. In the second step, we consider and discuss, more specifically, the feedback effect on the flow by the particle and the resulting effective viscosity of the suspension.


title: Leading directions in the SMEFT: Renormalization Effects

abstract: The stability of the electroweak scale, challenged by the absence of deviations in flavor physics, prompts the consideration of SMEFT scenarios governed by approximate SM flavor symmetries. This study examines microscopic theories that match onto a set of $U(3)^5$-symmetric dimension-6 operators. Renormalization group mixing from the ultraviolet to the electroweak scale yields significant phenomenological constraints, particularly pronounced for UV-motivated directions. To demonstrate this, we explore a complete suite of tree-level models featuring new spin-0, 1/2, and 1 fields, categorized by their irreducible representations under the flavor group. We find that for the leading directions, corresponding to a single-mediator dominance, RG mixing effects occasionally serve as the primary indirect probe.


title: Dust Dynamics in Hall-effected Protoplanetary Disks. I. Background Drift Hall Instability

abstract: Recent studies have shown that the large-scale gas dynamics of protoplanetary disks (PPDs) are controlled by non-ideal magneto-hydrodynamics (MHD), but how this influences dust dynamics is not fully understood. To this end, we investigate the stability of dusty, magnetized disks subject to the Hall effect, which applies to planet-forming regions of PPDs. We find a novel Background Drift Hall Instability (BDHI) that may facilitate planetesimal formation in Hall-effected disk regions. Through a combination of linear analysis and nonlinear simulations, we demonstrate the viability and characteristics of BDHI. We find it can potentially dominate over the classical streaming instability (SI) and standard MHD instabilities at low dust-to-gas ratios and weak magnetic fields. We also identify magnetized versions of the classic SI, but these are usually subdominant. We highlight the complex interplay between magnetic fields and dust-gas dynamics in PPDs, underscoring the need to consider non-ideal MHD like the Hall effect in the broader narrative of planet formation.


title: Improving Efficiency of Diffusion Models via Multi-Stage Framework and Tailored Multi-Decoder Architectures

abstract: Diffusion models, emerging as powerful deep generative tools, excel in various applications. They operate through a two-steps process: introducing noise into training samples and then employing a model to convert random noise into new samples (e.g., images). However, their remarkable generative performance is hindered by slow training and sampling. This is due to the necessity of tracking extensive forward and reverse diffusion trajectories, and employing a large model with numerous parameters across multiple timesteps (i.e., noise levels). To tackle these challenges, we present a multi-stage framework inspired by our empirical findings. These observations indicate the advantages of employing distinct parameters tailored to each timestep while retaining universal parameters shared across all time steps. Our approach involves segmenting the time interval into multiple stages where we employ custom multi-decoder U-net architecture that blends time-dependent models with a universally shared encoder. Our framework enables the efficient distribution of computational resources and mitigates inter-stage interference, which substantially improves training efficiency. Extensive numerical experiments affirm the effectiveness of our framework, showcasing significant training and sampling efficiency enhancements on three state-of-the-art diffusion models, including large-scale latent diffusion models. Furthermore, our ablation studies illustrate the impact of two important components in our framework: (i) a novel timestep clustering algorithm for stage division, and (ii) an innovative multi-decoder U-net architecture, seamlessly integrating universal and customized hyperparameters.


title: Theoretical consideration of a twisted atom

abstract: We investigate the twisted state of an atom and the possible effect of such a state on the properties of the photons emitted as a result of an electron transition in that atom. We first propose a framework for describing the twisted atomic state, and then explore possible differences in the nuclear recoil effects in the twisted atom compared to those in the plane-wave atom. We conclude that if the initial atomic state is twisted, then the photon distribution is altered. We point out that in a certain observation scheme, one can detect a feature of this twist in the distribution of the emitted photons, even in zero order in $m/M$.


title: MAGICS I. The First Few Orbits Encode the Fate of Seed Massive Black Hole Pairs

abstract: The elusive massive black hole (MBH) seeds stand to be revealed by the Laser Space Antenna Interferometer through mergers. As an aftermath of galaxy mergers, MBH coalescence is a vastly multi-scale process connected to galaxy formation. We introduce the "Massive black hole Assembly in Galaxies Informed by Cosmological Simulations" (MAGICS) suite, with galaxy/MBH properties and orbits recovered from large-volume cosmological simulation ASTRID. The simulations include subgrid star formation, supernovae feedback, and MBH accretion/feedback. In this first suite, we extract fifteen representative galaxy mergers with seed MBHs to examine their dynamics at an improved mass and spatial resolution (by $\sim2000$ and $\sim20$) and follow MBH orbits down to $\sim10\,\text{pc}$. We find that the seed MBH energy loss and orbital decay are largely governed by global torques induced by the galaxy merger process on scales resolvable by cosmological simulations. Specifically, pairs sink quickly if their orbits shrink rapidly below $1\,\text{kpc}$ during the first $\sim200\,\text{Myr}$ of pairing due to effective energy loss in major galaxy mergers, whereas MBHs gaining energy in minor galaxy mergers with head-on collisions are likely to stall. High initial eccentricities ($e_\text{init}>0.5$) and high stellar densities at kpc scales ($\rho_\text{star}>0.05\,M_\odot/\text{pc}^3$) also lead to most efficient decays. $\sim50\%$ high-redshift seed MBH pairs experience consecutive galaxy mergers and are more likely to stall at $\sim1\,\text{kpc}$. For a subset of systems, we carry out N-Body re-simulations until binary formation and find that some stalled systems merge at high-z when embedded in sufficient nuclear star clusters.


title: The Narrow Line Region properties of ESO138-G001 unveiled by SOAR/SIFS observations

abstract: We study in detail the inner 600 pc of the Seyfert 2 galaxy ESO138-G001 by means of the SOAR Integral Field Spectrograph (SIFS) attached to the SOAR telescope. This source is known for displaying a very rich coronal line spectrum and a blob of high-excitation emission ~3" SE of the active galactic nucleus (AGN). The nature of this emission has not been fully understood yet. The excellent spatial and spectral resolution of SIFS allows us to confirm that the bulk of the coronal line forest emission region is very compact, of ~0.8" in diameter, centred on the AGN and most likely powered by radiation from the AGN. In addition, evidence of a nuclear outflow, restricted to the inner 1" centred at the nucleus is found based on the detection of broad components in the most important emission lines. The gas in the inner few tens of parsecs filters out the AGN continuum so that the NLR is basically illuminated by a modified SED. This scenario is confirmed by means of photoionisation models that reproduce the most important lines detected in the SIFS field-of-view. From the modelling, we also found that the black hole mass M_BH of the AGN is about 10^5.5 solar mass, in agreement with previous X-ray observations. The spectrum of the SE blob is dominated by emission lines of low- to mid-ionisation, with no hints of coronal lines. Our results show that it represents gas in the ionisation cone that is photoionised by the filtered central AGN continuum.


title: Multilinear Wavelet Compact T(1) Theorem

abstract: We prove a wavelet $T(1)$ theorem for compactness of multilinear Calder\'{o}n-Zygmund (CZ) operators. Our approach characterizes compactness in terms of testing conditions and yields a representation theorem for compact CZ forms in terms of wavelet and paraproduct forms that reflect the compact nature of the operator.


title: Defect formation energy, electronic structure and phonon dispersion study of half-Heusler TiSnX (X = Pd, Pt and Ni): an ab initio approach

abstract: In order to obtain reliable and close to the experimental transport properties, it is necessary to have a good description of the structural, electronic and vibrational properties of the materials. In this regard, the defect formation plays a crucial hole, specially when it has a small formation energy. In this study we have calculated, under the Density Functional Theory (DFT) formalism, the formation energy for five different models of defects, where one of them is interstitial and the other four substitutional. The interstitial Pd defect presented a very low formation energy, while the other defects have shown higher energies and, therefore they are less likely to emerge in the synthesis of the material.


title: Vision-Language Models as a Source of Rewards

abstract: Building generalist agents that can accomplish many goals in rich open-ended environments is one of the research frontiers for reinforcement learning. A key limiting factor for building generalist agents with RL has been the need for a large number of reward functions for achieving different goals. We investigate the feasibility of using off-the-shelf vision-language models, or VLMs, as sources of rewards for reinforcement learning agents. We show how rewards for visual achievement of a variety of language goals can be derived from the CLIP family of models, and used to train RL agents that can achieve a variety of language goals. We showcase this approach in two distinct visual domains and present a scaling trend showing how larger VLMs lead to more accurate rewards for visual goal achievement, which in turn produces more capable RL agents.


title: JWST Reveals Star Formation Across a Spiral Arm in M33

abstract: Young stellar objects (YSOs) are the gold standard for tracing star formation in galaxies but have been unobservable beyond the Milky Way and Magellanic Clouds. But that all changed when the James Webb Space Telescope was launched, which we use to identify YSOs in the Local Group galaxy M33, marking the first time that individual YSOs have been identified at these large distances. We present MIRI imaging mosaics at 5.6 and 21 microns that cover a significant portion of one of M33's spiral arms that has existing panchromatic imaging from the Hubble Space Telescope and deep ALMA CO measurements. Using these MIRI and Hubble Space Telescope images, we identify point sources using the new DOLPHOT MIRI module. We identify 793 candidate YSOs from cuts based on colour, proximity to giant molecular clouds (GMCs), and visual inspection. Similar to Milky Way GMCs, we find that higher mass GMCs contain more YSOs and YSO emission, which further shows YSOs identify star formation better than most tracers that cannot capture this relationship at cloud scales. We find evidence of enhanced star formation efficiency in the southern spiral arm by comparing the YSOs to the molecular gas mass.


title: Mutually elusive: vectorlike antileptons and leptoquarks

abstract: We study the properties of vectorlike fermions that have the same gauge charges as the Standard Model lepton doublets, but opposite lepton number. These antileptons undergo decays mediated by heavier scalar leptoquarks, while the symmetries of this renormalizable model protect the vectorlike fermions and the leptoquarks from standard decays probed so far at colliders. If the new particles couple predominantly to second-generation quarks, then their collider probes involve multiple jets and two taus or neutrinos, and are hampered by large backgrounds. If couplings to third-generation quarks are large, then the collider signals involve top quarks, and can be probed more efficiently at the LHC. Even in that case, both the vectorlike fermion doublet and the leptoquarks remain more elusive than in models with standard decays.


title: Efficient Online Learning of Contact Force Models for Connector Insertion

abstract: Contact-rich manipulation tasks with stiff frictional elements like connector insertion are difficult to model with rigid-body simulators. In this work, we propose a new approach for modeling these environments by learning a quasi-static contact force model instead of a full simulator. Using a feature vector that contains information about the configuration and control, we find a linear mapping adequately captures the relationship between this feature vector and the sensed contact forces. A novel Linear Model Learning (LML) algorithm is used to solve for the globally optimal mapping in real time without any matrix inversions, resulting in an algorithm that runs in nearly constant time on a GPU as the model size increases. We validate the proposed approach for connector insertion both in simulation and hardware experiments, where the learned model is combined with an optimization-based controller to achieve smooth insertions in the presence of misalignments and uncertainty. Our website featuring videos, code, and more materials is available at https://model-based-plugging.github.io/.


title: Solar flare catalog from 3 years of Chandrayaan-2 XSM observations

abstract: We present a catalog of 6266 solar flares detected by the X-Ray Solar Monitor onboard the Chandrayaan-2 lunar orbiter between 1.55 and 12.4 keV (1 and 8 \AA) from 2019 September 12 to 2022 November 4, including 1469 type A flares. The catalog represents the first large sample, including both type A, hot thermal flares, and type B, impulsive flares, with a sub-A class sensitive instrument. We also detect 213 sub-A and 1330 A class flares. Individual flares are fit with an exponentially-modified Gaussian function and multi-flare groups are decomposed into individual flares. We validate our findings with flare catalogs made using visual inspection as well as automatic pipelines on Geostationary Operational Environmental Satellite and Solar Dynamics Observatory data. We find a clear bimodality in the ratio of the width to decay time between type A and B flares. We infer a power-law index of $\alpha_F = 1.92 \pm 0.09$ for the background-subtracted peak flux distribution of XSM flares, which is consistent with the value $\sim 2$ reported in the literature. We also infer $\alpha_F = 1.90 \pm 0.09$ for type B, and $\alpha_F = 1.94 \pm 0.08$ for type A flares, which has previously not been reported in the literature. These comparable values hint at a similarity in their generative processes.


title: A symplectic approach to Schr\"odinger equations in the infinite-dimensional unbounded setting

abstract: By using the theory of analytic vectors and manifolds modelled on normed spaces, we provide a rigorous symplectic differential geometric approach to $t$-dependent Schr\"odinger equations on separable (possibly infinite-dimensional) Hilbert spaces determined by unbounded $t$-dependent self-adjoint Hamiltonians satisfying a technical condition. As an application, the Marsden--Weinstein reduction procedure is employed to map above-mentioned $t$-dependent Schr\"odinger equations onto their projective spaces. Other applications of physical and mathematical relevance are also analysed.


title: Fast Sampling via Discrete Non-Markov Diffusion Models

abstract: Discrete diffusion models have emerged as powerful tools for high-quality data generation. Despite their success in discrete spaces, such as text generation tasks, the acceleration of discrete diffusion models remains under explored. In this paper, we propose a discrete non-Markov diffusion model, which admits an accelerated reverse sampling for discrete data generation. Our method significantly reduces the number of function evaluations (i.e., calls to the neural network), making the sampling process much faster. Furthermore, we study the transition from finite to infinite step sampling, offering new insights into bridging the gap between discrete and continuous-time processes for discrete diffusion models. Extensive experiments on natural language generation and machine translation tasks demonstrate the superior performance of our method in terms of both generation speed and sample quality compared to existing methods for discrete diffusion models.


title: Matrix Dyson equation for correlated linearizations and test error of random features regression

abstract: This paper develops some theory of the matrix Dyson equation (MDE) for correlated linearizations and uses it to solve a problem on asymptotic deterministic equivalent for the test error in random features regression. The theory developed for the correlated MDE includes existence-uniqueness, spectral support bounds, and stability properties of the MDE. This theory is new for constructing deterministic equivalents for pseudoresolvents of a class of correlated linear pencils. In the application, this theory is used to give a deterministic equivalent of the test error in random features ridge regression, in a proportional scaling regime, wherein we have conditioned on both training and test datasets.


title: Isocrystals and limits of rigid local Langlands correspondences

abstract: We show that, over a nonarchimedean local field, the rigid refined local Langlands correspondence and associated endoscopic character identities for connected reductive $G$ follow if one only has them for all such $G$ with connected center. The strategy is to construct a projective system of central extensions and then take limits of the Langlands correspondences (and endoscopic data) of each group in the system. As an application, we prove the equivalence of the rigid refined local Langlands correspondence and its analogue for isocrystals, generalizing the work of [Kal18] in the $p$-adic case.


title: DIRECT: Deep Active Learning under Imbalance and Label Noise

abstract: Class imbalance is a prevalent issue in real world machine learning applications, often leading to poor performance in rare and minority classes. With an abundance of wild unlabeled data, active learning is perhaps the most effective technique in solving the problem at its root -- collecting a more balanced and informative set of labeled examples during annotation. Label noise is another common issue in data annotation jobs, which is especially challenging for active learning methods. In this work, we conduct the first study of active learning under both class imbalance and label noise. We propose a novel algorithm that robustly identifies the class separation threshold and annotates the most uncertain examples that are closest from it. Through a novel reduction to one-dimensional active learning, our algorithm DIRECT is able to leverage the classic active learning literature to address issues such as batch labeling and tolerance towards label noise. We present extensive experiments on imbalanced datasets with and without label noise. Our results demonstrate that DIRECT can save more than 60% of the annotation budget compared to state-of-art active learning algorithms and more than 80% of annotation budget compared to random sampling.


title: Model-Free Change Point Detection for Mixing Processes

abstract: This paper considers the change point detection problem under dependent samples. In particular, we provide performance guarantees for the MMD-CUSUM test under exponentially $\alpha$, $\beta$, and fast $\phi$-mixing processes, which significantly expands its utility beyond the i.i.d. and Markovian cases used in previous studies. We obtain lower bounds for average-run-length (ARL) and upper bounds for average-detection-delay (ADD) in terms of the threshold parameter. We show that the MMD-CUSUM test enjoys the same level of performance as the i.i.d. case under fast $\phi$-mixing processes. The MMD-CUSUM test also achieves strong performance under exponentially $\alpha$/$\beta$-mixing processes, which are significantly more relaxed than existing results. The MMD-CUSUM test statistic adapts to different settings without modifications, rendering it a completely data-driven, dependence-agnostic change point detection scheme. Numerical simulations are provided at the end to evaluate our findings.


title: Weaving Pathways for Justice with GPT: LLM-driven automated drafting of interactive legal applications

abstract: Can generative AI help us speed up the authoring of tools to help self-represented litigants? In this paper, we describe 3 approaches to automating the completion of court forms: a generative AI approach that uses GPT-3 to iteratively prompt the user to answer questions, a constrained template-driven approach that uses GPT-4-turbo to generate a draft of questions that are subject to human review, and a hybrid method. We use the open source Docassemble platform in all 3 experiments, together with a tool created at Suffolk University Law School called the Assembly Line Weaver. We conclude that the hybrid model of constrained automated drafting with human review is best suited to the task of authoring guided interviews.


title: The geometry of Deroin-Tholozan representations

abstract: We present a way to build hyperbolic spheres with conical singularities by gluing together simple building blocks. Our construction provides good control over the holonomy of the resulting hyperbolic cone sphere. In particular, it can be used to realize any Deroin-Tholozan (DT) representation as the holonomy of a hyperbolic cone sphere. Our construction is inspired by the correspondence between DT representations and chains of triangles in the hyperbolic plane. It gives a geometric interpretation of certain action-angle coordinates on the space of DT representations, which come from this correspondence.


title: Long-Range Structural Order in a Hidden Phase of Ruddlesden-Popper Bilayer Nickelate La$_3$Ni$_2$O$_7$

abstract: The recent discovery of superconductivity in Ruddlesden-Popper bilayer nickelate, specifically La$_3$Ni$_2$O$_7$, has generated significant interest in the exploration of high-temperature superconductivity within this material family. In this study, we present the crystallographic and electrical resistivity properties of two distinct Ruddlesden-Popper nickelates: the bilayer La$_3$Ni$_2$O$_7$ (referred to as 2222-phase) and a previously uncharacterized phase, La$_3$Ni$_2$O$_7$ (1313-phase). The 2222-phase is characterized by a pseudo $F$-centered orthorhombic lattice, featuring bilayer perovskite [LaNiO$_3$] layers interspaced by rock salt [LaO] layers, forming a repeated ...2222... sequence. Intriguingly, the 1313-phase, which displays semiconducting properties, crystallizes in the $Cmmm$ space group and exhibits a pronounced predilection for a $C$-centered orthorhombic lattice. Within this structure, the perovskite [LaNiO$_3$] layers exhibit a distinctive long-range ordered arrangement, alternating between single- and trilayer configurations, resulting in a ...1313... sequence. This report contributes to novel insights into the crystallography and the structure-property relationship of Ruddlesden-Popper nickelates, paving the way for further investigations into their unique physical properties.


title: Robust option pricing with volatility term structure -- An empirical study for variance options

abstract: The robust option pricing problem is to find upper and lower bounds on fair prices of financial claims using only the most minimal assumptions. It contrasts with the classical, model-based approach and gained prominence in the wake of the 2008 financial crisis, and can be used to understand the extent to which a model-based price is sensitive to the underlying model assumptions. Common approaches involve pricing exotic derivatives such as variance options by incorporating market data through implied volatility. The existing literature focuses largely on incorporating implied volatility information corresponding to the maturity of the exotic option. In this paper, we aim to explain how intermediate data can and should be incorporated. It is natural to expect that this additional information will improve the robust pricing bounds. To investigate this question, we consider variance options, where the bounds of the informed robust pricing problem are known. We proceed to conduct an empirical study uncovering a surprising finding: Contrary to common belief, the incorporation of more information does not lead to an improvement of the robust pricing bounds.


title: On the evolution of structure in triangle-free graphs

abstract: We study the typical structure and the number of triangle-free graphs with $n$ vertices and $m$ edges where $m$ is large enough so that a typical triangle-free graph has a cut containing nearly all of its edges, but may not be bipartite. Erd\H{o}s, Kleitman, and Rothschild showed that almost every triangle-free graph is bipartite. Osthus, Pr\"omel, and Taraz later showed that for $m \ge (1+\epsilon)\frac{\sqrt{3}}{4}n^{3/2}\sqrt{\log n}$, almost every triangle-free graph on $n$ vertices and $m$ edges is bipartite. Here we give a precise characterization of the distribution of edges within each part of the max cut of a uniformly chosen triangle-free graph $G$ on $n$ vertices and $m$ edges, for a larger range of densities with $m=\Theta(n^{3/2} \sqrt{\log n})$. Using this characterization, we describe the evolution of the structure of typical triangle-free graphs as the density changes. We show that as the number of edges decreases below $\frac{\sqrt{3}}{4} n^{3/2}\sqrt{\log n}$, the following structural changes occur in $G$: -Isolated edges, then trees, then more complex subgraphs emerge as `defect edges', edges within parts of a max cut of $G$. The distribution of defect edges is first that of independent Erd\H{o}s-R\'{e}nyi random graphs, then that of independent exponential random graphs, conditioned on a small maximum degree and no triangles. -There is a sharp threshold for $3$-colorability at $m \sim \frac{\sqrt{2}}{4} n^{3/2}\sqrt{\log n}$ and a sharp threshold between $4$-colorability and unbounded chromatic number at $m\sim\frac{1}{4}n^{3/2}\sqrt{\log n}$. -Giant components emerge in the defect edges at $m\sim\frac{1}{4} n^{3/2}\sqrt{\log n}$. We use these results to prove asymptotic formulas for the number of triangle-free graphs at these densities. We also prove analogous results for $G(n,p)$ conditioned on triangle-freeness.


title: Measurement in the Age of LLMs: An Application to Ideological Scaling

abstract: Much of social science is centered around terms like ``ideology'' or ``power'', which generally elude precise definition, and whose contextual meanings are trapped in surrounding language. This paper explores the use of large language models (LLMs) to flexibly navigate the conceptual clutter inherent to social scientific measurement tasks. We rely on LLMs' remarkable linguistic fluency to elicit ideological scales of both legislators and text, which accord closely to established methods and our own judgement. A key aspect of our approach is that we elicit such scores directly, instructing the LLM to furnish numeric scores itself. This approach affords a great deal of flexibility, which we showcase through a variety of different case studies. Our results suggest that LLMs can be used to characterize highly subtle and diffuse manifestations of political ideology in text.


title: Tuning the Josephson diode response with an ac current

abstract: Josephson diodes are superconducting elements that show an asymmetry in the critical current depending on the direction of the current. Here, we theoretically explore how an alternating current bias can tune the response of such a diode. We show that for slow driving there is always a regime where the system can only carry zero-voltage dc current in one direction, thus effectively behaving as an ideal Josephson diode. Under fast driving, the diode efficiency is also tunable, although the ideal regime cannot be reached in this case. We also investigate the residual dissipation due to the time-dependent current bias and show that it remains small. All our conclusions are solely based on the critical current asymmetry of the junction, and are thus compatible with any Josephson diode.


title: Permutation invariant tensor models and partition algebras

abstract: Matrix models with continuous symmetry are powerful tools for studying quantum gravity and holography. Tensor models have also found applications in holographic quantum gravity. Matrix models with discrete permutation symmetry have been shown to satisfy large $N$ factorisation properties relevant to holography, while also having applications to the statistical analysis of ensembles of real-world matrices. Here we develop 3-index tensor models in dimension $D$ with a discrete symmetry of permutations in the symmetric group $S_D$. We construct the most general permutation invariant Gaussian tensor model using the representation theory of symmetric groups and associated partition algebras. We define a representation basis for the 3-index tensors, where the two-point function is diagonalised. Inverting the change of basis gives an explicit formula for the two-point function in the tensor basis for general $D$.


title: Pseudorandomness from Subset States

abstract: We show it is possible to obtain quantum pseudorandomness and pseudoentanglement from random subset states -- i.e. quantum states which are equal superpositions over (pseudo)random subsets of strings. This answers an open question of Aaronson et al. [arXiv:2211.00747], who devised a similar construction augmented by pseudorandom phases. Our result follows from a direct calculation of the trace distance between $t$ copies of random subset states and the Haar measure, via the representation theory of the symmetric group. We show that the trace distance is negligibly small, as long as the subsets are of an appropriate size which is neither too big nor too small. In particular, we analyze the action of basis permutations on the symmetric subspace, and show that the largest component is described by the Johnson scheme: the double-cosets of the symmetric group $\mathbb{S}_N$ by the subgroup $\mathbb{S}_t \times \mathbb{S}_{N-t}$. The Gelfand pair property of this setting implies that the matrix eigenbasis coincides with the symmetric group irreducible blocks, with the largest eigenblock asymptotically approaching the Haar average. An immediate corollary of our result is that quantum pseudorandom and pseudoentangled state ensembles do not require relative phases.


title: WikiMuTe: A web-sourced dataset of semantic descriptions for music audio

abstract: Multi-modal deep learning techniques for matching free-form text with music have shown promising results in the field of Music Information Retrieval (MIR). Prior work is often based on large proprietary data while publicly available datasets are few and small in size. In this study, we present WikiMuTe, a new and open dataset containing rich semantic descriptions of music. The data is sourced from Wikipedia's rich catalogue of articles covering musical works. Using a dedicated text-mining pipeline, we extract both long and short-form descriptions covering a wide range of topics related to music content such as genre, style, mood, instrumentation, and tempo. To show the use of this data, we train a model that jointly learns text and audio representations and performs cross-modal retrieval. The model is evaluated on two tasks: tag-based music retrieval and music auto-tagging. The results show that while our approach has state-of-the-art performance on multiple tasks, but still observe a difference in performance depending on the data used for training.


title: On the domination number of the cartesian product of the path graph and any pair of graphs

abstract: It is known that for any graph $G,$ $\gamma (G\square P_2)\geq \gamma (G)$ where $\gamma$ stands for the domination number, $\square$ for the cartesian product and $P_2$ is the path graph on two vertices. In an attempt to prove Vizing's conjecture, Clark and Suen proved in $2000$ that $\gamma (X\square Y)\geq \frac{1}{2}\gamma (X)\gamma (Y)$ for any pair of graphs $X$ and $Y.$ Combining these two inequalities, we have $\gamma (X\square Y\square P_2)\geq \frac{1}{2}\gamma (X)\gamma (Y).$ In this paper, we use space projections to improve this lower bound and show that $\gamma (X\square Y\square P_2)\geq \frac{2}{3}\gamma (X)\gamma (Y)$ for any pair of graphs $X$ and $Y.$ In addition, we prove that $\gamma (X\square Y\square P_{n})\geq c_n\gamma (X)\gamma (Y)\gamma (P_{n}),$ where $c_n$ is almost $\frac{3}{4}$ when $n$ is big enough.


title: A colossal advantage: 3D-local noisy shallow quantum circuits defeat unbounded fan-in classical circuits

abstract: We present a computational problem with the following properties: (i) Every instance can be solved with near-certainty by a constant-depth quantum circuit using only nearest-neighbor gates in 3D even when its implementation is corrupted by noise. (ii) Any constant-depth classical circuit composed of unbounded fan-in AND, OR, as well as NOT gates, i.e., an AC0-circuit, of size smaller than a certain subexponential, fails to solve a uniformly random instance with probability greater than a certain constant. Such an advantage against unbounded fan-in classical circuits was previously only known in the noise-free case or without locality constraints. We overcome these limitations, proposing a quantum advantage demonstration amenable to experimental realizations. Subexponential circuit-complexity lower bounds have traditionally been referred to as exponential. We use the term colossal since our fault-tolerant 3D architecture resembles a certain Roman monument.


title: X-ray Reflection from the Plunging Region of Black Hole Accretion Disks

abstract: Accretion around black holes is very often characterized by distinctive X-ray reflection features (mostly, iron inner-shell transitions), which arise due to the primary radiation being reprocessed by a dense and relatively colder medium, such as an accretion disk. Most reflection modeling assume that emission stops at the inner-most stable circular orbit (ISCO), and that for smaller radii - in the plunging region - the density drops and the accretion flow is far too ionized for efficient line production. We investigate the spectral features of the reflection in the plunging regions of optically-thick and geometrically-thin accretion disks around black holes. We show that for cases in which the density profile is considered constant (as expected in highly magnetized flows), or in cases in which the disk density is high enough such that the ionization still allows line formation within the ISCO, there is a significant modification of the observed reflected spectrum. Consistent with previous studies, we found that the impact of the radiation reprocessed in the plunging region is stronger the lower the black hole spin, when the plunging region subtends a larger area. Likewise, as for the case of standard reflection modeling, the relativistic broadening of the iron line is more pronounced at low inclination, whereas the blueshift and relativistic beaming effect is dominant at high inclination. We also tested the effects of various prescriptions of the stress at the ISCO radius on the reflection spectrum, and found that several of these cases appear to show line profiles distinct enough to be distinguishable with reasonably good quality observational data.


title: Mitigating Outlier Activations in Low-Precision Fine-Tuning of Language Models

abstract: Low-precision fine-tuning of language models has gained prominence as a cost-effective and energy-efficient approach to deploying large-scale models in various applications. However, this approach is susceptible to the existence of outlier values in activation. The outlier values in the activation can negatively affect the performance of fine-tuning language models in the low-precision regime since they affect the scaling factor and thus make representing smaller values harder. This paper investigates techniques for mitigating outlier activation in low-precision integer fine-tuning of the language models. Our proposed novel approach enables us to represent the outlier activation values in 8-bit integers instead of floating-point (FP16) values. The benefit of using integers for outlier values is that it enables us to use operator tiling to avoid performing 16-bit integer matrix multiplication to address this problem effectively. We provide theoretical analysis and supporting experiments to demonstrate the effectiveness of our approach in improving the robustness and performance of low-precision fine-tuned language models.


title: The Twisted Gradient Flow strong coupling with Parallel Tempering on Boundary Conditions

abstract: We present a proposal for calculating the running of the coupling constant of the $\mathrm{SU}(3)$ pure-gauge theory, which combines the Twisted Gradient Flow (TGF) renormalization scheme with Parallel Tempering on Boundary Conditions (PTBC). The TGF is a gradient flow-based renormalization scheme formulated in an asymmetric lattice with twisted boundary conditions. Combined with step scaling, it has been successfully used to calculate the $\mathrm{SU}(3)$ $\Lambda$ parameter. As with all gradient flow-based schemes, the coupling constant is highly correlated with the topological charge and affected by topology freezing, an issue addressed by projecting the determination of the coupling onto the zero topological sector. As an alternative to the zero-charge projection, we combine TGF with PTBC, by replicating multiple copies of the same lattice, interpolating between periodic and open boundary conditions in a parallel-tempered manner. We present a first exploration of these ideas by analyzing specific ensembles of $\mathrm{SU}(3)$ lattices with and without PTBC.


title: Analytical strong line diagnostics and their redshift evolution

abstract: The JWST is allowing new measurements of gas-phase metallicities in galaxies between cosmic noon and cosmic dawn through observations of multiple rest-frame optical/ultraviolet [OIII], [OII], and hydrogen Balmer series lines. The most robust approach to such measurements uses luminosity ratios between the excited auroral transition, [OIII] 4364A, and the lower [OIII] 5008A/4960A lines to determine the gas temperature. The ratio of the luminosities in the latter transitions to those in hydrogen Balmer series lines then yield relatively clean metallicity estimates. In the absence of detection of the, often faint, [OIII] auroral line, however, the ratios of various [OIII], [OII], [NII], and Balmer lines are instead used to determine metallicities. Here we present a refined approach for extracting metallicities from these ``strong line diagnostics''. Our method exploits empirical correlations between the temperature of OIII/OII regions and gas-phase metallicity, which lie close to theoretical expectations from thermal equilibrium calculations. We then show, from first principles, how to extract metallicities from traditional strong line diagnostics, R2, R3, R23, O3O2, and N2O2. We show that these ratios depend also on ionization correction factors, but that these can be determined self-consistently along with the metallicities. We quantify the success of our method using metallicities derived from galaxies with auroral line determinations and show that it generally works better than previous empirical approaches. The scatter in the observed line ratios and redshift evolution are largely explained by O3O2 variations. We provide publicly available routines for extracting metallicities from strong line diagnostics using our methodology.


title: Shifted coisotropic structures for differentiable stacks

abstract: We introduce a notion of coisotropics on 1-shifted symplectic Lie groupoids (i.e. quasi-symplectic groupoids) using twisted Dirac structures and show that it satisfies properties analogous to the corresponding derived-algebraic notion in shifted Poisson geometry. In particular, intersections of 1-coisotropics are 0-shifted Poisson. We also show that 1-shifted coisotropic structures transfer through Morita equivalences, giving a well-defined notion for differentiable stacks. Most results are formulated with clean-intersection conditions weaker than transversality while avoiding derived geometry. Examples of 1-coisotropics that are not necessarily Lagrangians include Hamiltonian actions of quasi-symplectic groupoids on Dirac manifolds, and this recovers several generalizations of Marsden-Weinstein-Meyer's symplectic reduction via intersection and Morita transfer.


title: Physics-Informed Quantum Machine Learning for Solving Partial Differential Equations

abstract: In this work, we solve differential equations using quantum Chebyshev feature maps. We propose a tensor product over a summation of Pauli-Z operators as a change in the measurement observables resulting in improved accuracy and reduced computation time for initial value problems processed by floating boundary handling. This idea has been tested on solving the complex dynamics of a Riccati equation as well as on a system of differential equations. Furthermore, a second-order differential equation is investigated in which we propose adding entangling layers to improve accuracy without increasing the variational parameters. Additionally, a modified self-adaptivity approach of physics-informed neural networks is incorporated to balance the multi-objective loss function. Finally, a new quantum circuit structure is proposed to approximate multivariable functions, tested on solving a 2D Poisson's equation.


title: Random-matrix models of monitored quantum circuits

abstract: We study the competition between Haar-random unitary dynamics and measurements for unstructured systems of qubits. For projective measurements, we derive various properties of the statistical ensemble of Kraus operators analytically, including the purification time and the distribution of Born probabilities. The latter generalizes the Porter-Thomas distribution for random unitary circuits to the monitored setting and is log-normal at long times. We also consider weak measurements that interpolate between identity quantum channels and projective measurements. In this setting, we derive an exactly solvable Fokker-Planck equation for the joint distribution of singular values of Kraus operators, analogous to the Dorokhov-Mello-Pereyra-Kumar (DMPK) equation modelling disordered quantum wires. We expect that the statistical properties of Kraus operators we have established for these simple systems will serve as a model for the entangling phase of monitored quantum systems more generally.

categories: quant-ph cond-mat.dis-nn cond-mat.stat-mech hep-th


title: A new type of large-scale signature change in emergent modified gravity

abstract: Emergent modified gravity presents a new class of gravitational theories in which the structure of space-time with Riemannian geometry of a certain signature is not presupposed. Relying on crucial features of a canonical formulation, the geometry of space-time is instead derived from the underlying dynamical equations for phase-space degrees of freedom together with a crucial covariance condition. Here, a large class of spherically symmetric models is solved analytically for Schwarzschild-type black-hole configurations with generic modification functions, using a variety of slicings that explicitly demonstrates general covariance. For some choices of the modification functions, a new type of signature change is found and evaluated. In contrast to previous versions discussed for instance in models of loop quantum gravity, signature change happens on timelike hypersurfaces in the exterior region of a black hole where it is not covered by a horizon. A large region between the horizon and the signature-change hypersurface may nevertheless be nearly classical, such that the presence of a signature-change boundary around Lorentzian space-time, or a Euclidean wall around the universe, is consistent with observations provided signature change happens sufficiently far from the black hole.


title: Speed limits of two-qubit gates with qudits

abstract: The speed of elementary quantum gates ultimately sets the limit on the speed at which quantum circuits can operate. For a fixed physical interaction strength between two qubits, the speed of any two-qubit gate is limited even with arbitrarily fast single-qubit gates. In this work, we explore the possibilities of speeding up two-qubit gates beyond such a limit by expanding our computational space outside the qubit subspace, which is experimentally relevant for qubits encoded in multi-level atoms or anharmonic oscillators. We identify an optimal theoretical bound for the speed limit of a two-qubit gate achieved using two qudits with a bounded interaction strength and arbitrarily fast single-qudit gates. In addition, we find an experimentally feasible protocol using two parametrically coupled superconducting transmons that achieves this theoretical speed limit in a non-trivial way. We also consider practical scenarios with limited single-qudit drive strengths and off-resonant transitions. For such scenarios, we develop an open-source, machine learning assisted, quantum optimal control algorithm that can achieve a speedup close to the theoretical limit with near-perfect gate fidelity. This work opens up a new avenue to speed up two-qubit gates when the physical interaction strength between qubits cannot be easily increased while extra states outside the qubit subspace can be well controlled.


title: NestE: Modeling Nested Relational Structures for Knowledge Graph Reasoning

abstract: Reasoning with knowledge graphs (KGs) has primarily focused on triple-shaped facts. Recent advancements have been explored to enhance the semantics of these facts by incorporating more potent representations, such as hyper-relational facts. However, these approaches are limited to \emph{atomic facts}, which describe a single piece of information. This paper extends beyond \emph{atomic facts} and delves into \emph{nested facts}, represented by quoted triples where subjects and objects are triples themselves (e.g., ((\emph{BarackObama}, \emph{holds\_position}, \emph{President}), \emph{succeed\_by}, (\emph{DonaldTrump}, \emph{holds\_position}, \emph{President}))). These nested facts enable the expression of complex semantics like \emph{situations} over time and \emph{logical patterns} over entities and relations. In response, we introduce NestE, a novel KG embedding approach that captures the semantics of both atomic and nested factual knowledge. NestE represents each atomic fact as a $1\times3$ matrix, and each nested relation is modeled as a $3\times3$ matrix that rotates the $1\times3$ atomic fact matrix through matrix multiplication. Each element of the matrix is represented as a complex number in the generalized 4D hypercomplex space, including (spherical) quaternions, hyperbolic quaternions, and split-quaternions. Through thorough analysis, we demonstrate the embedding's efficacy in capturing diverse logical patterns over nested facts, surpassing the confines of first-order logic-like expressions. Our experimental results showcase NestE's significant performance gains over current baselines in triple prediction and conditional link prediction. The code and pre-trained models are open available at https://github.com/xiongbo010/NestE.


title: Diagnostic diagrams for ram-pressure stripped candidates

abstract: This paper presents a method for finding ram-pressure stripped (RPS) galaxy candidates by performing a morphological analysis of galaxy images obtained from the Legacy survey. We consider a sample of about 600 galaxies located in different environments such as groups and clusters, tidally interacting pairs and the field. The sample includes 160 RPS previously classified in the literature into classes from J1 to J5, based on the increasing level of disturbances. Our morphological analysis was done using the {\sc astromorphlib} software followed by the inspection of diagnostic diagrams involving combinations of different parameters like the asymmetry ($A$), concentration ($C$), S\'ersic index ($n$), and bulge strength parameters $F(G,\,M_{20})$. We found that some of those diagrams display a distinct region in which galaxies classified as J3, J4 and J5 decouples from isolated galaxies. We call this region as the morphological transition zone and we also found that tidally interacting galaxies in pairs are predominant within this zone. Nevertheless, after visually inspecting the objects in the morphological transition zone to discard obvious contaminants, we ended up with 33 bonafide new RPS candidates in the studied nearby groups and clusters (Hydra, Fornax, and CLoGS sample), of which one-third show clear evidence of unwinding arms. Future works may potentially further increase significantly the samples of known RPS using such method.


title: Hamiltonian Truncation Crafted for UV-divergent QFTs

abstract: We develop the theory of Hamiltonian Truncation (HT) to systematically study RG flows that require the renormalization of coupling constants. This is a necessary step towards making HT a fully general method for QFT calculations. We apply this theory to a number of QFTs defined as relevant deformations of $d=1+1$ CFTs. We investigated three examples of increasing complexity: the deformed Ising, Tricritical-Ising, and non-unitary minimal model $M(3,7)$. The first two examples provide a crosscheck of our methodologies against well established characteristics of these theories. The $M(3,7)$ CFT deformed by its $Z_2$-even operators shows an intricate phase diagram that we clarify. At a boundary of this phase diagram we show that this theory flows, in the IR, to the $M(3,5)$ CFT.

categories: hep-th cond-mat.stat-mech hep-lat hep-ph


title: Mosaic-SDF for 3D Generative Models

abstract: Current diffusion or flow-based generative models for 3D shapes divide to two: distilling pre-trained 2D image diffusion models, and training directly on 3D shapes. When training a diffusion or flow models on 3D shapes a crucial design choice is the shape representation. An effective shape representation needs to adhere three design principles: it should allow an efficient conversion of large 3D datasets to the representation form; it should provide a good tradeoff of approximation power versus number of parameters; and it should have a simple tensorial form that is compatible with existing powerful neural architectures. While standard 3D shape representations such as volumetric grids and point clouds do not adhere to all these principles simultaneously, we advocate in this paper a new representation that does. We introduce Mosaic-SDF (M-SDF): a simple 3D shape representation that approximates the Signed Distance Function (SDF) of a given shape by using a set of local grids spread near the shape's boundary. The M-SDF representation is fast to compute for each shape individually making it readily parallelizable; it is parameter efficient as it only covers the space around the shape's boundary; and it has a simple matrix form, compatible with Transformer-based architectures. We demonstrate the efficacy of the M-SDF representation by using it to train a 3D generative flow model including class-conditioned generation with the 3D Warehouse dataset, and text-to-3D generation using a dataset of about 600k caption-shape pairs.


title: Many-body mobility edges in 1D and 2D revealed by convolutional neural networks

abstract: We adapt a machine-learning approach to study the many-body localization transition in interacting fermionic systems on disordered 1D and 2D lattices. We perform supervised training of convolutional neural networks (CNNs) using labelled many-body wavefunctions at weak and strong disorder. In these limits, the average validation accuracy of the trained CNNs exceeds 99.95%. We use the disorder-averaged predictions of the CNNs to generate energy-resolved phase diagrams, which exhibit many-body mobility edges. We provide finite-size estimates of the critical disorder strengths at $W_c\sim2.8$ and $9.8$ for 1D and 2D systems of 16 sites respectively. Our results agree with the analysis of energy-level statistics and inverse participation ratio. By examining the convolutional layer, we unveil its feature extraction mechanism which highlights the pronounced peaks in localized many-body wavefunctions while rendering delocalized wavefunctions nearly featureless.

categories: cond-mat.dis-nn cond-mat.mes-hall cond-mat.stat-mech cond-mat.str-el


title: Shannon capacity, Lov\'asz theta number and the Mycielski construction

abstract: We investigate the effect of the well-known Mycielski construction on the Shannon capacity of graphs and on one of its most prominent upper bounds, the (complementary) Lov\'asz theta number. We prove that if the Shannon capacity of a graph, the distinguishability graph of a noisy channel, is attained by some finite power, then its Mycielskian has strictly larger Shannon capacity than the graph itself. For the complementary Lov\'asz theta function we show that its value on the Mycielskian of a graph is completely determined by its value on the original graph, a phenomenon similar to the one discovered for the fractional chromatic number by Larsen, Propp and Ullman. We also consider the possibility of generalizing our results on the Sperner capacity of directed graphs and on the generalized Mycielsky construction. Possible connections with what Zuiddam calls the asymptotic spectrum of graphs are discussed as well.


title: Gaussian Process Regression under Computational and Epistemic Misspecification

abstract: Gaussian process regression is a classical kernel method for function estimation and data interpolation. In large data applications, computational costs can be reduced using low-rank or sparse approximations of the kernel. This paper investigates the effect of such kernel approximations on the interpolation error. We introduce a unified framework to analyze Gaussian process regression under important classes of computational misspecification: Karhunen-Lo\`eve expansions that result in low-rank kernel approximations, multiscale wavelet expansions that induce sparsity in the covariance matrix, and finite element representations that induce sparsity in the precision matrix. Our theory also accounts for epistemic misspecification in the choice of kernel parameters.


title: Nuclear modified transverse momentum dependent parton distribution and fragmentation functions

abstract: In this study, we extend our previous global analysis of nuclear-modified transverse momentum distribution functions (nTMDs) to also consider the nuclear-modified collinear fragmentation function. Our methodology incorporates the global set of experimental data from both Drell-Yan production and Semi-Inclusive Deep Inelastic Scattering. Through a comprehensive global extraction of these distributions, we demonstrate the effectiveness of this extension by strongly describing the entire global dataset. A focal point of this paper is the impact of recent Jefferson Lab measurements. Most notably, to simultaneously describe experimental data at Jefferson Lab and HERMES we find that it is necessary to introduce a parameter which accounts for the non-perturbative scale evolution of the nTMDs. Additionally, we assess the kinematic coverage of the experimental data and provide insights into experimental opportunities at Jefferson Lab, future Electron-Ion Colliders, RHIC, and the LHC. These opportunities have the potential to significantly enhance and refine global analyses of nuclear-modified TMDs, contributing to a deeper understanding of the structure of cold nuclear matter.


title: Upper Semicontinuity of Index Plus Nullity for Minimal and CMC Hypersurfaces

abstract: We consider a sequence of bubble converging minimal hypersurfaces, or H-CMC hypersurfaces, in compact Riemannian manifolds without boundary, of dimension 4, 5, 6 or 7, and prove upper semicontinuity of index plus nullity, for such a bubble converging sequence. This complements the previously known lower semicontinuity of index obtained by Buzano--Sharp, and Bourni--Sharp--Tinaglia. The strategy of our proof is to analyse a weighted eigenvalue problem along our sequence of hypersurfaces. This strategy is inspired by the recent work of Da Lio--Gianocca--Rivi\`{e}re. A key aspect of our proof is making use of a Lorentz--Sobolev inequality to study the behaviour of these weighted eigenfunctions on the neck regions along the sequence, as well as the index and nullity of our non-compact bubbles.


title: 3DGS-Avatar: Animatable Avatars via Deformable 3D Gaussian Splatting

abstract: We introduce an approach that creates animatable human avatars from monocular videos using 3D Gaussian Splatting (3DGS). Existing methods based on neural radiance fields (NeRFs) achieve high-quality novel-view/novel-pose image synthesis but often require days of training, and are extremely slow at inference time. Recently, the community has explored fast grid structures for efficient training of clothed avatars. Albeit being extremely fast at training, these methods can barely achieve an interactive rendering frame rate with around 15 FPS. In this paper, we use 3D Gaussian Splatting and learn a non-rigid deformation network to reconstruct animatable clothed human avatars that can be trained within 30 minutes and rendered at real-time frame rates (50+ FPS). Given the explicit nature of our representation, we further introduce as-isometric-as-possible regularizations on both the Gaussian mean vectors and the covariance matrices, enhancing the generalization of our model on highly articulated unseen poses. Experimental results show that our method achieves comparable and even better performance compared to state-of-the-art approaches on animatable avatar creation from a monocular input, while being 400x and 250x faster in training and inference, respectively.


title: Criteria for Analyticity of Multidimensionally Subordinate Semigroups

abstract: Let $\psi$ be a Bernstein function in one variable. A.~Carasso and T.~Kato obtained necessary and sufficient conditions for $\psi$ to have a property that $\psi(A)$ generates a quasibounded holomorphic semigroup for every generator $A$ of a bounded $C_0$-semigroup in a Banach space and deduced necessary conditions as well. We generalize their results to the multidimensional case and also give sufficient conditions for the property mentioned above.


title: Successor Heads: Recurring, Interpretable Attention Heads In The Wild

abstract: In this work we present successor heads: attention heads that increment tokens with a natural ordering, such as numbers, months, and days. For example, successor heads increment 'Monday' into 'Tuesday'. We explain the successor head behavior with an approach rooted in mechanistic interpretability, the field that aims to explain how models complete tasks in human-understandable terms. Existing research in this area has found interpretable language model components in small toy models. However, results in toy models have not yet led to insights that explain the internals of frontier models and little is currently understood about the internal operations of large language models. In this paper, we analyze the behavior of successor heads in large language models (LLMs) and find that they implement abstract representations that are common to different architectures. They form in LLMs with as few as 31 million parameters, and at least as many as 12 billion parameters, such as GPT-2, Pythia, and Llama-2. We find a set of 'mod-10 features' that underlie how successor heads increment in LLMs across different architectures and sizes. We perform vector arithmetic with these features to edit head behavior and provide insights into numeric representations within LLMs. Additionally, we study the behavior of successor heads on natural language data, identifying interpretable polysemanticity in a Pythia successor head.


title: Reliability in Semantic Segmentation: Can We Use Synthetic Data?

abstract: Assessing the reliability of perception models to covariate shifts and out-of-distribution (OOD) detection is crucial for safety-critical applications such as autonomous vehicles. By nature of the task, however, the relevant data is difficult to collect and annotate. In this paper, we challenge cutting-edge generative models to automatically synthesize data for assessing reliability in semantic segmentation. By fine-tuning Stable Diffusion, we perform zero-shot generation of synthetic data in OOD domains or inpainted with OOD objects. Synthetic data is employed to provide an initial assessment of pretrained segmenters, thereby offering insights into their performance when confronted with real edge cases. Through extensive experiments, we demonstrate a high correlation between the performance on synthetic data and the performance on real OOD data, showing the validity approach. Furthermore, we illustrate how synthetic data can be utilized to enhance the calibration and OOD detection capabilities of segmenters.


title: DVQI: A Multi-task, Hardware-integrated Artificial Intelligence System for Automated Visual Inspection in Electronics Manufacturing

abstract: As electronics manufacturers continue to face pressure to increase production efficiency amid difficulties with supply chains and labour shortages, many printed circuit board assembly (PCBA) manufacturers have begun to invest in automation and technological innovations to remain competitive. One such method is to leverage artificial intelligence (AI) to greatly augment existing manufacturing processes. In this paper, we present the DarwinAI Visual Quality Inspection (DVQI) system, a hardware-integration artificial intelligence system for the automated inspection of printed circuit board assembly defects in an electronics manufacturing environment. The DVQI system enables multi-task inspection via minimal programming and setup for manufacturing engineers while improving cycle time relative to manual inspection. We also present a case study of the deployed DVQI system's performance and impact for a top electronics manufacturer.


title: Slant, Fan, and Narrow: the Response of Stellar Streams to a Tilting Galactic Disk

abstract: Stellar streams are sensitive tracers of the gravitational potential, which is typically assumed to be static in the inner Galaxy. However, massive mergers like Gaia-Sausage-Enceladus can impart torques on the stellar disk of the Milky Way that result in the disk tilting at rates of up to 10-20 deg/Gyr. Here, we demonstrate the effects of disk tilting on the morphology and kinematics of stellar streams. Through a series of numerical experiments, we find that streams with nearby apocenters $(r_{\rm apo} \lesssim 20~\rm{kpc})$ are sensitive to disk tilting, with the primary effect being changes to the stream's on-sky track and width. Interestingly, disk tilting can produce both more diffuse streams and more narrow streams, depending on the orbital inclination of the progenitor and the direction in which the disk is tilting. Our model of Pal 5's tidal tails for a tilting rate of 15 deg/Gyr is in excellent agreement with the observed stream's track and width, and reproduces the extreme narrowing of the trailing tail. We also find that failure to account for a tilting disk can bias constraints on shape parameters of the Milky Way's local dark matter distribution at the level of 5-10%, with the direction of the bias changing for different streams. Disk tilting could therefore explain discrepancies in the Milky Way's dark matter halo shape inferred using different streams.


title: Let's do the time-warp-attend: Learning topological invariants of dynamical systems

abstract: Dynamical systems across the sciences, from electrical circuits to ecological networks, undergo qualitative and often catastrophic changes in behavior, called bifurcations, when their underlying parameters cross a threshold. Existing methods predict oncoming catastrophes in individual systems but are primarily time-series-based and struggle both to categorize qualitative dynamical regimes across diverse systems and to generalize to real data. To address this challenge, we propose a data-driven, physically-informed deep-learning framework for classifying dynamical regimes and characterizing bifurcation boundaries based on the extraction of topologically invariant features. We focus on the paradigmatic case of the supercritical Hopf bifurcation, which is used to model periodic dynamics across a wide range of applications. Our convolutional attention method is trained with data augmentations that encourage the learning of topological invariants which can be used to detect bifurcation boundaries in unseen systems and to design models of biological systems like oscillatory gene regulatory networks. We further demonstrate our method's use in analyzing real data by recovering distinct proliferation and differentiation dynamics along pancreatic endocrinogenesis trajectory in gene expression space based on single-cell data. Our method provides valuable insights into the qualitative, long-term behavior of a wide range of dynamical systems, and can detect bifurcations or catastrophic transitions in large-scale physical and biological systems.


title: Reducing strain fluctuations in quantum dot devices by gate-layer stacking

abstract: Nanofabricated metal gate electrodes are commonly used to confine and control electrons in electrostatically defined quantum dots. However, these same gates impart a complicated strain geometry that affects the confinement potential and potentially impairs device functionality. Here we investigate strain-induced fluctuations of the potential energy in Si/SiGe heterostructures, caused by (i) lattice mismatch, (ii) materials-dependent thermal contraction, and (iii) deposition stress in the metal gates. By simulating different gate geometries, ranging from simple to realistically complicated, and including features like overlapping metal and oxide layers, we can explain most observed strain features. In particular, we show that strain-induced potential fluctuations can be suppressed by employing overlapping gates that cover the whole active region, when the oxide layers are thin. These results suggest that strain effects should not present a serious challenge to qubit uniformity when following simple design rules.


title: A framework for conditional diffusion modelling with applications in motif scaffolding for protein design

abstract: Many protein design applications, such as binder or enzyme design, require scaffolding a structural motif with high precision. Generative modelling paradigms based on denoising diffusion processes emerged as a leading candidate to address this motif scaffolding problem and have shown early experimental success in some cases. In the diffusion paradigm, motif scaffolding is treated as a conditional generation task, and several conditional generation protocols were proposed or imported from the Computer Vision literature. However, most of these protocols are motivated heuristically, e.g. via analogies to Langevin dynamics, and lack a unifying framework, obscuring connections between the different approaches. In this work, we unify conditional training and conditional sampling procedures under one common framework based on the mathematically well-understood Doob's h-transform. This new perspective allows us to draw connections between existing methods and propose a new variation on existing conditional training protocols. We illustrate the effectiveness of this new protocol in both, image outpainting and motif scaffolding and find that it outperforms standard methods.


title: Pixel Aligned Language Models

abstract: Large language models have achieved great success in recent years, so as their variants in vision. Existing vision-language models can describe images in natural languages, answer visual-related questions, or perform complex reasoning about the image. However, it is yet unclear how localization tasks, such as word grounding or referring localization, can be performed using large language models. In this work, we aim to develop a vision-language model that can take locations, for example, a set of points or boxes, as either inputs or outputs. When taking locations as inputs, the model performs location-conditioned captioning, which generates captions for the indicated object or region. When generating locations as outputs, our model regresses pixel coordinates for each output word generated by the language model, and thus performs dense word grounding. Our model is pre-trained on the Localized Narrative dataset, which contains pixel-word-aligned captioning from human attention. We show our model can be applied to various location-aware vision-language tasks, including referring localization, location-conditioned captioning, and dense object captioning, archiving state-of-the-art performance on RefCOCO and Visual Genome. Project page: https://jerryxu.net/PixelLLM .


title: Auto MC-Reward: Automated Dense Reward Design with Large Language Models for Minecraft

abstract: Many reinforcement learning environments (e.g., Minecraft) provide only sparse rewards that indicate task completion or failure with binary values. The challenge in exploration efficiency in such environments makes it difficult for reinforcement-learning-based agents to learn complex tasks. To address this, this paper introduces an advanced learning system, named Auto MC-Reward, that leverages Large Language Models (LLMs) to automatically design dense reward functions, thereby enhancing the learning efficiency. Auto MC-Reward consists of three important components: Reward Designer, Reward Critic, and Trajectory Analyzer. Given the environment information and task descriptions, the Reward Designer first design the reward function by coding an executable Python function with predefined observation inputs. Then, our Reward Critic will be responsible for verifying the code, checking whether the code is self-consistent and free of syntax and semantic errors. Further, the Trajectory Analyzer summarizes possible failure causes and provides refinement suggestions according to collected trajectories. In the next round, Reward Designer will further refine and iterate the dense reward function based on feedback. Experiments demonstrate a significant improvement in the success rate and learning efficiency of our agents in complex tasks in Minecraft, such as obtaining diamond with the efficient ability to avoid lava, and efficiently explore trees and animals that are sparse in the plains biome.


title: Beyond the parametric approximation: pump depletion, entanglement and squeezing in macroscopic down-conversion

abstract: We study the dynamics of the pump mode in the down-conversion Hamiltonian using the cumulant expansion method, perturbation theory, and the full numerical simulation of systems with a pump mean photon number of up to one hundred thousand. We particularly focus on the properties of the pump-mode such as depletion, entanglement, and squeezing for an experimentally relevant initial state in which the pump mode is initialized in a coherent state. Through this analysis, we obtain the short-time behaviour of various quantities and derive timescales at which the above-mentioned features, which cannot be understood through the parametric approximation, originate in the system. We also provide an entanglement witness involving moments of bosonic operators that can capture the entanglement of the pump mode. Finally, we study the photon-number statistics of the pump and the signal/idler modes to understand the general behaviour of these modes for experimentally relevant time scales.


title: Fractional corner charges induced by fragile topology in threefold symmetric two-dimensional materials

abstract: We perform a systematic study of the signatures of fragile topology in a number of nonmagnetic two-dimensional materials belonging to space group 164, most of them transition metal dichalcogenides. Using group theory analysis in the framework of topological quantum chemistry, we find fragile bands near the Fermi level for all the materials studied. Since stable topological bands are also present in these systems, the interplay of both phases is discussed, showing that corner charges appear in nearly three quarters of the materials and that they are caused by fragile topology. Using first-principles calculations, we predict corner states with fractional corner charges protected by C3 symmetry. Our work aims to broaden the scope of materials with experimentally accessible fragile bands.


title: TinyGSM: achieving >80% on GSM8k with small language models

abstract: Small-scale models offer various computational advantages, and yet to which extent size is critical for problem-solving abilities remains an open question. Specifically for solving grade school math, the smallest model size so far required to break the 80\% barrier on the GSM8K benchmark remains to be 34B. Our work studies how high-quality datasets may be the key for small language models to acquire mathematical reasoning. We introduce \texttt{TinyGSM}, a synthetic dataset of 12.3M grade school math problems paired with Python solutions, generated fully by GPT-3.5. After finetuning on \texttt{TinyGSM}, we find that a duo of a 1.3B generation model and a 1.3B verifier model can achieve 81.5\% accuracy, outperforming existing models that are orders of magnitude larger. This also rivals the performance of the GPT-3.5 ``teacher'' model (77.4\%), from which our model's training data is generated. Our approach is simple and has two key components: 1) the high-quality dataset \texttt{TinyGSM}, 2) the use of a verifier, which selects the final outputs from multiple candidate generations.


title: Text2Immersion: Generative Immersive Scene with 3D Gaussians

abstract: We introduce Text2Immersion, an elegant method for producing high-quality 3D immersive scenes from text prompts. Our proposed pipeline initiates by progressively generating a Gaussian cloud using pre-trained 2D diffusion and depth estimation models. This is followed by a refining stage on the Gaussian cloud, interpolating and refining it to enhance the details of the generated scene. Distinct from prevalent methods that focus on single object or indoor scenes, or employ zoom-out trajectories, our approach generates diverse scenes with various objects, even extending to the creation of imaginary scenes. Consequently, Text2Immersion can have wide-ranging implications for various applications such as virtual reality, game development, and automated content creation. Extensive evaluations demonstrate that our system surpasses other methods in rendering quality and diversity, further progressing towards text-driven 3D scene generation. We will make the source code publicly accessible at the project page.


title: OccNeRF: Advancing 3D Occupancy Prediction in LiDAR-Free Environments

abstract: As a fundamental task of vision-based perception, 3D occupancy prediction reconstructs 3D structures of surrounding environments. It provides detailed information for autonomous driving planning and navigation. However, most existing methods heavily rely on the LiDAR point clouds to generate occupancy ground truth, which is not available in the vision-based system. In this paper, we propose an OccNeRF method for training occupancy networks without 3D supervision. Different from previous works which consider a bounded scene, we parameterize the reconstructed occupancy fields and reorganize the sampling strategy to align with the cameras' infinite perceptive range. The neural rendering is adopted to convert occupancy fields to multi-camera depth maps, supervised by multi-frame photometric consistency. Moreover, for semantic occupancy prediction, we design several strategies to polish the prompts and filter the outputs of a pretrained open-vocabulary 2D segmentation model. Extensive experiments for both self-supervised depth estimation and 3D occupancy prediction tasks on nuScenes and SemanticKITTI datasets demonstrate the effectiveness of our method.


title: Helping or Herding? Reward Model Ensembles Mitigate but do not Eliminate Reward Hacking

abstract: Reward models play a key role in aligning language model applications towards human preferences. However, this setup creates an incentive for the language model to exploit errors in the reward model to achieve high estimated reward, a phenomenon often termed \emph{reward hacking}. A natural mitigation is to train an ensemble of reward models, aggregating over model outputs to obtain a more robust reward estimate. We explore the application of reward ensembles to alignment at both training time (through reinforcement learning) and inference time (through reranking). First, we show that reward models are \emph{underspecified}: reward models that perform similarly in-distribution can yield very different rewards when used in alignment, due to distribution shift. Second, underspecification results in overoptimization, where alignment to one reward model does not improve reward as measured by another reward model trained on the same data. Third, overoptimization is mitigated by the use of reward ensembles, and ensembles that vary by their \emph{pretraining} seeds lead to better generalization than ensembles that differ only by their \emph{fine-tuning} seeds, with both outperforming individual reward models. However, even pretrain reward ensembles do not eliminate reward hacking: we show several qualitative reward hacking phenomena that are not mitigated by ensembling because all reward models in the ensemble exhibit similar error patterns.


title: DriveMLM: Aligning Multi-Modal Large Language Models with Behavioral Planning States for Autonomous Driving

abstract: Large language models (LLMs) have opened up new possibilities for intelligent agents, endowing them with human-like thinking and cognitive abilities. In this work, we delve into the potential of large language models (LLMs) in autonomous driving (AD). We introduce DriveMLM, an LLM-based AD framework that can perform close-loop autonomous driving in realistic simulators. To this end, (1) we bridge the gap between the language decisions and the vehicle control commands by standardizing the decision states according to the off-the-shelf motion planning module. (2) We employ a multi-modal LLM (MLLM) to model the behavior planning module of a module AD system, which uses driving rules, user commands, and inputs from various sensors (e.g., camera, lidar) as input and makes driving decisions and provide explanations; This model can plug-and-play in existing AD systems such as Apollo for close-loop driving. (3) We design an effective data engine to collect a dataset that includes decision state and corresponding explanation annotation for model training and evaluation. We conduct extensive experiments and show that our model achieves 76.1 driving score on the CARLA Town05 Long, and surpasses the Apollo baseline by 4.7 points under the same settings, demonstrating the effectiveness of our model. We hope this work can serve as a baseline for autonomous driving with LLMs. Code and models shall be released at https://github.com/OpenGVLab/DriveMLM.


title: SHAP-EDITOR: Instruction-guided Latent 3D Editing in Seconds

abstract: We propose a novel feed-forward 3D editing framework called Shap-Editor. Prior research on editing 3D objects primarily concentrated on editing individual objects by leveraging off-the-shelf 2D image editing networks. This is achieved via a process called distillation, which transfers knowledge from the 2D network to 3D assets. Distillation necessitates at least tens of minutes per asset to attain satisfactory editing results, and is thus not very practical. In contrast, we ask whether 3D editing can be carried out directly by a feed-forward network, eschewing test-time optimisation. In particular, we hypothesise that editing can be greatly simplified by first encoding 3D objects in a suitable latent space. We validate this hypothesis by building upon the latent space of Shap-E. We demonstrate that direct 3D editing in this space is possible and efficient by building a feed-forward editor network that only requires approximately one second per edit. Our experiments show that Shap-Editor generalises well to both in-distribution and out-of-distribution 3D assets with different prompts, exhibiting comparable performance with methods that carry out test-time optimisation for each edited instance.


title: Absence of a direct metal to Mott insulator transition for disordered interacting fermions on the Cayley tree

abstract: Interacting fermions in the presence of disorder pose one of the most challenging problems in condensed matter physics, primarily due to the absence of accurate numerical tools. Our investigation delves into the intricate interplay between interaction-induced Mott insulation and disorder-driven Anderson localization in the Hubbard model subjected to a random potential. On the Cayley tree, the application of statistical dynamical mean-field theory proves adept at discerning among a metal and the two distinct insulators, Anderson or Mott. Our comprehensive analysis, accounting for subtle yet potent finite-size effects and fluctuations, yields a noteworthy finding: in the presence of disorder, we consistently observe an intervening Anderson-localized regime between the metallic and Mott insulator states. This observation intriguingly mirrors scenarios witnessed in dirty Bosons, where an insulating Bose glass phase consistently emerges between the superfluid and Mott phases.


title: Universal Coarsening in a Homogeneous Two-Dimensional Bose Gas

abstract: Coarsening of an isolated far-from-equilibrium quantum system is a paradigmatic many-body phenomenon, relevant from subnuclear to cosmological lengthscales, and predicted to feature universal dynamic scaling. Here, we observe universal scaling in the coarsening of a homogeneous two-dimensional Bose gas, with exponents that match analytical predictions. For different initial states, we reveal universal scaling in the experimentally accessible finite-time dynamics by elucidating and accounting for the initial-state-dependent prescaling effects. The methods we introduce establish direct comparison between cold-atom experiments and non-equilibrium field theory, and are applicable to any study of universality far from equilibrium.

categories: cond-mat.quant-gas cond-mat.stat-mech hep-ph physics.atom-ph quant-ph


title: ZeroRF: Fast Sparse View 360{\deg} Reconstruction with Zero Pretraining

abstract: We present ZeroRF, a novel per-scene optimization method addressing the challenge of sparse view 360{\deg} reconstruction in neural field representations. Current breakthroughs like Neural Radiance Fields (NeRF) have demonstrated high-fidelity image synthesis but struggle with sparse input views. Existing methods, such as Generalizable NeRFs and per-scene optimization approaches, face limitations in data dependency, computational cost, and generalization across diverse scenarios. To overcome these challenges, we propose ZeroRF, whose key idea is to integrate a tailored Deep Image Prior into a factorized NeRF representation. Unlike traditional methods, ZeroRF parametrizes feature grids with a neural network generator, enabling efficient sparse view 360{\deg} reconstruction without any pretraining or additional regularization. Extensive experiments showcase ZeroRF's versatility and superiority in terms of both quality and speed, achieving state-of-the-art results on benchmark datasets. ZeroRF's significance extends to applications in 3D content generation and editing. Project page: https://sarahweiii.github.io/zerorf/


title: Single Mesh Diffusion Models with Field Latents for Texture Generation

abstract: We introduce a framework for intrinsic latent diffusion models operating directly on the surfaces of 3D shapes, with the goal of synthesizing high-quality textures. Our approach is underpinned by two contributions: field latents, a latent representation encoding textures as discrete vector fields on the mesh vertices, and field latent diffusion models, which learn to denoise a diffusion process in the learned latent space on the surface. We consider a single-textured-mesh paradigm, where our models are trained to generate variations of a given texture on a mesh. We show the synthesized textures are of superior fidelity compared those from existing single-textured-mesh generative models. Our models can also be adapted for user-controlled editing tasks such as inpainting and label-guided generation. The efficacy of our approach is due in part to the equivariance of our proposed framework under isometries, allowing our models to seamlessly reproduce details across locally similar regions and opening the door to a notion of generative texture transfer.


title: VL-GPT: A Generative Pre-trained Transformer for Vision and Language Understanding and Generation

abstract: In this work, we introduce Vision-Language Generative Pre-trained Transformer (VL-GPT), a transformer model proficient at concurrently perceiving and generating visual and linguistic data. VL-GPT achieves a unified pre-training approach for both image and text modalities by employing a straightforward auto-regressive objective, thereby enabling the model to process image and text as seamlessly as a language model processes text. To accomplish this, we initially propose a novel image tokenizer-detokenizer framework for visual data, specifically designed to transform raw images into a sequence of continuous embeddings and reconstruct them accordingly. In combination with the existing text tokenizer and detokenizer, this framework allows for the encoding of interleaved image-text data into a multimodal sequence, which can subsequently be fed into the transformer model. Consequently, VL-GPT can perform large-scale pre-training on multimodal corpora utilizing a unified auto-regressive objective (i.e., next-token prediction). Upon completion of pre-training, VL-GPT exhibits remarkable zero-shot and few-shot performance across a diverse range of vision and language understanding and generation tasks, including image captioning, visual question answering, text-to-image generation, and more. Additionally, the pre-trained model retrains in-context learning capabilities when provided with multimodal prompts. We further conduct instruction tuning on our VL-GPT, highlighting its exceptional potential for multimodal assistance. The source code and model weights shall be released.


title: FineControlNet: Fine-level Text Control for Image Generation with Spatially Aligned Text Control Injection

abstract: Recently introduced ControlNet has the ability to steer the text-driven image generation process with geometric input such as human 2D pose, or edge features. While ControlNet provides control over the geometric form of the instances in the generated image, it lacks the capability to dictate the visual appearance of each instance. We present FineControlNet to provide fine control over each instance's appearance while maintaining the precise pose control capability. Specifically, we develop and demonstrate FineControlNet with geometric control via human pose images and appearance control via instance-level text prompts. The spatial alignment of instance-specific text prompts and 2D poses in latent space enables the fine control capabilities of FineControlNet. We evaluate the performance of FineControlNet with rigorous comparison against state-of-the-art pose-conditioned text-to-image diffusion models. FineControlNet achieves superior performance in generating images that follow the user-provided instance-specific text prompts and poses compared with existing methods. Project webpage: https://samsunglabs.github.io/FineControlNet-project-page


title: Bayesian Optimization for Robust State Preparation in Quantum Many-Body Systems

abstract: New generations of ultracold-atom experiments are continually raising the demand for efficient solutions to optimal control problems. Here, we apply Bayesian optimization to improve a state-preparation protocol recently implemented in an ultracold-atom system to realize a two-particle fractional quantum Hall state. Compared to manual ramp design, we demonstrate the superior performance of our optimization approach in a numerical simulation - resulting in a protocol that is 10x faster at the same fidelity, even when taking into account experimentally realistic levels of disorder in the system. We extensively analyze and discuss questions of robustness and the relationship between numerical simulation and experimental realization, and how to make the best use of the surrogate model trained during optimization. We find that numerical simulation can be expected to substantially reduce the number of experiments that need to be performed with even the most basic transfer learning techniques. The proposed protocol and workflow will pave the way toward the realization of more complex many-body quantum states in experiments.


title: Revisiting Depth Completion from a Stereo Matching Perspective for Cross-domain Generalization

abstract: This paper proposes a new framework for depth completion robust against domain-shifting issues. It exploits the generalization capability of modern stereo networks to face depth completion, by processing fictitious stereo pairs obtained through a virtual pattern projection paradigm. Any stereo network or traditional stereo matcher can be seamlessly plugged into our framework, allowing for the deployment of a virtual stereo setup that is future-proof against advancement in the stereo field. Exhaustive experiments on cross-domain generalization support our claims. Hence, we argue that our framework can help depth completion to reach new deployment scenarios.


title: Quark-lepton mass relations from modular flavor symmetry

abstract: The so-called Golden Mass Relation provides a testable correlation between charged-lepton and down-type quark masses, that arises in certain flavor models that do not rely on Grand Unification. Such models typically involve broken family symmetries. In this work, we demonstrate that realistic fermion mass relations can emerge naturally in modular invariant models, without relying on ad hoc flavon alignments. We provide a model-independent derivation of a class of mass relations that are experimentally testable. These relations are determined by both the Clebsch-Gordan coefficients of the specific finite modular group and the expansion coefficients of its modular forms, thus offering potential probes of modular invariant models. As a detailed example, we present a set of viable mass relations based on the $\Gamma_4\cong S_4$ symmetry, which have calculable deviations from the usual Golden Mass Relation.


title: LIME: Localized Image Editing via Attention Regularization in Diffusion Models

abstract: Diffusion models (DMs) have gained prominence due to their ability to generate high-quality, varied images, with recent advancements in text-to-image generation. The research focus is now shifting towards the controllability of DMs. A significant challenge within this domain is localized editing, where specific areas of an image are modified without affecting the rest of the content. This paper introduces LIME for localized image editing in diffusion models that do not require user-specified regions of interest (RoI) or additional text input. Our method employs features from pre-trained methods and a simple clustering technique to obtain precise semantic segmentation maps. Then, by leveraging cross-attention maps, it refines these segments for localized edits. Finally, we propose a novel cross-attention regularization technique that penalizes unrelated cross-attention scores in the RoI during the denoising steps, ensuring localized edits. Our approach, without re-training and fine-tuning, consistently improves the performance of existing methods in various editing benchmarks.


title: Brain-Inspired Machine Intelligence: A Survey of Neurobiologically-Plausible Credit Assignment

abstract: In this survey, we examine algorithms for conducting credit assignment in artificial neural networks that are inspired or motivated by neurobiology. These processes are unified under one possible taxonomy, which is constructed based on how a learning algorithm answers a central question underpinning the mechanisms of synaptic plasticity in complex adaptive neuronal systems: where do the signals that drive the learning in individual elements of a network come from and how are they produced? In this unified treatment, we organize the ever-growing set of brain-inspired learning schemes into six general families and consider these in the context of backpropagation of errors and its known criticisms. The results of this review are meant to encourage future developments in neuro-mimetic systems and their constituent learning processes, wherein lies an important opportunity to build a strong bridge between machine learning, computational neuroscience, and cognitive science.


title: Comparative study of Kondo effect in Vanadium dichalcogenides VX$_2$ (X=Se & Te)

abstract: We report on the electrical transport, magnetotransport, and magnetic properties studies on the transition metal dichalcogenides VSe$_2$ and VTe$_2$ and draw a comprehensive comparison between them. We observe Kondo effect in both systems induced by the exchange interaction between localized moments and conduction electrons at low temperature, resulting into resistance upturn at 6 K for VSe$_2$ and 17 K for VTe$_2$. From the field dependent resistance measurements we find that the data is fitted best with modified Hamann equation corrected by the quantum Brillouin function for VSe$_2$, while the data is fitted best with modified Hamann equation corrected by the classical Langevin function for VTe$_2$. Interestingly, we observe a contrasting magnetoresistance (MR) property between these systems across the Kondo temperature. That means, negative MR is found in both systems in the Kondo state. In the normal state MR is positive for VSe$_2$, while it is negligible for VTe$_2$. In addition, both systems show weak ferromagnetism at low temperature due to intercalated V atoms.


title: Livestock feeding behavior: A tutorial review on automated techniques for ruminant monitoring

abstract: Livestock feeding behavior is an influential research area for those involved in animal husbandry and agriculture. In recent years, there has been a growing interest in automated systems for monitoring the behavior of ruminants. Despite the developments accomplished in the last decade, there is still much to do and learn about the methods for measuring and analyzing livestock feeding behavior. Automated monitoring systems mainly use motion, acoustic, and image sensors to collect animal behavioral data. The performance evaluation of existing methods is a complex task and direct comparisons between studies are difficult. Several factors prevent a direct comparison, starting from the diversity of data and performance metrics used in the experiments. To the best of our knowledge, this work represents the first tutorial-style review on the analysis of the feeding behavior of ruminants, emphasizing the relationship between sensing methodologies, signal processing and computational intelligence methods. It assesses the main sensing methodologies (i.e. based on movement, sound, images/videos and pressure) and the main techniques to measure and analyze the signals associated with feeding behavior, evaluating their use in different settings and situations. It also highlights the potentiality of automated monitoring systems to provide valuable information that improves our understanding of livestock feeding behavior. The relevance of these systems is increasingly important due to their impact on production systems and research. Finally, the paper closes by discussing future challenges and opportunities in livestock feeding behavior monitoring.


title: High precision atom interferometer-based dynamic gravimeter measurement by eliminating the cross-coupling effect

abstract: A dynamic gravimeter with an atomic interferometer (AI) can perform absolute gravity measurements with high precision. AI-based dynamic gravity measurement is a type of joint measurement that uses AI sensors and a classical accelerometer. The coupling of the two sensors may degrade the measurement precision. In this study, we analyzed the cross-coupling effect and introduced a recovery vector to suppress this effect. We improved the phase noise of the interference fringe by a factor of 1.9 by performing marine gravity measurements using an AI-based gravimeter and optimizing the recovery vector. Marine gravity measurements were performed, and high gravity measurement precision was achieved. The external and inner coincidence accuracies of the gravity measurement are 0.42 mGal and 0.46 mGal, which were improved by factors of 4.18 and 4.21 by optimizing the cross-coupling effect.