title: Microscopically grounded constitutive model for dense suspensions of soft particles below jamming

abstract: We derive from particle-level dynamics a constitutive model describing the rheology of two-dimensional dense soft suspensions below the jamming transition, in a regime where hydrodynamic interactions between particles are screened. Based on a statistical description of particle dynamics, we obtain through a set of physically plausible approximations a non-linear tensorial evolution equation for the deviatoric part of the stress tensor, involving the strain-rate and vorticity tensors. This tensorial evolution equation involves singular terms usually not taken into account in phenomenological constitutive models, which most often assume a regular expansion in terms of the stress tensor. All coefficients appearing in the equation have known expressions in terms of the microscopic parameters of the model. The predictions of this microscopically grounded constitutive model have several qualitative features that are specific to the rheology of soft suspensions measured in experiments or simulations. The model shows a typical behavior of polymeric visco-elastic materials, such as normal stress differences quadratic in the shear rate $\dot\gamma$, as well as typical behaviors of suspensions of stiff particles, such as a particle pressure linear in $\dot\gamma$ and a zero-shear viscosity diverging at the jamming transition. The model also predicts a sharper shear thinning than other visco-elastic models at small shear rates, in qualitative agreement with experimental observations. Furthermore the shear thinning follows a critical scaling close to the jamming transition.


title: Handbook of Convergence Theorems for (Stochastic) Gradient Methods

abstract: This is a handbook of simple proofs of the convergence of gradient and stochastic gradient descent type methods. We consider functions that are Lipschitz, smooth, convex, strongly convex, and/or Polyak-{\L}ojasiewicz functions. Our focus is on ``good proofs'' that are also simple. Each section can be consulted separately. We start with proofs of gradient descent, then on stochastic variants, including minibatching and momentum. Then move on to nonsmooth problems with the subgradient method, the proximal gradient descent and their stochastic variants. Our focus is on global convergence rates and complexity rates. Some slightly less common proofs found here include that of SGD (Stochastic gradient descent) with a proximal step, with momentum, and with mini-batching without replacement.


title: Quantum exploration of high-dimensional canyon landscapes

abstract: Canyon landscapes in high dimension can be described as manifolds of small, but extensive dimension, immersed in a higher dimensional ambient space and characterized by a zero potential energy on the manifold. Here we consider the problem of a quantum particle exploring a prototype of a high-dimensional random canyon landscape. We characterize the thermal partition function and show that around the point where the classical phase space has a satisfiability transition so that zero potential energy canyons disappear, moderate quantum fluctuations have a deleterious effect and induce glassy phases at temperature where classical thermal fluctuations alone would thermalize the system. Surprisingly we show that even when, classically, diffusion is expected to be unbounded in space, the interplay between quantum fluctuations and the randomness of the canyon landscape conspire to have a confining effect.


title: The Hazards and Benefits of Condescension in Social Learning

abstract: In a misspecified social learning setting, agents are condescending if they perceive their peers as having private information that is of lower quality than it is in reality. Applying this to a standard sequential model, we show that outcomes improve when agents are mildly condescending. In contrast, too much condescension leads to worse outcomes, as does anti-condescension.


title: Regularized Approach for Bingham Viscoplastic Shallow Flow Using the Discontinuous Galerkin Method

abstract: This paper aims to simulate viscoplastic flow in a shallow-water regime. We specifically use the Bingham model in which the material behaves as a solid if the stress is below a certain threshold, otherwise, it moves as a fluid. The main difficulty of this problem is the coupling of the shallow-water equations with the viscoplastic constitutive laws and the high computational effort needed in its solution. Although there have been many studies of this problem, most of these works use explicit methods with simplified empirical models. In our work, to accommodate non-uniform grids and complicated geometries, we use the discontinuous Galerkin method to solve shallow viscoplastic flows. This method is attractive due to its high parallelization, h- and p-adaptivity, and ability to capture shocks. Additionally, we treat the discontinuities in the interfaces between elements with numerical fluxes that ensure a stable solution of the nonlinear hyperbolic equations. To couple the Bingham model with the shallow-water equations, we regularize the problem with three alternatives. Finally, in order to show the effectiveness of our approach, we perform numerical examples for the usual benchmarks of the shallow-water equations.

categories: math.NA cs.CE cs.NA physics.comp-ph physics.flu-dyn


title: Collective Vortical Motion and Vorticity Reversals of Self-Propelled Particles on Circularly Patterned Substrates

abstract: The collective behavior of self-propelled particles (SPPs) under the combined effects of a circularly patterned substrate and circular confinement is investigated through coarse-grained molecular dynamics simulations of polarized and disjoint ring polymers. The study is performed over a wide range of values of the SPPs packing fraction $\bar\phi$, motility force $F_D$, and area fraction of the patterned region. At low packing fractions, the SPPs are excluded from the system's center and exhibit a vortical motion that is dominated by the substrate at intermediate values of $F_D$. This exclusion zone is due to the coupling between the driving force and torque induced by the substrate, which induces an outward spiral motion of the SPPs. For high values of $F_D$, the SPPs exclusion from the center is dominated by the confining boundary. At high values of $\bar\phi$, the substrate pattern leads to reversals in the vorticity, which become quasi-periodic with increasing $\bar\phi$. We also found that the substrate pattern is able to separate SPPs based on their motilities.

categories: cond-mat.soft physics.bio-ph physics.chem-ph physics.comp-ph


title: Hubble Constant Measurement from Three Large-Separation Quasars Strongly Lensed by Galaxy Clusters

abstract: Tension between cosmic microwave background-based and distance ladder-based determinations of the Hubble constant ${\rm H}_{\rm 0}$ motivates pursuit of independent methods that are not subject to the same systematic effects. A promising alternative, proposed by Refsdal in 1964, relies on the inverse scaling of ${\rm H}_{\rm 0}$ with the delay between the arrival times of at least two images of a strongly-lensed variable source such as a quasar. To date, Refsdal's method has mostly been applied to quasars lensed by individual galaxies rather than by galaxy clusters. Using the three quasars strongly lensed by galaxy clusters (SDSS J1004+4112, SDSS J1029+2623, and SDSS J2222+2745) that have both multiband Hubble Space Telescope data and published time delay measurements, we derive ${\rm H}_{\rm 0}$, accounting for the systematic and statistical sources of uncertainty. While a single time delay measurement does not yield a well-constrained ${\rm H}_{\rm 0}$ value, analyzing the systems together tightens the constraint. Combining the six time delays measured in the three cluster-lensed quasars gives ${\rm H}_{\rm 0}$ = 74.1 $\pm$ 8.0 km s$^{-1}$ Mpc$^{-1}$. To reach 1$\%$ uncertainty in ${\rm H}_{\rm 0}$, we estimate that a sample size of order of 620 time delay measurements of similar quality as those from SDSS J1004+4112, SDSS J1029+2623, and SDSS J2222+2745 would be needed. Improving the lens modeling uncertainties by a factor of two and a half may reduce the needed sample size to 100 time delays, potentially reachable in the next decade.


title: On the Convergence of No-Regret Learning Dynamics in Time-Varying Games

abstract: Most of the literature on learning in games has focused on the restrictive setting where the underlying repeated game does not change over time. Much less is known about the convergence of no-regret learning algorithms in dynamic multiagent settings. In this paper, we characterize the convergence of optimistic gradient descent (OGD) in time-varying games. Our framework yields sharp convergence bounds for the equilibrium gap of OGD in zero-sum games parameterized on natural variation measures of the sequence of games, subsuming known results for static games. Furthermore, we establish improved second-order variation bounds under strong convexity-concavity, as long as each game is repeated multiple times. Our results also apply to time-varying general-sum multi-player games via a bilinear formulation of correlated equilibria, which has novel implications for meta-learning and for obtaining refined variation-dependent regret bounds, addressing questions left open in prior papers. Finally, we leverage our framework to also provide new insights on dynamic regret guarantees in static games.


title: Regular Separability in B\"{u}chi VASS

abstract: We study the ($\omega$-)regular separability problem for B\"uchi VASS languages: Given two B\"uchi VASS with languages $L_1$ and $L_2$, check whether there is a regular language that fully contains $L_1$ while remaining disjoint from $L_2$. We show that the problem is decidable in general and PSPACE-complete in the 1-dimensional case, assuming succinct counter updates. The results rely on several arguments. We characterize the set of all regular languages disjoint from $L_2$. Based on this, we derive a (sound and complete) notion of inseparability witnesses, non-regular subsets of $L_1$. Finally, we show how to symbolically represent inseparability witnesses and how to check their existence.


title: Probing Majorana wavefunctions in Kitaev honeycomb spin liquids with second-order two-dimensional spectroscopy

abstract: Two-dimensional coherent terahertz spectroscopy (2DCS) emerges as a valuable tool to probe the nature, couplings, and lifetimes of excitations in quantum materials. It thus promises to identify unique signatures of spin liquid states in quantum magnets by directly probing properties of their exotic fractionalized excitations. Here, we calculate the second-order 2DCS of the Kitaev honeycomb model and demonstrate that distinct spin liquid fingerprints appear already in this lowest-order nonlinear response $\chi^{(2)}_{yzx}(\omega_1, \omega_2)$ when using crossed light polarizations. We further relate the off-diagonal 2DCS peaks to the localized nature of the matter Majorana excitations trapped by $\mathbb{Z}_2$ flux excitations and show that 2DCS thus directly probes the inverse participation ratio of Majorana wavefunctions. By providing experimentally observable features of spin liquid states in the 2D spectrum, our work can guide future 2DCS experiments on Kitaev magnets.


title: Another Look at Partially Observed Optimal Stochastic Control: Existence, Ergodicity, and Approximations without Belief-Reduction

abstract: We present an alternative view for the study of optimal control of partially observed Markov Decision Processes (POMDPs). We first revisit the traditional (and by now standard) separated-design method of reducing the problem to fully observed MDPs (belief-MDPs), and present conditions for the existence of optimal policies. Then, rather than working with this standard method, we define a Markov chain taking values in an infinite dimensional product space with control actions and the state process causally conditionally independent given the measurement/information process. We provide new sufficient conditions for the existence of optimal control policies under the discounted cost and average cost infinite horizon criteria. In particular, while in the belief-MDP reduction of POMDPs, weak Feller condition requirement imposes total variation continuity on either the system kernel or the measurement kernel, with the approach of this paper only weak continuity of both the transition kernel and the measurement kernel is needed (and total variation continuity is not) together with regularity conditions related to filter stability. For the discounted cost setup, we establish near optimality of finite window policies via a direct argument involving near optimality of quantized approximations for MDPs under weak Feller continuity, where finite truncations of memory can be viewed as quantizations of infinite memory with a uniform diameter in each finite window restriction under the product metric. For the average cost setup, we provide new existence conditions and also a general approach on how to initialize the randomness which we show to establish convergence to optimal cost. In the control-free case, our analysis leads to new and weak conditions for the existence and uniqueness of invariant probability measures for non-linear filter processes.


title: Exponential decay of the solutions to nonlinear Schr\"odinger systems

abstract: We show that the components of finite energy solutions to general nonlinear Schr\"odinger systems have exponential decay at infinity. Our results apply to positive or sign-changing components, and to cooperative, competitive, or mixed-interaction systems. As an application, we use the exponential decay to derive an upper bound for the least possible energy of a solution with a prescribed number of positive and nonradial sign-changing components.


title: Approximations for the divergence of the local large-scale structure velocity field and its implications for Tilted Cosmology

abstract: We characterize the peculiar velocity field of the local large-scale structure reconstructed from the $2M++$ survey, by treating it as a fluid, extracting the divergence via different approximations over a range pf averaged scales. This reconstructed field is important for cosmology, since it was used to correct the peculiar redshifts of the last SNIA compilation Pantheon+. The results have intriguing implications for the LLSS fluid dynamics and particularly for the ``Tilted Cosmology'' model, although those results have to be taken carefully as the velocity field could contain significant bias due to the reconstruction procedure. Those possible bias and its influence in our results are discussed. Representative values of the apparent deceleration parameter ($\Tilde{q}$) are computed, in order to compare our results with the theoretical predictions of the tilted-universe scenario. We conclude that better velocity field reconstructions are necessary in order to constrain the parameters implied in LLSS research and alternative cosmologies.


title: The EXTRA-BL4S experiment for the measurement of the energy and angular distributions of transition radiation X-rays

abstract: We have designed and implemented an experiment to measure the angular distributions and the energy spectra of the transition radiation X-rays emitted by fast electrons and positrons crossing different radiators. Our experiment was selected among the proposals of the 2021 Beamline for Schools contest, a competition for high-school students organized every year by CERN and DESY, and was performed at the DESY II Test Beam facility area TB21, using a high-purity beam of electrons or positrons with momenta in the range from 1 to 6 GeV/c. The measurements were performed using a 100 um thick silicon pixel detector, with a pitch of 55 um. Our results are consistent with the expectations from the theoretical models describing the production of transition radiation in multilayer regular radiators.


title: Superconcentration for minimal surfaces in first passage percolation and disordered Ising ferromagnets

abstract: We consider the standard first passage percolation model on $\mathbb Z^ d$ with a distribution $G$ taking two values $0<a<b$. We study the maximal flow through the cylinder $[0,n]^ {d-1}\times [0,hn]$ between its top and bottom as well as its associated minimal surface(s). We prove that the variance of the maximal flow is superconcentrated, i.e. in $O(\frac {n^{d-1}} {\log n})$, for $h\geq h_0$ (for a large enough constant $h_0=h_0(a,b)$). Equivalently, we obtain that the ground state energy of a disordered Ising ferromagnet in a cylinder $[0,n]^ {d-1}\times [0,hn]$ is superconcentrated when opposite boundary conditions are applied at the top and bottom faces and for a large enough constant $h\geq h_0$ (which depends on the law of the coupling constants). Our proof is inspired by the proof of Benjamini--Kalai--Schramm. Yet, one major difficulty in this setting is to control the influence of the edges since the averaging trick used in the proof of Benjamini--Kalai--Schramm fails for surfaces. Of independent interest, we prove that minimal surfaces (in the present discrete setting) cannot have long thin chimneys.


title: Forward electromagnetic induction modelling in a multilayered half-space: An open-source software tool

abstract: Electromagnetic induction (EMI) techniques are widely used in geophysical surveying. Their success is mainly due to their easy and fast data acquisition, but the effectiveness of data inversion is strongly influenced by the quality of sensed data, resulting from suiting the device configuration to the physical features of the survey site. Forward modelling is an essential tool to optimize this aspect and design a successful surveying campaign. In this paper, a new software tool for forward EMI modelling is introduced. It extends and complements an existing open-source package for EMI data inversion, and includes an interactive graphical user interface. Its use is explained by a theoretical introduction and demonstrated through a simulated case study. The nonlinear data inversion issue is briefly discussed and the inversion module of the package is extended by a new regularized minimal-norm algorithm.


title: Lattice models for ballistic aggregation: cluster-shape dependent exponents

abstract: We study ballistic aggregation on a two dimensional square lattice, where particles move ballistically in between momentum and mass conserving coalescing collisions. Three models are studied based on the shapes of the aggregates: in the first the aggregates remain point particles, in the second they retain the fractal shape at the time of collision, and in the third they assume a spherical shape. The exponents describing the power law temporal decay of number of particles and energy as well as dependence of velocity correlations on mass are determined using large scale Monte Carlo simulations. It is shown that the exponents are universal only for the point particle model. In the other two cases, the exponents are dependent on the initial number density and correlations vanish at high number densities. The fractal dimension for the second model is close to 1.49.


title: Light-Weight Pointcloud Representation with Sparse Gaussian Process

abstract: This paper presents a framework to represent high-fidelity pointcloud sensor observations for efficient communication and storage. The proposed approach exploits Sparse Gaussian Process to encode pointcloud into a compact form. Our approach represents both the free space and the occupied space using only one model (one 2D Sparse Gaussian Process) instead of the existing two-model framework (two 3D Gaussian Mixture Models). We achieve this by proposing a variance-based sampling technique that effectively discriminates between the free and occupied space. The new representation requires less memory footprint and can be transmitted across limitedbandwidth communication channels. The framework is extensively evaluated in simulation and it is also demonstrated using a real mobile robot equipped with a 3D LiDAR. Our method results in a 70 to 100 times reduction in the communication rate compared to sending the raw pointcloud.


title: Ontology-based Solution for Building an Intelligent Searching System on Traffic Law Documents

abstract: In this paper, an ontology-based approach is used to organize the knowledge base of legal documents in road traffic law. This knowledge model is built by the improvement of ontology Rela-model. In addition, several searching problems on traffic law are proposed and solved based on the legal knowledge base. The intelligent search system on Vietnam road traffic law is constructed by applying the method. The searching system can help users to find concepts and definitions in road traffic law. Moreover, it can also determine penalties and fines for violations in the traffic. The experiment results show that the system is efficient for users' typical searching and is emerging for usage in the real-world.


title: Photo- and electro-production of narrow exotic states: from light quarks to charm and up to bottom

abstract: Accessing a full image of the inner content of hadrons represents a central endeavour of modern particle physics, with the main scientific motivation to investigate the strong interaction binding the visible matter. On the one hand, the structure of known exotic candidates is a fundamental open issue addressed widely by scientists. On the other hand, looking for new states of exotic nature is a central component for theoretical and experimental efforts from electron-positron machine and electron accelerator with fixed target to heavy ion and electron-ion colliders. In this article we present a succinct short overview of the attempt to search for exotic narrow $N^*$ and $Z$ states containing light quarks only or also charm, and its connotation for bottom regions (the latter two are also known as $P_c$ ($Z_c$) and $P_b$ ($Z_b$) states, respectively in {the literature}). We address the effort of searching for exotic narrow $N^*$ and $Z$ states in light quark sector. We focus on recent progress in searching for signal of $P_c$ and $Z_c$ states photoproduction and its implication into the $P_b$ and $Z_b$ photoproduction and their decay properties. We also discuss future perspectives for the field in electron-ion colliders, a good place to disentangle the nature of some of these states and investigate some other enlightening topics including QCD trace anomaly and quarkonium-nucleon scattering length.


title: Femtosecond Laser Engraved 2D Tunable Optofluidic Liquid Core/Air Cladding Channel Waveguides on PDMS

abstract: We have demonstrated the fabrication and characterization of 2D liquid-based multimode optical waveguide structures over a Polydimethylsiloxane (PDMS) material-based chip. Fabrication of two separate microstructures, one with a width of 14 microns and a depth of 27 microns while the other with a width as well as depth of 110 microns, was achieved by the femtosecond laser micromachining process. The dye solution is passed through the microstructure from one end to the other; wherein the dye solution acts as the core while PDMS and air act as the cladding medium. The femtosecond laser micromachining parameters are optimized in terms of laser power, pulse width, writing speed, focused beam size, etc. The quality of fabricated microstructures is confirmed by microscopic analysis. The confirmation of liquid-core/air cladding-based waveguide is obtained through spectral and modal analysis. The optical analysis has been done by using fluorescence light coupled out from waveguide structures filled with different dye solutions. These waveguide structures give strong light confinement and intense interaction between dye solution and pump light. The developed microstructures are tunable in terms of intensity, wavelength, and beam size. Such microstructures can be implemented in the design and development of lab-on-chip microlasers and sensing applications in any multifunction lab-on-chip devices.


title: Periodicity of joint co-tiles in $\mathbb{Z}^d$

abstract: An old theorem of Newman asserts that any tiling of $\mathbb{Z}$ by a finite set is periodic. Few years ago Bhattacharya proved the periodic tiling conjecture in $\mathbb{Z}^2$. Namely, he proved that for a finite subset $F$ of $\mathbb{Z}^2$, if there exists $A \subseteq \mathbb{Z}^d$ such that $F \oplus A = \mathbb{Z}^d$ then there exists a periodic $A' \subseteq \mathbb{Z}^d$ such that $F \oplus A' = \mathbb{Z}^d$. The recent refutation of the periodic tiling conjecture in high dimensions due to Greenfeld and Tao motivates finding different generalizations of Newman's theorem and of Bhattacharya's theorem that hold in arbitrary dimension $d$. In this paper, we formulate and prove such generalizations. We do so by studying the structure of joint co-tiles in $\mathbb{Z}^d$. Our generalization of Newman's theorem states that for any $d \ge 1$, any joint co-tile for $d$ independent tiles is periodic. For a $(d-1)$-tuple of finite subsets of $\mathbb{Z}^d$ that satisfy a certain technical condition that we call property $(\star)$, we prove that any joint co-tile decomposes into disjoint $(d-1)$-periodic sets. Consequently, we show that for a $(d-1)$-tuple of finite subsets of $\mathbb{Z}^d$ that satisfy property $(\star)$, the existence of a joint co-tile implies the existence of periodic joint co-tile. Conversely, we prove that if a finite subset $F$ in $\mathbb{Z}^d$ admits a periodic co-tile $A$, then there exist $(d-1)$ additional tiles that together with $F$ are independent and admit $A$ as a joint co-tile, and $(d-2)$ additional tiles that together with $F$ satisfy the property $(\star)$. Combined, our results give a new necessary and sufficient condition for a subset of $\mathbb{Z}^d$ to tile periodically. We also discuss tilings and joint tilings in other countable abelian groups.


title: Multi-compartment poroelastic models of perfused biological soft tissues: implementation in FEniCSx

abstract: Soft biological tissues demonstrate strong time-dependent and strain-rate mechanical behavior, arising from their intrinsic visco-elasticity and fluid-solid interactions (especially at sufficiently large time scales). The time-dependent mechanical properties of soft tissues influence their physiological functions and are linked to several pathological processes. Poro-elastic modeling represents a promising approach because it allows the integration of multiscale/multiphysics data to probe biologically relevant phenomena at a smaller scale and embeds the relevant mechanisms at the larger scale. The implementation of multi-phasic flow poro-elastic models however is a complex undertaking, requiring extensive knowledge. The open-source software FEniCSx Project provides a novel tool for the automated solution of partial differential equations by the finite element method. This paper aims to provide the required tools to model the mixed formulation of poro-elasticity, from the theory to the implementation, within FEniCSx. Several benchmark cases are studied. A column under confined compression conditions is compared to the Terzaghi analytical solution, using the L2-norm. An implementation of poro-hyper-elasticity is proposed. A bi-compartment column is compared to previously published results (Cast3m implementation). For all cases, accurate results are obtained in terms of a normalized Root Mean Square Error (RMSE). Furthermore, the FEniCSx computation is found three times faster than the legacy FEniCS one. The benefits of parallel computation are also highlighted.


title: A Benchmark Study by using various Machine Learning Models for Predicting Covid-19 trends

abstract: Machine learning and deep learning play vital roles in predicting diseases in the medical field. Machine learning algorithms are widely classified as supervised, unsupervised, and reinforcement learning. This paper contains a detailed description of our experimental research work in that we used a supervised machine-learning algorithm to build our model for outbreaks of the novel Coronavirus that has spread over the whole world and caused many deaths, which is one of the most disastrous Pandemics in the history of the world. The people suffered physically and economically to survive in this lockdown. This work aims to understand better how machine learning, ensemble, and deep learning models work and are implemented in the real dataset. In our work, we are going to analyze the current trend or pattern of the coronavirus and then predict the further future of the covid-19 confirmed cases or new cases by training the past Covid-19 dataset by using the machine learning algorithm such as Linear Regression, Polynomial Regression, K-nearest neighbor, Decision Tree, Support Vector Machine and Random forest algorithm are used to train the model. The decision tree and the Random Forest algorithm perform better than SVR in this work. The performance of SVR and lasso regression are low in all prediction areas Because the SVR is challenging to separate the data using the hyperplane for this type of problem. So SVR mostly gives a lower performance in this problem. Ensemble (Voting, Bagging, and Stacking) and deep learning models(ANN) also predict well. After the prediction, we evaluated the model using MAE, MSE, RMSE, and MAPE. This work aims to find the trend/pattern of the covid-19.


title: Quantum Test of the Local Position Invariance with Internal Clock Interferometry

abstract: Current attempts to test local position invariance (LPI) compare different clock transition rates with classically exchanged signals. We propose an experimental scheme for the quantum test of LPI: an internal atomic clock interferometer comprising two interfering clocks within one atom. We prepare the atom in a superposition of two clock states and one ground state, which evolves coherently along two quantum clock oscillations into stable internal Ramsey interference patterns. The interference pattern with the shared ground state shows a visibility modulation, which can be interpreted as the beating of the individual clock oscillations and a direct consequence of complementarity. Upon the interferometer experiencing a different gravitational potential, LPI predicts that both clock tick rates will change proportionally, while quantum complementarity indicates that the visibility modulation should modify accordingly. This change is deemed insignificant for the first period of visibility modulation but can be stacked up until the limit of the system coherence time. Since no splitting or recombining is involved, the system coherence time can be as long as the trap lifetime or the clock state lifetime. The required resolution to observe the visibility modulation is within reach of the state-of-art optical clocks' sensitivities. This experimental scheme is feasible in different scenarios, still or with speed, and may shed new light on studying the quantum effect of time and general relativity.


title: Domain-Agnostic Molecular Generation with Chemical Feedback

abstract: The generation of molecules with desired properties has become increasingly popular, revolutionizing the way scientists design molecular structures and providing valuable support for chemical and drug design. However, despite the potential of language models in molecule generation, they face challenges such as generating syntactically or chemically flawed molecules, having narrow domain focus, and struggling to create diverse and feasible molecules due to limited annotated data or external molecular databases. To tackle these challenges, we introduce MolGen, a pre-trained molecular language model tailored specifically for molecule generation. Through the reconstruction of over 100 million molecular SELFIES, MolGen internalizes structural and grammatical insights. This is further enhanced by domain-agnostic molecular prefix tuning, fostering robust knowledge transfer across diverse domains. Importantly, our chemical feedback paradigm steers the model away from molecular hallucinations, ensuring alignment between the model's estimated probabilities and real-world chemical preferences. Extensive experiments on well-known benchmarks underscore MolGen's optimization capabilities in properties such as penalized logP, QED, and molecular docking. Additional analyses confirm its proficiency in accurately capturing molecule distributions, discerning intricate structural patterns, and efficiently exploring the chemical space. Code is available at https://github.com/zjunlp/MolGen.


title: Maximum Optimality Margin: A Unified Approach for Contextual Linear Programming and Inverse Linear Programming

abstract: In this paper, we study the predict-then-optimize problem where the output of a machine learning prediction task is used as the input of some downstream optimization problem, say, the objective coefficient vector of a linear program. The problem is also known as predictive analytics or contextual linear programming. The existing approaches largely suffer from either (i) optimization intractability (a non-convex objective function)/statistical inefficiency (a suboptimal generalization bound) or (ii) requiring strong condition(s) such as no constraint or loss calibration. We develop a new approach to the problem called \textit{maximum optimality margin} which designs the machine learning loss function by the optimality condition of the downstream optimization. The max-margin formulation enjoys both computational efficiency and good theoretical properties for the learning procedure. More importantly, our new approach only needs the observations of the optimal solution in the training data rather than the objective function, which makes it a new and natural approach to the inverse linear programming problem under both contextual and context-free settings; we also analyze the proposed method under both offline and online settings, and demonstrate its performance using numerical experiments.


title: Planar and Nematic Aerogels: DLCA and Superfluid 3He

abstract: We perform cluster aggregation simulations to model the structure of anisotropic aerogel. By biasing the diffusion process, we are able to obtain two distinct types of globally anisotropic aerogel structures which we call "nematic", with long strands along the anisotropy axis, and "planar", with long strands in planes perpendicular to the anisotropy axis. We calculate the auto-correlation function, the structure factor, and the angular dependence of the free-path distribution for these samples. The calculated structure factor from simulated aerogels can be compared with data from small-angle X-ray scattering (SAXS) of lab-grown aerogel allowing us to classify the spatial structure of the lab-grown samples. We find that the simulated "nematic" aerogel has a structure factor consistent with lab-grown, axially-compressed silica aerogel while the simulated "planar" aerogel has a structure factor consistent with lab-grown "stretched" silica aerogel. Unexpectedly, compressing previously isotropic silica aerogel leads to the formation of long strands along the compression axis while stretching silica aerogel leads to formation of planes perpendicular to the stretching axis. We discuss the implication of this determination on experiments of superfluid $^3$He in anisotropic aerogel, in particular the orbital analog of the spin-flop transition.


title: Better than DFA? A Bayesian Method for Estimating the Hurst Exponent in Behavioral Sciences

abstract: Detrended Fluctuation Analysis (DFA) is the most popular fractal analytical technique used to evaluate the strength of long-range correlations in empirical time series in terms of the Hurst exponent, $H$. Specifically, DFA quantifies the linear regression slope in log-log coordinates representing the relationship between the time series' variability and the number of timescales over which this variability is computed. We compared the performance of two methods of fractal analysis -- the current gold standard, DFA, and a Bayesian method that is not currently well-known in behavioral sciences: the Hurst-Kolmogorov (HK) method -- in estimating the Hurst exponent of synthetic and empirical time series. Simulations demonstrate that the HK method consistently outperforms DFA in three important ways. The HK method: (i) accurately assesses long-range correlations when the measurement time series is short, (ii) shows minimal dispersion about the central tendency, and (iii) yields a point estimate that does not depend on the length of the measurement time series or its underlying Hurst exponent. Comparing the two methods using empirical time series from multiple settings further supports these findings. We conclude that applying DFA to synthetic time series and empirical time series during brief trials is unreliable and encourage the systematic application of the HK method to assess the Hurst exponent of empirical time series in behavioral sciences.


title: Sharp fractional Hardy inequalities with a remainder for $1<p<2$

abstract: The main purpose of this article is to obtain (weighted) fractional Hardy inequalities with a remainder and fractional Hardy-Sobolev-Maz'ya inequalities valid for $1<p<2$.


title: Spectroscopy of CASSOWARY gravitationally-lensed galaxies in SDSS: characterisation of an extremely bright reionization-era analog at $z=1.42$

abstract: We present new observations of sixteen bright ($r=19-21$) gravitationally lensed galaxies at $z\simeq 1-3$ selected from the CASSOWARY survey. Included in our sample is the $z=1.42$ galaxy CSWA-141, one of the brightest known reionization-era analogs at high redshift (g=20.5), with a large sSFR (31.2 Gyr$^{-1}$) and an [OIII]+H$\beta$ equivalent width (EW$_{\rm{[OIII]+H\beta}}$=730~\r{A}) that is nearly identical to the average value expected at $z\simeq 7-8$. In this paper, we investigate the rest-frame UV nebular line emission in our sample with the goal of understanding the factors that regulate strong CIII] emission. Whereas most of the sources in our sample show weak UV line emission, we find elevated CIII] in the spectrum of CSWA-141 (EW$_{\rm{CIII]}}$=4.6$\pm1.9$~\r{A}) together with detections of other prominent emission lines (OIII], Si III], Fe II$^\star$, Mg II). We compare the rest-optical line properties of high redshift galaxies with strong and weak CIII] emission, and find that systems with the strongest UV line emission tend to have young stellar populations and nebular gas that is moderately metal-poor and highly ionized, consistent with trends seen at low and high redshift. The brightness of CSWA-141 enables detailed investigation of the extreme emission line galaxies which become common at $z>6$. We find that gas traced by the CIII] doublet likely probes higher densities than that traced by [OII] and [SII]. Characterisation of the spectrally resolved Mg II emission line and several low ionization absorption lines suggests neutral gas around the young stars is likely optically thin, potentially facilitating the escape of ionizing radiation.


title: Quantum and quantum-inspired optimization for solving the minimum bin packing problem

abstract: Quantum computing devices are believed to be powerful in solving hard computational tasks, in particular, combinatorial optimization problems. In the present work, we consider a particular type of the minimum bin packing problem, which can be used for solving the problem of filling spent nuclear fuel in deep-repository canisters that is relevant for atomic energy industry. We first redefine the aforementioned problem it in terms of quadratic unconstrained binary optimization. Such a representation is natively compatible with existing quantum annealing devices as well as quantum-inspired algorithms. We then present the results of the numerical comparison of quantum and quantum-inspired methods. Results of our study indicate on the possibility to solve industry-relevant problems of atomic energy industry using quantum and quantum-inspired optimization.


title: Production and measurement of stellar neutron spectrum at 30 keV

abstract: In the present experiment we measure the forward-emitted angle-integrated neutron spectrum of the 7Li(p,n)7Be reaction via time-of-flight neutron spectrometry. The proton beam is shaped to a Gaussian-like distribution with energies close to the reaction threshold upstream the thick lithium target. The angle-integrated neutron spectrum resembles a Maxwellian or stellar neutron spectrum at kT=30 keV.


title: Online Convex Optimization with Stochastic Constraints: Zero Constraint Violation and Bandit Feedback

abstract: This paper studies online convex optimization with stochastic constraints. We propose a variant of the drift-plus-penalty algorithm that guarantees $O(\sqrt{T})$ expected regret and zero constraint violation, after a fixed number of iterations, which improves the vanilla drift-plus-penalty method with $O(\sqrt{T})$ constraint violation. Our algorithm is oblivious to the length of the time horizon $T$, in contrast to the vanilla drift-plus-penalty method. This is based on our novel drift lemma that provides time-varying bounds on the virtual queue drift and, as a result, leads to time-varying bounds on the expected virtual queue length. Moreover, we extend our framework to stochastic-constrained online convex optimization under two-point bandit feedback. We show that by adapting our algorithmic framework to the bandit feedback setting, we may still achieve $O(\sqrt{T})$ expected regret and zero constraint violation, improving upon the previous work for the case of identical constraint functions. Numerical results demonstrate our theoretical results.


title: Fast Approximation of Polynomial Zeros and Matrix Eigenvalues

abstract: We approximate the d complex zeros of a univariate polynomial p(x) of a degree d or those zeros that lie in a fixed region of interest on the complex plane such as a disc or a square. Our divide and conquer algorithm of STOC 1995 supports solution of this problem in optimal Boolean time (up to a poly-logarithmic factor), that is, runs nearly as fast as one can access the coefficients of p with the precision necessary to support required accuracy of the output. That record complexity has not been matched by any other algorithm yet, but our root-finder of 1995 is quite involved and has never been implemented. We present alternative nearly optimal root-finders based on our novel variants of the classical subdivision iterations. Unlike our predecessor of 1995, we require randomization of Las Vegas type, allowing us to detect any output error at a dominated computational cost, but our new root-finders are much simpler to implement than their predecessor of 1995. According to the results of extensive test with standard test polynomials for their preliminary version, which incorporates only a part of our novel techniques, the new root-finders compete and for a large class of inputs significantly supersedes the package of root-finding subroutines MPSolve, which for decades has been user's choice package. Unlike our predecessor of 1995 and all known fast algorithms for the cited tasks of polynomial root-finding, our new algorithms can be also applied to a polynomial given by a black box oracle for its evaluation rather than by its coefficients. This makes our root-finders particularly efficient for polynomials p(x) that can be evaluated fast such as the Mandelbrot polynomials or those given by the sum of a small number of shifted monomials. Our algorithm can be readily extended to fast approximation of the eigenvalues of a matrix or a matrix polynomial.


title: On Low-Rank Convex-Convex Quadratic Fractional Programming

abstract: We present an efficient algorithm for solving fractional programming problems whose objective functions are the ratio of a low-rank quadratic to a positive definite quadratic with convex constraints. The proposed algorithm for these convex-convex problems is based on the Shen-Yu Quadratic Transform which finds stationary points of concave-convex sum-of-ratios problems. We further use elements of the algorithm proposed in [arXiv:1802.10192] and the classic Dinkelbach approach to ensure convergence. We show that our algorithm performs better than previous algorithms for low-rank problems.


title: Principled Reinforcement Learning with Human Feedback from Pairwise or $K$-wise Comparisons

abstract: We provide a theoretical framework for Reinforcement Learning with Human Feedback (RLHF). Our analysis shows that when the true reward function is linear, the widely used maximum likelihood estimator (MLE) converges under both the Bradley-Terry-Luce (BTL) model and the Plackett-Luce (PL) model. However, we show that when training a policy based on the learned reward model, MLE fails while a pessimistic MLE provides policies with improved performance under certain coverage assumptions. Additionally, we demonstrate that under the PL model, the true MLE and an alternative MLE that splits the $K$-wise comparison into pairwise comparisons both converge. Moreover, the true MLE is asymptotically more efficient. Our results validate the empirical success of existing RLHF algorithms in InstructGPT and provide new insights for algorithm design. Furthermore, our results unify the problem of RLHF and max-entropy Inverse Reinforcement Learning (IRL), and provide the first sample complexity bound for max-entropy IRL.

categories: cs.LG cs.AI cs.HC math.ST stat.ML stat.TH


title: A "network of networks" (from history to algebra)

abstract: Recall first the algebraic treatment of flows or tensions in a transportation network $N$, i.e. a connected antisymmetric 1-graph $G(X, U)$. Assume that, unusually, we take the values of flows (resp. tensions) in $\mathbb{C}$. So the algebraic lattices $\Gamma$ of flow (resp. tension) values associated to $G(X, U)$ are lattices of $\mathbb{C}$. These lattices are congruent modulo the action of the special linear group SL($2, \mathbb{C}$). Then, it is well known one can define a lattice function $G_{k}(\Gamma)$, as a modular function of weight $2k$, on the set $\mathcal{R}$ of all lattices of $\mathbb{C}$. Let now $N_{1}, N_{2}, ..., N_{p}$ be connected antisymmetric 1-graphs and $C_{n}$, the set of hermitian symmetric matrices $n \times n$. Let also $\mathcal{R'} $ be the set of all the lattices of $C_{n}$. The previous structure can be transposed to any $ n \times n $ symmetric hermitian matrices of flow (or tension) values of the $G_{i}$. In this case, the Siegel space $S_{n}= C_{n}$ replaces the Poincar\'{e} half-plane, and the symplectic group Sp$(2n, \mathbb{R})$ takes the place of the special linear group SL($2, \mathbb{C}$). We get now the new lattice function as a function of all the lattices of $S_{n}$, i.e. a model of the "network of networks" $\mathcal{R'}$. In the end, we study the tree of minimal length of $\mathcal{R'}$.


title: Location-based Activity Behavior Deviation Detection for Nursing Home using IoT Devices

abstract: With the advancement of the Internet of Things(IoT) and pervasive computing applications, it provides a better opportunity to understand the behavior of the aging population. However, in a nursing home scenario, common sensors and techniques used to track an elderly living alone are not suitable. In this paper, we design a location-based tracking system for a four-story nursing home - The Salvation Army, Peacehaven Nursing Home in Singapore. The main challenge here is to identify the group activity among the nursing home's residents and to detect if they have any deviated activity behavior. We propose a location-based deviated activity behavior detection system to detect deviated activity behavior by leveraging data fusion technique. In order to compute the features for data fusion, an adaptive method is applied for extracting the group and individual activity time and generate daily hybrid norm for each of the residents. Next, deviated activity behavior detection is executed by considering the difference between daily norm patterns and daily input data for each resident. Lastly, the deviated activity behavior among the residents are classified using a rule-based classification approach. Through the implementation, there are 44.4% of the residents do not have deviated activity behavior , while 37% residents involved in one deviated activity behavior and 18.6% residents have two or more deviated activity behaviors.


title: AlignGraph: A Group of Generative Models for Graphs

abstract: It is challenging for generative models to learn a distribution over graphs because of the lack of permutation invariance: nodes may be ordered arbitrarily across graphs, and standard graph alignment is combinatorial and notoriously expensive. We propose AlignGraph, a group of generative models that combine fast and efficient graph alignment methods with a family of deep generative models that are invariant to node permutations. Our experiments demonstrate that our framework successfully learns graph distributions, outperforming competitors by 25% -560% in relevant performance scores.


title: Self-Supervised RGB-T Tracking with Cross-Input Consistency

abstract: In this paper, we propose a self-supervised RGB-T tracking method. Different from existing deep RGB-T trackers that use a large number of annotated RGB-T image pairs for training, our RGB-T tracker is trained using unlabeled RGB-T video pairs in a self-supervised manner. We propose a novel cross-input consistency-based self-supervised training strategy based on the idea that tracking can be performed using different inputs. Specifically, we construct two distinct inputs using unlabeled RGB-T video pairs. We then track objects using these two inputs to generate results, based on which we construct our cross-input consistency loss. Meanwhile, we propose a reweighting strategy to make our loss function robust to low-quality training samples. We build our tracker on a Siamese correlation filter network. To the best of our knowledge, our tracker is the first self-supervised RGB-T tracker. Extensive experiments on two public RGB-T tracking benchmarks demonstrate that the proposed training strategy is effective. Remarkably, despite training only with a corpus of unlabeled RGB-T video pairs, our tracker outperforms seven supervised RGB-T trackers on the GTOT dataset.


title: A Review of Scene Representations for Robot Manipulators

abstract: For a robot to act intelligently, it needs to sense the world around it. Increasingly, robots build an internal representation of the world from sensor readings. This representation can then be used to inform downstream tasks, such as manipulation, collision avoidance, or human interaction. In practice, scene representations vary widely depending on the type of robot, the sensing modality, and the task that the robot is designed to do. This review provides an overview of the scene representations used for robot manipulators (robot arms). We focus primarily on representations which are built from real world sensing and are used to inform some downstream robotics task.


title: BayesSpeech: A Bayesian Transformer Network for Automatic Speech Recognition

abstract: Recent developments using End-to-End Deep Learning models have been shown to have near or better performance than state of the art Recurrent Neural Networks (RNNs) on Automatic Speech Recognition tasks. These models tend to be lighter weight and require less training time than traditional RNN-based approaches. However, these models take frequentist approach to weight training. In theory, network weights are drawn from a latent, intractable probability distribution. We introduce BayesSpeech for end-to-end Automatic Speech Recognition. BayesSpeech is a Bayesian Transformer Network where these intractable posteriors are learned through variational inference and the local reparameterization trick without recurrence. We show how the introduction of variance in the weights leads to faster training time and near state-of-the-art performance on LibriSpeech-960.


title: Room-temperature spin glass behavior in zinc ferrite epitaxial thin films

abstract: Zinc ferrite (ZnFe$_{\text{2}}$O$_{\text{4}}$) epitaxial thin films were grown by reactive magnetron sputtering on MgAl$_{\text{2}}$O$_{\text{4}}$ and Al$_{\text{2}}$O$_{\text{3}}$ substrates varying a range of preparation parameters. The resulting structural and magnetic properties were investigated using a range of experimental techniques confirming epitaxial growth of ZnFe$_{\text{2}}$O$_{\text{4}}$ with the nominal stoichiometric composition and long range magnetic order at and above room temperature. The main preparation parameter influencing the temperature $T_{\text{f}}$ of the bifurcation between $M(T)$ curves under field cooled and zero-field cooled conditions was found to be the growth rate of the films, while growth temperature or the Ar:O$_2$ ratio did not systematically influence $T_{\text{f}}$. Furthermore $T_{\text{f}}$ was found to be systematically higher for MgAl$_{\text{2}}$O$_{\text{4}}$ as substrate and $T_{\text{f}}$ extends to above room temperature. While in some samples $T_{\text{f}}$ seems to be more likely correlated with superparamagentism, the highest $T_{\text{f}}$ occurs in ZnFe$_{\text{2}}$O$_{\text{4}}$ epitaxial films where experimental signatures of magnetic glassiness can be found. Element-selective X-ray magnetic circular dichroism measurements aim at associating the magnetic glassiness with the occurrence of a different valence state and lattice site incorporation of Fe pointing to a complex interplay of various competing magnetic interactions in ZnFe$_{\text{2}}$O$_{\text{4}}$.


title: Commissioning, Performance, and Effect of the Quench Current-boosting Device on a Dedicated Superconducting Magnet

abstract: Superconducting magnet training is one of the accelerator related issues attracting attention due to significant operational costs and time budget associated to it. It is especially worrisome that magnets based on the next-generation Nb3Sn technology are affected by long training. While various efforts are underway to better understand and resolve the problem a parallel path could also be investigated, a path bypassing the issue. Following the concept of fast induced over-current during magnet powering, FNAL has developed an upgradable capacitor-based device to discharge through a superconducting magnet at quench detection or operator chosen time. The 0.4 F/1 kV device has been tested on a 1-m-long dipole-coil in a mirror magnet configuration and conclusive results on magnet training elimination have been observed. In this paper we discuss the main characteristics of the device, compare simulated response and actual performance, elaborate on test drivers and outcomes. Next steps and perspectives for future use are debated.


title: Gaussian process regression and conditional Karhunen-Lo\'{e}ve models for data assimilation in inverse problems

abstract: We present a model inversion algorithm, CKLEMAP, for data assimilation and parameter estimation in partial differential equation models of physical systems with spatially heterogeneous parameter fields. These fields are approximated using low-dimensional conditional Karhunen-Lo\'{e}ve expansions, which are constructed using Gaussian process regression models of these fields trained on the parameters' measurements. We then assimilate measurements of the state of the system and compute the maximum a posteriori estimate of the CKLE coefficients by solving a nonlinear least-squares problem. When solving this optimization problem, we efficiently compute the Jacobian of the vector objective by exploiting the sparsity structure of the linear system of equations associated with the forward solution of the physics problem. The CKLEMAP method provides better scalability compared to the standard MAP method. In the MAP method, the number of unknowns to be estimated is equal to the number of elements in the numerical forward model. On the other hand, in CKLEMAP, the number of unknowns (CKLE coefficients) is controlled by the smoothness of the parameter field and the number of measurements, and is in general much smaller than the number of discretization nodes, which leads to a significant reduction of computational cost with respect to the standard MAP method. To show its advantage in scalability, we apply CKLEMAP to estimate the transmissivity field in a two-dimensional steady-state subsurface flow model of the Hanford Site by assimilating synthetic measurements of transmissivity and hydraulic head. We find that the execution time of CKLEMAP scales nearly linearly as $N^{1.33}$, where $N$ is the number of discretization nodes, while the execution time of standard MAP scales as $N^{2.91}$. The CKLEMAP method improved execution time without sacrificing accuracy when compared to the standard MAP.

categories: cs.LG math.AP physics.flu-dyn physics.geo-ph


title: Text-To-4D Dynamic Scene Generation

abstract: We present MAV3D (Make-A-Video3D), a method for generating three-dimensional dynamic scenes from text descriptions. Our approach uses a 4D dynamic Neural Radiance Field (NeRF), which is optimized for scene appearance, density, and motion consistency by querying a Text-to-Video (T2V) diffusion-based model. The dynamic video output generated from the provided text can be viewed from any camera location and angle, and can be composited into any 3D environment. MAV3D does not require any 3D or 4D data and the T2V model is trained only on Text-Image pairs and unlabeled videos. We demonstrate the effectiveness of our approach using comprehensive quantitative and qualitative experiments and show an improvement over previously established internal baselines. To the best of our knowledge, our method is the first to generate 3D dynamic scenes given a text description.


title: Quantifying Hidden Symmetry in the Tetragonal CH$_3$NH$_3$PbI$_3$ Perovskite

abstract: The assignment of an exact space group to the tetragonal CH$_3$NH$_3$PbI$_3$ perovskite structure is experimentally challenging and controversial in the literature. Average orientation of the methylammonium ion that gives symmetry to the experimental measurement is not captured in a static density functional theory calculation, although the quasi-I4cm and quasi-I4/mcm structures are commonly used in calculations. In this work we have developed a methodology to quantify the hidden symmetry of these structures using group theory, to enable use of symmetries in understanding spectroscopy and other properties. We study the approximate symmetry of vibrational modes, including analysis of degenerate representations, as well as the dielectric, elastic, electro-optic, Born effective charge, and Raman tensors and the dynamical matrix. Comparing to each subgroup of the full tetragonal D$_{4h}$, our results show that the quasi-I4cm is best described by the expected corresponding point group C$_{4v}$, whereas the quasi-I4/mcm (despite corresponding to point group D$_{4h}$) is best described by the lower symmetry C$_{2v}$. Our methodology can be useful generally for analysis of other soft hybrid materials or any approximately symmetric material.


title: High Speed Focal Plane Wavefront Sensing with an Optical Chopper

abstract: Focal plane wavefront sensing and control is a critical approach to reducing non-common path errors between the a conventional astronomical adaptive optics (AO) wavefront sensor (WFS) detector and science camera. However, in addition to mitigating non-common path errors, recent focal plane wavefront sensing techniques have been developed to operate at speeds fast enough to enable "multi-WFS" AO, where residual atmospheric errors are further corrected by a focal plane WFS. Although a number of such techniques have been recently developed for coronagraphic imaging, here we present one designed for non-coronagraphic imaging. Utilizing conventional AO system components, this concept additionally requires (1) a detector imaging the focal plane of the WFS light source and (2) a pupil plane optical chopper device that is non-common path to the first WFS and is synchronized to the focal plane imager readout. These minimal hardware requirements enable the temporal amplitude modulation to resolve the sine ambiguity of even wavefront modes for both low, mid, and high wavefront spatial frequencies. Similar capabilities have been demonstrated with classical phase diversity by defocusing the detector, but such techniques are incompatible with simultaneous science observations. This optical chopping technique, however, enables science imaging at up to a 50% duty cycle. We present both simulations and laboratory validation of this concept on SEAL, the Santa Cruz Extreme AO Laboratory testbed.


title: Real-Time Digital Twins: Vision and Research Directions for 6G and Beyond

abstract: This article presents a vision where \textit{real-time} digital twins of the physical wireless environments are continuously updated using multi-modal sensing data from the distributed infrastructure and user devices, and are used to make communication and sensing decisions. This vision is mainly enabled by the advances in precise 3D maps, multi-modal sensing, ray-tracing computations, and machine/deep learning. This article details this vision, explains the different approaches for constructing and utilizing these real-time digital twins, discusses the applications and open problems, and presents a research platform that can be used to investigate various digital twin research directions.


title: BillionCOV: An Enriched Billion-scale Collection of COVID-19 tweets for Efficient Hydration

abstract: The COVID-19 pandemic introduced new norms such as social distancing, face masks, quarantine, lockdowns, travel restrictions, work/study from home, and business closures, to name a few. The pandemic's seriousness made people vocal on social media, especially on microblogs such as Twitter. Researchers have been collecting and sharing large-scale datasets of COVID-19 tweets since the early days of the outbreak. Sharing raw Twitter data with third parties is restricted; users need to hydrate tweet identifiers in a public dataset to re-create the dataset locally. Large-scale datasets that include original tweets, retweets, quotes, and replies have tweets in billions which takes months to hydrate. The existing datasets carry issues related to proportion and redundancy. We report that more than 500 million tweet identifiers point to deleted or protected tweets. In order to address these issues, this paper introduces an enriched global billion-scale English-language COVID-19 tweets dataset, BillionCOV, that contains 1.4 billion tweets originating from 240 countries and territories between October 2019 and April 2022. Importantly, BillionCOV facilitates researchers to filter tweet identifiers for efficient hydration. This paper discusses associated methods to fetch raw Twitter data for a set of tweet identifiers, presents multiple tweets' distributions to provide an overview of BillionCOV, and finally, reviews the dataset's potential use cases.


title: Reformulation of Special Relativity and Electromagnetism in terms of Reference Frames defined as maps from spacetime onto affine spaces

abstract: A reference frame on a set $M$ is given by a 3-dimensional euclidean space $E$, a function from $M$ to $E$, a 1-dimensional affine space $A$ and a function from $M$ to $A$. The definition allows an intuitive and coordinate-free formulation of Newtonian mechanics, special relativity and electromagnetism in terms of frames instead of coordinates. In particular, the postulate of a set of charts on $M$ (an atlas) is replaced by the postulate of a set of frames. Then the charts can be re-obtained through the choice of affine coordinates. In addition, units enter the theory as elements of positive spaces and we obtain a geometric and manifestly unit-independent reformulation. Each frame allows us to identify spacetime with a 4-dimensional product-space and we can generalize the definition of differentiable manifolds such that the frames turn out to form an atlas. Then the only difference between Newtonian mechanics and special relativity is the assumed type of transition functions - Galilean transformations or Poincar\'e transformations between affine spaces. This allows us to highlight the common features and differences in the second chapter of the paper. For example, we define velocity reciprocity in mathematical terms and prove the phenomenon for both kind of transformations. The chapter concludes with a discussion of inertial and accelerated frames. In the third chapter we restrict our attention to the reformulation of special relativity and electromagnetism with a strong emphasis on covariance. World lines are introduced as particular subsets of spacetime, the proper time of world line is defined as an affine structure on the world line and the reformulation of electromagnetism is based on the representation of differential forms w.r.t. a frame.


title: Chemical Power for Swarms of Microscopic Robots in Blood Vessels

abstract: Microscopic robots in the bloodstream could obtain power from fuel cells using glucose and oxygen. Previous studies of small numbers of such robots operating near each other showed how robots compete with their neighbors for oxygen. However, proposed applications involve billions of such robots operating throughout the body. With such large numbers, the robots can have systemic effects on oxygen concentration. This paper evaluates these effects and their consequences for robot power generation, oxygen available to tissue and heating as such robots move with the blood. When robots consume oxygen as fast as it diffuses to their surfaces, available power decreases significantly as robots move from the lungs, through arteries to capillaries and veins. Tens of billions of robots can obtain hundreds of picowatts throughout the circuit, while a trillion robots significantly deplete oxygen in the veins. Robots can mitigate this depletion by limiting their oxygen consumption, either overall or in specific locations or situations.


title: Simultaneous Asymmetric Quantum Remote State Preparation Scheme in Noisy Environments

abstract: In this paper we discuss a quantum multi-tasking protocol for preparation of known one-qubit and two-qubit states respectively in two different locations. The ideal remote state preparation protocol is discussed in the first place in which a five-qubit entangled state is utilized. The design for the preparation of such entanglement is also presented and run on IBM quantum composer platform. The effects of three types of noises on the protocol are discussed and in all these cases the reduced fidelities of the process are calculated. The variations of these fidelities with respect to different parameters are analysed.


title: Classification of vertices on social networks by multiple approaches

abstract: Due to the advent of the expressions of data other than tabular formats, the topological compositions which make samples interrelated came into prominence. Analogically, those networks can be interpreted as social connections, dataflow maps, citation influence graphs, protein bindings, etc. However, in the case of social networks, it is highly crucial to evaluate the labels of discrete communities. The reason underneath for such a study is the non-negligible importance of analyzing graph networks to partition the vertices by using the topological features of network graphs, solely. For each of these interaction-based entities, a social graph, a mailing dataset, and two citation sets are selected as the testbench repositories. This paper, it was not only assessed the most valuable method but also determined how graph neural networks work and the need to improve against non-neural network approaches which are faster and computationally cost-effective. Also, this paper showed a limit to be excesses by prospective graph neural network variations by using the topological features of networks trialed.


title: Blockchain-aided Secure Semantic Communication for AI-Generated Content in Metaverse

abstract: The construction of virtual transportation networks requires massive data to be transmitted from edge devices to Virtual Service Providers (VSP) to facilitate circulations between the physical and virtual domains in Metaverse. Leveraging semantic communication for reducing information redundancy, VSPs can receive semantic data from edge devices to provide varied services through advanced techniques, e.g., AI-Generated Content (AIGC), for users to explore digital worlds. But the use of semantic communication raises a security issue because attackers could send malicious semantic data with similar semantic information but different desired content to break Metaverse services and cause wrong output of AIGC. Therefore, in this paper, we first propose a blockchain-aided semantic communication framework for AIGC services in virtual transportation networks to facilitate interactions of the physical and virtual domains among VSPs and edge devices. We illustrate a training-based targeted semantic attack scheme to generate adversarial semantic data by various loss functions. We also design a semantic defense scheme that uses the blockchain and zero-knowledge proofs to tell the difference between the semantic similarities of adversarial and authentic semantic data and to check the authenticity of semantic data transformations. Simulation results show that the proposed defense method can reduce the semantic similarity of the adversarial semantic data and the authentic ones by up to 30% compared with the attack scheme.


title: Graph Encoder Ensemble for Simultaneous Vertex Embedding and Community Detection

abstract: In this paper, we introduce a novel and computationally efficient method for vertex embedding, community detection, and community size determination. Our approach leverages a normalized one-hot graph encoder and a rank-based cluster size measure. Through extensive simulations, we demonstrate the excellent numerical performance of our proposed graph encoder ensemble algorithm.


title: An operator-algebraic formulation of self-testing

abstract: We give a new definition of self-testing for correlations in terms of states on $C^*$-algebras. We show that this definition is equivalent to the standard definition for any class of finite-dimensional quantum models which is closed, provided that the correlation is extremal and has a full-rank model in the class. This last condition automatically holds for the class of POVM quantum models, but does not necessarily hold for the class of projective models by a result of Baptista, Chen, Kaniewski, Lolck, Man{\v{c}}inska, Gabelgaard Nielsen, and Schmidt. For extremal binary correlations and for extremal synchronous correlations, we show that any self-test for projective models is a self-test for POVM models. The question of whether there is a self-test for projective models which is not a self-test for POVM models remains open. An advantage of our new definition is that it extends naturally to commuting operator models. We show that an extremal correlation is a self-test for finite-dimensional quantum models if and only if it is a self-test for finite-dimensional commuting operator models, and also observe that many known finite-dimensional self-tests are in fact self-tests for infinite-dimensional commuting operator models.


title: The Quantum Alternating Operator Ansatz for Satisfiability Problems

abstract: We comparatively study, through large-scale numerical simulation, the performance across a large set of Quantum Alternating Operator Ansatz (QAOA) implementations for finding approximate and optimum solutions to unconstrained combinatorial optimization problems. Our survey includes over 100 different mixing unitaries, and we combine each mixer with both the standard phase separator unitary representing the objective function and a thresholded version. Our numerical tests for randomly chosen instances of the unconstrained optimization problems Max 2-SAT and Max 3-SAT reveal that the traditional transverse-field mixer with the standard phase separator performs best for problem sizes of 8 through 14 variables, while the recently introduced Grover mixer with thresholding wins at problems of size 6. This result (i) corrects earlier work suggesting that the Grover mixer is a superior mixer based only on results from problems of size 6, thus illustrating the need to push numerical simulation to larger problem sizes to more accurately predict performance; and (ii) it suggests that more complicated mixers and phase separators may not improve QAOA performance.


title: Understanding Finetuning for Factual Knowledge Extraction from Language Models

abstract: Language models (LMs) pretrained on large corpora of text from the web have been observed to contain large amounts of various types of knowledge about the world. This observation has led to a new and exciting paradigm in knowledge graph construction where, instead of manual curation or text mining, one extracts knowledge from the parameters of an LM. Recently, it has been shown that finetuning LMs on a set of factual knowledge makes them produce better answers to queries from a different set, thus making finetuned LMs a good candidate for knowledge extraction and, consequently, knowledge graph construction. In this paper, we analyze finetuned LMs for factual knowledge extraction. We show that along with its previously known positive effects, finetuning also leads to a (potentially harmful) phenomenon which we call Frequency Shock, where at the test time the model over-predicts rare entities that appear in the training set and under-predicts common entities that do not appear in the training set enough times. We show that Frequency Shock leads to a degradation in the predictions of the model and beyond a point, the harm from Frequency Shock can even outweigh the positive effects of finetuning, making finetuning harmful overall. We then consider two solutions to remedy the identified negative effect: 1- model mixing and 2- mixture finetuning with the LM's pre-training task. The two solutions combined lead to significant improvements compared to vanilla finetuning.


title: Coin Sampling: Gradient-Based Bayesian Inference without Learning Rates

abstract: In recent years, particle-based variational inference (ParVI) methods such as Stein variational gradient descent (SVGD) have grown in popularity as scalable methods for Bayesian inference. Unfortunately, the properties of such methods invariably depend on hyperparameters such as the learning rate, which must be carefully tuned by the practitioner in order to ensure convergence to the target measure at a suitable rate. In this paper, we introduce a suite of new particle-based methods for scalable Bayesian inference based on coin betting, which are entirely learning-rate free. We illustrate the performance of our approach on a range of numerical examples, including several high-dimensional models and datasets, demonstrating comparable performance to other ParVI algorithms with no need to tune a learning rate.


title: Universal scaling of adiabatic tunneling out of a shallow confinement potential

abstract: The ability to tune quantum tunneling is key for achieving selectivity in manipulation of individual particles in quantum technology applications. In this work we count electron escape events out of a time-dependent confinement potential, realized as a dynamic quantum dot in a GaAs/AlGaAs heterostructure. A universal scaling relation of the escape probability as a function of potential barrier risetime and depth is established and developed as a method to probe tunneling rates over many orders of magnitude reaching limits of WKB approximation as the anharmonicity of shallow confinement becomes relevant. Crossover to thermally activated transport is used to estimate the single time-energy scale of the universal model. In application to metrological single electron sources, in-situ calibrated control signals greatly extend the accessible dynamical range for probing the quantization mechanism. Validation of the cubic potential approximation sets a foundation for microscopic modeling of quantum tunneling devices in the shallow confinement regime.


title: Robust Almost-Sure Reachability in Multi-Environment MDPs

abstract: Multiple-environment MDPs (MEMDPs) capture finite sets of MDPs that share the states but differ in the transition dynamics. These models form a proper subclass of partially observable MDPs (POMDPs). We consider the synthesis of policies that robustly satisfy an almost-sure reachability property in MEMDPs, that is, one policy that satisfies a property for all environments. For POMDPs, deciding the existence of robust policies is an EXPTIME-complete problem. In this paper, we show that this problem is PSPACE-complete for MEMDPs, while the policies in general require exponential memory. We exploit the theoretical results to develop and implement an algorithm that shows promising results in synthesizing robust policies for various benchmarks.


title: Line Luminosities of Galactic and Magellanic Cloud Wolf-Rayet stars

abstract: We provide line luminosities and spectroscopic templates of prominent optical emission lines of 133 Galactic Wolf-Rayet stars by exploiting Gaia DR3 parallaxes and optical spectrophotometry, and provide comparisons with 112 counterparts in the Magellanic Clouds. Average line luminosities of the broad blue (He II 4686, C III 4647,51, N III 4634,41, N V 4603,20) and yellow (C IV 5801,12) emission features for WN, WN/C, WC and WO stars have application in characterising the Wolf-Rayet populations of star-forming regions of distant, unresolved galaxies. Early-type WN stars reveal lower line luminosities in more metal poor environments, but the situation is less clear for late-type WN stars. LMC WC4-5 line luminosities are higher than their Milky Way counterparts, with line luminosities of Magellanic Cloud WO stars higher than Galactic stars. We highlight other prominent optical emission lines, N IV 3478,85 for WN and WN/C stars, O IV 3403,13 for WC and WO stars and O VI 3811,34 for WO stars. We apply our calibrations to representative metal-poor and metal-rich WR galaxies, IC 4870 and NGC 3049, respectively, with spectral templates also applied based on a realistic mix of subtypes. Finally, the global blue and C IV 5801,12 line luminosities of the Large (Small) Magellanic Clouds are 2.6e38 erg/s (9e36 erg/s) and 8.8e37 erg/s (4e36 erg/s), respectively, with the cumulative WR line luminosity of the Milky Way estimated to be an order of magnitude higher than the LMC.


title: Investigating the impact of the molecular charge-exchange rate on detached SOLPS-ITER simulations

abstract: Plasma-molecular interactions generate molecular ions which react with the plasma and contribute to detachment through molecular activated recombination (MAR), reducing the ion target flux, and molecular activated dissociation (MAD), both of which create excited atoms. Hydrogenic emission from these atoms have been detected experimentally in detached TCV, JET and MAST-U deuterium plasmas. The TCV findings, however, were in disagreement with SOLPS-ITER simulations for deuterium indicating a molecular ion density ($D_2^+$) that was insufficient to lead to significant hydrogenic emission, which was attributed to underestimates of the molecular charge exchange rate ($D_2 + D^+ \rightarrow D_2^+ + D$) for deuterium (obtained by rescaling the hydrogen rates by their isotope mass). In this work, we have performed new SOLPS-ITER simulations with the default rate setup and a modified rate setup where ion isotope mass rescaling was disabled. This increased the $D_2^+$ content by $> \times 100$. By disabling ion isotope mass rescaling: 1) the total ion sinks are more than doubled due to the inclusion of MAR; 2) the additional MAR causes the ion target flux to roll-over during detachment; 3) the total $D\alpha$ emission in the divertor increases during deep detachment by roughly a factor four; 4) the neutral atom density in the divertor is doubled due to MAD, leading to a 50\% increase in neutral pressure; 5) total hydrogenic power loss is increased by up to 60\% due to MAD. These differences result in an improved agreement between the experiment and the simulations in terms of spectroscopic measurements, ion source/sink inferences and the occurrence of an ion target flux roll-over.


title: The frequency ratio and time delay of solar radio emissions with fundamental and harmonic components

abstract: Solar radio bursts generated through the plasma emission mechanism produce radiation near the local plasma frequency (fundamental emission) and double the plasma frequency (harmonic). While the theoretical ratio of these two frequencies is close to 2, simultaneous observations give ratios ranging from 1.6 to 2, suggesting either a ratio different from 2, a delay of the fundamental emission, or both. To address this long-standing question, we conducted high frequency, high time resolution imaging spectroscopy of type III and type J bursts with fine structures for both the fundamental and harmonic components with LOFAR between 30 and 80 MHz. The short-lived and narrow frequency-band fine structures observed simultaneously at fundamental and harmonic frequencies give a frequency ratio of 1.66 and 1.73, similar to previous observations. However, frequency-time cross-correlations suggest a frequency ratio of 1.99 and 1.95 with a time delay between the F and H emissions of 1.00 and 1.67 s, respectively for each event. Hence, simultaneous frequency ratio measurements different from 2 are caused by the delay of the fundamental emission. Among the processes causing fundamental emission delays, anisotropic radio-wave scattering is dominant. Moreover, the levels of anisotropy and density fluctuations reproducing the delay of fundamental emissions are consistent with those required to simulate the source size and duration of fundamental emissions. Using these simulations we are able to, for the first time, provide quantitative estimates of the delay time of the fundamental emissions caused by radio-wave propagation effects at multiple frequencies, which can be used in future studies.


title: ZiCo: Zero-shot NAS via Inverse Coefficient of Variation on Gradients

abstract: Neural Architecture Search (NAS) is widely used to automatically obtain the neural network with the best performance among a large number of candidate architectures. To reduce the search time, zero-shot NAS aims at designing training-free proxies that can predict the test performance of a given architecture. However, as shown recently, none of the zero-shot proxies proposed to date can actually work consistently better than a naive proxy, namely, the number of network parameters (#Params). To improve this state of affairs, as the main theoretical contribution, we first reveal how some specific gradient properties across different samples impact the convergence rate and generalization capacity of neural networks. Based on this theoretical analysis, we propose a new zero-shot proxy, ZiCo, the first proxy that works consistently better than #Params. We demonstrate that ZiCo works better than State-Of-The-Art (SOTA) proxies on several popular NAS-Benchmarks (NASBench101, NATSBench-SSS/TSS, TransNASBench-101) for multiple applications (e.g., image classification/reconstruction and pixel-level prediction). Finally, we demonstrate that the optimal architectures found via ZiCo are as competitive as the ones found by one-shot and multi-shot NAS methods, but with much less search time. For example, ZiCo-based NAS can find optimal architectures with 78.1%, 79.4%, and 80.4% test accuracy under inference budgets of 450M, 600M, and 1000M FLOPs, respectively, on ImageNet within 0.4 GPU days. Our code is available at https://github.com/SLDGroup/ZiCo.


title: A Complete Inference System for Skip-free Guarded Kleene Algebra with Tests

abstract: Guarded Kleene Algebra with Tests (GKAT) is a fragment of Kleene Algebra with Tests (KAT) that was recently introduced to reason efficiently about imperative programs. In contrast to KAT, GKAT does not have an algebraic axiomatization, but relies on an analogue of Salomaa's axiomatization of Kleene Algebra. In this paper, we present an algebraic axiomatization and prove two completeness results for a large fragment of GKAT consisting of skip-free programs.


title: Minimax estimation of discontinuous optimal transport maps: The semi-discrete case

abstract: We consider the problem of estimating the optimal transport map between two probability distributions, $P$ and $Q$ in $\mathbb R^d$, on the basis of i.i.d. samples. All existing statistical analyses of this problem require the assumption that the transport map is Lipschitz, a strong requirement that, in particular, excludes any examples where the transport map is discontinuous. As a first step towards developing estimation procedures for discontinuous maps, we consider the important special case where the data distribution $Q$ is a discrete measure supported on a finite number of points in $\mathbb R^d$. We study a computationally efficient estimator initially proposed by Pooladian and Niles-Weed (2021), based on entropic optimal transport, and show in the semi-discrete setting that it converges at the minimax-optimal rate $n^{-1/2}$, independent of dimension. Other standard map estimation techniques both lack finite-sample guarantees in this setting and provably suffer from the curse of dimensionality. We confirm these results in numerical experiments, and provide experiments for other settings, not covered by our theory, which indicate that the entropic estimator is a promising methodology for other discontinuous transport map estimation problems.


title: Proof to count bound state nodes in supersymmetric quantum mechanics

abstract: A normalizable static supersymmetric bound ground state annihilated by the super-generators has got zero number of internal nodes in the framework of one-dimensional supersymmetric quantum mechanics. The super-generator transformations between excited super-partner bound states as combined with the standard technique of Wronskian provides an elegant and self-sufficient way to derive the equality of internal nodes amount to the number of consequent excitation.


title: Gravitoelectromagnetic quadrirefringence

abstract: We develop an effective approach for the study of the interaction of gravitational waves (GWs) and electromagnetic waves (EMWs), showing that quadrirefringence can be produced, a phenomenon consisting in a frequency and polarization dependency of the speed of the different polarizations of GWs and EMWs, which is also inducing a frequency and polarization dependent modification of the GW-EMW luminosity distance ratio. Quadrirefringence can be due to the GW-EMW interaction in the source or during the propagation from the source to the observer. In the first case the astrophysical properties of the source can induce a unique characteristic imprint on GWs and EMWs for each source, the rainbow of binaries, while the effect on the propagation from the source could be used to probe the large scale electromagnetic field using GWs. Numerical general relativistic magnetohydrodynamic (GRMHD) simulations can be used to obtain precise theoretical predictions for different binary systems with large electromagnetic and gravitational fields, such as binary neutron stars.


title: DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvature

abstract: The increasing fluency and widespread usage of large language models (LLMs) highlight the desirability of corresponding tools aiding detection of LLM-generated text. In this paper, we identify a property of the structure of an LLM's probability function that is useful for such detection. Specifically, we demonstrate that text sampled from an LLM tends to occupy negative curvature regions of the model's log probability function. Leveraging this observation, we then define a new curvature-based criterion for judging if a passage is generated from a given LLM. This approach, which we call DetectGPT, does not require training a separate classifier, collecting a dataset of real or generated passages, or explicitly watermarking generated text. It uses only log probabilities computed by the model of interest and random perturbations of the passage from another generic pre-trained language model (e.g., T5). We find DetectGPT is more discriminative than existing zero-shot methods for model sample detection, notably improving detection of fake news articles generated by 20B parameter GPT-NeoX from 0.81 AUROC for the strongest zero-shot baseline to 0.95 AUROC for DetectGPT. See https://ericmitchell.ai/detectgpt for code, data, and other project information.


title: Spherical Configurations over Finite Fields

abstract: We establish that if $d \geq 2k + 6$ and $q$ is odd and sufficiently large with respect to $\alpha \in (0,1)$, then every set $A\subseteq \mathbf{F}_q^d$ of size $|A| \geq \alpha q^d$ will contain an isometric copy of every spherical $(k+2)$-point configuration that spans $k$ dimensions.


title: Ab initio potential energy curves, scattering lengths, and rovibrational levels of the He$_2^+$ molecular ion in excited electronic states

abstract: We calculate accurate potential energy curves for a ground-state He$^+$ ion interacting with a He atom in the lowest-energy metastable $^3\!S$ electronic state. We employ the full configuration interaction method, equivalent to exact diagonalization, with results extrapolated to the complete basis set limit. The leading relativistic and adiabatic corrections are included using perturbation theory. We calculate rovibrational levels and spectroscopic constants of the He$_2^+$ molecular ion in excited electronic states for three stable isotopologues. We predict the scattering lengths for ultracold ion-atom collisions. The theoretical data are presented with their uncertainties and agree well with previous results for the ground state. The reported results may be useful for the spectroscopy of the He$_2^+$ molecular ion in the excited electronic state and collisional studies of He$^+$ ions immersed in ultracold gases of metastable He atoms.


title: Neural Continuous-Discrete State Space Models for Irregularly-Sampled Time Series

abstract: Learning accurate predictive models of real-world dynamic phenomena (e.g., climate, biological) remains a challenging task. One key issue is that the data generated by both natural and artificial processes often comprise time series that are irregularly sampled and/or contain missing observations. In this work, we propose the Neural Continuous-Discrete State Space Model (NCDSSM) for continuous-time modeling of time series through discrete-time observations. NCDSSM employs auxiliary variables to disentangle recognition from dynamics, thus requiring amortized inference only for the auxiliary variables. Leveraging techniques from continuous-discrete filtering theory, we demonstrate how to perform accurate Bayesian inference for the dynamic states. We propose three flexible parameterizations of the latent dynamics and an efficient training objective that marginalizes the dynamic states during inference. Empirical results on multiple benchmark datasets across various domains show improved imputation and forecasting performance of NCDSSM over existing models.


title: SemSup-XC: Semantic Supervision for Zero and Few-shot Extreme Classification

abstract: Extreme classification (XC) involves predicting over large numbers of classes (thousands to millions), with real-world applications like news article classification and e-commerce product tagging. The zero-shot version of this task requires generalization to novel classes without additional supervision. In this paper, we develop SemSup-XC, a model that achieves state-of-the-art zero-shot and few-shot performance on three XC datasets derived from legal, e-commerce, and Wikipedia data. To develop SemSup-XC, we use automatically collected semantic class descriptions to represent classes and facilitate generalization through a novel hybrid matching module that matches input instances to class descriptions using a combination of semantic and lexical similarity. Trained with contrastive learning, SemSup-XC significantly outperforms baselines and establishes state-of-the-art performance on all three datasets considered, gaining up to 12 precision points on zero-shot and more than 10 precision points on one-shot tests, with similar gains for recall@10. Our ablation studies highlight the relative importance of our hybrid matching module and automatically collected class descriptions.


title: Learning Good Features to Transfer Across Tasks and Domains

abstract: Availability of labelled data is the major obstacle to the deployment of deep learning algorithms for computer vision tasks in new domains. The fact that many frameworks adopted to solve different tasks share the same architecture suggests that there should be a way of reusing the knowledge learned in a specific setting to solve novel tasks with limited or no additional supervision. In this work, we first show that such knowledge can be shared across tasks by learning a mapping between task-specific deep features in a given domain. Then, we show that this mapping function, implemented by a neural network, is able to generalize to novel unseen domains. Besides, we propose a set of strategies to constrain the learned feature spaces, to ease learning and increase the generalization capability of the mapping network, thereby considerably improving the final performance of our framework. Our proposal obtains compelling results in challenging synthetic-to-real adaptation scenarios by transferring knowledge between monocular depth estimation and semantic segmentation tasks.


title: Generalised Jeffery's equations for rapidly spinning particles. Part 1: Spheroids

abstract: The observed behaviour of passive objects in simple flows can be surprisingly intricate, and is complicated further by object activity. Inspired by the motility of bacterial swimmers, in this two-part study we examine the three-dimensional motion of rigid active particles in shear Stokes flow, focusing on bodies that induce rapid rotation as part of their activity. Here, in Part 1, we develop a multiscale framework to investigate these emergent dynamics and apply it to simple spheroidal objects. In Part 2 (arXiv:2301.11032), we apply our framework to understand the emergent dynamics of more complex shapes; helicoidal objects with chirality. Via a multiple-scales asymptotic analysis for nonlinear systems, we systematically derive emergent equations of motion for long-term trajectories that explicitly account for the strong (leading-order) effects of fast spinning. Supported by numerical examples, we constructively link these effective dynamics to the well-known Jeffery's orbits for passive spheroids, deriving an explicit closed-form expression for the effective shape of the active particle, broadening the scope of Jeffery's seminal study to spinning spheroids.


title: LoRaLay: A Multilingual and Multimodal Dataset for Long Range and Layout-Aware Summarization

abstract: Text Summarization is a popular task and an active area of research for the Natural Language Processing community. By definition, it requires to account for long input texts, a characteristic which poses computational challenges for neural models. Moreover, real-world documents come in a variety of complex, visually-rich, layouts. This information is of great relevance, whether to highlight salient content or to encode long-range interactions between textual passages. Yet, all publicly available summarization datasets only provide plain text content. To facilitate research on how to exploit visual/layout information to better capture long-range dependencies in summarization models, we present LoRaLay, a collection of datasets for long-range summarization with accompanying visual/layout information. We extend existing and popular English datasets (arXiv and PubMed) with layout information and propose four novel datasets -- consistently built from scholar resources -- covering French, Spanish, Portuguese, and Korean languages. Further, we propose new baselines merging layout-aware and long-range models -- two orthogonal approaches -- and obtain state-of-the-art results, showing the importance of combining both lines of research.


title: Distributed Optimization Methods for Multi-Robot Systems: Part I -- A Tutorial

abstract: Distributed optimization provides a framework for deriving distributed algorithms for a variety of multi-robot problems. This tutorial constitutes the first part of a two-part series on distributed optimization applied to multi-robot problems, which seeks to advance the application of distributed optimization in robotics. In this tutorial, we demonstrate that many canonical multi-robot problems can be cast within the distributed optimization framework, such as multi-robot simultaneous localization and planning (SLAM), multi-robot target tracking, and multi-robot task assignment problems. We identify three broad categories of distributed optimization algorithms: distributed first-order methods, distributed sequential convex programming, and the alternating direction method of multipliers (ADMM). We describe the basic structure of each category and provide representative algorithms within each category. We then work through a simulation case study of multiple drones collaboratively tracking a ground vehicle. We compare solutions to this problem using a number of different distributed optimization algorithms. In addition, we implement a distributed optimization algorithm in hardware on a network of Rasberry Pis communicating with XBee modules to illustrate robustness to the challenges of real-world communication networks.