title: Bridging the Gap between Object and Image-level Representations for Open-Vocabulary Detection

abstract: Existing open-vocabulary object detectors typically enlarge their vocabulary sizes by leveraging different forms of weak supervision. This helps generalize to novel objects at inference. Two popular forms of weak-supervision used in open-vocabulary detection (OVD) include pretrained CLIP model and image-level supervision. We note that both these modes of supervision are not optimally aligned for the detection task: CLIP is trained with image-text pairs and lacks precise localization of objects while the image-level supervision has been used with heuristics that do not accurately specify local object regions. In this work, we propose to address this problem by performing object-centric alignment of the language embeddings from the CLIP model. Furthermore, we visually ground the objects with only image-level supervision using a pseudo-labeling process that provides high-quality object proposals and helps expand the vocabulary during training. We establish a bridge between the above two object-alignment strategies via a novel weight transfer function that aggregates their complimentary strengths. In essence, the proposed model seeks to minimize the gap between object and image-centric representations in the OVD setting. On the COCO benchmark, our proposed approach achieves 36.6 AP50 on novel classes, an absolute 8.2 gain over the previous best performance. For LVIS, we surpass the state-of-the-art ViLD model by 5.0 mask AP for rare categories and 3.4 overall. Code: https://github.com/hanoonaR/object-centric-ovd.


title: Finding Fallen Objects Via Asynchronous Audio-Visual Integration

abstract: The way an object looks and sounds provide complementary reflections of its physical properties. In many settings cues from vision and audition arrive asynchronously but must be integrated, as when we hear an object dropped on the floor and then must find it. In this paper, we introduce a setting in which to study multi-modal object localization in 3D virtual environments. An object is dropped somewhere in a room. An embodied robot agent, equipped with a camera and microphone, must determine what object has been dropped -- and where -- by combining audio and visual signals with knowledge of the underlying physics. To study this problem, we have generated a large-scale dataset -- the Fallen Objects dataset -- that includes 8000 instances of 30 physical object categories in 64 rooms. The dataset uses the ThreeDWorld platform which can simulate physics-based impact sounds and complex physical interactions between objects in a photorealistic setting. As a first step toward addressing this challenge, we develop a set of embodied agent baselines, based on imitation learning, reinforcement learning, and modular planning, and perform an in-depth analysis of the challenge of this new task.


title: AVDDPG: Federated reinforcement learning applied to autonomous platoon control

abstract: Since 2016 federated learning (FL) has been an evolving topic of discussion in the artificial intelligence (AI) research community. Applications of FL led to the development and study of federated reinforcement learning (FRL). Few works exist on the topic of FRL applied to autonomous vehicle (AV) platoons. In addition, most FRL works choose a single aggregation method (usually weight or gradient aggregation). We explore FRL's effectiveness as a means to improve AV platooning by designing and implementing an FRL framework atop a custom AV platoon environment. The application of FRL in AV platooning is studied under two scenarios: (1) Inter-platoon FRL (Inter-FRL) where FRL is applied to AVs across different platoons; (2) Intra-platoon FRL (Intra-FRL) where FRL is applied to AVs within a single platoon. Both Inter-FRL and Intra-FRL are applied to a custom AV platooning environment using both gradient and weight aggregation to observe the performance effects FRL can have on AV platoons relative to an AV platooning environment trained without FRL. It is concluded that Intra-FRL using weight aggregation (Intra-FRLWA) provides the best performance for controlling an AV platoon. In addition, we found that weight aggregation in FRL for AV platooning provides increases in performance relative to gradient aggregation. Finally, a performance analysis is conducted for Intra-FRLWA versus a platooning environment without FRL for platoons of length 3, 4 and 5 vehicles. It is concluded that Intra-FRLWA largely out-performs the platooning environment that is trained without FRL.


title: On Non-Linear operators for Geometric Deep Learning

abstract: This work studies operators mapping vector and scalar fields defined over a manifold $\mathcal{M}$, and which commute with its group of diffeomorphisms $\text{Diff}(\mathcal{M})$. We prove that in the case of scalar fields $L^p_\omega(\mathcal{M,\mathbb{R}})$, those operators correspond to point-wise non-linearities, recovering and extending known results on $\mathbb{R}^d$. In the context of Neural Networks defined over $\mathcal{M}$, it indicates that point-wise non-linear operators are the only universal family that commutes with any group of symmetries, and justifies their systematic use in combination with dedicated linear operators commuting with specific symmetries. In the case of vector fields $L^p_\omega(\mathcal{M},T\mathcal{M})$, we show that those operators are solely the scalar multiplication. It indicates that $\text{Diff}(\mathcal{M})$ is too rich and that there is no universal class of non-linear operators to motivate the design of Neural Networks over the symmetries of $\mathcal{M}$.


title: Magnetic signature of vertically migrating aggregations in the ocean

abstract: The transport of heat and solutes by vertically migrating aggregations of plankton has long been explored as a potentially important source of ocean mixing. However, direct evidence of enhanced mixing due to these migrations remains challenging to obtain and inconclusive. These shortcomings are due to the limitations of current measurement techniques, i.e., velocimetry techniques, which require a priori knowledge of the precise aggregation location and typically trigger animal avoidance behavior from introducing instrumentation into the migration. Here we develop a new approach to overcome these longstanding limitations by leveraging advancements in modern magnetometry to detect the flow-induced magnetic fields that naturally arise from seawater as it moves through the Earth's geomagnetic field. We derive quantitative predictions showing that these flow-induced magnetic fields in the vicinity of migrating aggregations have a strength proportional to the integrated fluid transport due to the migration. Importantly these magnetic signatures are potentially detectable remotely at a significant distance far from the aggregation and region of moving fluid with emerging quantum-enhanced magnetometry techniques such as Nitrogen-Vacancy centers in diamond. These results provide a new, testable framework for quantifying the significance of fluid transport in the ocean due to swimming organisms that may finally resolve a scientific debate with potentially enormous implications for our understanding of ocean dynamics and climate change.


title: Deriving instrumental point spread functions from partially occulted images

abstract: The point-spread function (PSF) of an imaging system describes the response of the system to a point source. Accurately determining the PSF enables one to correct for the combined effects of focussing and scattering within the imaging system, and thereby enhance the spatial resolution and dynamic contrast of the resulting images. We present a semi-empirical semi-blind methodology to derive a PSF from partially occulted images. We partition the two-dimensional PSF into multiple segments, set up a multi-linear system of equations, and directly fit the system of equations to determine the PSF weight in each segment. The algorithm is guaranteed to converge towards the correct instrumental PSF for a large class of occultations, does not require a predefined functional form of the PSF, and can be applied to a large variety of partially occulted images, such as within laboratory settings, regular calibrations within a production line or in the field, astronomical images of distant clusters of stars, or partial solar eclipse images. We show that the central weight of the PSF, which gives the percentage of photons that are not scattered by the instrument, is accurate to bettern than 1.2%. The mean absolute percentage error between the reconstructed and true PSF is usually between 0.5% and 5% for the entire PSF, between 0.5% and 5% for the PSF core, and between 0.5% and 3% for the PSF tail.


title: Harmonic calibration of quadrature phase interferometry

abstract: The two output signals of quadrature phase interferometers allow to benefit both from the high sensitivity of interferometry (working inside a fringe) and from an extended input range (counting fringes). Their calibration to reach a linear output is traditionally performed using Heydemann's correction, which involves fitting one output versus the other by an ellipse. Here we present two alternative methods based on the linear response of the measurement to a sinusoidal input in time, which enables a direct calibration with an excellent linearity. A ten fold improvement with respect to the usual technique is demonstrated on an optical interferometer measuring the deflection of scanning force microscopy cantilevers.


title: Convolution Neural Network based Mode Decomposition for Degenerated Modes via Multiple Images from Polarizers

abstract: In this paper, a mode decomposition (MD) method for degenerated modes has been studied. Convolution neural network (CNN) has been applied for image training and predicting the mode coefficients. Four-fold degenerated $LP_{11}$ series has been the target to be decomposed. Multiple images are regarded as an input to decompose the degenerate modes. Total of seven different images, including the full original near-field image, and images after linear polarizers of four directions (0$^\circ$, 45$^\circ$, 90$^\circ$, and 135$^\circ$), and images after two circular polarizers (right-handed and left-handed) has been considered for training, validation, and test. The output label of the model has been chosen as the real and imaginary components of the mode coefficient, and the loss function has been selected to be the root-mean-square (RMS) of the labels. The RMS and mean-absolute-error (MAE) of the label, intensity, phase, and field correlation between the actual and predicted values have been selected to be the metrics to evaluate the CNN model. The CNN model has been trained with 100,000 three-dimensional images with depths of three, four, and seven. The performance of the trained model was evaluated via 10,000 test samples with four sets of images - images after three linear polarizers (0$^\circ$, 45$^\circ$, 90$^\circ$) and image after right-handed circular polarizer - showed 0.0634 of label RMS, 0.0292 of intensity RMS, 0.1867 rad of phase MAE, and 0.9978 of average field correlation. The performance of 4 image sets showed at least 50.68\% of performance enhancement compared to models considering only images after linear polarizers.


title: Recent Results of Energy Disaggregation with Behind-the-Meter Solar Generation

abstract: The rapid deployment of renewable generations such as photovoltaic (PV) generations brings great challenges to the resiliency of existing power systems. Because PV generations are volatile and typically invisible to the power system operator, estimating the generation and characterizing the uncertainty are in urgent need for operators to make insightful decisions. This paper summarizes our recent results on energy disaggregation at the substation level with Behind-the-Meter solar generation. We formulate the so-called ``partial label'' problem for energy disaggregation at substations, where the aggregate measurements contain the total consumption of multiple loads, and the existence of some loads is unknown. We develop two model-free disaggregation approaches based on deterministic dictionary learning and Bayesian dictionary learning, respectively. Unlike conventional methods which require fully annotated training data of individual loads, our approaches can extract load patterns given partially labeled aggregate data. Therefore, our partial label formulation is more applicable in the real world. Compared with deterministic dictionary learning, the Bayesian dictionary learning-based approach provides the uncertainty measure for the disaggregation results, at the cost of increased computational complexity. All the methods are validated by numerical experiments.


title: Causal Effective Field Theories

abstract: Physical principles such as unitarity, causality, and locality can constrain the space of consistent effective field theories (EFTs) by imposing two-sided bounds on the allowed values of Wilson coefficients. In this paper, we consider the bounds that arise from the requirement of low-energy causality alone, without appealing to any assumptions about UV physics. We focus on shift-symmetric theories, and consider bounds that arise from the propagation around both a homogeneous and a spherically-symmetric background. We find that low-energy causality, namely the requirement that there are no resolvable time advances within the regime of validity of the EFT, produces two-sided bounds in agreement with compact positivity constraints previously obtained from $2 \rightarrow 2$ scattering amplitude dispersion relations using full crossing symmetry.


title: Mapping Milky Way disk perturbations in stellar number density and vertical velocity using Gaia DR3

abstract: We have mapped the number density and mean vertical velocity of the Milky Way's stellar disk out to roughly two kiloparsecs from the Sun using Gaia Data Release 3 (DR3) and complementary photo-astrometric distance information from StarHorse. For the number counts, we carefully masked spatial regions that are compromised by open clusters, great distances, or dust extinction and used Gaussian processes to arrive at a smooth, non-parametric estimate for the underlying number density field. We find that the number density and velocity fields depart significantly from an axisymmetric and mirror-symmetric model. These departures, which include projections of the Gaia phase-space spiral, signal the presence of local disturbances in the disk. We identify two features that are present in both stellar number density and mean vertical velocity. One of these features appears to be associated with the Local Spiral Arm. It is most prominent at small heights and is largely symmetric across the mid-plane of the disk. The density and velocity field perturbations are phase-shifted by roughly a quarter wavelength, suggesting a breathing mode that is propagating in the direction of Galactic longitude $l\sim 270$ deg. The second feature is a gradient in the stellar number density and mean vertical velocity with respect to Galactocentric radius. This feature, which extends across the entire region of our analysis, may be associated with the extension of the Galactic warp into the Solar neighbourhood in combination with more localised bending waves.


title: Realistic HI scale heights of Milky Way-mass galaxies in the FIREbox cosmological volume

abstract: Accurately reproducing the thin cold gas discs observed in nearby spiral galaxies has been a long standing issue in cosmological simulations. Here, we present measurements of the radially resolved HI scale height in 22 non-interacting Milky Way-mass galaxies from the FIREbox cosmological volume. We measure the HI scale heights using five different approaches commonly used in the literature: fitting the vertical volume density distribution with a Gaussian, the distance between maximum and half-maximum of the vertical volume density distribution, a semi-empirical description using the velocity dispersion and the galactic gravitational potential, the analytic assumption of hydrostatic equilibrium, and the distance from the midplane which encloses $\gtrsim$60 per cent of the HI mass. We find median HI scale heights, measured using the vertical volume distribution, that range from ~100 pc in the galactic centres to ~800 pc in the outskirts and are in excellent agreement with recent observational results. We speculate that the presence of a realistic multiphase interstellar medium, including cold gas, and realistic stellar feedback are the drivers behind the realistic HI scale heights.


title: Shift Symmetries for p-Forms and Mixed Symmetry Fields on (A)dS

abstract: Massive fields on (anti) de Sitter space realize extended shift symmetries at particular values of their masses. We find these symmetries for all bosonic p-forms and mixed symmetry fields, in arbitrary spacetime dimension. These shift symmetric fields correspond to the missing longitudinal modes of mixed symmetry partially massless fields where the top row of the Young tableau is activated.


title: Radiative corrections to the forward-backward asymmetry in $e^+e^-\to\pi^+\pi^-$

abstract: We present a calculation of the $C$-odd radiative corrections to $e^+e^-\to \pi^+\pi^-$ in a dispersive formalism, concentrating on the leading pion-pole contribution in the virtual box diagrams. In particular, we show how the effect of a general pion vector form factor in the loop integral can be incorporated in a model-independent way and how the cancellation of infrared singularities proceeds in this case. The numerical results, dominated by the infrared enhanced contributions, indicate significant corrections beyond scalar QED, essentially confirming recent findings in generalized vector-meson-dominance models.


title: The Berry dipole photovoltaic demon and the thermodynamics of photo-current generation within the optical gap of metals

abstract: We dismantle the previously held misconception that it is impossible for bulk rectification mechanisms to induce a net DC electric current when the frequency of the impinging radiation lies within the optical gap of a metal in the limit of small carrier relaxation rates. We argue that generically such in-gap rectification mechanisms are irreversible and accompanied by a continuous exchange of energy with a heat bath and must also be necessarily accompanied by a small but finite absorption of radiation in order to guarantee the positivity of the net entropy production and abide by the second law of thermodynamics. We show, however, that the intra-band non-linear Hall effect arising from the Berry curvature is a special kind of in-gap rectification mechanism that behaves as a ``photo-voltaic demon'', namely it can operate as an ideal reversible and dissipationless conveyor of energy between the radiation and an external circuit. Its reversible nature allows for an interesting mode of operation as an amplifier of circularly polarized light, whose efficiency can approach 100%, and which could be technologically promising especially in the infrared frequency range.


title: Classical solutions of the Boltzmann equation with irregular initial data

abstract: This article considers the spatially inhomogeneous, non-cutoff Boltzmann equation. We construct a large-data classical solution given bounded, measurable initial data with uniform polynomial decay of mild order in the velocity variable. Our result requires no assumption of strict positivity for the initial data, except locally in some small ball in phase space. We also obtain existence results for weak solutions when our decay and positivity assumptions for the initial data are relaxed. Because the regularity of our solutions may degenerate as $t \rightarrow 0$, uniqueness is a challenging issue. We establish weak-strong uniqueness under the additional assumption that the initial data possesses no vacuum regions and is H\"older continuous. As an application of our short-time existence theorem, we prove global existence near equilibrium for bounded, measurable initial data that decays at a finite polynomial rate in velocity.


title: The Spiderweb proto-cluster is being magnetized by its central radio jet

abstract: We present deep broadband radio polarization observations of the Spiderweb radio galaxy (J1140-2629) in a galaxy proto-cluster at $z=2.16$. These yield the most detailed polarimetric maps yet made of a high redshift radio galaxy. The intrinsic polarization angles and Faraday Rotation Measures (RMs) reveal coherent magnetic fields spanning the $\sim60$ kpc length of the jets, while $\sim50$% fractional polarizations indicate these fields are well-ordered. Source-frame absolute RM values of $\sim1,000$ rad/m/m are typical, and values up to $\sim11,100$ rad/m/m are observed. The Faraday-rotating gas cannot be well-mixed with the synchrotron-emitting gas, or stronger-than-observed depolarization would occur. Nevertheless, an observed spatial coincidence between a localized absolute RM enhancement of $\sim1,100$ rad/m/m, a bright knot of Ly$\alpha$ emission, and a deviation of the radio jet provide direct evidence for vigorous jet-gas interaction. We detect a large-scale RM gradient totaling $\sim1,000$s rad/m/m across the width of the jet, suggesting a net clockwise (as viewed from the AGN) toroidal magnetic field component exists at 10s-of-kpc-scales, which we speculate may be associated with the operation of a Poynting-Robertson cosmic battery. We conclude the RMs are mainly generated in a sheath of hot gas around the radio jet, rather than the ambient foreground proto-cluster gas. The estimated magnetic field strength decreases by successive orders-of-magnitude going from the jet hotspots ($\sim90$ $\mu$G) to the jet sheath ($\sim10$ $\mu$G) to the ambient intracluster medium ($\sim1$ $\mu$G). Synthesizing our results, we propose that the Spiderweb radio galaxy is actively magnetizing its surrounding proto-cluster environment, with possible implications for theories of the origin and evolution of cosmic magnetic fields.


title: Metal Mixing in the R-Process Enhanced Ultra-Faint Dwarf Galaxy Reticulum II

abstract: The ultra-faint dwarf galaxy Reticulum~II was enriched by a single rare and prolific r-process event. The r-process content of Reticulum~II thus provides a unique opportunity to study metal mixing in a relic first galaxy. Using multi-object high-resolution spectroscopy with VLT/GIRAFFE and Magellan/M2FS, we identify 32 clear spectroscopic member stars and measure abundances of Mg, Ca, Fe, and Ba where possible. We find $72^{+10}_{-12}$% of the stars are r-process-enhanced, with a mean $\left\langle\mbox{[Ba/H]}\right\rangle=-1.68~\pm~0.07$ and unresolved intrinsic dispersion $\sigma_{\rm [Ba/H]} < 0.20$. The homogeneous r-process abundances imply that Ret~II's metals are well-mixed by the time the r-enhanced stars form, which simulations have shown requires at least 100 Myr of metal mixing in between bursts of star formation to homogenize. This is the first direct evidence of bursty star formation in an ultra-faint dwarf galaxy. The homogeneous dilution prefers a prompt and high-yield r-process site, such as collapsar disk winds or prompt neutron star mergers. We also find evidence from [Ba/H] and [Mg/Ca] that the r-enhanced stars in Ret~II formed in the absence of substantial pristine gas accretion, perhaps indicating that ${\approx}70$% of Ret~II stars formed after reionization.


title: A Step in Understanding the $S_8$ Tension

abstract: Models of dark sectors with a mass threshold can have important cosmological signatures. If, in the era prior to recombination, a relativistic species becomes nonrelativistic and is then depopulated in equilibrium, there can be measurable impacts on the cosmic microwave background as the entropy is transferred to lighter relativistic particles. In particular, if this ``step'' occurs near $z\sim 20,000$, the model can naturally accommodate larger values of $H_0$. If this stepped radiation is additionally coupled to dark matter, there can be a meaningful impact on the matter power spectrum as dark matter can be coupled via a species that becomes nonrelativistic and depleted. This can naturally lead to suppressed power at scales inside the sound horizon before the step, while leaving conventional cold dark matter signatures for power outside the sound horizon. We study these effects and show such models can naturally provide lower values of $S_8$ than scenarios without a step. This suggests these models may provide an interesting framework to address the $S_8$ tension, both in concert with the $H_0$ tension and without.


title: Interlayer excitonic insulator in two-dimensional double-layer semiconductor junctions: An explicitly solvable model

abstract: Excitonic insulators conduct neither electrons nor holes but bound electron-hole pairs, excitons. Unfortunately, it is not possible to inject and detect the electron and hole currents independently within a single semiconducting layer. However, interlayer excitonic insulators provide a spatial separation of electrons and holes enabling exciton current measurements. The problem is that the spatial separation weakens electron-hole pairing and may lead to interlayer exciton disassociation. Here we develop an explicitly solvable model to determine an interlayer separation that is strong enough to prevent electron and hole hopping across the layers but still allows for electron-hole pairing sufficient for transition into an interlayer excitonic insulator state. An ideal junction to realize such a state would comprise a pair of identical narrow-gap two-dimensional semiconductors separated by a wide-gap dielectric layer with low dielectric permittivity. The present study quantifies parameters of such a junction by taking into account interlayer coherence effects.


title: Athena charged particle diverter simulations: effects of micro-roughness on proton scattering using Geant4

abstract: The last generation of X-ray focusing telescopes operating outside the Earth's radiation belt discovered that optics were able to focus not only astrophysical X-ray photons, but also low-energy heliophysical protons entering the Field of View (FOV). This "soft proton" contamination affects around 40\% of the observation time of XMM-Newton. The ATHENA Charged Particle Diverter (CPD) was designed to use magnetic fields to move these soft protons away from the FOV of the detectors, separating the background-contributing ions in the focused beam from the photons of interest. These magnetically deflected protons can hit other parts of the payload and scatter back to the focal plane instruments. Evaluating the impact of this secondary scattering with accurate simulations is essential for the CPD scientific assessment. However, while Geant4 simulations of grazing soft proton scattering on X-ray mirrors have been recently validated, the scattering on the unpolished surfaces of the payload (e.g. the baffle or the diverter itself) is still to be verified with experimental results. Moreover, the roughness structure can affect the energy and angle of the scattered protons, with a scattering efficiency depending on the specific target volume. Using Atomic Force Microscopy to take nanometer-scale surface roughness measurements from different materials and coating samples, we use Geant4 together with the CADMesh library to shoot protons at these very detailed surface roughness models to understand the effects of different material surface roughnesses, coatings, and compositions on proton energy deposition and scattering angles. We compare and validate the simulation results with laboratory experiments, and propose a framework for future proton scattering experiments.


title: Three-loop helicity amplitudes for quark-gluon scattering in QCD

abstract: We compute the three-loop helicity amplitudes for $q\bar{q} \to gg$ and its crossed partonic channels, in massless QCD. Our analytical results provide a non-trivial check of the color quadrupole contribution to the infrared poles for external states in different color representations. At high energies, the $qg \to qg$ amplitude shows the predicted factorized form from Regge theory and confirms previous results for the gluon Regge trajectory extracted from $qq' \to qq'$ and $gg \to gg$ scattering.


title: Millisecond Pulsars in Dense Star Clusters: Evolution, Scaling Relations, and the Galactic-Center Gamma-ray Excess

abstract: The number of millisecond pulsars (MSPs) observed in Milky Way globular clusters has increased explosively in recent years, but the underlying population is still uncertain due to observational biases. We use state-of-the-art $N$-body simulations to study the evolution of MSP populations in dense star clusters. These cluster models span a wide range in initial conditions, including different initial masses, metallicities, and virial radii, which nearly cover the full range of properties exhibited by the population of globular clusters in the Milky Way. We demonstrate how different initial cluster properties affect the number of MSPs, for which we provide scaling relations as a function of cluster age and mass. As an application, we use our formulae to estimate the number of MSPs delivered to the Galactic Center from inspiralling globular clusters to probe the origin of the Galactic-Center gamma-ray excess detected by Fermi. We predict about $400$ MSPs in the Galactic Center from disrupted globular clusters, which can potentially explain most of the observed gamma-ray excess.


title: Multi-critical Points in Black Hole Phase Transitions

abstract: We present the first examples in black hole thermodynamics of multicritical phase transitions, in which more than three distinct black hole phases merge at a critical point. Working in the context of non-linear electrodynamics, we explicitly present examples of black hole quadruple and quintuple points, and demonstrate how $n$-tuple critical points can be obtained. Our results indicate that black holes can have multiple phases beyond the three types observed so far, resembling the behaviour of multicomponent chemical systems. We discuss the interpretation of our results in the context of the Gibbs Phase Rule.


title: Testing the Collisionless Nature of Dark Matter with the Radial Acceleration Relation in Galaxy Clusters

abstract: The radial acceleration relation (RAR) represents a tight empirical relation between the inferred total and baryonic centripetal accelerations, $g_{\rm{tot}}=GM_{\rm{tot}}(<r)/r^2$ and $g_{\rm{bar}}=GM_{\rm{bar}}(<r)/r^2$, observed in galaxies and galaxy clusters. The tight correlation between these two quantities can provide insight into the nature of dark matter. Here we use BAHAMAS, a state-of-the-art suite of cosmological hydrodynamical simulations, to characterize the RAR in cluster-scale halos for both cold and collisionless dark matter (CDM) and self-interacting dark matter (SIDM) models. SIDM halos generally have reduced central dark matter densities, which reduces the total acceleration in the central region when compared with CDM. We compare the RARs in galaxy clusters simulated with different dark matter models to the RAR inferred from CLASH observations. Our comparison shows that the cluster-scale RAR in the CDM model provides an excellent match to the CLASH RAR obtained by Tian et al. including the high-acceleration regime probed by the brightest cluster galaxies (BCGs). By contrast, models with a larger SIDM cross-section yield increasingly poorer matches to the CLASH RAR. Excluding the BCG regions results in a weaker but still competitive constraint on the SIDM cross-section. Using the RAR data outside the central $r<100$kpc region, an SIDM model with $\sigma/m=0.3$cm$^{2}$g$^{-1}$ is disfavored at the $3.8\sigma$ level with respect to the CDM model. This study demonstrates the power of the cluster-scale RAR for testing the collisionless nature of dark matter.


title: Negative Mass Black Holes in de-Sitter Space

abstract: We show that asymptotically de Sitter black holes of negative mass can exist in Lovelock gravity. Such black holes have horizon geometries with non-constant curvature and are known as Exotic Black Holes. We explicitly examine the case of Gauss-Bonnet gravity. We briefly discuss the positive mass case where we show how the transverse space geometry affects whether a black hole will exist or not.For negative mass solutions we shown how three different black hole spacetimes are possible depending on the transverse space geometry. We also provide closed form expressions for the geometric parameters to ensure that a black hole spacetime is observed. We close with a discussion of the massless case, where there are many different spacetimes that are permitted.


title: Removing degeneracy and multimodality in gravitational wave source parameters

abstract: Quasicircular binary black hole mergers are described by 15 parameters, of which gravitational wave observations can typically constrain only $\sim 10$ independent combinations to varying degree. In this work, we devise coordinates that remove correlations, and disentangle well- and poorly-measured quantities. Additionally, we identify approximate discrete symmetries in the posterior as the primary cause of multimodality, and design a method to tackle this type of multimodality. The resulting posteriors have little structure and can be sampled efficiently and robustly. We provide a Python package for parameter estimation, cogwheel, that implements these methods together with other algorithms for accelerating the inference process. One of the coordinates we introduce is a spin azimuth that is measured remarkably well in several events. We suggest this might be a sensitive indicator of orbital precession, and we anticipate that it will shed light on the occurrence of spin-orbit misalignment in nature.


title: Meta-Learning the Difference: Preparing Large Language Models for Efficient Adaptation

abstract: Large pretrained language models (PLMs) are often domain- or task-adapted via fine-tuning or prompting. Finetuning requires modifying all of the parameters and having enough data to avoid overfitting while prompting requires no training and few examples but limits performance. Instead, we prepare PLMs for data- and parameter-efficient adaptation by learning to learn the difference between general and adapted PLMs. This difference is expressed in terms of model weights and sublayer structure through our proposed dynamic low-rank reparameterization and learned architecture controller. Experiments on few-shot dialogue completion, low-resource abstractive summarization, and multi-domain language modeling show improvements in adaptation time and performance over direct finetuning or preparation via domain-adaptive pretraining. Ablations show our task-adaptive reparameterization (TARP) and model search (TAMS) components individually improve on other parameter-efficient transfer like adapters and structure-learning methods like learned sparsification.


title: Gravitational Waves from Current-Carrying Cosmic Strings

abstract: Cosmic strings are predicted by many Standard Model extensions involving the cosmological breaking of a symmetry with nontrivial first homotopy group and represent a potential source of primordial gravitational waves (GWs). Present efforts to model the GW signal from cosmic strings are often based on minimal models, such as, eg, the Nambu--Goto action that describes cosmic strings as exactly one-dimensional objects without any internal structure. In order to arrive at more realistic predictions, it is therefore necessary to consider nonminimal models that make an attempt at accounting for the microscopic properties of cosmic strings. With this goal in mind, we derive in this paper the GW spectrum emitted by current-carrying cosmic strings (CCCSs), which may form in a variety of cosmological scenarios. Our analysis is based on a generalized version of the velocity-dependent one-scale (VOS) model, which, in addition to the mean velocity and correlation length of the string network, also describes the evolution of a chiral (light-like) current. As we are able to show, the solutions of the VOS equations imply a temporarily growing fractional cosmic-string energy density, $\Omega_{\rm cs}$. This results in an enhanced GW signal across a broad frequency interval, whose boundaries are determined by the times of generation and decay of cosmic-string currents. Our findings have important implications for GW experiments in the Hz to MHz band and motivate the construction of realistic particle physics models that give rise to large currents on cosmic strings.


title: Energy Correlators of Hadronically Decaying Electroweak Bosons

abstract: Energy correlators are field-theoretically clean and phenomenologically valuable probes of QCD dynamics. We explore the possibility of using the information encoded in the energy correlators of a hadronically decaying electroweak vector boson in order to extract its full decay density matrix. The kinematics of the one- and two-point energy correlators can indeed discriminate between longitudinal and transverse modes and reveal the interference pattern between different vector polarizations. Such observables improve the sensitivity to microscopic new physics affecting the production rate of the different helicities. We assess the impact on higher dimensional EFT operators in simple scenarios.


title: The effect of smooth parametrizations on nonconvex optimization landscapes

abstract: We develop new tools to study landscapes in nonconvex optimization. Given one optimization problem, we pair it with another by smoothly parametrizing the domain. This is either for practical purposes (e.g., to use smooth optimization algorithms with good guarantees) or for theoretical purposes (e.g., to reveal that the landscape satisfies a strict saddle property). In both cases, the central question is: how do the landscapes of the two problems relate? More precisely: how do desirable points such as local minima and critical points in one problem relate to those in the other problem? A key finding in this paper is that these relations are often determined by the parametrization itself, and are almost entirely independent of the cost function. Accordingly, we introduce a general framework to study parametrizations by their effect on landscapes. The framework enables us to obtain new guarantees for an array of problems, some of which were previously treated on a case-by-case basis in the literature. Applications include: optimizing low-rank matrices and tensors through factorizations; solving semidefinite programs via the Burer-Monteiro approach; training neural networks by optimizing their weights and biases; and quotienting out symmetries.


title: False Negative Reduction in Semantic Segmentation under Domain Shift using Depth Estimation

abstract: State-of-the-art deep neural networks demonstrate outstanding performance in semantic segmentation. However, their performance is tied to the domain represented by the training data. Open world scenarios cause inaccurate predictions which is hazardous in safety relevant applications like automated driving. In this work, we enhance semantic segmentation predictions using monocular depth estimation to improve segmentation by reducing the occurrence of non-detected objects in presence of domain shift. To this end, we infer a depth heatmap via a modified segmentation network which generates foreground-background masks, operating in parallel to a given semantic segmentation network. Both segmentation masks are aggregated with a focus on foreground classes (here road users) to reduce false negatives. To also reduce the occurrence of false positives, we apply a pruning based on uncertainty estimates. Our approach is modular in a sense that it post-processes the output of any semantic segmentation network. In our experiments, we observe less non-detected objects of most important classes and an enhanced generalization to other domains compared to the basic semantic segmentation prediction.


title: Hypercritical accretion during common envelopes in triples leading to binary black holes in the pair-instability-supernova mass gap

abstract: Hydrodynamic studies of stellar-mass compact objects (COs) in a common envelope (CE)have shown that the accretion rate onto the CO is a few orders of magnitude below the Bondi-Hoyle-Lyttleton (BHL) estimate. This is several orders of magnitude above the Eddington limit and above the limit for neutrino-cooled accretion (i.e., hypercritical accretion, or HCA). Considering that a binary system inside the CE of a third star accretes material at nearly the same rate as a single object of the same total mass, we propose stellar-evolution channels which form binary black hole (BBH) systems with its component masses within the pair-instability supernova (PISN) mass gap. Our model is based on HCA onto the BBH system engulfed into the CE of a massive tertiary star. Furthermore, we propose a mass transfer mode which allows to store mass lost by the binary onto a third star. Through the use of population synthesis simulations for the evolution of BBHs and standard binary-evolution principles for the interaction with a tertiary star, we are able to produce BBHs masses consistent with those estimated for GW190521. We also discuss the massive binary system Mk34 as a possible progenitor of BBHs in the PISN gap, as well as the spin distribution of the observed mergers in the gravitational-wave catalog.


title: Thermal spin dynamics of Kitaev magnets $-$ scattering continua and magnetic field induced phases within a stochastic semiclassical approach

abstract: The honeycomb magnet $\alpha-$RuCl$_3$ is a prime candidate material for realizing the Kitaev quantum spin liquid (QSL), but it shows long-range magnetic order at low temperature. Nevertheless, its broad inelastic neutron scattering (INS) response at finite frequency has been interpreted as that of a 'proximate QSL'. A moderate in-plane magnetic field indeed melts the residual zigzag order, giving rise to peculiar intermediate field phases before the high-field polarized state. In INS measurements the low-frequency spin waves disappear, leading to a broad scattering continuum in the field-induced intermediate regime, whose nature is currently under debate. Here, we study the magnetic field dependent spin dynamics of the $K-\Gamma-\Gamma'-$model within a stochastic semiclassical treatment, which incorporates the effect of finite-temperature fluctuations. At temperatures relevant for INS experiments, we show how the excitations of the zigzag phase broaden and that the different intermediate phases all show a similar continuum response. We discuss the implications of our results for experiments and highlight the importance of distinguishing finite temperature fluctuations from genuine quantum fractionalization signatures in frustrated magnets.


title: Residuals of an Equilibrium Model for the Galaxy Reveal a State of Disequilibrium in the Solar Neighborhood

abstract: We simultaneously model the gravitational potential and phase space distribution function (DF) of giant stars near the Sun using the {\it Gaia} DR2 radial velocity catalog. We assume that the Galaxy is in equilibrium and is symmetric about both the spin axis of the disk and the Galactic midplane. The potential is taken as a sum of terms that nominally represent contributions from the gas disk, stellar disk, bulge, and dark matter halo. Our DF model for the giants comprise two components to account for a mix of thin and thick disk stars. The DF for each component is described by an analytic function of the energy, the spin angular momentum, and the vertical energy, in accord with Jeans theorem. We present model predictions for the radial and vertical forces within $\sim 2\,{\rm kpc}$ of the Sun, highlighting the rotation curve and vertical force profile in the Solar Neighbourhood. Finally, we show residuals for star counts in the $R-z$ and $z-v_z$ planes as well as maps of the mean radial and azimuthal velocities in the $z-v_z$ plane. Using our model for the potential, we also examine the star count residuals in action-frequency-angle coordinates. The {\it Gaia} phase spirals, velocity arches, some of the known moving groups and bending modes appear as well-defined features in these maps.


title: HierarchicalForecast: A Reference Framework for Hierarchical Forecasting in Python

abstract: Large collections of time series data are commonly organized into structures with different levels of aggregation; examples include product and geographical groupings. It is often important to ensure that the forecasts are coherent so that the predicted values at disaggregate levels add up to the aggregate forecast. The growing interest of the Machine Learning community in hierarchical forecasting systems indicates that we are in a propitious moment to ensure that scientific endeavors are grounded on sound baselines. For this reason, we put forward the HierarchicalForecast library, which contains preprocessed publicly available datasets, evaluation metrics, and a compiled set of statistical baseline models. Our Python-based reference framework aims to bridge the gap between statistical and econometric modeling, and Machine Learning forecasting research. Code and documentation are available in https://github.com/Nixtla/hierarchicalforecast.


title: The Complexity of Proportionality Degree in Committee Elections

abstract: Over the last few years, researchers have put significant effort into understanding of the notion of proportional representation in committee election. In particular, recently they have proposed the notion of proportionality degree. We study the complexity of computing committees with a given proportionality degree and of testing if a given committee provides a particular one. This way, we complement recent studies that mostly focused on the notion of (extended) justified representation. We also study the problems of testing if a cohesive group of a given size exists and of counting such groups.


title: Improving the accuracy of discretisations of the vector transport equation on the lowest-order quadrilateral Raviart-Thomas finite elements

abstract: Within finite element models of fluids, vector-valued fields such as velocity or momentum variables are commonly discretised using the Raviart-Thomas elements. However, when using the lowest-order quadrilateral Raviart-Thomas elements, standard finite element discretisations of the vector transport equation typically have a low order of spatial accuracy. This paper describes two schemes that improve the accuracy of transporting such vector-valued fields on two-dimensional curved manifolds. The first scheme that is presented reconstructs the transported field in a higher-order function space, where the transport equation is then solved. The second scheme applies a mixed finite element formulation to the vector transport equation, simultaneously solving for the transported field and its vorticity. An approach to stabilising this mixed vector-vorticity formulation is presented that uses a Streamline Upwind Petrov-Galerkin (SUPG) method. These schemes are then demonstrated, along with their accuracy properties, through some numerical tests. Two new test cases are used to assess the transport of vector-valued fields on curved manifolds, solving the vector transport equation in isolation. The improvement of the schemes is also shown through two standard test cases for rotating shallow-water models.


title: Should All Proposals be Treated Equally in Object Detection?

abstract: The complexity-precision trade-off of an object detector is a critical problem for resource constrained vision tasks. Previous works have emphasized detectors implemented with efficient backbones. The impact on this trade-off of proposal processing by the detection head is investigated in this work. It is hypothesized that improved detection efficiency requires a paradigm shift, towards the unequal processing of proposals, assigning more computation to good proposals than poor ones. This results in better utilization of available computational budget, enabling higher accuracy for the same FLOPS. We formulate this as a learning problem where the goal is to assign operators to proposals, in the detection head, so that the total computational cost is constrained and the precision is maximized. The key finding is that such matching can be learned as a function that maps each proposal embedding into a one-hot code over operators. While this function induces a complex dynamic network routing mechanism, it can be implemented by a simple MLP and learned end-to-end with off-the-shelf object detectors. This 'dynamic proposal processing' (DPP) is shown to outperform state-of-the-art end-to-end object detectors (DETR, Sparse R-CNN) by a clear margin for a given computational complexity.


title: On the greatest common divisor of $n$ and the $n$th Fibonacci number, II

abstract: Let $\mathcal{A}$ be the set of all integers of the form $\gcd(n, F_n)$, where $n$ is a positive integer and $F_n$ denotes the $n$th Fibonacci number. Leonetti and Sanna proved that $\mathcal{A}$ has natural density equal to zero, and asked for a more precise upper bound. We prove that \begin{equation*} \#\big(\mathcal{A} \cap [1, x]\big) \ll \frac{x \log \log \log x}{\log \log x} \end{equation*} for all sufficiently large $x$.


title: TF-GNN: Graph Neural Networks in TensorFlow

abstract: TensorFlow-GNN (TF-GNN) is a scalable library for Graph Neural Networks in TensorFlow. It is designed from the bottom up to support the kinds of rich heterogeneous graph data that occurs in today's information ecosystems. In addition to enabling machine learning researchers and advanced developers, TF-GNN offers low-code solutions to empower the broader developer community in graph learning. Many production models at Google use TF-GNN, and it has been recently released as an open source project. In this paper we describe the TF-GNN data model, its Keras message passing API, and relevant capabilities such as graph sampling and distributed training.

categories: cs.LG cs.NE cs.SI physics.soc-ph stat.ML


title: Winning the lottery with neural connectivity constraints: faster learning across cognitive tasks with spatially constrained sparse RNNs

abstract: Recurrent neural networks (RNNs) are often used to model circuits in the brain, and can solve a variety of difficult computational problems requiring memory, error-correction, or selection [Hopfield, 1982, Maass et al., 2002, Maass, 2011]. However, fully-connected RNNs contrast structurally with their biological counterparts, which are extremely sparse (~0.1%). Motivated by the neocortex, where neural connectivity is constrained by physical distance along cortical sheets and other synaptic wiring costs, we introduce locality masked RNNs (LM-RNNs) that utilize task-agnostic predetermined graphs with sparsity as low as 4%. We study LM-RNNs in a multitask learning setting relevant to cognitive systems neuroscience with a commonly used set of tasks, 20-Cog-tasks [Yang et al., 2019]. We show through reductio ad absurdum that 20-Cog-tasks can be solved by a small pool of separated autapses that we can mechanistically analyze and understand. Thus, these tasks fall short of the goal of inducing complex recurrent dynamics and modular structure in RNNs. We next contribute a new cognitive multi-task battery, Mod-Cog, consisting of upto 132 tasks that expands by 7-fold the number of tasks and task-complexity of 20-Cog-tasks. Importantly, while autapses can solve the simple 20-Cog-tasks, the expanded task-set requires richer neural architectures and continuous attractor dynamics. On these tasks, we show that LM-RNNs with an optimal sparsity result in faster training and better data-efficiency than fully connected networks.


title: Aerobatic Trajectory Generation for a VTOL Fixed-Wing Aircraft Using Differential Flatness

abstract: This paper proposes a novel algorithm for aerobatic trajectory generation for a vertical take-off and landing (VTOL) tailsitter flying wing aircraft. The algorithm differs from existing approaches for fixed-wing trajectory generation, as it considers a realistic six-degree-of-freedom (6DOF) flight dynamics model, including aerodynamics equations. Using a global dynamics model enables the generation of aerobatics trajectories that exploit the entire flight envelope, enabling agile maneuvering through the stall regime, sideways uncoordinated flight, inverted flight etc. The method uses the differential flatness property of the global tailsitter flying wing dynamics, which is derived in this work. By performing snap minimization in the differentially flat output space, a computationally efficient algorithm, suitable for online motion planning, is obtained. The algorithm is demonstrated in extensive flight experiments encompassing six aerobatics maneuvers, a time-optimal drone racing trajectory, and an airshow-like aerobatic sequence for three tailsitter aircraft.


title: Ride-Hailing for Autonomous Vehicles: Hyperledger Fabric-Based Secure and Decentralize Blockchain Platform

abstract: Ride-hailing and ride-sharing applications have recently gained popularity as a convenient alternative to traditional modes of travel. Current research into autonomous vehicles is accelerating rapidly and will soon become a critical component of a ride-hailing platforms architecture. Implementing an autonomous vehicle ride-hailing platform proves a difficult challenge due to the centralized nature of traditional ride-hailing architectures. In a traditional ride-hailing environment the drivers operate their own personal vehicles so it follows that a fleet of autonomous vehicles would be required for a centralized ride-hailing platform to succeed. Decentralization of the ride-hailing platform would remove a roadblock along the way to an autonomous vehicle ride-hailing platform by allowing owners of autonomous vehicles to add their vehicles to a community-driven fleet when not in use. Blockchain technology is an attractive choice for this decentralized architecture due to its immutability and fault tolerance. This thesis proposes a framework for developing a decentralized ride-hailing architecture that is verifiably secure. This framework is implemented on the Hyperledger Fabric blockchain platform. The evaluation of the implementation is done by applying known security models, utilizing a static analysis tool, and performing a performance analysis under heavy network load.


title: Reinforcement Learning-based Joint User Scheduling and Link Configuration in Millimeter-wave Networks

abstract: In this paper, we develop algorithms for joint user scheduling and three types of mmWave link configuration: relay selection, codebook optimization, and beam tracking in millimeter wave (mmWave) networks. Our goal is to design an online controller that dynamically schedules users and configures their links to minimize the system delay. To solve this complex scheduling problem, we model it as a dynamic decision-making process and develop two reinforcement learning-based solutions. The first solution is based on deep reinforcement learning (DRL), which leverages the proximal policy optimization to train a neural network-based solution. Due to the potential high sample complexity of DRL, we also propose an empirical multi-armed bandit (MAB)-based solution, which decomposes the decision-making process into a sequential of sub-actions and exploits classic maxweight scheduling and Thompson sampling to decide those sub-actions. Our evaluation of the proposed solutions confirms their effectiveness in providing acceptable system delay. It also shows that the DRL-based solution has better delay performance while the MAB-based solution has a faster training process.


title: Semi-analytical near-Earth objects propagation: the orbit history of (35107) 1991 VH and (175706) 1996 FG3

abstract: The propagation of small bodies in the Solar system is driven by the combination of planetary encounters that cause abrupt changes in their orbits and secular long-term perturbations. We propose a propagation strategy that combines both of these effects into a single framework for long-term, rapid propagation of small bodies in the inner Solar System. The analytical secular perturbation of Jupiter is interrupted to numerically solve planetary encounters, which last a small fraction of the simulation time. The proposed propagation method is compared to numerical integrations in the Solar system, effectively capturing properties of the numerical solutions in a fraction of the computational time. We study the orbital history of the Janus mission targets: (35107) 1991 VH and (175706) 1996 FG3, obtaining a stochastic representation of their long-term dynamics and frequencies of very close encounters. Over the last million years the probability of a strongly perturbing flyby is found to be small.


title: Universal quantum (semi)groups and Hopf envelopes: Erratum

abstract: In \cite{F} there is a statement generalizing the results in \cite{FG}. Unfortunately there is a mistake in a computation that affects the main result. I don't know if the main result in \cite{F} is true or not, but I propose an alternative statement (Theorem 3.7) that was actually the main motivation in \cite{FG}. This statement answers in an affirmative way the question whether the localization of the FRT construction with respect to a quantum determinant is a Hopf algebra, in case the Nichols algebra associated to the braiding is finite dimensional.


title: A Novel IoT-based Framework for Non-Invasive Human Hygiene Monitoring using Machine Learning Techniques

abstract: People's personal hygiene habits speak volumes about the condition of taking care of their bodies and health in daily lifestyle. Maintaining good hygiene practices not only reduces the chances of contracting a disease but could also reduce the risk of spreading illness within the community. Given the current pandemic, daily habits such as washing hands or taking regular showers have taken primary importance among people, especially for the elderly population living alone at home or in an assisted living facility. This paper presents a novel and non-invasive framework for monitoring human hygiene using vibration sensors where we adopt Machine Learning techniques. The approach is based on a combination of a geophone sensor, a digitizer, and a cost-efficient computer board in a practical enclosure. Monitoring daily hygiene routines may help healthcare professionals be proactive rather than reactive in identifying and controlling the spread of potential outbreaks within the community. The experimental result indicates that applying a Support Vector Machine (SVM) for binary classification exhibits a promising accuracy of ~95% in the classification of different hygiene habits. Furthermore, both tree-based classifier (Random Forrest and Decision Tree) outperforms other models by achieving the highest accuracy (100%), which means that classifying hygiene events using vibration and non-invasive sensors is possible for monitoring hygiene activity.


title: VMAS: A Vectorized Multi-Agent Simulator for Collective Robot Learning

abstract: While many multi-robot coordination problems can be solved optimally by exact algorithms, solutions are often not scalable in the number of robots. Multi-Agent Reinforcement Learning (MARL) is gaining increasing attention in the robotics community as a promising solution to tackle such problems. Nevertheless, we still lack the tools that allow us to quickly and efficiently find solutions to large-scale collective learning tasks. In this work, we introduce the Vectorized Multi-Agent Simulator (VMAS). VMAS is an open-source framework designed for efficient MARL benchmarking. It is comprised of a vectorized 2D physics engine written in PyTorch and a set of twelve challenging multi-robot scenarios. Additional scenarios can be implemented through a simple and modular interface. We demonstrate how vectorization enables parallel simulation on accelerated hardware without added complexity. When comparing VMAS to OpenAI MPE, we show how MPE's execution time increases linearly in the number of simulations while VMAS is able to execute 30,000 parallel simulations in under 10s, proving more than 100x faster. Using VMAS's RLlib interface, we benchmark our multi-robot scenarios using various Proximal Policy Optimization (PPO)-based MARL algorithms. VMAS's scenarios prove challenging in orthogonal ways for state-of-the-art MARL algorithms. The VMAS framework is available at https://github.com/proroklab/VectorizedMultiAgentSimulator. A video of VMAS scenarios and experiments is available at https://youtu.be/aaDRYfiesAY.


title: Central limit theorem for the principal eigenvalue and eigenvector of Chung-Lu random graphs

abstract: A Chung-Lu random graph is an inhomogeneous Erd\H{o}s-R\'enyi random graph in which vertices are assigned average degrees, and pairs of vertices are connected by an edge with a probability that is proportional to the product of their average degrees, independently for different edges. We derive a central limit theorem for the principal eigenvalue and the components of the principal eigenvector of the adjacency matrix of a Chung-Lu random graph. Our derivation requires certain assumptions on the average degrees that guarantee connectivity, sparsity and bounded inhomogeneity of the graph.

categories: math.PR cond-mat.dis-nn cond-mat.stat-mech math-ph math.MP


title: RELICS: Small-scale Star Formation in Lensed Galaxies at $z = 6-10$

abstract: Detailed observations of star forming galaxies at high redshift are critical to understand the formation and evolution of the earliest galaxies. Gravitational lensing provides an important boost, allowing observations at physical scales unreachable in unlensed galaxies. We present three lensed galaxies from the RELICS survey at $z_{phot} = 6 - 10$, including the most highly magnified galaxy at $z_{phot} \sim 6$ (WHL0137-zD1, dubbed the Sunrise Arc), the brightest known lensed galaxy at $z_{phot} \sim 6$ (MACS0308-zD1), and the only spatially resolved galaxy currently known at $z_{phot} \sim 10$ (SPT0615-JD). The Sunrise Arc contains seven star-forming clumps with delensed radii as small as 3 pc, the smallest spatial scales yet observed in a $z>6$ galaxy, while SPT0615-JD contains features measuring a few tens of parsecs. MACS0308-zD1 contains a $r\sim 30$ pc clump with a star formation rate (SFR) of $\sim 3 M_{\odot} \textrm{ yr}^{-1}$, giving it a SFR surface density of $\Sigma_{SFR} \sim 10^3 M_{\odot}\textrm{ yr}^{-1}\textrm{ kpc}^{-2}$. These galaxies provide a unique window into small scale star formation during the Epoch of Reionization. They will be excellent targets for future observations with JWST, including one approved program targeting the Sunrise Arc.


title: Non-isomorphic smooth compactifications of the moduli space of cubic surfaces

abstract: The moduli space of complex cubic surfaces has three different, but isomorphic, compact realizations: as a GIT quotient, as a Baily--Borel compactification of a ball quotient, and as a compactified $K$-moduli space. From all three perspectives, there is a unique boundary point corresponding to non-stable surfaces. From the GIT point of view, to deal with this point, it is natural to consider the Kirwan blowup, while from the ball quotient point of view it is natural to consider the toroidal compactification. Both these spaces have the same cohomology and and it is therefore natural to ask whether they are isomorphic. Here we show that this is in fact not the case. Indeed, we show the more refined statement that both spaces are equivalent in the Grothendieck ring, but not $K$-equivalent. Along the way, we establish a number of results and techniques for dealing with singularities and canonical classes of Kirwan blowups and toroidal compactifications of ball quotients.


title: A Review of Quantum Cybersecurity: Threats, Risks and Opportunities

abstract: The promise of quantum computing is not speeding up conventional computing rather delivering an exponential advantage for certain classes of problems, with profound implications for cybersecurity for instance. With the advent and development of quantum computers, cyberspace security can surely become the most critical problem for the Internet in near future. On contrary, prosaic quantum technology can be promising to transform cybersecurity. This research aims to synthesize basic and fundamental studies concerning quantum cybersecurity that can be emerged both as a threat and solution to critical cybersecurity issues based on a systematic study. We provide a comprehensive, illustrative description of the current state-of-the-art quantum computing and cybersecurity and present the proposed approaches to date. Findings in quantum computing cybersecurity suggest that quantum computing can be adopted for the betterment of cybersecurity threats while it poses the most unexpected threats to cybersecurity. The focus and depth of this systematic survey not only provide quantum and cybersecurity practitioners and researchers with a consolidated body of knowledge about current trends in this area but also underpins a starting point for further research in this field.


title: CMC Tori in the Generalised Berger Spheres and their Duals

abstract: The study of minimal surfaces has a long history, due to the important applications. Given a fixed boundary, one wants to minimise the surface area: this can be used, for example, to minimise the area of the roof of a building. Similarly, looking for constant mean curvature (CMC) provides us with many interesting applications in physics: one of the easiest examples are soap bubbles. In this work however we occupy ourselves with minimal and constant mean curvature surfaces in the three-dimensional sphere $S^3$ and its dual space $\Sigma^3$. In Chapter 1 we give a brief overview of the tools of Riemannian and Lorentzian geometry that we will use. We then take a closer look at $S^3$, computing its Levi-Civita connection and sectional curvatures: in Chapter 2 with respect to the Riemannian metric g and in Chapter 4 with respect to the Lorentzian metric h. Further, we determine some minimal and CMC tori inside ($S^3$, g) in Chapter 3 and in ($S^3$, h) in Chapter 5. We then proceed with the dual space $\Sigma^3$ of $S^3$. In Chapter 6, we calculate the Levi-Civita connection and sectional curvatures with respect to g, and with respect to h in Chapter 8. Again we look for minimal and CMC tori of a certain family in ($\Sigma^3$, g) in Chapter 7 and in ($\Sigma^3$, h) in Chapter 9. In the appendix, the reader will find a Maple program. It was written to check the computations of the $S^3$ cases, but it can easily be adapted to$\Sigma^3$.


title: Deep Learning to Jointly Schema Match, Impute, and Transform Databases

abstract: An applied problem facing all areas of data science is harmonizing data sources. Joining data from multiple origins with unmapped and only partially overlapping features is a prerequisite to developing and testing robust, generalizable algorithms, especially in health care. We approach this issue in the common but difficult case of numeric features such as nearly Gaussian and binary features, where unit changes and variable shift make simple matching of univariate summaries unsuccessful. We develop two novel procedures to address this problem. First, we demonstrate multiple methods of "fingerprinting" a feature based on its associations to other features. In the setting of even modest prior information, this allows most shared features to be accurately identified. Second, we demonstrate a deep learning algorithm for translation between databases. Unlike prior approaches, our algorithm takes advantage of discovered mappings while identifying surrogates for unshared features and learning transformations. In synthetic and real-world experiments using two electronic health record databases, our algorithms outperform existing baselines for matching variable sets, while jointly learning to impute unshared or transformed variables.


title: ALMA-IMF IV -- A comparative study of the main hot cores in W43-MM1: detection, temperature and molecular composition

abstract: W43-MM1 is a young region, very rich in terms of high-mass star formation. We aim to systematically identify the massive cores which contain a hot core and compare their molecular composition. We used ALMA high-spatial resolution (2500 au) data of W43-MM1 to identify line-rich protostellar cores and make a comparative study of their temperature and molecular composition. The identification of hot cores is based on both the spatial distribution of the complex organic molecules and the contribution of molecular lines relative to the continuum intensity. We rely on the analysis of CH3CN and CH3CCH to estimate the temperatures of the selected cores. Finally, we rescale the spectra of the different hot cores based on their CH3OCHO line intensities to directly compare the detections and line intensities of the other species. W43-MM1 turns out to be a region rich in massive hot cores with at least 1 less massive and 7 massive hot cores. The excitation temperature of CH3CN is of the same order for all of them (120-160 K). There is a factor of up to 30 difference in the intensity of the complex organic molecules (COMs) lines. However the molecular emission of the hot cores appears to be the same within a factor 2-3. This points towards both a similar chemical composition and excitation of most of the COMs over these massive cores, which span about an order of magnitude in core mass. In contrast, CH3CCH emission is found to preferentially trace more the envelope, with a temperature ranging from 50 K to 90 K. Core 1, the most massive hot core of W43-MM1, shows a richer line spectrum than the other cores. In core 2, the emission of O-bearing molecules does not peak at the dust continuum core center; the blue and red shifted emission correspond to the outflow lobes, suggesting a formation via the sublimation of the ice mantles through shocks or UV irradiation on the walls of the cavity.


title: Oxygen vacancy dynamics in Pt/TiOx/TaOy/Pt memristors: exchange with the environment and internal electromigration

abstract: Memristors are expected to be one of the key building blocks for the development of new bio-inspired nanoelectronics. Memristive effects in transition metal oxides are usually linked to the electromigration at the nanoscale of charged oxygen vacancies (OV). In this paper we address, for Pt/TiOx/TaOy/Pt devices, the exchange of OV between the device and the environment upon the application of electrical stress. From a combination of experiments and theoretical simulations we determine that both TiOx and TaOy layers oxidize, via environmental oxygen uptake, during the electroforming process. Once the memristive effect is stabilized (post-forming behavior) our results suggest that oxygen exchange with the environment is suppressed and the OV dynamics that drives the memristive behavior is restricted to an internal electromigration between TiOx and TaOy layers. Our work provides relevant information for the design of reliable binary oxide memristive devices.


title: RWT-SLAM: Robust Visual SLAM for Highly Weak-textured Environments

abstract: As a fundamental task for intelligent robots, visual SLAM has made great progress over the past decades. However, robust SLAM under highly weak-textured environments still remains very challenging. In this paper, we propose a novel visual SLAM system named RWT-SLAM to tackle this problem. We modify LoFTR network which is able to produce dense point matching under low-textured scenes to generate feature descriptors. To integrate the new features into the popular ORB-SLAM framework, we develop feature masks to filter out the unreliable features and employ KNN strategy to strengthen the matching robustness. We also retrained visual vocabulary upon new descriptors for efficient loop closing. The resulting RWT-SLAM is tested in various public datasets such as TUM and OpenLORIS, as well as our own data. The results shows very promising performance under highly weak-textured environments.


title: Data integration in systems genetics and aging research

abstract: Human life expectancy has dramatically improved over the course of the last century. Although this reflects a global improvement in sanitation and medical care, this also implies that more people suffer from diseases that typically manifest later in life, like Alzheimer and atherosclerosis. Increasing healthspan by delaying or reverting the development of these age-related diseases has therefore become an urgent challenge in biomedical research. Research in this field is complicated by the multi-factorial nature of age-related diseases. They are rooted in complex physiological mechanisms impacted by heritable, environment and life-style factors that can be unique to each individual. Although technological advances in high-throughput biomolecular assays have enabled researchers to investigate individual physiology at the molecular level, integrating information about its different components, and accounting for individual variations remains a challenge. We are using a large collection of omics and phenotype data derived from the BXD mouse genetic diversity panel to explore how good data management practices, as fostered by the FAIR principles, paired with an explainable artificial intelligence framework, can provide solutions to decipher the complex roots of age-related diseases. These developments will help to propose innovative approaches to extend healthspan in the aging global population.


title: Cherenkov radiation and scattering of external dispersive waves by two-color solitons

abstract: For waveguides with two separate regions of anomalous dispersion, it is possible to create a quasi-stable two-color solitary wave. In this paper we consider how those waves interact with dispersive radiation, both generation of Cherenkov radiation and scattering of incident dispersive waves. We derive the analytic resonance conditions and verify them through numeric experiments. We also report incident radiation driving the internal oscillations of the soliton during the scattering process in case of an intense incident radiation. We generalize the resonance conditions for the case of an oscillating soliton and demonstrate how one can use the scattering process to probe and excite an internal mode of two-color soliton molecules.


title: Emergence of biological transportation networks as a self-regulated process

abstract: We study self-regulating processes modeling biological transportation networks. Firstly, we write the formal $L^2$-gradient flow for the symmetric tensor valued diffusivity $D$ of a broad class of entropy dissipations associated with a purely diffusive model. The introduction of a prescribed electric potential leads to the Fokker-Planck equation, for whose entropy dissipations we also investigate the formal $L^2$-gradient flow. We derive an integral formula for the second variation of the dissipation functional, proving convexity (in dependence of diffusivity tensor) for a quadratic entropy density modeling Joule heating. Finally, we couple in the Poisson equation for the electric potential obtaining the Poisson-Nernst-Planck system. The formal gradient flow of the associated entropy loss functional is derived, giving an evolution equation for $D$ coupled with two auxiliary elliptic PDEs.


title: Highlight Specular Reflection Separation based on Tensor Low-rank and Sparse Decomposition Using Polarimetric Cues

abstract: This paper is concerned with specular reflection removal based on tensor low-rank decomposition framework with the help of polarization information. Our method is motivated by the observation that the specular highlight of an image is sparsely distributed while the remaining diffuse reflection can be well approximated by a linear combination of several distinct colors using a low-rank and sparse decomposition framework. Unlike current solutions, our tensor low-rank decomposition keeps the spatial structure of specular and diffuse information which enables us to recover the diffuse image under strong specular reflection or in saturated regions. We further define and impose a new polarization regularization term as constraint on color channels. This regularization boosts the performance of the method to recover an accurate diffuse image by handling the color distortion, a common problem of chromaticity-based methods, especially in case of strong specular reflection. Through comprehensive experiments on both synthetic and real polarization images, we demonstrate that our method is able to significantly improve the accuracy of highlight specular removal, and outperform the competitive methods to recover the diffuse image, especially in regions of strong specular reflection or in saturated areas.


title: Emergent higher-symmetry protected topological orders in the confined phase of $U(1)$ gauge theory

abstract: We consider compact $U^\kappa(1)$ gauge theory in 3+1D with the $2\pi$-quantized topological term ${\sum_{I, J =1}^\kappa\frac{K_{IJ}}{4\pi}\int_{M^4}F^I\wedge F^J}$. At energies below the gauge charges' gaps but above the monopoles' gaps, this field theory has an emergent ${\mathbb{Z}_{k_1}^{(1)}\times\mathbb{Z}_{k_2}^{(1)}\times\cdots}$ 1-symmetry, where $k_i$ are the diagonal elements of the Smith normal form of $K$ and $\mathbb{Z}_{0}^{(1)}$ is regarded as $U(1)^{(1)}$. In the $U^\kappa(1)$ confined phase, the boundary's IR properties are described by Chern-Simons field theory and has a ${\mathbb{Z}_{k_1}^{(1)}\times\mathbb{Z}_{k_2}^{(1)}\times\cdots}$ 1-symmetry that can be anomalous. To show these results, we develop a bosonic lattice model whose IR properties are described by this field theory, thus acting as its UV completion. The lattice model in the aforementioned limit has an exact ${\mathbb{Z}_{k_1}^{(1)}\times\mathbb{Z}_{k_2}^{(1)}\times\cdots}$ 1-symmetry. We find that a gapped phase of the lattice model, corresponding to the confined phase of the $U^\kappa(1)$ gauge theory, is a symmetry protected topological (SPT) phase for the ${\mathbb{Z}_{k_1}^{(1)}\times\mathbb{Z}_{k_2}^{(1)}\times\cdots}$ 1-symmetry, whose SPT invariant is ${e^{i\pi\sum_{I, J}K_{IJ}\int B_I\smile B_J+B_I\underset{1}{\smile} d B_J}e^{i\pi\sum_{I< J}K_{IJ}\int d B_I\underset{2}{\smile}d B_J}}$. Here, the background 2-cochains $B_I$ satisfy ${d B_I=\sum_I B_{I}K_{IJ} = 0}$ mod $1$ and describe the symmetry twist of the ${\mathbb{Z}_{k_1}^{(1)}\times\mathbb{Z}_{k_2}^{(1)}\times\cdots}$ 1-symmetry. We apply this general result to a few examples with simple $K$ matrices. We find the non-trivial SPT order in the confined phases of these models and discuss its classifications using the fourth cohomology group of the corresponding 2-group.


title: A new type of results on probabilities of moderate deviations for i.i.d. random variables

abstract: Let $\{X, X_{n}; n \geq 1\}$ be a sequence of i.i.d. non-degenerate real-valued random variables with $\mathbb{E}X^{2} < \infty$. Let $S_{n} = \sum_{i=1}^{n} X_{i}$, $n \geq 1$. Let $g(\cdot): ~[0, \infty) \rightarrow [0, \infty)$ be a nondecreasing regularly varying function with index $\rho \geq 0$ and $\lim_{t \rightarrow \infty} g(t) = \infty$. Let $\mu = \mathbb{E}X$ and $\sigma^{2} = \mathbb{E}(X - \mu)^{2}$. In this paper, we obtain precise asymptotic estimates for probabilities of moderate deviations by showing that, for all $x > 0$, \[ \limsup_{n \rightarrow \infty} \frac{\log \mathbb{P}\left(S_{n} - n \mu > x \sqrt{n g(\log n)} \right)}{g(\log n)} = - \left(\frac{x^{2}}{2\sigma^{2}} \wedge \frac{\overline{\lambda}_{1}}{2^{\rho}} \right), \] \[ \liminf_{n \rightarrow \infty} \frac{\log \mathbb{P}\left(S_{n} - n \mu > x \sqrt{n g(\log n)} \right)}{g(\log n)} = - \left(\frac{x^{2}}{2\sigma^{2}} \wedge \frac{\underline{\lambda}_{1}}{2^{\rho}} \right), \] \[ \limsup_{n \rightarrow \infty} \frac{\log \mathbb{P}\left(S_{n} - n \mu < -x \sqrt{n g(\log n)} \right)}{g(\log n)} = - \left(\frac{x^{2}}{2\sigma^{2}} \wedge \frac{\overline{\lambda}_{2}}{2^{\rho}} \right), \] and \[ \liminf_{n \rightarrow \infty} \frac{\log \mathbb{P}\left(S_{n} - n \mu < -x \sqrt{n g(\log n)} \right)}{g(\log n)} = - \left(\frac{x^{2}}{2\sigma^{2}} \wedge \frac{\underline{\lambda}_{2}}{2^{\rho}} \right), \] where $\overline{\lambda}_{1}$ are $\underline{\lambda}_{1}$ are determined by the asymptotic behavior of $\mathbb{P}(X > t)$ and $\overline{\lambda}_{2}$ and $\underline{\lambda}_{2}$ are determined by the asymptotic behavior of $\mathbb{P}(X < -t)$. Unlike those known results in the literature, the moderate deviation results established in this paper depend on both the variance and the asymptotic behavior of the tail distribution of $X$.


title: BibleTTS: a large, high-fidelity, multilingual, and uniquely African speech corpus

abstract: BibleTTS is a large, high-quality, open speech dataset for ten languages spoken in Sub-Saharan Africa. The corpus contains up to 86 hours of aligned, studio quality 48kHz single speaker recordings per language, enabling the development of high-quality text-to-speech models. The ten languages represented are: Akuapem Twi, Asante Twi, Chichewa, Ewe, Hausa, Kikuyu, Lingala, Luganda, Luo, and Yoruba. This corpus is a derivative work of Bible recordings made and released by the Open.Bible project from Biblica. We have aligned, cleaned, and filtered the original recordings, and additionally hand-checked a subset of the alignments for each language. We present results for text-to-speech models with Coqui TTS. The data is released under a commercial-friendly CC-BY-SA license.


title: Anomalous transport in itinerant van der Waals ferromagnets Fe$_n$GeTe$_2$ (\emph{n}=3, 4, 5)

abstract: Ferromagnetic (FM) semimetals Fe$_n$GeTe$_2$(n=3, 4, 5), exhibit several symmetry-protected band-crossing points or lines near the Fermi energy (E$_F$) and these topological properties of energy bands lead to interesting transport properties. We study these materials employing the first-principle calculations and the tight-binding Hamiltonian constructed by fitting the parameters of the first principles calculation. In the presence of spin-orbit coupling (SOC) for n=3,5 a large Berry curvature (BC) concentrated on the nodal lines is observed. The consequence of the correlation of the topological nodal line and magnetic moments on anomalous Hall conductivity (AHC) $\sigma_{xy}$ and anomalous Nernst conductivity (ANC) $\alpha_{xy}$ have been investigated. We find $\sigma_{xy}=150$ S/cm for n=3, 295 S/cm for n=4, and 90 S/cm for n=5 at 0 K, while the ANC is observed as $\alpha_{xy}=0.55$ A/Km for n=3, 0.10 A/Km for n=5, and 0.80 A/Km for n=4, at the E$_F$ at room temperature. Our calculated AHC values at 0 K, i.e., 150 S/cm for Fe$_3$GeTe$_2$ and 90 S/cm Fe$_5$GeTe$_2$, are consistent with the experimentally reported values. Also the experimentally reported value of ANC for Fe$_5$GeTe$_2$ is close to our calculated value at room temperature, i.e., 0.10 A/Km.


title: An Analysis of Uplink Success Probability in Multi-Cell Lora Networks Under Different Channel Models

abstract: The development of the low power wide area network (LPWAN) for the internet of things (IoTs) is expected to grow widely, allowing remote monitoring of smart devices from a distance of up to several kilometers. This paper studies the performance and success probability of multi-cell LoRa networks. Using tools of stochastic geometry, the paper analyzes the important metric namely success probability in both Rayleigh and Rician channel models. The obtained analysis helps investigate and evaluate other quality criteria in the multi-cell LoRa network such as throughput, SNR and SIR requirements. Moreover, we provide numerical simulation results to corroborate the theoretical analysis and to verify how our analysis can characterize the given reliability target.


title: Dynamics of free time-dependent effective mass

abstract: The consensus is that an object with a large mass will not manifest quantum behavior. Therefore, we expect that the quantumness of a time-dependent effective mass (TDEM) will erase after a long time when the mass profile continuously grows with time. However, the present article depicts that the Wigner quasi-probability distribution (WQD) will manifest an entanglement behavour forever for two spatially separated free TDEM. The time-dependent Schr\"{o}dinger equation for a free particle with TDEM is solved with the help of Lewis-Riesenfeld phase space invariant method. WQD for the system of two identical TDEM with quadratically increasing mass profile shows that the particles are never separated. In particular, their reminiscent is present at the origin of the phase-space forever.


title: Trapped-particle microrheology of active suspensions

abstract: In microrheology, the local rheological properties such as viscoelasticity of a complex fluid are inferred from the free or forced motion of embedded colloidal probe particles. Theoretical machinery developed for forced-probe microrheology of colloidal suspensions focused on either constant-force (CF) or constant-velocity (CV) probes while in experiments neither the force nor the kinematics of the probe is fixed. More importantly, the constraint of CF or CV introduces a difficulty in the meaningful quantification of the fluctuations of the probe due to a thermodynamic uncertainty relation. It is known that for a Brownian particle trapped in a harmonic potential well, the product of the standard deviations of the trap force and the particle position is $d k_BT$ in $d$ dimensions with $k_BT$ being the thermal energy. As a result, if the force (position) is not allowed to fluctuate, the position (force) fluctuation becomes infinite. To allow the measurement of fluctuations, in this work we consider a microrheology model in which the embedded probe is dragged along by a moving harmonic potential so that both its position and the trap force are allowed to fluctuate. Starting from the full Smoluchowski equation governing the dynamics of $N$ hard active Brownian particles, we derive a pair Smoluchowski equation describing the dynamics of the probe as it interacts with one bath particle by neglecting hydrodynamic interactions among particles in the dilute limit. From this, we determine the mean and the variance (i.e., fluctuation) of the probe position in terms of the pair probability distribution. We then characterize the behavior of the system in the limits of both weak and strong trap. By taking appropriate limits, we show that our generalized model can be reduced to the well-studied CF or CV microrheology models.


title: Night Sky Brightness Measurement, Quality Assessment and Monitoring

abstract: Ground-based optical astronomy necessarily involves sensing the light of astronomical objects along with the contributions of many natural sources ranging from the Earth's atmosphere to cosmological light. In addition, astronomers have long contended with artificial light pollution that further adds to the 'background' against which astronomical objects are seen. Understanding the brightness of the night sky is therefore fundamental to astronomy. The last comprehensive review of this subject was nearly a half-century ago, and we have learned much about both the natural and artificial night sky since. This Review considers which influences determine the total optical brightness of the night sky; the means by which that brightness is measured; and how night sky quality is assessed and monitored in the long term.


title: An Embedding-Dynamic Approach to Self-supervised Learning

abstract: A number of recent self-supervised learning methods have shown impressive performance on image classification and other tasks. A somewhat bewildering variety of techniques have been used, not always with a clear understanding of the reasons for their benefits, especially when used in combination. Here we treat the embeddings of images as point particles and consider model optimization as a dynamic process on this system of particles. Our dynamic model combines an attractive force for similar images, a locally dispersive force to avoid local collapse, and a global dispersive force to achieve a globally-homogeneous distribution of particles. The dynamic perspective highlights the advantage of using a delayed-parameter image embedding (a la BYOL) together with multiple views of the same image. It also uses a purely-dynamic local dispersive force (Brownian motion) that shows improved performance over other methods and does not require knowledge of other particle coordinates. The method is called MSBReg which stands for (i) a Multiview centroid loss, which applies an attractive force to pull different image view embeddings toward their centroid, (ii) a Singular value loss, which pushes the particle system toward spatially homogeneous density, (iii) a Brownian diffusive loss. We evaluate downstream classification performance of MSBReg on ImageNet as well as transfer learning tasks including fine-grained classification, multi-class object classification, object detection, and instance segmentation. In addition, we also show that applying our regularization term to other methods further improves their performance and stabilize the training by preventing a mode collapse.


title: Rotated ansatz for approximate counterdiabatic driving

abstract: Approximate counterdiabatic (CD) protocols are a powerful tool to enhance quantum adiabatic processes that allow to reliably manipulate quantum systems on short time scales. However, implementing CD protocols entails the introduction of additional control fields in the Hamiltonian, often associated with highly non-local multi-body interactions. Here, we introduce a novel variational rotated ansatz (RA) to systematically generate experimentally accessible approximate CD protocols. We numerically benchmark our approach on state preparation and adiabatic quantum computing algorithms, and find that using RA protocols significantly enhances their performances.


title: G2L: A Geometric Approach for Generating Pseudo-labels that Improve Transfer Learning

abstract: Transfer learning is a deep-learning technique that ameliorates the problem of learning when human-annotated labels are expensive and limited. In place of such labels, it uses instead the previously trained weights from a well-chosen source model as the initial weights for the training of a base model for a new target dataset. We demonstrate a novel but general technique for automatically creating such source models. We generate pseudo-labels according to an efficient and extensible algorithm that is based on a classical result from the geometry of high dimensions, the Cayley-Menger determinant. This G2L (``geometry to label'') method incrementally builds up pseudo-labels using a greedy computation of hypervolume content. We demonstrate that the method is tunable with respect to expected accuracy, which can be forecast by an information-theoretic measure of dataset similarity (divergence) between source and target. The results of 280 experiments show that this mechanical technique generates base models that have similar or better transferability compared to a baseline of models trained on extensively human-annotated ImageNet1K labels, yielding an overall error decrease of 0.43\%, and an error decrease in 4 out of 5 divergent datasets tested.


title: Blockchain-based Medical Image Sharing and Automated Critical-results Notification: A Novel Framework

abstract: In teleradiology, medical images are transmitted to offsite radiologists for interpretation and the dictation report is sent back to the original site to aid timely diagnosis and proper patient care. Although teleradiology offers great benefits including time and cost efficiency, after-hour coverages, and staffing shortage management, there are some technical and operational limitations to overcome in reaching its full potential. We analyzed the current teleradiology workflow to identify inefficiencies. Image unavailability and delayed critical result communication stemmed from lack of system integration between teleradiology practice and healthcare institutions are among the most substantial factors causing prolonged turnaround time. In this paper, we propose a blockchain-based medical image sharing and automated critical-results notification platform to address the current limitation. We believe the proposed platform will enhance efficiency in workflow by eliminating the need for intermediaries and will benefit patients by eliminating the need for storing medical images in hard copies. While considerable progress was achieved, further research on governance and HIPAA compliance is required to optimize the adoption of the new application. Towards an idea to a working paradigm, we will implement the prototype during the next phase of our study.


title: A Learn-and-Control Strategy for Jet-Based Additive Manufacturing

abstract: In this paper, we develop a predictive geometry control framework for jet-based additive manufacturing (AM) based on a physics-guided recurrent neural network (RNN) model. Because of its physically interpretable architecture, the model's parameters are obtained by training the network through back propagation using input-output data from a small number of layers. Moreover, we demonstrate that the model can be dually expressed such that the layer droplet input pattern for (each layer of) the part to be fabricated now becomes the network parameter to be learned by back-propagation. This approach is applied for feedforward predictive control in which the network parameters are learned offline from previous data and the control input pattern for all layers to be printed is synthesized. Sufficient conditions for the predictive controller's stability are then shown. Furthermore, we design an algorithm for efficiently implementing feedback predictive control in which the network parameters and input patterns (for the receding horizon) are learned online with no added lead time for computation. The feedforward control scheme is shown experimentally to improve the RMS reference tracking error by more than 30% over the state of the art. We also experimentally demonstrate that process uncertainties are compensated by the online learning and feedback control.


title: Flow Synthesis Based Visual Servoing Frameworks for Monocular Obstacle Avoidance Amidst High-Rises

abstract: We propose a novel flow synthesis based visual servoing framework enabling long-range obstacle avoidance for Micro Air Vehicles (MAV) flying amongst tall skyscrapers. Recent deep learning based frameworks use optical flow to do high-precision visual servoing. In this paper, we explore the question: can we design a surrogate flow for these high-precision visual-servoing methods, which leads to obstacle avoidance? We revisit the concept of saliency for identifying high-rise structures in/close to the line of attack amongst other competing skyscrapers and buildings as a collision obstacle. A synthesised flow is used to displace the salient object segmentation mask. This flow is so computed that the visual servoing controller maneuvers the MAV safely around the obstacle. In this approach, we use a multi-step Cross-Entropy Method (CEM) based servo control to achieve flow convergence, resulting in obstacle avoidance. We use this novel pipeline to successfully and persistently maneuver high-rises and reach the goal in simulated and photo-realistic real-world scenes. We conduct extensive experimentation and compare our approach with optical flow and short-range depth-based obstacle avoidance methods to demonstrate the proposed framework's merit. Additional Visualisation can be found at https://sites.google.com/view/monocular-obstacle/home


title: Mirror Complementary Transformer Network for RGB-thermal Salient Object Detection

abstract: RGB-thermal salient object detection (RGB-T SOD) aims to locate the common prominent objects of an aligned visible and thermal infrared image pair and accurately segment all the pixels belonging to those objects. It is promising in challenging scenes such as nighttime and complex backgrounds due to the insensitivity to lighting conditions of thermal images. Thus, the key problem of RGB-T SOD is to make the features from the two modalities complement and adjust each other flexibly, since it is inevitable that any modalities of RGB-T image pairs failure due to challenging scenes such as extreme light conditions and thermal crossover. In this paper, we propose a novel mirror complementary Transformer network (MCNet) for RGB-T SOD. Specifically, we introduce a Transformer-based feature extraction module to effective extract hierarchical features of RGB and thermal images. Then, through the attention-based feature interaction and serial multiscale dilated convolution (SDC) based feature fusion modules, the proposed model achieves the complementary interaction of low-level features and the semantic fusion of deep features. Finally, based on the mirror complementary structure, the salient regions of the two modalities can be accurately extracted even one modality is invalid. To demonstrate the robustness of the proposed model under challenging scenes in real world, we build a novel RGB-T SOD dataset VT723 based on a large public semantic segmentation RGB-T dataset used in the autonomous driving domain. Expensive experiments on benchmark and VT723 datasets show that the proposed method outperforms state-of-the-art approaches, including CNN-based and Transformer-based methods. The code and dataset will be released later at https://github.com/jxr326/SwinMCNet.


title: Condensation for Mouse Pairs

abstract: In this paper, we prove a fine condensation theorem. This is quite similar to condensation theorems for pure extender mice in the literature, except that condensation for iteration strategies has been added to the mix.


title: Teaching Rotational Physics with Bivectors

abstract: Angular momentum is traditionally taught as a (pseudo)vector quantity, tied closely to the cross product. This approach is familiar to experts but challenging for students, and full of subtleties. Here, we present an alternative pedagogical approach: angular momentum is described using bivectors, which can be visualized as "tiles" with area and orientation and whose components form an antisymmetric matrix. Although bivectors have historically been studied in specialized contexts like spacetime classification or geometric algebra, they are no more complicated to understand than cross products. The bivector language provides a more fundamental definition for rotational physics, and opens the door to understanding rotations in relativity and in extra dimensions.