title: Multi-class real-time crash risk forecasting using convolutional neural network: Istanbul case study

abstract: The performance of an artificial neural network (ANN) in forecasting crash risk is shown in this paper. To begin, some traffic and weather data are acquired as raw data. This data is then analyzed, and relevant characteristics are chosen to utilize as input data based on additional tree and Pearson correlation. Furthermore, crash and non-crash time data are separated; then, feature values for crash and non-crash events are written in three four-minute intervals prior to the crash and non-crash events using the average of all available values for that period. The number of non-crash samples was lowered after calculating crash likelihood for each period based on accident labeling. The proposed CNN model is capable of learning from recorded, processed, and categorized input characteristics such as traffic characteristics and meteorological conditions. The goal of this work is to forecast the chance of a real-time crash based on three periods before events. The area under the curve (AUC) for the receiver operating characteristic curve (ROC curve), as well as sensitivity as the true positive rate and specificity as the false positive rate, are shown and compared with three typical machine learning and neural network models. Finally, when it comes to the error value, AUC, sensitivity, and specificity parameters as performance variables, the executed model outperforms other models. The findings of this research suggest applying the CNN model as a multi-class prediction model for real-time crash risk prediction. Our emphasis is on multi-class prediction, while prior research used this for binary (two-class) categorization like crash and non-crash.


title: Landau's Theorem on conjugacy classes for normal subgroups

abstract: Landau's theorem on conjugacy classes asserts that there are only finitely many finite groups, up to isomorphism, with exactly $k$ conjugacy classes for any positive integer $k$. We show that, for any positive integers $n$ and $s$, there exists only a finite number of finite groups $G$, up to isomorphism, having a normal subgroup $N$ of index $n$ which contains exactly $s$ non-central $G$-conjugacy classes. We provide upper bounds for the orders of $G$ and $N$, which are used by using GAP to classify all finite groups with normal subgroups having a small index and few $G$-classes. We also study the corresponding problems when we only take into account the set of $G$-classes of prime-power order elements contained in a normal subgroup.


title: Boundary controllability of incompressible Euler fluids with Boussinesq heat effects

abstract: This paper deals with the boundary controllability of inviscid incompressible fluids for which thermal effects are important. They will be modeled through the so called Boussinesq approximation. In the zero heat diffusion case, by adapting and extending some ideas from J.-M.~Coron and O.~Glass, we establish the simultaneous global exact controllability of the velocity field and the temperature for 2D and 3D flows. When the heat diffusion coefficient is positive, we present some additional results concerning exact controllability for the velocity field and local null controllability of the temperature.


title: Remarks on the control of two-phase Stefan free-boundary problems

abstract: This paper concerns the null controllability of the two-phase 1D Stefan problem with distributed controls. This is a free-boundary problem that models solidification or melting processes. In each phase, a parabolic equation, completed with initial and boundary conditions must be satisfied; the phases are separated by a phase-change interface where an additional free-boundary condition is imposed. We assume that two localized sources of heating/cooling controls act on the system (one in each phase). We prove a local null controllability result: the temperatures and the interface can be respectively steered to zero and to a prescribed location provided the initial data and interface position are sufficiently close to the targets. The ingredients of the proofs are a compactness-uniqueness argument (to deduce appropriate observability estimates adapted to constraints) and a fixed-point formulation and resolution of the controllability problem (to deduce the result for the nonlinear system). We also prove a negative result corresponding to the case where only one control acts on the system and the interface does not collapse to the boundary.


title: Dodging the electricity price hike: Can demand-side flexibility compensate for spot price increases for households in Germany?

abstract: In 2022, energy prices skyrocketed across Europe, with average day-ahead spot market prices in Germany 2.43 times higher than the previous year, hinting at future trends. At the same time, electricity infrastructure is expected to be overutilized in some regions in the future due to the uptake of electric vehicles, heat pumps, PV systems, and other appliances in the residential sector. Dynamic electricity pricing for households is proposed as a solution to alleviate infrastructure strain and reduce costs. The question arises as to what impact dynamic electricity prices as recently seen on the day-ahead spot market in Germany would have on the use of flexibility in households and whether it can compensate for cost increases for households. We analyze the cost-effectiveness of utilizing flexibility through a home energy management system (HEMS) and smart meters against increased self-consumption using a HEMS and static tariffs. We show that with higher electricity prices and price spreads, a higher share of households can offset initial investments in HEMS and metering operation costs by utilizing flexibility from their electric vehicles, heat pumps, and battery storage systems. While increasing self-consumption remains beneficial for households with heat pumps and PV systems, dynamic electricity tariffs are financially more advantageous for those with electric vehicles. The study also determines the maximum additional annual costs for HEMS and metering point operation that still allow cost savings for 75% of households. these costs range from 126 to 145 Euro in the self-consumption scenario depending and from 50 to 111 Euro in the dynamic electricity tariff scenario, highlighting the financial viability of flexibility utilization in response to current pricing trends.


title: A Fixed-Mass multifractal approach for unweighted complex networks

abstract: Complex networks have been studied in recent years due to their relevance in biological, social and technical real systems, such as the world wide web, social networks and biochemical interactions. One of the most current features of complex networks is the presence of (multi-)fractal properties. In spite of the amount of contributions that have been developed in fractal and multifractal analysis, all of them have focused on the adaptation of Fixed size algorithms (FSA) to complex networks, mostly box-counting and sandbox procedures. In this manuscript, a Fixed-mass algorithm (FMA) is adapted to explore the (multi-)fractality of unweighted complex networks is first proposed on the basis on a box-counting procedure. Thus, the aim of this work is to explore the applicability of a FMA to study fractal and multifractal characteristics of unweighted complex networks. After describing the proposed FMA for complex networks, it is tested in several kinds of complex networks such as deterministic, synthetic and real ones. Results suggest that FMA is able to adequately reproduce the fractal and multifractal properties of synthetic complex networks (scale-free, small-world and random). In addition, the algorithm is used for the multifractal description of real complex networks. The main advantage of FMA over FSA is that the minimum configuration of boxes (ideal) for completely covering the network is known. Therefore, results are quite precise when a reasonable covering configuration is obtained, allowing the reconstruction of the Mass exponent, {\tau} , and the Dimension function, D(q), with proper goodness-fits.


title: A mixed formulation for the direct approximation of $L^2$-weighted controls for the linear heat equation

abstract: This paper deals with the numerical computation of null controls for the linear heat equation. The goal is to compute approximations of controls that drive the solution from a prescribed initial state to zero at a given positive time. In [Fernandez-Cara \& M\"unch, Strong convergence approximations of null controls for the 1D heat equation, 2013], a so-called primal method is described leading to a strongly convergent approximation of distributed control: the controls minimize quadratic weighted functionals involving both the control and the state and are obtained by solving the corresponding optimality conditions. In this work, we adapt the method to approximate the control of minimal square integrable-weighted norm. The optimality conditions of the problem are reformulated as a mixed formulation involving both the state and its adjoint. We prove the well-posedness of the mixed formulation (in particular the inf-sup condition) then discuss several numerical experiments. The approach covers both the boundary and the inner situation and is valid in any dimension.


title: Electricity Price Forecasting in the Irish Balancing Market

abstract: Short-term electricity markets are becoming more relevant due to less-predictable renewable energy sources, attracting considerable attention from the industry. The balancing market is the closest to real-time and the most volatile among them. Its price forecasting literature is limited, inconsistent and outdated, with few deep learning attempts and no public dataset. This work applies to the Irish balancing market a variety of price prediction techniques proven successful in the widely studied day-ahead market. We compare statistical, machine learning, and deep learning models using a framework that investigates the impact of different training sizes. The framework defines hyperparameters and calibration settings; the dataset and models are made public to ensure reproducibility and to be used as benchmarks for future works. An extensive numerical study shows that well-performing models in the day-ahead market do not perform well in the balancing one, highlighting that these markets are fundamentally different constructs. The best model is LEAR, a statistical approach based on LASSO, which outperforms more complex and computationally demanding approaches.


title: Learning-augmented Online Algorithm for Two-level Ski-rental Problem

abstract: In this paper, we study the two-level ski-rental problem,where a user needs to fulfill a sequence of demands for multiple items by choosing one of the three payment options: paying for the on-demand usage (i.e., rent), buying individual items (i.e., single purchase), and buying all the items (i.e., combo purchase). Without knowing future demands, the user aims to minimize the total cost (i.e., the sum of the rental, single purchase, and combo purchase costs) by balancing the trade-off between the expensive upfront costs (for purchase) and the potential future expenses (for rent). We first design a robust online algorithm (RDTSR) that offers a worst-case performance guarantee. While online algorithms are robust against the worst-case scenarios, they are often overly cautious and thus suffer a poor average performance in typical scenarios. On the other hand, Machine Learning (ML) algorithms typically show promising average performance in various applications but lack worst-case performance guarantees. To harness the benefits of both methods, we develop a learning-augmented algorithm (LADTSR) by integrating ML predictions into the robust online algorithm, which outperforms the robust online algorithm under accurate predictions while ensuring worst-case performance guarantees even when predictions are inaccurate. Finally, we conduct numerical experiments on both synthetic and real-world trace data to corroborate the effectiveness of our approach.


title: Dynamic Graph Information Bottleneck

abstract: Dynamic Graphs widely exist in the real world, which carry complicated spatial and temporal feature patterns, challenging their representation learning. Dynamic Graph Neural Networks (DGNNs) have shown impressive predictive abilities by exploiting the intrinsic dynamics. However, DGNNs exhibit limited robustness, prone to adversarial attacks. This paper presents the novel Dynamic Graph Information Bottleneck (DGIB) framework to learn robust and discriminative representations. Leveraged by the Information Bottleneck (IB) principle, we first propose the expected optimal representations should satisfy the Minimal-Sufficient-Consensual (MSC) Condition. To compress redundant as well as conserve meritorious information into latent representation, DGIB iteratively directs and refines the structural and feature information flow passing through graph snapshots. To meet the MSC Condition, we decompose the overall IB objectives into DGIB$_{MS}$ and DGIB$_C$, in which the DGIB$_{MS}$ channel aims to learn the minimal and sufficient representations, with the DGIB$_{MS}$ channel guarantees the predictive consensus. Extensive experiments on real-world and synthetic dynamic graph datasets demonstrate the superior robustness of DGIB against adversarial attacks compared with state-of-the-art baselines in the link prediction task. To the best of our knowledge, DGIB is the first work to learn robust representations of dynamic graphs grounded in the information-theoretic IB principle.


title: AMICO galaxy clusters in KiDS-DR3: measuring the splashback radius from weak gravitational lensing

abstract: Context. Weak gravitational lensing offers a powerful method to investigate the projected matter density distribution within galaxy clusters, granting crucial insights into the broader landscape of dark matter on cluster scales. Aims. In this study, we make use of the large photometric galaxy cluster data set derived from the publicly available Third Data Release of the Kilo-Degree Survey, along with the associated shear signal. Our primary objective is to model the peculiar sharp transition in the cluster profile slope, that is what is commonly referred to as the splashback radius. The data set under scrutiny includes 6962 galaxy clusters, selected by AMICO - an optimised detection algorithm of galaxy clusters - on the KiDS-DR3 data, in the redshift range of 0.1 < z < 0.6, all observed at a signal-to-noise ratio greater than 3.5. Methods. Employing a comprehensive Bayesian analysis, we model the stacked excess surface mass density distribution of the clusters. We adopt a model from recent results on numerical simulations that capture the dynamics of both orbiting and infalling materials, separated by the region where the density profile slope undergoes a pronounced deepening. Results. We find that the adopted profile successfully characterizes the cluster masses, consistent with previous works, and models the deepening of the slope of the density profiles measured with weak-lensing data up to the outskirts. Moreover, we measure the splashback radius of galaxy clusters and show that its value is close to the radius within which the enclosed overdensity is 200 times the mean matter density of the Universe, while theoretical models predict a larger value consistent with a low accretion rate. This points to a potential bias of optically selected clusters preferentially characterized by a high density at small scales compared to a pure mass-selected cluster sample.


title: Thermal conductivity with bells and whistlers: suppression of the magnetothermal instability in galaxy clusters

abstract: In the hot intracluster medium (ICM) in galaxy clusters, plasma microinstabilities may play an important role in the transport of heat and momentum on the large scales. In this paper, we continue our investigation of the effect of whistler suppression of thermal conductivity on the magneto-thermal instability (MTI), which may be active in the periphery of galaxy clusters and contribute to the observed turbulence. We use a closure for the heat flux inspired by kinetic simulations and show that MTI turbulence with whistler suppression exhibits a critical transition: for modest suppression of the conductivity, the MTI turbulent velocities decrease in agreement with previous MTI scaling laws. However, for suppression above a critical threshold, the MTI loses its ability to maintain equipartition-level magnetic fields through a small-scale dynamo, and the system enters a ``death-spiral''. We propose a model to explain this critical transition, and speculate that conditions in the hot ICM are favourable to the upkeep of the dynamo. Additionaly, with whistler suppression high-$\beta$ regions are brought out of thermal equilibrium while the efficiency of MTI turbulent driving is reduced. Finally, we show that external turbulence interferes with the MTI and leads to lower levels of turbulence. While individually both external turbulence and whistler suppression weaken the MTI, we find that they can exhibit a complex interplay when acting in conjunction, with external turbulence boosting the whistler-suppressed thermal conductivity and even reviving a ``dead'' MTI. Our study illustrates how extending magnetohydrodynamics with a simple prescription for microscale plasma physics can lead to the formation of a complicated dynamical system and demonstrates that further work is needed in order to bridge the gap between micro- and macro scales in galaxy clusters.


title: Tropical Amplitudes For Colored Lagrangians

abstract: Recently a new formulation for scattering amplitudes in Tr($\Phi^3$) theory has been given based on simple combinatorial ideas in the space of kinematic data. This allows all-loop integrated amplitudes to be expressed as ''curve integrals'' defined using tropical building blocks - the ''headlight functions''. This paper shows how the formulation extends to the amplitudes of more general Lagrangians. We will present a number of different ways of introducing tropical ''numerator functions'' that allow us to describe general Lagrangian interactions. The simplest family of these ''tropical numerators'' computes the amplitudes of interesting Lagrangians with infinitely many interactions. We also describe methods for tropically formulating the amplitudes for general Lagrangians. One uses a variant of ''Wick contraction'' to glue together numerator factors for general interaction vertices. Another uses a natural characterization of polygons on surfaces to give a novel combinatorial description of all possible diagrams associated with arbitrary valence interactions.


title: Hilbert-Space Ergodicity in Driven Quantum Systems: Obstructions and Designs

abstract: Despite its long history, a canonical formulation of quantum ergodicity that applies to general classes of quantum dynamics, including driven systems, has not been fully established. Here we introduce and study a notion of quantum ergodicity for closed systems with time-dependent Hamiltonians, defined as statistical randomness exhibited in their long-time dynamics. Concretely, we consider the temporal ensemble of quantum states (time-evolution operators) generated by the evolution, and investigate the conditions necessary for them to be statistically indistinguishable from uniformly random states (operators) in the Hilbert space (space of unitaries). We find that the number of driving frequencies underlying the Hamiltonian needs to be sufficiently large for this to occur. Conversely, we show that statistical pseudo-randomness -- indistinguishability up to some large but finite moment, can already be achieved by a quantum system driven with a single frequency, i.e., a Floquet system, as long as the driving period is sufficiently long. Our work relates the complexity of a time-dependent Hamiltonian and that of the resulting quantum dynamics, and offers a fresh perspective to the established topics of quantum ergodicity and chaos from the lens of quantum information.


title: Enhancing Shift Current via Virtual Multiband Transitions

abstract: Finding materials exhibiting substantial shift current holds the potential for designing shift current-based photovoltaics that outperform conventional solar cells. However, the myriad of factors governing shift current response poses significant challenges in designing devices that showcase large shift current. Here, we propose a general design principle that exploits inter-orbital mixing to excite virtual multiband transitions in materials with multiple flat bands to achieve enhanced shift current response. We further explicitly relate this design principle to maximizing Wannier function spread as expressed through the formalism of quantum geometry. We demonstrate the viability of our design using a 1D stacked Rice-Mele model. Then, we consider a concrete material realization - alternating angle twisted multilayer graphene (TMG) - a natural platform to experimentally realize such an effect. We identify a new set of twist angles at which the shift current response is maximized via virtual transitions for each multilayer graphene and highlight the importance of TMG as a promising material to achieve an enhanced shift current response at terahertz frequencies. Our proposed mechanism also applies to other 2D systems and can serve as a guiding principle for designing multiband systems that exhibit enhanced shift current response.


title: A $1.9\,M_{\odot}$ neutron star candidate in a 2-year orbit

abstract: We report discovery and characterization of a main-sequence G star orbiting a dark object with mass $1.90\pm 0.04 M_{\odot}$. The system was discovered via Gaia astrometry and has an orbital period of 731 days. We obtained multi-epoch RV follow-up over a period of 639 days, allowing us to refine the Gaia orbital solution and precisely constrain the masses of both components. The luminous star is a $\gtrsim 12$ Gyr-old, low-metallicity halo star near the main-sequence turnoff ($T_{\rm eff}\approx 6000$ K; $\log(g/\left[{\rm cm\,s^{-2}}\right])\approx 4.0$; $\rm [Fe/H]\approx-1.25$; $M\approx0.79 M_{\odot}$) with a highly enhanced lithium abundance. The RV mass function sets a minimum companion mass for an edge-on orbit of $M_2 > 1.67 M_{\odot}$, well above the Chandrasekhar limit. The Gaia inclination constraint, $i=68.7\pm 1.4$ deg, then implies a companion mass of $M_2=1.90\pm0.04 M_{\odot}$. The companion is most likely a massive neutron star: the only viable alternative is two massive white dwarfs in a close binary, but this scenario is disfavored on evolutionary grounds. The system's low eccentricity ($e=0.122\pm 0.002$) disfavors dynamical formation channels and implies that the neutron star likely formed with little mass loss ($\lesssim1\,M_{\odot}$) and with a weak natal kick ($v_{\rm kick}\lesssim 20\,\rm km\,s^{-1}$). The current orbit is too small to have accommodated the neutron star progenitor as a red supergiant or super-AGB star. The simplest formation scenario -- isolated binary evolution -- requires the system to have survived unstable mass transfer and common envelope evolution with a donor-to-accretor mass ratio $>10$. The system, which we call Gaia NS1, is likely a progenitor of symbiotic X-ray binaries and long-period millisecond pulsars. Its discovery challenges binary evolution models and bodes well for Gaia's census of compact objects in wide binaries.


title: One-loop analysis of $\beta$ decays in SMEFT

abstract: We perform a loop-level analysis of charged-current (CC) processes involving light leptons and quarks within the Standard Model Effective Field Theory (SMEFT). This work is motivated by the high precision reached in experiment and Standard Model calculations for CC decays of mesons, neutron, and nuclei, and by a lingering tension in the Cabibbo universality test. We identify the SMEFT operators that induce the largest loop-level contributions to CC processes. These include four-quark and four-fermion semileptonic operators involving two third-generation quarks. We discuss the available constraints on the relevant effective couplings and along the way we derive new loop-level bounds from $K \to \pi \nu \bar \nu$ on four-quark operators involving two top quarks. We find that low-energy CC processes are quite competitive with other probes, set constraints that do not depend on flavor-symmetry assumptions, and probe operators involving third-generation quarks up to effective scales of $\Lambda\simeq 8$ TeV. Finally, we briefly discuss single-field ultraviolet completions that could induce the relevant operators.


title: Twist-free axisymmetric critical collapse of a complex scalar field

abstract: Critical phenomena in gravitational collapse are characterized by the emergence of surprising structure in solution space, namely the appearance of universal power-laws and periodicities near the threshold of collapse, and a universal discretely self-similar solution at the threshold itself. This seminal work spurred a comprehensive investigation of extreme spherical spacetimes in numerical relativity, with analogous results for numerous matter models. Recent research suggests that the generalization to less symmetric scenarios is subtle. In twist-free axisymmetric vacuum collapse for instance, numerical evidence suggests a breakdown of universality of solutions at the threshold of collapse. In this study, we explore gravitational collapse involving a massless complex scalar field minimally coupled to general relativity. We employ the pseudospectral code BAMPS to investigate a neighborhood of the spherically symmetric critical solution in phase space, focusing on aspherical departures from it. First, working in explicit spherical symmetry, we find strong evidence that the spacetime metric of the spherical critical solution of the complex scalar field agrees with that of the Choptuik solution. We then examine universality of the behavior of solutions near the threshold of collapse as the departure from spherical symmetry increases, comparing with recent investigations of the real scalar field. We present a series of well-tuned numerical results and document shifts of the power-law exponent and periods as a function of the degree of asphericity of the initial data. At sufficiently high asphericities we find that the center of collapse bifurcates, on the symmetry axis, but away from the origin. Finally we look for and evaluate evidence that in the highly aspherical setting the collapse is driven by gravitational waves.


title: Determination of the Collins-Soper kernel from Lattice QCD

abstract: This work presents a determination of the quark Collins-Soper kernel, which relates transverse-momentum-dependent parton distributions (TMDs) at different rapidity scales, using lattice quantum chromodynamics (QCD). This is the first such determination with systematic control of quark mass, operator mixing, and discretization effects. Next-to-next-to-leading logarithmic matching is used to match lattice-calculable distributions to the corresponding TMDs. The continuum-extrapolated lattice QCD results are consistent with several recent phenomenological parameterizations of the Collins-Soper kernel and are precise enough to disfavor other parameterizations.


title: High-Resolution X-Ray Spectroscopy of Interstellar Iron Toward Cygnus X-1 and GX 339-4

abstract: We present a high-resolution spectral study of Fe L-shell extinction by the diffuse interstellar medium (ISM) in the direction of the X-ray binaries Cygnus X-1 and GX 339-4, using the XMM-Newton reflection grating spectrometer. The majority of interstellar Fe is suspected to condense into dust grains in the diffuse ISM, but the compounds formed from this process are unknown. Here, we use the laboratory cross sections from Kortright & Kim (2000) and Lee et al. (2009) to model the absorption and scattering profiles of metallic Fe, and the crystalline compounds fayalite (Fe$_2$SiO$_4$), ferrous sulfate (FeSO$_4$), hematite ($\alpha$-Fe$_2$O$_3$), and lepidocrocite ($\gamma$-FeOOH), which have oxidation states ranging from Fe$^{0}$ to Fe$^{3+}$. We find that the observed Fe L-shell features are systematically offset in energy from the laboratory measurements. An examination of over two dozen published measurements of Fe L-shell absorption finds a 1-2 eV scatter in energy positions of the L-shell features. Motivated by this, we fit for the best energy-scale shift simultaneously with the fine structure of the Fe L-shell extinction cross sections. Hematite and lepidocrocite provide the best fits ($\approx +1.1$ eV shift), followed by fayalite ($\approx +1.8$ eV shift). However, fayalite is disfavored, based on the implied abundances and knowledge of ISM silicates gained by infrared astronomical observations and meteoritic studies. We conclude that iron oxides in the Fe$^{3+}$ oxidation state are good candidates for Fe-bearing dust. To verify this, new absolute photoabsorption measurements are needed on an energy scale accurate to better than 0.2 eV.


title: Optimising quantum tomography via shadow inversion

abstract: In quantum information theory, the accurate estimation of observables is pivotal for quantum information processing, playing a crucial role in compute and communication protocols. This work introduces a novel technique for estimating such objects, leveraging an underutilised resource in the inversion map of classical shadows that greatly refines the estimation cost of target observables without incurring any additional overhead. A generalised framework for computing and optimising additional degrees of freedom in the homogeneous space of the shadow inversion is given that may be adapted to a variety of near-term problems. In the special case of local measurement strategies we show feasible optimisation leading to an exponential separation in sample complexity versus the standard approach and in an exceptional case we give non-trivial examples of optimised post-processing for local measurements, achieving the same efficiency as the global Cliffords shadows.


title: Simba-EoR: Early galaxy formation in the Simba simulation including a new sub-grid interstellar medium model

abstract: We update the dust model present within the Simba galaxy simulations with a self-consistent framework for the co-evolution of dust and molecular hydrogen populations in the interstellar medium, and use this to explore $z \geq 6$ galaxy evolution. In addition to tracking the evolution of dust and molecular hydrogen abundances, our model fully integrates these species into the Simba simulation, explicitly modelling their impact on physical processes such as star formation and cooling through the inclusion of a novel two-phase sub-grid model for interstellar gas. In running two high-resolution simulations down to $z \sim 6$ we find that our Simba-EoR model displays a generally tighter concordance with observational data than fiducial Simba. Additionally we observe that our Simba-EoR models increase star formation activity at early epochs, producing larger dust-to-gas ratios consequently. Finally, we discover a significant population of hot dust at $\sim 100$ K, aligning with contemporaneous observations of high-redshift dusty galaxies, alongside the large $\sim 20$ K population typically identified.


title: Greedy Matchings in Bipartite Graphs with Ordered Vertex Sets

abstract: We define and study greedy matchings in vertex-ordered bipartite graphs. It is shown that each vertex-ordered bipartite graph has a unique greedy matching. The proof uses (a weak form of) Newman's lemma. The vertex ordering is called a preference relation. Given a vertex-ordered bipartite graph, the goal is to match every vertex of one vertex class but to leave unmatched as many as possible vertices of low preference in the other concept class. We investigate how well greedy algorithms perform in this setting. It is shown that they have optimal performance provided that the vertex-ordering is cleverly chosen. The study of greedy matchings is motivated by problems in learning theory like illustrating or teaching concepts by means of labeled examples.


title: A Scalable Algorithm for Individually Fair K-means Clustering

abstract: We present a scalable algorithm for the individually fair ($p$, $k$)-clustering problem introduced by Jung et al. and Mahabadi et al. Given $n$ points $P$ in a metric space, let $\delta(x)$ for $x\in P$ be the radius of the smallest ball around $x$ containing at least $n / k$ points. A clustering is then called individually fair if it has centers within distance $\delta(x)$ of $x$ for each $x\in P$. While good approximation algorithms are known for this problem no efficient practical algorithms with good theoretical guarantees have been presented. We design the first fast local-search algorithm that runs in ~$O(nk^2)$ time and obtains a bicriteria $(O(1), 6)$ approximation. Then we show empirically that not only is our algorithm much faster than prior work, but it also produces lower-cost solutions.


title: Closed-form solutions for generic N-token AMM arbitrage

abstract: Convex optimisation has provided a mechanism to determine arbitrage trades on automated market markets (AMMs) since almost their inception. Here we outline generic closed-form solutions for $N$-token geometric mean market maker pool arbitrage, that in simulation (with synthetic and historic data) provide better arbitrage opportunities than convex optimisers and is able to capitalise on those opportunities sooner. Furthermore, the intrinsic parallelism of the proposed approach (unlike convex optimisation) offers the ability to scale on GPUs, opening up a new approach to AMM modelling by offering an alternative to numerical-solver-based methods. The lower computational cost of running this new mechanism can also enable on-chain arbitrage bots for multi-asset pools.


title: A partial order on antichains of a fixed size

abstract: We introduce a new partial order on the set of all antichains of a fixed size in a given poset. When applied to minuscule posets, these partial orders give rise to distributive lattices that appear in the branching rules for minuscule representations of simply laced complex simple Lie algebras.


title: NICE: To Optimize In-Context Examples or Not?

abstract: Recent work shows that in-context learning and optimization of in-context examples (ICE) can significantly improve the accuracy of large language models (LLMs) on a wide range of tasks, leading to an apparent consensus that ICE optimization is crucial for better performance. However, most of these studies assume a fixed or no instruction provided in the prompt. We challenge this consensus by investigating the necessity of optimizing ICE when task-specific instructions are provided and find that there are many tasks for which it yields diminishing returns. In particular, using a diverse set of tasks and a systematically created instruction set with gradually added details, we find that as the prompt instruction becomes more detailed, the returns on ICE optimization diminish. To characterize this behavior, we introduce a task-specific metric called Normalized Invariability to Choice of Examples (NICE) that quantifies the learnability of tasks from a given instruction, and provides a heuristic to help decide whether to optimize instructions or ICE for a new task. Given a task, the proposed metric can reliably predict the utility of optimizing ICE compared to using random ICE. Our code is available at https://github.com/microsoft/nice-icl.


title: Corruption Robust Offline Reinforcement Learning with Human Feedback

abstract: We study data corruption robustness for reinforcement learning with human feedback (RLHF) in an offline setting. Given an offline dataset of pairs of trajectories along with feedback about human preferences, an $\varepsilon$-fraction of the pairs is corrupted (e.g., feedback flipped or trajectory features manipulated), capturing an adversarial attack or noisy human preferences. We aim to design algorithms that identify a near-optimal policy from the corrupted data, with provable guarantees. Existing theoretical works have separately studied the settings of corruption robust RL (learning from scalar rewards directly under corruption) and offline RLHF (learning from human feedback without corruption); however, they are inapplicable to our problem of dealing with corrupted data in offline RLHF setting. To this end, we design novel corruption robust offline RLHF methods under various assumptions on the coverage of the data-generating distributions. At a high level, our methodology robustifies an offline RLHF framework by first learning a reward model along with confidence sets and then learning a pessimistic optimal policy over the confidence set. Our key insight is that learning optimal policy can be done by leveraging an offline corruption-robust RL oracle in different ways (e.g., zero-order oracle or first-order oracle), depending on the data coverage assumptions. To our knowledge, ours is the first work that provides provable corruption robust offline RLHF methods.


title: Flavor Factorization at Two-Loops

abstract: Recently, a factorization theorem was proposed for partonic flavor evolution as defined by the net flavor of the Winner-Take-All axis of a jet. We validate the factorization theorem through explicit calculation at two-loop order, and in the process extract all anomalous dimensions and renormalization factors for any ultraviolet-to-infrared flavor transition at this order. These results can then be used to extract the renormalized hard function for flavored jet production at next-to-next-to-leading order for any process of interest.


title: Bosenovae with Quadratically-Coupled Scalars in Quantum Sensing Experiments

abstract: Ultralight dark matter (ULDM) particles of mass $m_\phi \lesssim 1~{\rm eV}$ can form boson stars in DM halos. Collapse of boson stars leads to explosive bosenova emission of copious relativistic ULDM particles. In this work, we analyze sensitivity of terrestrial and space-based experiments to detect such relativistic scalar ULDM particles interacting through quadratic couplings with Standard Model constituents, including electrons, photons and gluons. We highlight key differences with searches for linear ULDM couplings. Screening of ULDM with quadratic couplings near the surface of the Earth can significantly impact observations in terrestrial experiments, motivating future space-based experiments. We demonstrate excellent ULDM discovery prospects, especially for quantum sensors, which can probe quadratic couplings orders below existing constraints by detecting bosenova events in the ULDM mass range $10^{-23}\,{\rm eV} \lesssim m_\phi \lesssim 10^{-5}\,{\rm eV}$. We also report updated constraints on quadratic couplings of ULDM in case it comprises cold DM.

categories: hep-ph astro-ph.CO astro-ph.HE physics.atom-ph


title: ExGRG: Explicitly-Generated Relation Graph for Self-Supervised Representation Learning

abstract: Self-supervised Learning (SSL) has emerged as a powerful technique in pre-training deep learning models without relying on expensive annotated labels, instead leveraging embedded signals in unlabeled data. While SSL has shown remarkable success in computer vision tasks through intuitive data augmentation, its application to graph-structured data poses challenges due to the semantic-altering and counter-intuitive nature of graph augmentations. Addressing this limitation, this paper introduces a novel non-contrastive SSL approach to Explicitly Generate a compositional Relation Graph (ExGRG) instead of relying solely on the conventional augmentation-based implicit relation graph. ExGRG offers a framework for incorporating prior domain knowledge and online extracted information into the SSL invariance objective, drawing inspiration from the Laplacian Eigenmap and Expectation-Maximization (EM). Employing an EM perspective on SSL, our E-step involves relation graph generation to identify candidates to guide the SSL invariance objective, and M-step updates the model parameters by integrating the derived relational information. Extensive experimentation on diverse node classification datasets demonstrates the superiority of our method over state-of-the-art techniques, affirming ExGRG as an effective adoption of SSL for graph representation learning.


title: EntGPT: Linking Generative Large Language Models with Knowledge Bases

abstract: The ability of Large Language Models (LLMs) to generate factually correct output remains relatively unexplored due to the lack of fact-checking and knowledge grounding during training and inference. In this work, we aim to address this challenge through the Entity Disambiguation (ED) task. We first consider prompt engineering, and design a three-step hard-prompting method to probe LLMs' ED performance without supervised fine-tuning (SFT). Overall, the prompting method improves the micro-F_1 score of the original vanilla models by a large margin, on some cases up to 36% and higher, and obtains comparable performance across 10 datasets when compared to existing methods with SFT. We further improve the knowledge grounding ability through instruction tuning (IT) with similar prompts and responses. The instruction-tuned model not only achieves higher micro-F1 score performance as compared to several baseline methods on supervised entity disambiguation tasks with an average micro-F_1 improvement of 2.1% over the existing baseline models, but also obtains higher accuracy on six Question Answering (QA) tasks in the zero-shot setting. Our methodologies apply to both open- and closed-source LLMs.


title: Hairy black hole, Fermionic greybody factors, Quasinormal modes, Hawking radiation, Power spectrum and sparsity

abstract: A hairy black hole (HBH) emerges due to matter surrounding the Schwarzschild metric when using the Extended Gravitational Decoupling (GD) approach. The fermionic greybody factors (GFs) and quasinormal modes (QNMs) as well as Hawking spectra and sparsity of HBH solutions are investigated. We consider massive and massless spin- 1/2 fermions, along with massless spin- 3/2 fermions. The equations of the effective potential for fermions with different spins are derived in HBH spacetime. Then, the rigorous bound method is used to calculate the fermionic spin- 1/2 and spin- 3/2 GFs. With the time domain integration method at our disposal, we illustrate the impact of additional parameters on the ringdown waveform of the massless fermionic spin -1/2 and spin -3/2 fields and, in turn, on their quasinormal modes. We then delve into investigating the Hawking spectra and sparsity of the radiation emitted by an HBH. Hairy parameters significantly affect the sparsity of Hawking radiation as well. We observe that the total power emitted by the BH increases both with $\alpha$ and $Q$ but decreases with $l_{0}$. Our study conclusively shows the significant impact of the additional parameters on important astrophysical phenomena such as quasinormal modes, Hawking spectra, and sparsity.


title: Nearest Neighbor Complexity and Boolean Circuits

abstract: A nearest neighbor representation of a Boolean function $f$ is a set of vectors (anchors) labeled by $0$ or $1$ such that $f(\vec{x}) = 1$ if and only if the closest anchor to $\vec{x}$ is labeled by $1$. This model was introduced by Hajnal, Liu, and Tur\'an (2022), who studied bounds on the number of anchors required to represent Boolean functions under different choices of anchors (real vs. Boolean vectors) as well as the more expressive model of $k$-nearest neighbors. We initiate the study of the representational power of nearest and $k$-nearest neighbors through Boolean circuit complexity. To this end, we establish a connection between Boolean functions with polynomial nearest neighbor complexity and those that can be efficiently represented by classes based on linear inequalities -- min-plus polynomial threshold functions -- previously studied in relation to threshold circuits. This extends an observation of Hajnal et al. (2022). We obtain exponential lower bounds on the $k$-nearest neighbors complexity of explicit $n$-variate functions, assuming $k \leq n^{1-\epsilon}$. Previously, no superlinear lower bound was known for any $k>1$. Next, we further extend the connection between nearest neighbor representations and circuits to the $k$-nearest neighbors case. As a result, we show that proving superpolynomial lower bounds for the $k$-nearest neighbors complexity of an explicit function for arbitrary $k$ would require a breakthrough in circuit complexity. In addition, we prove an exponential separation between the nearest neighbor and $k$-nearest neighbors complexity (for unrestricted $k$) of an explicit function. These results address questions raised by Hajnal et al. (2022) of proving strong lower bounds for $k$-nearest neighbors and understanding the role of the parameter $k$. Finally, we devise new bounds on the nearest neighbor complexity for several explicit functions.


title: Retzzles: Do Jigsaw Puzzle Actions on Interactive Display Maps Increase the Retention of Map Information?

abstract: While maps provide upfront content, this might not always be the most effective way for users to remember information. With the proliferation of interactive displays for tourists and visitors in public spaces, we can create a more playful user experience with maps than just exploring them. Adding interactions with the map could also help users retain more information as they use them. In this paper, we investigated whether completing a jigsaw puzzle of a map supports users in retaining more information about a specific map. The results of a between-subject study with a sample of n=28 indicate that additional interaction helped improve mean scores of textual and spatial recall but not visual recall. However, the results are not statistically significant, and the topic is subject to further investigation. Our findings contribute to discussions on using interactive touchscreen displays in similar learning scenarios involving memory retention.


title: Limited-angle TOF-PET for intraoperative surgical applications: Simulation Study

abstract: In this work, we present modeling and imaging performance of a dual panel limited-angle TOF-PET system for intraoperative surgical applications using GATE monte carlo toolkit. Several detector parameters such as detector pixel dimensions, timing resolution and depth of interaction resolution along with tumor uptake ratio and phantom dimension are varied. Ultimately TOF-PET detector properties to achieve a specific imaging task are presented. To assess image resolution, we employed Simple Back Projection (SBP) reconstruction due to its fast speed compared to list-mode Maximum Likelihood Expectation Maximization (MLEM). We evaluated the quality of the reconstructed images using metrics contrast-to-noise ratio (CNR), contrast recovery coefficient (CRC), and signal-to-noise ratio (SNR). The purpose is to show effects of different detector parameters on the resolution of reconstructed images.


title: US Adaptive Optics Roadmap to Achieve Astro2020

abstract: In the recent Astro2020 Decadal Report, ''Pathways to Discovery in Astronomy and Astrophysics for the 2020s'' Adaptive Optics (AO) was identified as a crucial technology for a variety of reasons. These included an emphasis on high-contrast imaging and AO systems as being part of future technology development especially with application to the two US ELT projects. Instrument upgrades were also identified for existing 4m to 10m class telescopes which would incorporate upgrades to existing AO systems. As noted in the Report: (1) ''the central role of AO instrumentation and the importance of further development are rapidly growing, with novel concepts pushing toward wider area'', (2) ''Visible AO has high potential scientific return by opening up an entire wavelength regime to high angular resolution studies. The goal is to exploit the smaller diffraction limit of telescopes in the optical, yet both the coherence length and time decrease at shorter wavelengths requiring wavefront sensing at high spatial and temporal frequencies that are currently technologically challenging. This is an important developing area for the 2020s - 2030s.'', and (3) ''Such investments in AO systems development is a key risk mitigation strategy for ELTs, whose full resolution and sensitivity potential can only be realized with AO, and which is recognized as the most important technical risk for both GMT and TMT''. A workshop was held in May, 2023 to develop a Community Response document (this document) to provide feedback and suggested priorities to various funding agencies, such as NSF, NASA, and DoE, as to the AO Research and Development priorities to meet the technical and science objectives outlined in Astro2020 for ground-based AO, both stand-alone and in support of space missions.


title: The energy landscape of the Kuramoto model in one-dimensional random geometric graphs with a hole

abstract: We study the energy function of the Kuramoto model in random geometric graphs defined in the unit circle as the number of nodes diverges. We prove the existence of at least one local minimum for each winding number $q\in \mathbb{Z}$ with high probability. Hence providing a large family of graphs that support patterns that are generic. These states are in correspondence with the explicit twisted states found in WSG and other highly symmetric networks, but in our situation there is no explicit formula due to the lack of symmetry. The method of proof is simple and robust. It allows other types of graphs like $k-$nn graphs or the boolean model and holds also for graphs defined in any simple closed curve or even a small neighborhood of the curve and for weighted graphs. It seems plausible that the method can be extended also to higher dimensions, but a more careful analysis is required.


title: qec_code_sim: An open-source Python framework for estimating the effectiveness of quantum-error correcting codes on superconducting qubits

abstract: Quantum computers are highly susceptible to errors due to unintended interactions with their environment. It is crucial to correct these errors without gaining information about the quantum state, which would result in its destruction through back-action. Quantum Error Correction (QEC) provides information about occurred errors without compromising the quantum state of the system. However, the implementation of QEC has proven to be challenging due to the current performance levels of qubits -- break-even requires fabrication and operation quality that is beyond the state-of-the-art. Understanding how qubit performance factors into the success of a QEC code is a valuable exercise for tracking progress towards fault-tolerant quantum computing. Here we present qec_code_sim, an open-source, lightweight Python framework for studying the performance of small quantum error correcting codes under the influence of a realistic error model appropriate for superconducting transmon qubits, with the goal of enabling useful hardware studies and experiments. qec_code_sim requires minimal software dependencies and prioritizes ease of use, ease of change, and pedagogy over execution speed. As such, it is a tool well-suited to small teams studying systems on the order of one dozen qubits.


title: Higgs boson off-shell measurements probe non-linearities

abstract: The measurements of off-shell Higgs boson contributions in massive gauge boson pair production are known to probe its electroweak interactions across different energy scales. Often employed as an estimator of the Higgs boson width in restricted theories of beyond the Standard Model physics, we revisit this measurement and re-advertise its potential to constrain aspects of Higgs boson non-linearity. We show that this so-called off-shell measurement complements related analyses of multi-Higgs final states.


title: Boundary value problems for holomorphic functions on Lipschitz planar domains

abstract: We study the $\bar\partial$ equation subject to various boundary value conditions on bounded simply connected Lipschitz domains $D\subset\mathbb C$: for the Dirichlet problem with datum in $L^p(bD, \sigma)$, this is simply a restatement of the fact that members of the holomorphic Hardy spaces are uniquely and completely determined by their boundary values. Here we identify the maximal data spaces and obtain estimates in the maximal $p$-range for the Dirichlet, Regularity-for-Dirichlet, Neumann, and Robin boundary conditions for $\bar\partial$.


title: CLIPZyme: Reaction-Conditioned Virtual Screening of Enzymes

abstract: Computational screening of naturally occurring proteins has the potential to identify efficient catalysts among the hundreds of millions of sequences that remain uncharacterized. Current experimental methods remain time, cost and labor intensive, limiting the number of enzymes they can reasonably screen. In this work, we propose a computational framework for in-silico enzyme screening. Through a contrastive objective, we train CLIPZyme to encode and align representations of enzyme structures and reaction pairs. With no standard computational baseline, we compare CLIPZyme to existing EC (enzyme commission) predictors applied to virtual enzyme screening and show improved performance in scenarios where limited information on the reaction is available (BEDROC$_{85}$ of 44.69%). Additionally, we evaluate combining EC predictors with CLIPZyme and show its generalization capacity on both unseen reactions and protein clusters.


title: Copper phosphate micro-flowers coated with indocyanine green and iron oxide nanoparticles for in vivo localization optoacoustic tomography and magnetic actuation

abstract: Efficient drug delivery is a major challenge in modern medicine and pharmaceutical research. Micrometer-scale robots have recently been proposed as a promising venue to amplify precision of drug administration. Remotely controlled microrobots sufficiently small to navigate through microvascular networks can reach any part of the human body, yet real-time tracking is crucial for providing precise guidance and verifying successful arrival at the target. In vivo deep-tissue monitoring of individual microrobots is currently hampered by the lack of sensitivity and/or spatio-temporal resolution of commonly used clinical imaging modalities. We synthesized biocompatible and biodegradable copper phosphate micro-flowers loaded with indocyanine green and iron oxide nanoparticles to enable in vivo individual detection with localization optoacoustic tomography. We demonstrate magnetic actuation and optoacoustic tracking of these decorated micro-flowers at a per-particle level. Functional super-resolution imaging achieved via tracking intravenously injected particles provides a means of identifying microvascular targets and quantifying blood flow, while the versatile carrying capacity can be further exploited for transporting multiple types of drug formulations.


title: Modelling of planetary accretion and core-mantle structure formation

abstract: We advance a thermodynamically consistent model of self-gravitational accretion and differentiation in planets. The system is modeled in actual variables as a compressible thermoviscoelastic fluid in a fixed, sufficiently large domain. The supply of material to the accreting and differentiating system is described as a bulk source of mass, volume, impulse, and energy localized in some border region of the domain. Mass, momentum, and energy conservation, along with constitutive relations, result in an extended compressible Navier-Stokes-Fourier-Poisson system. After studying some single-component setting, we consider a two-component situation, where metals and silicates mix and differentiate under gravity, eventually forming a core-mantle structure. The energetics of the models are elucidated. Moreover, we prove that the models are stable, in that self-gravitational collapse is excluded. Eventually, we comment on the prospects of devising a rigorous mathematical approximation and existence theory.


title: Low-Rank Learning by Design: the Role of Network Architecture and Activation Linearity in Gradient Rank Collapse

abstract: Our understanding of learning dynamics of deep neural networks (DNNs) remains incomplete. Recent research has begun to uncover the mathematical principles underlying these networks, including the phenomenon of "Neural Collapse", where linear classifiers within DNNs converge to specific geometrical structures during late-stage training. However, the role of geometric constraints in learning extends beyond this terminal phase. For instance, gradients in fully-connected layers naturally develop a low-rank structure due to the accumulation of rank-one outer products over a training batch. Despite the attention given to methods that exploit this structure for memory saving or regularization, the emergence of low-rank learning as an inherent aspect of certain DNN architectures has been under-explored. In this paper, we conduct a comprehensive study of gradient rank in DNNs, examining how architectural choices and structure of the data effect gradient rank bounds. Our theoretical analysis provides these bounds for training fully-connected, recurrent, and convolutional neural networks. We also demonstrate, both theoretically and empirically, how design choices like activation function linearity, bottleneck layer introduction, convolutional stride, and sequence truncation influence these bounds. Our findings not only contribute to the understanding of learning dynamics in DNNs, but also provide practical guidance for deep learning engineers to make informed design decisions.


title: Oriented-grid Encoder for 3D Implicit Representations

abstract: Encoding 3D points is one of the primary steps in learning-based implicit scene representation. Using features that gather information from neighbors with multi-resolution grids has proven to be the best geometric encoder for this task. However, prior techniques do not exploit some characteristics of most objects or scenes, such as surface normals and local smoothness. This paper is the first to exploit those 3D characteristics in 3D geometric encoders explicitly. In contrast to prior work on using multiple levels of details, regular cube grids, and trilinear interpolation, we propose 3D-oriented grids with a novel cylindrical volumetric interpolation for modeling local planar invariance. In addition, we explicitly include a local feature aggregation for feature regularization and smoothing of the cylindrical interpolation features. We evaluate our approach on ABC, Thingi10k, ShapeNet, and Matterport3D, for object and scene representation. Compared to the use of regular grids, our geometric encoder is shown to converge in fewer steps and obtain sharper 3D surfaces. When compared to the prior techniques, our method gets state-of-the-art results.


title: Shortest-path percolation on complex networks

abstract: We propose a bond-percolation model intended to describe the consumption, and eventual exhaustion, of resources in transport networks. Edges forming minimum-length paths connecting demanded origin-destination nodes are removed if below a certain budget. As pairs of nodes are demanded and edges are removed, the macroscopic connected component of the graph disappears, i.e., the graph undergoes a percolation transition. Here, we study such a shortest-path-percolation transition in homogeneous random graphs where pairs of demanded origin-destination nodes are randomly generated, and fully characterize it by means of finite-size scaling analysis. If budget is finite, the transition is identical to the one of ordinary percolation, where a single giant cluster shrinks as edges are removed from the graph; for infinite budget, the transition becomes more abrupt than the one of ordinary percolation, being characterized by the sudden fragmentation of the giant connected component into a multitude of clusters of similar size.


title: Detecting anomalous CP violation in heavy ion collisions through baryon-electric charge correlations

abstract: The chiral magnetic effect (CME) and the chiral vortical effect (CVE) induce a correlation between baryon and electric currents. We show that this correlation can be detected using a new observable: a mixed baryon-electric charge correlator. This correlator is proportional to the baryon asymmetry, suggesting a novel way to separate the chiral effects from the background in heavy ion collisions.


title: Radiative neutron capture rate of $^{11}$B$(n,\gamma)^{12}$B reaction from the Coulomb dissociation of $^{12}$B

abstract: We calculate the $^{11}$B$(n,\gamma)^{12}$B reaction rate, an important constituent in nucleosynthesis networks, contributed by resonant as well as non-resonant capture. For the resonant rate, we use the narrow resonance approximation whereas the non-resonant contribution is calculated with the Coulomb dissociation method for which we use finite-range distorted wave Born approximation theory. We then compare our calculated rate of $^{11}$B$(n,\gamma)^{12}$B reaction with those reported earlier and with other charged particle reactions on $^{11}$B.


title: Convergence of Gradient Descent with Small Initialization for Unregularized Matrix Completion

abstract: We study the problem of symmetric matrix completion, where the goal is to reconstruct a positive semidefinite matrix $\rm{X}^\star \in \mathbb{R}^{d\times d}$ of rank-$r$, parameterized by $\rm{U}\rm{U}^{\top}$, from only a subset of its observed entries. We show that the vanilla gradient descent (GD) with small initialization provably converges to the ground truth $\rm{X}^\star$ without requiring any explicit regularization. This convergence result holds true even in the over-parameterized scenario, where the true rank $r$ is unknown and conservatively over-estimated by a search rank $r'\gg r$. The existing results for this problem either require explicit regularization, a sufficiently accurate initial point, or exact knowledge of the true rank $r$. In the over-parameterized regime where $r'\geq r$, we show that, with $\widetilde\Omega(dr^9)$ observations, GD with an initial point $\|\rm{U}_0\| \leq \epsilon$ converges near-linearly to an $\epsilon$-neighborhood of $\rm{X}^\star$. Consequently, smaller initial points result in increasingly accurate solutions. Surprisingly, neither the convergence rate nor the final accuracy depends on the over-parameterized search rank $r'$, and they are only governed by the true rank $r$. In the exactly-parameterized regime where $r'=r$, we further enhance this result by proving that GD converges at a faster rate to achieve an arbitrarily small accuracy $\epsilon>0$, provided the initial point satisfies $\|\rm{U}_0\| = O(1/d)$. At the crux of our method lies a novel weakly-coupled leave-one-out analysis, which allows us to establish the global convergence of GD, extending beyond what was previously possible using the classical leave-one-out analysis.


title: The wheel classes in the locally finite homology of $\mathrm{GL}_n(\mathbb{Z})$, canonical integrals and zeta values

abstract: We compute the canonical integrals associated to wheel graphs, and prove that they are proportional to odd zeta values. From this we deduce that wheel classes define explicit non-zero classes in: the locally finite homology of the general linear group $\GL_n(\ZZ)$ in both odd and even ranks, the homology of the moduli spaces of tropical curves, and the moduli space of tropical abelian varieties. We deduce the existence of a doubly infinite family of auxiliary classes in the even commutative graph complex.


title: Measuring the Dunkelflaute: How (not) to analyze variable renewable energy shortage

abstract: As variable renewable energy sources increasingly gain importance in global energy systems, there is a growing interest in understanding periods of variable renewable energy shortage ("Dunkelflauten"). Defining, quantifying, and comparing such shortage events across different renewable generation technologies and locations presents a surprisingly intricate challenge. Various methodological approaches exist in different bodies of literature, which have been applied to single technologies in specific locations or technology portfolios across multiple regions. We provide an overview of various methods for quantifying variable renewable energy shortage, focusing either on supply from variable renewables or its mismatch with electricity demand. We explain and critically discuss the merits and challenges of different approaches for defining and identifying shortage events and propose further methodological improvements for more accurate shortage determination. Additionally, we elaborate on comparability requirements for multi-technological and multi-regional energy shortage analysis. In doing so, we aim to contribute to unifying disparate methodologies, harmonizing terminologies, and providing guidance for future research.


title: A Methodology for Questionnaire Analysis: Insights through Cluster Analysis of an Investor Competition Data

abstract: In this paper, we propose a methodology for the analysis of questionnaire data along with its application on discovering insights from investor data motivated by a day trading competition. The questionnaire includes categorical questions, which are reduced to binary questions, 'yes' or 'no'. The methodology reduces dimensionality by grouping questions and participants with similar responses using clustering analysis. Rule discovery was performed by using a conversion rate metric. Innovative visual representations were proposed to validate the cluster analysis and the relation discovery between questions. When crossing with financial data, additional insights were revealed related to the recognized clusters.


title: Linear combinations of cluster mean-field states applied to spin systems

abstract: We present an innovative cluster-based method employing linear combinations of diverse cluster mean-field (cMF) states, and apply it to describe the ground state of strongly-correlated spin systems. In cluster mean-field theory, the ground state wavefunction is expressed as a factorized tensor product of optimized cluster states. While our prior work concentrated on a single cMF tiling, this study removes that constraint by combining different tilings of cMF states. Selection criteria, including translational symmetry and spatial proximity, guide this process. We present benchmark calculations for the one- and two-dimensional $J_1-J_2$ and $XXZ$ Heisenberg models. Our findings highlight two key aspects. First, the method offers a semi-quantitative description of the $0.4 \lessapprox J_2/J_1 \lessapprox 0.6$ regime of the $J_1-J_2$ model - a particularly challenging regime for existing methods. Second, our results demonstrate the capability of our method to provide qualitative descriptions for all the models and regimes considered, establishing it as a valuable reference. However, the inclusion of additional (weak) correlations is necessary for quantitative agreement, and we explore methods to incorporate these extra correlations.


title: Embedding Compression for Teacher-to-Student Knowledge Transfer

abstract: Common knowledge distillation methods require the teacher model and the student model to be trained on the same task. However, the usage of embeddings as teachers has also been proposed for different source tasks and target tasks. Prior work that uses embeddings as teachers ignores the fact that the teacher embeddings are likely to contain irrelevant knowledge for the target task. To address this problem, we propose to use an embedding compression module with a trainable teacher transformation to obtain a compact teacher embedding. Results show that adding the embedding compression module improves the classification performance, especially for unsupervised teacher embeddings. Moreover, student models trained with the guidance of embeddings show stronger generalizability.


title: Three-dimensional Hard X-ray Ptychographic Reflectometry Imaging on Extended Mesoscopic Surface Structures

abstract: Many nano and quantum devices, with their sizes often spanning from millimeters down to sub-nanometer, have intricate low-dimensional, non-uniform, or hierarchical structures on surfaces and interfaces. Since their functionalities are dependent on these structures, high-resolution surface-sensitive characterization becomes imperative to gain a comprehensive understanding of the function-structure relationship. We thus developed hard X-ray ptychographic reflectometry imaging, a new technique that merges the high-resolution two-dimensional imaging capabilities of hard X-ray ptychography for extended objects, with the high-resolution depth profiling capabilities of X-ray reflectivity for layered structures. The synergy of these two methods fully leverages both amplitude and phase information from ptychography reconstruction to not only reveal surface topography and localized structures such as shapes and electron densities, but also yields statistical details such as interfacial roughness that is not readily accessible through coherent imaging solely. The hard X-ray ptychographic reflectometry imaging is well-suited for three-dimensional imaging of mesoscopic samples, particularly those comprising planar or layered nanostructures on opaque supports, and could also offer a high-resolution surface metrology and defect analysis on semiconductor devices such as integrated nanocircuits and lithographic photomasks for microchip fabrications.


title: Scalable Kernel Logistic Regression with Nystr\"om Approximation: Theoretical Analysis and Application to Discrete Choice Modelling

abstract: The application of kernel-based Machine Learning (ML) techniques to discrete choice modelling using large datasets often faces challenges due to memory requirements and the considerable number of parameters involved in these models. This complexity hampers the efficient training of large-scale models. This paper addresses these problems of scalability by introducing the Nystr\"om approximation for Kernel Logistic Regression (KLR) on large datasets. The study begins by presenting a theoretical analysis in which: i) the set of KLR solutions is characterised, ii) an upper bound to the solution of KLR with Nystr\"om approximation is provided, and finally iii) a specialisation of the optimisation algorithms to Nystr\"om KLR is described. After this, the Nystr\"om KLR is computationally validated. Four landmark selection methods are tested, including basic uniform sampling, a k-means sampling strategy, and two non-uniform methods grounded in leverage scores. The performance of these strategies is evaluated using large-scale transport mode choice datasets and is compared with traditional methods such as Multinomial Logit (MNL) and contemporary ML techniques. The study also assesses the efficiency of various optimisation techniques for the proposed Nystr\"om KLR model. The performance of gradient descent, Momentum, Adam, and L-BFGS-B optimisation methods is examined on these datasets. Among these strategies, the k-means Nystr\"om KLR approach emerges as a successful solution for applying KLR to large datasets, particularly when combined with the L-BFGS-B and Adam optimisation methods. The results highlight the ability of this strategy to handle datasets exceeding 200,000 observations while maintaining robust performance.


title: GLaM: Fine-Tuning Large Language Models for Domain Knowledge Graph Alignment via Neighborhood Partitioning and Generative Subgraph Encoding

abstract: Integrating large language models (LLMs) with knowledge graphs derived from domain-specific data represents an important advancement towards more powerful and factual reasoning. As these models grow more capable, it is crucial to enable them to perform multi-step inferences over real-world knowledge graphs while minimizing hallucination. While large language models excel at conversation and text generation, their ability to reason over domain-specialized graphs of interconnected entities remains limited. For example, can we query a LLM to identify the optimal contact in a professional network for a specific goal, based on relationships and attributes in a private database? The answer is no--such capabilities lie beyond current methods. However, this question underscores a critical technical gap that must be addressed. Many high-value applications in areas such as science, security, and e-commerce rely on proprietary knowledge graphs encoding unique structures, relationships, and logical constraints. We introduce a fine-tuning framework for developing Graph-aligned LAnguage Models (GLaM) that transforms a knowledge graph into an alternate text representation with labeled question-answer pairs. We demonstrate that grounding the models in specific graph-based knowledge expands the models' capacity for structure-based reasoning. Our methodology leverages the large-language model's generative capabilities to create the dataset and proposes an efficient alternate to retrieval-augmented generation styled methods.


title: Perfect Bayesian Persuasion

abstract: A sender commits to an experiment to persuade a receiver. Accounting for the sender's experiment-choice incentives, and not presupposing a receiver tie-breaking rule when indifferent, we characterize when the sender's equilibrium payoff is unique and so coincides with her "Bayesian persuasion" value. A sufficient condition in finite models is that every action which is receiver-optimal at some belief is uniquely optimal at some other belief -- a generic property. We similarly show the equilibrium sender payoff is typically unique in ordered models. In an extension, we show uniqueness generates robustness to imperfect sender commitment.


title: Evaluation Metrics for Text Data Augmentation in NLP

abstract: Recent surveys on data augmentation for natural language processing have reported different techniques and advancements in the field. Several frameworks, tools, and repositories promote the implementation of text data augmentation pipelines. However, a lack of evaluation criteria and standards for method comparison due to different tasks, metrics, datasets, architectures, and experimental settings makes comparisons meaningless. Also, a lack of methods unification exists and text data augmentation research would benefit from unified metrics to compare different augmentation methods. Thus, academics and the industry endeavor relevant evaluation metrics for text data augmentation techniques. The contribution of this work is to provide a taxonomy of evaluation metrics for text augmentation methods and serve as a direction for a unified benchmark. The proposed taxonomy organizes categories that include tools for implementation and metrics calculation. Finally, with this study, we intend to present opportunities to explore the unification and standardization of text data augmentation metrics.


title: Precoded Polar Product Codes

abstract: Precoded polar product codes are proposed, where selected component codes enable successive cancellation list decoding to generate bit-wise soft messages efficiently for iterative decoding while targeting optimized distance spectrum as opposed to eBCH or polar component codes. Rate compatibility is a byproduct of $1$-bit granularity in the component code design.


title: Product of Tensors and Description of Networks

abstract: Any kind of network can be naturally represented by a Directed Acyclic Graph (DAG); additionally, activation functions can determine the reaction of each node of the network with respect to the signal(s) incoming. We study the characterization of the signal distribution in a network under the lens of tensor algebra. More specifically, we describe every activation function as tensor distributions with respect to the nodes, called \textit{activation tensors}. The distribution of the signal is encoded in the \textit{total tensor} of the network. We formally prove that the total tensor can be obtained by computing the \textit{Batthacharya-Mesner Product} (BMP), an $n$-ary operation for tensors of order $n$, on the set of the activation tensors properly ordered and processed via two basic operations, that we call \textit{blow} and \textit{forget}. Our theoretical framework can be validated through the related code developed in Python.


title: High-contrast periodic random jumps in continuum and limit Markov process

abstract: The paper deals with the asymptotic properties of a random jump process in a high contrast periodic medium in $\mathbb R^d$, $d\geq 1$. We show that if the coordinates of the random jump process in $\mathbb R^d$ are equipped with an extra variable that characterizes the position of the process inside the period, then the limit dynamics of this two-component process is Markov. We describe the limit process and prove the convergence in law in the path space. We show that the components of the limit process are coupled and derive the evolution equation with a memory term for the spatial component of the process. We also discuss the construction of the limit process in the $L^2$ space and study the spectrum of the generator of the limit semigroup.


title: Towards molecular docking with neutral atoms

abstract: New computational strategies, such as molecular docking, are emerging to speed up the drug discovery process. This method predicts the activity of molecules at the binding site of proteins, helping to select the ones that exhibit desirable behavior and rejecting the rest. However, for large chemical libraries, it is essential to search and score configurations using fewer computational resources while maintaining high precision. In this work, we map the molecular docking problem to a graph problem, a maximum-weight independent set problem on a unit-disk graph in a physical neutral atom quantum processor. Here, each vertex represents an atom trapped by optical tweezers. The Variational Quantum Adiabatic Algorithm (VQAA) approach is used to solve the generic graph problem with two optimization methods, Scipy and Hyperopt. Additionally, a machine learning method is explored using the adiabatic algorithm. Results for multiple graphs are presented, and a small instance of the molecular docking problem is solved, demonstrating the potential for near-term quantum applications.


title: Roots of Alexander polynomials of random positive 3-braids

abstract: Motivated by an observation of Dehornoy, we study the roots of Alexander polynomials of knots and links that are closures of positive 3-strand braids. We give experimental data on random such braids and find that the roots exhibit marked patterns, which we refine into precise conjectures. We then prove several results along those lines, for example that generically at least 69% of the roots are on the unit circle, which appears to be sharp. We also show there is a large root-free region near the origin. We further study the equidistribution properties of such roots by introducing a Lyapunov exponent of the Burau representation of random positive braids, and a corresponding bifurcation measure. In the spirit of Deroin and Dujardin, we conjecture that the bifurcation measure gives the limiting measure for such roots, and prove this on a region with positive limiting mass. We use tools including work of Gambaudo and Ghys on the signature function of links, for which we prove a central limit theorem.


title: Retrosynthesis Prediction via Search in (Hyper) Graph

abstract: Predicting reactants from a specified core product stands as a fundamental challenge within organic synthesis, termed retrosynthesis prediction. Recently, semi-template-based methods and graph-edits-based methods have achieved good performance in terms of both interpretability and accuracy. However, due to their mechanisms these methods cannot predict complex reactions, e.g., reactions with multiple reaction center or attaching the same leaving group to more than one atom. In this study we propose a semi-template-based method, the \textbf{Retro}synthesis via \textbf{S}earch \textbf{i}n (Hyper) \textbf{G}raph (RetroSiG) framework to alleviate these limitations. In the proposed method, we turn the reaction center identification and the leaving group completion tasks as tasks of searching in the product molecular graph and leaving group hypergraph respectively. As a semi-template-based method RetroSiG has several advantages. First, RetroSiG is able to handle the complex reactions mentioned above by its novel search mechanism. Second, RetroSiG naturally exploits the hypergraph to model the implicit dependencies between leaving groups. Third, RetroSiG makes full use of the prior, i.e., one-hop constraint. It reduces the search space and enhances overall performance. Comprehensive experiments demonstrated that RetroSiG achieved competitive results. Furthermore, we conducted experiments to show the capability of RetroSiG in predicting complex reactions. Ablation experiments verified the efficacy of specific elements, such as the one-hop constraint and the leaving group hypergraph.


title: Europium $c$-axis ferromagnetism in Eu(Co$_{1-x}$Ni$_{x}$)$_{2-y}$As$_{2}$: A single-crystal neutron diffraction study

abstract: We report neutron diffraction results for the body-centered-tetragonal series Eu(Co$_{1-x}$Ni$_x$)$_{2-y}$As$_2$, $x=0.10$, $0.20$, $0.42$, and $0.82$, $y\leq0.10$, that detail changes to the magnetic ordering with nominal hole doping. We report the antiferromagnetic (AFM) propagation vectors, magnetic transition temperatures, and the ordered magnetic moments. We find a nonmonotonic change of the AFM propagation vector with $x$, with a minimum occurring at the tetragonal to collapsed-tetragonal phase crossover. For $x=0.10$ and $0.82$ we find $c$-axis helix ordering of the Eu magnetic moments (spins) similar to $x=0$ and $1$, with the spins oriented within the $ab$-plane. For $x=0.20$ and $0.42$ we find higher-temperature $c$-axis FM order and lower-temperature $c$-axis cone order. Using the extinction conditions for the space group, we discovered that the Eu spins are ordered in the higher-temperature $c$-axis FM phase for intermediate values of $x$, contrary to a previous report suggesting only Co/Ni spin ordering. Although we cannot directly confirm that the Co/Ni spins are also ordered, we suggest that $c$-axis itinerant-FM ordering of the Co/Ni spins could provide a molecular field that drives FM ordering of the Eu spins, which in turn provides the anisotropy for the lower-temperature $c$-axis cone order.


title: Some integral operators acting on $H^{\infty}$

abstract: Let $f$ and $g$ be analytic on the unit disc $\mathbb{D}$. The integral operator $T_g$ is defined by $ T_g f(z) = \int_0^z f(t)g'(t)\,dt$, $z \in \mathbb{D}$. The problem considered is characterizing those symbols $g$ for which $T_g$ acting on $H^\infty$, the space of bounded analytic functions on $\mathbb{D}$, is bounded or compact. When the symbol is univalent, these become questions in univalent function theory. The corresponding problems for the companion operator, $ S_g f(z)= \int_0^z f'(t)g(t)\, dt$, acting on $H^\infty$ are also studied.


title: Twenty Constructionist Things to Do with Artificial Intelligence and Machine Learning

abstract: In this paper, we build on the 1971 memo "Twenty Things to Do With a Computer" by Seymour Papert and Cynthia Solomon and propose twenty constructionist things to do with artificial intelligence and machine learning. Several proposals build on ideas developed in the original memo while others are new and address topics in science, mathematics, and the arts. In reviewing the big themes, we notice a renewed interest in children's engagement not just for technical proficiency but also to cultivate a deeper understanding of their own cognitive processes. Furthermore, the ideas stress the importance of designing personally relevant AI/ML applications, moving beyond isolated models and off-the-shelf datasets disconnected from their interests. We also acknowledge the social aspects of data production involved in making AI/ML applications. Finally, we highlight the critical dimensions necessary to address potential harmful algorithmic biases and consequences of AI/ML applications.


title: Consistent inclusion of fluctuations in first-order causal and stable relativistic hydrodynamics

abstract: We construct, for the first time, a Bemfica-Disconzi-Noronha-Kovtun (BDNK) theory for linear stochastic fluctuations, which is proved to be mathematically consistent, causal, and covariantly stable. The Martin-Siggia-Rose action is shown to be bilocal in most cases, and the noise is not white. The presence of nonhydrodynamic modes induces long-range correlations in the primary fluid variables (temperature, chemical potential, and flow velocity). However, correlators of conserved densities remain localized in space, and coincide with those calculated within fluctuating Isreal-Stewart theory. We show that, in some cases, there is a nonlocal change of variables that maps the Israel-Stewart action into the BDNK action.


title: Capturing Cancer as Music: Cancer Mechanisms Expressed through Musification

abstract: The development of cancer is difficult to express on a simple and intuitive level due to its complexity. Since cancer is so widespread, raising public awareness about its mechanisms can help those affected cope with its realities, as well as inspire others to make lifestyle adjustments and screen for the disease. Unfortunately, studies have shown that cancer literature is too technical for the general public to understand. We found that musification, the process of turning data into music, remains an unexplored avenue for conveying this information. We explore the pedagogical effectiveness of musification through the use of an algorithm that manipulates a piece of music in a manner analogous to the development of cancer. We conducted two lab studies and found that our approach is marginally more effective at promoting cancer literacy when accompanied by a text-based article than text-based articles alone.


title: Distributed Quasi-Newton Method for Multi-Agent Optimization

abstract: We present a distributed quasi-Newton (DQN) method, which enables a group of agents to compute an optimal solution of a separable multi-agent optimization problem locally using an approximation of the curvature of the aggregate objective function. Each agent computes a descent direction from its local estimate of the aggregate Hessian, obtained from quasi-Newton approximation schemes using the gradient of its local objective function. Moreover, we introduce a distributed quasi-Newton method for equality-constrained optimization (EC-DQN), where each agent takes Karush-Kuhn-Tucker-like update steps to compute an optimal solution. In our algorithms, each agent communicates with its one-hop neighbors over a peer-to-peer communication network to compute a common solution. We prove convergence of our algorithms to a stationary point of the optimization problem. In addition, we demonstrate the competitive empirical convergence of our algorithm in both well-conditioned and ill-conditioned optimization problems, in terms of the computation time and communication cost incurred by each agent for convergence, compared to existing distributed first-order and second-order methods. Particularly, in ill-conditioned problems, our algorithms achieve a faster computation time for convergence, while requiring a lower communication cost, across a range of communication networks with different degrees of connectedness, by leveraging information on the curvature of the problem.


title: Source-sink dynamics in a two-patch SI epidemic model with life stages and no recovery from infection

abstract: This study presents a comprehensive analysis of a two-patch, two-life stage SI model without recovery from infection, focusing on the dynamics of disease spread and host population viability in natural populations. The model, inspired by real-world ecological crises like the decline of amphibian populations due to chytridiomycosis and sea star populations due to Sea Star Wasting Disease, aims to understand the conditions under which a sink host population can present ecological rescue from a healthier, source population. Mathematical and numerical analyses reveal the critical roles of the basic reproductive numbers of the source and sink populations, the maturation rate, and the dispersal rate of juveniles in determining population outcomes. The study identifies conditions for disease-free, endemic, and extinction equilibria in sink populations, emphasizing the potential for ecological and evolutionary mechanisms to facilitate coexistence or recovery. These findings provide insights into managing natural populations affected by disease, with implications for conservation strategies, such as the importance of maintaining reproductively viable refuge populations and considering the effects of dispersal and maturation rates on population recovery. The research underscores the complexity of host-pathogen dynamics in spatially structured environments and highlights the need for multi-faceted approaches to biodiversity conservation in the face of emerging diseases.


title: Non-Radial Free Geodesics. I. In Spatially Flat FLRW Spacetime

abstract: This paper provides an analytical examination of non-radial geodesics within the context of the spatially flat Friedmann Lema\^itre Robertson Walker (FLRW) spacetime. Using the symmetry properties of the system, two constants of motion related to this dynamical system are derived. This treatment enables us to explicitly compute the radial and angular peculiar velocities, as well as the evolution of the comoving radial distance and angle over time. The study introduces three distinct methods to characterize geodesic solutions, and additionally examines the radial geodesic limit, the null geodesic limit, and the comoving geodesic limit. Additionally, the paper investigates both non-radial and radial free geodesics within the Lambda Cold Dark Matter ({\Lambda}CDM) model, presenting detailed results and discussions. Lastly, we explore the total angle swept by a free particle from the initial singularity to infinity as measured by a comoving observer, offering insights into the dynamics of free particles in FLRW spacetime.


title: A Survey of Four Precessing Waveform Models for Binary Black Hole Systems

abstract: Angular momentum and spin precession are expected to be generic features of a significant fraction of binary black hole systems. As such, it is essential to have waveform models that faithfully incorporate the effects of precession. Here, we assess how well the current state of the art models achieve this for waveform strains constructed only from the $\ell=2$ multipoles.Specifically, we conduct a survey on the faithfulness of the waveform models %(approximants) \texttt{SEOBNRv5PHM}, \texttt{TEOBResumS}, \texttt{IMRPhenomTPHM}, \texttt{IMRPhenomXPHM} to the numerical relativity (NR) surrogate \texttt{NRSur7dq4} and to NR waveforms from the \texttt{SXS} catalog. The former assessment involves systems with mass ratios up to six and dimensionless spins up to 0.8. The latter employs $317$ short and $23$ long \texttt{SXS} waveforms. For all cases, we use reference inclinations of zero and $90^\circ$. We find that all four models become more faithful as the mass ratio approaches unity and when the merger-ringdown portion of the waveforms are excluded. We also uncover a correlation between the co-precessing $(2,\pm2)$ multipole mismatches and the overall strain mismatch. We additionally find that for high inclinations, precessing $(2,\pm 1)$ multipoles that are more faithful than their $(2,\pm2)$ counterparts, and comparable in magnitude, improve waveform faithfulness. As a side note, we show that use of uniformly-filled parameter spaces may lead to an overestimation of precessing model faithfulness. We conclude our survey with a parameter estimation study in which we inject two precessing \texttt{SXS} waveforms (at low and high masses) and recover the signal with \texttt{SEOBNRv5PHM}, \texttt{IMRPhenomTPHM} and \texttt{IMRPhenomXPHM}. As a bonus, we present preliminary multidimensional fits to model unfaithfulness for Bayesian model selection in parameter estimation studies.


title: Debating with More Persuasive LLMs Leads to More Truthful Answers

abstract: Common methods for aligning large language models (LLMs) with desired behaviour heavily rely on human-labelled data. However, as models grow increasingly sophisticated, they will surpass human expertise, and the role of human evaluation will evolve into non-experts overseeing experts. In anticipation of this, we ask: can weaker models assess the correctness of stronger models? We investigate this question in an analogous setting, where stronger models (experts) possess the necessary information to answer questions and weaker models (non-experts) lack this information. The method we evaluate is debate, where two LLM experts each argue for a different answer, and a non-expert selects the answer. We find that debate consistently helps both non-expert models and humans answer questions, achieving 76% and 88% accuracy respectively (naive baselines obtain 48% and 60%). Furthermore, optimising expert debaters for persuasiveness in an unsupervised manner improves non-expert ability to identify the truth in debates. Our results provide encouraging empirical evidence for the viability of aligning models with debate in the absence of ground truth.


title: Learn to Teach: Improve Sample Efficiency in Teacher-student Learning for Sim-to-Real Transfer

abstract: Simulation-to-reality (sim-to-real) transfer is a fundamental problem for robot learning. Domain Randomization, which adds randomization during training, is a powerful technique that effectively addresses the sim-to-real gap. However, the noise in observations makes learning significantly harder. Recently, studies have shown that employing a teacher-student learning paradigm can accelerate training in randomized environments. Learned with privileged information, a teacher agent can instruct the student agent to operate in noisy environments. However, this approach is often not sample efficient as the experience collected by the teacher is discarded completely when training the student, wasting information revealed by the environment. In this work, we extend the teacher-student learning paradigm by proposing a sample efficient learning framework termed Learn to Teach (L2T) that recycles experience collected by the teacher agent. We observe that the dynamics of the environments for both agents remain unchanged, and the state space of the teacher is coupled with the observation space of the student. We show that a single-loop algorithm can train both the teacher and student agents under both Reinforcement Learning and Inverse Reinforcement Learning contexts. We implement variants of our methods, conduct experiments on the MuJoCo benchmark, and apply our methods to the Cassie robot locomotion problem. Extensive experiments show that our method achieves competitive performance while only requiring environmental interaction with the teacher.


title: Transfer learning with generative models for object detection on limited datasets

abstract: The availability of data is limited in some fields, especially for object detection tasks, where it is necessary to have correctly labeled bounding boxes around each object. A notable example of such data scarcity is found in the domain of marine biology, where it is useful to develop methods to automatically detect submarine species for environmental monitoring. To address this data limitation, the state-of-the-art machine learning strategies employ two main approaches. The first involves pretraining models on existing datasets before generalizing to the specific domain of interest. The second strategy is to create synthetic datasets specifically tailored to the target domain using methods like copy-paste techniques or ad-hoc simulators. The first strategy often faces a significant domain shift, while the second demands custom solutions crafted for the specific task. In response to these challenges, here we propose a transfer learning framework that is valid for a generic scenario. In this framework, generated images help to improve the performances of an object detector in a few-real data regime. This is achieved through a diffusion-based generative model that was pretrained on large generic datasets. With respect to the state-of-the-art, we find that it is not necessary to fine tune the generative model on the specific domain of interest. We believe that this is an important advance because it mitigates the labor-intensive task of manual labeling the images in object detection tasks. We validate our approach focusing on fishes in an underwater environment, and on the more common domain of cars in an urban setting. Our method achieves detection performance comparable to models trained on thousands of images, using only a few hundreds of input data. Our results pave the way for new generative AI-based protocols for machine learning applications in various domains.

categories: cs.CV cond-mat.dis-nn cs.AI cs.LG cs.NA math.NA