title: Data-driven design of multilayer hyperbolic metamaterials for near-field thermal radiative modulator with high modulation contrast

abstract: The thermal modulator based on the near-field radiative heat transfer has wide applications in thermoelectric diodes, thermoelectric transistors, and thermal storage. However, the design of optimal near-field thermal radiation structure is a complex and challenging problem due to the tremendous number of degrees of freedom. In this work, we have proposed a data-driven machine learning workflow to efficiently design multilayer hyperbolic metamaterials composed of ${\alpha}$-MoO$_{\rm 3}$ for near-field thermal radiative modulator with high modulation contrast. By combining the multilayer perceptron and Bayesian optimization, the rotation angle, layer thickness and gap distance of the multilayer metamaterials are optimized to achieve a maximum thermal modulation contrast ratio of 6.29. This represents a 97% improvement compared to previous single layer structure. The large thermal modulation contrast is mainly attributed to the alignment and misalignment of hyperbolic plasmon polaritons and hyperbolic surface phonon polaritons of each layer controlled by the rotation. The results provide a promising way for accelerating the designing and manipulating of near-field radiative heat transfer by anisotropic hyperbolic materials through the data-driven style.


title: When a random tape is not enough: lower bounds for a problem in adversarially robust streaming

abstract: Adversarially robust streaming algorithms are required to process a stream of elements and produce correct outputs, even when each stream element can be chosen depending on earlier algorithm outputs. As with classic streaming algorithms, which must only be correct for the worst-case fixed stream, adversarially robust algorithms with access to randomness can use significantly less space than deterministic algorithms. We prove that for the Missing Item Finding problem in streaming, the space complexity also significantly depends on how adversarially robust algorithms are permitted to use randomness. (In contrast, the space complexity of classic streaming algorithms does not depend as strongly on the way randomness is used.) For Missing Item Finding on streams of length $r$ with elements in $\{1,...n\}$, and $\le 1/\text{poly}(n)$ error, we show that when $r = O(2^{\sqrt{\log n}})$, "random seed" adversarially robust algorithms, which only use randomness at initialization, require $r^{\Omega(1)}$ bits of space, while "random tape" adversarially robust algorithms, which may make random decisions at any time, may use $O(\text{polylog}(r))$ random bits. When $r = \Theta(\sqrt{n})$, "random tape" adversarially robust algorithms need $r^{\Omega(1)}$ space, while "random oracle" adversarially robust algorithms, which can read from a long random string for free, may use $O(\text{polylog}(r))$ space. The space lower bound for the "random seed" case follows, by a reduction given in prior work, from a lower bound for pseudo-deterministic streaming algorithms given in this paper.


title: CLEVRER-Humans: Describing Physical and Causal Events the Human Way

abstract: Building machines that can reason about physical events and their causal relationships is crucial for flexible interaction with the physical world. However, most existing physical and causal reasoning benchmarks are exclusively based on synthetically generated events and synthetic natural language descriptions of causal relationships. This design brings up two issues. First, there is a lack of diversity in both event types and natural language descriptions; second, causal relationships based on manually-defined heuristics are different from human judgments. To address both shortcomings, we present the CLEVRER-Humans benchmark, a video reasoning dataset for causal judgment of physical events with human labels. We employ two techniques to improve data collection efficiency: first, a novel iterative event cloze task to elicit a new representation of events in videos, which we term Causal Event Graphs (CEGs); second, a data augmentation technique based on neural language generative models. We convert the collected CEGs into questions and answers to be consistent with prior work. Finally, we study a collection of baseline approaches for CLEVRER-Humans question-answering, highlighting the great challenges set forth by our benchmark.


title: Universal Dynamics at the Lowest Temperatures

abstract: High-performance graphical processing units (GPU) are used for the repeated parallelised propagation of non-linear partial differential equations on large spatio-temporal grids. The main challenge results as a combination of the requirement of large grids for exploring scaling over several orders of magnitude, both in space and time, and the need for high statistics in averaging over many runs, in computing correlation functions for highly fluctuating quantum many-body states. With our simulations, we explore the dynamics of complex quantum systems far from equilibrium, with the aim of classifying their universal characteristics such as scaling exponents near non-thermal fixed points. Our results are strongly relevant for the development of synthetic quantum systems when exploring the respective physics in the laboratory.


title: Solving Degree Bounds For Iterated Polynomial Systems

abstract: For Arithmetization-Oriented ciphers and hash functions Gr\"obner basis attacks are generally considered as the most competitive attack vector. Unfortunately, the complexity of Gr\"obner basis algorithms is only understood for special cases, and it is needless to say that these cases do not apply to most cryptographic polynomial systems. Therefore, cryptographers have to resort to experiments, extrapolations and hypotheses to assess the security of their designs. One established measure to quantify the complexity of linear algebra-based Gr\"obner basis algorithms is the so-called solving degree. Caminata \& Gorla revealed that under a certain genericity condition on a polynomial system the solving degree is always upper bounded by the Castelnuovo-Mumford regularity and henceforth by the Macaulay bound, which only takes the degrees and number of variables of the input polynomials into account. In this paper we extend their framework to iterated polynomial systems, the standard polynomial model for symmetric ciphers and hash functions. In particular, we prove solving degree bounds for various attacks on MiMC, Feistel-MiMC, Feistel-MiMC-Hash, Hades and GMiMC. Our bounds fall in line with the hypothesized complexity of Gr\"obner basis attacks on these designs, and to the best of our knowledge this is the first time that a mathematical proof for these complexities is provided. Moreover, by studying polynomials with degree falls we can prove lower bounds on the Castelnuovo-Mumford regularity for attacks on MiMC, Feistel-MiMC and Feistel-MiMC-Hash provided that only a few solutions of the corresponding iterated polynomial system originate from the base field. Hence, regularity-based solving degree estimations can never surpass a certain threshold, a desirable property for cryptographic polynomial systems.


title: Huge Dzyaloshinskii-Moriya interactions in Re_Co_Pt thin films

abstract: We investigate the magnetization and the Dzyaloshinskii-Moriya interactions (DMI) in Pt/Co/Re thin films in the case of perfect interfaces and upon the introduction of intermixing on both Co interfaces. Calculations were implemented on a series of systems with a varied number of cobalt atomic layers (ALs). Remarkably, the Re is able to introduce a DMI at the interface with cobalt and also, increase the DMI at the Pt/Co interface. We demonstrate that the chiral magnetic multilayer Pt/Co/Re with chiral spin structure can achieve a huge DMI value which is almost double of that attained in the prototype system W/Co/Pt. We study also the DMI as a function of the Re thickness finding the optimal thickness to maximize the DMI. When we include a disorder that cancels a contribution from all first-neighbor Co atoms in the intermixed region, we found out that intermixing at the two interfaces affects the strength of the DMI solely when introduced at the Pt/Co interface where the DMI loses almost half of its value. On the contrary, the mixing at the Co/Re interface has very little or no effect as compared to the case with perfect interfaces. The value of the DMI would be somewhere between the perfect interface case and the totally intermixed case. The realization of such a device should focus on the reduction of the Pt/Co intermixing to realize this huge DMI interaction.


title: Evaluating Self-Supervised Speech Representations for Indigenous American Languages

abstract: The application of self-supervision to speech representation learning has garnered significant interest in recent years, due to its scalability to large amounts of unlabeled data. However, much progress, both in terms of pre-training and downstream evaluation, has remained concentrated in monolingual models that only consider English. Few models consider other languages, and even fewer consider indigenous ones. In our submission to the New Language Track of the ASRU 2023 ML-SUPERB Challenge, we present an ASR corpus for Quechua, an indigenous South American Language. We benchmark the efficacy of large SSL models on Quechua, along with 6 other indigenous languages such as Guarani and Bribri, on low-resource ASR. Our results show surprisingly strong performance by state-of-the-art SSL models, showing the potential generalizability of large-scale models to real-world data.


title: Proof-theoretic methods in quantifier-free definability

abstract: We introduce a proof-theoretic method for showing nondefinability of second-order intuitionistic connectives by quantifier-free schemata. We apply the method to confirm that Taranovsky's "realizability disjunction" connective does not admit a quantifier-free definition, and use it to obtain new results and more nuanced information about the nondefinability of Kreisel's and Po{\l}acik's unary connectives. The finitary and combinatorial nature of our method makes it more resilient to changes in metatheory than common semantic approaches, whose robustness tends to waver once we pass to non-classical and especially anti-classical settings. Furthermore, we can easily transcribe the problem-specific subproofs into univalent type theory and check them using the Agda proof assistant.


title: Distributional PAC-Learning from Nisan's Natural Proofs

abstract: Carmosino et al. (2016) demonstrated that natural proofs of circuit lower bounds for $\Lambda$ imply efficient algorithms for learning $\Lambda$-circuits, but only over \textit{the uniform distribution}, with \textit{membership queries}, and provided $\AC^0[p] \subseteq \Lambda$. We consider whether this implication can be generalized to $\Lambda \not\supseteq \AC^0[p]$, and to learning algorithms which use only random examples and learn over arbitrary example distributions (Valiant's PAC-learning model). We first observe that, if, for any circuit class $\Lambda$, there is an implication from natural proofs for $\Lambda$ to PAC-learning for $\Lambda$, then standard assumptions from lattice-based cryptography do not hold. In particular, we observe that depth-2 majority circuits are a (conditional) counter example to the implication, since Nisan (1993) gave a natural proof, but Klivans and Sherstov (2009) showed hardness of PAC-learning under lattice-based assumptions. We thus ask: what learning algorithms can we reasonably expect to follow from Nisan's natural proofs? Our main result is that all natural proofs arising from a type of communication complexity argument, including Nisan's, imply PAC-learning algorithms in a new \textit{distributional} variant (i.e., an ``average-case'' relaxation) of Valiant's PAC model. Our distributional PAC model is stronger than the average-case prediction model of Blum et al. (1993) and the heuristic PAC model of Nanashima (2021), and has several important properties which make it of independent interest, such as being \textit{boosting-friendly}. The main applications of our result are new distributional PAC-learning algorithms for depth-2 majority circuits, polytopes and DNFs over natural target distributions, as well as the nonexistence of encoded-input weak PRFs that can be evaluated by depth-2 majority circuits.


title: Deep surrogate model for learning Green's function associated with linear reaction-diffusion operator

abstract: In this paper, we present a deep surrogate model for learning the Green's function associated with the reaction-diffusion operator in rectangular domain. The U-Net architecture is utilized to effectively capture the mapping from source to solution of the target partial differential equations (PDEs). To enable efficient training of the model without relying on labeled data, we propose a novel loss function that draws inspiration from traditional numerical methods used for solving PDEs. Furthermore, a hard encoding mechanism is employed to ensure that the predicted Green's function is perfectly matched with the boundary conditions. Based on the learned Green's function from the trained deep surrogate model, a fast solver is developed to solve the corresponding PDEs with different sources and boundary conditions. Various numerical examples are also provided to demonstrate the effectiveness of the proposed model.


title: Invariant measures for place dependent idempotent iterated function systems

abstract: We study the set of invariant idempotent probabilities for place dependent idempotent iterated function systems defined in compact metric spaces. Using well-known ideas from dynamical systems, such as the Ma\~{n}\'{e} potential and the Aubry set, we provide a complete characterization of the densities of such idempotent probabilities. As an application, we provide an alternative formula for the attractor of a class of fuzzy iterated function systems.


title: Failure of quasi-isometric rigidity for infinite-ended groups

abstract: We prove that an infinite-ended group whose one-ended factors have finite-index subgroups and are in a family of groups with a nonzero multiplicative invariant is not quasi-isometrically rigid. Combining this result with work of the first author proves that a residually-finite multi-ended hyperbolic group is quasi-isometrically rigid if and only if it is virtually free. The proof adapts an argument of Whyte for commensurability of free products of closed hyperbolic surface groups.


title: A combined LOFAR and XMM-Newton analysis of the disturbed cluster PSZ2G113.91-37.01

abstract: In this work, we investigated the interplay between the X-ray and radio emission of the cluster PSZ2G113.91-37.01 (z = 0.371) using the high-quality XMM-Newton observations of the CHEX-MATE project, and the images of the LoTSS-DR2. The cluster is undergoing a merger along the north-south axis, and shows a central radio halo and two radio relics, one in the southern and one in the northern regions. The analysis of the intracluster medium distribution revealed the presence of a northern surface brightness jump associated to the merger event. By extracting spectra across this discontinuity, we classified the edge as a cold front. Furthermore, we made use of upgraded Giant Metrewave Radio Telescope observations that allowed us to perform a spectral analysis of the G113 radio emission. We found evidence of re-acceleration of particles in the northern relic, and we measured an associated Mach number of M = 1.95 $\pm$ 0.01, as inferred from radio observations. We then performed a point-to-point analysis of the X-ray and radio emission both in the halo and in the northern relic regions. We found a strong correlation for the halo and an anti-correlation for the relic. The former behaviour is in agreement with previous studies. The relic anti-correlation is likely related to the reverse radial distribution of the X-ray (increasing towards the cluster centre) and radio (decreasing towards the cluster centre) emissions. Finally, we performed a point-to-point analysis of the radio emission and the residuals obtained by subtracting a double beta model to the X-ray emission. We found a strong correlation between the two quantities. This behaviour suggests the presence of a connection between the process responsible for the radio emission and the one that leaves fluctuations in the X-ray observations.


title: TRAM: Bridging Trust Regions and Sharpness Aware Minimization

abstract: Sharpness-aware minimization (SAM) reports improving domain generalization by reducing the loss surface curvature in the parameter space. However, generalization during fine-tuning is often more dependent on the transferability of representations in the function space. Trust-region methods (TR) target this goal by regularizing representation curvature to reduce catastrophic forgetting of pre-trained task-agnostic information while adopting task-specific skills. We consider unifying these strategies for low curvature in both parameter space and function space to improve out-of-domain (OOD) generalization. We propose Trust Region Aware Minimization (TRAM), a SAM algorithm fine-tuning for low parameter sharpness and smooth, informative representations preserving pre-trained structure. TRAM uses a trust region bound to inform the SAM adversarial neighborhood, introducing an awareness of function curvature within optimization for flatter minima. We empirically validate TRAM in vision (cross-dataset adaptation) and text (OOD language modeling, zero-shot cross-lingual transfer) tasks where robust domain transfer and representation generality are critical. TRAM outperforms SAM- and TR-based optimization across all tasks, notably surpassing competing methods for hard transfer between anticorrelated domains. TRAM establishes a novel standard in fine-tuning for domain-generalizable models with minimal additional computation over previous sharpness-aware methods.


title: Rethinking Fairness for Human-AI Collaboration

abstract: Existing approaches to algorithmic fairness aim to ensure equitable outcomes if human decision-makers comply perfectly with algorithmic decisions. However, perfect compliance with the algorithm is rarely a reality or even a desirable outcome in human-AI collaboration. Yet, recent studies have shown that selective compliance with fair algorithms can amplify discrimination relative to the prior human policy. As a consequence, ensuring equitable outcomes requires fundamentally different algorithmic design principles that ensure robustness to the decision-maker's (a priori unknown) compliance pattern. We define the notion of compliance-robustly fair algorithmic recommendations that are guaranteed to (weakly) improve fairness in decisions, regardless of the human's compliance pattern. We propose a simple optimization strategy to identify the best performance-improving compliance-robustly fair policy. However, we show that it may be infeasible to design algorithmic recommendations that are simultaneously fair in isolation, compliance-robustly fair, and more accurate than the human policy; thus, if our goal is to improve the equity and accuracy of human-AI collaboration, it may not be desirable to enforce traditional fairness constraints.


title: An alternative proof of the Faltings-Elkies bound

abstract: We give an alternative proof of the Faltings-Elkies bound on the average value of the Arakelov-Green function in pairs of a given set of $n$ points on a Riemann surface, which grows asymptotically like $O((\log n)/n)$. Our result is effective in terms of bounds of the Arakelov-Green function with respect to a given covering by local coordinates.


title: Refinement of Interval Approximations for Fully Commutative Quivers

abstract: A fundamental challenge in multiparameter persistent homology is the absence of a complete and discrete invariant. To address this issue, we propose an enhanced framework that realizes a holistic understanding of a fully commutative quiver's representation via synthesizing interpretations obtained from intervals. Additionally, it provides a mechanism to tune the balance between approximation resolution and computational complexity. This framework is evaluated on commutative ladders of both finite-type and infinite-type. For the former, we discover an efficient method for the indecomposable decomposition leveraging solely one-parameter persistent homology. For the latter, we introduce a new invariant that reveals persistence in the second parameter by connecting two standard persistence diagrams using interval approximations. We subsequently present several models for constructing commutative ladder filtrations, offering fresh insights into random filtrations and demonstrating our toolkit's effectiveness in analyzing the topology of materials.


title: General Equilibrium Theory for Climate Change

abstract: We propose two general equilibrium models, quota equilibrium and emission tax equilibrium. The government specifies quotas or taxes on emissions, then refrains from further action. Quota equilibrium exists; the allocation of emission property rights strongly impacts the distribution of welfare. If the only externality arises from total net emissions, quota equilibrium is constrained Pareto Optimal. Every quota equilibrium can be realized as an emission tax equilibrium and vice versa. However, for certain tax rates, emission tax equilibrium may not exist, or may exhibit high multiplicity. Full Pareto Optimality of quota equilibrium can often be achieved by setting the right quota.


title: Nonlinear Hodge flows in symplectic geometry

abstract: Given a symplectic class $[\omega]$ on a four torus $T^4$ (or a $K3$ surface), a folklore problem in symplectic geometry is whether symplectic forms in $[\omega]$ are isotropic to each other. We introduce a family of nonlinear Hodge heat flows on compact symplectic four manifolds to approach this problem, which is an adaption of nonlinear Hodge theory in symplectic geometry. As a particular example, we study a conformal Hodge heat flow in detail. We prove a stability result of the flow near an almost Kahler structure $(M, \omega, g)$. We also prove that, if $|\nabla \log u|$ stays bounded along the flow, then the flow exists for all time for any initial symplectic form $\rho\in [\omega]$ and it converges to $\omega$ smoothly along the flow with uniform control, where $u$ is the volume potential of $\rho$.


title: Extreme sparsification of physics-augmented neural networks for interpretable model discovery in mechanics

abstract: Data-driven constitutive modeling with neural networks has received increased interest in recent years due to its ability to easily incorporate physical and mechanistic constraints and to overcome the challenging and time-consuming task of formulating phenomenological constitutive laws that can accurately capture the observed material response. However, even though neural network-based constitutive laws have been shown to generalize proficiently, the generated representations are not easily interpretable due to their high number of trainable parameters. Sparse regression approaches exist that allow to obtaining interpretable expressions, but the user is tasked with creating a library of model forms which by construction limits their expressiveness to the functional forms provided in the libraries. In this work, we propose to train regularized physics-augmented neural network-based constitutive models utilizing a smoothed version of $L^{0}$-regularization. This aims to maintain the trustworthiness inherited by the physical constraints, but also enables interpretability which has not been possible thus far on any type of machine learning-based constitutive model where model forms were not assumed a-priory but were actually discovered. During the training process, the network simultaneously fits the training data and penalizes the number of active parameters, while also ensuring constitutive constraints such as thermodynamic consistency. We show that the method can reliably obtain interpretable and trustworthy constitutive models for compressible and incompressible hyperelasticity, yield functions, and hardening models for elastoplasticity, for synthetic and experimental data.


title: Interacting nodal semimetals with non-linear bands

abstract: We investigate the quasi-particle and transport properties of a model describing interacting Dirac and Weyl semimetals in the presence of local Hubbard repulsion $U$, where we explicitly include a deviation from the linearity of the energy-momentum dispersion through an intermediate-energy scale $\Lambda$. Our focus lies on the correlated phase of the semimetal. At the nodal point, the renormalization of spectral weight at a fixed temperature $T$ exhibits a weak dependence on $\Lambda$ but is sensitive to the proximity to the Mott transition. Conversely, the scattering rate of quasi-particles and the resistivity display high-temperature exponents that crucially rely on $\Lambda$, leading to a crossover towards a conventional Fermi-liquid behaviour at finite T. Finally, by employing the Nernst-Einstein relation for conductivity, we identify a corresponding density crossover as a function of the chemical potential.


title: Investigating Gaia EDR3 parallax systematics using asteroseismology of Cool Giant Stars observed by Kepler, K2, and TESS II. Deciphering Gaia parallax systematics using red clump stars

abstract: We analyse Gaia EDR3 parallax systematics as a function of magnitude and sky location using a recently published catalogue of 12,500 asteroseismic red-giant star distances. We selected ~ 3500 red clump (RC) stars of similar chemical composition as the optimal subsample for this purpose. We perform a detailed assessment of systematic uncertainties relevant for parallax offset estimation based on the asteroseismic distances. Following this assessment, we adopt for our baseline analysis the asteroseismic parameters measured as in Elsworth et al. (2020), spectroscopy from APOGEE (DR17), and we further restrict the sample to low-extinction RC stars with quality astrometric solutions from Gaia EDR3. We then investigated both the parallax offset relative to the published Gaia EDR3 parallaxes and the residual parallax offset after correcting Gaia EDR3 parallaxes following Lindegren et al. (2021). We find residual parallax offsets very close to zero (-1.6 +/- 0.5 (stat.) +/- 10 (syst.) muas) for stars fainter than G > 11 mag in the initial Kepler field. For 17 K2 campaigns in the same magnitude range, the residual parallax offset is +16.5 +/- 1.7 (stat.) +/- 10 (syst.) muas. At brighter magnitudes (G <= 11 mag), we find inconsistent residual parallax offsets between the Kepler field, 17 K2 campaigns, and the TESS southern continuous viewing zone, with differences of up to 60 muas. This suggests a significant dependence on sky location at bright magnitudes due to the lack of bright physical pairs available for determining the parallax offset corrections. Finally, we estimate the absolute magnitude of the RC and obtain M_Ks^RC = -1.650 +/- 0.025 mag in the 2MASS Ks-band and M_G^RC = (0.432 +/- 0.004) - (0.821 +/- 0.033) (Teff [K] - 4800K)/1000K [mag] in the Gaia G-band.


title: Strategic Evaluation: Subjects, Evaluators, and Society

abstract: A broad current application of algorithms is in formal and quantitative measures of murky concepts -- like merit -- to make decisions. When people strategically respond to these sorts of evaluations in order to gain favorable decision outcomes, their behavior can be subjected to moral judgments. They may be described as 'gaming the system' or 'cheating,' or (in other cases) investing 'honest effort' or 'improving.' Machine learning literature on strategic behavior has tried to describe these dynamics by emphasizing the efforts expended by decision subjects hoping to obtain a more favorable assessment -- some works offer ways to preempt or prevent such manipulations, some differentiate 'gaming' from 'improvement' behavior, while others aim to measure the effort burden or disparate effects of classification systems. We begin from a different starting point: that the design of an evaluation itself can be understood as furthering goals held by the evaluator which may be misaligned with broader societal goals. To develop the idea that evaluation represents a strategic interaction in which both the evaluator and the subject of their evaluation are operating out of self-interest, we put forward a model that represents the process of evaluation using three interacting agents: a decision subject, an evaluator, and society, representing a bundle of values and oversight mechanisms. We highlight our model's applicability to a number of social systems where one or two players strategically undermine the others' interests to advance their own. Treating evaluators as themselves strategic allows us to re-cast the scrutiny directed at decision subjects, towards the incentives that underpin institutional designs of evaluations. The moral standing of strategic behaviors often depend on the moral standing of the evaluations and incentives that provoke such behaviors.


title: On the geometry of rate independent droplet evolution

abstract: We consider a toy model of rate independent droplet motion on a surface with contact angle hysteresis based on the one-phase Bernoulli free boundary problem. Taking advantage of two notions of weak solutions, energy-based and comparison-principle-based, we study the dynamic contact angle of moving contact lines and the geometry of de-pinning. We show that these two notions of solutions coincide in a star-shaped setting, where we show (almost) optimal regularity of the contact line and the convergence of a minimizing movements scheme. In a general setting, the notions differ essentially in how they handle jumps, but both are shown to satisfy a weak motion law.


title: Probabilistic Load Forecasting of Distribution Power Systems based on Empirical Copulas

abstract: Accurate and reliable electricity load forecasts are becoming increasingly important as the share of intermittent resources in the system increases. Distribution System Operators (DSOs) are called to accurately forecast their production and consumption to place optimal bids in the day-ahead market. Violations of their dispatch-plan requires activation of reserve-power which has a direct cost for the DSO, and also necessitate available reserve-capacity. Forecasts must account for the volatility of weather-parameters that impacts both the production and consumption of electricity. If DSO-loads are small or lower-granularity forecasts are needed, traditional statistical methods may fail to provide reliable performance since they rely on a priori statistical distributions of the variables to forecast. In this paper we introduce a probabilistic load forecast (PLF) method based on empirical copulas. Our model is data-driven, does not need a priori assumption on parametric distribution for variables, nor the dependence structure (copula), but employs a kernel density estimate of the underlying distribution using beta kernels that have bounded support on the unit hypercube. The method naturally supports variables with widely different distributions, such as weather data (including forecasted ones) and historic electricity consumption, and produces a conditional probability distribution for every time step in the forecast, which allows inferring the quantiles of interest. The proposed non-parametric approach is highly flexible and can produce meaningful forecasts even at very low aggregated levels (e.g. neighborhoods). We present results from an open dataset and showcase the strength of the model with respect to Quantile Regression using standard probabilistic evaluation metrics.


title: Visual inspection for illicit items in X-ray images using Deep Learning

abstract: Automated detection of contraband items in X-ray images can significantly increase public safety, by enhancing the productivity and alleviating the mental load of security officers in airports, subways, customs/post offices, etc. The large volume and high throughput of passengers, mailed parcels, etc., during rush hours practically make it a Big Data problem. Modern computer vision algorithms relying on Deep Neural Networks (DNNs) have proven capable of undertaking this task even under resource-constrained and embedded execution scenarios, e.g., as is the case with fast, single-stage object detectors. However, no comparative experimental assessment of the various relevant DNN components/methods has been performed under a common evaluation protocol, which means that reliable cross-method comparisons are missing. This paper presents exactly such a comparative assessment, utilizing a public relevant dataset and a well-defined methodology for selecting the specific DNN components/modules that are being evaluated. The results indicate the superiority of Transformer detectors, the obsolete nature of auxiliary neural modules that have been developed in the past few years for security applications and the efficiency of the CSP-DarkNet backbone CNN.


title: Balancing Autonomy and Alignment: A Multi-Dimensional Taxonomy for Autonomous LLM-powered Multi-Agent Architectures

abstract: Large language models (LLMs) have revolutionized the field of artificial intelligence, endowing it with sophisticated language understanding and generation capabilities. However, when faced with more complex and interconnected tasks that demand a profound and iterative thought process, LLMs reveal their inherent limitations. Autonomous LLM-powered multi-agent systems represent a strategic response to these challenges. Such systems strive for autonomously tackling user-prompted goals by decomposing them into manageable tasks and orchestrating their execution and result synthesis through a collective of specialized intelligent agents. Equipped with LLM-powered reasoning capabilities, these agents harness the cognitive synergy of collaborating with their peers, enhanced by leveraging contextual resources such as tools and datasets. While these architectures hold promising potential in amplifying AI capabilities, striking the right balance between different levels of autonomy and alignment remains the crucial challenge for their effective operation. This paper proposes a comprehensive multi-dimensional taxonomy, engineered to analyze how autonomous LLM-powered multi-agent systems balance the dynamic interplay between autonomy and alignment across various aspects inherent to architectural viewpoints such as goal-driven task management, agent composition, multi-agent collaboration, and context interaction. It also includes a domain-ontology model specifying fundamental architectural concepts. Our taxonomy aims to empower researchers, engineers, and AI practitioners to systematically analyze the architectural dynamics and balancing strategies employed by these increasingly prevalent AI systems. The exploratory taxonomic classification of selected representative LLM-powered multi-agent systems illustrates its practical utility and reveals potential for future research and development.


title: Dynamical Love Numbers for Kerr Black Holes

abstract: While static Love number vanish identically for Kerr black holes, we show that the corresponding dynamical tidal coefficients are generically non-zero and exhibit logarithmic behavior. The computational method employs a related but simpler scheme consistent with CFT descriptions, low-frequency regimes and post-Newtonian results. These coefficients are illustrated with a numerical examples.


title: Robustness-Guided Image Synthesis for Data-Free Quantization

abstract: Quantization has emerged as a promising direction for model compression. Recently, data-free quantization has been widely studied as a promising method to avoid privacy concerns, which synthesizes images as an alternative to real training data. Existing methods use classification loss to ensure the reliability of the synthesized images. Unfortunately, even if these images are well-classified by the pre-trained model, they still suffer from low semantics and homogenization issues. Intuitively, these low-semantic images are sensitive to perturbations, and the pre-trained model tends to have inconsistent output when the generator synthesizes an image with poor semantics. To this end, we propose Robustness-Guided Image Synthesis (RIS), a simple but effective method to enrich the semantics of synthetic images and improve image diversity, further boosting the performance of downstream data-free compression tasks. Concretely, we first introduce perturbations on input and model weight, then define the inconsistency metrics at feature and prediction levels before and after perturbations. On the basis of inconsistency on two levels, we design a robustness optimization objective to enhance the semantics of synthetic images. Moreover, we also make our approach diversity-aware by forcing the generator to synthesize images with small correlations in the label space. With RIS, we achieve state-of-the-art performance for various settings on data-free quantization and can be extended to other data-free compression tasks.


title: A C2-tilde-lattice that is not residually finite

abstract: We construct the first example of a lattice on an irreducible Euclidean building that is not residually finite. Conjecturally, the normal subgroup theorem extends to this lattice making it virtually simple.


title: Autoregressive Coefficients based Intelligent Protection of Transmission Lines Connected to Type-3 Wind Farms

abstract: Protective relays can mal-operate for transmission lines connected to doubly fed induction generator (DFIG) based large capacity wind farms (WFs). The performance of distance relays protecting such lines is investigated and a statistical model based intelligent protection of the area between the grid and the WF is proposed in this article. The suggested method employs an adaptive fuzzy inference system to detect faults based on autoregressive (AR) coefficients of the 3-phase currents selected using minimum redundancy maximum relevance algorithm. Deep learning networks are used to supervise the detection of faults, their subsequent localization, and classification. The effectiveness of the scheme is evaluated on IEEE 9-bus and IEEE 39-bus systems with varying fault resistances, fault inception times, locations, fault types, wind speeds, and transformer connections. Further, the impact of factors like the presence of type-4 WFs, double circuit lines, WF capacity, grid strength, FACTs devices, reclosing on permanent faults, power swings, fault during power swings, voltage instability, load encroachment, high impedance faults, evolving and cross-country faults, close-in and remote-end faults, CT saturation, sampling rate, data window size, synchronization error, noise, and semi-supervised learning are considered while validating the proposed scheme. The results show the efficacy of the suggested method in dealing with various system conditions and configurations while protecting the transmission lines that are connected to WFs.


title: Certification of Deep Learning Models for Medical Image Segmentation

abstract: In medical imaging, segmentation models have known a significant improvement in the past decade and are now used daily in clinical practice. However, similar to classification models, segmentation models are affected by adversarial attacks. In a safety-critical field like healthcare, certifying model predictions is of the utmost importance. Randomized smoothing has been introduced lately and provides a framework to certify models and obtain theoretical guarantees. In this paper, we present for the first time a certified segmentation baseline for medical imaging based on randomized smoothing and diffusion models. Our results show that leveraging the power of denoising diffusion probabilistic models helps us overcome the limits of randomized smoothing. We conduct extensive experiments on five public datasets of chest X-rays, skin lesions, and colonoscopies, and empirically show that we are able to maintain high certified Dice scores even for highly perturbed images. Our work represents the first attempt to certify medical image segmentation models, and we aspire for it to set a foundation for future benchmarks in this crucial and largely uncharted area.


title: POLYLLA: Polygonal/Polyhedral meshing algorithm based on terminal-edge regions and terminal-face regions

abstract: Polylla is a polygonal mesh algorithm that generates meshes with arbitrarily shaped polygons using the concept of terminal-edge regions. Until now, Polylla has been limited to 2D meshes, but in this work, we extend Polylla to 3D volumetric meshes. We present two versions of Polylla 3D. The first version generates terminal-edge regions, converts them into polyhedra, and repairs polyhedra that are joined by only an edge. This version differs from the original Polylla algorithm in that it does not have the same phases as the 2D version. In the second version, we define two new concepts: longest-face propagation path and terminal-face regions. We use these concepts to create an almost direct extension of the 2D Polylla mesh with the same three phases: label phase, traversal phase, and repair phase.


title: MapperGPT: Large Language Models for Linking and Mapping Entities

abstract: Aligning terminological resources, including ontologies, controlled vocabularies, taxonomies, and value sets is a critical part of data integration in many domains such as healthcare, chemistry, and biomedical research. Entity mapping is the process of determining correspondences between entities across these resources, such as gene identifiers, disease concepts, or chemical entity identifiers. Many tools have been developed to compute such mappings based on common structural features and lexical information such as labels and synonyms. Lexical approaches in particular often provide very high recall, but low precision, due to lexical ambiguity. As a consequence of this, mapping efforts often resort to a labor intensive manual mapping refinement through a human curator. Large Language Models (LLMs), such as the ones employed by ChatGPT, have generalizable abilities to perform a wide range of tasks, including question-answering and information extraction. Here we present MapperGPT, an approach that uses LLMs to review and refine mapping relationships as a post-processing step, in concert with existing high-recall methods that are based on lexical and structural heuristics. We evaluated MapperGPT on a series of alignment tasks from different domains, including anatomy, developmental biology, and renal diseases. We devised a collection of tasks that are designed to be particularly challenging for lexical methods. We show that when used in combination with high-recall methods, MapperGPT can provide a substantial improvement in accuracy, beating state-of-the-art (SOTA) methods such as LogMap.


title: Enhancing Exfiltration Path Analysis Using Reinforcement Learning

abstract: Building on previous work using reinforcement learning (RL) focused on identification of exfiltration paths, this work expands the methodology to include protocol and payload considerations. The former approach to exfiltration path discovery, where reward and state are associated specifically with the determination of optimal paths, are presented with these additional realistic characteristics to account for nuances in adversarial behavior. The paths generated are enhanced by including communication payload and protocol into the Markov decision process (MDP) in order to more realistically emulate attributes of network based exfiltration events. The proposed method will help emulate complex adversarial considerations such as the size of a payload being exported over time or the protocol on which it occurs, as is the case where threat actors steal data over long periods of time using system native ports or protocols to avoid detection. As such, practitioners will be able to improve identification of expected adversary behavior under various payload and protocol assumptions more comprehensively.


title: GoLLIE: Annotation Guidelines improve Zero-Shot Information-Extraction

abstract: Large Language Models (LLMs) combined with instruction tuning have made significant progress when generalizing to unseen tasks. However, they have been less successful in Information Extraction (IE), lagging behind task-specific models. Typically, IE tasks are characterized by complex annotation guidelines that describe the task and give examples to humans. Previous attempts to leverage such information have failed, even with the largest models, as they are not able to follow the guidelines out of the box. In this paper, we propose GoLLIE (Guideline-following Large Language Model for IE), a model able to improve zero-shot results on unseen IE tasks by virtue of being fine-tuned to comply with annotation guidelines. Comprehensive evaluation empirically demonstrates that GoLLIE is able to generalize to and follow unseen guidelines, outperforming previous attempts at zero-shot information extraction. The ablation study shows that detailed guidelines are key for good results.


title: LumiNet: The Bright Side of Perceptual Knowledge Distillation

abstract: In knowledge distillation literature, feature-based methods have dominated due to their ability to effectively tap into extensive teacher models. In contrast, logit-based approaches, which aim to distill `dark knowledge' from teachers, typically exhibit inferior performance compared to feature-based methods. To bridge this gap, we present LumiNet, a novel knowledge distillation algorithm designed to enhance logit-based distillation. We introduce the concept of 'perception', aiming to calibrate logits based on the model's representation capability. This concept addresses overconfidence issues in logit-based distillation method while also introducing a novel method to distill knowledge from the teacher. It reconstructs the logits of a sample/instances by considering relationships with other samples in the batch. LumiNet excels on benchmarks like CIFAR-100, ImageNet, and MSCOCO, outperforming leading feature-based methods, e.g., compared to KD with ResNet18 and MobileNetV2 on ImageNet, it shows improvements of 1.5% and 2.05%, respectively.


title: Regress Before Construct: Regress Autoencoder for Point Cloud Self-supervised Learning

abstract: Masked Autoencoders (MAE) have demonstrated promising performance in self-supervised learning for both 2D and 3D computer vision. Nevertheless, existing MAE-based methods still have certain drawbacks. Firstly, the functional decoupling between the encoder and decoder is incomplete, which limits the encoder's representation learning ability. Secondly, downstream tasks solely utilize the encoder, failing to fully leverage the knowledge acquired through the encoder-decoder architecture in the pre-text task. In this paper, we propose Point Regress AutoEncoder (Point-RAE), a new scheme for regressive autoencoders for point cloud self-supervised learning. The proposed method decouples functions between the decoder and the encoder by introducing a mask regressor, which predicts the masked patch representation from the visible patch representation encoded by the encoder and the decoder reconstructs the target from the predicted masked patch representation. By doing so, we minimize the impact of decoder updates on the representation space of the encoder. Moreover, we introduce an alignment constraint to ensure that the representations for masked patches, predicted from the encoded representations of visible patches, are aligned with the masked patch presentations computed from the encoder. To make full use of the knowledge learned in the pre-training stage, we design a new finetune mode for the proposed Point-RAE. Extensive experiments demonstrate that our approach is efficient during pre-training and generalizes well on various downstream tasks. Specifically, our pre-trained models achieve a high accuracy of \textbf{90.28\%} on the ScanObjectNN hardest split and \textbf{94.1\%} accuracy on ModelNet40, surpassing all the other self-supervised learning methods. Our code and pretrained model are public available at: \url{https://github.com/liuyyy111/Point-RAE}.


title: The DECam Ecliptic Exploration Project (DEEP) III: Survey characterization and simulation methods

abstract: We present a detailed study of the observational biases of the DECam Ecliptic Exploration Project's (DEEP) B1 data release and survey simulation software that enables direct statistical comparisons between models and our data. We inject a synthetic population of objects into the images, and then subsequently recover them in the same processing as our real detections. This enables us to characterize the survey's completeness as a function of apparent magnitudes and on-sky rates of motion. We study the statistically optimal functional form for the magnitude, and develop a methodology that can estimate the magnitude and rate efficiencies for all survey's pointing groups simultaneously. We have determined that our peak completeness is on average 80\% in each pointing group, and our magnitude drops to $25\%$ of this value at $m_{25} = 26.22$. We describe the freely available survey simulation software and its methodology. We conclude by using it to infer that our effective search area for objects at 40 au is $14.8\deg^2$, and that our lack of dynamically cold distant objects means that there at most $8\times 10^3$ objects with $60 < a < 80$ au and absolute magnitudes $H \leq 8$.


title: Paradoxes in the co-evolution of contagions and institutions

abstract: Epidemic models study the spread of an undesired agent through a population, be it infectious diseases through a country, misinformation in online social media, or pests infesting a region. In combating these epidemics, we rely neither on global top-down interventions, nor solely on individual adaptations. Instead, interventions most commonly come from local institutions such as public health departments, moderation teams on social media platforms, or other forms of group governance. Classic models, which are often individual or agent-based, are ill-suited to capture local adaptations. We leverage recent development of institutional dynamics based on cultural group selection to study how groups can attempt local control of an epidemic by taking inspiration from the successes and failures of other groups. Incorporating these institutional changes into the epidemic dynamics reveals paradoxes: a higher transmission rate can result in smaller outbreaks and decreasing the speed of institutional adaptation generally reduces outbreak size. When groups perceive a contagion as more worrisome, they can invest in improved policies and, if they maintain these policies long enough to have impact, lead to a reduction in endemicity. By looking at the interplay between the speed of institutions and the transmission rate of the contagions, we find rich co-evolutionary dynamics that reflect the complexity of known biological and social contagions.


title: Do Internal Software Metrics Have Relationship with Fault-proneness and Change-proneness?

abstract: Fault-proneness is a measure that indicates the possibility of programming errors occurring within a software system. On the other hand, change-proneness refers to the potential for modifications to be made to the software. Both of these measures are crucial indicators of software maintainability, as they influence internal software metrics such as size, inheritance, and coupling, particularly when numerous changes are made to the system. In the literature, research has predicted change- and fault-proneness using internal software metrics that is almost a decade old. However, given the continuous evolution of software systems, it is essential to revisit and update our understanding of these relationships. Therefore, we have conducted an empirical study to revisit the relationship between internal software metrics and change-proneness, and faultproneness, aiming to provide current and relevant insights. In our study, we identified 25 internal software metrics along with the measures of change-proneness and fault-proneness within the wellknown open-source systems from the Apache and Eclipse ecosystems. We then analyzed the relationships between these metrics using statistical correlation methods. Our results revealed that most of the metrics have little to no correlation with fault-proneness. However, metrics related to inheritance, coupling, and comments showed a moderate to high correlation with change-proneness. These findings will assist developers to minimize the higher correlated software metrics to enhance maintainability in terms of change- and fault-proneness. Additionally, these insights can guide researchers in developing new approaches for predicting changes and faults by incorporating the metrics that have been shown to have stronger correlations.


abstract: We propose and experimentally demonstrate a differential microscopy method to obtain simultaneous amplitude, phase, and quantitative polarization gradient imaging in a single experimental embodiment. A full-field optical spatial differentiator is achieved in a relatively simple setup by placing a glass cover slip as a Signum phase mask in the Fourier plane of a standard 4-f imaging system and accordingly named Signum phase mask differential microscopy. The longstanding requisite of polarized light to obtain the spatial differentiation of the field at the object plane is eliminated in our scheme and, hence, leads to the emergence of quantitative differential polarization contrast imaging by integrating polarization degree of freedom as an additional contrast agent in the framework of differential microscopy. Implementation of the proposed differential imaging scheme in high-resolution microscopy is experimentally demonstrated alongside its functionality for a broad wavelength range. Simultaneous acquisition of differential phase, amplitude, and polarization (anisotropy) gradient imaging in a rather elementary optical setup enables a low-cost multi-functional differential microscopy system that is anticipated to emerge as a revolutionary tool in label-free imaging and optical image processing.


title: Hadamard Domain Training with Integers for Class Incremental Quantized Learning

abstract: Continual learning is a desirable feature in many modern machine learning applications, which allows in-field adaptation and updating, ranging from accommodating distribution shift, to fine-tuning, and to learning new tasks. For applications with privacy and low latency requirements, the compute and memory demands imposed by continual learning can be cost-prohibitive for resource-constraint edge platforms. Reducing computational precision through fully quantized training (FQT) simultaneously reduces memory footprint and increases compute efficiency for both training and inference. However, aggressive quantization especially integer FQT typically degrades model accuracy to unacceptable levels. In this paper, we propose a technique that leverages inexpensive Hadamard transforms to enable low-precision training with only integer matrix multiplications. We further determine which tensors need stochastic rounding and propose tiled matrix multiplication to enable low-bit width accumulators. We demonstrate the effectiveness of our technique on several human activity recognition datasets and CIFAR100 in a class incremental learning setting. We achieve less than 0.5% and 3% accuracy degradation while we quantize all matrix multiplications inputs down to 4-bits with 8-bit accumulators.


title: PV-OSIMr: A Lowest Order Complexity Algorithm for Computing the Delassus Matrix

abstract: We present PV-OSIMr, an efficient algorithm for computing the Delassus matrix (also known as the inverse operational space inertia matrix) for a kinematic tree, with the lowest order computational complexity known in literature. PV-OSIMr is derived by optimizing the Popov-Vereshchagin (PV) solver computations using the compositionality of the force and motion propagators. It has a computational complexity of O(n + m^2 ) compared to O(n + m^2d) of the original PV-OSIM algorithm and O(n+md+m^2 ) of the extended force propagator algorithm (EFPA), where n is the number of joints, m is the number of constraints and d is the depth of the kinematic tree. Since Delassus matrix computation requires constructing an m x m sized matrix and must consider all the n joints at least once, the asymptotic computational complexity of PV-OSIMr is optimal. We further benchmark our algorithm and find it to be often more efficient than the PV-OSIM and EFPA in practice.


title: Embeddings of matrix algebras into uniform Roe algebras and quasi-local algebras

abstract: We answer the recent problem posed by Baudier, Braga, Farah, Vignati, and Willett that asks whether the $\ell_\infty$-direct sum of the matrix algebras embeds into the uniform Roe algebra or the quasi-local algebra of a uniformly locally finite metric space. The answers are no and yes, respectively. Hence the inclusion of the uniform Roe algebra into the quasi-local algebra can be proper.


title: The DECam Ecliptic Exploration Project (DEEP) VI: first multi-year observations of trans-Neptunian objects

abstract: We present the first set of trans-Neptunian objects (TNOs) observed on multiple nights in data taken from the DECam Ecliptic Exploration Project (DEEP). Of these 110 TNOs, 105 do not coincide with previously known TNOs and appear to be new discoveries. Each individual detection for our objects resulted from a digital tracking search at TNO rates of motion, using two to four hour exposure sets, and the detections were subsequently linked across multiple observing seasons. This procedure allows us to find objects with magnitudes $m_{VR} \approx 26$. The object discovery processing also included a comprehensive population of objects injected into the images, with a recovery and linking rate of at least $94\%$. The final orbits were obtained using a specialized orbit fitting procedure that accounts for the positional errors derived from the digital tracking procedure. Our results include robust orbits and magnitudes for classical TNOs with absolute magnitudes $H \sim 10$, as well as a dynamically detached object found at 76 au (semi-major axis $a\approx 77 \, \mathrm{au}$). We find a disagreement between our population of classical TNOs and the CFEPS-L7 three component model for the Kuiper belt.


title: Role of Spatial Coherence in Diffractive Optical Neural Networks

abstract: Diffractive optical neural networks (DONNs) have emerged as a promising optical hardware platform for ultra-fast and energy-efficient signal processing for machine learning tasks, particularly in computer vision. Previous experimental demonstrations of DONNs have only been performed using coherent light. However, many real-world DONN applications require consideration of the spatial coherence properties of the optical signals. Here, we study the role of spatial coherence in DONN operation and performance. We propose a numerical approach to efficiently simulate DONNs under incoherent and partially coherent input illumination and discuss the corresponding computational complexity. As a demonstration, we train and evaluate simulated DONNs on the MNIST dataset of handwritten digits to process light with varying spatial coherence.


title: Updates on the determination of $\vert V_{cb} \vert$, $R(D^{*})$ and $\vert V_{ub} \vert/\vert V_{cb} \vert$

abstract: We present an updated determination of the values of $\vert V_{cb} \vert$, $R(D^*)$ and $\vert V_{ub} \vert/\vert V_{cb} \vert$ based on the new data on semileptonic $B \to D^* \ell \nu_\ell$ decays by the Belle and Belle-II Collaborations and on the recent theoretical progress in the calculation of the form factors relevant for semileptonic $B \to D^* \ell \nu_\ell$ and $B_s \to K \ell \nu_\ell$ decays. In particular we present results derived by applying either the Dispersive Matrix (DM) method of Refs. [1-6] or the more standard Boyd-Grinstein-Lebed (BGL) [7] approach to the most recent values of the form factors determined in lattice QCD. Using all the available lattice results for the form factors from the DM method we get the theoretical value $R^{\rm th}(D^*) = 0.262 \pm 0.009$ and we extract from a bin-per-bin analysis of the experimental data the value $\vert V_{cb} \vert = (39.92 \pm 0.64) \cdot10^{-3}$. Our result for $R(D^*)$ is consistent with the latest experimental world average $R^{\rm exp}(D^*) = 0.284 \pm 0.012$ [8]} at the $\simeq 1.5\,\sigma$ level. Our value for $\vert V_{cb} \vert$ is compatible with the latest inclusive determinations $\vert V_{cb} \vert^{\rm incl} = (41.97 \pm 0.48) \cdot 10^{-3}$ [9] and $\vert V_{cb} \vert^{\rm incl} = (41.69\pm 0.63) \cdot 10^{-3}$ [10] within $\simeq 2.6$ and $\simeq 2.0$ standard deviations, respectively. From a reappraisal of the calculations of $\vert V_{ub} \vert / \vert V_{cb} \vert$, we also obtain $\vert V_{ub} \vert / \vert V_{cb} \vert = 0.087\pm 0.009$ in good agreement with the result $\vert V_{ub} \vert / \vert V_{cb} \vert = 0.0844\pm 0.0056$ from the latest FLAG review [11].


title: Quantifying High-Order Interdependencies in Entangled Quantum States

abstract: Here, we leverage recent advances in information theory to develop a novel method to characterise the dominant character of the high-order dependencies of quantum systems. To this end, we introduce the Q-information: an information-theoretic measure capable of distinguishing quantum states dominated by synergy or redundancy. We illustrate the measure by investigating the properties of paradigmatic entangled Qubit states and find that -- in contrast to classical systems -- quantum systems need at least four variables to exhibit high-order properties. Furthermore, our results reveal that unitary evolution can radically affect the internal information organisation in a way that strongly depends on the corresponding Hamiltonian. Overall, the Q-information sheds light on novel aspects of the internal organisation of quantum systems and their time evolution, opening new avenues for studying several quantum phenomena and related technologies.


title: Prediction of depinning transitions in interface models using Gini and Kolkata indices

abstract: The dynamics of driven interfaces through disordered media is a common framework for a myriad of diverse systems starting from mode-I fracture, vortex lines in superconductors, magnetic domain walls to invading fluid in a porous medium to name a few. The dynamics, for a slow enough drive, progress through punctuated equilibria, showing an intermittent, scale free response statistics that are characterized by only a few parameters. For a strong enough driving, on the other hand, the interface is depinnind i.e., can move continuously through the embedded medium. This depinning transition, often characterized as a critical phenomenon, is a crucial point for the system in question, since it often represent a drastic change in the system (catastrophic failure in the case of fracture, magnetisation switching in the case of domain walls, breakthrough point in the case of fluid invasion etc.). In this work, we outline a framework that can give a precursory signal of the imminent depinning transition by monitoring the variations in sizes or the inequality of the intermittent responses of a system seen prior to the depinning point. In particular, we use measures traditionally used to quantify economic inequality, the Gini index and the Kolkata index, for the case of the unequal responses of pre-critical systems. The crossing point of these two indices serves as a precursor to imminent depinning. Given a scale free size distributions of the responses, we calculate the expressions for these indices, evaluate their crossing points and give a recipe for forecasting depinning transitions. We compare these with simulation results from the Edwards-Wilkindon, KPZ and fiber bundle model interface with variable interaction strength. The results are applicable for any interface dynamics undergoing depinning transition.


title: A strong min-max property for level sets of Phase Transitions

abstract: We show that certain functions whose nodal sets lie near a fixed nondegenerate minimal hypersurface satisfy a strong min-max principle for the Allen--Cahn energy which is analogous to the strong min-max principle for non-degenerate minimal hypersurfaces first proved by Brian White.


title: SmoothLLM: Defending Large Language Models Against Jailbreaking Attacks

abstract: Despite efforts to align large language models (LLMs) with human intentions, widely-used LLMs such as GPT, Llama, and Claude are susceptible to jailbreaking attacks, wherein an adversary fools a targeted LLM into generating objectionable content. To address this vulnerability, we propose SmoothLLM, the first algorithm designed to mitigate jailbreaking attacks. Based on our finding that adversarially-generated prompts are brittle to character-level changes, our defense randomly perturbs multiple copies of a given input prompt, and then aggregates the corresponding predictions to detect adversarial inputs. Across a range of popular LLMs, SmoothLLM sets the state-of-the-art for robustness against the GCG, PAIR, RandomSearch, and AmpleGCG jailbreaks. SmoothLLM is also resistant against adaptive GCG attacks, exhibits a small, though non-negligible trade-off between robustness and nominal performance, and is compatible with any LLM. Our code is publicly available at \url{https://github.com/arobey1/smooth-llm}.


title: Third order correction to semileptonic $b\to u$ decay: fermionic contributions

abstract: We present the QCD corrections of order $\alpha_s^3$ to the decay rate of $b \to u \ell \bar \nu_\ell$, with $\ell = e,\mu$, originating from diagrams with closed fermion loops and neglecting the mass of the up quark. Our calculation relies on integration-by-parts reduction of Feynman integrals with one propagator raised to a symbolic power in Kira and the numerical evaluation of master integrals with AMFlow. This allows us to obtain results for the fermionic contributions to the total semileptonic rate with an accuracy of more than thirty digits.


title: DecoderLens: Layerwise Interpretation of Encoder-Decoder Transformers

abstract: In recent years, many interpretability methods have been proposed to help interpret the internal states of Transformer-models, at different levels of precision and complexity. Here, to analyze encoder-decoder Transformers, we propose a simple, new method: DecoderLens. Inspired by the LogitLens (for decoder-only Transformers), this method involves allowing the decoder to cross-attend representations of intermediate encoder layers instead of using the final encoder output, as is normally done in encoder-decoder models. The method thus maps previously uninterpretable vector representations to human-interpretable sequences of words or symbols. We report results from the DecoderLens applied to models trained on question answering, logical reasoning, speech recognition and machine translation. The DecoderLens reveals several specific subtasks that are solved at low or intermediate layers, shedding new light on the information flow inside the encoder component of this important class of models.


title: Probabilistic Generative Modeling for Procedural Roundabout Generation for Developing Countries

abstract: Due to limited resources and fast economic growth, designing optimal transportation road networks with traffic simulation and validation in a cost-effective manner is vital for developing countries, where extensive manual testing is expensive and often infeasible. Current rule-based road design generators lack diversity, a key feature for design robustness. Generative Flow Networks (GFlowNets) learn stochastic policies to sample from an unnormalized reward distribution, thus generating high-quality solutions while preserving their diversity. In this work, we formulate the problem of linking incident roads to the circular junction of a roundabout by a Markov decision process, and we leverage GFlowNets as the Junction-Art road generator. We compare our method with related methods and our empirical results show that our method achieves better diversity while preserving a high validity score.


title: Speaker localization using direct path dominance test based on sound field directivity

abstract: Estimation of the direction-of-arrival (DoA) of a speaker in a room is important in many audio signal processing applications. Environments with reverberation that masks the DoA information are particularly challenging. Recently, a DoA estimation method that is robust to reverberation has been developed. This method identifies time-frequency bins dominated by the contribution from the direct path, which carries the correct DoA information. However, its implementation is computationally demanding as it requires frequency smoothing to overcome the effect of coherent early reflections and matrix decomposition to apply the direct-path dominance (DPD) test. In this work, a novel computationally-efficient alternative to the DPD test is proposed, based on the directivity measure for sensor arrays, which requires neither frequency smoothing nor matrix decomposition, and which has been reformulated for sound field directivity with spherical microphone arrays. The paper presents the proposed method and a comparison to previous methods under a range of reverberation and noise conditions. Result demonstrate that the proposed method shows comparable performance to the original method in terms of robustness to reverberation and noise, and is about four times more computationally efficient for the given experiment.


title: Initiatives Based on the Psychology of Scarcity Can Increase Covid-19 Vaccinations

abstract: Background: Here we investigate whether releasing COVID-19 vaccines in limited quantities and at limited times boosted Italy's vaccination campaign in 2021. This strategy exploits insights from psychology and consumer marketing. Methods: We built an original dataset covering 200 days of vaccination data in Italy, including 'open day' events. Open-day events (in short: open days) are instances where COVID-19 vaccines were released in limited quantities and only for a specific day at a specified location (usually, a large pavilion or a public building). Our dependent variables are the number of total and first doses administered in proportion to the eligible population. Our key independent variable is the presence of open-day events in a given region on a specific day. We analyzed the data using regression with fixed effects for time and region. The analysis was robust to alternative model specifications. Findings: We find that when an open day event was organized, in proportion to the eligible population, there was an average 0.39-0.44 percentage point increase in total doses administered and a 0.30-0.33 percentage point increase in first doses administered. These figures correspond to an average increase of 10,455-11,796 in total doses administered and 8,043-8,847 in the first doses administered. Interpretation: Releasing vaccines in limited quantities and at limited times by organizing open-day events was associated with an increase in COVID-19 vaccinations in most Italian regions. These results call for wider adoption of vaccination strategies based on the limited release of vaccines for other infectious diseases or future pandemics.


title: Goldstein Stationarity in Lipschitz Constrained Optimization

abstract: We prove the first convergence guarantees for a subgradient method minimizing a generic Lipschitz function over generic Lipschitz inequality constraints. No smoothness or convexity (or weak convexity) assumptions are made. Instead, we utilize a sequence of recent advances in Lipschitz unconstrained minimization, which showed convergence rates of $O(1/\delta\epsilon^3)$ towards reaching a "Goldstein" stationary point, that is, a point where an average of gradients sampled at most distance $\delta$ away has size at most $\epsilon$. We generalize these prior techniques to handle functional constraints, proposing a subgradient-type method with similar $O(1/\delta\epsilon^3)$ guarantees on reaching a Goldstein Fritz-John or Goldstein KKT stationary point, depending on whether a certain Goldstein-style generalization of constraint qualification holds.


title: DirectGPT: A Direct Manipulation Interface to Interact with Large Language Models

abstract: We characterize and demonstrate how the principles of direct manipulation can improve interaction with large language models. This includes: continuous representation of generated objects of interest; reuse of prompt syntax in a toolbar of commands; manipulable outputs to compose or control the effect of prompts; and undo mechanisms. This idea is exemplified in DirectGPT, a user interface layer on top of ChatGPT that works by transforming direct manipulation actions to engineered prompts. A study shows participants were 50% faster and relied on 50% fewer and 72% shorter prompts to edit text, code, and vector images compared to baseline ChatGPT. Our work contributes a validated approach to integrate LLMs into traditional software using direct manipulation. Data, code, and demo available at https://osf.io/3wt6s.


title: Substitutes markets with budget constraints: solving for competitive and optimal prices

abstract: Markets with multiple divisible goods have been studied widely from the perspective of revenue and welfare. In general, it is well known that envy-free revenue-maximal outcomes can result in lower welfare than competitive equilibrium outcomes. We study a market in which buyers have quasilinear utilities with linear substitutes valuations and budget constraints, and the seller must find prices and an envy-free allocation that maximise revenue or welfare. Our setup mirrors markets such as ad auctions and auctions for the exchange of financial assets. We prove that the unique competitive equilibrium prices are also envy-free revenue-maximal. This coincidence of maximal revenue and welfare is surprising and breaks down even when buyers have piecewise-linear valuations. We present a novel characterisation of the set of "feasible" prices at which demand does not exceed supply, show that this set has an elementwise minimal price vector, and demonstrate that these prices maximise revenue and welfare. The proof also implies an algorithm for finding this unique price vector.


title: Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!

abstract: Optimizing large language models (LLMs) for downstream use cases often involves the customization of pre-trained LLMs through further fine-tuning. Meta's open release of Llama models and OpenAI's APIs for fine-tuning GPT-3.5 Turbo on custom datasets also encourage this practice. But, what are the safety costs associated with such custom fine-tuning? We note that while existing safety alignment infrastructures can restrict harmful behaviors of LLMs at inference time, they do not cover safety risks when fine-tuning privileges are extended to end-users. Our red teaming studies find that the safety alignment of LLMs can be compromised by fine-tuning with only a few adversarially designed training examples. For instance, we jailbreak GPT-3.5 Turbo's safety guardrails by fine-tuning it on only 10 such examples at a cost of less than $0.20 via OpenAI's APIs, making the model responsive to nearly any harmful instructions. Disconcertingly, our research also reveals that, even without malicious intent, simply fine-tuning with benign and commonly used datasets can also inadvertently degrade the safety alignment of LLMs, though to a lesser extent. These findings suggest that fine-tuning aligned LLMs introduces new safety risks that current safety infrastructures fall short of addressing -- even if a model's initial safety alignment is impeccable, it is not necessarily to be maintained after custom fine-tuning. We outline and critically analyze potential mitigations and advocate for further research efforts toward reinforcing safety protocols for the custom fine-tuning of aligned LLMs.


title: What would it cost to connect the unconnected? Estimating global universal broadband infrastructure investment

abstract: Roughly 3 billion citizens remain offline, equating to approximately 40 percent of the global population. Therefore, providing Internet connectivity is an essential part of the Sustainable Development Goals (SDGs) (Goal 9). In this paper a high-resolution global model is developed to evaluate the necessary investment requirements to achieve affordable universal broadband. The results indicate that approximately $418 billion needs to be mobilized to connect all unconnected citizens globally (targeting 40-50 GB/Month per user with 95 percent reliability). The bulk of additional investment is for emerging market economies (73 percent) and low-income developing countries (24 percent). To our knowledge, the paper contributes the first high-resolution global assessment which quantifies universal broadband investment at the sub-national level to achieve SDG Goal 9.


title: Multimarginal generative modeling with stochastic interpolants

abstract: Given a set of $K$ probability densities, we consider the multimarginal generative modeling problem of learning a joint distribution that recovers these densities as marginals. The structure of this joint distribution should identify multi-way correspondences among the prescribed marginals. We formalize an approach to this task within a generalization of the stochastic interpolant framework, leading to efficient learning algorithms built upon dynamical transport of measure. Our generative models are defined by velocity and score fields that can be characterized as the minimizers of simple quadratic objectives, and they are defined on a simplex that generalizes the time variable in the usual dynamical transport framework. The resulting transport on the simplex is influenced by all marginals, and we show that multi-way correspondences can be extracted. The identification of such correspondences has applications to style transfer, algorithmic fairness, and data decorruption. In addition, the multimarginal perspective enables an efficient algorithm for reducing the dynamical transport cost in the ordinary two-marginal setting. We demonstrate these capacities with several numerical examples.


title: Function-Space Optimality of Neural Architectures With Multivariate Nonlinearities

abstract: We investigate the function-space optimality (specifically, the Banach-space optimality) of a large class of shallow neural architectures with multivariate nonlinearities/activation functions. To that end, we construct a new family of Banach spaces defined via a regularization operator, the $k$-plane transform, and a sparsity-promoting norm. We prove a representer theorem that states that the solution sets to learning problems posed over these Banach spaces are completely characterized by neural architectures with multivariate nonlinearities. These optimal architectures have skip connections and are tightly connected to orthogonal weight normalization and multi-index models, both of which have received recent interest in the neural network community. Our framework is compatible with a number of classical nonlinearities including the rectified linear unit (ReLU) activation function, the norm activation function, and the radial basis functions found in the theory of thin-plate/polyharmonic splines. We also show that the underlying spaces are special instances of reproducing kernel Banach spaces and variation spaces. Our results shed light on the regularity of functions learned by neural networks trained on data, particularly with multivariate nonlinearities, and provide new theoretical motivation for several architectural choices found in practice.


title: Non-minimally coupled quintessence in the Gauss-Bonnet model, symmetry breaking, and cosmic acceleration

abstract: We consider a model consisting of a quintessence coupled to the Ricci scalar and the Gauss-Bonnet invariant. We propose a mechanism for the rising of dark energy in the matter era, alleviating the coincidence problem. The role of the Gauss-Bonnet invariant is to restore the initial $Z_2$ symmetry. The Ricci scalar breaks this symmetry during the Universe's expansion and activates the quintessence. In our model, the observational constraint on gravitational wave speed is respected.


title: Hadronic processes at work in 5BZB J0630-2406

abstract: Recent observations are shedding light on the important role that active galactic nuclei (AGN) play in the production of high-energy neutrinos. In this study, we focus on one object, 5BZB J0630-2406, which is among the blazars recently proposed as associated with neutrino emission during the first 7-yr IceCube observations. Modelling the quasi-simultaneous, broad-band spectral energy distribution, we explore various scenarios from purely leptonic to lepto-hadronic models, testing the inclusion of external photon fields. This theoretical study provides a complementary testing ground for the proposed neutrino-blazar association. Despite being historically classified as a BL Lac, our study shows that 5BZB J0630-2406 belongs to the relatively rare sub-class of high-power flat-spectrum radio quasars (FSRQs). Our results indicate that interactions between protons and external radiation fields can produce a neutrino flux that is within the reach of the IceCube detector. Furthermore, the spectral shape of the X-ray emission suggests the imprint of hadronic processes related to very energetic protons.


title: Taylor coefficients and series involving harmonic numbers

abstract: During 2022--2023 Z.-W. Sun posed many conjectures on infinite series with summands involving generalized harmonic numbers. Motivated by this, we deduce $31$ series identities involving harmonic numbers, three of which were previously conjectured by the second author. For example, we obtain that \[ \sum_{k=1}^{\infty} \frac{(-1)^k}{k^2{2k \choose k}{3k \choose k}} \big( \frac{7 k-2}{2 k-1} H_{k-1}^{(2)}-\frac{3}{4 k^2} \big)=\frac{\pi^4}{720}. \] and \[ \sum_{k=1}^\infty \frac{1}{k^2 {2k \choose k}^2} \left( \frac{30k-11}{k(2k-1)} (H_{2k-1}^{(3)} + 2 H_{k-1}^{(3)}) + \frac{27}{8k^4} \right) = 4 \zeta(3)^2, \] where $H_n^{(m)}$ denotes $\sum_{0<j \le n}j^{-m}$.


title: BrickStARt: Enabling In-situ Design and Tangible Exploration for Personal Fabrication using Mixed Reality

abstract: 3D printers enable end-users to design and fabricate unique physical artifacts but maintain an increased entry barrier and friction. End users must design tangible artifacts through intangible media away from the main problem space (ex-situ) and transfer spatial requirements to an abstract software environment. To allow users to evaluate dimensions, balance, or fit early and in-situ, we developed BrickStARt, a design tool using tangible construction blocks paired with a mixed-reality headset. Users assemble a physical block model at the envisioned location of the fabricated artifact. Designs can be tested tangibly, refined, and digitally post-processed, remaining continuously in-situ. We implemented BrickStARt using a Magic Leap headset and present walkthroughs, highlighting novel interactions for 3D design. In a user study (n=16), first-time 3D modelers succeeded more often using BrickStARt than Tinkercad. Our results suggest that BrickStARt provides an accessible and explorative process while facilitating quick, tangible design iterations that allow users to detect physics-related issues (e.g., clearance) early on.


title: Observations of a PT-like phase transition and limit cycle oscillations in non-reciprocally coupled optomechanical oscillators levitated in vacuum

abstract: We explore the collective non-Hermitian dynamics of a pair of non-conservatively coupled optomechanical oscillators. The oscillators consist of silica nanoparticles optically levitated in vacuum in two parallel pairs of interfering counter-propagating laser beams. By adjusting the relative phase, polarization, and separation of the trapping laser beams, we set the optical interaction between the particles to be purely non-reciprocal. Continuously varying the relative power of the trapping beams over a predefined range takes the system through transition, analogous to a parity-time (PT) phase transition. Decreasing the dissipation rate within the non-equilibrium phase induces a Hopf bifurcation resulting in the formation of collective limit cycle oscillations similar to those observed in phonon lasers. Such systems provide a novel platform for exceptional point optomechanical sensing and due to their wide flexibility and tunability of the interactions can be extended to multi-particle systems, paving the way for the development of topological optomechanical media.


title: Robust Analysis of Auction Equilibria

abstract: Equilibria in auctions can be very difficult to analyze, beyond the symmetric environments where revenue equivalence renders the analysis straightforward. This paper takes a robust approach to evaluating the equilibria of auctions. Rather than identify the equilibria of an auction under specific environmental conditions, it considers worst-case analysis, where an auction is evaluated according to the worst environment and worst equilibrium in that environment. It identifies a non-equilibrium property of auctions that governs whether or not their worst-case equilibria are good for welfare and revenue. This property is easy to analyze, can be refined from data, and composes across markets where multiple auctions are run simultaneously.


title: Varying Entropy Degrees of Freedom Effects in Low-Scale Leptogenesis

abstract: We analyse in detail the effect of varying entropy degrees of freedom on low-scale leptogenesis models. As an archetypal model, we consider the Tri-Resonant Leptogensis${}$ (TRL) scenario introduced recently by the authors, where the neutrino-Yukawa coupling matrix is dictated by an approximate $\mathbb{Z}_n$ discrete symmetry (with $n=3,6$). TRL models exhibit no preferred direction in the leptonic flavour space and have the remarkable feature that leptogenesis can successfully take place even if all light neutrinos are strictly massless up to one-loop order. Most interestingly, for TRL scenarios with heavy Majorana neutrinos lighter than 100 GeV, temperature varying degrees of freedom associated with the entropy of the plasma have a dramatic impact on the predictions of the Baryon Asymmetry in the Universe (BAU), and may sensitively depend on the freeze-out sphaleron temperature $T_{\rm sph}$. We find that this is a generic feature of most freeze-out low-scale leptogenesis models discussed in the literature. In the same context, we consider heavy-neutrino scenarios realising dynamics related to critical unstable qudits in the thermal plasma and assess their significance in generating the BAU. The phenomenological implications of TRL scenarios at the intensity and high-energy frontiers are analysed.


title: Pose-Free Generalizable Rendering Transformer

abstract: In the field of novel-view synthesis, the necessity of knowing camera poses (e.g., via Structure from Motion) before rendering has been a common practice. However, the consistent acquisition of accurate camera poses remains elusive, and errors in pose extraction can adversely impact the view synthesis process. To address this challenge, we introduce PF-GRT, a new Pose-Free framework for Generalizable Rendering Transformer, eliminating the need for pre-computed camera poses and instead leveraging feature-matching learned directly from data. PF-GRT is parameterized using a local relative coordinate system, where one of the source images is set as the origin. An OmniView Transformer is designed for fusing multi-view cues under the pose-free setting, where unposed-view fusion and origin-centric aggregation are performed. The 3D point feature along target ray is sampled by projecting onto the selected origin plane. The final pixel intensities are modulated and decoded using another Transformer. PF-GRT demonstrates an impressive ability to generalize to new scenes that were not encountered during the training phase, without the need of pre-computing camera poses. Our experiments with zero-shot rendering on the LLFF, RealEstate-10k, Shiny, and Blender datasets reveal that it produces superior quality in generating photo-realistic images. Moreover, it demonstrates robustness against noise in test camera poses. Code is available at https://zhiwenfan.github.io/PF-GRT/.


title: Adaptive variational ground state preparation for spin-1 models on qubit-based architectures

abstract: We apply the adaptive variational quantum imaginary time evolution (AVQITE) method to prepare ground states of one-dimensional spin $S=1$ models. We compare different spin-to-qubit encodings (standard binary, Gray, unary, and multiplet) with regard to the performance and quantum resource cost of the algorithm. Using statevector simulations we study two well-known spin-1 models: the Blume-Capel model of transverse-field Ising spins with single-ion anisotropy, and the XXZ model with single-ion anisotropy. We consider system sizes of up to $20$ qubits, which corresponds to spin-$1$ chains up to length $10$. We determine the dependence of the number of CNOT gates in the AVQITE state preparation circuit on the encoding, the initial state, and the choice of operator pool in the adaptive method. Independent on the choice of encoding, we find that the CNOT gate count scales cubically with the number of spins for the Blume-Capel model and quartically for the anistropic XXZ model. However, the multiplet and Gray encodings present smaller prefactors in the scaling relations. These results provide useful insights for the implementation of AVQITE on quantum hardware.


title: Spinning a levitated mechanical oscillator far into the deep-strong coupling regime

abstract: The field of levitodynamics has made substantial advancements in manipulating the translational and rotational degrees of freedom of levitated nanoparticles. Notably, rotational degrees of freedom can now be cooled to millikelvin temperatures and driven into GHz rotational speeds. However, in the case of cylindrically symmetric nanorotors, only the rotations around their short axes have been effectively manipulated, while the possibility to control rotation around the longer axis has remained a notable gap in the field. Here, we extend the rotational control toolbox by engineering an optically levitated nanodumbbell in vacuum into controlled spinning around its long axis with spinning rates exceeding 1 GHz. This fast spinning introduces deep-strong coupling between the nanodumbell's libration modes, such that the coupling rate $g$ exceeds the bare libration frequencies $\Omega_0$ by two orders of magnitude with $g/\Omega_0=724\pm 33$. Our control over the long-axis rotation opens the door to study the physics of deep-strong coupled mechanical oscillators and to observe macroscopic rotational quantum interference effects, thus laying a solid foundation for future applications in quantum technologies. Additionally, we find that our system offers great potential as a nanoscopic gyroscope with competitive sensitivity.


title: OMG-ATTACK: Self-Supervised On-Manifold Generation of Transferable Evasion Attacks

abstract: Evasion Attacks (EA) are used to test the robustness of trained neural networks by distorting input data to misguide the model into incorrect classifications. Creating these attacks is a challenging task, especially with the ever-increasing complexity of models and datasets. In this work, we introduce a self-supervised, computationally economical method for generating adversarial examples, designed for the unseen black-box setting. Adapting techniques from representation learning, our method generates on-manifold EAs that are encouraged to resemble the data distribution. These attacks are comparable in effectiveness compared to the state-of-the-art when attacking the model trained on, but are significantly more effective when attacking unseen models, as the attacks are more related to the data rather than the model itself. Our experiments consistently demonstrate the method is effective across various models, unseen data categories, and even defended models, suggesting a significant role for on-manifold EAs when targeting unseen models.


title: Beyond One-Preference-Fits-All Alignment: Multi-Objective Direct Preference Optimization

abstract: A single language model (LM), despite aligning well with an average labeler through reinforcement learning from human feedback (RLHF), may not universally suit diverse human preferences. Recent approaches therefore opt for customization by collecting multi-dimensional feedback and creating distinct reward models (RMs) for each dimension (e.g., helpfulness, harmlessness, or honesty). Different LMs can then be optimized for different preferences using multi-objective RLHF (MORLHF) with different reward weightings. Yet, RL fine-tuning is unstable and resource-heavy, especially for MORLHF with diverse and usually conflicting objectives. In this paper, we present Multi-Objective Direct Preference Optimization (MODPO), an RL-free algorithm that extends Direct Preference Optimization (DPO) for multiple alignment objectives with minimal overheads. Essentially, MODPO folds language modeling directly into reward modeling, training LMs as implicit collective reward models (cRMs) that combine all objectives with specific weightings. While theoretically guaranteed to produce the same optimal solutions as MORLHF, MODPO is practically more stable and computationally efficient. Empirical results from safety alignment and long-form question answering confirm that MODPO matches or outperforms existing methods, consistently producing a Pareto front of LMs that cater to diverse preferences with 3 times less computational resources compared to MORLHF.


title: The Effect of Quadratic Base Change on Torsion

abstract: Let $K$ be a quadratic field and $E$ an elliptic curve defined over $K$ such that $E(K)[2]\simeq C_2.$ In this paper, we study the effect of quadratic base change on $E(K)_{\text{tor}}.$ In particular, we examine the growth of $E(K)_{\text{tor}}$ upon quadratic base change when $K$ is any quadratic cyclotomic field. In addition, for a given elliptic curve $E/K$ with prescribed torsion group over $K,$ (no restriction on its $2$-torsion part) we describe an algorithm to find all quadratic extensions $L/K$ in which $E(K)_{\text{tor}} \subsetneq E(L)_{\text{tor}}$ and describe $E(L)_{\text{tor}}$ in each such case.


title: Agent Instructs Large Language Models to be General Zero-Shot Reasoners

abstract: We introduce a method to improve the zero-shot reasoning abilities of large language models on general language understanding tasks. Specifically, we build an autonomous agent to instruct the reasoning process of large language models. We show this approach further unleashes the zero-shot reasoning abilities of large language models to more tasks. We study the performance of our method on a wide set of datasets spanning generation, classification, and reasoning. We show that our method generalizes to most tasks and obtains state-of-the-art zero-shot performance on 20 of the 29 datasets that we evaluate. For instance, our method boosts the performance of state-of-the-art large language models by a large margin, including Vicuna-13b (13.3%), Llama-2-70b-chat (23.2%), and GPT-3.5 Turbo (17.0%). Compared to zero-shot chain of thought, our improvement in reasoning is striking, with an average increase of 10.5%. With our method, Llama-2-70b-chat outperforms zero-shot GPT-3.5 Turbo by 10.2%.


title: Relic density of asymmetric dark matter and constraints on the parameter spaces

abstract: Based on the cosmological observations, the baryon and dark matter energy densities are similar. There may exist an asymmetry between the dark matter particles and their corresponding anti--particles. We review the relic density of asymmetric dark matter particle and anti--particle in the standard cosmological scenario and quintessence model with kination phase. Then we use the Planck data to find constraints on the annihilation cross section and the mass of the asymmetric dark matter in those models.


title: A Theory of Pitch for the Hydrodynamic Properties of Molecules, Helices, and Achiral Swimmers at Low Reynolds Number

abstract: We present a theory for pitch, a matrix property which is linked to the coupling of rotational and translational motion of rigid bodies at low Reynolds number. The pitch matrix is a geometric property of objects in contact with a surrounding fluid, and it can be decomposed into three principal axes of pitch and their associated \textit{moments of pitch}. The moments of pitch predict the translational motion in a direction parallel to each pitch axis when the object is rotated around that axis, and can be used to explain translational drift, particularly for rotating helices. We also provide a symmetrized boundary element model for blocks of the resistance tensor, allowing calculation of the pitch matrix for arbitrary rigid bodies. We analyze a range of chiral objects, including chiral molecules and helices. Chiral objects with a $C_n$ symmetry axis with $n > 2$ show additional symmetries in their pitch matrices. We also show that some achiral objects have non-vanishing pitch matrices, and use this result to explain recent observations of achiral microswimmers. We also discuss the small, but non-zero pitch of Lord Kelvin's isotropic helicoid.