title: Road to perdition? The effect of illicit drug use on labour market outcomes of prime-age men in Mexico

abstract: This study addresses the impact of illicit drug use on the labour market outcomes of men in Mexico. We leverage statistical information from three waves of a comparable national survey and make use of Lewbel's heteroskedasticity-based instrumental variable strategy to deal with the endogeneity of drug consumption. Our results suggests that drug consumption has quite negative effects in the Mexican context: It reduces employment, occupational attainment and formality and raises unemployment of local men. These effects seem larger than those estimated for high-income economies


title: FA-Depth: Toward Fast and Accurate Self-supervised Monocular Depth Estimation

abstract: Most existing methods often rely on complex models to predict scene depth with high accuracy, resulting in slow inference that is not conducive to deployment. To better balance precision and speed, we first designed SmallDepth based on sparsity. Second, to enhance the feature representation ability of SmallDepth during training under the condition of equal complexity during inference, we propose an equivalent transformation module(ETM). Third, to improve the ability of each layer in the case of a fixed SmallDepth to perceive different context information and improve the robustness of SmallDepth to the left-right direction and illumination changes, we propose pyramid loss. Fourth, to further improve the accuracy of SmallDepth, we utilized the proposed function approximation loss (APX) to transfer knowledge in the pretrained HQDecv2, obtained by optimizing the previous HQDec to address grid artifacts in some regions, to SmallDepth. Extensive experiments demonstrate that each proposed component improves the precision of SmallDepth without changing the complexity of SmallDepth during inference, and the developed approach achieves state-of-the-art results on KITTI at an inference speed of more than 500 frames per second and with approximately 2 M parameters. The code and models will be publicly available at https://github.com/fwucas/FA-Depth.


title: High-performance superconducting two-qubit gate using a three-mode tunable coupler

abstract: Building a scalable universal high-performance quantum processor is a formidable challenge. In particular, the problem of realizing fast high-perfomance two-qubit gates of high-fidelity remains needful. Here we propose a unitary cell for a scalable quantum processor consisting of two transmons and a tunable three-mode coupler allowing for a ZZ interaction control. We experimentally demonstrate the native CZ gate with the pulse duration of 60~ns achieving the two-qubit gate fidelity above 98%, limited mostly by qubit coherence time. Numerical simulations show that by optimizing the gate duration the fidelity can be pushed over 99.97%.


title: Preservation theorems on sparse classes revisited

abstract: We revisit the work studying homomorphism preservation for first-order logic in sparse classes of structures initiated in [Atserias et al., JACM 2006] and [Dawar, JCSS 2010]. These established that first-order logic has the homomorphism preservation property in any sparse class that is monotone and addable. It turns out that the assumption of addability is not strong enough for the proofs given. We demonstrate this by constructing classes of graphs of bounded treewidth which are monotone and addable but fail to have homomorphism preservation. We also show that homomorphism preservation fails on the class of planar graphs. On the other hand, the proofs of homomorphism preservation can be recovered by replacing addability by a stronger condition of amalgamation over bottlenecks. This is analogous to a similar condition formulated for extension preservation in [Atserias et al., SiCOMP 2008].


title: The fourth moment of the Hurwitz zeta function

abstract: We prove a sharp upper bound for the fourth moment of the Hurwitz zeta function $\zeta(s,\alpha)$ on the critical line when the shift parameter $\alpha$ is irrational and of irrationality exponent strictly less than 3. As a consequence, we determine the order of magnitude of the $2k$th moment for all $0 \leqslant k \leqslant 2$ in this case. In contrast to the Riemann zeta function and other $L$-functions from arithmetic, these grow like $T (\log T)^k$. This suggests, and we conjecture, that the value distribution of $\zeta(s,\alpha)$ on the critical line is Gaussian.


title: Unconventional Unidirectional Magnetoresistance in vdW Heterostructures

abstract: Electrical readout of magnetic states is a key to realize novel spintronics devices for efficient computing and data storage. Unidirectional magnetoresistance (UMR) in bilayer systems, consisting of a spin source material and a magnetic layer, refers to a change in the longitudinal resistance upon the reversal of magnetization, which typically originates from the interaction of spin-current and magnetization at the interface. Because of UMR s linear dependence on applied charge current and magnetization, it can be used to electrically read the magnetization state. However, in conventional spin source materials, the spin polarization of an electric field induced spin current is restricted to be in the film plane and hence the ensuing UMR can only respond to the in plane component of the magnetization. On the other hand, magnets with perpendicular magnetic anisotropy (PMA) are highly desired for magnetic memory and spin-logic devices, while the electrical read out of PMA magnets through UMR is critically missing. Here, we report the discovery of an unconventional UMR in bilayer heterostructures of a topological semimetal (WTe2) and a PMA ferromagnetic insulator (Cr2Ge2Te6, CGT), which allows to electrically read the up and down magnetic states of the CGT layer by measuring the longitudinal resistance. Our theoretical calculations based on a tight binding model show that the unconventional UMR originates from the interplay of crystal symmetry breaking in WTe2 and magnetic exchange interaction across the WTe2 and CGT interface. Combining with the ability of WTe2 to obtain magnetic field free switching of the PMA magnets, our discoveries open an exciting pathway to achieve two terminal magnetic memory devices that operate solely on the spin orbit torque and UMR, which is critical for developing next-generation non volatile and low power consumption data storage technologies.


title: A Versatile Framework for Analyzing Galaxy Image Data by Implanting Human-in-the-loop on a Large Vision Model

abstract: The exponential growth of astronomical datasets provides an unprecedented opportunity for humans to gain insight into the Universe. However, effectively analyzing this vast amount of data poses a significant challenge. Astronomers are turning to deep learning techniques to address this, but the methods are limited by their specific training sets, leading to considerable duplicate workloads too. Hence, as an example to present how to overcome the issue, we built a framework for general analysis of galaxy images, based on a large vision model (LVM) plus downstream tasks (DST), including galaxy morphological classification, image restoration, object detection, parameter extraction, and more. Considering the low signal-to-noise ratio of galaxy images and the imbalanced distribution of galaxy categories, we have incorporated a Human-in-the-loop (HITL) module into our large vision model, which leverages human knowledge to enhance the reliability and interpretability of processing galaxy images interactively. The proposed framework exhibits notable few-shot learning capabilities and versatile adaptability to all the abovementioned tasks on galaxy images in the DESI legacy imaging surveys. Expressly, for object detection, trained by 1000 data points, our DST upon the LVM achieves an accuracy of 96.7%, while ResNet50 plus Mask R-CNN gives an accuracy of 93.1%; for morphology classification, to obtain AUC ~0.9, LVM plus DST and HITL only requests 1/50 training sets compared to ResNet18. Expectedly, multimodal data can be integrated similarly, which opens up possibilities for conducting joint analyses with datasets spanning diverse domains in the era of multi-message astronomy.


title: Prioritising GitHub Priority Labels

abstract: Communities on GitHub often use issue labels as a way of triaging issues by assigning them priority ratings based on how urgently they should be addressed. The labels used are determined by the repository contributors and not standardised by GitHub. This makes it difficult for priority-related reasoning across repositories for both researchers and contributors. Previous work shows interest in how issues are labelled and what the consequences for those labels are. For instance, some previous work has used clustering models and natural language processing to categorise labels without a particular emphasis on priority. With this publication, we introduce a unique data set of 812 manually categorised labels pertaining to priority; normalised and ranked as low-, medium-, or high-priority. To provide an example of how this data set could be used, we have created a tool for GitHub contributors that will create a list of the highest priority issues from the repositories to which they contribute. We have released the data set and the tool for anyone to use on Zenodo because we hope that this will help the open source community address high-priority issues more effectively and inspire other uses.


title: Neuroscheduling for Remote Estimation

abstract: Many modern distributed systems consist of devices that generate more data than what can be transmitted via a communication link in near real time with high-fidelity. We consider the scheduling problem in which a device has access to multiple data sources, but at any moment, only one of them is revealed in real-time to a remote receiver. Even when the sources are Gaussian, and the fidelity criterion is the mean squared error, the globally optimal data selection strategy is not known. We propose a data-driven methodology to search for the elusive optimal solution using linear function approximation approach called neuroscheduling and establish necessary and sufficient conditions for the optimal scheduler to not over fit training data. Additionally, we present several numerical results that show that the globally optimal scheduler and estimator pair to the Gaussian case are nonlinear.


title: COGNET-MD, an evaluation framework and dataset for Large Language Model benchmarks in the medical domain

abstract: Large Language Models (LLMs) constitute a breakthrough state-of-the-art Artificial Intelligence (AI) technology which is rapidly evolving and promises to aid in medical diagnosis either by assisting doctors or by simulating a doctor's workflow in more advanced and complex implementations. In this technical paper, we outline Cognitive Network Evaluation Toolkit for Medical Domains (COGNET-MD), which constitutes a novel benchmark for LLM evaluation in the medical domain. Specifically, we propose a scoring-framework with increased difficulty to assess the ability of LLMs in interpreting medical text. The proposed framework is accompanied with a database of Multiple Choice Quizzes (MCQs). To ensure alignment with current medical trends and enhance safety, usefulness, and applicability, these MCQs have been constructed in collaboration with several associated medical experts in various medical domains and are characterized by varying degrees of difficulty. The current (first) version of the database includes the medical domains of Psychiatry, Dentistry, Pulmonology, Dermatology and Endocrinology, but it will be continuously extended and expanded to include additional medical domains.


title: Labelled Well Quasi Ordered Classes of Bounded Linear Clique Width

abstract: We provide an algorithm to decide whether a class of finite graphs that has bounded linear clique width is well-quasi-ordered by the induced subgraph relation in the presence of a labelling of the vertices, where the class is given by an $\mathsf{MSO}$-transduction from finite words. This study leverages tools from automata theory, and the proof scheme allows to derive a weak version of the Pouzet conjecture for classes of bounded linear clique-width. We also provide an automata based characterization of which classes of $\mathsf{NLC}$ graphs are labelled-well-quasi-ordered by the induced subgraph relation, where we recover the results of Daligault Rao and Thomass\'e by encoding the models into trees with the gap embedding relation of Dershowitz and Tzameret.


title: The unluckiest star: A spectroscopically confirmed repeated partial tidal disruption event AT 2022dbl

abstract: The unluckiest star orbits a supermassive black hole elliptically. Every time it reaches the pericenter, it shallowly enters the tidal radius and gets partially tidal disrupted, producing a series of flares. Confirmation of a repeated partial tidal disruption event (pTDE) requires not only evidence to rule out other types of transients, but also proof that only one star is involved, as TDEs from multiple stars can also produce similar flares. In this letter, we report the discovery of a repeated pTDE, AT 2022dbl. In a quiescent galaxy at z=0.0284, two separate optical/UV flares have been observed in 2022 and 2024, with no bright X-ray, radio or mid-infrared counterparts. Compared to the first flare, the second flare has a similar blackbody temperature of ~26,000 K, slightly lower peak luminosity, and slower rise and fall phases. Compared to the ZTF TDEs, their blackbody parameters, bolometric energies and light curve shapes are all similar. The spectra taken during the second flare show a steeper continuum than the late-time spectra of the previous flare, consistent with a newly risen flare. More importantly, the possibility of two independent TDEs can be largely ruled out because the optical spectra taken around the peak of the two flares exhibit highly similar broad Balmer, N III and possible He II emission lines, especially the extreme ~4100{\AA} emission lines. This represents the first robust spectroscopic evidence for a repeated pTDE, which can soon be verified by observing the third flare, given its short orbital period.


title: ZX-calculus is Complete for Finite-Dimensional Hilbert Spaces

abstract: The ZX-calculus is a graphical language for reasoning about quantum computing and quantum information theory. As a complete graphical language, it incorporates a set of axioms rich enough to derive any equation of the underlying formalism. While completeness of the ZX-calculus has been established for qubits and the Clifford fragment of prime-dimensional qudits, universal completeness beyond two-level systems has remained unproven until now. In this paper, we present a proof establishing the completeness of finite-dimensional ZX-calculus, incorporating only the mixed-dimensional Z-spider and the qudit X-spider as generators. Our approach builds on the completeness of another graphical language, the finite-dimensional ZW-calculus, with direct translations between these two calculi. By proving its completeness, we lay a solid foundation for the ZX-calculus as a versatile tool not only for quantum computation but also for various fields within finite-dimensional quantum theory.


title: Efficient Line Search Method Based on Regression and Uncertainty Quantification

abstract: Unconstrained optimization problems are typically solved using iterative methods, which often depend on line search techniques to determine optimal step lengths in each iteration. This paper introduces a novel line search approach. Traditional line search methods, aimed at determining optimal step lengths, often discard valuable data from the search process and focus on refining step length intervals. This paper proposes a more efficient method using Bayesian optimization, which utilizes all available data points, i.e., function values and gradients, to guide the search towards a potential global minimum. This new approach more effectively explores the search space, leading to better solution quality. It is also easy to implement and integrate into existing frameworks. Tested on the challenging CUTEst test set, it demonstrates superior performance compared to existing state-of-the-art methods, solving more problems to optimality with equivalent resource usage.


title: Filtrations associated with singularities

abstract: We fix a complex analytic normal singularity germ $(X,o)$ of dimension $\geq 2$ and a (not necessarily irreducible) reduced Weil divisor $(S,o)\subset (X,o)$. The embedded resolution of the pair determines a multi-index filtration of the local ring $\mathcal{O}_{X,o}$, which measures the embedded geometry of the pair. Furthermore, from the (induced) resolution of $(S,o)$ we also consider a multi-index filtration associated with $(S,o)$. This latter one can be lifted to a filtration of $\mathcal{O}_{X,o}$ too. The main result proves that the second filtration of $\mathcal{O}_{X,o}$ can be realized as a `limit' filtration of the first one (if we blow up certain centers sufficiently many times).


title: Witnessing Entanglement and Quantum Correlations in Condensed Matter: A Review

abstract: The detection and certification of entanglement and quantum correlations in materials is of fundamental and far-reaching importance, and has seen significant recent progress. It impacts both our understanding of the basic science of quantum many-body phenomena as well as the identification of systems suitable for novel technologies. Frameworks suitable to condensed matter that connect measurements to entanglement and coherence have been developed in the context of quantum information theory. These take the form of entanglement witnesses and quantum correlation measures. The underlying theory of these quantities, their relation to condensed matter experimental techniques, and their application to real materials are comprehensively reviewed. In addition, their usage in e.g. protocols, the relative advantages and disadvantages of witnesses and measures, and future prospects in, e.g., correlated electrons, entanglement dynamics, and entangled spectroscopic probes, are presented. Consideration is given to the interdisciplinary nature of this emerging research and substantial ongoing progress by providing an accessible and practical treatment from fundamentals to application. Particular emphasis is placed on quantities accessible to collective measurements, including by susceptibility and spectroscopic techniques. This includes the magnetic susceptibility witness, one-tangle, concurrence and two-tangle, two-site quantum discord, and quantum coherence measures such as the quantum Fisher information.


title: Hyper-doping of Silicon for Plasmonics in the Telecommunication Range

abstract: We investigate hyper-doping, a promising approach to introduce a high concentration of impurities into silicon beyond its solid solubility limit, for its potential applications in near-infrared plasmonics. We systematically explore the incorporation of dopants into silicon using ion implantation and pulsed laser melting annealing processes. Reflectance spectra analysis shows an achievable plasma wavelength of around 1.5 $\mu$m for dopant concentrations exceeding 4 at.%. Complex refractive index data for the doped silicon samples are extracted, revealing their potential for near-infrared plasmonic applications. Moreover, we propose a fabrication process that allows for the creation of hyper-doped silicon nanoparticles without the need for additional masking steps. Our research paves the way for designing CMOS-compatible plasmonic nanostructures operating in the telecommunication wavelength range. The study's findings offer significant insights into the utilization of hyper-doped silicon for advanced photonic and optoelectronic applications.


title: Inverse Design for Waveguide Dispersion with a Differentiable Mode Solver

abstract: Inverse design of optical components based on adjoint sensitivity analysis has the potential to address the most challenging photonic engineering problems. However existing inverse design tools based on finite-difference-time-domain (FDTD) models are poorly suited for optimizing waveguide modes for adiabatic transformation or perturbative coupling, which lies at the heart of many important photonic devices. Among these, dispersion engineering of optical waveguides is especially challenging in ultrafast and nonlinear optical applications involving broad optical bandwidths and frequency-dependent anisotropic dielectric material response. In this work we develop gradient back-propagation through a general purpose electromagnetic eigenmode solver and use it to demonstrate waveguide dispersion optimization for second harmonic generation with maximized phase-matching bandwidth. This optimization of three design parameters converges in eight steps, reducing the computational cost of optimization by ~100x compared to exhaustive search and identifies new designs for broadband optical frequency doubling of laser sources in the 1.3-1.4 micron wavelength range.Furthermore we demonstrate that the computational cost of gradient back-propagation is independent of the number of parameters, as required for optimization of complex geometries. This technique enables practical inverse design for a broad range of previously intractable photonic devices.


title: Where do developers admit their security-related concerns?

abstract: Developers use different means to document the security concerns of their code. Because of all of these opportunities, they may forget where the information is stored, or others may not be aware of it, and leave it unmaintained for so long that it becomes obsolete, if not useless. In this work, we analyzed different sources of code documentation from four large-scale, real-world, open-source projects in an industrial setting to understand where developers report their security concerns. In particular, we manually inspected 2.559 instances taken from source code comments, commit messages, and issue trackers. Overall, we found that developers prefer to document security concerns in source code comments and issue trackers. We also found that the longer the comments stay unfixed, the more likely they remain unfixed. Thus, to create awareness among developers, we implemented a pipeline to remind them about the introduction or removal of comments pointing to a security problem.


title: Limitations of the rate-distribution formalism in describing luminescence quenching in the presence of diffusion

abstract: When encountering complex fluorescence decays that deviate from exponentiality, a very appealing and powerful approach is to use lifetime (or equivalent rate constant) distributions. These are related by Laplace transform to multi-exponential functions, stretched exponentials, Becquerel's law, and others. In the case of bimolecular quenching, time-independent probability distributions of the rate constants have occasionally been used. Here we show that this mathematical formalism has a clear physical interpretation only when the fluorophore and quencher molecules are immobile, as in the solid state. However, such an interpretation is no longer possible once we consider the motion of fluorophores with respect to quenchers. Therefore, for systems in which the relative motion of fluorophores and quenchers cannot be neglected, it is not appropriate to use the time-independent continuous reaction rate or decay time distributions to describe, fit, or rationalize experimental results.


title: Broadening Privacy and Surveillance: Eliciting Interconnected Values with a Scenarios Workbook on Smart Home Cameras

abstract: We use a design workbook of speculative scenarios as a values elicitation activity with 14 participants. The workbook depicts use case scenarios with smart home camera technologies that involve surveillance and uneven power relations. The scenarios were initially designed by the researchers to explore scenarios of privacy and surveillance within three social relationships involving "primary" and "non-primary" users: Parents-Children, Landlords-Tenants, and Residents-Domestic Workers. When the scenarios were utilized as part of a values elicitation activity with participants, we found that they reflected on a broader set of interconnected social values beyond privacy and surveillance, including autonomy and agency, physical safety, property rights, trust and accountability, and fairness. The paper suggests that future research about ethical issues in smart homes should conceptualize privacy as interconnected with a broader set of social values (which can align or be in tension with privacy), and reflects on considerations for doing research with non-primary users.


title: $K\to\pi\nu\bar\nu$ spectra and NA62 interpretation

abstract: Using the measured and projected invisible mass spectrum of the $K^+\to\pi^+\nu\bar\nu$ mode, we determine the current and future constraints within the model-independent framework of the weak effective theory at dimension-six. We work in two different operator bases depending whether neutrinos are Majorana or Dirac fermions. This makes it possible to transparently incorporate mass effects of additional sterile neutrinos for all operators.


title: POSTER: Testing network-based RTK for GNSS receiver security

abstract: Global Navigation Satellite Systems (GNSS) provide precise location, while Real Time Kinematics (RTK) allow mobile receivers (termed rovers), leveraging fixed stations, to correct errors in their Position Navigation and Timing (PNT) solution. This allows compensating for multi-path effects, ionospheric errors, and observation biases, enabling consumer receivers to achieve centimeter-level accuracy. While network distribution of correction streams can be protected with common secure networking practices, the reference stations can still be attacked by GNSS spoofing or jamming. This work investigates (i) the effect RTK reference station spoofing has on the rover's PNT solution quality and (ii) the potential countermeasures towards hardening the RTK infrastructure.


title: Practical Superdirective and Efficient Rectenna for Low-Power RF Energy Harvesting

abstract: This paper presents the design and analysis of a superdirective rectenna optimized for enhanced RF-to-DC efficiency and realised gain, featuring direct impedance matching between the antenna and the rectifier. Employing passively loaded, low profile strip dipoles on a low-loss substrate, the rectenna achieves a realised gain of 6.9 dBi and an RF-to-DC efficiency of 22.1% at -20 dBm.


title: UVCANDELS: The role of dust on the stellar mass$-$size relation of disk galaxies at 0.5 $\leq z \leq$ 3.0

abstract: We use the Ultraviolet Imaging of the Cosmic Assembly Near-infrared Deep Extragalactic Legacy Survey fields (UVCANDELS) to measure half-light radii in the rest-frame far-UV for $\sim$16,000 disk-like galaxies over $0.5\leq z \leq 3$. We compare these results to rest-frame optical sizes that we measure in a self-consistent way and find that the stellar mass-size relation of disk galaxies is steeper in the rest-frame UV than in the optical across our entire redshift range. We show that this is mainly driven by massive galaxies ($\gtrsim10^{10}$M$_\odot$), which we find to also be among the most dusty. Our results are consistent with the literature and have commonly been interpreted as evidence of inside-out growth wherein galaxies form their central structures first. However, they could also suggest that the centers of massive galaxies are more heavily attenuated than their outskirts. We distinguish between these scenarios by modeling and selecting galaxies at $z=2$ from the VELA simulations suite in a way that is consistent with UVCANDELS. We show that the effects of dust alone can account for the size differences we measure at $z=2$. This indicates that, at different wavelengths, size differences and the different slopes of the stellar mass-size relation do not constitute evidence for inside-out growth.


title: Memristive response and neuromorphic functionality of polycrystalline ferroelectric Ca:HfO$_{2}$-based devices

abstract: Memristors are considered key building blocks for the development of neuromorphic computing hardware. For ferroelectric memristors with a capacitor-like structure, the polarization direction modulates the height of the Schottky barriers -- present at ferroelectric/metal interfaces -- that control the device resistance. Here, we unveil the coexistence of multiple memristive mechanisms in Pt/Ca:HfO$_2$/Pt devices fabricated on silicon by a simple and effective low-toxicity chemical solution method. Depending on the fabrication conditions, either dielectric or ferroelectric devices are obtained, each one presenting a distinct memristive response. The devices are forming-free and can sustain ferroelectric switching and memristive behavior simultaneously. Aided by numerical simulations, we describe this behavior as a competition of different mechanisms, including the effect of the ferroelectric polarization on Schottky interfaces and oxygen vacancy electromigration. Finally, we propose a simple learning algorithm for time-series recognition, designed to take advantage of the resistance relaxations present in the case of the ferroelectric devices.


title: Harmonic operators on convolution quantum group algebras

abstract: Let ${\Bbb G}$ be a locally compact quantum group and ${\mathcal T}(L^2({\Bbb G}))$ be the Banach algebra of trace class operators on $L^2({\Bbb G})$ with the convolution induced by the right fundamental unitary of ${\Bbb G}$. We study the space of harmonic operators $\widetilde{\mathcal H}_\omega$ in ${\mathcal B}(L^2({\Bbb G}))$ associated to a contractive element $\omega\in {\mathcal T}(L^2({\Bbb G}))$. We characterize the existence of non-zero harmonic operators in ${\mathcal K}(L^2({\Bbb G}))$ and relate them with some properties of the quantum group ${\Bbb G}$, such as finiteness, amenability and co-amenability.


title: A minimal scenario for the origin of non-equilibrium order

abstract: Extant life contains numerous non-equilibrium mechanisms to create order not achievable at equilibrium; it is generally assumed that these mechanisms evolved because the resulting order was sufficiently beneficial to overcome associated costs of time and energy. Here, we identify a broad range of conditions under which non-equilibrium order-creating mechanisms will evolve as an inevitable consequence of self-replication, even if the order is not directly functional. We show that models of polymerases, when expanded to include known stalling effects, can evolve kinetic proofreading through selection for fast replication alone, consistent with data from recent mutational screens. Similarly, replication contingent on fast self-assembly can select for non-equilibrium instabilities and result in more ordered structures without any direct selection for order. We abstract these results into a framework that predicts that self-replication intrinsically amplifies dissipative order-enhancing mechanisms if the distribution of replication times is wide enough. Our work suggests the intriguing possibility that non-equilibrium order can arise more easily than assumed, even before that order is directly functional, with consequences impacting mutation rate evolution and kinetic traps in self-assembly to the origin of life.


title: Synthesis of Temporal Causality

abstract: We present an automata-based algorithm to synthesize omega-regular causes for omega-regular effects on executions of a reactive system, such as counterexamples uncovered by a model checker. Our theory is a generalization of temporal causality, which has recently been proposed as a framework for drawing causal relationships between trace properties on a given trace. So far, algorithms exist only for verifying a single causal relationship and, as an extension, cause synthesis through enumeration, which is complete only for a small fragment of effect properties. This work presents the first complete cause-synthesis algorithm for the class of omega-regular effects. We show that in this case, causes are guaranteed to be omega-regular themselves and can be computed as, e.g., nondeterministic B\"uchi automata. We demonstrate the practical feasibility of this algorithm with a prototype tool and evaluate its performance for cause synthesis and cause checking.


title: Blackbox Adaptation for Medical Image Segmentation

abstract: In recent years, various large foundation models have been proposed for image segmentation. There models are often trained on large amounts of data corresponding to general computer vision tasks. Hence, these models do not perform well on medical data. There have been some attempts in the literature to perform parameter-efficient finetuning of such foundation models for medical image segmentation. However, these approaches assume that all the parameters of the model are available for adaptation. But, in many cases, these models are released as APIs or blackboxes, with no or limited access to the model parameters and data. In addition, finetuning methods also require a significant amount of compute, which may not be available for the downstream task. At the same time, medical data can't be shared with third-party agents for finetuning due to privacy reasons. To tackle these challenges, we pioneer a blackbox adaptation technique for prompted medical image segmentation, called BAPS. BAPS has two components - (i) An Image-Prompt decoder (IP decoder) module that generates visual prompts given an image and a prompt, and (ii) A Zero Order Optimization (ZOO) Method, called SPSA-GC that is used to update the IP decoder without the need for backpropagating through the foundation model. Thus, our method does not require any knowledge about the foundation model's weights or gradients. We test BAPS on four different modalities and show that our method can improve the original model's performance by around 4%.


title: Global Symmetry and Integral Constraint on Superconformal Lines in Four Dimensions

abstract: We study properties of point-like impurities preserving flavor symmetry and supersymmetry in four-dimensional ${\cal N} = 2$ field theories. At large distances, such impurities are described by half-BPS superconformal line defects. By working in the $\text{AdS}_2\times \text{S}^2$ conformal frame, we develop a novel and simpler way of deriving the superconformal Ward identities relating the various two-point functions of flavor current multiplet operators in the presence of the defect. We use these relations to simplify a certain integrated two-point function of flavor current multiplet operators that, in Lagrangian theories, can be computed using supersymmetric localization. The simplification gives an integral constraint on the two-point function of the flavor current multiplet superconformal primary with trivial integration measure in the $\text{AdS}_2\times \text{S}^2$ conformal frame. We provide several consistency checks on our Ward identities.


title: Strategic control for a Boltzmann like decision-making model

abstract: We study a prototypical non-polynomial decision-making model for which agents in a population potentially alternate between two consumption strategies, one related to the exploitation of an unlimited but considerably expensive resource and the other a comparably cheaper but restricted and slowly renewable source. In particular, we study a model following a Boltzmann-like exploration policy, enhancing the accuracy at which the exchange rates are captured with respect to classical polynomial approaches by considering sigmoidal functions to represent the cost-profit relation in both exploit strategies. Additionally, given the intrinsic timescale separation between the decision-making process and recovery rates of the renewable resource, we use geometric singular perturbation theory to analyze the model. We further use numerical analysis to determine parameter ranges for which the model undergoes bifurcations. These bifurcations, being related to critical states of the system, are relevant to the fast transitions between strategies. Hence, we design controllers to regulate such rapid transitions by taking advantage of the system's criticality.


title: Nearly self-similar blowup of generalized axisymmetric Navier-Stokes and Boussinesq equations

abstract: We perform numerical investigation of nearly self-similar blowup of generalized axisymmetric Navier-Stokes equations and Boussinesq system with a time-dependent fractional dimension. The dynamic change of the space dimension is proportional to the ratio R(t)/Z(t), where (R(t),Z(t)) is the position at which the maximum vorticity achieves its global maximum. This choice of space dimension is to ensure that the advection along the r-direction has the same scaling as that along the z-direction, thus preventing formation of two-scale solution structure. For the generalized axisymmetric Navier-Stokes equations with solution dependent viscosity, we show that the solution develops a self-similar blowup with dimension equal to 3.188 and the self-similar profile satisfies the axisymmetric Navier-Stokes equations with constant viscosity. We also study the nearly self-similar blowup of the axisymmetric Boussinesq system with constant viscosity. The generalized axisymmetric Boussinesq system preserves almost all the known properties of the 3D Navier-Stokes equations except for the conservation of angular momentum. We present convincing numerical evidence that the generalized axisymmetric Boussinesq system develops a stable nearly self-similar blowup solution with maximum vorticity increased by O(10^{30}).


title: Is the annualized compounded return of Medallion over 35%?

abstract: It is a challenge to estimate fund performance by compounded returns. Arguably, it is incorrect to use yearly returns directly for compounding, with reported annualized return of above 60% for Medallion for the 31 years up to 2018. We propose an estimation based on fund sizes and trading profits and obtain a compounded return of 32.6% before fees with a 3% financing rate. Alternatively, we suggest using the manager's wealth as a proxy and arriving at a compounded growth rate of 25.6% for Simons for the 33 years up to 2020. We conclude that the annualized compounded return of Medallion before fees is probably under 35%. Our findings have implications for how to compute fund performance correctly.


title: GenToC: Leveraging Partially-Labeled Data for Product Attribute-Value Identification

abstract: In the e-commerce domain, the accurate extraction of attribute-value pairs from product listings (e.g., Brand: Apple) is crucial for enhancing search and recommendation systems. The automation of this extraction process is challenging due to the vast diversity of product categories and their respective attributes, compounded by the lack of extensive, accurately annotated training datasets and the demand for low latency to meet the real-time needs of e-commerce platforms. To address these challenges, we introduce GenToC, a novel two-stage model for extracting attribute-value pairs from product titles. GenToC is designed to train with partially-labeled data, leveraging incomplete attribute-value pairs and obviating the need for a fully annotated dataset. Moreover, we introduce a bootstrapping method that enables GenToC to progressively refine and expand its training dataset. This enhancement substantially improves the quality of data available for training other neural network models that are typically faster but are inherently less capable than GenToC in terms of their capacity to handle partially-labeled data. By supplying an enriched dataset for training, GenToC significantly advances the performance of these alternative models, making them more suitable for real-time deployment. Our results highlight the unique capability of GenToC to learn from a limited set of labeled data and to contribute to the training of more efficient models, marking a significant leap forward in the automated extraction of attribute-value pairs from product titles. GenToC has been successfully integrated into India's largest B2B e-commerce platform, IndiaMART.com, achieving a significant increase of 21.1% in recall over the existing deployed system while maintaining a high precision of 89.5% in this challenging task.


title: Binding energy referencing in X-ray photoelectron spectroscopy: expanded data set confirms that adventitious carbon aligns to the vacuum level

abstract: The correct referencing of the binding energy (BE) scale is essential for the accuracy of chemical analysis by x-ray photoelectron spectroscopy. The C 1s C C/C-H peak from adventitious carbon (AdC), most commonly used for that purpose, was previously shown to shift by several eVs following changes in the sample work function, thus indicating that AdC aligns to the sample vacuum level (VL). Here, results from a much larger sample set are presented including 360 specimens of thin-film samples comprising metals, nitrides, carbides, borides, oxides, carbonitrides, and oxynitrides. Irrespective of the material system the C 1s peak of AdC is found to follow changes in the sample work function fully confirming previous results. Several observations exclude differential charging as plausible explanation. All experimental evidence points instead to the VL alignment at the AdC/sample interface as the source of shifts. Should the C 1s peak of AdC be used for spectra referencing the measurement of sample work function is necessary, irrespective of whether samples are measured grounded or insulated from the spectrometer.


title: Data-generating process and time-series asset pricing

abstract: We study the data-generating processes for factors expressed in return differences, which the literature on time-series asset pricing seems to have overlooked. For the factors' data-generating processes or long-short zero-cost portfolios, a meaningful definition of returns is impossible; further, the compounded market factor (MF) significantly underestimates the return difference between the market and the risk-free rate compounded separately. Surprisingly, if MF were treated coercively as periodic-rebalancing long-short (i.e., the same as size and value), Fama-French three-factor (FF3) would be economically unattractive for lacking compounding and irrelevant for suffering from the small "size of an effect." Otherwise, FF3 might be misspecified if MF were buy-and-hold long-short. Finally, we show that OLS with net returns for single-index models leads to inflated alphas, exaggerated t-values, and overestimated Sharpe ratios (SR); worse, net returns may lead to pathological alphas and SRs. We propose defining factors (and SRs) with non-difference compound returns.


title: A new class of $\alpha$-Farey maps and an application to normal numbers

abstract: We define two types of the $\alpha$-Farey maps $F_{\alpha}$ and $F_{\alpha, \flat}$ for $0 < \alpha < \tfrac{1}{2}$, which were previously defined only for $\tfrac{1}{2} \le \alpha \le 1$ by R.~Natsui (2004). Then, for each $0 < \alpha < \tfrac{1}{2}$, we construct the natural extension maps on the plane and show that the natural extension of $F_{\alpha, \flat}$ is metrically isomorphic to the natural extension of the original Farey map. As an application, we show that the set of normal numbers associted with $\alpha$-continued fractions does not vary by the choice of $\alpha$, $0 < \alpha < 1$. This extends the result by C.~Kraaikamp and H.~Nakada (2000).


title: Kernel Expansions for High-Dimensional Mean-Field Control with Non-local Interactions

abstract: Mean-field control (MFC) problems aim to find the optimal policy to control massive populations of interacting agents. These problems are crucial in areas such as economics, physics, and biology. We consider the non-local setting, where the interactions between agents are governed by a suitable kernel. For $N$ agents, the interaction cost has $\mathcal{O}(N^2)$ complexity, which can be prohibitively slow to evaluate and differentiate when $N$ is large. To this end, we propose an efficient primal-dual algorithm that utilizes basis expansions of the kernels. The basis expansions reduce the cost of computing the interactions, while the primal-dual methodology decouples the agents at the expense of solving for a moderate number of dual variables. We also demonstrate that our approach can further be structured in a multi-resolution manner, where we estimate optimal dual variables using a moderate $N$ and solve decoupled trajectory optimization problems for large $N$. We illustrate the effectiveness of our method on an optimal control of 5000 interacting quadrotors.


title: Randomized Householder QR

abstract: This paper introduces a randomized Householder QR factorization (RHQR). This factorization can be used to obtain a well conditioned basis of a vector space and thus can be employed in a variety of applications. The RHQR factorization of the input matrix $W$ is equivalent to the standard Householder QR factorization of matrix $\Psi W$, where $\Psi$ is a sketching matrix that can be obtained from any subspace embedding technique. For this reason, the RHQR factorization can also be reconstructed from the Householder QR factorization of the sketched problem, yielding a single-synchronization randomized QR factorization (recRHQR). In most contexts, left-looking RHQR requires a single synchronization per iteration, with half the computational cost of Householder QR, and a similar cost to Randomized Gram-Schmidt (RGS) overall. We discuss the usage of RHQR factorization in the Arnoldi process and then in GMRES, showing thus how it can be used in Krylov subspace methods to solve systems of linear equations. Based on Charles Sheffield's connection between Householder QR and Modified Gram-Schmidt (MGS), a BLAS2-RGS is also derived. A finite precision analysis shows that, under mild probabilistic assumptions, the RHQR factorization of the input matrix $W$ inherits the stability of the Householder QR factorization, producing a well-conditioned basis and a columnwise backward stable factorization, all independently of the condition number of the input $W$, and with the accuracy of the sketching step. We study the subsampled randomized Hadamard transform (SRHT) as a very stable sketching technique. Numerical experiments show that RHQR produces a well conditioned basis whose sketch is numerically orthogonal and an accurate factorization, even for the most difficult inputs and with high-dimensional operations made in half-precision.


title: Boosting Few-Pixel Robustness Verification via Covering Verification Designs

abstract: Proving local robustness is crucial to increase the reliability of neural networks. While many verifiers prove robustness in $L_\infty$ $\epsilon$-balls, very little work deals with robustness verification in $L_0$ $\epsilon$-balls, capturing robustness to few pixel attacks. This verification introduces a combinatorial challenge, because the space of pixels to perturb is discrete and of exponential size. A previous work relies on covering designs to identify sets for defining $L_\infty$ neighborhoods, which if proven robust imply that the $L_0$ $\epsilon$-ball is robust. However, the number of neighborhoods to verify remains very high, leading to a high analysis time. We propose covering verification designs, a combinatorial design that tailors effective but analysis-incompatible coverings to $L_0$ robustness verification. The challenge is that computing a covering verification design introduces a high time and memory overhead, which is intensified in our setting, where multiple candidate coverings are required to identify how to reduce the overall analysis time. We introduce CoVerD, an $L_0$ robustness verifier that selects between different candidate coverings without constructing them, but by predicting their block size distribution. This prediction relies on a theorem providing closed-form expressions for the mean and variance of this distribution. CoVerD constructs the chosen covering verification design on-the-fly, while keeping the memory consumption minimal and enabling to parallelize the analysis. The experimental results show that CoVerD reduces the verification time on average by up to 5.1x compared to prior work and that it scales to larger $L_0$ $\epsilon$-balls.


title: High-dimensional multiple imputation (HDMI) for partially observed confounders including natural language processing-derived auxiliary covariates

abstract: Multiple imputation (MI) models can be improved by including auxiliary covariates (AC), but their performance in high-dimensional data is not well understood. We aimed to develop and compare high-dimensional MI (HDMI) approaches using structured and natural language processing (NLP)-derived AC in studies with partially observed confounders. We conducted a plasmode simulation study using data from opioid vs. non-steroidal anti-inflammatory drug (NSAID) initiators (X) with observed serum creatinine labs (Z2) and time-to-acute kidney injury as outcome. We simulated 100 cohorts with a null treatment effect, including X, Z2, atrial fibrillation (U), and 13 other investigator-derived confounders (Z1) in the outcome generation. We then imposed missingness (MZ2) on 50% of Z2 measurements as a function of Z2 and U and created different HDMI candidate AC using structured and NLP-derived features. We mimicked scenarios where U was unobserved by omitting it from all AC candidate sets. Using LASSO, we data-adaptively selected HDMI covariates associated with Z2 and MZ2 for MI, and with U to include in propensity score models. The treatment effect was estimated following propensity score matching in MI datasets and we benchmarked HDMI approaches against a baseline imputation and complete case analysis with Z1 only. HDMI using claims data showed the lowest bias (0.072). Combining claims and sentence embeddings led to an improvement in the efficiency displaying the lowest root-mean-squared-error (0.173) and coverage (94%). NLP-derived AC alone did not perform better than baseline MI. HDMI approaches may decrease bias in studies with partially observed confounders where missingness depends on unobserved factors.


title: Stretching Newton polygons using pure polynomials

abstract: Fix a prime $p$ and polynomials $f,g\in \mathbb{Q}_p[x]$. If the Newton polygon of $g$ consists of a single segment with negative slope, we show under some mild conditions that the Newton polygon of $f\circ g$ is identical to that of $f$, but stretched horizontally by a factor of $\operatorname{deg} g$. Specializing to the case $f=g$, this implies that all iterates of certain pure polynomials are irreducible, recovering a classical result of Odoni on the dynamical irreducibility of Eisenstein polynomials. We also prove that the Taylor polynomials of the exponential function (a well-known family of irreducible polynomials) remain irreducible upon composition with all iterates of certain pure polynomials of large enough degree.


title: Using Degeneracy in the Loss Landscape for Mechanistic Interpretability

abstract: Mechanistic Interpretability aims to reverse engineer the algorithms implemented by neural networks by studying their weights and activations. An obstacle to reverse engineering neural networks is that many of the parameters inside a network are not involved in the computation being implemented by the network. These degenerate parameters may obfuscate internal structure. Singular learning theory teaches us that neural network parameterizations are biased towards being more degenerate, and parameterizations with more degeneracy are likely to generalize further. We identify 3 ways that network parameters can be degenerate: linear dependence between activations in a layer; linear dependence between gradients passed back to a layer; ReLUs which fire on the same subset of datapoints. We also present a heuristic argument that modular networks are likely to be more degenerate, and we develop a metric for identifying modules in a network that is based on this argument. We propose that if we can represent a neural network in a way that is invariant to reparameterizations that exploit the degeneracies, then this representation is likely to be more interpretable, and we provide some evidence that such a representation is likely to have sparser interactions. We introduce the Interaction Basis, a tractable technique to obtain a representation that is invariant to degeneracies from linear dependence of activations or Jacobians.


title: The Local Interaction Basis: Identifying Computationally-Relevant and Sparsely Interacting Features in Neural Networks

abstract: Mechanistic interpretability aims to understand the behavior of neural networks by reverse-engineering their internal computations. However, current methods struggle to find clear interpretations of neural network activations because a decomposition of activations into computational features is missing. Individual neurons or model components do not cleanly correspond to distinct features or functions. We present a novel interpretability method that aims to overcome this limitation by transforming the activations of the network into a new basis - the Local Interaction Basis (LIB). LIB aims to identify computational features by removing irrelevant activations and interactions. Our method drops irrelevant activation directions and aligns the basis with the singular vectors of the Jacobian matrix between adjacent layers. It also scales features based on their importance for downstream computation, producing an interaction graph that shows all computationally-relevant features and interactions in a model. We evaluate the effectiveness of LIB on modular addition and CIFAR-10 models, finding that it identifies more computationally-relevant features that interact more sparsely, compared to principal component analysis. However, LIB does not yield substantial improvements in interpretability or interaction sparsity when applied to language models. We conclude that LIB is a promising theory-driven approach for analyzing neural networks, but in its current form is not applicable to large language models.


title: Quantifying risk of a noise-induced AMOC collapse from northern and tropical Atlantic Ocean variability

abstract: The Atlantic Meridional Overturning Circulation (AMOC) exerts a major influence on global climate. There is much debate about whether the current strong AMOC may collapse as a result of anthropogenic forcing and/or internal variability. Increasing the noise in simple salt-advection models can change the apparent AMOC tipping threshold. However, it's not clear if 'present-day' variability is strong enough to induce a collapse. Here, we investigate how internal variability affects the likelihood of AMOC collapse. We examine internal variability of basin-scale salinities and temperatures in four CMIP6 pre-industrial simulations. We fit this to an empirical, process-based AMOC box model, and find that noise-induced AMOC collapse (defined as a decade in which the mean AMOC strength falls below 5 Sv) is unlikely for pre-industrial CMIP6 variability unless external forcing shifts the AMOC closer to a threshold. However, CMIP6 models seem to underestimate present-day Atlantic Ocean variability, and stronger variability substantially increases the likelihood of noise-induced collapse, especially if forcing brings the AMOC close to a stability threshold. Surprisingly, we find a case where forcing temporarily overshoots a stability threshold but noise decreases the probability of collapse. Accurately modelling internal decadal variability is essential for understanding the increased uncertainty in AMOC projections.


title: Submodular Information Selection for Hypothesis Testing with Misclassification Penalties

abstract: We consider the problem of selecting an optimal subset of information sources for a hypothesis testing/classification task where the goal is to identify the true state of the world from a finite set of hypotheses, based on finite observation samples from the sources. In order to characterize the learning performance, we propose a misclassification penalty framework, which enables non-uniform treatment of different misclassification errors. In a centralized Bayesian learning setting, we study two variants of the subset selection problem: (i) selecting a minimum cost information set to ensure that the maximum penalty of misclassifying the true hypothesis remains bounded and (ii) selecting an optimal information set under a limited budget to minimize the maximum penalty of misclassifying the true hypothesis. Under certain assumptions, we prove that the objective (or constraints) of these combinatorial optimization problems are weak (or approximate) submodular, and establish high-probability performance guarantees for greedy algorithms. Further, we propose an alternate metric for information set selection which is based on the total penalty of misclassification. We prove that this metric is submodular and establish near-optimal guarantees for the greedy algorithms for both the information set selection problems. Finally, we present numerical simulations to validate our theoretical results over several randomly generated instances.

categories: stat.ML cs.CC cs.IT cs.LG math.IT math.OC


title: FitNets: An Adaptive Framework to Learn Accurate Traffic Distributions

abstract: Learning precise distributions of traffic features (e.g., burst sizes, packet inter-arrival time) is still a largely unsolved problem despite being critical for management tasks such as capacity planning or anomaly detection. A key limitation nowadays is the lack of feedback between the control plane and the data plane. Programmable data planes offer the opportunity to create systems that let data- and control plane to work together, compensating their respective shortcomings. We present FitNets, an adaptive network monitoring system leveraging feedback between the data- and the control plane to learn accurate traffic distributions. In the control plane, FitNets relies on Kernel Density Estimators which allow to provably learn distributions of any shape. In the data plane, FitNets tests the accuracy of the learned distributions while dynamically adapting data collection to the observed distribution fitness, prioritizing under-fitted features. We have implemented FitNets in Python and P4 (including on commercially available programmable switches) and tested it on real and synthetic traffic traces. FitNets is practical: it is able to estimate hundreds of distributions from up to 60 millions samples per second, while providing accurate error estimates and adapting to complex traffic patterns.


title: Coloring spheres in 3--manifolds

abstract: The sphere graph of $M_r$, a connect sum of $r$ copies of $S^1\times S^2$ was introduced by Hatcher as an analog of the curve graph of a surface to study the outer automorphism group of a free group $F_r$. Bestvina, Bromberg, and Fujiwara proved that the chromatic number of the curve graph is finite; bounds were subsequently improved by Gaster, Greene, and Vlamis. Motivated by the analogy, we provide upper and lower bounds for the chromatic number of the sphere graph of $M_r$. As a corollary to the prime decomposition of 3-manifolds, this gives bounds on the chromatic number of the sphere graph for any orientable 3-manifold.


title: Learning low-degree quantum objects

abstract: We consider the problem of learning low-degree quantum objects up to $\varepsilon$-error in $\ell_2$-distance. We show the following results: $(i)$ unknown $n$-qubit degree-$d$ (in the Pauli basis) quantum channels and unitaries can be learned using $O(1/\varepsilon^d)$ queries (independent of $n$), $(ii)$ polynomials $p:\{-1,1\}^n\rightarrow [-1,1]$ arising from $d$-query quantum algorithms can be classically learned from $O((1/\varepsilon)^d\cdot \log n)$ many random examples $(x,p(x))$ (which implies learnability even for $d=O(\log n)$), and $(iii)$ degree-$d$ polynomials $p:\{-1,1\}^n\to [-1,1]$ can be learned through $O(1/\varepsilon^d)$ queries to a quantum unitary $U_p$ that block-encodes $p$. Our main technical contributions are new Bohnenblust-Hille inequalities for quantum channels and completely bounded~polynomials.


title: Reconstruction of Manipulated Garment with Guided Deformation Prior

abstract: Modeling the shape of garments has received much attention, but most existing approaches assume the garments to be worn by someone, which constrains the range of shapes they can assume. In this work, we address shape recovery when garments are being manipulated instead of worn, which gives rise to an even larger range of possible shapes. To this end, we leverage the implicit sewing patterns (ISP) model for garment modeling and extend it by adding a diffusion-based deformation prior to represent these shapes. To recover 3D garment shapes from incomplete 3D point clouds acquired when the garment is folded, we map the points to UV space, in which our priors are learned, to produce partial UV maps, and then fit the priors to recover complete UV maps and 2D to 3D mappings. Experimental results demonstrate the superior reconstruction accuracy of our method compared to previous ones, especially when dealing with large non-rigid deformations arising from the manipulations.


title: Nonperturbative correlation functions from homotopy algebras

abstract: The formula for correlation functions based on quantum $A_\infty$ algebras in arXiv:2203.05366, arXiv:2305.11634, and arXiv:2305.13103 requires dividing the action into the free part and the interaction part. We present a new form of the formula which does not involve such division. The new formula requires choosing a solution to the equations of motion which does not have to be real, and we claim that the formula gives correlation functions evaluated on the Lefschetz thimble associated with the solution we chose. Our formula correctly reproduces correlation functions in perturbation theory, but it can be valid nonperturbatively, and we present numerical evidence for scalar field theories in zero dimensions both in the Euclidean case and the Lorentzian case that correlation functions for finite coupling constants can be reproduced. When the theory consists of a single Lefschetz thimble, our formula gives correlation functions of the theory by choosing the solution corresponding to the thimble. When the theory consists of multiple Lefschetz thimbles, we need to evaluate the ratios of the partition functions for those thimbles and we describe a method of such evaluations based on quantum $A_\infty$ algebras in a forthcoming paper.


title: A Survey on Large Language Models with Multilingualism: Recent Advances and New Frontiers

abstract: The rapid development of Large Language Models (LLMs) demonstrates remarkable multilingual capabilities in natural language processing, attracting global attention in both academia and industry. To mitigate potential discrimination and enhance the overall usability and accessibility for diverse language user groups, it is important for the development of language-fair technology. Despite the breakthroughs of LLMs, the investigation into the multilingual scenario remains insufficient, where a comprehensive survey to summarize recent approaches, developments, limitations, and potential solutions is desirable. To this end, we provide a survey with multiple perspectives on the utilization of LLMs in the multilingual scenario. We first rethink the transitions between previous and current research on pre-trained language models. Then we introduce several perspectives on the multilingualism of LLMs, including training and inference methods, model security, multi-domain with language culture, and usage of datasets. We also discuss the major challenges that arise in these aspects, along with possible solutions. Besides, we highlight future research directions that aim at further enhancing LLMs with multilingualism. The survey aims to help the research community address multilingual problems and provide a comprehensive understanding of the core concepts, key techniques, and latest developments in multilingual natural language processing based on LLMs.


title: Gravitational waves from low-scale cosmic strings

abstract: Cosmic strings are a common prediction in many grand unified theories and a promising source of stochastic gravitational waves (GWs) from the early Universe. In this paper, we point out that the GW signal from cosmic strings produced at a comparatively low energy scale, $v \lesssim 10^9 \textrm{GeV}$, exhibits several novel features that are not present in the case of high-scale cosmic strings. Our findings notably include (i) a sharp cutoff frequency $f_{\rm cut}$ in the GW spectrum from the fundamental oscillation mode on closed string loops and (ii) an oscillating pattern in the total GW spectrum from all oscillation modes whose local minima are located at integer multiples of $f_{\rm cut}$. These features reflect the fact that string loops produced in the early Universe fail to shrink to zero size because of GW emission within the age of the Universe, if their tension is low enough. In addition, they offer an exciting opportunity to directly probe the discrete spectrum of oscillation modes on closed string loops in GW observations. For strings produced at a scale $v \sim 10^9\textrm{GeV}$, the novel features in the GW spectrum are within the sensitivity reach of future experiments such as BBO and DECIGO.


title: Observational Scaling Laws and the Predictability of Language Model Performance

abstract: Understanding how language model performance varies with scale is critical to benchmark and algorithm development. Scaling laws are one approach to building this understanding, but the requirement of training models across many different scales has limited their use. We propose an alternative, observational approach that bypasses model training and instead builds scaling laws from ~80 publically available models. Building a single scaling law from multiple model families is challenging due to large variations in their training compute efficiencies and capabilities. However, we show that these variations are consistent with a simple, generalized scaling law where language model performance is a function of a low-dimensional capability space, and model families only vary in their efficiency in converting training compute to capabilities. Using this approach, we show the surprising predictability of complex scaling phenomena: we show that several emergent phenomena follow a smooth, sigmoidal behavior and are predictable from small models; we show that the agent performance of models such as GPT-4 can be precisely predicted from simpler non-agentic benchmarks; and we show how to predict the impact of post-training interventions like Chain-of-Thought and Self-Consistency as language model capabilities continue to improve.


title: DINO as a von Mises-Fisher mixture model

abstract: Self-distillation methods using Siamese networks are popular for self-supervised pre-training. DINO is one such method based on a cross-entropy loss between $K$-dimensional probability vectors, obtained by applying a softmax function to the dot product between representations and learnt prototypes. Given the fact that the learned representations are $L^2$-normalized, we show that DINO and its derivatives, such as iBOT, can be interpreted as a mixture model of von Mises-Fisher components. With this interpretation, DINO assumes equal precision for all components when the prototypes are also $L^2$-normalized. Using this insight we propose DINO-vMF, that adds appropriate normalization constants when computing the cluster assignment probabilities. Unlike DINO, DINO-vMF is stable also for the larger ViT-Base model with unnormalized prototypes. We show that the added flexibility of the mixture model is beneficial in terms of better image representations. The DINO-vMF pre-trained model consistently performs better than DINO on a range of downstream tasks. We obtain similar improvements for iBOT-vMF vs iBOT and thereby show the relevance of our proposed modification also for other methods derived from DINO.


title: A hide-and-seek game: Looking for Population III stars during the Epoch of Reionization through the HeII$\lambda$1640 line

abstract: The gas surrounding first-generation (Pop III) stars is expected to emit a distinct signature in the form of the HeII recombination line at 1640~\AA (HeII$\lambda$1640). Here we explore the challenges and opportunities in identifying this elusive stellar population via the HeII$\lambda$1640 in $M_\star > 10^{7.5} ~ \mathrm{M_\odot}$ galaxies during the Epoch of Reionization (EoR, $z \simeq 6 - 10$), using JWST/NIRSpec. With this aim in mind, we combine cosmological dustyGadget simulations with analytical modeling of the intrinsic HeII emission. While tentative candidates with bright HeII emission like GN-z11 have been proposed in the literature, the prevalence of such bright systems remains unclear due to significant uncertainties involved in the prediction of the HeII luminosity. In fact, similar Pop III clumps might be almost two orders of magnitude fainter depending on the underlying Pop III model (e.g., with/without stellar mass loss and/or assuming different Pop III-formation efficiencies in star-forming clouds). Moreover, up to $\sim 90 \%$ of these clumps might be missed with NIRSpec/MOS due to the limited FoV, while this problem appears to be less severe with NIRSpec/IFU. We propose deep spectroscopy targeting potential peripheral Pop III clumps around bright, massive galaxies as a promising approach to achieve a clear detection of the first stars.


title: Variational Quantum Algorithm Landscape Reconstruction by Low-Rank Tensor Completion

abstract: Variational quantum algorithms (VQAs) are a broad class of algorithms with many applications in science and industry. Applying a VQA to a problem involves optimizing a parameterized quantum circuit by maximizing or minimizing a cost function. A particular challenge associated with VQAs is understanding the properties of associated cost functions. Having the landscapes of VQA cost functions can greatly assist in developing and testing new variational quantum algorithms, but they are extremely expensive to compute. Reconstructing the landscape of a VQA using existing techniques requires a large number of cost function evaluations, especially when the dimension or the resolution of the landscape is high. To address this challenge, we propose a low-rank tensor-completion-based approach for local landscape reconstruction. By leveraging compact low-rank representations of tensors, our technique can overcome the curse of dimensionality and handle high-resolution landscapes. We demonstrate the power of landscapes in VQA development by showcasing practical applications of analyzing penalty terms for constrained optimization problems and examining the probability landscapes of certain basis states.


title: Scalability enhancement of quantum computing under limited connectivity through distributed quantum computing

abstract: We employ quantum-volume random-circuit sampling to benchmark the two-QPU entanglement-assisted distributed quantum computing (DQC) and compare it with single-QPU quantum computing. We first specify a single-qubit depolarizing noise model in the random circuit. Based on this error model, we show the one-to-one correspondence of three figures of merits, namely average gate fidelity, heavy output probability, and linear cross-entropy. We derive an analytical approximation of the average gate fidelity under the specified noise model, which is shown to align with numerical simulations. The approximation is calculated based on a noise propagation matrix obtained from the extended connectivity graph of a DQC device. In numerical simulation, we unveil the scalability enhancement in DQC for the QPUs with limited connectivity. Furthermore, we provide a simple formula to estimate the average gate fidelity, which also provides us with a heuristic method to evaluate the scalability enhancement in DQC, and a guide to optimize the structure of a DQC configuration.


title: Efficient photon-pair generation in layer-poled lithium niobate nanophotonic waveguides

abstract: Integrated photon-pair sources are crucial for scalable photonic quantum systems. Thin-film lithium niobate is a promising platform for on-chip photon-pair generation through spontaneous parametric down-conversion (SPDC). However, the device implementation faces practical challenges. Periodically poled lithium niobate (PPLN), despite enabling flexible quasi-phase matching, suffers from poor fabrication reliability and device repeatability, while conventional modal phase matching (MPM) methods yield limited efficiencies due to inadequate mode overlaps. Here, we introduce a layer-poled lithium niobate (LPLN) nanophotonic waveguide for efficient photon-pair generation. It leverages layer-wise polarity inversion through electrical poling to break spatial symmetry and significantly enhance nonlinear interactions for MPM, achieving a notable normalized second-harmonic generation (SHG) conversion efficiency of 4615% W^{-1}cm^{-2}. Through a cascaded SHG and SPDC process, we demonstrate photon-pair generation with a normalized brightness of 3.1*10^6 Hz nm^{-1} mW^{-2} in a 3.3 mm long LPLN waveguide, surpassing existing on-chip sources under similar operating configurations. Crucially, our LPLN waveguides offer enhanced fabrication reliability and reduced sensitivity to geometric variations and temperature fluctuations compared to PPLN devices. We expect LPLN to become a promising solution for on-chip nonlinear wavelength conversion and non-classical light generation, with immediate applications in quantum communication, networking, and on-chip photonic quantum information processing.


title: Probabilistic transfer learning methodology to expedite high fidelity simulation of reactive flows

abstract: Reduced order models based on the transport of a lower dimensional manifold representation of the thermochemical state, such as Principal Component (PC) transport and Machine Learning (ML) techniques, have been developed to reduce the computational cost associated with the Direct Numerical Simulations (DNS) of reactive flows. Both PC transport and ML normally require an abundance of data to exhibit sufficient predictive accuracy, which might not be available due to the prohibitive cost of DNS or experimental data acquisition. To alleviate such difficulties, similar data from an existing dataset or domain (source domain) can be used to train ML models, potentially resulting in adequate predictions in the domain of interest (target domain). This study presents a novel probabilistic transfer learning (TL) framework to enhance the trust in ML models in correctly predicting the thermochemical state in a lower dimensional manifold and a sparse data setting. The framework uses Bayesian neural networks, and autoencoders, to reduce the dimensionality of the state space and diffuse the knowledge from the source to the target domain. The new framework is applied to one-dimensional freely-propagating flame solutions under different data sparsity scenarios. The results reveal that there is an optimal amount of knowledge to be transferred, which depends on the amount of data available in the target domain and the similarity between the domains. TL can reduce the reconstruction error by one order of magnitude for cases with large sparsity. The new framework required 10 times less data for the target domain to reproduce the same error as in the abundant data scenario. Furthermore, comparisons with a state-of-the-art deterministic TL strategy show that the probabilistic method can require four times less data to achieve the same reconstruction error.


title: Distribution functions for the modelling of accretion remnants in Milky Way-like galaxies: insights from IllustrisTNG

abstract: We study accretion remnants around Milky Way analogs in the IllustrisTNG simulations to determine how well commonly used distribution functions (DFs) describe their phase-space distributions. We identify 30 Milky Way analogs and 116 remnants from mergers with stellar mass ratios greater than 1:20. Two-power density profiles, as well as rotating constant-anisotropy and Osipkov-Merritt DFs are fit to the remnants. We determine that the remnants are suitable for equilibrium modelling by assessing them in the context of the Jeans equation. Each of the models we consider are reasonably able to fit the stellar remnant energy and angular momentum distribution, as well as the magnitude and shape of velocity dispersion profiles. Case studies matched to two well-known merger remnants in the stellar halo-Gaia-Sausage/Enceladus (GS/E) and Sequoia-are explored in more depth. We find good evidence that remnants with high anisotropy $\beta$, such as GS/E, are better modelled with a superposition of two Osipkov-Merritt DFs than either a constant-anisotropy model or a single Osipkov-Merritt DF. We estimate an Osipkov-Merritt profile with scale radius between 2-4 kpc would be a good first-order representation of GS/E, and comment on existing observational evidence for this as well as studies which could demonstrate it. Overall, we find that DF-based models work well for describing the kinematics of large merger remnants. Our results will be an important reference for future studies which seek to constrain both the spatial and kinematic properties of merger remnants in the Milky Way stellar halo.


title: Application of Tensorized Neural Networks for Cloud Classification

abstract: Convolutional neural networks (CNNs) have gained widespread usage across various fields such as weather forecasting, computer vision, autonomous driving, and medical image analysis due to its exceptional ability to extract spatial information, share parameters, and learn local features. However, the practical implementation and commercialization of CNNs in these domains are hindered by challenges related to model sizes, overfitting, and computational time. To address these limitations, our study proposes a groundbreaking approach that involves tensorizing the dense layers in the CNN to reduce model size and computational time. Additionally, we incorporate attention layers into the CNN and train it using Contrastive self-supervised learning to effectively classify cloud information, which is crucial for accurate weather forecasting. We elucidate the key characteristics of tensorized neural network (TNN), including the data compression rate, accuracy, and computational speed. The results indicate how TNN change their properties under the batch size setting.


title: Depth-aware Panoptic Segmentation

abstract: Panoptic segmentation unifies semantic and instance segmentation and thus delivers a semantic class label and, for so-called thing classes, also an instance label per pixel. The differentiation of distinct objects of the same class with a similar appearance is particularly challenging and frequently causes such objects to be incorrectly assigned to a single instance. In the present work, we demonstrate that information on the 3D geometry of the observed scene can be used to mitigate this issue: We present a novel CNN-based method for panoptic segmentation which processes RGB images and depth maps given as input in separate network branches and fuses the resulting feature maps in a late fusion manner. Moreover, we propose a new depth-aware dice loss term which penalises the assignment of pixels to the same thing instance based on the difference between their associated distances to the camera. Experiments carried out on the Cityscapes dataset show that the proposed method reduces the number of objects that are erroneously merged into one thing instance and outperforms the method used as basis by 2.2% in terms of panoptic quality.


title: Surgical-LVLM: Learning to Adapt Large Vision-Language Model for Grounded Visual Question Answering in Robotic Surgery

abstract: Recent advancements in Surgical Visual Question Answering (Surgical-VQA) and related region grounding have shown great promise for robotic and medical applications, addressing the critical need for automated methods in personalized surgical mentorship. However, existing models primarily provide simple structured answers and struggle with complex scenarios due to their limited capability in recognizing long-range dependencies and aligning multimodal information. In this paper, we introduce Surgical-LVLM, a novel personalized large vision-language model tailored for complex surgical scenarios. Leveraging the pre-trained large vision-language model and specialized Visual Perception LoRA (VP-LoRA) blocks, our model excels in understanding complex visual-language tasks within surgical contexts. In addressing the visual grounding task, we propose the Token-Interaction (TIT) module, which strengthens the interaction between the grounding module and the language responses of the Large Visual Language Model (LVLM) after projecting them into the latent space. We demonstrate the effectiveness of Surgical-LVLM on several benchmarks, including EndoVis-17-VQLA, EndoVis-18-VQLA, and a newly introduced EndoVis Conversations dataset, which sets new performance standards. Our work contributes to advancing the field of automated surgical mentorship by providing a context-aware solution.


title: Global License Plate Dataset

abstract: In the pursuit of advancing the state-of-the-art (SOTA) in road safety, traffic monitoring, surveillance, and logistics automation, we introduce the Global License Plate Dataset (GLPD). The dataset consists of over 5 million images, including diverse samples captured from 74 countries with meticulous annotations, including license plate characters, license plate segmentation masks, license plate corner vertices, as well as vehicle make, colour, and model. We also include annotated data on more classes, such as pedestrians, vehicles, roads, etc. We include a statistical analysis of the dataset, and provide baseline efficient and accurate models. The GLPD aims to be the primary benchmark dataset for model development and finetuning for license plate recognition.


title: Classification of colorectal primer carcinoma from normal colon with mid-infrared spectra

abstract: In this project, we used formalin-fixed paraffin-embedded (FFPE) tissue samples to measure thousands of spectra per tissue core with Fourier transform mid-infrared spectroscopy using an FT-IR imaging system. These cores varied between normal colon (NC) and colorectal primer carcinoma (CRC) tissues. We created a database to manage all the multivariate data obtained from the measurements. Then, we applied classifier algorithms to identify the tissue based on its yielded spectra. For classification, we used the random forest, a support vector machine, XGBoost, and linear discriminant analysis methods, as well as three deep neural networks. We compared two data manipulation techniques using these models and then applied filtering. In the end, we compared model performances via the sum of ranking differences (SRD).


title: Block Selective Reprogramming for On-device Training of Vision Transformers

abstract: The ubiquity of vision transformers (ViTs) for various edge applications, including personalized learning, has created the demand for on-device fine-tuning. However, training with the limited memory and computation power of edge devices remains a significant challenge. In particular, the memory required for training is much higher than that needed for inference, primarily due to the need to store activations across all layers in order to compute the gradients needed for weight updates. Previous works have explored reducing this memory requirement via frozen-weight training as well storing the activations in a compressed format. However, these methods are deemed inefficient due to their inability to provide training or inference speedup. In this paper, we first investigate the limitations of existing on-device training methods aimed at reducing memory and compute requirements. We then present block selective reprogramming (BSR) in which we fine-tune only a fraction of total blocks of a pre-trained model and selectively drop tokens based on self-attention scores of the frozen layers. To show the efficacy of BSR, we present extensive evaluations on ViT-B and DeiT-S with five different datasets. Compared to the existing alternatives, our approach simultaneously reduces training memory by up to 1.4x and compute cost by up to 2x while maintaining similar accuracy. We also showcase results for Mixture-of-Expert (MoE) models, demonstrating the effectiveness of our approach in multitask learning scenarios.


title: VICAN: Very Efficient Calibration Algorithm for Large Camera Networks

abstract: The precise estimation of camera poses within large camera networks is a foundational problem in computer vision and robotics, with broad applications spanning autonomous navigation, surveillance, and augmented reality. In this paper, we introduce a novel methodology that extends state-of-the-art Pose Graph Optimization (PGO) techniques. Departing from the conventional PGO paradigm, which primarily relies on camera-camera edges, our approach centers on the introduction of a dynamic element - any rigid object free to move in the scene - whose pose can be reliably inferred from a single image. Specifically, we consider the bipartite graph encompassing cameras, object poses evolving dynamically, and camera-object relative transformations at each time step. This shift not only offers a solution to the challenges encountered in directly estimating relative poses between cameras, particularly in adverse environments, but also leverages the inclusion of numerous object poses to ameliorate and integrate errors, resulting in accurate camera pose estimates. Though our framework retains compatibility with traditional PGO solvers, its efficacy benefits from a custom-tailored optimization scheme. To this end, we introduce an iterative primal-dual algorithm, capable of handling large graphs. Empirical benchmarks, conducted on a new dataset of simulated indoor environments, substantiate the efficacy and efficiency of our approach.


title: Legible Label Layout for Data Visualization, Algorithm and Integration into Vega-Lite

abstract: Legible labels should not overlap with other labels and other marks in a chart. When a chart contains a large number of data points, manually positioning these labels for each data point in the chart is a tedious task. A labeling algorithm is necessary to automatically layout the labels for a chart with a large number of data points. The state-of-the-art labeling algorithm detects overlaps using a set of points to approximate each mark's shape. This approach is inefficient for large marks or many marks as it requires too many points to detect overlaps. In response, we present a bitmap-based label placement algorithm, which leverages an occupancy bitmap to accelerate overlap detection. To create an occupancy bitmap, we rasterize marks onto a bitmap based on the area they occupy in the chart. With the bitmap, we can efficiently place labels without overlapping existing marks, regardless of the number and geometric complexity of the marks. This bitmap-based algorithm offers significant performance improvements over the state-of-the-art approach while placing a similar number of labels. We also integrate this algorithm into Vega-Lite as one of its encoding channels, label encoding. Label encoding allows users to encode fields in each data point with a text label to annotate the mark that represents the data point in a chart.


title: Multimodal CLIP Inference for Meta-Few-Shot Image Classification

abstract: In recent literature, few-shot classification has predominantly been defined by the N-way k-shot meta-learning problem. Models designed for this purpose are usually trained to excel on standard benchmarks following a restricted setup, excluding the use of external data. Given the recent advancements in large language and vision models, a question naturally arises: can these models directly perform well on meta-few-shot learning benchmarks? Multimodal foundation models like CLIP, which learn a joint (image, text) embedding, are of particular interest. Indeed, multimodal training has proven to enhance model robustness, especially regarding ambiguities, a limitation frequently observed in the few-shot setup. This study demonstrates that combining modalities from CLIP's text and image encoders outperforms state-of-the-art meta-few-shot learners on widely adopted benchmarks, all without additional training. Our results confirm the potential and robustness of multimodal foundation models like CLIP and serve as a baseline for existing and future approaches leveraging such models.


title: Arbitrage equilibrium and the emergence of universal microstructure in deep neural networks

abstract: Despite the stunning progress recently in large-scale deep neural network applications, our understanding of their microstructure, 'energy' functions, and optimal design remains incomplete. Here, we present a new game-theoretic framework, called statistical teleodynamics, that reveals important insights into these key properties. The optimally robust design of such networks inherently involves computational benefit-cost trade-offs that are not adequately captured by physics-inspired models. These trade-offs occur as neurons and connections compete to increase their effective utilities under resource constraints during training. In a fully trained network, this results in a state of arbitrage equilibrium, where all neurons in a given layer have the same effective utility, and all connections to a given layer have the same effective utility. The equilibrium is characterized by the emergence of two lognormal distributions of connection weights and neuronal output as the universal microstructure of large deep neural networks. We call such a network the Jaynes Machine. Our theoretical predictions are shown to be supported by empirical data from seven large-scale deep neural networks. We also show that the Hopfield network and the Boltzmann Machine are the same special case of the Jaynes Machine.


title: Building a Simplistic Automatic Extruder: Instrument Development Opportunities for the Laboratory

abstract: A well-rounded introduction to work in a STEM laboratory is vital to scientific education. Besides the ability to use available instrumentation for sample characterization, students should also be imparted knowledge in the steps of instrument development and construction. These concepts can be taught using the example of lipid vesicle preparation via extrusion. Vesicle extrusion is a common technique that involves syringes pushing solutions through membrane filters and is used in fundamental studies on vesicles. Such research is important to better understand of biological phenomena and drug development. Well prepared samples are key to successful research. While the manual approach is very useful to acquire experience, automatic extrusion is more convenient, and automation often results in better reproducibility. These advantages can be combined in a simplistic automatic extruder, that does not require advanced technical skills to be assembled. It can therefore be used by various groups, ranging undergraduate to graduate students using equipment typically available. Using this approach, students can acquire different skillsets including coding, testing, and advanced use of building materials based on their properties. Finally, the quality of the automatic extruder is verified.


title: Statistical Mechanics and Artificial Neural Networks: Principles, Models, and Applications

abstract: The field of neuroscience and the development of artificial neural networks (ANNs) have mutually influenced each other, drawing from and contributing to many concepts initially developed in statistical mechanics. Notably, Hopfield networks and Boltzmann machines are versions of the Ising model, a model extensively studied in statistical mechanics for over a century. In the first part of this chapter, we provide an overview of the principles, models, and applications of ANNs, highlighting their connections to statistical mechanics and statistical learning theory. Artificial neural networks can be seen as high-dimensional mathematical functions, and understanding the geometric properties of their loss landscapes (i.e., the high-dimensional space on which one wishes to find extrema or saddles) can provide valuable insights into their optimization behavior, generalization abilities, and overall performance. Visualizing these functions can help us design better optimization methods and improve their generalization abilities. Thus, the second part of this chapter focuses on quantifying geometric properties and visualizing loss functions associated with deep ANNs.

categories: cond-mat.dis-nn cond-mat.stat-mech cs.AI cs.LG


title: Physics of a granular pile

abstract: From the onset of the subject, granular media have been defying the toolkit of statistical mechanics thus preventing from understanding their thermodynamical and rheological properties and making them one of the key remaining mysteries in science. In the present work, we offer a resolution to this problem in the case of static granular media by considering a collective behavior of 2D identical balls forming a granular pile in the gravity field, which allows us to develop its thermodynamics and rheology from the first principles. Besides the uncertainty due to rough substrate on which the pile is built, we uncover another one due to ambiguities occurring in the positions of some interior balls. Both are responsible for the thermodynamic description of the granular pile, which proves to be anything but ordinary. In particular, we show that a pile is characterized by three temperatures: one is infinite, the other is negative, and the third is of higher-order. Also, considering the fields of ball displacements $\boldsymbol{\xi}$ and the normal force deviations $\delta\boldsymbol{N}$ from the ideal isosceles triangular structure of a regular pile reveals the hyperbolic nature of the $\boldsymbol{\xi}$-field and ability of the $\delta\boldsymbol{N}$-field to change the characteristic type from hyperbolic to elliptic. The latter property not only explains the origin of force chains and provides an adequate description of the rheology of static granular media, but turned out to be instrumental for understanding of granular media thermodynamics. Our model should provide a basis for further grasping of granular media properties, in general.


title: Foundation Models for Education: Promises and Prospects

abstract: With the advent of foundation models like ChatGPT, educators are excited about the transformative role that AI might play in propelling the next education revolution. The developing speed and the profound impact of foundation models in various industries force us to think deeply about the changes they will make to education, a domain that is critically important for the future of humans. In this paper, we discuss the strengths of foundation models, such as personalized learning, education inequality, and reasoning capabilities, as well as the development of agent architecture tailored for education, which integrates AI agents with pedagogical frameworks to create adaptive learning environments. Furthermore, we highlight the risks and opportunities of AI overreliance and creativity. Lastly, we envision a future where foundation models in education harmonize human and AI capabilities, fostering a dynamic, inclusive, and adaptive educational ecosystem.


title: Optimizing Surgical Plans for Parenchyma-Sparing Liver Resections through Contour-Guided Resection and Surface Approximation

abstract: Objective: This study introduces a novel method for defining virtual resections in liver cancer surgery, aimed at enhancing the adaptability of parenchyma-sparing resection (PSR) plans. By comparing these with traditional anatomical resection (AR) plans, we explore the potential for optimization in surgical planning. Methods: Leveraging contours and spline surface approximations directly from the liver's surface, our method aligns closely with actual surgical procedures, offering a more realistic representation of curved resection paths. This technique, tested against 14 cases from the OSLO-COMET study, incorporates surface deformation for versatile plan modeling, comparing volumetric outcomes of PSR and AR. Results: The study highlights significant benefits of PSR over AR, including reduced resected volume ($32.71 \pm 13.80$ ml for PSR vs. $249.53 \pm 135.23$ ml for AR, $p <0.0001$) and higher remnant liver volume ($1922.77 \pm 442.86$ ml for PSR vs. $1716.87 \pm 403.00$ ml for AR, $p <0.0001$). PSR also showed a considerably higher remnant percentage ($98.16 \pm 0.81%$) compared to AR ($87.40 \pm 6.49%$, $p <0.0001$). Conclusion: The proposed approach is able to define virtual resections accommodating a wide variety of resections (i.e., PSR and AR). Careful surgical planning using virtual resections can optimize the resection strategy. Significance: This study presents a novel computer-aided planning system for liver surgery, demonstrating its efficacy and flexibility for definition of virtual resections. Virtual surgery planning can be used for optimization of resection strategies leading to increased preservation of healthy tissue.