title: Emerging Technologies for 6G Non-Terrestrial-Networks: From Academia to Industrial Applications

abstract: Terrestrial networks form the fundamental infrastructure of modern communication systems, serving more than 4 billion users globally. However, terrestrial networks are facing a wide range of challenges, from coverage and reliability to interference and congestion. As the demands of the 6G era are expected to be much higher, it is crucial to address these challenges to ensure a robust and efficient communication infrastructure for the future. To address these problems, Non-terrestrial Network (NTN) has emerged to be a promising solution. NTNs are communication networks that leverage airborne (e.g., unmanned aerial vehicles) and spaceborne vehicles (e.g., satellites) to facilitate ultra-reliable communications and connectivity with high data rates and low latency over expansive regions. This article aims to provide a comprehensive survey on the utilization of network slicing, Artificial Intelligence/Machine Learning (AI/ML), and Open Radio Access Network (ORAN) to address diverse challenges of NTNs from the perspectives of both academia and industry. Particularly, we first provide an in-depth tutorial on NTN and the key enabling technologies including network slicing, AI/ML, and ORAN. Then, we provide a comprehensive survey on how network slicing and AI/ML have been leveraged to overcome the challenges that NTNs are facing. Moreover, we present how ORAN can be utilized for NTNs. Finally, we highlight important challenges, open issues, and future research directions of NTN in the 6G era.


title: Stable-Makeup: When Real-World Makeup Transfer Meets Diffusion Model

abstract: Current makeup transfer methods are limited to simple makeup styles, making them difficult to apply in real-world scenarios. In this paper, we introduce Stable-Makeup, a novel diffusion-based makeup transfer method capable of robustly transferring a wide range of real-world makeup, onto user-provided faces. Stable-Makeup is based on a pre-trained diffusion model and utilizes a Detail-Preserving (D-P) makeup encoder to encode makeup details. It also employs content and structural control modules to preserve the content and structural information of the source image. With the aid of our newly added makeup cross-attention layers in U-Net, we can accurately transfer the detailed makeup to the corresponding position in the source image. After content-structure decoupling training, Stable-Makeup can maintain content and the facial structure of the source image. Moreover, our method has demonstrated strong robustness and generalizability, making it applicable to varioustasks such as cross-domain makeup transfer, makeup-guided text-to-image generation and so on. Extensive experiments have demonstrated that our approach delivers state-of-the-art (SOTA) results among existing makeup transfer methods and exhibits a highly promising with broad potential applications in various related fields.


title: Configuration spaces of orbits and their $S_n$-equivariant $E$-polynomials

abstract: In this paper, we introduce the configuration space of orbits, a generalization of the configuration space of points but for algebraic varieties that are acted by an algebraic reductive group. We develop a novel method for computing the $S_n$-equivariant $E$-polynomial of an algebraic variety, and we apply it to this new kind of varieties.


title: Gapless superfluidity in neutron stars: Thermal properties

abstract: The interior of mature neutron stars is expected to contain superfluid neutrons and superconducting protons. The influence of temperature and currents on superfluid properties is studied within the self-consistent time-dependent nuclear energy-density functional theory. We find that this theory predicts the existence of a regime in which nucleons are superfluid (the order parameter remains finite) even though the energy spectrum of quasiparticle excitations exhibits no gap. We show that the disappearance of the gap leads to a specific heat that is not exponentially suppressed at low temperatures as in the BCS regime but can be comparable to that in the normal phase. Introducing some dimensionless effective superfluid velocity, we show that the behavior of the specific heat is essentially universal and we derive general approximate analytical formulas for applications to neutron-star cooling simulations.


title: Beyond the Labels: Unveiling Text-Dependency in Paralinguistic Speech Recognition Datasets

abstract: Paralinguistic traits like cognitive load and emotion are increasingly recognized as pivotal areas in speech recognition research, often examined through specialized datasets like CLSE and IEMOCAP. However, the integrity of these datasets is seldom scrutinized for text-dependency. This paper critically evaluates the prevalent assumption that machine learning models trained on such datasets genuinely learn to identify paralinguistic traits, rather than merely capturing lexical features. By examining the lexical overlap in these datasets and testing the performance of machine learning models, we expose significant text-dependency in trait-labeling. Our results suggest that some machine learning models, especially large pre-trained models like HuBERT, might inadvertently focus on lexical characteristics rather than the intended paralinguistic features. The study serves as a call to action for the research community to reevaluate the reliability of existing datasets and methodologies, ensuring that machine learning models genuinely learn what they are designed to recognize.


title: Higher Witt Groups for 2-Categories I: Centralizers

abstract: In this article, we investigate monoidal, braided, sylleptic centralizers of monoidal, braided, sylleptic 2-functors. We specifically focus on multifusion 2-categories and show that monoidal, braided, sylleptic centralizers are multifusion again, via studying the corresponding enveloping algebras. We provide a characterization of the non-degeneracy condition for monoidal, braided, and sylleptic fusion 2-categories, via vanishing of their centers. Applying Double Centralizer Theorems, we establish the relationship between monoidal, braided, symmetric local modules and free modules. In particular, we obtain factorization properties of non-degenerate monoidal, braided, and sylleptic fusion 2-categories. Main results in this article will be used to study higher Witt equivalences of non-degenerate monoidal, braided, sylleptic 2-categories in the sequential articles.


title: Transforming Competition into Collaboration: The Revolutionary Role of Multi-Agent Systems and Language Models in Modern Organizations

abstract: This article explores the dynamic influence of computational entities based on multi-agent systems theory (SMA) combined with large language models (LLM), which are characterized by their ability to simulate complex human interactions, as a possibility to revolutionize human user interaction from the use of specialized artificial agents to support everything from operational organizational processes to strategic decision making based on applied knowledge and human orchestration. Previous investigations reveal that there are limitations, particularly in the autonomous approach of artificial agents, especially when dealing with new challenges and pragmatic tasks such as inducing logical reasoning and problem solving. It is also considered that traditional techniques, such as the stimulation of chains of thoughts, require explicit human guidance. In our approach we employ agents developed from large language models (LLM), each with distinct prototyping that considers behavioral elements, driven by strategies that stimulate the generation of knowledge based on the use case proposed in the scenario (role-play) business, using a discussion approach between agents (guided conversation). We demonstrate the potential of developing agents useful for organizational strategies, based on multi-agent system theories (SMA) and innovative uses based on large language models (LLM based), offering a differentiated and adaptable experiment to different applications, complexities, domains, and capabilities from LLM.


title: PROSKILL: A formal skill language for acting in robotics

abstract: Acting is an important decisional function for autonomous robots. Acting relies on skills to implement and to model the activities it oversees: refinement, local recovery, temporal dispatching, external asynchronous events, and commands execution, all done online. While sitting between planning and the robotic platform, acting often relies on programming primitives and an interpreter which executes these skills. Following our experience in providing a formal framework to program the functional components of our robots, we propose a new language, to program the acting skills. This language maps unequivocally into a formal model which can then be used to check properties offline or execute the skills, or more precisely their formal equivalent, and perform runtime verification. We illustrate with a real example how we can program a survey mission for a drone in this new language, prove some formal properties on the program and directly execute the formal model on the drone to perform the mission.


title: A first principles study of the Stark shift effect on the zero-phonon line of the NV center in diamond

abstract: Point defects in semiconductors are attractive candidates for quantum information science applications owing to their ability to act as spin-photon interface or single-photon emitters. However, the coupling between the change of dipole moment upon electronic excitation and stray electric fields in the vicinity of the defect, an effect known as Stark shift, can cause significant spectral diffusion in the emitted photons. In this work, using first principles computations, we revisit the methodology to compute the Stark shift of point defects up to the second order. The approach consists of applying an electric field on a defect in a slab and monitoring the changes in the computed zero-phonon line (i.e., difference in energy between the ground and excited state) obtained from constraining the orbital occupations (constrained-DFT). We study the Stark shift of the negatively charged nitrogen-vacancy (NV) center in diamond using this slab approach. We discuss and compare two approaches to ensure a negatively charged defect in a slab and we show that converged values of the Stark shift measured by the change in dipole moment between the ground and excited states ($\Delta \mu$) can be obtained. We obtain a Stark shift of $\Delta \mu$=2.68D using the semi-local GGA-PBE functional and of $\Delta \mu$=2.23D using the HSE hybrid-functional. The results of the slab computations are significantly different than those obtained with Modern Theory of Polarization ($\Delta \mu$=4.34D for GGA-PBE) indicating a potential issue with the combination of constrained-DFT and Modern Theory of Polarization, at least in certain codes.


title: Privacy Guarantees in Posterior Sampling under Contamination

abstract: In recent years, differential privacy has been adopted by tech-companies and governmental agencies as the standard for measuring privacy in algorithms. We study the level of differential privacy in Bayesian posterior sampling setups. As opposed to the common privatization approach of injecting Laplace/Gaussian noise into the output, Huber's contamination model is considered, where we replace at random the data points with samples from a heavy-tailed distribution. We derived bounds for the differential privacy level $(\epsilon,\delta)$ for our approach while lifting the common restriction on assuming bounded observation and parameter space seen in the existing literature. We further consider the effect of sample size on privacy level and the convergence rate of $(\epsilon,\delta)$ to zero. Asymptotically, the contamination approach is fully private at no cost of information loss. We also provide some examples depicting inference models that our setup is applicable to with a theoretical estimation of convergence rate.


title: SemCity: Semantic Scene Generation with Triplane Diffusion

abstract: We present "SemCity," a 3D diffusion model for semantic scene generation in real-world outdoor environments. Most 3D diffusion models focus on generating a single object, synthetic indoor scenes, or synthetic outdoor scenes, while the generation of real-world outdoor scenes is rarely addressed. In this paper, we concentrate on generating a real-outdoor scene through learning a diffusion model on a real-world outdoor dataset. In contrast to synthetic data, real-outdoor datasets often contain more empty spaces due to sensor limitations, causing challenges in learning real-outdoor distributions. To address this issue, we exploit a triplane representation as a proxy form of scene distributions to be learned by our diffusion model. Furthermore, we propose a triplane manipulation that integrates seamlessly with our triplane diffusion model. The manipulation improves our diffusion model's applicability in a variety of downstream tasks related to outdoor scene generation such as scene inpainting, scene outpainting, and semantic scene completion refinements. In experimental results, we demonstrate that our triplane diffusion model shows meaningful generation results compared with existing work in a real-outdoor dataset, SemanticKITTI. We also show our triplane manipulation facilitates seamlessly adding, removing, or modifying objects within a scene. Further, it also enables the expansion of scenes toward a city-level scale. Finally, we evaluate our method on semantic scene completion refinements where our diffusion model enhances predictions of semantic scene completion networks by learning scene distribution. Our code is available at https://github.com/zoomin-lee/SemCity.


title: Superexchange Mechanism in Coupled Triangulenes Forming Spin-1 Chains

abstract: We show that the origin of the antiferromagnetic coupling in spin-1 triangulene chains, which were recently synthesized and measured by Mishra et al. Nature 598, 287-292 (2021) originates from a superexchange mechanism. This process, mediated by inter-triangulene states, opens the possibility to control parameters in the effective bilinear-biquadratic spin model. We start from the derivation of an effective tight-binding model for triangulene chains using a combination of tight-binding and Hartree-Fock methods fitted to hybrid density functional theory results. Next, correlation effects are investigated within the configuration interaction method. Our low-energy many-body spectrum for $N_{\rm Tr}=2$ and $N_{\rm Tr}=4$ triangulene chains agree well with the bilinear-biquadratic spin-1 chain antiferromagnetic model when indirect coupling processes, and superexchange coupling between triangulene spins are taken into account.


title: The probabilistic p-center problem: Planning service for potential customers

abstract: This work deals with the probabilistic p-center problem, which aims at minimizing the expected maximum distance between any site with demand and its center, considering that each site has demand with a specific probability. The problem is of interest when emergencies may occur at predefined sites with known probabilities. For this problem we propose and analyze different formulations as well as a Variable Neighborhood Search heuristic. Computational tests are reported, showing the potentials and limits of each formulation, the impact of their enhancements, and the effectiveness of the heuristic.


title: Towards a Stallings-type theorem for finite groups

abstract: A recent development in graph theory is to study local separators, vertex sets that need not separate graphs globally but just locally. We use this idea to conjecture an extension of Stallings' theorem to finite nilpotent groups. We provide an example demonstrating that the assumption of nilpotency is necessary, and prove a stronger form of this conjecture for low connectivities, as follows. A finite nilpotent group that has a Cayley graph with a local separator of size at most two is cyclic, dihedral or a direct product of a cyclic group with the group of order two.


title: Fragmentation of Dense Rotation-Dominated Structures Fed by Collapsing Gravomagneto-Sheetlets and Origin of Misaligned 100 au-Scale Binaries and Multiple Systems

abstract: The majority of stars are in binary/multiple systems. How such systems form in turbulent, magnetized cores of molecular clouds in the presence of non-ideal MHD effects remains relatively under-explored. Through ATHENA++-based non-ideal MHD AMR simulations with ambipolar diffusion, we show that the collapsing protostellar envelope is dominated by dense gravomagneto-sheetlets, a turbulence-warped version of the classic pseuodisk produced by anisotropic magnetic resistance to the gravitational collapse, in agreement with previous simulations of turbulent, magnetized single-star formation. The sheetlets feed mass, magnetic fields, and angular momentum to a Dense ROtation-Dominated (DROD) structure, which fragments into binary/multiple systems. This DROD fragmentation scenario is a more dynamic variant of the traditional disk fragmentation scenario for binary/multiple formation, with dense spiral filaments created by inhomogeneous feeding from the highly structured larger-scale sheetlets rather than the need for angular momentum transport, which is dominated by magnetic braking. Collisions between the dense spiraling filaments play a key role in pushing the local magnetic Toomre parameter $Q_\mathrm{m}$ below unity, leading to gravitational collapse and stellar companion formation provided that the local material is sufficiently demagnetized, with a plasma-$\beta$ of order unity or more. This mechanism can naturally produce {\it in situ} misaligned systems on the 100-au scale, often detected with high-resolution ALMA observations. Our simulations also highlight the importance of non-ideal MHD effects, which affect whether fragmentation occurs and, if so, the masses and orbital parameters of the stellar companions formed.


title: Joint Modeling of Longitudinal Measurements and Time-to-event Outcomes Using BUGS

abstract: The objective of this paper is to provide an introduction to the principles of Bayesian joint modeling of longitudinal measurements and time-to-event outcomes, as well as model implementation using the BUGS language syntax. This syntax can be executed directly using OpenBUGS or by utilizing convenient functions to invoke OpenBUGS and JAGS from R software. In this paper, all details of joint models are provided, ranging from simple to more advanced models. The presentation started with the joint modeling of a Gaussian longitudinal marker and time-to-event outcome. The implementation of the Bayesian paradigm of the model is reviewed. The strategies for simulating data from the JM are also discussed. A proportional hazard model with various forms of baseline hazards, along with the discussion of all possible association structures between the two sub-models are taken into consideration. The paper covers joint models with multivariate longitudinal measurements, zero-inflated longitudinal measurements, competing risks, and time-to-event with cure fraction. The models are illustrated by the analyses of several real data sets. All simulated and real data and code are available at \url{https://github.com/tbaghfalaki/JM-with-BUGS-and-JAGS}.


title: A boundary integral based particle initialization algorithm for Smooth Particle Hydrodynamics

abstract: Algorithms for initializing particle distribution in SPH simulations of complex geometries have been proven essential for improving the accuracy of SPH simulations. However, no such algorithms exist for boundary integral SPH models, which can model complex geometries without needing virtual particle layers. This study introduces a Boundary Integral based Particle Initialization (BIPI) algorithm. It consists of a particle-shifting technique carefully designed to redistribute particles to fit the boundary by using the boundary integral formulation for particles adjacent to the boundary. The proposed BIPI algorithm gives special consideration to particles adjacent to the boundary to prevent artificial volume compression. It can automatically produce a "uniform" particle distribution with reduced and stabilized concentration gradient for domains with complex geometrical shapes. Finally, a number of examples are presented to demonstrate the effectiveness of the proposed algorithm.


title: FairRR: Pre-Processing for Group Fairness through Randomized Response

abstract: The increasing usage of machine learning models in consequential decision-making processes has spurred research into the fairness of these systems. While significant work has been done to study group fairness in the in-processing and post-processing setting, there has been little that theoretically connects these results to the pre-processing domain. This paper proposes that achieving group fairness in downstream models can be formulated as finding the optimal design matrix in which to modify a response variable in a Randomized Response framework. We show that measures of group fairness can be directly controlled for with optimal model utility, proposing a pre-processing algorithm called FairRR that yields excellent downstream model utility and fairness.


title: Conservative Black Hole Scattering at Fifth Post-Minkowskian and First Self-Force Order

abstract: We compute the 5PM order contributions to the scattering angle and impulse of classical black hole scattering in the conservative sector at first self-force order (1SF) using the worldline quantum field theory formalism. This challenging four-loop computation required the use of advanced integration-by-parts and differential equation technology implemented on high-performance computing systems. Use of partial fraction identities allowed us to render the complete integrand in a fully planar form. The resulting function space is simpler than expected: in the scattering angle we see only multiple polylogarithms up to weight three, and a total absence of the elliptic integrals that appeared at 4PM order. All checks on our result, both internal - cancellation of dimensional regularization poles, preservation of the on-shell condition - and external - matching the slow-velocity limit with the post-Newtonian (PN) literature up to 5PN order and matching the tail terms to the 4PM loss of energy - are passed.


title: Minimal Elements of the Causal Boundary with Applications to Spacetime Splitting

abstract: In 1972, Geroch, Kronheimer, and Penrose introduced what is now called the causal boundary of a spacetime. This boundary is constructed out of Terminal Indecomposable Past sets (TIPs) and their future analogues (TIFs), which are the pasts and futures of inextendible causal curves. The causal boundary is a key tool to understand the global structure of a spacetime. In this paper, we show that in a spacetime with compact Cauchy surfaces, there is always at least one minimal TIP and one minimal TIF, minimal meaning that it does not contain another TIP (resp.\ TIF) as a proper subset. We then study the implications of the minimal TIP and TIF meeting each other. This condition generalizes some of the "no observer horizon" conditions that have been used in the literature to obtain partial solutions of the Bartnik splitting conjecture. We also show that such a no observer horizons condition is satisfied when the spacetime has a (possibly discrete) timelike conformal symmetry, generalizing a result of Costa e Silva, Flores, and Herrera about conformal Killing vector fields.


title: QCD Equation of State at nonzero baryon density in external magnetic field

abstract: This paper is devoted to the study of QCD equation of state in external magnetic field and nonzero baryon density. Our study is carried out by means of lattice simulation with 2+1 dynamical staggered quarks at the physical masses. The simulation is conducted at imaginary baryon chemical potential what allowed us to overcome the sign problem. We expand the pressure in the baryon imaginary chemical potential and study three leading nonzero coefficients in this expansion. These coefficients were calculated for the following values of magnetic field: $eB=0.3$, $0.6$, $1.2$ GeV$^2$ with the lattice sizes $8\times32^3$, $10\times40^3$, $12\times48^3$. Using these data we take continuum limit for the coefficients. Our results indicate considerable enhancement of the expansion coefficients by the magnetic field.


title: Finite time BV blowup for Liu-admissible solutions to $p$-system via computer-assisted proof

abstract: In this paper, we consider finite time blowup of the $BV$-norm for exact solutions to genuinely nonlinear hyperbolic systems in one space dimension, in particular the $p$-system. We consider solutions verifying shock admissibility criteria such as the Lax E-condition and the Liu E-condition. In particular, we present Riemann initial data which admits infinitely many bounded solutions, each of which experience, not just finite time, but in fact instantaneous blowup of the $BV$ norm. The Riemann initial data is allowed to come from an open set in state space. Our method provably does not admit a strictly convex entropy. The main results in this article compare to Jenssen [SIAM J. Math. Anal., 31(4):894--908, 2000], who shows $BV$ blowup for bounded solutions, or alternatively, blowup in $L^\infty$, for an artificial $3\times 3$ system which is not genuinely nonlinear. Baiti-Jenssen [Discrete Contin. Dynam. Systems, 7(4):837--853, 2001] improves upon this Jenssen result and can consider a genuinely nonlinear system, but then the blowup is only in $L^\infty$ and they cannot construct bounded solutions which blowup in $BV$. Moreover, their system is non-physical and provably does not admit a global, strictly convex entropy. Our result also shows sharpness of the recent Bressan-De Lellis result [Arch. Ration. Mech. Anal., 247(6):Paper No. 106, 12, 2023] concerning well-posedness via the Liu E-condition. The proof of our theorem is computer-assisted, following the framework of Sz\'{e}kelyhidi [Arch. Ration. Mech. Anal., 172(1):133--152, 2004]. Our code is available on the GitHub.


title: Multi-period stochastic covering location problems: Modeling framework and solution approach

abstract: This paper introduces a very general discrete covering location model that accounts for uncertainty and time-dependent aspects. A MILP formulation is proposed for the problem. Afterwards, it is observed that most of the models existing in the literature related with covering location can be considered as particular cases of this formulation. In order to tackle large instances of this problem a Lagrangian relaxation based heuristic is developed. A computational study is addressed to check the potentials and limits of the formulation and some variants proposed for the problem, as well as to evaluate the heuristic. Finally, different measures to report the relevance of considering a multi-period stochastic setting are studied.


title: Generative deep learning-enabled ultra-large field-of-view lens-free imaging

abstract: Advancements in high-throughput biomedical applications necessitate real-time, large field-of-view (FOV) imaging capabilities. Conventional lens-free imaging (LFI) systems, while addressing the limitations of physical lenses, have been constrained by dynamic, hard-to-model optical fields, resulting in a limited one-shot FOV of approximately 20 $mm^2$. This restriction has been a major bottleneck in applications like live-cell imaging and automation of microfluidic systems for biomedical research. Here, we present a deep-learning(DL)-based imaging framework - GenLFI - leveraging generative artificial intelligence (AI) for holographic image reconstruction. We demonstrate that GenLFI can achieve a real-time FOV over 550 $mm^2$, surpassing the current LFI system by more than 20-fold, and even larger than the world's largest confocal microscope by 1.76 times. The resolution is at the sub-pixel level of 5.52 $\mu m$, without the need for a shifting light source. The unsupervised learning-based reconstruction does not require optical field modeling, making imaging dynamic 3D samples (e.g., droplet-based microfluidics and 3D cell models) in complex optical fields possible. This GenLFI framework unlocks the potential of LFI systems, offering a robust tool to tackle new frontiers in high-throughput biomedical applications such as drug discovery.


title: Transparent boundary condition and its effectively local approximation for the Schr\"{o}dinger equation on a rectangular computational domain

abstract: The transparent boundary condition for the free Schr\"{o}dinger equation on a rectangular computational domain requires implementation of an operator of the form $\sqrt{\partial_t-i\triangle_{\Gamma}}$ where $\triangle_{\Gamma}$ is the Laplace-Beltrami operator. It is known that this operator is nonlocal in time as well as space which poses a significant challenge in developing an efficient numerical method of solution. The computational complexity of the existing methods scale with the number of time-steps which can be attributed to the nonlocal nature of the boundary operator. In this work, we report an effectively local approximation for the boundary operator such that the resulting complexity remains independent of number of time-steps. At the heart of this algorithm is a Pad\'e approximant based rational approximation of certain fractional operators that handles corners of the domain adequately. For the spatial discretization, we use a Legendre-Galerkin spectral method with a new boundary adapted basis which ensures that the resulting linear system is banded. A compatible boundary-lifting procedure is also presented which accommodates the segments as well as the corners on the boundary. The proposed novel scheme can be implemented within the framework of any one-step time marching schemes. In particular, we demonstrate these ideas for two one-step methods, namely, the backward-differentiation formula of order 1 (BDF1) and the trapezoidal rule (TR). For the sake of comparison, we also present a convolution quadrature based scheme conforming to the one-step methods which is computationally expensive but serves as a golden standard. Finally, several numerical tests are presented to demonstrate the effectiveness of our novel method as well as to verify the order of convergence empirically.


title: DexCap: Scalable and Portable Mocap Data Collection System for Dexterous Manipulation

abstract: Imitation learning from human hand motion data presents a promising avenue for imbuing robots with human-like dexterity in real-world manipulation tasks. Despite this potential, substantial challenges persist, particularly with the portability of existing hand motion capture (mocap) systems and the difficulty of translating mocap data into effective control policies. To tackle these issues, we introduce DexCap, a portable hand motion capture system, alongside DexIL, a novel imitation algorithm for training dexterous robot skills directly from human hand mocap data. DexCap offers precise, occlusion-resistant tracking of wrist and finger motions based on SLAM and electromagnetic field together with 3D observations of the environment. Utilizing this rich dataset, DexIL employs inverse kinematics and point cloud-based imitation learning to replicate human actions with robot hands. Beyond learning from human motion, DexCap also offers an optional human-in-the-loop correction mechanism to refine and further improve robot performance. Through extensive evaluation across six dexterous manipulation tasks, our approach not only demonstrates superior performance but also showcases the system's capability to effectively learn from in-the-wild mocap data, paving the way for future data collection methods for dexterous manipulation. More details can be found at https://dex-cap.github.io


title: RobotCycle: Assessing Cycling Safety in Urban Environments

abstract: This paper introduces RobotCycle, a novel ongoing project that leverages Autonomous Vehicle (AV) research to investigate how road infrastructure influences cyclist behaviour and safety during real-world journeys. The project's requirements were defined in collaboration with key stakeholders, including city planners, cyclists, and policymakers, informing the design of risk and safety metrics and the data collection criteria. We propose a data-driven approach relying on a novel, rich dataset of diverse traffic scenes and scenarios captured using a custom-designed wearable sensing unit. By analysing road-user trajectories, we identify normal path deviations indicating potential risks or hazardous interactions related to infrastructure elements in the environment. Our analysis correlates driving profiles and trajectory patterns with local road segments, driving conditions, and road-user interactions to predict traffic behaviours and identify critical scenarios. Moreover, by leveraging advancements in AV research, the project generates detailed 3D High-Definition Maps (HD Maps), traffic flow patterns, and trajectory models to provide a comprehensive assessment and analysis of the behaviour of all traffic agents. These data can then inform the design of cyclist-friendly road infrastructure, ultimately enhancing road safety and cyclability. The project provides valuable insights for enhancing cyclist protection and advancing sustainable urban mobility.


title: RADES axion search results with a High-Temperature Superconducting cavity in an 11.7 T magnet

abstract: We describe the results of a haloscope axion search performed with an 11.7 T dipole magnet at CERN. The search used a custom-made radio-frequency cavity coated with high-temperature superconducting tape. A set of 27 h of data at a resonant frequency of around 8.84 GHz was analysed. In the range of axion mass 36.5676 $\mu$eV to 36.5699 $\mu$eV, corresponding to a width of 554 kHz, no signal excess hinting at an axion-like particle was found. Correspondingly, in this mass range, a limit on the axion to photon coupling-strength was set in the range between g$_{a\gamma}\gtrsim$ 6.2e-13 GeV$^{-1}$ and g$_{a\gamma}\gtrsim$ 1.54e-13 GeV$^{-1}$ with a 95% confidence level.


title: Stability of the Favorable Falkner-Skan Profiles for the Stationary Prandtl Equations

abstract: The (favorable) Falkner-Skan boundary layer profiles are a one parameter ($\beta \in [0,2]$) family of self-similar solutions to the stationary Prandtl system which describes the flow over a wedge with angle $\beta \frac{\pi}{2}$. The most famous member of this family is the endpoint Blasius profile, $\beta = 0$, which exhibits pressureless flow over a flat plate. In contrast, the $\beta > 0$ profiles are physically expected to exhibit a \textit{favorable pressure gradient}, a common adage in the physics literature. In this work, we prove quantitative scattering estimates as $x \rightarrow \infty$ which precisely captures the effect of this favorable gradient through the presence of new ``CK" (Cauchy-Kovalevskaya) terms that appear in a quasilinear energy cascade.


title: Search for new bosons with ytterbium isotope shifts

abstract: The Standard Model of particle physics describes the properties of elementary particles and their interactions remarkably well, but in particular does not account for dark matter. Isotope-shift spectroscopy is a sensitive probe of fifth forces and new particles that illuminate the dark matter sector. This method sets bounds on new bosons that couple neutrons and electrons with masses in the keV/c2 to MeV/c2 range. With increasing spectroscopic precision, such searches are limited by uncertainties of isotope masses and the understanding of nuclear structure. Here, we report on high-precision mass-ratio and isotope-shift measurements of the ytterbium isotopes $^{168,170,172,174,176}$Yb that exceed previous measurements by up to two orders of magnitude. From these measurements, we extract higher-order changes in the nuclear charge distribution along the Yb isotope chain and use these to benchmark novel ab initio calculations. Our measurements set new bounds on the existence of the proposed boson.


title: Optimal regularity for nonlocal elliptic equations and free boundary problems

abstract: In this article we establish for the first time the $C^s$ boundary regularity of solutions to nonlocal elliptic equations with kernels $K(y)\asymp |y|^{-n-2s}$. This was known to hold only when $K$ is homogeneous, and it is quite surprising that it holds for general inhomogeneous kernels, too. As an application of our results, we also establish the optimal $C^{1+s}$ regularity of solutions to obstacle problems for general nonlocal operators with kernels $K(y)\asymp |y|^{-n-2s}$. Again, this was only known when $K$ is homogeneous, and it solves a long-standing open question in the field. A new key idea is to construct a 1D solution as a minimizer of an appropriate nonlocal one-phase free boundary problem, for which we establish optimal $C^s$ regularity and non-degeneracy estimates.


title: SIT: Fine-tuning Large Language Models with Sequential Instructions

abstract: Despite the success of existing instruction-tuned models, we find that they usually struggle to respond to queries with multiple instructions. This impairs their performance in complex problems whose solution consists of multiple intermediate tasks. Thus, we contend that part of the fine-tuning data mixture should be sequential--containing a chain of interrelated tasks. We first approach sequential instruction tuning from a task-driven perspective, manually creating interpretable intermediate tasks for multilingual and visual question answering: namely "translate then predict" and "caption then answer". Next, we automate this process by turning instructions in existing datasets (e.g., Alpaca and FlanCoT) into diverse and complex sequential instructions, making our method general-purpose. Models that underwent our sequential instruction tuning show improved results in coding, maths, and open-ended generation. Moreover, we put forward a new benchmark named SeqEval to evaluate a model's ability to follow all the instructions in a sequence, which further corroborates the benefits of our fine-tuning method. We hope that our endeavours will open new research avenues on instruction tuning for complex tasks.


title: Fine-tuning Neural Network Quantum States

abstract: Recent progress in the design and optimization of Neural-Network Quantum States (NQS) have made them an effective method to investigate ground-state properties of quantum many-body systems. In contrast to the standard approach of training a separate NQS from scratch at every point of the phase diagram, we demonstrate that the optimization of a NQS at a highly expressive point of the phase diagram (i.e., close to a phase transition) yields interpretable features that can be reused to accurately describe a wide region across the transition. We demonstrate the feasibility of our approach on different systems in one and two dimensions by initially pretraining a NQS at a given point of the phase diagram, followed by fine-tuning only the output layer for all other points. Notably, the computational cost of the fine-tuning step is very low compared to the pretraining stage. We argue that the reduced cost of this paradigm has significant potential to advance the exploration of condensed matter systems using NQS, mirroring the success of fine-tuning in machine learning and natural language processing.


title: Second gadolinium loading to Super-Kamiokande

abstract: The first loading of gadolinium (Gd) into Super-Kamiokande in 2020 was successful, and the neutron capture efficiency on Gd reached 50\%. To further increase the Gd neutron capture efficiency to 75\%, 26.1 tons of $\rm Gd_2(\rm SO_4)_3\cdot \rm 8H_2O$ was additionally loaded into Super-Kamiokande (SK) from May 31 to July 4, 2022. As the amount of loaded $\rm Gd_2(\rm SO_4)_3\cdot \rm 8H_2O$ was doubled compared to the first loading, the capacity of the powder dissolving system was doubled. We also developed new batches of gadolinium sulfate with even further reduced radioactive impurities. In addition, a more efficient screening method was devised and implemented to evaluate these new batches of $\rm Gd_2(\rm SO_4)_3\cdot \rm 8H_2O$. Following the second loading, the Gd concentration in SK was measured to be $333.5\pm2.5$ ppm via an Atomic Absorption Spectrometer (AAS). From the mean neutron capture time constant of neutrons from an Am/Be calibration source, the Gd concentration was independently measured to be 332.7 $\pm$ 6.8(sys.) $\pm$ 1.1(stat.) ppm, consistent with the AAS result. Furthermore, during the loading the Gd concentration was monitored continually using the capture time constant of each spallation neutron produced by cosmic-ray muons,and the final neutron capture efficiency was shown to become 1.5 times higher than that of the first loaded phase, as expected.


title: Joint Selection: Adaptively Incorporating Public Information for Private Synthetic Data

abstract: Mechanisms for generating differentially private synthetic data based on marginals and graphical models have been successful in a wide range of settings. However, one limitation of these methods is their inability to incorporate public data. Initializing a data generating model by pre-training on public data has shown to improve the quality of synthetic data, but this technique is not applicable when model structure is not determined a priori. We develop the mechanism jam-pgm, which expands the adaptive measurements framework to jointly select between measuring public data and private data. This technique allows for public data to be included in a graphical-model-based mechanism. We show that jam-pgm is able to outperform both publicly assisted and non publicly assisted synthetic data generation mechanisms even when the public data distribution is biased.


title: A Fourier Transform Framework for Domain Adaptation

abstract: By using unsupervised domain adaptation (UDA), knowledge can be transferred from a label-rich source domain to a target domain that contains relevant information but lacks labels. Many existing UDA algorithms suffer from directly using raw images as input, resulting in models that overly focus on redundant information and exhibit poor generalization capability. To address this issue, we attempt to improve the performance of unsupervised domain adaptation by employing the Fourier method (FTF).Specifically, FTF is inspired by the amplitude of Fourier spectra, which primarily preserves low-level statistical information. In FTF, we effectively incorporate low-level information from the target domain into the source domain by fusing the amplitudes of both domains in the Fourier domain. Additionally, we observe that extracting features from batches of images can eliminate redundant information while retaining class-specific features relevant to the task. Building upon this observation, we apply the Fourier Transform at the data stream level for the first time. To further align multiple sources of data, we introduce the concept of correlation alignment. To evaluate the effectiveness of our FTF method, we conducted evaluations on four benchmark datasets for domain adaptation, including Office-31, Office-Home, ImageCLEF-DA, and Office-Caltech. Our results demonstrate superior performance.


title: Equitable Pricing in Auctions

abstract: We study how pricing affects the division of surplus among buyers in auctions for multiple units. Our equity objective may be important, e.g., for competition concerns in downstream markets, complementing the long-standing debate on revenue and efficiency. We study a canonical model of auctions for multiple indivisible units with unit demand buyers and valuations with a private and a common component and consider all pricing rules that are a mixture (i.e., a convex combination) of pay-as-bid and uniform pricing. We propose the winners' empirical variance (WEV), the expected empirical variance of surplus among the winners, as a metric for surplus equity. We show that, for a range of private-common value proportions, a strictly interior mix of pay-as-bid and uniform pricing minimizes WEV. From an equity perspective, auctions with a higher private value component benefit from more price discrimination, whereas only auctions with a sufficiently high common value justify a more uniform pricing rule. We provide a criterion under which strictly mixed pricing dominates uniform pricing, a partial ranking of different mixed pricing formats, and bounds on the WEV-minimizing pricing under the assumption of log-concave signal distributions. In numerical experiments, we further illustrate the WEV-minimal pricing as a function of the private-common-value mix.


title: BraSyn 2023 challenge: Missing MRI synthesis and the effect of different learning objectives

abstract: This work addresses the Brain Magnetic Resonance Image Synthesis for Tumor Segmentation (BraSyn) challenge, which was hosted as part of the Brain Tumor Segmentation (BraTS) challenge in 2023. In this challenge, researchers are invited to synthesize a missing magnetic resonance image sequence, given other available sequences, to facilitate tumor segmentation pipelines trained on complete sets of image sequences. This problem can be tackled using deep learning within the framework of paired image-to-image translation. In this study, we propose investigating the effectiveness of a commonly used deep learning framework, such as Pix2Pix, trained under the supervision of different image-quality loss functions. Our results indicate that the use of different loss functions significantly affects the synthesis quality. We systematically study the impact of various loss functions in the multi-sequence MR image synthesis setting of the BraSyn challenge. Furthermore, we demonstrate how image synthesis performance can be optimized by combining different learning objectives beneficially.


title: The Importance of Optical Wavelength Data on Atmospheric Retrievals of Exoplanet Transmission Spectra

abstract: Exoplanet transmission spectra provide rich information about the chemical composition, clouds and temperature structure of exoplanet atmospheres. Most exoplanet transmission spectra only span infrared wavelengths ($\gtrsim$ 1 $\rm{\mu m}$), which can preclude crucial atmospheric information from shorter wavelengths. Here, we explore how retrieved atmospheric parameters from exoplanet transmission spectra change with the addition of optical data. From a sample of 14 giant planets with transit spectra from 0.3-4.5 $\rm{\mu m}$, primarily from the Hubble and Spitzer space telescopes, we apply a free chemistry retrieval to planetary spectra for wavelength ranges of 0.3-4.5 $\rm{\mu m}$, 0.6-4.5 $\rm{\mu m}$, and 1.1-4.5 $\rm{\mu m}$. We analyse the posterior distributions of these retrievals and perform an information content analysis, finding wavelengths below 0.6 $\rm{\mu m}$ are necessary to constrain cloud scattering slope parameters ($\log{a}$ and $\gamma$) and alkali species Na and K. There is limited improvement in the constraints on the remaining atmospheric parameters. Across the population, we find limb temperatures are retrieved colder than planetary equilibrium temperatures but have an overall good agreement with Global Circulation Models. As JWST extends to a minimum wavelength of 0.6 $\rm{\mu m}$, we demonstrate that exploration into complementing JWST observations with optical HST data is important to further our understanding of aerosol properties and alkali abundances in exoplanet atmospheres.


title: Boosting keyword spotting through on-device learnable user speech characteristics

abstract: Keyword spotting systems for always-on TinyML-constrained applications require on-site tuning to boost the accuracy of offline trained classifiers when deployed in unseen inference conditions. Adapting to the speech peculiarities of target users requires many in-domain samples, often unavailable in real-world scenarios. Furthermore, current on-device learning techniques rely on computationally intensive and memory-hungry backbone update schemes, unfit for always-on, battery-powered devices. In this work, we propose a novel on-device learning architecture, composed of a pretrained backbone and a user-aware embedding learning the user's speech characteristics. The so-generated features are fused and used to classify the input utterance. For domain shifts generated by unseen speakers, we measure error rate reductions of up to 19% from 30.1% to 24.3% based on the 35-class problem of the Google Speech Commands dataset, through the inexpensive update of the user projections. We moreover demonstrate the few-shot learning capabilities of our proposed architecture in sample- and class-scarce learning conditions. With 23.7 kparameters and 1 MFLOP per epoch required for on-device training, our system is feasible for TinyML applications aimed at battery-powered microcontrollers.


title: Variational structures for the Fokker--Planck equation with general Dirichlet boundary conditions

abstract: We prove the convergence of a modified Jordan--Kinderlehrer--Otto scheme to a solution to the Fokker--Planck equation in $\Omega \Subset \mathbb{R}^d$ with general, positive and temporally constant, Dirichlet boundary conditions. We work under mild assumptions on the domain, the drift, and the initial datum. In the special case where $\Omega$ is an interval in $\mathbb{R}^1$, we prove that such a solution is a gradient flow -- curve of maximal slope -- within a suitable space of measures, endowed with a modified Wasserstein distance. Our discrete scheme and modified distance draw inspiration from contributions by A. Figalli and N. Gigli [J. Math. Pures Appl. 94, (2010), pp. 107--130], and J. Morales [J. Math. Pures Appl. 112, (2018), pp. 41--88] on an optimal-transport approach to evolution equations with Dirichlet boundary conditions. Similarly to these works, we allow the mass to flow from/to the boundary $\partial \Omega$ throughout the evolution. However, our leading idea is to also keep track of the mass at the boundary by working with measures defined on the whole closure $\overline \Omega$. The driving functional is a modification of the classical relative entropy that also makes use of the information at the boundary. As an intermediate result, when $\Omega$ is an interval in $\mathbb{R}^1$, we find a formula for the descending slope of this geodesically nonconvex functional.


title: Type IV-like Solar Radio Burst Consisting of a Series of Spikes Observed by PSP

abstract: Solar and interplanetary radio bursts can reflect the existence and motion of energetic electrons and are therefore a kind of vital phenomenon in solar activities. The present study reported a solar radio burst (SRB) event observed by Parker Solar Probe (PSP) in its 8th orbital encounter phase, and it lasted about 20 hours in a frequency range of 0.5-15 MHz, called the type IV-like SRB. This type IV-like SRB consists of a series of numerous spikes with the center-frequency drifting slowly from ~5 MHz to ~1 MHz, and each individual spike appears a much faster frequency drifting and has a narrow frequency range of a few MHz and short duration of a few minutes. Based on the empirical models of the solar atmosphere adopted commonly, combining the in-situ measurement by PSP, we propose that these small-scale spikes were generated by a group of solitary kinetic Alfv\'en waves (SKAWs) in a magnetic loop accompanying coronal mass ejection (CME) and moving outwards, in which the frequency drifting of individual spike is caused by the SKAW's propagation and the center-frequency drifting may be attributed to the motion of the magnetic loop.


title: Beyond Memorization: The Challenge of Random Memory Access in Language Models

abstract: Recent developments in Language Models (LMs) have shown their effectiveness in NLP tasks, particularly in knowledge-intensive tasks. However, the mechanisms underlying knowledge storage and memory access within their parameters remain elusive. In this paper, we investigate whether a generative LM (e.g., GPT-2) is able to access its memory sequentially or randomly. Through carefully-designed synthetic tasks, covering the scenarios of full recitation, selective recitation and grounded question answering, we reveal that LMs manage to sequentially access their memory while encountering challenges in randomly accessing memorized content. We find that techniques including recitation and permutation improve the random memory access capability of LMs. Furthermore, by applying this intervention to realistic scenarios of open-domain question answering, we validate that enhancing random access by recitation leads to notable improvements in question answering. The code to reproduce our experiments can be found at https://github.com/sail-sg/lm-random-memory-access.


title: A Stochastic GDA Method With Backtracking For Solving Nonconvex (Strongly) Concave Minimax Problems

abstract: We propose a stochastic GDA (gradient descent ascent) method with backtracking (SGDA-B) to solve nonconvex-(strongly) concave (NCC) minimax problems $\min_x \max_y \sum_{i=1}^N g_i(x_i)+f(x,y)-h(y)$, where $h$ and $g_i$ for $i = 1, \ldots, N$ are closed, convex functions, $f$ is $L$-smooth and $\mu$-strongly concave in $y$ for some $\mu\geq 0$. We consider two scenarios: (i) the deterministic setting where we assume one can compute $\nabla f$ exactly, and (ii) the stochastic setting where we have only access to $\nabla f$ through an unbiased stochastic oracle with a finite variance. While most of the existing methods assume knowledge of the Lipschitz constant $L$, SGDA-B is agnostic to $L$. Moreover, SGDA-B can support random block-coordinate updates. In the deterministic setting, SGDA-B can compute an $\epsilon$-stationary point within $\mathcal{O}(L\kappa^2/\epsilon^2)$ and $\mathcal{O}(L^3/\epsilon^4)$ gradient calls when $\mu>0$ and $\mu=0$, respectively, where $\kappa=L/\mu$. In the stochastic setting, for any $p \in (0, 1)$ and $\epsilon >0$, it can compute an $\epsilon$-stationary point with high probability, which requires $\mathcal{O}(L\kappa^3\epsilon^{-4}\log(1/p))$ and $\tilde{\mathcal{O}}(L^4\epsilon^{-7}\log(1/p))$ stochastic oracle calls, with probability at least $1-p$, when $\mu>0$ and $\mu=0$, respectively. To our knowledge, SGDA-B is the first GDA-type method with backtracking to solve NCC minimax problems and achieves the best complexity among the methods that are agnostic to $L$. We also provide numerical results for SGDA-B on a distributionally robust learning problem illustrating the potential performance gains that can be achieved by SGDA-B.


title: StyleGaussian: Instant 3D Style Transfer with Gaussian Splatting

abstract: We introduce StyleGaussian, a novel 3D style transfer technique that allows instant transfer of any image's style to a 3D scene at 10 frames per second (fps). Leveraging 3D Gaussian Splatting (3DGS), StyleGaussian achieves style transfer without compromising its real-time rendering ability and multi-view consistency. It achieves instant style transfer with three steps: embedding, transfer, and decoding. Initially, 2D VGG scene features are embedded into reconstructed 3D Gaussians. Next, the embedded features are transformed according to a reference style image. Finally, the transformed features are decoded into the stylized RGB. StyleGaussian has two novel designs. The first is an efficient feature rendering strategy that first renders low-dimensional features and then maps them into high-dimensional features while embedding VGG features. It cuts the memory consumption significantly and enables 3DGS to render the high-dimensional memory-intensive features. The second is a K-nearest-neighbor-based 3D CNN. Working as the decoder for the stylized features, it eliminates the 2D CNN operations that compromise strict multi-view consistency. Extensive experiments show that StyleGaussian achieves instant 3D stylization with superior stylization quality while preserving real-time rendering and strict multi-view consistency. Project page: https://kunhao-liu.github.io/StyleGaussian/


title: Supporting Error Chains in Static Analysis for Precise Evaluation Results and Enhanced Usability

abstract: Context: Static analyses are well-established to aid in understanding bugs or vulnerabilities during the development process or in large-scale studies. A low false-positive rate is essential for the adaption in practice and for precise results of empirical studies. Unfortunately, static analyses tend to report where a vulnerability manifests rather than the fix location. This can cause presumed false positives or imprecise results. Method: To address this problem, we designed an adaption of an existing static analysis algorithm that can distinguish between a manifestation and fix location, and reports error chains. An error chain represents at least two interconnected errors that occur successively, thus building the connection between the fix and manifestation location. We used our tool CogniCryptSUBS for a case study on 471 GitHub repositories, a performance benchmark to compare different analysis configurations, and conducted an expert interview. Result: We found that 50 % of the projects with a report had at least one error chain. Our runtime benchmark demonstrated that our improvement caused only a minimal runtime overhead of less than 4 %. The results of our expert interview indicate that with our adapted version participants require fewer executions of the analysis. Conclusion: Our results indicate that error chains occur frequently in real-world projects, and ignoring them can lead to imprecise evaluation results. The runtime benchmark indicates that our tool is a feasible and efficient solution for detecting error chains in real-world projects. Further, our results gave a hint that the usability of static analyses may benefit from supporting error chains.


title: pyvene: A Library for Understanding and Improving PyTorch Models via Interventions

abstract: Interventions on model-internal states are fundamental operations in many areas of AI, including model editing, steering, robustness, and interpretability. To facilitate such research, we introduce $\textbf{pyvene}$, an open-source Python library that supports customizable interventions on a range of different PyTorch modules. $\textbf{pyvene}$ supports complex intervention schemes with an intuitive configuration format, and its interventions can be static or include trainable parameters. We show how $\textbf{pyvene}$ provides a unified and extensible framework for performing interventions on neural models and sharing the intervened upon models with others. We illustrate the power of the library via interpretability analyses using causal abstraction and knowledge localization. We publish our library through Python Package Index (PyPI) and provide code, documentation, and tutorials at https://github.com/stanfordnlp/pyvene.


title: A geometric model for the module category of a string algebra

abstract: In this paper, we give a geometric construction of string algebras and of their module categories. Our approach uses dissections of punctured Riemann surfaces with extra data at marked points, called labels. As an application, we give a classification of support tau-tilting modules in terms of arcs in such a tiled surface. In the case when the string algebra is gentle, we recover the classification given arXiv:2004.11136.


title: Mesh Refinement with Early Termination for Dynamic Feasibility Problems

abstract: We propose a novel early-terminating mesh refinement strategy using an integrated residual method to solve dynamic feasibility problems. As a generalization of direct collocation, the integrated residual method is used to approximate an infinite-dimensional problem into a sequence of finite-dimensional optimization subproblems. Each subproblem in the sequence is a finer approximation of the previous. It is shown that these subproblems need not be solved to a high precision; instead, an early termination procedure can determine when mesh refinement should be performed. The new refinement strategy, applied to an inverted pendulum swing-up problem, outperforms a conventional refinement method by up to a factor of three in function evaluations.


title: Probing quantum criticality in ferromagnetic CeRh6Ge4

abstract: CeRh$_6$Ge$_4$ is unusual in that its ferromagnetic transition can be suppressed continuously to zero temperature, i.e., to a ferromagnetic quantum-critical point (QCP), through the application of modest hydrostatic pressure. This discovery has raised the possibility that the ferromagnetic QCP may be of the Kondo-breakdown type characterized by a jump in Fermi volume, to which thermopower S measurements should be sensitive. Though $S/T$ changes both sign and magnitude around the critical pressure P$_{c}\approx{}0.8$ GPa, these changes are not abrupt but extend over a pressure interval from within the ferromagnetic state up to P$_c$. Together with temperature and pressure variations in electrical resistivity and previously reported heat capacity, thermopower results point to the near coincidence of two sequential effects near P$_c$, delocalization of 4f degrees-of-freedom through orbital-selective hybridization followed by quantum criticality of itinerant ferromagnetism.


title: Higher condensation theory

abstract: We develop a unified theory of defect condensations for topological orders in all dimensions based on higher categories, higher algebras and higher representations. We show that condensing a $k$-codimensional topological defect $A$ in an $n$+1D (potentially anomalous) topological order $\mathsf C^{n+1}$ amounts to a $k$-step process. In the first step, we condense $A$ along one of the transversal directions, thus obtaining a $(k-1)$-codimensional defect $\Sigma A$, which can be further condensed as the second step, so on and so forth. In the $k$-th step, condensing $\Sigma^{k-1}A$ along the only transversal direction defines a phase transition to a new phase $\mathsf D^{n+1}$. Mathematically, a $k$-codimensional defect $A$ is condensable if it is equipped with the structure of a condensable $E_k$-algebra. In this case, $\Sigma A$ is naturally a condensable $E_{k-1}$-algebra, thus it can be further condensed. The condensed phase $\mathsf D^{n+1}$ consists of all deconfined topological defects in $\mathsf C^{n+1}$. A $k$-codimensional topological defect is deconfined if and only if it is equipped with a $k$-dimensional $A$-action, which defines an $E_k$-module over $A$. When $\mathsf C^{n+1}$ is anomaly-free, the same condensation can be alternatively defined by replacing the last two steps by a single step of condensing the $E_2$-algebra $\Sigma^{k-2}A$ directly. The condensed phase $\mathsf D^{n+1}$ is determined by the category of $E_2$-modules over $\Sigma^{k-2}A$. When $n=2$, this modified last step is precisely a usual anyon condensation in a 2+1D topological order. The proofs of the most mathematical results will appear in a mathematical companion of this paper. We also briefly discuss some generalizations and applications that naturally arise from our condensation theory such as higher Morita theory, factorization homology and the condensation theory of non-topological defects.


title: Implications of tristability on localization phenomena: a necking bifurcation's tale

abstract: We analyze the implication of tristability on localization phenomena in one-dimensional extended dissipative systems. In this context, localized states appear due to the interaction and locking of front waves connecting different extended states. In the tristable regime investigated here two extended uniform states coexist with one periodic Turing pattern. This scenario leads to the transition from the standard-homoclinic-snaking-related localized states associated with uniform-pattern bistability to the collapsed-homoclinic-snaking-related states which arise in a uniform-bistable configuration. We find that this transition is mediated by the emergence of hybrid states through codimension-two necking bifurcations. To perform this study we use bifurcation analysis on a non-variational mean-field model describing the spatiotemporal dynamics of light pulses in passive Kerr cavities.


title: Chronos: Learning the Language of Time Series

abstract: We introduce Chronos, a simple yet effective framework for pretrained probabilistic time series models. Chronos tokenizes time series values using scaling and quantization into a fixed vocabulary and trains existing transformer-based language model architectures on these tokenized time series via the cross-entropy loss. We pretrained Chronos models based on the T5 family (ranging from 20M to 710M parameters) on a large collection of publicly available datasets, complemented by a synthetic dataset that we generated via Gaussian processes to improve generalization. In a comprehensive benchmark consisting of 42 datasets, and comprising both classical local models and deep learning methods, we show that Chronos models: (a) significantly outperform other methods on datasets that were part of the training corpus; and (b) have comparable and occasionally superior zero-shot performance on new datasets, relative to methods that were trained specifically on them. Our results demonstrate that Chronos models can leverage time series data from diverse domains to improve zero-shot accuracy on unseen forecasting tasks, positioning pretrained models as a viable tool to greatly simplify forecasting pipelines.


title: Branch-Train-MiX: Mixing Expert LLMs into a Mixture-of-Experts LLM

abstract: We investigate efficient methods for training Large Language Models (LLMs) to possess capabilities in multiple specialized domains, such as coding, math reasoning and world knowledge. Our method, named Branch-Train-MiX (BTX), starts from a seed model, which is branched to train experts in embarrassingly parallel fashion with high throughput and reduced communication cost. After individual experts are asynchronously trained, BTX brings together their feedforward parameters as experts in Mixture-of-Expert (MoE) layers and averages the remaining parameters, followed by an MoE-finetuning stage to learn token-level routing. BTX generalizes two special cases, the Branch-Train-Merge method, which does not have the MoE finetuning stage to learn routing, and sparse upcycling, which omits the stage of training experts asynchronously. Compared to alternative approaches, BTX achieves the best accuracy-efficiency tradeoff.


title: UniHand: Privacy-preserving Universal Handover for Small-Cell Networks in 5G-enabled Mobile Communication with KCI Resilience

abstract: Introducing Small Cell Networks (SCN) has significantly improved wireless link quality, spectrum efficiency and network capacity, which has been viewed as one of the key technologies in the fifth-generation (5G) mobile network. However, this technology increases the frequency of handover (HO) procedures caused by the dense deployment of cells in the network with reduced cell coverage, bringing new security and privacy issues. The current 5G-AKA and HO protocols are vulnerable to security weaknesses, such as the lack of forward secrecy and identity confusion attacks. The high HO frequency of HOs might magnify these security and privacy concerns in the 5G mobile network. This work addresses these issues by proposing a secure privacy-preserving universal HO scheme ($\UniHand$) for SCNs in 5G mobile communication. $\UniHand$ can achieve mutual authentication, strong anonymity, perfect forward secrecy, key-escrow-free and key compromise impersonation (KCI) resilience. To the best of our knowledge, this is the \textit{first} scheme to achieve secure, privacy-preserving universal HO with \textit{KCI} resilience for roaming users in 5G environment. We demonstrate that our proposed scheme is resilient against all the essential security threats by performing a comprehensive formal security analysis and conducting relevant experiments to show the cost-effectiveness of the proposed scheme.


title: Label Dropout: Improved Deep Learning Echocardiography Segmentation Using Multiple Datasets With Domain Shift and Partial Labelling

abstract: Echocardiography (echo) is the first imaging modality used when assessing cardiac function. The measurement of functional biomarkers from echo relies upon the segmentation of cardiac structures and deep learning models have been proposed to automate the segmentation process. However, in order to translate these tools to widespread clinical use it is important that the segmentation models are robust to a wide variety of images (e.g. acquired from different scanners, by operators with different levels of expertise etc.). To achieve this level of robustness it is necessary that the models are trained with multiple diverse datasets. A significant challenge faced when training with multiple diverse datasets is the variation in label presence, i.e. the combined data are often partially-labelled. Adaptations of the cross entropy loss function have been proposed to deal with partially labelled data. In this paper we show that training naively with such a loss function and multiple diverse datasets can lead to a form of shortcut learning, where the model associates label presence with domain characteristics, leading to a drop in performance. To address this problem, we propose a novel label dropout scheme to break the link between domain characteristics and the presence or absence of labels. We demonstrate that label dropout improves echo segmentation Dice score by 62% and 25% on two cardiac structures when training using multiple diverse partially labelled datasets.


title: NPCoronaPredict: A computational pipeline for the prediction of the nanoparticle-biomolecule corona

abstract: The corona of a nanoparticle immersed in a biological fluid is of key importance to its eventual fate and bioactivity in the environment or inside live tissues. It is critical to have insight into both the underlying bionano interactions and the corona composition to ensure biocompatibility of novel engineered nanomaterials. A prediction of these properties in silico requires the successful spanning of multiple orders of magnitude of both time and physical dimensions to produce results in a reasonable amount of time, necessitating the development of a multiscale modelling approach. Here, we present the NPCoronaPredict open-source software package: a suite of software tools to enable this prediction for complex multi-component nanomaterials in essentially arbitrary biological fluids, or more generally any medium containing organic molecules. The package integrates several recent physics-based computational models and a library of both physics-based and data-driven parameterisations for nanomaterials and organic molecules. We describe the underlying theoretical background and the package functionality from the design of multi-component NPs through to the evaluation of the corona.


title: The Variant of Designated Verifier Signature Scheme with Message Recovery

abstract: In this work, we introduce a strong Designated Verifier Signature (DVS) scheme that incorporates a message recovery mechanism inspired by the concept of the Universal Designated Verifier Signature (UDVS) scheme. It is worth noting that Saeednia's strong designated verifier signature scheme fails to guarantee the privacy of the signature, making it unsuitable for certain applications such as medical record certificates or voting systems. To overcome this limitation, we extend Lee's strong designated verifier signature with a message recovery scheme to develop a universal designated verifier signature scheme. This universal designated verifier scheme is crafted to safeguard the privacy of signature holders, ensuring that only designated verifiers can authenticate the true signer and recover the messages.


title: Augmenting Interpolation-Based Model Checking with Auxiliary Invariants (Extended Version)

abstract: Software model checking is a challenging problem, and generating relevant invariants is a key factor in proving the safety properties of a program. Program invariants can be obtained by various approaches, including lightweight procedures based on data-flow analysis and intensive techniques using Craig interpolation. Although data-flow analysis runs efficiently, it often produces invariants that are too weak to prove the properties. By contrast, interpolation-based approaches build strong invariants from interpolants, but they might not scale well due to expensive interpolation procedures. Invariants can also be injected into model-checking algorithms to assist the analysis. Invariant injection has been studied for many well-known approaches, including k-induction, predicate abstraction, and symbolic execution. We propose an augmented interpolation-based verification algorithm that injects external invariants into interpolation-based model checking (McMillan, 2003), a hardware model-checking algorithm recently adopted for software verification. The auxiliary invariants help prune unreachable states in Craig interpolants and confine the analysis to the reachable parts of a program. We implemented the proposed technique in the verification framework CPAchecker and evaluated it against mature SMT-based methods in CPAchecker as well as other state-of-the-art software verifiers. We found that injecting invariants reduces the number of interpolation queries needed to prove safety properties and improves the run-time efficiency. Consequently, the proposed invariant-injection approach verified difficult tasks that none of its plain version (i.e., without invariants), the invariant generator, or any compared tools could solve.


title: Fusing Climate Data Products using a Spatially Varying Autoencoder

abstract: Autoencoders are powerful machine learning models used to compress information from multiple data sources. However, autoencoders, like all artificial neural networks, are often unidentifiable and uninterpretable. This research focuses on creating an identifiable and interpretable autoencoder that can be used to meld and combine climate data products. The proposed autoencoder utilizes a Bayesian statistical framework, allowing for probabilistic interpretations while also varying spatially to capture useful spatial patterns across the various data products. Constraints are placed on the autoencoder as it learns patterns in the data, creating an interpretable consensus that includes the important features from each input. We demonstrate the utility of the autoencoder by combining information from multiple precipitation products in High Mountain Asia.


title: Time-discretization method for a multi-term time fractional differential equation with delay

abstract: This paper discusses a multi-term time-fractional delay differential equation in a real Hilbert space. An iterative scheme for a multi-term time-fractional differential equation is established using Rothe's method. The method of semi-discretization is extended to this kind of time fractional problem with delay in the case that the time delay parameter $\nu >0$ satisfies $\nu\leq T$, where $T$ denotes the final time. We apply the accretivity of the operator $A$ in an iterative scheme to establish the existence and regularity of strong solutions to the considered problem. Finally, an example is provided to demonstrate the abstract result.


title: Preconditioners based on Voronoi quantizers of random variable coefficients for stochastic elliptic partial differential equations

abstract: A preconditioning strategy is proposed for the iterative solve of large numbers of linear systems with variable matrix and right-hand side which arise during the computation of solution statistics of stochastic elliptic partial differential equations with random variable coefficients sampled by Monte Carlo. Building on the assumption that a truncated Karhunen-Lo\`{e}ve expansion of a known transform of the random variable coefficient is known, we introduce a compact representation of the random coefficient in the form of a Voronoi quantizer. The number of Voronoi cells, each of which is represented by a centroidal variable coefficient, is set to the prescribed number $P$ of preconditioners. Upon sampling the random variable coefficient, the linear system assembled with a given realization of the coefficient is solved with the preconditioner whose centroidal variable coefficient is the closest to the realization. We consider different ways to define and obtain the centroidal variable coefficients, and we investigate the properties of the induced preconditioning strategies in terms of average number of solver iterations for sequential simulations, and of load balancing for parallel simulations. Another approach, which is based on deterministic grids on the system of stochastic coordinates of the truncated representation of the random variable coefficient, is proposed with a stochastic dimension which increases with the number $P$ of preconditioners. This approach allows to bypass the need for preliminary computations in order to determine the optimal stochastic dimension of the truncated approximation of the random variable coefficient for a given number of preconditioners.


title: The Missing Piece in Model Editing: A Deep Dive into the Hidden Damage Brought By Model Editing

abstract: Large Language Models have revolutionized numerous tasks with their remarkable efficacy.However, the editing of these models, crucial for rectifying outdated or erroneous information, often leads to a complex issue known as the ripple effect in the hidden space. This effect, while difficult to detect, can significantly impede the efficacy of model editing tasks and deteriorate model performance.This paper addresses this scientific challenge by proposing a novel evaluation methodology, Graphical Outlier Relation based Assessment(GORA), which quantitatively evaluates the adaptations of the model and the subsequent impact of editing. Furthermore, we introduce the Selective Outlier Re-Editing Approach(SORA), a model editing method designed to mitigate this ripple effect. Our comprehensive evaluations reveal that the ripple effect in the hidden space is a significant issue in all current model editing methods. However, our proposed methods, GORA and SORA, effectively identify and alleviate this issue, respectively, contributing to the advancement of LLM editing techniques.


title: Computational modelling of complex multiphase behavior of environmentally-friendly materials for sustainable technological solutions

abstract: This study presents a computational framework to investigate and predict the complicated multiphase properties of eco-friendly lead-free piezoelectric materials, which are crucial for sustainable technological progress. Although their electromechanical properties vary by phase, lead-free piezoelectric materials show a considerable thermo-electromechanical response. Lead-free materials such as Bi$_{0.5}$Na$_{0,5}$TiO$_{3}$ (BNT) and other BNT-type piezoelectric materials transition to rhombohedral (R3c), orthorhombic (Pnma), tetragonal (P4bm), and cubic (Cc) phases with temperature variation. These phases are determined by the symmetry and alignment of the ferroelectric domains. Multiple phases can occur simultaneously under specific thermal, electrical, and mechanical conditions, leading in complex multiphase behaviour. These materials' performance must be assessed by studying such behaviour. This study uses Landau-Ginzburg-Devonshire theory to simulate material micro-domain phase transitions. The computational model for BNT-type piezoelectric material covers temperature-induced ferroelectric domain switching and phase transitions. Therefore, the developed computational approach will assist us in better understanding the influence of these materials' complex multiphase behaviour on creating sustainable solutions with green technologies.

categories: cond-mat.mtrl-sci math-ph math.AP math.MP physics.app-ph


title: Affine Gateaux Differentials and the von Mises Statistical Calculus

abstract: This paper presents a general study of one-dimensional differentiability for functionals on convex domains that are not necessarily open. The local approximation is carried out by affine functionals, rather than linear ones as in standard Gateaux differentiability. This affine notion of differentiability naturally arises in many applications and, here and there, it appeared in the literature. Our systematic analysis aims to give a general perspective on it.


title: From Files to Streams: Revisiting Web History and Exploring Potentials for Future Prospects

abstract: Over the last 30 years, the World Wide Web has changed significantly. In this paper, we argue that common practices to prepare web pages for delivery conflict with many efforts to present content with minimal latency, one fundamental goal that pushed changes in the WWW. To bolster our arguments, we revisit reasons that led to changes of HTTP and compare them systematically with techniques to prepare web pages. We found that the structure of many web pages leverages features of HTTP/1.1 but hinders the use of recent HTTP features to present content quickly. To improve the situation in the future, we propose fine-grained content segmentation. This would allow to exploit streaming capabilities of recent HTTP versions and to render content as quickly as possible without changing underlying protocols or web browsers.


title: Convex cones, assessment functions, balanced attributes

abstract: We investigate a class of polyhedral convex cones, with $R^k_+$ (the nonegative orthant in $\mathbb{R}^k$) as a special case. We start with the observation that for convex cones contained in $\mathbb{R}^k$, the respective cone efficiency is inconsistent with the Pareto efficiency, the latter being deeply rooted in economics, the decision theory, and the multiobjective optimization theory. Despite that, we argue that convex cones contained in $\mathbb{R}^k$ and the respective cone efficiency are also relevant to these domains. To demonstrate this, we interpret polyhedral convex cones of the investigated class in terms of assessment functions, i.e., functions that aggregate multiple numerical attributes into single numbers. Further, we observe that all assessment functions in the current use share the same limitation; that is, they do not take explicitly into account attribute proportionality. In consequence, the issue of {\em attribute balance} (meaning {\it the balance of attribute values}) escapes them. In contrast, assessment functions defined by polyhedral convex cones of the investigated class, contained in $\mathbb{R}^k$, enforce the attribute balance. However, enforcing the attribute balance is, in general, inconsistent with the well-established paradigm of Pareto efficiency. We give a practical example where such inconsistency is meaningful.


title: Parity questions in critical planar Brownian loop-soups (or "where did the free planar bosons go?")

abstract: The critical two-dimensional Brownian loop-soup is an infinite collection of non-interacting Brownian loops in a planar domain that possesses some combinatorial features related to the notion of indistinguishability of bosons. The properly renormalized occupation time field of this collection of loops is known to be distributed like the properly defined square of a Gaussian free field. In the present paper, we investigate aspects of the question about how much information these fields provide about the loop-soup. Among other things, we show that the exact set of points that are actually visited by some loops in the loop-soup is not determined by these fields. We further prove that given the fields, a dense family of special points will each have a conditional probability 1/2 of being part of the loop-soup. We also exhibit another instance where the possible decompositions (given the field) into individual loops and excursions can be grouped into two clearly different groups, each having a conditional probability 1/2 of occurring.


title: Utilizing Load Shifting for Optimal Compressor Sequencing in Industrial Refrigeration

abstract: The ubiquity and energy needs of industrial refrigeration has prompted several research studies investigating various control opportunities for reducing energy demand. This work focuses on one such opportunity, termed compressor sequencing, which entails intelligently selecting the operational state of the compressors to service the required refrigeration load with the least possible work. We first study the static compressor sequencing problem and observe that deriving the optimal compressor operational state is computationally challenging and can vary dramatically based on the refrigeration load. Thus we introduce load shifting in conjunction with compressor sequencing, which entails strategically precooling the facility to allow for more efficient compressor operation. Interestingly, we show that load shifting not only provides benefits in computing the optimal compressor operational state, but also can lead to significant energy savings. Our results are based on and compared to real-world sensor data from an operating industrial refrigeration site of Butterball LLC located in Huntsville, AR, which demonstrated that without load shifting, even optimal compressor operation results in compressors often running at intermediate capacity levels, which can lead to inefficiencies. Through collected data, we demonstrate that a load shifting approach for compressor sequencing has the potential to reduce energy use of the compressors up to 20% compared to optimal sequencing without load shifting.


title: DeliGrasp: Inferring Object Properties with LLMs for Adaptive Grasp Policies

abstract: Large language models (LLMs) can provide rich physical descriptions of most worldly objects, allowing robots to achieve more informed and capable grasping. We leverage LLMs' common sense physical reasoning and code-writing abilities to infer an object's physical characteristics--mass $m$, friction coefficient $\mu$, and spring constant $k$--from a semantic description, and then translate those characteristics into an executable adaptive grasp policy. Using a current-controllable, two-finger gripper with a built-in depth camera, we demonstrate that LLM-generated, physically-grounded grasp policies outperform traditional grasp policies on a custom benchmark of 12 delicate and deformable items including food, produce, toys, and other everyday items, spanning two orders of magnitude in mass and required pick-up force. We also demonstrate how compliance feedback from DeliGrasp policies can aid in downstream tasks such as measuring produce ripeness. Our code and videos are available at: https://deligrasp.github.io


title: A Science4Peace initiative: Alleviating the consequences of sanctions in international scientific cooperation

abstract: The armed invasion of Ukraine by the Russian Federation has adversely affected the relations between Russia and Western countries. Among other aspects, it has put scientific cooperation and collaboration into question and changed the scientific landscape significantly. Cooperation between some Western institutions and their Russian and Belarusian partners were put on hold after February 24, 2022. The CERN Council decided at its meeting in December 2023 to terminate cooperation agreements with Russia and Belarus that date back a decade. CERN is an international institution with UN observer status, and has so far played a role in international cooperation which was independent of national political strategies. We argue that the Science4Peace idea still has a great value and scientific collaboration between scientists must continue, since fundamental science is by its nature an international discipline. A ban of scientists participating in international cooperation and collaboration is against the traditions, requirements and understanding of science. We call for measures to reactivate the peaceful cooperation of individual scientists on fundamental research in order to stimulate international cooperation for a more peaceful world in the future. Specifically, we plead for finding ways to continue this cooperation through international organizations, such as CERN and JINR.


title: When Eye-Tracking Meets Machine Learning: A Systematic Review on Applications in Medical Image Analysis

abstract: Eye-gaze tracking research offers significant promise in enhancing various healthcare-related tasks, above all in medical image analysis and interpretation. Eye tracking, a technology that monitors and records the movement of the eyes, provides valuable insights into human visual attention patterns. This technology can transform how healthcare professionals and medical specialists engage with and analyze diagnostic images, offering a more insightful and efficient approach to medical diagnostics. Hence, extracting meaningful features and insights from medical images by leveraging eye-gaze data improves our understanding of how radiologists and other medical experts monitor, interpret, and understand images for diagnostic purposes. Eye-tracking data, with intricate human visual attention patterns embedded, provides a bridge to integrating artificial intelligence (AI) development and human cognition. This integration allows novel methods to incorporate domain knowledge into machine learning (ML) and deep learning (DL) approaches to enhance their alignment with human-like perception and decision-making. Moreover, extensive collections of eye-tracking data have also enabled novel ML/DL methods to analyze human visual patterns, paving the way to a better understanding of human vision, attention, and cognition. This systematic review investigates eye-gaze tracking applications and methodologies for enhancing ML/DL algorithms for medical image analysis in depth.


title: An Approach to Evaluate Modeling Adequacy for Small-Signal Stability Analysis of IBR-related SSOs in Multimachine Systems

abstract: Time-varying phasor-based analysis of subsynchronous oscillations (SSOs) involving grid-following converters (GFLCs) and its benchmarking with electromagnetic transient (EMT) models have so far been restricted to highly simplified grid models with constant voltage sources behind series R-L circuits. In this paper, modeling adequacy of bulk power systems with synchronous generators (SGs), transmission systems, loads, and GFLCs are considered. To this end, we revisit the notions of time-varying phasor calculus, highlighting the distinction between space-phasor-calculus (SPC) and two often interchangeably used frameworks namely baseband-abc and generalized averaging. We present the models of grids in SPC framework that include transmission line dynamics, load dynamics, and SG stator transients. Next, we propose a generic approach to study modeling adequacy in small-signal sense by (a) identifying critical modes through eigenvalue and singular value analysis followed by (b) using weighted maximum singular value error magnitudes as metrics, and (c) further cross-validation. Using a modified 4-machine IEEE benchmark model with up to 3 GFLCs we show that SPC framework can be used for analysis of SSOs. Further, we consider the quasistationary phasor calculus (QPC) framework that neglects transmission line, load, and SG stator dynamics to show its adequacy in SSO modeling and analysis. Time-domain and frequency-domain results with EMT models are also presented.


title: Syncopated Dynamical Decoupling for Suppressing Crosstalk in Quantum Circuits

abstract: Theoretically understanding and experimentally characterizing and modifying the underlying Hamiltonian of a quantum system is of utmost importance in achieving high-fidelity quantum gates for quantum computing. In this work, we explore the use of dynamical decoupling (DD) in characterizing undesired two-qubit couplings as well as the underlying single-qubit decoherence, and in suppressing them. We develop a syncopated dynamical decoupling technique which protects against decoherence and selectively targets unwanted two-qubit interactions, overcoming both significant hurdles to achieving precise quantum control and realizing quantum computing on many hardware prototypes. On a transmon-qubit-based superconducting quantum device, we identify separate white and $1/f$ noise components underlying the single-qubit decoherence and a static ZZ coupling between pairs of qubits. We suppress these errors using syncopated dynamical decoupling in two-qubit benchmarking experiments and significantly boost performance in a realistic algorithmic quantum circuit.


title: Topological Protection of Optical Skyrmions through Complex Media

abstract: Recent experimental realizations of optical Skyrmions through the techniques of structured light have opened the doors to a completely new way of representing data in electromagnetic fields, namely its topology. Apart from potentially enhancing the bandwidth of optical systems, the intrinsically discrete nature of the topological number allows Skyrmions to naturally interface with the digital world. However, investigations into the topological protection of optical Skyrmions through various media remain limited to date. Here, we rigorously define the optical Skyrmion and establish a framework that can be used to analyze the effects of complex media on the topology of Skyrmion fields. Using this framework, we provide simple criteria for spatially varying retarders, diattenuators, depolarizers, and combinations of the former under which topological protection is guaranteed. We then present experimental results validating the robustness of the Skyrmion number against corrupting media and discuss ways of extending the optical Skyrmion to more general settings. We believe that the work presented in this paper provides a theoretical underpinning for the use of Skyrmions in practical applications ranging from optical communications to photonic computing.


title: MPCPA: Multi-Center Privacy Computing with Predictions Aggregation based on Denoising Diffusion Probabilistic Model

abstract: Privacy-preserving computing is crucial for multi-center machine learning in many applications such as healthcare and finance. In this paper a Multi-center Privacy Computing framework with Predictions Aggregation (MPCPA) based on denoising diffusion probabilistic model (DDPM) is proposed, in which conditional diffusion model training, DDPM data generation, a classifier, and strategy of prediction aggregation are included. Compared to federated learning, this framework necessitates fewer communications and leverages high-quality generated data to support robust privacy computing. Experimental validation across multiple datasets demonstrates that the proposed framework outperforms classic federated learning and approaches the performance of centralized learning with original data. Moreover, our approach demonstrates robust security, effectively addressing challenges such as image memorization and membership inference attacks. Our experiments underscore the efficacy of the proposed framework in the realm of privacy computing, with the code set to be released soon.


title: MoPE-CLIP: Structured Pruning for Efficient Vision-Language Models with Module-wise Pruning Error Metric

abstract: Vision-language pre-trained models have achieved impressive performance on various downstream tasks. However, their large model sizes hinder their utilization on platforms with limited computational resources. We find that directly using smaller pre-trained models and applying magnitude-based pruning on CLIP models leads to inflexibility and inferior performance. Recent efforts for VLP compression either adopt uni-modal compression metrics resulting in limited performance or involve costly mask-search processes with learnable masks. In this paper, we first propose the Module-wise Pruning Error (MoPE) metric, accurately assessing CLIP module importance by performance decline on cross-modal tasks. Using the MoPE metric, we introduce a unified pruning framework applicable to both pre-training and task-specific fine-tuning compression stages. For pre-training, MoPE-CLIP effectively leverages knowledge from the teacher model, significantly reducing pre-training costs while maintaining strong zero-shot capabilities. For fine-tuning, consecutive pruning from width to depth yields highly competitive task-specific models. Extensive experiments in two stages demonstrate the effectiveness of the MoPE metric, and MoPE-CLIP outperforms previous state-of-the-art VLP compression methods.


title: Programming droplet motion using metamaterials

abstract: Motion control of droplets has generated much attention for its applications to microfluidics, where precise control of small fluid volumes is an imperative requirement. Mechanical vibrations have been shown to be effective at inducing controllable depinning, and activation of different drop motion regimes. However, existing vibration-based strategies involve establishing homogeneous rigid-body dynamics on the substrate, and therefore lack any form of spatial heterogeneity and tuning. Addressing this limitation, metamaterials provide an ideal platform to achieve spectrally and spatially selective drop motion control, which leverages their ability to attenuate vibrations in selected frequency bands and in selected regions of a substrate. In this work, we illustrate the potential of metamaterials-based drop control by experimentally demonstrating a variety of drop motion capabilities on the surface of metaplates endowed with locally resonant stubs. The experiments leverage the design versatility of a LEGO component-enabled reconfigurable design platform and laser vibrometry measurements with high spatial resolution.


title: Critical metrics of eigenvalue functionals via Clarke subdifferential

abstract: We set up a new framework to study critical points of functionals defined as combinations of eigenvalues of operators with respect to a given set of parameters: Riemannian metrics, potentials, etc. Our setting builds upon Clarke's differentiation theory to provide a novel understanding of critical metrics. In particular, we unify and refine previous research carried out on Laplace and Steklov eigenvalues. We also use our theory to tackle original examples such as the conformal GJMS operators, the conformal Laplacian, and the Laplacian with mixed boundary conditions.