title: From axial C-hedra to general P-nets

abstract: We give a full classification of continuous flexible discrete axial cone-nets, which are called axial C-hedra. The obtained result can also be used to construct their semi-discrete analogs. Moreover, we identify a novel subclass within the determined class of (semi-)discrete axial cone-nets, whose members are named axial P-nets as they fulfill the proportion (P) of the intercept theorem. Known special cases of these axial P-nets are the smooth and discrete conic crease patterns with reflecting rule lines. By using a parallelism operation one can even generalize axial P-nets. The resulting general P-nets constitute a rich novel class of continuous flexible (semi-)discrete surfaces, which allow direct access to their spatial shapes by three control polylines. This intuitive method makes them suitable for transformable design tasks using interactive tools.


title: Hold 'em and Fold 'em: Towards Human-scale, Feedback-Controlled Soft Origami Robots

abstract: An underdeveloped capability in soft robotics is proprioceptive feedback control, where soft actuators can be sensed and controlled using only sensors on the robot's body. Additionally, soft actuators are often unable to support human-scale loads due to the extremely compliant materials in use. Developing both feedback control and the ability to actuate under large loads (e.g. 500 N) are key capacities required to move soft robotics into everyday applications. In this work, we independently demonstrate these key factors towards controlling and actuating human-scale loads: proprioceptive (embodied) feedback control of a soft, pneumatically-actuated origami robot; and actuation of these origami origami robots under a person's weight in an open-loop configuration. In both demonstrations, the actuators are controlled by internal fluidic pressure. Capacitive sensors patterned onto the robot provide position estimation and serve as input to a feedback controller. We demonstrate position control of a single actuator during stepped setpoints and sinusoidal trajectory following, with root mean square error (RMSE) below 4 mm. We also showcase the actuator's potential towards human-scale robotics as an "origami balance board" by joining three actuators into an open-loop controlled system with a platform that varies its height, roll, and pitch. This work contributes to the field of soft robotics by demonstrating closed-loop feedback position control without visual tracking as an input and lightweight, soft actuators that can support a person's weight. The project repository, including videos, CAD files, and ROS code, is available at https://parses-lab.github.io/kresling_control.


title: Learning to Prompt Segment Anything Models

abstract: Segment Anything Models (SAMs) like SEEM and SAM have demonstrated great potential in learning to segment anything. The core design of SAMs lies with Promptable Segmentation, which takes a handcrafted prompt as input and returns the expected segmentation mask. SAMs work with two types of prompts including spatial prompts (e.g., points) and semantic prompts (e.g., texts), which work together to prompt SAMs to segment anything on downstream datasets. Despite the important role of prompts, how to acquire suitable prompts for SAMs is largely under-explored. In this work, we examine the architecture of SAMs and identify two challenges for learning effective prompts for SAMs. To this end, we propose spatial-semantic prompt learning (SSPrompt) that learns effective semantic and spatial prompts for better SAMs. Specifically, SSPrompt introduces spatial prompt learning and semantic prompt learning, which optimize spatial prompts and semantic prompts directly over the embedding space and selectively leverage the knowledge encoded in pre-trained prompt encoders. Extensive experiments show that SSPrompt achieves superior image segmentation performance consistently across multiple widely adopted datasets.


title: Restriction Theorems and Root Systems for Symmetric Superspaces

abstract: In this paper we consider those involutions $\theta$ of a finite-dimensional Kac-Moody Lie superalgebra $\mathfrak g$, with associated decomposition $\mathfrak g=\mathfrak k\oplus\mathfrak p$, for which a Cartan subspace $\mathfrak a$ in $\mathfrak p_{\bar 0}$ is self-centralizing in $\mathfrak p$. For such $\theta$ the restriction map $C_\theta$ from $\mathfrak p$ to $\mathfrak a$ is injective on the algebra $P(\mathfrak p)^{\mathfrak k}$ of $\mathfrak k$-invariant polynomials on $\mathfrak p$. There are five infinite families and five exceptional cases of such involutions, and for each case we explicitly determine the structure of $P(\mathfrak p)^{\mathfrak k}$ by giving a complete set of generators for the image of $C_\theta$. We also determine precisely when the restriction map $R_\theta$ from $P(\mathfrak g)^{\mathfrak g}$ to $P(\mathfrak p)^{\mathfrak k}$ is surjective. Finally we introduce the notion of a generalized restricted root system, and show that in the present setting the $\mathfrak a$-roots $\Delta(\mathfrak a,\mathfrak g)$ always form such a system.


title: Time-certified Input-constrained NMPC via Koopman Operator

abstract: Determining solving-time certificates of nonlinear model predictive control (NMPC) implementations is a pressing requirement when deploying NMPC in production environments. Such a certificate guarantees that the NMPC controller returns a solution before the next sampling time. However, NMPC formulations produce nonlinear programs (NLPs) for which it is very difficult to derive their solving-time certificates. Our previous work, Wu and Braatz (2023), challenged this limitation with a proposed input-constrained MPC algorithm having exact iteration complexity but was restricted to linear MPC formulations. This work extends the algorithm to solve input-constrained NMPC problems, by using the Koopman operator and a condensing MPC technique. We illustrate the algorithm performance on a high-dimensional, nonlinear partial differential equation (PDE) control case study, in which we theoretically and numerically certify the solving time to be less than the sampling time.


title: Coexistence of multi-scale domains in ferroelectric polycrystals with non-uniform grain-size distributions

abstract: Engineering of ferroelectric domain structures enables direct control over the switching dynamics and is crucial for tuning the functional properties of ferroelectrics for various applications, ranging from capacitors to future nanoelectronics. Here, we investigate domain formation in poly- and single crystalline improper ferroelectric DyMnO3. We show that a non-uniform grain-size distribution in the polycrystals facilitates the coexistence of multi-scale domains, varying by up to one order of magnitude in size. This unusual domain structure originates from an inverted domain-size/grain-size dependence that is intrinsic to the hexagonal manganite polycrystals, expanding previous studies towards non-uniform grain-size distributions. Our results demonstrate that the micrometer-sized grains in DyMnO3 represent individual ferroelectric units with a characteristic domain structure, giving a new dimension to domain engineering in ferroelectric polycrystals with non-uniform microstructures.


title: DepressionEmo: A novel dataset for multilabel classification of depression emotions

abstract: Emotions are integral to human social interactions, with diverse responses elicited by various situational contexts. Particularly, the prevalence of negative emotional states has been correlated with negative outcomes for mental health, necessitating a comprehensive analysis of their occurrence and impact on individuals. In this paper, we introduce a novel dataset named DepressionEmo designed to detect 8 emotions associated with depression by 6037 examples of long Reddit user posts. This dataset was created through a majority vote over inputs by zero-shot classifications from pre-trained models and validating the quality by annotators and ChatGPT, exhibiting an acceptable level of interrater reliability between annotators. The correlation between emotions, their distribution over time, and linguistic analysis are conducted on DepressionEmo. Besides, we provide several text classification methods classified into two groups: machine learning methods such as SVM, XGBoost, and Light GBM; and deep learning methods such as BERT, GAN-BERT, and BART. The pretrained BART model, bart-base allows us to obtain the highest F1- Macro of 0.76, showing its outperformance compared to other methods evaluated in our analysis. Across all emotions, the highest F1-Macro value is achieved by suicide intent, indicating a certain value of our dataset in identifying emotions in individuals with depression symptoms through text analysis. The curated dataset is publicly available at: https://github.com/abuBakarSiddiqurRahman/DepressionEmo.


title: Protected Weyl semimetals within 2D chiral classes

abstract: Weyl semimetals in three dimensions can exist independently of any symmetry apart from translations. Conversely, in two dimensions, Weyl semimetals are believed to require additional symmetries including crystalline symmetries to exist. In this study, we demonstrate that a 2D Weyl semimetal phase can exist in systems with Hamiltonians possessing internal symmetries, such as time reversal ${\cal T}$, charge conjugation ${\cal C}$ , and their combined chiral symmetry ${\cal S} = {\cal CT}$, only. Starting from a minimal-dimension Dirac Hamiltonian, we establish the presence of a stable Weyl semimetal phase in each of the five chiral classes: AIII, BDI, CII, DIII, and CI in two dimension. Similar to 3D Weyl semimetals where Weyl points possess nontrivial topological charges (Chern number), the Weyl points in WSMs within the 2D chiral classes are characterized by the $Z$ winding numbers. In accordance with the bulk-boundary correspondence, protected Fermi arc edge states emerge, connecting the projections of Weyl points that carry opposite topological charges. Unlike the surface states in 3D WSMs, the edge states of WSMs within 2D chiral classes are completely dispersionless and are always at the zero energy due to the protecting chiral symmetry.


title: A semi-smooth Newton method for general projection equations applied to the nearest correlation matrix problem

abstract: In this paper, we extend and investigate the properties of the semi-smooth Newton method when applied to a general projection equation in finite dimensional spaces. We first present results concerning Clarke's generalized Jacobian of the projection onto a closed and convex cone. We then describe the iterative process for the general cone case and establish two convergence theorems. We apply these results to the constrained quadratic conic programming problem, emphasizing its connection to the projection equation. To illustrate the performance of our method, we conduct numerical experiments focusing on semidefinite least squares, in particular the nearest correlation matrix problem. In the latter scenario, we benchmark our outcomes against previous literature, presenting performance profiles and tabulated results for clarity and comparison.


title: Lightning Attention-2: A Free Lunch for Handling Unlimited Sequence Lengths in Large Language Models

abstract: Linear attention is an efficient attention mechanism that has recently emerged as a promising alternative to conventional softmax attention. With its ability to process tokens in linear computational complexities, linear attention, in theory, can handle sequences of unlimited length without sacrificing speed, i.e., maintaining a constant training speed for various sequence lengths with a fixed memory consumption. However, due to the issue with cumulative summation (cumsum), current linear attention algorithms cannot demonstrate their theoretical advantage in a causal setting. In this paper, we present Lightning Attention-2, the first linear attention implementation that enables linear attention to realize its theoretical computational benefits. To achieve this, we leverage the thought of tiling, separately handling the intra-block and inter-block components in linear attention calculation. Specifically, we utilize the conventional attention computation mechanism for the intra-blocks and apply linear attention kernel tricks for the inter-blocks. A tiling technique is adopted through both forward and backward procedures to take full advantage of the GPU hardware. We implement our algorithm in Triton to make it IO-aware and hardware-friendly. Various experiments are conducted on different model sizes and sequence lengths. Lightning Attention-2 retains consistent training and inference speed regardless of input sequence length and is significantly faster than other attention mechanisms. The source code is available at https://github.com/OpenNLPLab/lightning-attention.


title: The quantitative isoperimetric inequality for the Hilbert-Schmidt norm of localization operators

abstract: In this paper we study the Hilbert-Schmidt norm of time-frequency localization operators $L_{\Omega} \colon L^2(\mathbb{R}^d) \rightarrow L^2(\mathbb{R}^d)$, with Gaussian window, associated with a subset $\Omega\subset\mathbb{R}^{2d}$ of finite measure. We prove, in particular, that the Hilbert-Schmidt norm of $L_\Omega$ is maximized, among all subsets $\Omega$ of a given finite measure, when $\Omega$ is a ball and that there are no other extremizers. Actually, the main result is a quantitative version of this estimate, with sharp exponent. A similar problem is addressed for wavelet localization operators, where rearrangements are understood in the hyperbolic setting.


title: Distributed Data-driven Unknown-input Observers

abstract: Unknown inputs related to, e.g., sensor aging, modeling errors, or device bias, represent a major concern in wireless sensor networks, as they degrade the state estimation performance. To improve the performance, unknown-input observers (UIOs) have been proposed. Most of the results available to design UIOs are based on explicit system models, which can be difficult or impossible to obtain in real-world applications. Data-driven techniques, on the other hand, have become a viable alternative for the design and analysis of unknown systems using only data. In this context, a novel data-driven distributed unknown-input observer (D-DUIO) for an unknown linear system is developed, which leverages solely some data collected offline, without any prior knowledge of the system matrices. In the paper, first, the design of a DUIO is investigated by resorting to a traditional model-based approach. By resorting to a Lyapunov equation, it is proved that under some conditions, the state estimates at all nodes of the DUIO achieve consensus and collectively converge to the state of the system. Moving to a data-driven approach, it is shown that the input/output/state trajectories of the system are compatible with the equations of a D-DUIO, and this allows, under suitable assumptions, to express the matrices of a possible DUIO in terms of the matrices of pre-collected data. Then, necessary and sufficient conditions for the existence of the proposed D-DUIO are given. Finally, the efficacy of the D-DUIO is illustrated by means of numerical examples.


title: Benchmarking Deep Learning-Based Low Dose CT Image Denoising Algorithms

abstract: Long lasting efforts have been made to reduce radiation dose and thus the potential radiation risk to the patient for computed tomography acquisitions without severe deterioration of image quality. To this end, numerous reconstruction and noise reduction algorithms have been developed, many of which are based on iterative reconstruction techniques, incorporating prior knowledge in the projection or image domain. Recently, deep learning-based methods became increasingly popular and a multitude of papers claim ever improving performance both quantitatively and qualitatively. In this work, we find that the lack of a common benchmark setup and flaws in the experimental setup of many publications hinder verifiability of those claims. We propose a benchmark setup to overcome those flaws and improve reproducibility and verifiability of experimental results in the field. In a comprehensive and fair evaluation of several deep learning-based low dose CT denoising algorithms, we find that most methods perform statistically similar and improvements over the past six years have been marginal at best.


title: The Devil Behind the Mirror: Tracking the Campaigns of Cryptocurrency Abuses on the Dark Web

abstract: The dark web has emerged as the state-of-the-art solution for enhanced anonymity. Just like a double-edged sword, it also inadvertently becomes the safety net and breeding ground for illicit activities. Among them, cryptocurrencies have been prevalently abused to receive illicit income while evading regulations. Despite the continuing efforts to combat illicit activities, there is still a lack of an in-depth understanding regarding the characteristics and dynamics of cryptocurrency abuses on the dark web. In this work, we conduct a multi-dimensional and systematic study to track cryptocurrency-related illicit activities and campaigns on the dark web. We first harvest a dataset of 4,923 cryptocurrency-related onion sites with over 130K pages. Then, we detect and extract the illicit blockchain transactions to characterize the cryptocurrency abuses, targeting features from single/clustered addresses and illicit campaigns. Throughout our study, we have identified 2,564 illicit sites with 1,189 illicit blockchain addresses, which account for 90.8 BTC in revenue. Based on their inner connections, we further identify 66 campaigns behind them. Our exploration suggests that illicit activities on the dark web have strong correlations, which can guide us to identify new illicit blockchain addresses and onions, and raise alarms at the early stage of their deployment.


title: Adaptive Deep Fourier Residual method via overlapping domain decomposition

abstract: The Deep Fourier Residual (DFR) method is a specific type of variational physics-informed neural networks (VPINNs). It provides a robust neural network-based solution to partial differential equations (PDEs). The DFR strategy is based on approximating the dual norm of the weak residual of a PDE. This is equivalent to minimizing the energy norm of the error. To compute the dual of the weak residual norm, the DFR method employs an orthonormal spectral basis of the test space, which is known for rectangles or cuboids for multiple function spaces. In this work, we extend the DFR method with ideas of traditional domain decomposition (DD). This enables two improvements: (a) to solve problems in more general polygonal domains, and (b) to develop an adaptive refinement technique in the test space using a Dofler marking algorithm. In the former case, we show that under non-restrictive assumptions we retain the desirable equivalence between the employed loss function and the H1-error, numerically demonstrating adherence to explicit bounds in the case of the L-shaped domain problem. In the latter, we show how refinement strategies lead to potentially significant improvements against a reference, classical DFR implementation with a test function space of significantly lower dimensionality, allowing us to better approximate singular solutions at a more reasonable computational cost.


title: An Elementary Approach For Sums Of Consecutive Cubes Being Prime Power Squares

abstract: This paper proposes an elementary solution to a special case of finding all perfect squares that can be written as sum of consecutive integer cubes. It is shown that there are no non-trivial solutions if the perfect square is a prime power, i.e., it is divisible by two different primes if a non-trivial one exists. Solution mostly depends on $v_{p}(x)$ and general forms of Pythagorean triples.


title: Experimental bounds on linear-friction dissipative collapse models from levitated optomechanics

abstract: Collapse models constitute an alternative to quantum mechanics that solve the well-know quantum measurement problem. In this framework, a novel approach to include dissipation in collapse models has been recently proposed, and awaits experimental validation. Our work establishes experimental bounds on the so-constructed linear-friction dissipative Di\'osi-Penrose (dDP) and Continuous Spontaneous localisation (dCSL) models by exploiting experiments in the field of levitated optomechanics. Our results in the dDP case exclude collapse temperatures below $ 10^{-13}$K and $ 6 \times 10^{-12}$K respectively for values of the localisation length smaller than $10^{-6}$m and $10^{-8}$m. In the dCSL case the entire parameter space is excluded for values of the temperature lower than $6 \times 10^{-9}$K.


title: Benchmark Analysis of Various Pre-trained Deep Learning Models on ASSIRA Cats and Dogs Dataset

abstract: As the most basic application and implementation of deep learning, image classification has grown in popularity. Various datasets are provided by renowned data science communities for benchmarking machine learning algorithms and pre-trained models. The ASSIRA Cats & Dogs dataset is one of them and is being used in this research for its overall acceptance and benchmark standards. A comparison of various pre-trained models is demonstrated by using different types of optimizers and loss functions. Hyper-parameters are changed to gain the best result from a model. By applying this approach, we have got higher accuracy without major changes in the training model. To run the experiment, we used three different computer architectures: a laptop equipped with NVIDIA GeForce GTX 1070, a laptop equipped with NVIDIA GeForce RTX 3080Ti, and a desktop equipped with NVIDIA GeForce RTX 3090. The acquired results demonstrate supremacy in terms of accuracy over the previously done experiments on this dataset. From this experiment, the highest accuracy which is 99.65% is gained using the NASNet Large.


title: Polynomial rates via deconvolution for nonparametric estimation in McKean-Vlasov SDEs

abstract: This paper investigates the estimation of the interaction function for a class of McKean-Vlasov stochastic differential equations. The estimation is based on observations of the associated particle system at time $T$, considering the scenario where both the time horizon $T$ and the number of particles $N$ tend to infinity. Our proposed method recovers polynomial rates of convergence for the resulting estimator. This is achieved under the assumption of exponentially decaying tails for the interaction function. Additionally, we conduct a thorough analysis of the transform of the associated invariant density as a complex function, providing essential insights for our main results.


title: Hilbert coefficients of good I-Filtrations of modules

abstract: Let $M$ be a finitely generated module of dimention d over a Noetherian local ring (A,m) and I an m-primary ideal. Let be a pair of good I-filtrations F and F' of M. We show that the Hilbert coefficients e_i(F) are bounded below and above in terms of i, e_0(F'),...,e_i(F'), and reduction numbers of F and F', for all i \ge 1.


title: Transfer-Learning-Based Autotuning Using Gaussian Copula

abstract: As diverse high-performance computing (HPC) systems are built, many opportunities arise for applications to solve larger problems than ever before. Given the significantly increased complexity of these HPC systems and application tuning, empirical performance tuning, such as autotuning, has emerged as a promising approach in recent years. Despite its effectiveness, autotuning is often a computationally expensive approach. Transfer learning (TL)-based autotuning seeks to address this issue by leveraging the data from prior tuning. Current TL methods for autotuning spend significant time modeling the relationship between parameter configurations and performance, which is ineffective for few-shot (that is, few empirical evaluations) tuning on new tasks. We introduce the first generative TL-based autotuning approach based on the Gaussian copula (GC) to model the high-performing regions of the search space from prior data and then generate high-performing configurations for new tasks. This allows a sampling-based approach that maximizes few-shot performance and provides the first probabilistic estimation of the few-shot budget for effective TL-based autotuning. We compare our generative TL approach with state-of-the-art autotuning techniques on several benchmarks. We find that the GC is capable of achieving 64.37% of peak few-shot performance in its first evaluation. Furthermore, the GC model can determine a few-shot transfer budget that yields up to 33.39$\times$ speedup, a dramatic improvement over the 20.58$\times$ speedup using prior techniques.


title: Modified Levenberg-Marquardt Algorithm For Tensor CP Decomposition in Image Compression

abstract: This paper explores a new version of the Levenberg-Marquardt algorithm used for Tensor Canonical Polyadic (CP) decomposition with an emphasis on image compression and reconstruction. Tensor computation, especially CP decomposition, holds significant applications in data compression and analysis. In this study, we formulate CP as a nonlinear least squares optimization problem. Then, we present an iterative Levenberg-Marquardt (LM) based algorithm for computing the CP decomposition. Ultimately, we test the algorithm on various datasets, including randomly generated tensors and RGB images. The proposed method proves to be both efficient and effective, offering a reduced computational burden when compared to the traditional Levenberg-Marquardt technique.


title: Jahn-Teller driven quadrupolar ordering and spin-orbital dimer formation in GaNb$_{4}$Se$_{8}$

abstract: The lacunar spinel GaNb$_4$Se$_8$ is a tetrahedral cluster Mott insulator where spin-orbit coupling on molecular orbitals and Jahn-Teller energy scales are competitive. GaNb$_4$Se$_8$ undergoes a structural and anti-polar ordering transition at T$_Q$ = 50 K that corresponds to a quadrupolar ordering of molecular orbitals on Nb$_4$ clusters. A second transition occurs at T$_M$ = 29 K, where local distortions on the Nb$_4$ clusters rearrange. We present a single crystal x-ray diffraction investigation these phase transitions and solve the crystal structure in the intermediate T$_M$ < T < T$_Q$ and low T < T$_M$ temperature phases. The intermediate phase is a primitive cubic P2$_1$3 structure with a staggered arrangement of Nb4 cluster distortions. A symmetry mode analysis reveals that the transition at TQ is continuous and described by a single Jahn-Teller active amplitude mode. In the low temperature phase, the symmetry of Nb$_4$ clusters is further reduced and the unit cell doubles into an orthorhombic P2$_1$2$_1$2$_1$ space group. Nb$_4$ clusters rearrange through this transition to form a staggered arrangement of intercluster dimers, suggesting a valence bond solid magnetic state.


title: Reversing Unknown Quantum Processes via Virtual Combs: for Channels with Limited Information

abstract: The inherent irreversibility of quantum dynamics for open systems poses a significant barrier to the inversion of unknown quantum processes. To tackle this challenge, we propose the framework of virtual combs that exploit the unknown process iteratively with additional classical post-processing to simulate the process inverse. Our research establishes a path to achieving the exact inverse of unknown channels with certain conditions, accompanied by a no-go theorem that underscores the intrinsic limitations imposed by quantum mechanics on such tasks. Notably, we demonstrate that an $n$-slot virtual comb can exactly reverse a depolarizing channel with one unknown noise parameter out of $n+1$ potential candidates, and a 1-slot virtual comb can exactly reverse an arbitrary pair of quantum channels. We further explore the approximate inverse of an unknown channel within a given channel set. For any unknown depolarizing channels within a specified noise region, we unveil a worst-case error decay of $\mathcal{O}(n^{-1})$ of reversing the channel via virtual combs. Moreover, we show that virtual combs with constant slots can be applied to universally reverse unitary operations and investigate the trade-off between the slot number and the sampling overhead.


title: Algebraic curves as a source of separable multi-Hamiltonian systems

abstract: In this paper we systematically consider various ways of generating integrable and separable Hamiltonian systems in canonical and in non-canonical representations from algebraic curves on the plane. In particular, we consider St\"ackel transform between two pairs of St\"ackel systems, generated by 2n-parameter algebraic curves on the plane, as well as Miura maps between St\"ackel systems generated by (n+N)-parameter algebraic curves, leading to multi-Hamiltonian representation of these systems.


title: Solving the Scattering Problem for Open Wave-Guides, III: Radiation Conditions and Uniqueness

abstract: This paper continues the analysis of the scattering problem for a network of open wave-guides started in [arXiv:2302.04353, arXiv:2310.05816]. In this part we present explicit, physically motivated radiation conditions that ensure uniqueness of the solution to the scattering problem. These conditions stem from a 2000 paper of A. Vasy on 3-body Schrodinger operators; we discuss closely related conditions from a 1994 paper of H. Isozaki. Vasy's paper also proves the existence of the limiting absorption resolvents, and that the limiting solutions satisfy the radiation conditions. The statements of these results require a calculus of pseudodifferential operators, called the 3-body scattering calculus, which is briefly introduced here. We show that the solutions to the model problem obtained in arXiv:2302.04353 satisfy these radiation conditions, which makes it possible to prove uniqueness, and therefore existence, for the system of Fredholm integral equations introduced in that paper.


title: On Duplication-Free Codes for Disjoint or Equal-Length Errors

abstract: Motivated by applications in DNA storage, we study a setting in which strings are affected by tandem-duplication errors. In particular, we look at two settings: disjoint tandem-duplication errors, and equal-length tandem-duplication errors. We construct codes, with positive asymptotic rate, for the two settings, as well as for their combination. Our constructions are duplication-free codes, comprising codewords that do not contain tandem duplications of specific lengths. Additionally, our codes generalize previous constructions, containing them as special cases.


title: Rank-stability of polynomial equations

abstract: Extending the thoroughly studied theory of group stability, we study Ulam stability type problems for associative and Lie algebras; namely, we investigate obstacles to rank-approximation of almost solutions by exact solutions for systems of polynomial equations. This leads to a rich theory of stable associative and Lie algebras, with connections to linear soficity, amenability, growth, and group stability. We develop rank-stability and instability tests, examine the effect of algebraic constructions on rank-stability, and prove that while finite-dimensional associative algebras are rank-stable, `most' finite-dimensional Lie algebras are not.


title: Multiferroic quantum criticality in (Eu,Ba,Sr)TiO$_3$ solid solution

abstract: Based on the earlier published theory (\textit{Nature Mat}. \textbf{18}, 223--228 (2019)), a comprehensive experimental investigation of multiferroic quantum critical behavior of (Eu,Ba,Sr)TiO$_3$ polycrystalline and single crystal samples was performed. Presence of the displacive ferroelectric quantum criticality is revealed through non-classical ($T^2$) temperature scaling of inverse dielectric susceptibility up to 60\,K. With increasing hydrostatic pressure, this ferroelectric quantum criticality is gradually suppressed. Inverse magnetic susceptibility follows classical Curie-Weiss law down to 4 K, but quantum fluctuations belonging to an antiferromagnetic phase transition ($T_{\mathrm{N}} < 0.8$ K) change its scaling below 3 K to $T^{(1.7\pm 0.1)}$ and $T^{(2.1\pm 0.2)}$ for samples containing 29\,\% and 25\,\% of Eu$^{2+}$ ions, respectively. Experimental indications of the coexisting ferroelectric and antiferromagnetic, i.e. multiferroic, quantum fluctuations and qualitative explanation why they could be seen only in the immediate proximity of $T_{\mathrm{N}}$ is given.


title: Microwave magnetic excitations in U-type hexaferrite Sr$_4$CoZnFe$_{36}$O$_{60}$ ceramics

abstract: Microwave (MW) transmission, absorption, and reflection loss spectra of the ferrimagnetic U-type hexaferrite Sr$_4$CoZnFe$_{36}$O$_{60}$ ceramics were studied from 100 MHz to 35 GHz at temperatures between 10 and 390 K. 9 MW magnetic excitations with anomalous behavior near the ferrimagnetic phase transitions were revealed. They also change under the application of weak bias magnetic field (0 - 700 Oe) at room temperature. 6 pure magnetic modes are assigned to dynamics of the magnetic domain walls and inhomogeneous magnetic structure of the ceramics, to the natural ferromagnetic resonance (FMR) and to the higher-frequency magnons. 3 modes are considered as the magnetodielectric ones with dominating influence of the magnetic properties on their temperature and field dependences. Presence of the natural FMR in all ferrimagnetic phases proves existence of the non-zero internal magnetization and magnetocrystalline anisotropy. Splitting of the FMR into the two components without magnetic bias was observed in the collinear phase and is attributed to a change of the magnetocrystalline anisotropy during the phase transition. The high-frequency FMR component critically slows down to the phase transition. At room temperature, the FMR splitting and essential suppression of the higher-frequency modes was revealed under the weak bias field (300 - 700 Oe). The highly nonlinear MW response and the FMR splitting are caused by the gradual evolution of the polydomain magnetic structure to a monodomain one. The high number of magnetic excitations observed in the MW region confirms the suitability of using hexaferrite Sr$_4$CoZnFe$_{36}$O$_{60}$ ceramics as MW absorbers, shielding materials and highly tunable filters.


title: RoSA: Accurate Parameter-Efficient Fine-Tuning via Robust Adaptation

abstract: We investigate parameter-efficient fine-tuning (PEFT) methods that can provide good accuracy under limited computational and memory budgets in the context of large language models (LLMs). We present a new PEFT method called Robust Adaptation (RoSA) inspired by robust principal component analysis that jointly trains $\textit{low-rank}$ and $\textit{highly-sparse}$ components on top of a set of fixed pretrained weights to efficiently approximate the performance of a full-fine-tuning (FFT) solution. Across a series of challenging generative tasks such as grade-school math and SQL query generation, which require fine-tuning for good performance, we show that RoSA outperforms LoRA, pure sparse fine-tuning, and alternative hybrid methods at the same parameter budget, and can even recover the performance of FFT on some tasks. We provide system support for RoSA to complement the training algorithm, specifically in the form of sparse GPU kernels which enable memory- and computationally-efficient training, and show that it is also compatible with low-precision base weights, resulting in the first joint representation combining quantization, low-rank and sparse approximations. Our code is available at https://github.com/IST-DASLab/RoSA.


title: CoordGate: Efficiently Computing Spatially-Varying Convolutions in Convolutional Neural Networks

abstract: Optical imaging systems are inherently limited in their resolution due to the point spread function (PSF), which applies a static, yet spatially-varying, convolution to the image. This degradation can be addressed via Convolutional Neural Networks (CNNs), particularly through deblurring techniques. However, current solutions face certain limitations in efficiently computing spatially-varying convolutions. In this paper we propose CoordGate, a novel lightweight module that uses a multiplicative gate and a coordinate encoding network to enable efficient computation of spatially-varying convolutions in CNNs. CoordGate allows for selective amplification or attenuation of filters based on their spatial position, effectively acting like a locally connected neural network. The effectiveness of the CoordGate solution is demonstrated within the context of U-Nets and applied to the challenging problem of image deblurring. The experimental results show that CoordGate outperforms conventional approaches, offering a more robust and spatially aware solution for CNNs in various computer vision applications.


title: Production of true para-muonium in linearly polarized photon fusions

abstract: True muonium (TM) -- the bound state of $\mu^+\mu^-$ -- has not been discovered yet. It was demonstrated that searching for TM via $\gamma\gamma$ fusions in heavy ion collisions is feasible due to the enhancement of the atom number. We study the production of the true para-muonium (pTM) in the collisions of linearly polarized photons in the experiments of heavy-ion collisions, calculate the production rate as well as the transverse spectrum of pTM, and explore the discovery potential in nuclear experiments. Our results show that there is a significant correlation between the linearly polarized photon distribution and the transverse momentum distribution of pTM. The optimal kinematic region of the generated pTM is identified, which can provide a theoretical guide to the detection of pTM in experiments.


title: Mixture of multilayer stochastic block models for multiview clustering

abstract: In this work, we propose an original method for aggregating multiple clustering coming from different sources of information. Each partition is encoded by a co-membership matrix between observations. Our approach uses a mixture of multilayer Stochastic Block Models (SBM) to group co-membership matrices with similar information into components and to partition observations into different clusters, taking into account their specificities within the components. The identifiability of the model parameters is established and a variational Bayesian EM algorithm is proposed for the estimation of these parameters. The Bayesian framework allows for selecting an optimal number of clusters and components. The proposed approach is compared using synthetic data with consensus clustering and tensor-based algorithms for community detection in large-scale complex networks. Finally, the method is utilized to analyze global food trading networks, leading to structures of interest.


title: Castelnuovo-Mumford regularity of the closed neighborhood ideal of a graph

abstract: Let $G$ be a finite simple graph and let $NI(G)$ denote the closed neighborhood ideal of $G$ in a polynomial ring $R$. We show that if $G$ is a forest, then the Castelnuovo-Mumford regularity of $R/NI(G)$ is the same as the matching number of $G$, thus proving a conjecture of Sharifan and Moradi in the affirmative. We also show that if $G$ contains a simplicial vertex, then $NI(G)$ admits a Betti splitting, and consequently, the matching number of $G$ provides a lower bound for the Castelnuovo-Mumford regularity of $R/NI(G)$ when $G$ is a chordal graph, unicyclic graph, complete bipartite graph, or the wheel graph. For forests and unicyclic graphs, we show that the projective dimension of $R/NI(G)$ is also bounded below by the matching number of $G$. Moreover, we investigate the relationship between the regularity and the matching number for two graph operations, namely, the join and the corona product of two graphs.


title: Emergence of Larkin-Ovchinnikov-type superconducting state in a voltage-driven superconductor

abstract: We theoretically investigate a voltage-biased normal metal-superconductor-normal metal (N-S-N) junction. Using the nonequilibrium Green's function technique, we derive a quantum kinetic equation, to determine the superconducting order parameter self-consistently. The derived equation is an integral-differential equation with memory effects. We solve this equation by converting it into a system of ordinary differential equations with the use of a pole expansion of the Fermi-Dirac function. When the applied voltage exceeds the critical value, the superconductor switches to the normal state. We find that when the voltage is decreased from the normal phase, the system relaxes to a Larkin-Ovchinnikov (LO)-type inhomogeneous superconducting state, even in the absence of a magnetic Zeeman field. We point out that the emergence of the LO-type state can be attributed to the nonequilibrium energy distribution of electrons due to the bias voltage. We also point out that the system exhibits bistability, which leads to hysteresis in the voltage-current characteristic of the N-S-N junction.


title: Neutral electronic excitations and derivative discontinuities: An extended $N$-centered ensemble density functional theory perspective

abstract: This work merges two different types of many-electron ensembles, namely the Theophilou-Gross-Oliveira-Kohn ensembles of ground and neutrally-excited states, and the more recent $N$-centered ensembles of neutral and charged ground states. On that basis, an in-principle exact and general, so-called extended $N$-centered, ensemble density-functional theory of charged and neutral electronic excitations is derived. We revisit in this context the concept of density-functional derivative discontinuity for neutral excitations, without ever invoking nor using the asymptotic behavior of the ensemble electronic density. The present mathematical construction fully relies on the weight dependence of the ensemble Hartree-exchange-correlation density-functional energy, which makes the theory applicable to lattice models and opens new perspectives for the description of gaps in mesoscopic systems.


title: Weighted likelihood methods for robust fitting of wrapped models for $p$-torus data

abstract: We consider robust estimation of wrapped models to multivariate circular data that are points on the surface of a $p$-torus based on the weighted likelihood methodology.Robust model fitting is achieved by a set of weighted likelihood estimating equations, based on the computation of data dependent weights aimed to down-weight anomalous values, such as unexpected directions that do not share the main pattern of the bulk of the data. Weighted likelihood estimating equations with weights evaluated on the torus orobtained after unwrapping the data onto the Euclidean space are proposed and compared. Asymptotic properties and robustness features of the estimators under study have been studied, whereas their finite sample behavior has been investigated by Monte Carlo numerical experiment and real data examples.


title: Improved Weak Lensing Photometric Redshift Calibration via StratLearn and Hierarchical Modeling

abstract: Discrepancies between cosmological parameter estimates from cosmic shear surveys and from recent Planck cosmic microwave background measurements challenge the ability of the highly successful $\Lambda$CDM model to describe the nature of the Universe. To rule out systematic biases in cosmic shear survey analyses, accurate redshift calibration within tomographic bins is key. In this paper, we improve photo-$z$ calibration via Bayesian hierarchical modeling of full galaxy photo-$z$ conditional densities, by employing $\textit{StratLearn}$, a recently developed statistical methodology, which accounts for systematic differences in the distribution of the spectroscopic training/source set and the photometric target set. Using realistic simulations that were designed to resemble the KiDS+VIKING-450 dataset, we show that $\textit{StratLearn}$-estimated conditional densities improve the galaxy tomographic bin assignment, and that our $\textit{StratLearn}$-Bayesian framework leads to nearly unbiased estimates of the target population means. This leads to a factor of $\sim 2$ improvement upon the previously best photo-$z$ calibration method. Our approach delivers a maximum bias per tomographic bin of $\Delta \langle z \rangle = 0.0095 \pm 0.0089$, with an average absolute bias of $0.0052 \pm 0.0067$ across the five tomographic bins.


title: North-South asymmetries in the Galactic thin disk associated with the vertical phase spiral as seen using LAMOST-Gaia stars

abstract: We select 1,052,469 (754,635) thin disk stars from {\it Gaia} eDR3 and LAMOST DR7 in the range of Galactocentric radius $R$ (guiding center radius $R_\mathrm{g}$) from 8 to 11\,kpc to investigate the asymmetries between the North and South of the disk midplane. More specifically we analyze the vertical velocity dispersion profiles ($\sigma_{v_{z}}(z$)) in different bins of $R$ ($R_\mathrm{g}$) and $[\mathrm{Fe/H}]$. We find troughs in the profiles of $\sigma_{v_{z}}(z)$ located in both the North ($z \sim 0.7$\,kpc) and South ($z \sim -0.5$\,kpc) of the disk at all radial and chemical bins studied. The difference between the Northern and Southern vertical velocity dispersion profiles ($\Delta\sigma_{v_{z}}(|z|)$) shows a shift between curves of different $R$ and $R_\mathrm{g}$. A similar shift exists in these NS asymmetry profiles further divided into different $[\mathrm{Fe/H}]$ ranges. The sample binned with $R_\mathrm{g}$ more clearly displays the features in the velocity dispersion profiles. The shift in the peaks of the $\Delta\sigma_{v_{z}}$ profiles and the variation in the phase spiral shape binned by metallicity indicate the variation of the vertical potential profiles and the radial metallicity gradient. The wave-like signal in NS asymmetry of $\sigma_{v_{z}}(z)$ largely originates from phase spiral; while the NS asymmetry profiles of [Fe/H] only display a weak wave-like feature near solar radius. We perform a test particle simulation to qualitatively reproduce the observed results. A quantitative explanation of the NS asymmetry in the metallicity profile needs careful consideration of the spiral shape and the perturbation model, and we leave this for future work.


title: Efficient estimation for ergodic diffusion processes sampled at high frequency

abstract: A general theory of efficient estimation for ergodic diffusion processes sampled at high frequency with an infinite time horizon is presented. High frequency sampling is common in many applications, with finance as a prominent example. The theory is formulated in term of approximate martingale estimating functions and covers a large class of estimators including most of the previously proposed estimators for diffusion processes. Easily checked conditions ensuring that an estimating function is an approximate martingale are derived, and general conditions ensuring consistency and asymptotic normality of estimators are given. Most importantly, simple conditions are given that ensure rate optimality and efficiency. Rate optimal estimators of parameters in the diffusion coefficient converge faster than estimators of drift coefficient parameters because they take advantage of the information in the quadratic variation. The conditions facilitate the choice among the multitude of estimators that have been proposed for diffusion models. Optimal martingale estimating functions in the sense of Godambe and Heyde and their high frequency approximations are, under weak conditions, shown to satisfy the conditions for rate optimality and efficiency. This provides a natural feasible method of constructing explicit rate optimal and efficient estimating functions by solving a linear equation.


title: In-vivo blood pressure sensing with bi-filler nanocomposite

abstract: Conductive elastomers present desirable qualities for sensing pressure in-vivo, such as high piezoresistance in tiny volumes, conformability and, biocompatibility. Many PDMS-based electrically conductive nanocomposites however, are susceptible to electrical drift following repeated stress cycles and chemical aging. Innovative approaches are needed to stabilize their percolation network against deformation to improve reproducibility and facilitate sensor calibration. One approach we propose here is to decouple the tunnelling-percolation network of HOPG nanoparticles from the incomplete viscoelastic recovery of the PDMS matrix by inserting minute amounts of insulating SiO$_2$ nanospheres. SiO$_2$ nanospheres effectively reduce the number of nearest neighbours at each percolation node switching off the parallel electrical pathways that might become activated by incomplete viscoelastic relaxation. We varied the size of SiO$_2$ nanospheres and their filling fraction to demonstrate nearly complete piezoresistance recovery when SiO$_2$ and HOPG nanoparticles have equal diameters ($\approx$400nm) and SiO$_2$ and HOPG volume fractions are 1% and 29.5% respectively. We demonstrate an in-vivo blood pressure sensor based on this bi-filler composite.


title: AI-based Mapping of the Conservation Status of Orchid Assemblages at Global Scale

abstract: Although increasing threats on biodiversity are now widely recognised, there are no accurate global maps showing whether and where species assemblages are at risk. We hereby assess and map at kilometre resolution the conservation status of the iconic orchid family, and discuss the insights conveyed at multiple scales. We introduce a new Deep Species Distribution Model trained on 1M occurrences of 14K orchid species to predict their assemblages at global scale and at kilometre resolution. We propose two main indicators of the conservation status of the assemblages: (i) the proportion of threatened species, and (ii) the status of the most threatened species in the assemblage. We show and analyze the variation of these indicators at World scale and in relation to currently protected areas in Sumatra island. Global and interactive maps available online show the indicators of conservation status of orchid assemblages, with sharp spatial variations at all scales. The highest level of threat is found at Madagascar and the neighbouring islands. In Sumatra, we found good correspondence of protected areas with our indicators, but supplementing current IUCN assessments with status predictions results in alarming levels of species threat across the island. Recent advances in deep learning enable reliable mapping of the conservation status of species assemblages on a global scale. As an umbrella taxon, orchid family provides a reference for identifying vulnerable ecosystems worldwide, and prioritising conservation actions both at international and local levels.


title: Comparative Evaluation of Animated Scatter Plot Transitions

abstract: Scatter plots are popular for displaying 2D data, but in practice, many data sets have more than two dimensions. For the analysis of such multivariate data, it is often necessary to switch between scatter plots of different dimension pairs, e.g., in a scatter plot matrix (SPLOM). Alternative approaches include a "grand tour" for an overview of the entire data set or creating artificial axes from dimensionality reduction (DR). A cross-cutting concern in all techniques is the ability of viewers to find correspondence between data points in different views. Previous work proposed animations to preserve the mental map between view changes and to trace points as well as clusters between scatter plots of the same underlying data set. In this paper, we evaluate a variety of spline- and rotation-based view transitions in a crowdsourced user study focusing on ecological validity. Using the study results, we assess each animation's suitability for tracing points and clusters across view changes. We evaluate whether the order of horizontal and vertical rotation is relevant for task accuracy. The results show that rotations with an orthographic camera or staged expansion of a depth axis significantly outperform all other animation techniques for the traceability of individual points. Further, we provide a ranking of the animated transition techniques for traceability of individual points. However, we could not find any significant differences for the traceability of clusters. Furthermore, we identified differences by animation direction that could guide further studies to determine potential confounds for these differences. We publish the study data for reuse and provide the animation framework as a D3.js plug-in.


title: Co-Clustering Multi-View Data Using the Latent Block Model

abstract: The Latent Block Model (LBM) is a prominent model-based co-clustering method, returning parametric representations of each block cluster and allowing the use of well-grounded model selection methods. The LBM, while adapted in literature to handle different feature types, cannot be applied to datasets consisting of multiple disjoint sets of features, termed views, for a common set of observations. In this work, we introduce the multi-view LBM, extending the LBM method to multi-view data, where each view marginally follows an LBM. In the case of two views, the dependence between them is captured by a cluster membership matrix, and we aim to learn the structure of this matrix. We develop a likelihood-based approach in which parameter estimation uses a stochastic EM algorithm integrating a Gibbs sampler, and an ICL criterion is derived to determine the number of row and column clusters in each view. To motivate the application of multi-view methods, we extend recent work developing hypothesis tests for the null hypothesis that clusters of observations in each view are independent of each other. The testing procedure is integrated into the model estimation strategy. Furthermore, we introduce a penalty scheme to generate sparse row clusterings. We verify the performance of the developed algorithm using synthetic datasets, and provide guidance for optimal parameter selection. Finally, the multi-view co-clustering method is applied to a complex genomics dataset, and is shown to provide new insights for high-dimension multi-view problems.


title: Modeling dynamic crack branching in unsaturated porous media through multi-phase micro-periporomechanics

abstract: Dynamic crack branching in unsaturated porous media holds significant relevance in various fields, including geotechnical engineering, geosciences, and petroleum engineering. This article presents a numerical investigation into dynamic crack branching in unsaturated porous media using a recently developed coupled micro-periporomechanics paradigm. This paradigm extends the periporomechanics model by incorporating the micro-rotation of the solid skeleton. Within this framework, each material point is equipped with three degrees of freedom: displacement, micro-rotation, and fluid pressure. Consistent with the Cosserat continuum theory, a length scale associated with the micro-rotation of material points is inherently integrated into the model. This study encompasses several key aspects: (1) Validation of the coupled micro-periporomechanics paradigm for effectively modeling crack branching in deformable porous media, (2) Examination of the transition from a single branch to multiple branches in porous media under drained conditions, (3) Simulation of single crack branching in unsaturated porous media under dynamic loading conditions, and (4) Investigation of multiple crack branching in unsaturated porous media under dynamic loading conditions. The numerical results obtained in this study are systematically analyzed to elucidate the factors that influence dynamic crack branching in porous media subjected to dynamic loading. Furthermore, the comprehensive numerical findings underscore the efficacy and robustness of the coupled micro-periporomechanics paradigm in accurately modeling dynamic crack branching in variably saturated porous media.


title: Narrowing the Knowledge Evaluation Gap: Open-Domain Question Answering with Multi-Granularity Answers

abstract: Factual questions typically can be answered correctly at different levels of granularity. For example, both ``August 4, 1961'' and ``1961'' are correct answers to the question ``When was Barack Obama born?''. Standard question answering (QA) evaluation protocols, however, do not explicitly take this into account and compare a predicted answer against answers of a single granularity level. In this work, we propose GRANOLA QA, a novel evaluation setting where a predicted answer is evaluated in terms of accuracy and informativeness against a set of multi-granularity answers. We present a simple methodology for enriching existing datasets with multi-granularity answers, and create GRANOLA-EQ, a multi-granularity version of the EntityQuestions dataset. We evaluate a range of decoding methods on GRANOLA-EQ, including a new algorithm, called Decoding with Response Aggregation (DRAG), that is geared towards aligning the response granularity with the model's uncertainty. Our experiments show that large language models with standard decoding tend to generate specific answers, which are often incorrect. In contrast, when evaluated on multi-granularity answers, DRAG yields a nearly 20 point increase in accuracy on average, which further increases for rare entities. Overall, this reveals that standard evaluation and decoding schemes may significantly underestimate the knowledge encapsulated in LMs.


title: World Wine Exports: What Determines the Success of New World Wine Producers?

abstract: By using an econometric approach this paper looks at the evolution of the world wine industry in the period 1961-2005. A particular stylized fact is the appearance of nontraditional producing and exporting countries of wine from the beginning of the nineties. We show that the success of these new producing and exporting countries can be explained by the importance of the demand from non-producing countries with little or no tradition of wine consumption, relative to the world demand. This stylized fact is consistent with a testable implication of the switching cost literature and to the best of our knowledge this is the first time that this implication is tested.


title: NIPn CHIPS

abstract: We give general conditions under which classes of valued fields have NIPn transfer and generalize the Anscombe-Jahnke classification of NIP henselian valued fields to NIPn henselian valued fields.


title: Caustic and hydrostatic mass bias: Implications for modified gravity

abstract: We propose and perform a joint analysis of the two different mass estimates of galaxy clusters, namely the hydrostatic and caustic techniques. Firstly, we show comprehensively that the mass bias between these two techniques can be possibly alleviated when cluster-specific assumptions constrained using the hydrostatic technique are utilized within the caustic technique. While at face value this demotes the caustic technique from a completely independent method, this allows one to further tighten the constraints on the cluster mass and subsequently, allow us to test modifications to gravity. Implementing the aforementioned formalism for two well-observed massive galaxy clusters, A2029 and A2142, we highlight the proof of concept. In the current implementation, we use this method to constrain the Chameleon screening and Vainshtein screening. As anticipated, we show that the joint analysis can help improve the constraints on these modified gravity scenarios.


title: Extended inverse theorems for $h$-fold sumsets in integers

abstract: Let $h \geq 2$, $k \geq 5$ be integers and $A$ be a nonempty finite set of $k$ integers. Very recently, Tang and Xing studied extended inverse theorems for $hk-h+1 < \left|hA\right| \leq hk+2h-3$. In this paper, we extend the work of Tang and Xing and study all possible inverse theorems for $hk-h+1<\left|hA\right| \leq hk+3h-4$. Furthermore, we give a range of $|hA|$ for which inverse problems are not possible.


title: Model Editing Harms General Abilities of Large Language Models: Regularization to the Rescue

abstract: Model editing is a technique that edits the large language models (LLMs) with updated knowledge to alleviate hallucinations without resource-intensive retraining. While current model editing methods can effectively modify a model's behavior within a specific area of interest, they often overlook the potential unintended side effects on the general abilities of LLMs such as reasoning, natural language inference, and question answering. In this paper, we raise concerns that model editing's improvements on factuality may come at the cost of a significant degradation of the model's general abilities. We systematically analyze the side effects by evaluating four popular editing methods on three LLMs across eight representative tasks. Our extensive empirical experiments show that it is challenging for current editing methods to simultaneously improve factuality of LLMs and maintain their general abilities. Our analysis reveals that the side effects are caused by model editing altering the original model weights excessively, leading to overfitting to the edited facts. To mitigate this, a method named RECT (RElative Change in weighT) is proposed to regularize the edit update weights. Evaluation results show that RECT can significantly mitigate the side effects of editing while still maintaining over 94% editing performance.


title: HiRace: Accurate and Fast Source-Level Race Checking of GPU Programs

abstract: Data races are egregious parallel programming bugs on CPUs. They are even worse on GPUs due to the hierarchical thread and memory structure, which makes it possible to write code that is correctly synchronized within a thread group while not being correct across groups. Thus far, all major data-race checkers for GPUs suffer from at least one of the following problems: they do not check races in global memory, do not work on recent GPUs, scale poorly, have not been extensively tested, miss simple data races, or are not dependable without detailed knowledge of the compiler. Our new data-race detection tool, HiRace, overcomes these limitations. Its key novelty is an innovative parallel finite-state machine that condenses an arbitrarily long access history into a constant-length state, thus allowing it to handle large and long-running programs. HiRace is a dynamic tool that checks for thread-group shared memory and global device memory races. It utilizes source-code instrumentation, thus avoiding driver, compiler, and hardware dependencies. We evaluate it on a modern calibrated data-race benchmark suite. On the 580 tested CUDA kernels, 346 of which contain data races, HiRace finds races missed by other tools without false alarms and is more than 10 times faster on average than the current state of the art, while incurring only half the memory overhead.


title: Scaling Laws And Statistical Properties of The Transaction Flows And Holding Times of Bitcoin

abstract: We study the temporal evolution of the holding-time distribution of bitcoins and find that the average distribution of holding-time is a heavy-tailed power law extending from one day to over at least $200$ weeks with an exponent approximately equal to $0.9$, indicating very long memory effects. We also report significant sample-to-sample variations of the distribution of holding times, which can be best characterized as multiscaling, with power-law exponents varying between $0.3$ and $2.5$ depending on bitcoin price regimes. We document significant differences between the distributions of book-to-market and of realized returns, showing that traders obtain far from optimal performance. We also report strong direct qualitative and quantitative evidence of the disposition effect in the Bitcoin Blockchain data. Defining age-dependent transaction flows as the fraction of bitcoins that are traded at a given time and that were born (last traded) at some specific earlier time, we document that the time-averaged transaction flow fraction has a power law dependence as a function of age, with an exponent close to $-1.5$, a value compatible with priority queuing theory. We document the existence of multifractality on the measure defined as the normalized number of bitcoins exchanged at a given time.


title: Ion Type Dependence of DNA Electronic Excitation in Water under Proton, alpha-particle, and Carbon Ion Irradiation: A First-Principles Simulation Study

abstract: Understanding how the electronic excitation of DNA changes in response to different high-energy particles is central to advancing ion beam cancer therapy. While protons have been the predominant ion of choice in beam cancer therapy, heavier ions, particularly carbon ions, have drawn significant attention over the past decade. Carbon ions are expected to transfer larger amounts of energy accordingly to the linear response theory. However, the molecular-level details of the electronic excitation under heavier ion irradiation remain unknown. In this work, we use real-time time-dependent density functional theory simulations to examine the quantum-mechanical details of DNA electronic excitations in water under proton, alpha-particle, and carbon ion irradiation. Our results show that the energy transfer does indeed increase for the heavier ions, while the excitation remains highly conformal. However, the increase in the energy transfer rate, measured by electronic stopping power, does not match the prediction by the linear response model, even when accounting for the velocity-dependence of the irradiating ions charge. The simulations also reveal that while the number of holes generated on DNA increases for heavier ions, the increase is only partially responsible for the larger stopping power. Larger numbers of highly energetic holes formed from the heavier ions also contribute significantly to the increased electronic stopping power.


title: All Segal objects are monads in generalised spans

abstract: We extend Barwick's and Haugseng's construction of the double $\infty$-category of spans in a pullback-complete $\infty$-category $\mathfrak{C}$ to more general shapes: for a large class of algebraic patterns $\mathfrak{P}$, we define a $\mathfrak{P}$-monoidal $\infty$-category of $\mathfrak{P}$-shaped spans in $\mathfrak{C}$, and we identify monads in it with Segal $\mathfrak{P}$-objects in $\mathfrak{C}$. For the cell pattern $\Theta^{\mathrm{op}}$, this recovers a homotopical reformulation of Batanin's original definition of weak $\omega$-categories, and in general can be seen as a variant of the generalised multicategories of Burroni, Hermida, Leinster and Cruttwell-Shulman.


title: EV-EcoSim: A grid-aware co-simulation platform for the design and optimization of electric vehicle charging infrastructure

abstract: To enable the electrification of transportation systems, it is important to understand how technologies such as grid storage, solar photovoltaic systems, and control strategies can aid the deployment of electric vehicle charging at scale. In this work, we present EV-EcoSim, a co-simulation platform that couples electric vehicle charging, battery systems, solar photovoltaic systems, grid transformers, control strategies, and power distribution systems, to perform cost quantification and analyze the impacts of electric vehicle charging on the grid. This python-based platform can run a receding horizon control scheme for real-time operation and a one-shot control scheme for planning problems, with multi-timescale dynamics for different systems to simulate realistic scenarios. We demonstrate the utility of EV-EcoSim through a case study focused on economic evaluation of battery size to reduce electricity costs while considering impacts of fast charging on the power distribution grid. We present qualitative and quantitative evaluations on the battery size in tabulated results. The tabulated results delineate the trade-offs between candidate battery sizing solutions, providing comprehensive insights for decision-making under uncertainty. Additionally, we demonstrate the implications of the battery controller model fidelity on the system costs and show that the fidelity of the battery controller can completely change decisions made when planning an electric vehicle charging site.


title: Entanglement inside a black hole before the Page time

abstract: We investigate the evolution of entanglement within an open, strongly coupled system interacting with a heat bath as its environment, in the frameworks of both the doubly holographic model and the Sachdev-Ye-Kitaev (SYK) model. Generally, the entanglement within the system initially increases as a result of internal interactions; however, it eventually dissipates into the environment. In the doubly holographic setup, we consider an end-of-the-world brane in the bulk to represent an eternal black hole hermalized by holographic matters. The reflected entropy between the bipartition of a large black hole exhibits a ramp-plateau-slump behavior, where the plateau arises due to the phase transition of the entanglement wedge cross-section before the Page time. In quantum mechanics, we consider a double copy of the SYK-plus-bath system in a global thermofield double state, resembling an eternal black hole interacting with an environment. The R\'enyi mutual information within the double-copied SYK clusters exhibits a ramp-plateau-slope-stabilizing behavior. The dynamic behaviors of the entanglement quantities observed in these two models are attributable to the competition between the internal interaction of the system and the external interaction with the baths. Our study provides a fine-grained picture of the dynamics of entanglement inside black holes before their Page time.


title: RNA-TransCrypt: Image Encryption Using Chaotic RNA Encoding, Novel Transformative Substitution, and Tailored Cryptographic Operations

abstract: Given the security concerns of Internet of Things (IoT) networks and limited computational resources of IoT devices, this paper presents RNA-TransCrypt, a novel image encryption scheme that is not only highly secure but also efficient and lightweight. RNA-TransCrypt integrates the biocryptographic properties of RNA encoding with the non-linearity and unpredictability of chaos theory. This scheme introduces three novel contributions: 1) the two-base RNA encoding method, which transforms the image into RNA strands-like sequence, ensuring efficient scrambling; 2) the transformative substitution technique, which transforms the s-box values before replacing the pixel values, and is responsible for making the scheme lightweight; and 3) three mathematical cryptographic operations designed especially for image encryption that ensure the effective transformation of the s-box values, resulting in a new outcome even for the same input values. These modules are key-dependent, utilizing chaotic keys generated by the De Jong Fractal Map and the Van der Pol Oscillator. Extensive security analysis, including histogram analysis, correlation analysis, and the results of the statistical security parameters obtained from the Gray-Level Co-occurrence Matrix (GLCM) validate the efficacy of the proposed scheme in encrypting input images with close-to-ideal results of 7.997 entropy and 0.0006 correlation.


title: Astrobiological Potential of Venus Atmosphere Chemical Anomalies and Other Unexplained Cloud Properties

abstract: Long-standing unexplained Venus atmosphere observations and chemical anomalies point to unknown chemistry but also leave room for the possibility of life. The unexplained observations include several gases out of thermodynamic equilibrium (e.g. tens of ppm O2, the possible presence of PH3 and NH3, SO2 and H2O vertical abundance profiles), an unknown composition of large, lower cloud particles, and the "unknown absorber(s)". Here we first review relevant properties of the Venus atmosphere and then describe the atmospheric chemical anomalies and how they motivate future astrobiology missions to Venus.


title: The infalling elliptical galaxy M89: The chemical composition of the AGN disturbed hot atmosphere

abstract: The chemical enrichment of X-ray-emitting hot atmospheres has hitherto been primarily studied in galaxy clusters. These studies revealed relative abundances of heavy elements that are remarkably similar to Solar. Here, we present measurements of the metal content of M89 (NGC 4552), an elliptical galaxy infalling into the Virgo cluster with a $\sim$10 kpc ram-pressure stripped X-ray tail. We take advantage of deep Chandra and XMM-Newton observations, and with particular attention to carefully modelling the spectra, we measure the O/Fe, Ne/Fe, Mg/Fe, Si/Fe and S/Fe ratios. Contrary to previous measurements in galaxy clusters, our results for the hot atmosphere of M89 suggest super-Solar abundance ratios with respect to iron (i.e. $\alpha$/Fe > 1), similar to its stellar components. Our analysis of the active galactic nucleus (AGN) activity in this system indicates that the AGN-induced outflow could have facilitated the stripping of the original galactic atmosphere, which has been replaced with fresh stellar mass loss material with super-Solar $\alpha$/Fe abundance ratios. Additionally, we report a new fitting bias in the RGS data of low-temperature plasma. The measured O/Fe ratios are >1$\sigma$ lower in multi-temperature models than a single temperature fit, leading to discrepancies in the calculations of supernova fractions derived from the metal abundances.


title: Re-energisation of AGN head-tail radio galaxies in the galaxy cluster ZwCl0634.1+47474

abstract: Low-frequency radio observations show an increasing number of radio galaxies located in galaxy clusters that display peculiar morphologies and spectral profiles. This is the result of the dynamical interaction of the galaxy with the surrounding medium. Studying this phenomenon is key to understanding the evolution of low-energy relativistic particles in the intracluster medium. We present a multi-frequency study of the three head-tail (HT) radio galaxies and the radio halo in the galaxy cluster ZwCl0634.1+4747. We make use of observations at four frequencies performed with LOFAR LBA (53 MHz), HBA (144 MHz), GMRT (323 MHz) and VLA (1518 MHz) data. The use of extremely low radio frequency observations, such as LOFAR at 53 and 144 MHz, allowed us to detect the extension of the tails up to a distance of ~ 1 Mpc. We extracted spectral profiles along the tails in order to identify possible departures from a pure ageing model, such as the Jaffe-Perola (JP) model, which only involves synchrotron and inverse-Compton losses. We found clear evidence of departures from this simple ageing model, such as surface brightness enhancement and spectral flattening along all of the tails. This can be interpreted as the consequence of particle re-acceleration along the tails. Possible explanations for this behaviour include the interaction between a shock and the radio tails or a turbulence-driven re-acceleration mechanism. We show that the latter scenario is able to reproduce the characteristic features that we observed in our profiles.


title: Autobiographical Notes of a Physicist

abstract: I describe aspects of my life in physics: the name I publish under, great physicists I have known, how I got into quantum foundations, what role I've played in it. My form is autobiographical, but my personal experience may illustrate what it was like being a physicist over the past 60 years. I offer some offbeat ways of thinking about some orthodox physics.


title: Effective Potential for Conformal Factor and GL(4) Symmetry

abstract: We revisit the issue that the effective potential for the conformal factor of the metric, which is generated by quantized matter fields, possesses a non-vanishing vacuum expectation value (VEV) or not. We prove that the effective potential has a vanishing vacuum expectation value on the basis of a global $GL(4)$ symmetry. We also account for the reason why there seem to be two different effective potentials for the conformal factor in a theory, one of which gives rise to a vanishing VEV for the conformal factor whereas the other does a non-vanishing VEV.


title: Atomic Layer Molecular Beam Epitaxy of Kagome Magnet RMn$_6$Sn$_6$ (R = Er, Tb) Thin Films

abstract: Kagome lattices have garnered substantial interest because their band structure consists of topological flat bands and Dirac cones. The RMn$_6$Sn$_6$ (R = rare earth) compounds are particularly interesting because of the existence of large intrinsic anomalous Hall effect (AHE) which originates from the gapped Dirac cones near the Fermi level. This makes RMn$_6$Sn$_6$ an outstanding candidate for realizing the high-temperature quantum anomalous Hall effect. The growth of RMn$_6$Sn$_6$ thin films is beneficial for both fundamental research and potential applications. However, most of the studies on RMn$_6$Sn$_6$ have focused on bulk crystals so far, and the synthesis of RMn$_6$Sn$_6$ thin films has not been reported so far. Here we report the atomic layer molecular beam epitaxy growth, structural and magnetic characterizations, and transport properties of ErMn$_6$Sn$_6$ and TbMn$_6$Sn$_6$ thin films. It is especially noteworthy that TbMn$_6$Sn$_6$ thin films have out-of-plane magnetic anisotropy, which is important for realizing the quantum anomalous Hall effect. Our work paves the avenue toward the control of the AHE using devices patterned from RMn$_6$Sn$_6$ thin films.


title: Bin Packing under Random-Order: Breaking the Barrier of 3/2

abstract: Best-Fit is one of the most prominent and practically used algorithms for the bin packing problem, where a set of items with associated sizes needs to be packed in the minimum number of unit-capacity bins. Kenyon [SODA '96] studied online bin packing under random-order arrival, where the adversary chooses the list of items, but the items arrive one by one according to an arrival order drawn uniformly randomly from the set of all permutations of the items. Kenyon's seminal result established an upper bound of $1.5$ and a lower bound of $1.08$ on the random-order ratio of Best-Fit, and it was conjectured that the true ratio is $\approx 1.15$. The conjecture, if true, will also imply that Best-Fit (on randomly permuted input) has the best performance guarantee among all the widely-used simple algorithms for (offline) bin packing. This conjecture has remained one of the major open problems in the area, as highlighted in the recent survey on random-order models by Gupta and Singla [Beyond the Worst-Case Analysis of Algorithms '20]. Recently, Albers et al. [Algorithmica '21] improved the upper bound to $1.25$ for the special case when all the item sizes are greater than $1/3$, and they improve the lower bound to $1.1$. Ayyadevara et al. [ICALP '22] obtained an improved result for the special case when all the item sizes lie in $(1/4, 1/2]$, which corresponds to the $3$-partition problem. The upper bound of $3/2$ for the general case, however, has remained unimproved. In this paper, we make the first progress towards the conjecture, by showing that Best-Fit achieves a random-order ratio of at most $1.5 - \varepsilon$, for a small constant $\varepsilon>0$. Furthermore, we establish an improved lower bound of $1.144$ on the random-order ratio of Best-Fit, nearly reaching the conjectured ratio.


title: An Effective Theory for Graphene Nanoribbons with Junctions

abstract: Graphene nanoribbons are a promising candidate for fault-tolerant quantum electronics. In this scenario, qubits are realised by localised states that can emerge on junctions in hybrid ribbons formed by two armchair nanoribbons of different widths. We derive an effective theory based on a tight-binding ansatz for the description of hybrid nanoribbons and use it to make accurate predictions of the energy gap and nature of the localisation in various hybrid nanoribbon geometries. We use quantum Monte Carlo simulations to demonstrate that the effective theory remains applicable in the presence of Hubbard interactions. We discover, in addition to the well known localisations on junctions, which we call `Fuji', a new type of `Kilimanjaro' localisation smeared out over a segment of the hybrid ribbon. We show that Fuji localisations in hybrids of width $N$ and $N+2$ armchair nanoribbons occur around symmetric junctions if and only if $N\pmod3=1$, while edge-aligned junctions never support strong localisation. This behaviour cannot be explained relying purely on the topological $Z_2$ invariant, which has been believed the origin of the localisations to date.

categories: cond-mat.mes-hall cond-mat.str-el hep-ph quant-ph


title: Low-Resource Vision Challenges for Foundation Models

abstract: Low-resource settings are well-established in natural language processing, where many languages lack sufficient data for deep learning at scale. However, low-resource problems are under-explored in computer vision. In this paper, we address this gap and explore the challenges of low-resource image tasks with vision foundation models. We first collect a benchmark of genuinely low-resource image data, covering historic maps, circuit diagrams, and mechanical drawings. These low-resource settings all share three challenges: data scarcity, fine-grained differences, and the distribution shift from natural images to the specialized domain of interest. While existing foundation models have shown impressive generalizability, we find they cannot transfer well to our low-resource tasks. To begin to tackle the challenges of low-resource vision, we introduce one simple baseline per challenge. Specifically, we i) enlarge the data space by generative models, ii) adopt the best sub-kernels to encode local regions for fine-grained difference discovery and iii) learn attention for specialized domains. Experiments on our three low-resource tasks demonstrate our proposals already provide a better baseline than transfer learning, data augmentation, and fine-grained methods. This highlights the unique characteristics and challenges of low-resource vision for foundation models that warrant further investigation. Project page: https://xiaobai1217.github.io/Low-Resource-Vision/.


title: Analytical solutions for optimal photon absorption into inhomogeneous spin memories

abstract: We investigate for optimal photon absorption a quantum electrodynamical model of an inhomogeneously-broadened spin ensemble coupled to a single-mode cavity. We consider a one-photon input pulse and obtain a simple one-parameter form for its optimal shape for absorption in the spin ensemble. Solutions to this problem are developed without using perturbation theory concerning the spin ensemble. Furthermore, we exploit the possibility of modulating the frequency and coupling rate of the resonator. We show some optimal scenarios and demonstrate the usefulness of our approach for the design of efficient quantum memories. In particular, we find the optimal cooperativity for different parameters and identify cases where absorption with a success probability larger than $99\%$ is achieved.


title: Jump Cut Smoothing for Talking Heads

abstract: A jump cut offers an abrupt, sometimes unwanted change in the viewing experience. We present a novel framework for smoothing these jump cuts, in the context of talking head videos. We leverage the appearance of the subject from the other source frames in the video, fusing it with a mid-level representation driven by DensePose keypoints and face landmarks. To achieve motion, we interpolate the keypoints and landmarks between the end frames around the cut. We then use an image translation network from the keypoints and source frames, to synthesize pixels. Because keypoints can contain errors, we propose a cross-modal attention scheme to select and pick the most appropriate source amongst multiple options for each key point. By leveraging this mid-level representation, our method can achieve stronger results than a strong video interpolation baseline. We demonstrate our method on various jump cuts in the talking head videos, such as cutting filler words, pauses, and even random cuts. Our experiments show that we can achieve seamless transitions, even in the challenging cases where the talking head rotates or moves drastically in the jump cut.


title: Inelastic electron scattering at large angles: the phonon polariton contribution

abstract: We explore the inelastic electron scattering in SrTiO3, PbTiO3, and SiC in their phonon energy range, challenging the assumption that phonon polaritons are excluded at large angles in high-resolution transmission electron energy-loss spectroscopy. We demonstrate that through multiple scattering, the electron beam can excite both phonons and phonon polaritons, and the relative proportion of each varies depending on the structure factor and scattering angle. Integrating dielectric theory, density functional theory, and multi-slice simulations, we provide a comprehensive framework for understanding these interactions in materials with polar optical phonons.


title: Low-resource finetuning of foundation models beats state-of-the-art in histopathology

abstract: To handle the large scale of whole slide images in computational pathology, most approaches first tessellate the images into smaller patches, extract features from these patches, and finally aggregate the feature vectors with weakly-supervised learning. The performance of this workflow strongly depends on the quality of the extracted features. Recently, foundation models in computer vision showed that leveraging huge amounts of data through supervised or self-supervised learning improves feature quality and generalizability for a variety of tasks. In this study, we benchmark the most popular vision foundation models as feature extractors for histopathology data. We evaluate the models in two settings: slide-level classification and patch-level classification. We show that foundation models are a strong baseline. Our experiments demonstrate that by finetuning a foundation model on a single GPU for only two hours or three days depending on the dataset, we can match or outperform state-of-the-art feature extractors for computational pathology. These findings imply that even with little resources one can finetune a feature extractor tailored towards a specific downstream task and dataset. This is a considerable shift from the current state, where only few institutions with large amounts of resources and datasets are able to train a feature extractor. We publish all code used for training and evaluation as well as the finetuned models.


title: Helicoidal surfaces of prescribed mean curvature in $\mathbb{R}^3$

abstract: Given a function $\mathcal{H} \in C^1(\mathbb{S}^2)$, an $\mathcal{H}$-surface $\Sigma$ is a surface in the Euclidean space $\mathbb{R}^3$ whose mean curvature $H_\Sigma$ satisfies $H_\Sigma = \mathcal{H} \circ \eta$, where $\eta$ is the Gauss map of $\Sigma$. The purpose of this paper is to use a phase space analysis to give some classification results for helicoidal $\mathcal{H}$-surfaces, when $\mathcal{H}$ is rotationally symmetric, that is, $\mathcal{H} \circ \eta = \mathfrak{h} \circ \nu$, for some $\mathfrak{h} \in C^1([-1,1])$, where $\nu$ is the angle function of the surface. We prove a classification theorem for the case where $\mathfrak{h}(t)$ is even and increasing for $t \in [0,1]$. Finally, we provide examples of helicoidal $\mathcal{H}$-surfaces in cases where $\mathfrak{h}$ vanishes at some point.


title: U-Mamba: Enhancing Long-range Dependency for Biomedical Image Segmentation

abstract: Convolutional Neural Networks (CNNs) and Transformers have been the most popular architectures for biomedical image segmentation, but both of them have limited ability to handle long-range dependencies because of inherent locality or computational complexity. To address this challenge, we introduce U-Mamba, a general-purpose network for biomedical image segmentation. Inspired by the State Space Sequence Models (SSMs), a new family of deep sequence models known for their strong capability in handling long sequences, we design a hybrid CNN-SSM block that integrates the local feature extraction power of convolutional layers with the abilities of SSMs for capturing the long-range dependency. Moreover, U-Mamba enjoys a self-configuring mechanism, allowing it to automatically adapt to various datasets without manual intervention. We conduct extensive experiments on four diverse tasks, including the 3D abdominal organ segmentation in CT and MR images, instrument segmentation in endoscopy images, and cell segmentation in microscopy images. The results reveal that U-Mamba outperforms state-of-the-art CNN-based and Transformer-based segmentation networks across all tasks. This opens new avenues for efficient long-range dependency modeling in biomedical image analysis. The code, models, and data are publicly available at https://wanglab.ai/u-mamba.html.


title: Spatio-temporal data fusion for the analysis of in situ and remote sensing data using the INLA-SPDE approach

abstract: We propose a Bayesian hierarchical model to address the challenge of spatial misalignment in spatio-temporal data obtained from in situ and satellite sources. The model is fit using the INLA-SPDE approach, which provides efficient computation. Our methodology combines the different data sources in a "fusion"" model via the construction of projection matrices in both spatial and temporal domains. Through simulation studies, we demonstrate that the fusion model has superior performance in prediction accuracy across space and time compared to standalone "in situ" and "satellite" models based on only in situ or satellite data, respectively. The fusion model also generally outperforms the standalone models in terms of parameter inference. Such a modeling approach is motivated by environmental problems, and our specific focus is on the analysis and prediction of harmful algae bloom (HAB) events, where the convention is to conduct separate analyses based on either in situ samples or satellite images. A real data analysis shows that the proposed model is a necessary step towards a unified characterization of bloom dynamics and identifying the key drivers of HAB events.


title: A parametrically programmable delay line for microwave photons

abstract: Delay lines capable of storing quantum information are crucial for advancing quantum repeaters and hardware efficient quantum computers. Traditionally, they are physically realized as extended systems that support wave propagation, such as waveguides. But such delay lines typically provide limited control over the propagating fields. Here, we introduce a parametrically addressed delay line (PADL) for microwave photons that provides a high level of control over the dynamics of stored pulses, enabling us to arbitrarily delay or even swap pulses. By parametrically driving a three-waving mixing superconducting circuit element that is weakly hybridized with an ensemble of resonators, we engineer a spectral response that simulates that of a physical delay line, while providing fast control over the delay line's properties and granting access to its internal modes. We illustrate the main features of the PADL, operating on pulses with energies on the order of a single photon, through a series of experiments, which include choosing which photon echo to emit, translating pulses in time, and swapping two pulses. We also measure the noise added to the delay line from our parametric interactions and find that the added noise is much less than one photon.


title: Basic fractional nonlinear-wave models and solitons

abstract: This review article provides a concise summary of one- and two-dimensional models for the propagation of linear and nonlinear waves in fractional media. The basic models, which originate from fractional quantum mechanics and more experimentally relevant setups emulating fractional diffraction in optics, are based on the Riesz definition of fractional derivatives, which are characterized by the respective Levy indices. Basic species of one-dimensional solitons, produced by the fractional models which include cubic or quadratic nonlinear terms, are outlined too. In particular, it is demonstrated that the variational approximation is relevant in many cases. A summary of the recently demonstrated experimental realization of the fractional group-velocity dispersion in fiber lasers is also presented.


title: Weighted degrees and truncated derived bibliographic networks

abstract: Large bibliographic networks are sparse -- the average node degree is small. This is not necessarily true for their product -- in some cases, it can ``explode'' (it is not sparse, increases in time and space complexity). An approach in such cases is to reduce the complexity of the problem by limiting our attention to a selected subset of important nodes and computing with corresponding truncated networks. The nodes can be selected by different criteria. An option is to consider the most important nodes in the derived network -- nodes with the largest weighted degree. It turns out that the weighted degrees in the derived network can be computed efficiently without computing the derived network itself.


title: Revisiting Adversarial Training at Scale

abstract: The machine learning community has witnessed a drastic change in the training pipeline, pivoted by those ''foundation models'' with unprecedented scales. However, the field of adversarial training is lagging behind, predominantly centered around small model sizes like ResNet-50, and tiny and low-resolution datasets like CIFAR-10. To bridge this transformation gap, this paper provides a modern re-examination with adversarial training, investigating its potential benefits when applied at scale. Additionally, we introduce an efficient and effective training strategy to enable adversarial training with giant models and web-scale data at an affordable computing cost. We denote this newly introduced framework as AdvXL. Empirical results demonstrate that AdvXL establishes new state-of-the-art robust accuracy records under AutoAttack on ImageNet-1K. For example, by training on DataComp-1B dataset, our AdvXL empowers a vanilla ViT-g model to substantially surpass the previous records of $l_{\infty}$-, $l_{2}$-, and $l_{1}$-robust accuracy by margins of 11.4%, 14.2% and 12.9%, respectively. This achievement posits AdvXL as a pioneering approach, charting a new trajectory for the efficient training of robust visual representations at significantly larger scales. Our code is available at https://github.com/UCSC-VLAA/AdvXL.


title: Morphable Diffusion: 3D-Consistent Diffusion for Single-image Avatar Creation

abstract: Recent advances in generative diffusion models have enabled the previously unfeasible capability of generating 3D assets from a single input image or a text prompt. In this work, we aim to enhance the quality and functionality of these models for the task of creating controllable, photorealistic human avatars. We achieve this by integrating a 3D morphable model into the state-of-the-art multi-view-consistent diffusion approach. We demonstrate that accurate conditioning of a generative pipeline on the articulated 3D model enhances the baseline model performance on the task of novel view synthesis from a single image. More importantly, this integration facilitates a seamless and accurate incorporation of facial expression and body pose control into the generation process. To the best of our knowledge, our proposed framework is the first diffusion model to enable the creation of fully 3D-consistent, animatable, and photorealistic human avatars from a single image of an unseen subject; extensive quantitative and qualitative evaluations demonstrate the advantages of our approach over existing state-of-the-art avatar creation models on both novel view and novel expression synthesis tasks. The code for our project is publicly available.


title: On the Effect of Contextual Information on Human Delegation Behavior in Human-AI collaboration

abstract: The constantly increasing capabilities of artificial intelligence (AI) open new possibilities for human-AI collaboration. One promising approach to leverage existing complementary capabilities is allowing humans to delegate individual instances to the AI. However, enabling humans to delegate instances effectively requires them to assess both their own and the AI's capabilities in the context of the given task. In this work, we explore the effects of providing contextual information on human decisions to delegate instances to an AI. We find that providing participants with contextual information significantly improves the human-AI team performance. Additionally, we show that the delegation behavior changes significantly when participants receive varying types of contextual information. Overall, this research advances the understanding of human-AI interaction in human delegation and provides actionable insights for designing more effective collaborative systems.


title: A Simple Baseline for Spoken Language to Sign Language Translation with 3D Avatars

abstract: The objective of this paper is to develop a functional system for translating spoken languages into sign languages, referred to as Spoken2Sign translation. The Spoken2Sign task is orthogonal and complementary to traditional sign language to spoken language (Sign2Spoken) translation. To enable Spoken2Sign translation, we present a simple baseline consisting of three steps: 1) creating a gloss-video dictionary using existing Sign2Spoken benchmarks; 2) estimating a 3D sign for each sign video in the dictionary; 3) training a Spoken2Sign model, which is composed of a Text2Gloss translator, a sign connector, and a rendering module, with the aid of the yielded gloss-3D sign dictionary. The translation results are then displayed through a sign avatar. As far as we know, we are the first to present the Spoken2Sign task in an output format of 3D signs. In addition to its capability of Spoken2Sign translation, we also demonstrate that two by-products of our approach-3D keypoint augmentation and multi-view understanding-can assist in keypoint-based sign language understanding. Code and models will be available at https://github.com/FangyunWei/SLRT