title: Spectra of typical Hilbert space operators

abstract: Let $\mathcal{B}(H)$ be the bounded, linear operators on a separable Hilbert space equipped with the norm topology. A property is called typical if the set of operators fulfilling the property is co-meager. We show that having non-empty continuous spectrum is a typical property and that the operators with non-empty point spectrum form a nowhere dense set. In addition we show that the set of operators with empty point spectrum is dense and characterize the closure of the set of those operators for which the spectrum and the point spectrum coincide.


title: Publicly-Detectable Watermarking for Language Models

abstract: We present a highly detectable, trustless watermarking scheme for LLMs: the detection algorithm contains no secret information, and it is executable by anyone. We embed a publicly-verifiable cryptographic signature into LLM output using rejection sampling. We prove that our scheme is cryptographically correct, sound, and distortion-free. We make novel uses of error-correction techniques to overcome periods of low entropy, a barrier for all prior watermarking schemes. We implement our scheme and make empirical measurements over open models in the 2.7B to 70B parameter range. Our experiments suggest that our formal claims are met in practice.


title: Methodological challenges of scenario generation validation: a rear-end crash-causation model for virtual safety assessment

abstract: Safety assessment of crash and conflict avoidance systems is important for both the automotive industry and other stakeholders. One type of system that needs such an assessment is a driver monitoring system (DMS) with some intervention (e.g., warning or nudging) when the driver looks off-road for too long. Although using computer simulation to assess safety systems is becoming increasingly common, it is not yet commonly used for systems that affect driver behavior, such as DMSs. Models that generate virtual crashes, taking crash-causation mechanisms into account, are needed to assess these systems. However, few such models exist, and those that do have not been thoroughly validated on real-world data. This study aims to address this research gap by validating a rear-end crash-causation model which is based on four crash-causation mechanisms related to driver behavior: a) off-road glances, b) too-short headway, c) not braking with the maximum deceleration possible, and d) sleepiness (not reacting before the crash). The pre-crash kinematics were obtained from the German GIDAS in-depth crash database. Challenges with the validation process were identified and addressed. Most notably, a process was developed to transform the generated crashes to mimic the crash severity distribution in GIDAS. This step was necessary because GIDAS does not include property-damage-only (PDO) crashes, while the generated crashes cover the full range of severities (including low-severity crashes, of which many are PDOs). Our results indicate that the proposed model is a reasonably good crash generator. We further demonstrated that the model is a valid method for assessing DMSs in virtual simulations; it shows the safety impact of shorter "longest" off-road glances. As expected, cutting away long off-road glances substantially reduces the number of crashes that occur and reduces the average delta-v.


title: Accelerating Kinetic Simulations of Electrostatic Plasmas with Reduced-Order Modeling

abstract: Despite the advancements in high-performance computing and modern numerical algorithms, the cost remains prohibitive for multi-query kinetic plasma simulations. In this work, we develop data-driven reduced-order models (ROM) for collisionless electrostatic plasma dynamics, based on the kinetic Vlasov-Poisson equation. Our ROM approach projects the equation onto a linear subspace defined by principal proper orthogonal decomposition (POD) modes. We introduce an efficient tensorial method to update the nonlinear term using a precomputed third-order tensor. We capture multiscale behavior with a minimal number of POD modes by decomposing the solution into multiple time windows using a physical-time indicator and creating a temporally-local ROM. Applied to 1D-1V simulations, specifically the benchmark two-stream instability case, our time-windowed reduced-order model (TW-ROM) with the tensorial approach solves the equation approximately 280 times faster than Eulerian simulations while maintaining a maximum relative error of 4% for the training data and 13% for the testing data.


title: Knowledge-based in silico models and dataset for the comparative evaluation of mammography AI for a range of breast characteristics, lesion conspicuities and doses

abstract: To generate evidence regarding the safety and efficacy of artificial intelligence (AI) enabled medical devices, AI models need to be evaluated on a diverse population of patient cases, some of which may not be readily available. We propose an evaluation approach for testing medical imaging AI models that relies on in silico imaging pipelines in which stochastic digital models of human anatomy (in object space) with and without pathology are imaged using a digital replica imaging acquisition system to generate realistic synthetic image datasets. Here, we release M-SYNTH, a dataset of cohorts with four breast fibroglandular density distributions imaged at different exposure levels using Monte Carlo x-ray simulations with the publicly available Virtual Imaging Clinical Trial for Regulatory Evaluation (VICTRE) toolkit. We utilize the synthetic dataset to analyze AI model performance and find that model performance decreases with increasing breast density and increases with higher mass density, as expected. As exposure levels decrease, AI model performance drops with the highest performance achieved at exposure levels lower than the nominal recommended dose for the breast type.


title: Modification of Tin (Sn) Metal Surfaces by Surface Plasmon Polariton Excitation

abstract: We report on the modification of tin (Sn) film surfaces under a laser beam irradiation that triggers surface plasmon polariton (SPP) excitations. The observed surface features in the form of small raised grains, with well-defined rooting, look similar to tin whisker nodules. We attribute the appearance of those features to the field-induced nucleation caused by the SPP related strong electric field. Possible implications of our findings include accelerated-life testing for tin whisker growth-related reliability as well as applications to nanoparticle nucleation.


title: How Well Do Feature-Additive Explainers Explain Feature-Additive Predictors?

abstract: Surging interest in deep learning from high-stakes domains has precipitated concern over the inscrutable nature of black box neural networks. Explainable AI (XAI) research has led to an abundance of explanation algorithms for these black boxes. Such post hoc explainers produce human-comprehensible explanations, however, their fidelity with respect to the model is not well understood - explanation evaluation remains one of the most challenging issues in XAI. In this paper, we ask a targeted but important question: can popular feature-additive explainers (e.g., LIME, SHAP, SHAPR, MAPLE, and PDP) explain feature-additive predictors? Herein, we evaluate such explainers on ground truth that is analytically derived from the additive structure of a model. We demonstrate the efficacy of our approach in understanding these explainers applied to symbolic expressions, neural networks, and generalized additive models on thousands of synthetic and several real-world tasks. Our results suggest that all explainers eventually fail to correctly attribute the importance of features, especially when a decision-making process involves feature interactions.


title: Solving the Traveling Telescope Problem with Mixed Integer Linear Programming

abstract: The size and complexity of modern astronomical surveys has grown to the point where, in many cases, traditional human scheduling of observations are tedious at best and impractical at worst. Automated scheduling algorithms present an opportunity to save human effort and increase scientific productivity. A common scheduling challenge involves determining the optimal ordering of a set of targets over a night subject to timing constraints and time-dependent slew overheads. We present a solution to the `Traveling Telescope Problem' (TTP) that uses Mixed-Integer Linear Programming (MILP). This algorithm is fast enough to enable dynamic schedule generation in many astronomical contexts. It can determine the optimal solution for 100 observations within 10 minutes on a modern workstation, reducing slew overheads by a factor of 5 compared to random ordering. We also provide a heuristic method that can return a near-optimal solution at significantly reduced computational cost. As a case study, we explore our algorithm's suitability to automatic schedule generation for Doppler planet searches.


title: GPT-4 Vision on Medical Image Classification -- A Case Study on COVID-19 Dataset

abstract: This technical report delves into the application of GPT-4 Vision (GPT-4V) in the nuanced realm of COVID-19 image classification, leveraging the transformative potential of in-context learning to enhance diagnostic processes.


title: Open boundary conditions of the $D^{(2)}_3$ spin chain and sectors of conformal field theories

abstract: We study open boundary conditions for the $D^{(2)}_3$ spin chain, which shares connections with the six-vertex model, under staggering, and also to the antiferromagnetic Potts model. By formulating a suitable transfer matrix, we obtain an integrable, open Hamiltonian, hence allowing for us to classify different regions of the underlying conformal field theory from eigenvalues of the Hamiltonian.


title: Designing Randomized Experiments to Predict Unit-Specific Treatment Effects

abstract: Typically, a randomized experiment is designed to test a hypothesis about the average treatment effect and sometimes hypotheses about treatment effect variation. The results of such a study may then be used to inform policy and practice for units not in the study. In this paper, we argue that given this use, randomized experiments should instead be designed to predict unit-specific treatment effects in a well-defined population. We then consider how different sampling processes and models affect the bias, variance, and mean squared prediction error of these predictions. The results indicate, for example, that problems of generalizability (differences between samples and populations) can greatly affect bias both in predictive models and in measures of error in these models. We also examine when the average treatment effect estimate outperforms unit-specific treatment effect predictive models and implications of this for planning studies.


title: Hard excitation mode of system with optomechanical instability

abstract: System with strong photon-phonon interaction and optomechanical instability are perspective for generation of coherent phonons and photons. Typically, above the threshold of optomechanical instability, the photon intensity increases linearly with pumping. We demonstrate that in such systems, it is possible to achieve hard mode of excitation when jump increase in the photon intensity takes place. We derive the analytical expression determining conditions for such a jump increase. We demonstrate that the hard excitation mode in system with optomechanical instability arises due to an additional phase condition for the existence of a nonzero solution. The discovered hard excitation mode paves the way for creation highly sensitive sensors and optical transistors.


title: On the Automatic Generation and Simplification of Children's Stories

abstract: With recent advances in large language models (LLMs), the concept of automatically generating children's educational materials has become increasingly realistic. Working toward the goal of age-appropriate simplicity in generated educational texts, we first examine the ability of several popular LLMs to generate stories with properly adjusted lexical and readability levels. We find that, in spite of the growing capabilities of LLMs, they do not yet possess the ability to limit their vocabulary to levels appropriate for younger age groups. As a second experiment, we explore the ability of state-of-the-art lexical simplification models to generalize to the domain of children's stories and, thus, create an efficient pipeline for their automatic generation. In order to test these models, we develop a dataset of child-directed lexical simplification instances, with examples taken from the LLM-generated stories in our first experiment. We find that, while the strongest-performing current lexical simplification models do not perform as well on material designed for children due to their reliance on large language models behind the scenes, some models that still achieve fairly strong results on general data can mimic or even improve their performance on children-directed data with proper fine-tuning, which we conduct using our newly created child-directed simplification dataset.


title: Cultivating Metal Whiskers by Surface Plasmon Polariton Excitation

abstract: This work presents a preliminary experimental study on the possibility to initiate growth of whiskers on the surfaces of some technologically important metals utilizing the enhanced electric field of surface plasmon polaritons (SPPs). The results provide evidence that a relatively high concentration of what appear to be whisker nuclei form in the region where SPPs were excited, whereas no such changes are observed on the untreated surface.


title: Doubly Robust Identification of Causal Effects of a Continuous Treatment using Discrete Instruments

abstract: Many empirical applications estimate causal effects of a continuous endogenous variable (treatment) using a binary instrument. Estimation is typically done through linear 2SLS. This approach requires a mean treatment change and causal interpretation requires the LATE-type monotonicity in the first stage. An alternative approach is to explore distributional changes in the treatment, where the first-stage restriction is treatment rank similarity. We propose causal estimands that are doubly robust in that they are valid under either of these two restrictions. We apply the doubly robust estimation to estimate the impacts of sleep on well-being. Our new estimates corroborate the usual 2SLS estimates.


title: Multi-fidelity Design of Porous Microstructures for Thermofluidic Applications

abstract: As modern electronic devices are increasingly miniaturized and integrated, their performance relies more heavily on effective thermal management. Two-phase cooling methods enhanced by porous surfaces, which capitalize on thin-film evaporation atop structured porous surfaces, are emerging as potential solutions. In such porous structures, the optimum heat dissipation capacity relies on two competing objectives that depend on mass and heat transfer. The computational costs of evaluating these objectives, the high dimensionality of the design space which a voxelated microstructure representation, and the manufacturability constraints hinder the optimization process for thermal management. We address these challenges by developing a data-driven framework for designing optimal porous microstructures for cooling applications. In our framework we leverage spectral density functions (SDFs) to encode the design space via a handful of interpretable variables and, in turn, efficiently search it. We develop physics-based formulas to quantify the thermofluidic properties and feasibility of candidate designs via offline simulations. To decrease the reliance on expensive simulations, we generate multi-fidelity data and build emulators to find Pareto-optimal designs. We apply our approach to a canonical problem on evaporator wick design and obtain fin-like topologies in the optimal microstructures which are also characteristics often observed in industrial applications.


title: Random walks on groups and superlinear divergent geodesics

abstract: In this paper, we study random walks on groups that contain superlinear divergent geodesics, in the line of thoughts of Goldsborough-Sisto. The existence of a superlinear divergent geodesic is a quasi-isometry invariant which allows us to execute Gou\"ezel's pivoting technique. We develop the theory of superlinear divergence and establish a central limit theorem for random walks on these groups.


title: Differentiable Simulator For Dynamic & Stochastic Optimal Gas & Power Flows

abstract: In many power systems, particularly those isolated from larger intercontinental grids, operational dependence on natural gas becomes pivotal, especially during fluctuations or unavailability of renewables coupled with uncertain consumption patterns. Efficient orchestration and inventive strategies are imperative for the smooth functioning of these standalone gas-grid systems. This paper delves into the challenge of synchronized dynamic and stochastic optimization for independent transmission-level gas-grid systems. Our approach's novelty lies in amalgamating the staggered-grid method for the direct assimilation of gas-flow PDEs with an automated sensitivity analysis facilitated by SciML/Julia, further enhanced by an intuitive linkage between gas and power grids via nodal flows. We initiate with a single pipe to establish a versatile and expandable methodology, later showcasing its effectiveness with increasingly intricate examples.


title: Lowering the reactor breakeven requirements for proton-Boron 11 fusion

abstract: Recently, it has been shown that altering the natural collisional power flow of the proton-Boron 11 (pB11) fusion reaction can significantly reduce the Lawson product of ion density and confinement time required to achieve ignition. However, these products are still onerous - on the order of $7 \times 10^{15}$ cm$^{-3}$s under the most optimistic scenarios. Fortunately, a breakeven fusion power plant does not require an igniting plasma, but rather a reactor that produces more electrical power than it consumes. Here, we extend the existing 0D power balance analysis to check the conditions on power plant breakeven. We find that even for the base thermonuclear reaction, modern high-efficiency thermal engines should reduce the Lawson product to $1.2 \times 10^{15}$ cm$^{-3}$s. We then explore the impact of several potential improvements, including fast proton heating, alpha power capture, direct conversion, and efficient heating. We find that such improvements could reduce the required Lawson product by a further order of magnitude, bringing aneutronic fusion to within target ITER design parameters.


title: Deep Reinforcement Learning for Weapons to Targets Assignment in a Hypersonic strike

abstract: We use deep reinforcement learning (RL) to optimize a weapons to target assignment (WTA) policy for multi-vehicle hypersonic strike against multiple targets. The objective is to maximize the total value of destroyed targets in each episode. Each randomly generated episode varies the number and initial conditions of the hypersonic strike weapons (HSW) and targets, the value distribution of the targets, and the probability of a HSW being intercepted. We compare the performance of this WTA policy to that of a benchmark WTA policy derived using non-linear integer programming (NLIP), and find that the RL WTA policy gives near optimal performance with a 1000X speedup in computation time, allowing real time operation that facilitates autonomous decision making in the mission end game.


title: Entanglement entropy of proton and its relation to thermodynamics entropy

abstract: I discuss the thermodynamics-based derivation of the formula for the entanglement entropy of a system of gluons. The derivation is based on an approach where saturation and the Unruh effect were used to obtain and discuss the entropy of gluons. The formula agrees, in the high-energy limit, up to a numerical factor, with more recent results, where arguments based on the density matrix and bipartition of the proton were used to obtain the formula. I also discuss the relation of entropy as obtained in BFKL in DLL approximation and with the application of the BK equation.


title: 3DCoMPaT$^{++}$: An improved Large-scale 3D Vision Dataset for Compositional Recognition

abstract: In this work, we present 3DCoMPaT$^{++}$, a multimodal 2D/3D dataset with 160 million rendered views of more than 10 million stylized 3D shapes carefully annotated at the part-instance level, alongside matching RGB point clouds, 3D textured meshes, depth maps, and segmentation masks. 3DCoMPaT$^{++}$ covers 41 shape categories, 275 fine-grained part categories, and 293 fine-grained material classes that can be compositionally applied to parts of 3D objects. We render a subset of one million stylized shapes from four equally spaced views as well as four randomized views, leading to a total of 160 million renderings. Parts are segmented at the instance level, with coarse-grained and fine-grained semantic levels. We introduce a new task, called Grounded CoMPaT Recognition (GCR), to collectively recognize and ground compositions of materials on parts of 3D objects. Additionally, we report the outcomes of a data challenge organized at CVPR2023, showcasing the winning method's utilization of a modified PointNet$^{++}$ model trained on 6D inputs, and exploring alternative techniques for GCR enhancement. We hope our work will help ease future research on compositional 3D Vision.


title: Preventing Language Models From Hiding Their Reasoning

abstract: Large language models (LLMs) often benefit from intermediate steps of reasoning to generate answers to complex problems. When these intermediate steps of reasoning are used to monitor the activity of the model, it is essential that this explicit reasoning is faithful, i.e. that it reflects what the model is actually reasoning about. In this work, we focus on one potential way intermediate steps of reasoning could be unfaithful: encoded reasoning, where an LLM could encode intermediate steps of reasoning in the generated text in a way that is not understandable to human readers. We show that language models can be trained to make use of encoded reasoning to get higher performance without the user understanding the intermediate steps of reasoning. We argue that, as language models get stronger, this behavior becomes more likely to appear naturally. Finally, we describe a methodology that enables the evaluation of defenses against encoded reasoning, and show that, under the right conditions, paraphrasing successfully prevents even the best encoding schemes we built from encoding more than 3 bits of information per KB of text.


title: The zero forcing numbers and propagation times of gear graphs and helm graphs

abstract: Zero forcing is a dynamic coloring process on graphs. Initially, each vertex of a graph is assigned a color of either blue or white, and then a process begins by which blue vertices force white vertices to become blue. The zero forcing number is the cardinality of the smallest set of initially blue vertices which can force the entire graph to become blue, and the propagation time is the minimum number of steps in such a zero forcing process. In this paper we will determine the zero forcing numbers and propagation times of two infinite classes of graphs called gear graphs and helm graphs.


title: Visualization of cylindrical resonances

abstract: The analysis of cylindrical resonators is part of standard physics curricula but, unlike for their rectangular counterpart, their mode structure is hardly ever visualized. The aim of this work is to show a way of doing it, providing a set of interactive web applications and citing potential use cases in the form of both academic courses and published research. These cover several branches of physics and engineering, showing that these materials can be useful for a broad audience.


title: Learning to design protein-protein interactions with enhanced generalization

abstract: Discovering mutations enhancing protein-protein interactions (PPIs) is critical for advancing biomedical research and developing improved therapeutics. While machine learning approaches have substantially advanced the field, they often struggle to generalize beyond training data in practical scenarios. The contributions of this work are three-fold. First, we construct PPIRef, the largest and non-redundant dataset of 3D protein-protein interactions, enabling effective large-scale learning. Second, we leverage the PPIRef dataset to pre-train PPIformer, a new SE(3)-equivariant model generalizing across diverse protein-binder variants. We fine-tune PPIformer to predict effects of mutations on protein-protein interactions via a thermodynamically motivated adjustment of the pre-training loss function. Finally, we demonstrate the enhanced generalization of our new PPIformer approach by outperforming other state-of-the-art methods on new, non-leaking splits of standard labeled PPI mutational data and independent case studies optimizing a human antibody against SARS-CoV-2 and increasing the thrombolytic activity of staphylokinase.


title: Operator is the Model

abstract: Koopman operator based models emerged as the leading methodology for machine learning of dynamical systems. But their scope is much larger. In fact they present a new take on modeling of physical systems, and even language. In this article I present some of the underlying mathematical structures, applications, connections to other methodologies such as transformer architectures


title: Learning to recognize occluded and small objects with partial inputs

abstract: Recognizing multiple objects in an image is challenging due to occlusions, and becomes even more so when the objects are small. While promising, existing multi-label image recognition models do not explicitly learn context-based representations, and hence struggle to correctly recognize small and occluded objects. Intuitively, recognizing occluded objects requires knowledge of partial input, and hence context. Motivated by this intuition, we propose Masked Supervised Learning (MSL), a single-stage, model-agnostic learning paradigm for multi-label image recognition. The key idea is to learn context-based representations using a masked branch and to model label co-occurrence using label consistency. Experimental results demonstrate the simplicity, applicability and more importantly the competitive performance of MSL against previous state-of-the-art methods on standard multi-label image recognition benchmarks. In addition, we show that MSL is robust to random masking and demonstrate its effectiveness in recognizing non-masked objects. Code and pretrained models are available on GitHub.


title: Reconfiguration of plane trees in convex geometric graphs

abstract: A non-crossing spanning tree of a set of points in the plane is a spanning tree whose edges pairwise do not cross. Avis and Fukuda in 1996 proved that there always exists a flip sequence of length at most $2n-4$ between any pair of non-crossing spanning trees (where $n$ denotes the number of points). Hernando et al. proved that the length of a minimal flip sequence can be of length at least $\frac 32 n$. Two recent results of Aichholzer et al. and Bousquet et al. improved the Avis and Fukuda upper bound by proving that there always exists a flip sequence of length respectively at most $2n - \log n$ and $2n - \sqrt{n}$. We improve the upper bound by a linear factor for the first time in 25 years by proving that there always exists a flip sequence between any pair of non-crossing spanning trees $T_1,T_2$ of length at most $c n$ where $c \approx 1.95$. Our result is actually stronger since we prove that, for any two trees $T_1,T_2$, there exists a flip sequence from $T_1$ to $T_2$ of length at most $c |T_1 \setminus T_2|$. We also improve the best lower bound in terms of the symmetric difference by proving that there exists a pair of trees $T_1,T_2$ such that a minimal flip sequence has length $\frac 53 |T_1 \setminus T_2|$, improving the lower bound of Hernando et al. by considering the symmetric difference instead of the number of vertices. We generalize this lower bound construction to non-crossing flips (where we close the gap between upper and lower bounds) and rotations.


title: Practical trainable temporal post-processor for multi-state quantum measurement

abstract: We develop and demonstrate a trainable temporal post-processor (TPP) harnessing a simple but versatile machine learning algorithm to provide optimal processing of quantum measurement data subject to arbitrary noise processes, for the readout of an arbitrary number of quantum states. We demonstrate the TPP on the essential task of qubit state readout, which has historically relied on temporal processing via matched filters in spite of their applicability only for specific noise conditions. Our results show that the TPP can reliably outperform standard filtering approaches under complex readout conditions, such as high power readout. Using simulations of quantum measurement noise sources, we show that this advantage relies on the TPP's ability to learn optimal linear filters that account for general quantum noise correlations in data, such as those due to quantum jumps, or correlated noise added by a phase-preserving quantum amplifier. We show that the transformation described by the TPP can be expressed via an efficient semi-analytic form, providing a linearly-scaling generalization of matched filtering to an arbitrary number of states under the most general noise conditions of the readout signal emanating from the measurement chain. The TPP can be efficiently, autonomously, and reliably trained on measurement data, and requires only linear operations, making it ideal for FPGA implementations in cQED for real-time processing of measurement data from general quantum systems.


title: On the $L^r$-differentiability of Two Lusin Classes and a Full Descriptive Characterization of the $HK_r$-integral

abstract: It is proved that any function of a Lusin-type class, the class of $ACG_r$-functions, is differentiable almost everywhere in the sense of a derivative defined in the space~$L^r$, $1\le r<\infty$. This leads to obtaining a full descriptive characterization of a Henstock-Kurzweil-type integral, the $HK_r$-integral, which serves to recover functions from their $L^r$-derivatives. The class $ACG_r$ is compared with the classical Lusin class $ACG$ and it is shown that a continuous $ACG$-function can fail to be $L^r$-differentiable almost everywhere.


title: Membranes, holography, and quantum information

abstract: In this thesis, I study Interface Conformal Field Theories (ICFT) and their holographic dual, which is composed of two asymptotically Anti-de-Sitter (AdS) spaces glued through a thin gravitating membrane. I restrict the study to simple minimal models, which allow for analytic control while providing universally applicable results. The analysis is set in 2D ICFT/3D gravity, but I expect much of the results to be generalizable to higher dimensions. I first consider this system at equilibrium and at finite temperature. By solving the equations of motion in the bulk, I find the allowable solution landscape. Classifying the rich set of solutions among 3 thermodynamical phases, I draw the phase diagram outlining the nature of the various phase transitions. I then examine a simple out-of-equilibrium situation arising from connecting at an interface two spatially infinite CFTs at different temperatures. Then a "Non-Equilibrium Steady State" (NESS) describes the growing region where the interaction has settled into a stationary phase. I determine the holographic dual of this region, composed of two spinning planar black holes glued at the membrane. I find an expression for the deformed out-of-equilibrium event horizon. This geometry suggests that the field theory interface acts as a perfect scrambler, a property that until now seemed unique to black hole horizons. Finally, I study the entanglement structure of the aforementioned geometries by means of the Ryu-Takayanagi prescription. After reviewing a construction in the vacuum state, I present partial results for more general geometries at finite temperature. For this purpose, I need to introduce numerical methods. I outline the main difficulties in their application and conclude by mentioning the Quantum Null Energy Condition (QNEC), an inequality linking entanglement entropy and energy, that can be used to test the consistency of the models.


title: Localic separation and the duality between closedness and fittedness

abstract: There are a number of localic separation axioms which are roughly analogous to the $T_1$-axiom from classical topology. For instance, besides the well-known subfitness and fitness, there are also Rosicky-Smarda's $T_1$-locales, totally unordered locales and, more categorically, the recently introduced $\mathcal{F}$-separated locales (i.e., those with a fitted diagonal) - a property strictly weaker than fitness. It has recently been shown that the strong Hausdorff property and $\mathcal{F}$-separatedness are in a certain sense dual to each other. In this paper, we provide further instances of this duality - e.g., we introduce a new first-order separation property which is to $\mathcal{F}$-separatedness as the Johnstone-Sun-shu-Hao-Paseka-Smarda conservative Hausdorff axiom is to the strong Hausdorff property, and which can be of independent interest. Using this, we tie up the loose ends of the theory by establishing all the possible implications between these properties and other $T_1$-type axioms occurring in the literature. In particular, we show that the strong Hausdorff property does not imply $\mathcal{F}$-separatedness, a question which remained open and shows a remarkable difference with its counterpart in the category of topological spaces.


title: Using convolutional neural networks for stereological characterization of 3D hetero-aggregates based on synthetic STEM data

abstract: The structural characterization of hetero-aggregates in 3D is of great interest, e.g., for deriving process-structure or structure-property relationships. However, since 3D imaging techniques are often difficult to perform as well as time and cost intensive, a characterization of hetero-aggregates based on 2D image data is desirable, but often non-trivial. To overcome the issues of characterizing 3D structures from 2D measurements, a method is presented that relies on machine learning combined with methods of spatial stochastic modeling, where the latter are utilized for the generation of synthetic training data. This kind of training data has the advantage that time-consuming experiments for the synthesis of differently structured materials followed by their 3D imaging can be avoided. More precisely, a parametric stochastic 3D model is presented, from which a wide spectrum of virtual hetero-aggregates can be generated. Additionally, the virtual structures are passed to a physics-based simulation tool in order to generate virtual scanning transmission electron microscopy (STEM) images. The preset parameters of the 3D model together with the simulated STEM images serve as a database for the training of convolutional neural networks, which can be used to determine the parameters of the underlying 3D model and, consequently, to predict 3D structures of hetero-aggregates from 2D STEM images. Furthermore, an error analysis is performed to evaluate the prediction power of the trained neural networks with respect to structural descriptors, e.g. the hetero-coordination number.


title: Tuning vortex critical velocity in Mo$_2$N thin films via striped magnetic domain configuration

abstract: We report on the impact of the magnetic domain stripe configuration on the critical velocity of vortices in superconducting/ferromagnetic bilayers. Using a 23 nm thick Mo$_2$N film, covered by a 48 nm FePt layer with tunable nanosized striped domains, we demonstrate that flux instability at low magnetic fields depends on the orientation of the stripes. When the stripes are perpendicular to the applied current and act as vortex guides, the velocity values reach 5 km/s, duplicating those found when configured parallel to the current, creating winding vortex paths. Our results indicate that vortex critical velocities can be tuned by configuring different domain structures, providing a platform to understand vortex dynamics in superconducting microstrips.


title: Polarization vs. magnetic field: competing eigenbases in laser-driven atoms

abstract: We present experimental results and a theoretical model that illustrate how competing eigenbases can determine the dynamics of a fluorescing atom. In the absence of a magnetic field, the atom can get trapped in a dark state, which inhibits fluorescence. In general, this will happen when the magnetic degeneracy of the ground state is greater than the one of the excited state. A canonical way to avoid optical pumping to dark states is to apply a magnetic field at an angle with respect to the polarization of the exciting light. This generates a competition of eigenbases which manifests as a crossover between two regimes dominated either by the laser or the magnetic field. We illustrate this crossover with fluorescence measurements on a single laser-cooled calcium ion in a Paul trap and find that it occurs at a critical laser intensity that is proportional to the external magnetic field. We contrast our results with numerical simulations of the atomic levels involved and also present a simple theoretical model that provides excellent agreement with experimental results and facilitates the understanding of the dynamics.


title: Sample based Explanations via Generalized Representers

abstract: We propose a general class of sample based explanations of machine learning models, which we term generalized representers. To measure the effect of a training sample on a model's test prediction, generalized representers use two components: a global sample importance that quantifies the importance of the training point to the model and is invariant to test samples, and a local sample importance that measures similarity between the training sample and the test point with a kernel. A key contribution of the paper is to show that generalized representers are the only class of sample based explanations satisfying a natural set of axiomatic properties. We discuss approaches to extract global importances given a kernel, and also natural choices of kernels given modern non-linear models. As we show, many popular existing sample based explanations could be cast as generalized representers with particular choices of kernels and approaches to extract global importances. Additionally, we conduct empirical comparisons of different generalized representers on two image and two text classification datasets.


title: Multiple Imputation Method for High-Dimensional Neuroimaging Data

abstract: Missingness is a common issue for neuroimaging data, and neglecting it in downstream statistical analysis can introduce bias and lead to misguided inferential conclusions. It is therefore crucial to conduct appropriate statistical methods to address this issue. While multiple imputation is a popular technique for handling missing data, its application to neuroimaging data is hindered by high dimensionality and complex dependence structures of multivariate neuroimaging variables. To tackle this challenge, we propose a novel approach, named High Dimensional Multiple Imputation (HIMA), based on Bayesian models. HIMA develops a new computational strategy for sampling large covariance matrices based on a robustly estimated posterior mode, which drastically enhances computational efficiency and numerical stability. To assess the effectiveness of HIMA, we conducted extensive simulation studies and real-data analysis using neuroimaging data from a Schizophrenia study. HIMA showcases a computational efficiency improvement of over 2000 times when compared to traditional approaches, while also producing imputed datasets with improved precision and stability.


title: Nonuniform Bose-Einstein condensate. I. An improvement of the Gross-Pitaevskii method

abstract: A nonuniform condensate is usually described by the Gross-Pitaevskii (GP) equation, which is derived with the help of the c-number ansatz $\hat{ \Psi}(\mathbf{r},t)=\Psi (\mathbf{r},t)$. Proceeding from a more accurate operator ansatz $\hat{\Psi}(\mathbf{r},t)=\hat{a}_{0}\Psi (\mathbf{r},t) \sqrt{N}$, we find the equation $i\hbar \frac{\partial \Psi (\mathbf{r},t)}{\partial t}=-\frac{\hbar ^{2}}{2m}\frac{\partial ^{2}\Psi (\mathbf{r},t)}{\partial \mathbf{r}^{2}}+\left( 1-\frac{1}{N}\right) 2c\Psi (\mathbf{r},t)|\Psi(\mathbf{r},t)|^{2}$ (the GP$_{N}$ equation). It differs from the GP equation by the factor $(1-1/N)$, where $N$ is the number of Bose particles. We compare the accuracy of the GP and GP$_{N}$ equations by analyzing the ground state of a one-dimensional system of point bosons with repulsive interaction ($c>0$) and zero boundary conditions. Both equations are solved numerically, and the system energy $E$ and the particle density profile $\rho (x)$ are determined for various values of~$N$, the mean particle density $\bar{\rho}$, and the coupling constant $\gamma =c/\bar{\rho}$. The solutions are compared with the exact ones obtained by the Bethe ansatz. The results show that in the weak coupling limit ($N^{-2}\ll \gamma \lesssim 0.1$), the GP and GP$_{N}$ equations describe the system equally well if $N\gtrsim 100$. For few-boson systems ($N\lesssim 10$) with $\gamma \lesssim N^{-2}$ the solutions of the GP$_{N}$ equation are in excellent agreement with the exact ones. That is, the multiplier $(1-1/N)$ allows one to describe few-boson systems with high accuracy. This means that it is reasonable to extend the notion of Bose-Einstein condensation to few-particle systems.


title: FPM-INR: Fourier ptychographic microscopy image stack reconstruction using implicit neural representations

abstract: Image stacks provide invaluable 3D information in various biological and pathological imaging applications. Fourier ptychographic microscopy (FPM) enables reconstructing high-resolution, wide field-of-view image stacks without z-stack scanning, thus significantly accelerating image acquisition. However, existing FPM methods take tens of minutes to reconstruct and gigabytes of memory to store a high-resolution volumetric scene, impeding fast gigapixel-scale remote digital pathology. While deep learning approaches have been explored to address this challenge, existing methods poorly generalize to novel datasets and can produce unreliable hallucinations. This work presents FPM-INR, a compact and efficient framework that integrates physics-based optical models with implicit neural representations (INR) to represent and reconstruct FPM image stacks. FPM-INR is agnostic to system design or sample types and does not require external training data. In our demonstrated experiments, FPM-INR substantially outperforms traditional FPM algorithms with up to a 25-fold increase in speed and an 80-fold reduction in memory usage for continuous image stack representations.


title: Gas density influences the transition from capillary collapse to surface seal in microfluidic jet impacts on deep pools

abstract: Studies of liquid jet impacts onto a deep liquid pool are of great significance for a multitude of engineering and environmental applications. During jet impact, the free surface of the pool deforms and a cavity is generated. Simultaneously, the free surface of the cavity extends radially outward and forms a rim. Eventually the cavity collapses by means of gas inertia and surface tension. In this work we study numerically such cavity collapse, under different impact velocities and ambient gas density conditions. An axisymmetric numerical model, based on the volume of fluid method is constructed in Basilisk C. This model is validated by qualitative and quantitative comparison with theory and experiments, in a parameter range that has not been previously explored. Our results show two distinct regimes in the cavity collapse mechanism. By considering forces pulling along the interface, we derive scaling arguments for the time of closure and maximum radius of the cavity, based on the Weber number. For jets with uniform constant velocity from tip to tail and $We \leq 150$ the cavity closure is capillary dominated and happens below the surface (deep seal). In contrast, for $We \geq 200$ the cavity closure happens above the surface (surface seal) and is dominated by the gas entrainment and the pressure gradient that it causes. Our results provide information for understanding pollutant transport during droplet impacts on large bodies of water, and other engineering application, like additive manufacturing, lithography and needle-free injections.


title: Feature Selection in the Contrastive Analysis Setting

abstract: Contrastive analysis (CA) refers to the exploration of variations uniquely enriched in a target dataset as compared to a corresponding background dataset generated from sources of variation that are irrelevant to a given task. For example, a biomedical data analyst may wish to find a small set of genes to use as a proxy for variations in genomic data only present among patients with a given disease (target) as opposed to healthy control subjects (background). However, as of yet the problem of feature selection in the CA setting has received little attention from the machine learning community. In this work we present contrastive feature selection (CFS), a method for performing feature selection in the CA setting. We motivate our approach with a novel information-theoretic analysis of representation learning in the CA setting, and we empirically validate CFS on a semi-synthetic dataset and four real-world biomedical datasets. We find that our method consistently outperforms previously proposed state-of-the-art supervised and fully unsupervised feature selection methods not designed for the CA setting. An open-source implementation of our method is available at https://github.com/suinleelab/CFS.


title: SkipAnalyzer: A Tool for Static Code Analysis with Large Language Models

abstract: We introduce SkipAnalyzer, a large language model (LLM)-powered tool for static code analysis. SkipAnalyzer has three components: 1) an LLM-based static bug detector that scans source code and reports specific types of bugs, 2) an LLM-based false-positive filter that can identify false-positive bugs in the results of static bug detectors (e.g., the result of step 1) to improve detection accuracy, and 3) an LLM-based patch generator that can generate patches for the detected bugs above. As a proof-of-concept, SkipAnalyzer is built on ChatGPT, which has exhibited outstanding performance in various software engineering tasks. To evaluate SkipAnalyzer, we focus on two types of typical and critical bugs that are targeted by static bug detection, i.e., Null Dereference and Resource Leak as subjects. We employ Infer to aid the gathering of these two bug types from 10 open-source projects. Consequently, our experiment dataset contains 222 instances of Null Dereference bugs and 46 instances of Resource Leak bugs. Our study demonstrates that SkipAnalyzer achieves remarkable performance in the mentioned static analysis tasks, including bug detection, false-positive warning removal, and bug repair. In static bug detection, SkipAnalyzer achieves accuracy values of up to 68.37% for detecting Null Dereference bugs and 76.95% for detecting Resource Leak bugs, improving the precision of the current leading bug detector, Infer, by 12.86% and 43.13%, respectively. For removing false-positive warnings, SkipAnalyzer can reach a precision of up to 93.88% for Null Dereference bugs and 63.33% for Resource Leak bugs. Additionally, SkipAnalyzer surpasses state-of-the-art false-positive warning removal tools. Furthermore, in bug repair, SkipAnalyzer can generate syntactically correct patches to fix its detected bugs with a success rate of up to 97.30%.


title: Evaluating the effects of high-throughput structural neuroimaging predictors on whole-brain functional connectome outcomes via network-based vector-on-matrix regression

abstract: The joint analysis of multimodal neuroimaging data is critical in the field of brain research because it reveals complex interactive relationships between neurobiological structures and functions. In this study, we focus on investigating the effects of structural imaging (SI) features, including white matter micro-structure integrity (WMMI) and cortical thickness, on the whole brain functional connectome (FC) network. To achieve this goal, we propose a network-based vector-on-matrix regression model to characterize the FC-SI association patterns. We have developed a novel multi-level dense bipartite and clique subgraph extraction method to identify which subsets of spatially specific SI features intensively influence organized FC sub-networks. The proposed method can simultaneously identify highly correlated structural-connectomic association patterns and suppress false positive findings while handling millions of potential interactions. We apply our method to a multimodal neuroimaging dataset of 4,242 participants from the UK Biobank to evaluate the effects of whole-brain WMMI and cortical thickness on the resting-state FC. The results reveal that the WMMI on corticospinal tracts and inferior cerebellar peduncle significantly affect functional connections of sensorimotor, salience, and executive sub-networks with an average correlation of 0.81 (p<0.001).


title: Multi Time Scale World Models

abstract: Intelligent agents use internal world models to reason and make predictions about different courses of their actions at many scales. Devising learning paradigms and architectures that allow machines to learn world models that operate at multiple levels of temporal abstractions while dealing with complex uncertainty predictions is a major technical hurdle. In this work, we propose a probabilistic formalism to learn multi-time scale world models which we call the Multi Time Scale State Space (MTS3) model. Our model uses a computationally efficient inference scheme on multiple time scales for highly accurate long-horizon predictions and uncertainty estimates over several seconds into the future. Our experiments, which focus on action conditional long horizon future predictions, show that MTS3 outperforms recent methods on several system identification benchmarks including complex simulated and real-world dynamical systems. Code is available at this repository: https://github.com/ALRhub/MTS3.


title: Contextual Stochastic Bilevel Optimization

abstract: We introduce contextual stochastic bilevel optimization (CSBO) -- a stochastic bilevel optimization framework with the lower-level problem minimizing an expectation conditioned on some contextual information and the upper-level decision variable. This framework extends classical stochastic bilevel optimization when the lower-level decision maker responds optimally not only to the decision of the upper-level decision maker but also to some side information and when there are multiple or even infinite many followers. It captures important applications such as meta-learning, personalized federated learning, end-to-end learning, and Wasserstein distributionally robust optimization with side information (WDRO-SI). Due to the presence of contextual information, existing single-loop methods for classical stochastic bilevel optimization are unable to converge. To overcome this challenge, we introduce an efficient double-loop gradient method based on the Multilevel Monte-Carlo (MLMC) technique and establish its sample and computational complexities. When specialized to stochastic nonconvex optimization, our method matches existing lower bounds. For meta-learning, the complexity of our method does not depend on the number of tasks. Numerical experiments further validate our theoretical results.


title: Efficient Fully Bayesian Approach to Brain Activity Mapping with Complex-Valued fMRI Data

abstract: Functional magnetic resonance imaging (fMRI) enables indirect detection of brain activity changes via the blood-oxygen-level-dependent (BOLD) signal. Conventional analysis methods mainly rely on the real-valued magnitude of these signals. In contrast, research suggests that analyzing both real and imaginary components of the complex-valued fMRI (cv-fMRI) signal provides a more holistic approach that can increase power to detect neuronal activation. We propose a fully Bayesian model for brain activity mapping with cv-fMRI data. Our model accommodates temporal and spatial dynamics. Additionally, we propose a computationally efficient sampling algorithm, which enhances processing speed through image partitioning. Our approach is shown to be computationally efficient via image partitioning and parallel computation while being competitive with state-of-the-art methods. We support these claims with both simulated numerical studies and an application to real cv-fMRI data obtained from a finger-tapping experiment.


title: Heuristics for Inequality minimization in PageRank values

abstract: This research study investigates the minimization of inequality in the ranks of vertices obtained using the PageRank algorithm. PageRank is a widely used algorithm for ranking webpages and plays a significant role in determining web traffic. This study employs the Gini coefficient, a measure of income/wealth inequality, to assess the inequality in PageRank distributions on various types of graphs. The investigation involves two experiments: one that modifies strategies for handling dead-end nodes and another that explores six deterministic methods for reducing inequality. Our findings indicate that a combination of two distinct heuristics may present an effective strategy for minimizing inequality.


title: Evaluating Cross-Domain Text-to-SQL Models and Benchmarks

abstract: Text-to-SQL benchmarks play a crucial role in evaluating the progress made in the field and the ranking of different models. However, accurately matching a model-generated SQL query to a reference SQL query in a benchmark fails for various reasons, such as underspecified natural language queries, inherent assumptions in both model-generated and reference queries, and the non-deterministic nature of SQL output under certain conditions. In this paper, we conduct an extensive study of several prominent cross-domain text-to-SQL benchmarks and re-evaluate some of the top-performing models within these benchmarks, by both manually evaluating the SQL queries and rewriting them in equivalent expressions. Our evaluation reveals that attaining a perfect performance on these benchmarks is unfeasible due to the multiple interpretations that can be derived from the provided samples. Furthermore, we find that the true performance of the models is underestimated and their relative performance changes after a re-evaluation. Most notably, our evaluation reveals a surprising discovery: a recent GPT4-based model surpasses the gold standard reference queries in the Spider benchmark in our human evaluation. This finding highlights the importance of interpreting benchmark evaluations cautiously, while also acknowledging the critical role of additional independent evaluations in driving advancements in the field.


title: Prediction of Yield Surface of Single Crystal Copper from Discrete Dislocation Dynamics and Geometric Learning

abstract: A yield surface of a material is a set of critical stress conditions beyond which macroscopic plastic deformation begins. For crystalline solids, plastic deformation occurs through the motion of dislocations, which can be captured by discrete dislocation dynamics (DDD) simulations. In this paper, we predict the yield surfaces and strain-hardening behaviors using DDD simulations and a geometric manifold learning approach. The yield surfaces in the three-dimensional space of plane stress are constructed for single-crystal copper subjected to uniaxial loading along the $[100]$ and $[110]$ directions, respectively. With increasing plastic deformation under $[100]$ loading, the yield surface expands nearly uniformly in all directions, corresponding to isotropic hardening. In contrast, under $[110]$ loading, latent hardening is observed, where the yield surface remains nearly unchanged in the orientations in the vicinity of the loading direction itself, but expands in other directions, resulting in an asymmetric shape. This difference in hardening behaviors is attributed to the different dislocation multiplication behaviors on various slip systems under the two loading conditions.


title: Spatial correlation increase in single-sensor satellite data reveals loss of Amazon rainforest resilience

abstract: The Amazon rainforest (ARF) is threatened by deforestation and climate change, which could trigger a regime shift to a savanna-like state. Previous work suggesting declining resilience in recent decades was based only on local resilience indicators. Moreover, previous results are potentially biased by the employed multi-sensor and optical satellite data and undetected anthropogenic land-use change. Here, we show that the spatial correlation provides a more robust resilience indicator than local estimators and employ it to measure resilience changes in the ARF, based on single-sensor Vegetation Optical Depth data under conservative exclusion of human activity. Our results show an overall loss of resilience until around 2019, which is especially pronounced in the southwestern and northern Amazon for the time period from 2002 to 2011. The demonstrated reliability of spatial correlation in coupled systems suggests that in particular the southwest of the ARF has experienced pronounced resilience loss over the last two decades.


title: ReConTab: Regularized Contrastive Representation Learning for Tabular Data

abstract: Representation learning stands as one of the critical machine learning techniques across various domains. Through the acquisition of high-quality features, pre-trained embeddings significantly reduce input space redundancy, benefiting downstream pattern recognition tasks such as classification, regression, or detection. Nonetheless, in the domain of tabular data, feature engineering and selection still heavily rely on manual intervention, leading to time-consuming processes and necessitating domain expertise. In response to this challenge, we introduce ReConTab, a deep automatic representation learning framework with regularized contrastive learning. Agnostic to any type of modeling task, ReConTab constructs an asymmetric autoencoder based on the same raw features from model inputs, producing low-dimensional representative embeddings. Specifically, regularization techniques are applied for raw feature selection. Meanwhile, ReConTab leverages contrastive learning to distill the most pertinent information for downstream tasks. Experiments conducted on extensive real-world datasets substantiate the framework's capacity to yield substantial and robust performance improvements. Furthermore, we empirically demonstrate that pre-trained embeddings can seamlessly integrate as easily adaptable features, enhancing the performance of various traditional methods such as XGBoost and Random Forest.


title: End-to-end Feature Selection Approach for Learning Skinny Trees

abstract: Joint feature selection and tree ensemble learning is a challenging task. Popular tree ensemble toolkits e.g., Gradient Boosted Trees and Random Forests support feature selection post-training based on feature importances, which are known to be misleading, and can significantly hurt performance. We propose Skinny Trees: a toolkit for feature selection in tree ensembles, such that feature selection and tree ensemble learning occurs simultaneously. It is based on an end-to-end optimization approach that considers feature selection in differentiable trees with Group $\ell_0 - \ell_2$ regularization. We optimize with a first-order proximal method and present convergence guarantees for a non-convex and non-smooth objective. Interestingly, dense-to-sparse regularization scheduling can lead to more expressive and sparser tree ensembles than vanilla proximal method. On 15 synthetic and real-world datasets, Skinny Trees can achieve $1.5\times$ - $620\times$ feature compression rates, leading up to $10\times$ faster inference over dense trees, without any loss in performance. Skinny Trees lead to superior feature selection than many existing toolkits e.g., in terms of AUC performance for $25\%$ feature budget, Skinny Trees outperforms LightGBM by $10.2\%$ (up to $37.7\%$), and Random Forests by $3\%$ (up to $12.5\%$).


title: Robust Graph Matching when Nodes are Corrupt

abstract: Two models are introduced to investigate graph matching in the presence of corrupt nodes. The weak model, inspired by biological networks, allows one or both networks to have a positive fraction of molecular entities interact randomly with their network. For this model, it is shown that no estimator can correctly recover a positive fraction of the corrupt nodes. Necessary conditions for any estimator to correctly identify and match all the uncorrupt nodes are derived, and it is shown that these conditions are also sufficient for the k-core estimator. The strong model, inspired by social networks, permits one or both networks to have a positive fraction of users connect arbitrarily. For this model, detection of corrupt nodes is impossible. Even so, we show that if only one of the networks is compromised, then under appropriate conditions, the maximum overlap estimator can correctly match a positive fraction of nodes albeit without explicitly identifying them.


title: Discourse Structures Guided Fine-grained Propaganda Identification

abstract: Propaganda is a form of deceptive narratives that instigate or mislead the public, usually with a political purpose. In this paper, we aim to identify propaganda in political news at two fine-grained levels: sentence-level and token-level. We observe that propaganda content is more likely to be embedded in sentences that attribute causality or assert contrast to nearby sentences, as well as seen in opinionated evaluation, speculation and discussions of future expectation. Hence, we propose to incorporate both local and global discourse structures for propaganda discovery and construct two teacher models for identifying PDTB-style discourse relations between nearby sentences and common discourse roles of sentences in a news article respectively. We further devise two methods to incorporate the two types of discourse structures for propaganda identification by either using teacher predicted probabilities as additional features or soliciting guidance in a knowledge distillation framework. Experiments on the benchmark dataset demonstrate that leveraging guidance from discourse structures can significantly improve both precision and recall of propaganda content identification.


title: Identifying Conspiracy Theories News based on Event Relation Graph

abstract: Conspiracy theories, as a type of misinformation, are narratives that explains an event or situation in an irrational or malicious manner. While most previous work examined conspiracy theory in social media short texts, limited attention was put on such misinformation in long news documents. In this paper, we aim to identify whether a news article contains conspiracy theories. We observe that a conspiracy story can be made up by mixing uncorrelated events together, or by presenting an unusual distribution of relations between events. Achieving a contextualized understanding of events in a story is essential for detecting conspiracy theories. Thus, we propose to incorporate an event relation graph for each article, in which events are nodes, and four common types of event relations, coreference, temporal, causal, and subevent relations, are considered as edges. Then, we integrate the event relation graph into conspiracy theory identification in two ways: an event-aware language model is developed to augment the basic language model with the knowledge of events and event relations via soft labels; further, a heterogeneous graph attention network is designed to derive a graph embedding based on hard labels. Experiments on a large benchmark dataset show that our approach based on event relation graph improves both precision and recall of conspiracy theory identification, and generalizes well for new unseen media sources.


title: Einstein-de Haas torque as a discrete spectroscopic probe allows nanomechanical measurement of a magnetic resonance

abstract: The Einstein-de Haas (EdH) effect is a fundamental, mechanical consequence of any temporal change of magnetism in an object. EdH torque results from conserving the object's total angular momentum: the angular momenta of all the specimen's magnetic moments, together with its mechanical angular momentum. Although the EdH effect is usually small and difficult to observe, it increases in magnitude with detection frequency. We explore the frequency-dependence of EdH torque for a thin film permalloy microstructure by employing a ladder of flexural beam modes (with five distinct resonance frequencies spanning from 3 to 208 MHz) within a nanocavity optomechanical torque sensor via magnetic hysteresis curves measured at mechanical resonances. At low DC fields the gyrotropic resonance of a magnetic vortex spin texture overlaps the 208 MHz mechanical mode. The massive EdH mechanical torques arising from this co-resonance yield a fingerprint of vortex core pinning and depinning in the sample. The experimental results are discussed in relation to mechanical torques predicted from both macrospin (at high DC magnetic field) and finite-difference solutions to the Landau-Lifshitz-Gilbert (LLG) equation. A global fit of the LLG solutions to the frequency-dependent data reveals a statistically significant discrepancy between the experimentally observed and simulated torque phase behaviours at spin texture transitions that can be reduced through the addition of a time constant to the conversion between magnetic cross-product torque and mechanical torque, constrained by experiment to be in the range of 0.5 - 4 ns.


title: Punica: Multi-Tenant LoRA Serving

abstract: Low-rank adaptation (LoRA) has become an important and popular method to adapt pre-trained models to specific domains. We present Punica, a system to serve multiple LoRA models in a shared GPU cluster. Punica contains a new CUDA kernel design that allows batching of GPU operations for different LoRA models. This allows a GPU to hold only a single copy of the underlying pre-trained model when serving multiple, different LoRA models, significantly enhancing GPU efficiency in terms of both memory and computation. Our scheduler consolidates multi-tenant LoRA serving workloads in a shared GPU cluster. With a fixed-sized GPU cluster, our evaluations show that Punica achieves 12x higher throughput in serving multiple LoRA models compared to state-of-the-art LLM serving systems while only adding 2ms latency per token. Punica is open source at https://github.com/punica-ai/punica .


title: MEDAVET: Traffic Vehicle Anomaly Detection Mechanism based on spatial and temporal structures in vehicle traffic

abstract: Currently, there are computer vision systems that help us with tasks that would be dull for humans, such as surveillance and vehicle tracking. An important part of this analysis is to identify traffic anomalies. An anomaly tells us that something unusual has happened, in this case on the highway. This paper aims to model vehicle tracking using computer vision to detect traffic anomalies on a highway. We develop the steps of detection, tracking, and analysis of traffic: the detection of vehicles from video of urban traffic, the tracking of vehicles using a bipartite graph and the Convex Hull algorithm to delimit moving areas. Finally for anomaly detection we use two data structures to detect the beginning and end of the anomaly. The first is the QuadTree that groups vehicles that are stopped for a long time on the road and the second that approaches vehicles that are occluded. Experimental results show that our method is acceptable on the Track4 test set, with an F1 score of 85.7% and a mean squared error of 25.432.


title: Deep Intrinsic Decomposition with Adversarial Learning for Hyperspectral Image Classification

abstract: Convolutional neural networks (CNNs) have been demonstrated their powerful ability to extract discriminative features for hyperspectral image classification. However, general deep learning methods for CNNs ignore the influence of complex environmental factor which enlarges the intra-class variance and decreases the inter-class variance. This multiplies the difficulty to extract discriminative features. To overcome this problem, this work develops a novel deep intrinsic decomposition with adversarial learning, namely AdverDecom, for hyperspectral image classification to mitigate the negative impact of environmental factors on classification performance. First, we develop a generative network for hyperspectral image (HyperNet) to extract the environmental-related feature and category-related feature from the image. Then, a discriminative network is constructed to distinguish different environmental categories. Finally, a environmental and category joint learning loss is developed for adversarial learning to make the deep model learn discriminative features. Experiments are conducted over three commonly used real-world datasets and the comparison results show the superiority of the proposed method. The implementation of the proposed method and other compared methods could be accessed at https://github.com/shendu-sw/Adversarial Learning Intrinsic Decomposition for the sake of reproducibility.


title: MultiScale Spectral-Spatial Convolutional Transformer for Hyperspectral Image Classification

abstract: Due to the powerful ability in capturing the global information, Transformer has become an alternative architecture of CNNs for hyperspectral image classification. However, general Transformer mainly considers the global spectral information while ignores the multiscale spatial information of the hyperspectral image. In this paper, we propose a multiscale spectral-spatial convolutional Transformer (MultiscaleFormer) for hyperspectral image classification. First, the developed method utilizes multiscale spatial patches as tokens to formulate the spatial Transformer and generates multiscale spatial representation of each band in each pixel. Second, the spatial representation of all the bands in a given pixel are utilized as tokens to formulate the spectral Transformer and generate the multiscale spectral-spatial representation of each pixel. Besides, a modified spectral-spatial CAF module is constructed in the MultiFormer to fuse cross-layer spectral and spatial information. Therefore, the proposed MultiFormer can capture the multiscale spectral-spatial information and provide better performance than most of other architectures for hyperspectral image classification. Experiments are conducted over commonly used real-world datasets and the comparison results show the superiority of the proposed method.


title: Modeling Shortest Paths in Polymeric Networks using Spatial Branching Processes

abstract: Recent studies have established a connection between the macroscopic mechanical response of polymeric materials and the statistics of the shortest path (SP) length between distant nodes in the polymer network. Since these statistics can be costly to compute and difficult to study theoretically, we introduce a branching random walk (BRW) model to describe the SP statistics from the coarse-grained molecular dynamics (CGMD) simulations of polymer networks. We postulate that the first passage time (FPT) of the BRW to a given termination site can be used to approximate the statistics of the SP between distant nodes in the polymer network. We develop a theoretical framework for studying the FPT of spatial branching processes and obtain an analytical expression for estimating the FPT distribution as a function of the cross-link density. We demonstrate by extensive numerical calculations that the distribution of the FPT of the BRW model agrees well with the SP distribution from the CGMD simulations. The theoretical estimate and the corresponding numerical implementations of BRW provide an efficient way of approximating the SP distribution in a polymer network. Our results have the physical meaning that by accounting for the realistic topology of polymer networks, extensive bond-breaking is expected to occur at a much smaller stretch than that expected from idealized models assuming periodic network structures. Our work presents the first analysis of polymer networks as a BRW and sets the framework for developing a generalizable spatial branching model for studying the macroscopic evolution of polymeric systems.


title: The Role of Reference Points in Machine-Learned Atomistic Simulation Models

abstract: This paper introduces the Chemical Environment Modeling Theory (CEMT), a novel, generalized framework designed to overcome the limitations inherent in traditional atom-centered Machine Learning Force Field (MLFF) models, widely used in atomistic simulations of chemical systems. CEMT demonstrated enhanced flexibility and adaptability by allowing reference points to exist anywhere within the modeled domain and thus, enabling the study of various model architectures. Utilizing Gaussian Multipole (GMP) featurization functions, several models with different reference point sets, including finite difference grid-centered and bond-centered models, were tested to analyze the variance in capabilities intrinsic to models built on distinct reference points. The results underscore the potential of non-atom-centered reference points in force training, revealing variations in prediction accuracy, inference speed and learning efficiency. Finally, a unique connection between CEMT and real-space orbital-free finite element Density Functional Theory (FE-DFT) is established, and the implications include the enhancement of data efficiency and robustness. It allows the leveraging of spatially-resolved energy densities and charge densities from FE-DFT calculations, as well as serving as a pivotal step towards integrating known quantum-mechanical laws into the architecture of ML models.


title: Affective Polarization and Dynamics of Information Spread in Online Networks

abstract: Members of different political groups not only disagree about issues but also dislike and distrust each other. While social media can amplify this emotional divide -- called affective polarization by political scientists -- there is a lack of agreement on its strength and prevalence. We measure affective polarization on social media by quantifying the emotions and toxicity of reply interactions. We demonstrate that, as predicted by affective polarization, interactions between users with same ideology (in-group replies) tend to be positive, while interactions between opposite-ideology users (out-group replies) are characterized by negativity and toxicity. Second, we show that affective polarization generalizes beyond the in-group/out-group dichotomy and can be considered a structural property of social networks. Specifically, we show that emotions vary with network distance between users, with closer interactions eliciting positive emotions and more distant interactions leading to anger, disgust, and toxicity. Finally, we show that similar information exhibits different dynamics when spreading in emotionally polarized groups. These findings are consistent across diverse datasets spanning discussions on topics such as the COVID-19 pandemic and abortion in the US. Our research provides insights into the complex social dynamics of affective polarization in the digital age and its implications for political discourse.


title: Improved Regret Bounds of (Multinomial) Logistic Bandits via Regret-to-Confidence-Set Conversion

abstract: Logistic bandit is a ubiquitous framework of modeling users' choices, e.g., click vs. no click for advertisement recommender system. We observe that the prior works overlook or neglect dependencies in $S \geq \lVert \theta_\star \rVert_2$, where $\theta_\star \in \mathbb{R}^d$ is the unknown parameter vector, which is particularly problematic when $S$ is large, e.g., $S \geq d$. In this work, we improve the dependency on $S$ via a novel approach called {\it regret-to-confidence set conversion (R2CS)}, which allows us to construct a convex confidence set based on only the \textit{existence} of an online learning algorithm with a regret guarantee. Using R2CS, we obtain a strict improvement in the regret bound w.r.t. $S$ in logistic bandits while retaining computational feasibility and the dependence on other factors such as $d$ and $T$. We apply our new confidence set to the regret analyses of logistic bandits with a new martingale concentration step that circumvents an additional factor of $S$. We then extend this analysis to multinomial logistic bandits and obtain similar improvements in the regret, showing the efficacy of R2CS. While we applied R2CS to the (multinomial) logistic model, R2CS is a generic approach for developing confidence sets that can be used for various models, which can be of independent interest.


title: Group Robust Classification Without Any Group Information

abstract: Empirical risk minimization (ERM) is sensitive to spurious correlations in the training data, which poses a significant risk when deploying systems trained under this paradigm in high-stake applications. While the existing literature focuses on maximizing group-balanced or worst-group accuracy, estimating these accuracies is hindered by costly bias annotations. This study contends that current bias-unsupervised approaches to group robustness continue to rely on group information to achieve optimal performance. Firstly, these methods implicitly assume that all group combinations are represented during training. To illustrate this, we introduce a systematic generalization task on the MPI3D dataset and discover that current algorithms fail to improve the ERM baseline when combinations of observed attribute values are missing. Secondly, bias labels are still crucial for effective model selection, restricting the practicality of these methods in real-world scenarios. To address these limitations, we propose a revised methodology for training and validating debiased models in an entirely bias-unsupervised manner. We achieve this by employing pretrained self-supervised models to reliably extract bias information, which enables the integration of a logit adjustment training loss with our validation criterion. Our empirical analysis on synthetic and real-world tasks provides evidence that our approach overcomes the identified challenges and consistently enhances robust accuracy, attaining performance which is competitive with or outperforms that of state-of-the-art methods, which, conversely, rely on bias labels for validation.


title: Design-Based Causal Inference with Missing Outcomes: Missingness Mechanisms, Imputation-Assisted Randomization Tests, and Covariate Adjustment

abstract: Design-based causal inference, also known as randomization-based or finite-population causal inference, is one of the most widely used causal inference frameworks, largely due to the merit that its validity can be guaranteed by study design (e.g., randomized experiments) and does not require assuming specific outcome-generating distributions or super-population models. Despite its advantages, design-based causal inference can still suffer from other data-related issues, among which outcome missingness is a prevalent and significant challenge. This work systematically studies the outcome missingness problem in design-based causal inference. First, we propose a general and flexible outcome missingness mechanism that can facilitate finite-population-exact randomization tests for the null effect. Second, under this general missingness mechanism, we propose a general framework called ``imputation and re-imputation" for conducting finite-population-exact randomization tests in design-based causal inference with missing outcomes. This framework can incorporate any imputation algorithms (from linear models to advanced machine learning-based imputation algorithms) while ensuring finite-population-exact type-I error rate control. Third, we extend our framework to conduct covariate adjustment in randomization tests and construct finite-population-valid confidence regions with missing outcomes. Our framework is evaluated via extensive simulation studies and applied to a large-scale randomized experiment. Corresponding Python and R packages are also developed.


title: Time-Dependent AGN Disc Winds I -- X-ray Irradiation

abstract: We study AGN line driven disc winds using time-dependent radiation hydrodynamics. The key criterion for determining wind launching is the coupling strength of the UV radiation field via the spectral lines of the gas. The strength of these lines in turn relies crucially on the gas ionization state, determined by the local X-ray intensity. We consider a suite of models where the central ionizing radiation is affected by scattering, absorption and re-emission by the intervening gas. In a pure attenuation model, the disc launches an episodic wind, as previous studies have shown. Including scattering or re-emission tends to weaken the wind, lowering the mass flux and outflow velocity and if sufficiently dominant, suppressing the outflow entirely. However, the exponential nature of radiative attenuation means only a modest, factor of a few, increase in the absorption cross section can overcome the wind suppression due to scattering and re-emission. We find mass outflow rates of $\sim 20\%$ or more of the assumed inflow rate through the disk, indicating that radiation driven winds may significantly alter the structure of the accretion flow. The winds also supply a large, time-varying column of material above the nominal constant disk scale height, which will determine the geometry of reprocessed emission from the central source. Our results suggest the need for accurate photoionization modeling, radiation transport as well as accretion disc physics, to study their effects on the AGN disc winds


title: Local atomic and magnetic structure of multiferroic (Sr,Ba)(Mn,Ti)O$_3$

abstract: We present a detailed study of the local atomic and magnetic structure of the type-I multiferroic perovskite system (Sr,Ba)(Mn,Ti)O$_3$ using x-ray and neutron pair distribution function (PDF) analysis, polarized neutron scattering, and muon spin relaxation ($\mu$SR) techniques. The atomic PDF analysis reveals widespread nanoscale tetragonal distortions of the crystal structure even in the paraelectric phase with average cubic symmetry, corresponding to incipient ferroelectricity in the local structure. Magnetic PDF analysis, polarized neutron scattering, and $\mu$SR likewise confirm the presence of short-range antiferromagnetic correlations in the paramagnetic state, which grow in magnitude as the temperature approaches the magnetic transition. We show that these short-range magnetic correlations coincide with a reduction of the tetragonal (i.e. ferroelectric) distortion in the average structure, suggesting that short-range magnetism can play an important role in magnetoelectric and/or magnetostructural phenomena even without genuine long-range magnetic order. The reduction of the tetragonal distortion scales linearly with the local magnetic order parameter, pointing to spontaneous linear magnetoelectric coupling in this system. These findings provide greater insight into the multiferroic properties of (Sr,Ba)(Mn,Ti)O$_3$ and demonstrate the importance of investigating the local atomic and magnetic structure to gain a deeper understanding of the intertwined degrees of freedom in multiferroics.


title: Quantum Interactions in Topological R166 Kagome Magnet

abstract: Kagome magnet has been found to be a fertile ground for the search of exotic quantum states in condensed matter. Arising from the unusual geometry, the quantum interactions in the kagome lattice give rise to various quantum states, including the Chern-gapped Dirac fermion, Weyl fermion, flat band and van Hove singularity. Here we review recent advances in the study of the R166 kagome magnet (RT6E6, R = rare earths; T = transition metals; and E = Sn, Ge, etc.) whose crystal structure highlights the transition-metal-based kagome lattice and rare-earth sublattice. Compared with other kagome magnets, the R166 family owns the particularly strong interplays between the d electrons on the kagome site and the localized f electrons on the rare-earth site. In the form of spin-orbital coupling, exchange interaction and many-body effect, the quantum interactions play an essential role in the Berry curvature field in both the reciprocal and real spaces of R166 family. We discuss the spectroscopic and transport visualization of the topological electrons hosted in the Mn kagome layer of RMn6Sn6 and the various topological effects due to the quantum interactions, including the Chern-gap opening, the exchange-biased effect, the topological Hall effect and the emergent inductance. We hope this work serves as a guide for future explorations of quantum magnets.


title: Interpretable machine learning for finding intermediate-mass black holes

abstract: Definitive evidence that globular clusters (GCs) host intermediate-mass black holes (IMBHs) is elusive. Machine learning (ML) models trained on GC simulations can in principle predict IMBH host candidates based on observable features. This approach has two limitations: first, an accurate ML model is expected to be a black box due to complexity; second, despite our efforts to realistically simulate GCs, the simulation physics or initial conditions may fail to fully reflect reality. Therefore our training data may be biased, leading to a failure in generalization on observational data. Both the first issue -- explainability/interpretability -- and the second -- out of distribution generalization and fairness -- are active areas of research in ML. Here we employ techniques from these fields to address them: we use the anchors method to explain an XGBoost classifier; we also independently train a natively interpretable model using Certifiably Optimal RulE ListS (CORELS). The resulting model has a clear physical meaning, but loses some performance with respect to XGBoost. We evaluate potential candidates in real data based not only on classifier predictions but also on their similarity to the training data, measured by the likelihood of a kernel density estimation model. This measures the realism of our simulated data and mitigates the risk that our models may produce biased predictions by working in extrapolation. We apply our classifiers to real GCs, obtaining a predicted classification, a measure of the confidence of the prediction, an out-of-distribution flag, a local rule explaining the prediction of XGBoost and a global rule from CORELS.


title: Certain linear isomorphisms for hyperalgebras relative to a Chevalley group

abstract: Let $G$ be a simply connected and simple algebraic group defined and split over a finite prime field $\mathbb{F}_p$ of $p$ elements. In this paper, using an $\mathbb{F}_p$-linear map splitting Frobenius endomorphism on a hyperalgebra relative to $G$, we obtain some $\mathbb{F}_p$-linear isomorphisms induced by multiplication in the hyperalgebra.


title: Optimization-Free Test-Time Adaptation for Cross-Person Activity Recognition

abstract: Human Activity Recognition (HAR) models often suffer from performance degradation in real-world applications due to distribution shifts in activity patterns across individuals. Test-Time Adaptation (TTA) is an emerging learning paradigm that aims to utilize the test stream to adjust predictions in real-time inference, which has not been explored in HAR before. However, the high computational cost of optimization-based TTA algorithms makes it intractable to run on resource-constrained edge devices. In this paper, we propose an Optimization-Free Test-Time Adaptation (OFTTA) framework for sensor-based HAR. OFTTA adjusts the feature extractor and linear classifier simultaneously in an optimization-free manner. For the feature extractor, we propose Exponential DecayTest-time Normalization (EDTN) to replace the conventional batch normalization (CBN) layers. EDTN combines CBN and Test-time batch Normalization (TBN) to extract reliable features against domain shifts with TBN's influence decreasing exponentially in deeper layers. For the classifier, we adjust the prediction by computing the distance between the feature and the prototype, which is calculated by a maintained support set. In addition, the update of the support set is based on the pseudo label, which can benefit from reliable features extracted by EDTN. Extensive experiments on three public cross-person HAR datasets and two different TTA settings demonstrate that OFTTA outperforms the state-of-the-art TTA approaches in both classification performance and computational efficiency. Finally, we verify the superiority of our proposed OFTTA on edge devices, indicating possible deployment in real applications. Our code is available at https://github.com/Claydon-Wang/OFTTA.


title: Covariate Balancing and the Equivalence of Weighting and Doubly Robust Estimators of Average Treatment Effects

abstract: We show that when the propensity score is estimated using a suitable covariate balancing procedure, the commonly used inverse probability weighting (IPW) estimator, augmented inverse probability weighting (AIPW) with linear conditional mean, and inverse probability weighted regression adjustment (IPWRA) with linear conditional mean are all numerically the same for estimating the average treatment effect (ATE) or the average treatment effect on the treated (ATT). Further, suitably chosen covariate balancing weights are automatically normalized, which means that normalized and unnormalized versions of IPW and AIPW are identical. For estimating the ATE, the weights that achieve the algebraic equivalence of IPW, AIPW, and IPWRA are based on propensity scores estimated using the inverse probability tilting (IPT) method of Graham, Pinto and Egel (2012). For the ATT, the weights are obtained using the covariate balancing propensity score (CBPS) method developed in Imai and Ratkovic (2014). These equivalences also make covariate balancing methods attractive when the treatment is confounded and one is interested in the local average treatment effect.


title: A General Framework for Robust G-Invariance in G-Equivariant Networks

abstract: We introduce a general method for achieving robust group-invariance in group-equivariant convolutional neural networks ($G$-CNNs), which we call the $G$-triple-correlation ($G$-TC) layer. The approach leverages the theory of the triple-correlation on groups, which is the unique, lowest-degree polynomial invariant map that is also complete. Many commonly used invariant maps--such as the max--are incomplete: they remove both group and signal structure. A complete invariant, by contrast, removes only the variation due to the actions of the group, while preserving all information about the structure of the signal. The completeness of the triple correlation endows the $G$-TC layer with strong robustness, which can be observed in its resistance to invariance-based adversarial attacks. In addition, we observe that it yields measurable improvements in classification accuracy over standard Max $G$-Pooling in $G$-CNN architectures. We provide a general and efficient implementation of the method for any discretized group, which requires only a table defining the group's product structure. We demonstrate the benefits of this method for $G$-CNNs defined on both commutative and non-commutative groups--$SO(2)$, $O(2)$, $SO(3)$, and $O(3)$ (discretized as the cyclic $C8$, dihedral $D16$, chiral octahedral $O$ and full octahedral $O_h$ groups)--acting on $\mathbb{R}^2$ and $\mathbb{R}^3$ on both $G$-MNIST and $G$-ModelNet10 datasets.


title: Linearly Embedding Sparse Vectors from $\ell_2$ to $\ell_1$ via Deterministic Dimension-Reducing Maps

abstract: This note is concerned with deterministic constructions of $m \times N$ matrices satisfying a restricted isometry property from $\ell_2$ to $\ell_1$ on $s$-sparse vectors. Similarly to the standard ($\ell_2$ to $\ell_2$) restricted isometry property, such constructions can be found in the regime $m \asymp s^2$, at least in theory. With effectiveness of implementation in mind, two simple constructions are presented in the less pleasing but still relevant regime $m \asymp s^4$. The first one, executing a Las Vegas strategy, is quasideterministic and applies in the real setting. The second one, exploiting Golomb rulers, is explicit and applies to the complex setting. As a stepping stone, an explicit isometric embedding from $\ell_2^n(\mathbb{C})$ to $\ell_4^{cn^2}(\mathbb{C})$ is presented. Finally, the extension of the problem from sparse vectors to low-rank matrices is raised as an open question.


title: On the associated spaces of the Hardy space

abstract: Characterizations of the associated spaces and second associated spaces of the Hardy space on $\mathbb{R}^n$ are given. Some results on the associated spaces of the $\textrm{BMO}(\mathbb{R}^n)$ space are proved also.


title: Accelerated degradation modeling considering long-range dependence and unit-to-unit variability

abstract: Accelerated degradation testing (ADT) is an effective way to evaluate the reliability and lifetime of highly reliable products. Existing studies have shown that the degradation processes of some products are non-Markovian with long-range dependence due to the interaction with environments. Besides, the degradation processes of products from the same population generally vary from each other due to various uncertainties. These two aspects bring great difficulty for ADT modeling. In this paper, we propose an improved ADT model considering both long-range dependence and unit-to-unit variability. To be specific, fractional Brownian motion (FBM) is utilized to capture the long-range dependence in the degradation process. The unit-to-unit variability among multiple products is captured by a random variable in the degradation rate function. To ensure the accuracy of the parameter estimations, a novel statistical inference method based on expectation maximization (EM) algorithm is proposed, in which the maximization of the overall likelihood function is achieved. The effectiveness of the proposed method is fully verified by a simulation case and a microwave case. The results show that the proposed model is more suitable for ADT modeling and analysis than existing ADT models.


title: On the second-order zero differential spectra of some power functions over finite fields

abstract: Boukerrou et al. (IACR Trans. Symmetric Cryptol. 2020(1), 331-362) introduced the notion of Feistel Boomerang Connectivity Table (FBCT), the Feistel counterpart of the Boomerang Connectivity Table (BCT), and the Feistel boomerang uniformity (which is the same as the second-order zero differential uniformity in even characteristic). FBCT is a crucial table for the analysis of the resistance of block ciphers to power attacks such as differential and boomerang attacks. It is worth noting that the coefficients of FBCT are related to the second-order zero differential spectra of functions. In this paper, by carrying out certain finer manipulations of solving specific equations over the finite field $\mathbb{F}_{p^n}$, we explicitly determine the second-order zero differential spectra of some power functions with low differential uniformity, and show that our considered functions also have low second-order zero differential uniformity. Our study pushes further former investigations on second-order zero differential uniformity and Feistel boomerang differential uniformity for a power function $F$.


title: Enhancing Grasping Performance of Novel Objects through an Improved Fine-Tuning Process

abstract: Grasping algorithms have evolved from planar depth grasping to utilizing point cloud information, allowing for application in a wider range of scenarios. However, data-driven grasps based on models trained on basic open-source datasets may not perform well on novel objects, which are often required in different scenarios, necessitating fine-tuning using new objects. The data driving these algorithms essentially corresponds to the closing region of the hand in 6D pose, and due to the uniqueness of 6D pose, synthetic annotation or real-machine annotation methods are typically employed. Acquiring large amounts of data with real-machine annotation is challenging, making synthetic annotation a common practice. However, obtaining annotated 6D pose data using conventional methods is extremely time-consuming. Therefore, we propose a method to quickly acquire data for novel objects, enabling more efficient fine-tuning. Our method primarily samples grasp orientations to generate and annotate grasps. Experimental results demonstrate that our fine-tuning process for a new object is 400 \% faster than other methods. Furthermore, we propose an optimized grasp annotation framework that accounts for the effects of the gripper closing, making the annotations more reasonable. Upon acceptance of this paper, we will release our algorithm as open-source.


title: The Roelcke Precompactness and Compactifications of Transformations Groups of Discrete Spaces and Homogeneous Chains

abstract: The Roelcke precompactness of transformation groups of discrete spaces and chains in the permutation topology and LOTS in the topology of pointwise convergence is studied. For ultratransitive actions compactifications of transformation groups using the Ellis construction are built.