title: Assessing the Performance of the ADAPT and AFT Flux Transport Models Using In-Situ Measurements From Multiple Satellites

abstract: The launches of Parker Solar Probe (Parker) and Solar Orbiter (SolO) are enabling a new era of solar wind studies that track the solar wind from its origin at the photosphere, through the corona, to multiple vantage points in the inner heliosphere. A key ingredient for these models is the input photospheric magnetic field map that provides the boundary condition for the coronal portion of many heliospheric models. In this paper, we perform steady-state, data-driven magnetohydrodynamic (MHD) simulations of the solar wind during Carrington rotation 2258 with the GAMERA model. We use the ADAPT and AFT flux transport models and quantitatively assess how well each model matches in-situ measurements from Parker, SolO, and Earth. We find that both models reproduce the magnetic field components at Parker quantitatively well. At SolO and Earth, the magnetic field is reproduced relatively well, though not as well as at Parker, and the density is reproduced extremely poorly. The velocity is overpredicted at Parker, but not at SolO or Earth, hinting that the Wang-Sheeley-Arge (WSA) relation, fine-tuned for Earth, misses the deceleration of the solar wind near the Sun. We conclude that AFT performs quantitatively similarly to ADAPT in all cases and that both models are comparable to a purely WSA heliospheric treatment with no MHD component. Finally, we trace field lines from SolO back to an active region outflow that was observed by Hinode/EIS, and which shows evidence of elevated charge state ratios.


title: Fusing Neural and Physical: Augment Protein Conformation Sampling with Tractable Simulations

abstract: The protein dynamics are common and important for their biological functions and properties, the study of which usually involves time-consuming molecular dynamics (MD) simulations in silico. Recently, generative models has been leveraged as a surrogate sampler to obtain conformation ensembles with orders of magnitude faster and without requiring any simulation data (a "zero-shot" inference). However, being agnostic of the underlying energy landscape, the accuracy of such generative model may still be limited. In this work, we explore the few-shot setting of such pre-trained generative sampler which incorporates MD simulations in a tractable manner. Specifically, given a target protein of interest, we first acquire some seeding conformations from the pre-trained sampler followed by a number of physical simulations in parallel starting from these seeding samples. Then we fine-tuned the generative model using the simulation trajectories above to become a target-specific sampler. Experimental results demonstrated the superior performance of such few-shot conformation sampler at a tractable computational cost.


title: Parametric Augmentation for Time Series Contrastive Learning

abstract: Modern techniques like contrastive learning have been effectively used in many areas, including computer vision, natural language processing, and graph-structured data. Creating positive examples that assist the model in learning robust and discriminative representations is a crucial stage in contrastive learning approaches. Usually, preset human intuition directs the selection of relevant data augmentations. Due to patterns that are easily recognized by humans, this rule of thumb works well in the vision and language domains. However, it is impractical to visually inspect the temporal structures in time series. The diversity of time series augmentations at both the dataset and instance levels makes it difficult to choose meaningful augmentations on the fly. In this study, we address this gap by analyzing time series data augmentation using information theory and summarizing the most commonly adopted augmentations in a unified format. We then propose a contrastive learning framework with parametric augmentation, AutoTCL, which can be adaptively employed to support time series representation learning. The proposed approach is encoder-agnostic, allowing it to be seamlessly integrated with different backbone encoders. Experiments on univariate forecasting tasks demonstrate the highly competitive results of our method, with an average 6.5\% reduction in MSE and 4.7\% in MAE over the leading baselines. In classification tasks, AutoTCL achieves a $1.2\%$ increase in average accuracy.


title: Dynamic Patch-aware Enrichment Transformer for Occluded Person Re-Identification

abstract: Person re-identification (re-ID) continues to pose a significant challenge, particularly in scenarios involving occlusions. Prior approaches aimed at tackling occlusions have predominantly focused on aligning physical body features through the utilization of external semantic cues. However, these methods tend to be intricate and susceptible to noise. To address the aforementioned challenges, we present an innovative end-to-end solution known as the Dynamic Patch-aware Enrichment Transformer (DPEFormer). This model effectively distinguishes human body information from occlusions automatically and dynamically, eliminating the need for external detectors or precise image alignment. Specifically, we introduce a dynamic patch token selection module (DPSM). DPSM utilizes a label-guided proxy token as an intermediary to identify informative occlusion-free tokens. These tokens are then selected for deriving subsequent local part features. To facilitate the seamless integration of global classification features with the finely detailed local features selected by DPSM, we introduce a novel feature blending module (FBM). FBM enhances feature representation through the complementary nature of information and the exploitation of part diversity. Furthermore, to ensure that DPSM and the entire DPEFormer can effectively learn with only identity labels, we also propose a Realistic Occlusion Augmentation (ROA) strategy. This strategy leverages the recent advances in the Segment Anything Model (SAM). As a result, it generates occlusion images that closely resemble real-world occlusions, greatly enhancing the subsequent contrastive learning process. Experiments on occluded and holistic re-ID benchmarks signify a substantial advancement of DPEFormer over existing state-of-the-art approaches. The code will be made publicly available.


title: I Am Not Them: Fluid Identities and Persistent Out-group Bias in Large Language Models

abstract: We explored cultural biases-individualism vs. collectivism-in ChatGPT across three Western languages (i.e., English, German, and French) and three Eastern languages (i.e., Chinese, Japanese, and Korean). When ChatGPT adopted an individualistic persona in Western languages, its collectivism scores (i.e., out-group values) exhibited a more negative trend, surpassing their positive orientation towards individualism (i.e., in-group values). Conversely, when a collectivistic persona was assigned to ChatGPT in Eastern languages, a similar pattern emerged with more negative responses toward individualism (i.e., out-group values) as compared to collectivism (i.e., in-group values). The results indicate that when imbued with a particular social identity, ChatGPT discerns in-group and out-group, embracing in-group values while eschewing out-group values. Notably, the negativity towards the out-group, from which prejudices and discrimination arise, exceeded the positivity towards the in-group. The experiment was replicated in the political domain, and the results remained consistent. Furthermore, this replication unveiled an intrinsic Democratic bias in Large Language Models (LLMs), aligning with earlier findings and providing integral insights into mitigating such bias through prompt engineering. Extensive robustness checks were performed using varying hyperparameter and persona setup methods, with or without social identity labels, across other popular language models.


title: Counting cusp excursions of reciprocal geodesics

abstract: For a fixed cusp neighborhood (determined by depth D) of the modular surface, we investigate the class of reciprocal geodesics that enter this neighborhood (called a cusp excursion) a fixed number of times.


title: Broadband spectroscopy of quantum noise

abstract: Characterizing noise is key to the optimal control of the quantum system it affects. Using a single-qubit probe and appropriate sequences of $\pi$ and non-$\pi$ pulses, we show how one can characterize the noise a quantum bath generates across a wide range of frequencies -- including frequencies below the limit set by the probe's $\mathbb{T}_2$ time. To do so we leverage an exact expression for the dynamics of the probe in the presence of non-$\pi$ pulses, and a general inequality between the symmetric (classical) and anti-symmetric (quantum) components of the noise spectrum generated by a Gaussian bath. Simulation demonstrates the effectiveness of our method.


title: Competitive Equilibrium for Chores: from Dual Eisenberg-Gale to a Fast, Greedy, LP-based Algorithm

abstract: We study the computation of competitive equilibrium for Fisher markets with $n$ agents and $m$ divisible chores. Prior work showed that competitive equilibria correspond to the nonzero KKT points of a non-convex analogue of the Eisenberg-Gale convex program. We introduce an analogue of the Eisenberg-Gale dual for chores: we show that all KKT points of this dual correspond to competitive equilibria, and while it is not a dual of the non-convex primal program in a formal sense, the objectives touch at all KKT points. Similar to the primal, the dual has problems from an optimization perspective: there are many feasible directions where the objective tends to positive infinity. We then derive a new constraint for the dual, which restricts optimization to a hyperplane that avoids all these directions. We show that restriction to this hyperplane retains all KKT points, and surprisingly, does not introduce any new ones. This allows, for the first time ever, application of iterative optimization methods over a convex region for computing competitive equilibria for chores. We next introduce a greedy Frank-Wolfe algorithm for optimization over our program and show a state-of-the-art convergence rate to competitive equilibrium. In the case of equal incomes, we show a $\mathcal{\tilde O}(n/\epsilon^2)$ rate of convergence, which improves over the two prior state-of-the-art rates of $\mathcal{\tilde O}(n^3/\epsilon^2)$ for an exterior-point method and $\mathcal{\tilde O}(nm/\epsilon^2)$ for a combinatorial method. Moreover, our method is significantly simpler: each iteration of our method only requires solving a simple linear program. We show through numerical experiments on simulated data and a paper review bidding dataset that our method is extremely practical. This is the first highly practical method for solving competitive equilibrium for Fisher markets with chores.


title: Orbital Competition in Bilayer Graphene's Fractional Quantum Hall Effect

abstract: The lowest Landau level of bilayer graphene has an octet of internal degrees of freedom, composed from spin, valley and orbital two-level systems. Dominance of $n=0$ orbitals over $n=1$ orbitals in low energy quantum fluctuations leads to distinct fractional quantum Hall characteristics compared dominance of $n=1$ over $n=0$. The competition between $n=0$ and $n=1$ orbitals depends sensitively on particle-hole asymmetry and on Lamb shifts due to exchange interactions with the negative energy sea, which must be accounted for simultaneously in assessing the orbital competition. We identify the circumstances under which $n=1$, which supports strong even-denominator FQH states with non-abelian quasiparticles, emerges robustly as the low-energy Landau level.


title: Barrier-Enhanced Homotopic Parallel Trajectory Optimization for Safety-Critical Autonomous Driving

abstract: Enforcing safety while preventing overly conservative behaviors is essential for autonomous vehicles to achieve high task performance. In this paper, we propose a barrier-enhanced homotopic parallel trajectory optimization (BHPTO) approach with over-relaxed alternating direction method of multipliers (ADMM) for real-time integrated decision-making and planning. To facilitate safety interactions between the ego vehicle (EV) and surrounding vehicles, a spatiotemporal safety module exhibiting bi-convexity is developed on the basis of barrier function. Varying barrier coefficients are adopted for different time steps in a planning horizon to account for the motion uncertainties of surrounding HVs and mitigate conservative behaviors. Additionally, we exploit the discrete characteristics of driving maneuvers to initialize nominal behavior-oriented free-end homotopic trajectories based on reachability analysis, and each trajectory is locally constrained to a specific driving maneuver while sharing the same task objectives. By leveraging the bi-convexity of the safety module and the kinematics of the EV, we formulate the BHPTO as a bi-convex optimization problem. Then constraint transcription and over-relaxed ADMM are employed to streamline the optimization process, such that multiple trajectories are generated in real time with feasibility guarantees. Through a series of experiments, the proposed development demonstrates improved task accuracy, stability, and consistency in various traffic scenarios using synthetic and real-world traffic datasets.


title: A Ramanujan enigma: Part 2

abstract: In his book entitled Divergent Series, Hardy makes various references to divergent series of sine functions. In this paper, we show how such series may be treated rigorously and, in particular, we revisit Entry 17(v) in Ramanujan's Notebooks.


title: Permutations with a Given X-Descent Set

abstract: Motivated by the work of Grinberg and Stanley, we investigate the enumeration of permutations with a given $X$-descent set, a generalization of the classical notion of a descent set. Our work expands on recent developments of Diaz-Lopez, Harris, Insko, Omar and Sagan and has interesting connections to Hamiltonian paths in directed graphs.


title: Quasar winds caught on acceleration and deceleration

abstract: We present an observational study of wind acceleration based on four low-ionization broad absorption line (LoBAL) quasars (J0136, J1238, J1259, J1344). J0136 and J1344 (group-1) are radio quiet and show large BAL-velocity shifts as opposed to stable line-locking associated absorption lines (AALs). Notably, J1344 displays a linear relation between BAL-velocity shift and time interval over three consecutive epochs, characteristic of compelling evidence for BAL acceleration. J1238 and J1259 (group 2) exhibit small BAL-velocity shifts along with steep-spectrum, weak radio emission at 3.0 and 1.4 GHz. All four quasars have spectral energy distributions (SEDs) with a peak at $\lambda_{\rm rest }\sim10~\mu$m, suggesting a link between the BAL acceleration and hot dust emission. The group-2 quasars are redder than group-1 quasars and have a steeper rise at $1<\lambda_{\rm rest }<3~\mu$m in their SEDs. All but J1238 exhibit a steep rise followed by a plateau-like time evolution in BAL-velocity shift. Our investigations, combined with previous studies of BAL acceleration, indicate that (1) the BAL-ISM coupling process is one of the major avenues for the origin of quasar reddening and patchy obscuration, (2) AAL outflows are ubiquitous and likely signify large-scale remnants of BAL winds coupled to interstellar medium (ISM), and (3) wind deceleration that is closely linked to the BAL-ISM coupling process may produce weak radio emission in otherwise radio-quiet quasars.


title: Collaborative Learning with Different Labeling Functions

abstract: We study a variant of Collaborative PAC Learning, in which we aim to learn an accurate classifier for each of the $n$ data distributions, while minimizing the number of samples drawn from them in total. Unlike in the usual collaborative learning setup, it is not assumed that there exists a single classifier that is simultaneously accurate for all distributions. We show that, when the data distributions satisfy a weaker realizability assumption, which appeared in [Crammer and Mansour, 2012] in the context of multi-task learning, sample-efficient learning is still feasible. We give a learning algorithm based on Empirical Risk Minimization (ERM) on a natural augmentation of the hypothesis class, and the analysis relies on an upper bound on the VC dimension of this augmented class. In terms of the computational efficiency, we show that ERM on the augmented hypothesis class is NP-hard, which gives evidence against the existence of computationally efficient learners in general. On the positive side, for two special cases, we give learners that are both sample- and computationally-efficient.


title: The XENONnT Dark Matter Experiment

abstract: The multi-staged XENON program at INFN Laboratori Nazionali del Gran Sasso aims to detect dark matter with two-phase liquid xenon time projection chambers of increasing size and sensitivity. The XENONnT experiment is the latest detector in the program, planned to be an upgrade of its predecessor XENON1T. It features an active target of 5.9 tonnes of cryogenic liquid xenon (8.5 tonnes total mass in cryostat). The experiment is expected to extend the sensitivity to WIMP dark matter by more than an order of magnitude compared to XENON1T, thanks to the larger active mass and the significantly reduced background, improved by novel systems such as a radon removal plant and a neutron veto. This article describes the XENONnT experiment and its sub-systems in detail and reports on the detector performance during the first science run.


title: Incremental Sequence Labeling: A Tale of Two Shifts

abstract: The incremental sequence labeling task involves continuously learning new classes over time while retaining knowledge of the previous ones. Our investigation identifies two significant semantic shifts: E2O (where the model mislabels an old entity as a non-entity) and O2E (where the model labels a non-entity or old entity as a new entity). Previous research has predominantly focused on addressing the E2O problem, neglecting the O2E issue. This negligence results in a model bias towards classifying new data samples as belonging to the new class during the learning process. To address these challenges, we propose a novel framework, Incremental Sequential Labeling without Semantic Shifts (IS3). Motivated by the identified semantic shifts (E2O and O2E), IS3 aims to mitigate catastrophic forgetting in models. As for the E2O problem, we use knowledge distillation to maintain the model's discriminative ability for old entities. Simultaneously, to tackle the O2E problem, we alleviate the model's bias towards new entities through debiased loss and optimization levels. Our experimental evaluation, conducted on three datasets with various incremental settings, demonstrates the superior performance of IS3 compared to the previous state-of-the-art method by a significant margin.The data, code, and scripts are publicly available at https://github.com/zzz47zzz/codebase-for-incremental-learning-with-llm.


title: Rank three instantons, representations and sutures

abstract: We show that the knot group of any knot in any integer homology sphere admits a non-abelian representation into $SU(3)$ such that meridians are mapped to matrices whose eigenvalues are the three distinct third roots of unity. This answers the $N=3$ case of a question posed by Xie and the first author. We also characterize when a $PU(3)$-bundle admits a flat connection. The key ingredient in the proofs is a study of the ring structure of $U(3)$ instanton Floer homology of $S^1\times \Sigma_g$. In an earlier paper, Xie and the first author stated the so-called eigenvalue conjecture about this ring, and in this paper we partially resolve this conjecture. This allows us to establish a surface decomposition theorem for $U(3)$ instanton Floer homology of sutured manifolds, and then obtain the mentioned topological applications. Along the way, we prove a structure theorem for $U(3)$ Donaldson invariants, which is the counterpart of Kronheimer and Mrowka's structure theorem for $U(2)$ Donaldson invariants. We also prove a non-vanishing theorem for the $U(3)$ Donaldson invariants of symplectic manifolds.


title: Light-Hole Spin Confined in Germanium

abstract: The selective confinement of light holes (LHs) in tensile strained germanium (Ge) quantum well is studied by mapping the electronic structure of Ge$_{1-x}$Sn$_x$/Ge/Ge$_{1-x}$Sn$_x$ heterostructures as a function of Sn content, residual strain, and Ge well thickness. it is shown that above $12\,\text{at.}\%$ Sn and below $0.4\%$ residual compressive strain in the barriers, the tensile strain in Ge becomes sufficiently large to yield a valence band edge with LH-like character, thus forming a quasi two-dimensional LH gas in Ge. The LH ground state has a larger in-plane effective mass than that of heavy hole (HH) in Si$_{1-y}$Ge$_y$/Ge/Si$_{1-y}$Ge$_y$ quantum wells. Moreover, LHs in optimal Ge$_{1-x}$Sn$_x$/Ge/Ge$_{1-x}$Sn$_x$ heterostructures are found to exhibit a strong $g$-tensor anisotropy, with the in-plane component one order of magnitude larger than that of HHs in typical planar systems. Two of three structure-inversion-asymmetry Rashba parameters, both of which are critical in electric-dipole-spin-resonance (EDSR) experiments, are effectively ten times the size of the cubic Rashba parameter in HH quantum wells. In the regime of LH selective confinement, every layer of the heterostructure is of direct bandgap which can be relevant for efficient optical photon-spin qubit interfaces. This work discusses the broad landscape of the characteristics of LH spin confined in Ge to guide the design and implementation of LH spin-based devices.


title: PRISE: LLM-Style Sequence Compression for Learning Temporal Action Abstractions in Control

abstract: Temporal action abstractions, along with belief state representations, are a powerful knowledge sharing mechanism for sequential decision making. In this work, we propose a novel view that treats inducing temporal action abstractions as a sequence compression problem. To do so, we bring a subtle but critical component of LLM training pipelines -- input tokenization via byte pair encoding (BPE) -- to the seemingly distant task of learning skills of variable time span in continuous control domains. We introduce an approach called Primitive Sequence Encoding (PRISE) that combines continuous action quantization with BPE to learn powerful action abstractions. We empirically show that high-level skills discovered by PRISE from a multitask set of robotic manipulation demonstrations significantly boost the performance of both multitask imitation learning as well as few-shot imitation learning on unseen tasks. Our code is released at https://github.com/FrankZheng2022/PRISE.


title: Composition Orderings for Linear Functions and Matrix Multiplication Orderings

abstract: We consider composition orderings for linear functions of one variable. Given $n$ linear functions $f_1,\dots,f_n$ and a constant $c$, the objective is to find a permutation $\sigma$ that minimizes/maximizes $f_{\sigma(n)}\circ\dots\circ f_{\sigma(1)}(c)$. It was first studied in the area of time-dependent scheduling, and known to be solvable in $O(n\log n)$ time if all functions are nondecreasing. In this paper, we present a complete characterization of optimal composition orderings for this case, by regarding linear functions as two-dimensional vectors. We also show several interesting properties on optimal composition orderings such as the equivalence between local and global optimality. Furthermore, by using the characterization above, we provide a fixed-parameter tractable (FPT) algorithm for the composition ordering problem for general linear functions, with respect to the number of decreasing linear functions. We next deal with matrix multiplication orderings as a generalization of composition of linear functions. Given $n$ matrices $M_1,\dots,M_n\in\mathbb{R}^{m\times m}$ and two vectors $w,y\in\mathbb{R}^m$, where $m$ denotes a positive integer, the objective is to find a permutation $\sigma$ that minimizes/maximizes $w^\top M_{\sigma(n)}\dots M_{\sigma(1)} y$. The problem is also viewed as a generalization of flow shop scheduling through a limit. By this extension, we show that the multiplication ordering problem for $2\times 2$ matrices is solvable in $O(n\log n)$ time if all the matrices are simultaneously triangularizable and have nonnegative determinants, and FPT with respect to the number of matrices with negative determinants, if all the matrices are simultaneously triangularizable. As the negative side, we finally prove that three possible natural generalizations are NP-hard: 1) when $m=2$, 2) when $m\geq 3$, and 3) the target version of the problem.


title: Khovanov homology and exotic $4$-manifolds

abstract: We show that the Khovanov-Rozansky $\mathfrak{gl}_2$ skein lasagna module distinguishes the exotic pair of knot traces $X_{-1}(-5_2)$ and $X_{-1}(P(3,-3,-8))$, an example first discovered by Akbulut. This gives the first analysis-free proof of the existence of exotic compact orientable $4$-manifolds. We also present a family of exotic knot traces that seem not directly recoverable from gauge/Floer-theoretic methods. Along the way, we present new explicit calculations of the Khovanov skein lasagna modules, and we define lasagna generalizations of the Lee homology and Rasmussen $s$-invariant, which are of independent interest. Other consequences of our work include a slice obstruction of knots in $4$-manifolds with nonvanishing skein lasagna module, a sharp shake genus bound for some knots from the lasagna $s$-invariant, and a construction of induced maps on Khovanov homology for cobordisms in $k\mathbb{CP}^2$.


title: Steering Conversational Large Language Models for Long Emotional Support Conversations

abstract: In this study, we address the challenge of consistently following emotional support strategies in long conversations by large language models (LLMs). We introduce the Strategy-Relevant Attention (SRA) metric, a model-agnostic measure designed to evaluate the effectiveness of LLMs in adhering to strategic prompts in emotional support contexts. By analyzing conversations within the Emotional Support Conversations dataset (ESConv) using LLaMA models, we demonstrate that SRA is significantly correlated with a model's ability to sustain the outlined strategy throughout the interactions. Our findings reveal that the application of SRA-informed prompts leads to enhanced strategic adherence, resulting in conversations that more reliably exhibit the desired emotional support strategies over longer conversations. Furthermore, we contribute a comprehensive, multi-branch synthetic conversation dataset for ESConv, featuring a variety of strategy continuations informed by our optimized prompting method. The code and data are publicly available on our Github.


title: Optimizing Skin Lesion Classification via Multimodal Data and Auxiliary Task Integration

abstract: The rising global prevalence of skin conditions, some of which can escalate to life-threatening stages if not timely diagnosed and treated, presents a significant healthcare challenge. This issue is particularly acute in remote areas where limited access to healthcare often results in delayed treatment, allowing skin diseases to advance to more critical stages. One of the primary challenges in diagnosing skin diseases is their low inter-class variations, as many exhibit similar visual characteristics, making accurate classification challenging. This research introduces a novel multimodal method for classifying skin lesions, integrating smartphone-captured images with essential clinical and demographic information. This approach mimics the diagnostic process employed by medical professionals. A distinctive aspect of this method is the integration of an auxiliary task focused on super-resolution image prediction. This component plays a crucial role in refining visual details and enhancing feature extraction, leading to improved differentiation between classes and, consequently, elevating the overall effectiveness of the model. The experimental evaluations have been conducted using the PAD-UFES20 dataset, applying various deep-learning architectures. The results of these experiments not only demonstrate the effectiveness of the proposed method but also its potential applicability under-resourced healthcare environments.


title: Electronic orders on the kagome lattice at the lower Van Hove filling

abstract: We study the electronic orders at the lower van Hove filling in the kagome lattice. In the weak limit of the Hubbard interaction $U$ versus the hopping parameter $t$, we find that the system develops itinerant ferromagnetism; In the intermediate range of $U$, we find the system develops noncollinear magnetic order with orthogonal spin moments on nearest-neighbor bonds. This is in fact a Chern insulator supporting quantized anomalous Hall conductance; In the strong $U$ limit, we map the Hubbard model to the $t$-$J$ model with $J = 4t^2/U$. For moderate values of $J$ we recover the noncollinear magnetic order obtained in the Hubbard model. However, in the limit of $J\to 0$ (or $U\to \infty$) we find the ferromagnetic order revives. The results are obtained by combination of the random-phase approximation and functional renormalization group in the weak to moderate limit of $U$, and the variational quantum Monte Carlo for the $t$-$J$ model in the strong coupling limit. The phase diagram is distinctly different to that at the higher van Hove filling studied earlier, and the difference can be attributed to the lack of particle-hole symmetry in the band structure with respect to the Dirac point.


title: Generative Modeling for Tabular Data via Penalized Optimal Transport Network

abstract: The task of precisely learning the probability distribution of rows within tabular data and producing authentic synthetic samples is both crucial and non-trivial. Wasserstein generative adversarial network (WGAN) marks a notable improvement in generative modeling, addressing the challenges faced by its predecessor, generative adversarial network. However, due to the mixed data types and multimodalities prevalent in tabular data, the delicate equilibrium between the generator and discriminator, as well as the inherent instability of Wasserstein distance in high dimensions, WGAN often fails to produce high-fidelity samples. To this end, we propose POTNet (Penalized Optimal Transport Network), a generative deep neural network based on a novel, robust, and interpretable marginally-penalized Wasserstein (MPW) loss. POTNet can effectively model tabular data containing both categorical and continuous features. Moreover, it offers the flexibility to condition on a subset of features. We provide theoretical justifications for the motivation behind the MPW loss. We also empirically demonstrate the effectiveness of our proposed method on four different benchmarks across a variety of real-world and simulated datasets. Our proposed model achieves orders of magnitude speedup during the sampling stage compared to state-of-the-art generative models for tabular data, thereby enabling efficient large-scale synthetic data generation.


title: Learning-Augmented Skip Lists

abstract: We study the integration of machine learning advice into the design of skip lists to improve upon traditional data structure design. Given access to a possibly erroneous oracle that outputs estimated fractional frequencies for search queries on a set of items, we construct a skip list that provably provides the optimal expected search time, within nearly a factor of two. In fact, our learning-augmented skip list is still optimal up to a constant factor, even if the oracle is only accurate within a constant factor. We show that if the search queries follow the ubiquitous Zipfian distribution, then the expected search time for an item by our skip list is only a constant, independent of the total number $n$ of items, i.e., $\mathcal{O}(1)$, whereas a traditional skip list will have an expected search time of $\mathcal{O}(\log n)$. We also demonstrate robustness by showing that our data structure achieves an expected search time that is within a constant factor of an oblivious skip list construction even when the predictions are arbitrarily incorrect. Finally, we empirically show that our learning-augmented skip list outperforms traditional skip lists on both synthetic and real-world datasets.


title: Charge bond order and s-wave superconductivity in the kagome lattice with electron-phonon coupling and electron-electron interaction

abstract: The effects of optical bond phonons coupled to electrons in two-dimensional lattices have attracted much interest recently, with the hope to explore unconventional superconducting mechanism and pairing symmetries. Here we conduct a systematic investigation of such phonon modes in the kagome lattice at and around the upper van Hove filling, in order to unravel new effects of the bond phonons in the presence of the unique sublattice frustration. We combine the singular-mode functional renormalization group and the projector determinant quantum Monte Carlo methods. At the upper van Hove filling and in the absence of the Hubbard interaction $U$, we find there exists an s-wave superconducting state at weaker electron-phonon coupling constant $\lambda$ and higher phonon frequency $\omega$, and a charge bond order (or the valence bond solid) state at larger $\lambda$ and lower $\omega$. The Hubbard interaction $U$ suppresses drastically the s-wave pairing, so that only the charge bond order survives. On the other hand, upon slight doping away from the van Hove filling, we observe that the charge bond order is suppressed due to the breakdown of the perfect Fermi surface nesting, while the superconductivity persists. The s-wave superconductivity and charge bond order may be relevant in the layered kagome superconductors AV$_3$Sb$_5$ (A=K, Rb, Cs).


title: PPN meets EFT of dark energy: Post-Newtonian approximation in higher-order scalar-tensor theories

abstract: We study the post-Newtonian limit of higher-order scalar-tensor theories that are degenerate in the unitary gauge. They can be conveniently described by the effective field theory (EFT) of dark energy. We determine all the parametrized post-Newtonian (PPN) parameters in terms of the EFT of dark energy parameters. Experimental bounds on the PPN parameters are then translated to constraints on the EFT parameters. We present a Lagrangian of a unitary degenerate higher-order scalar-tensor theory characterized by a single function of the kinetic term of the scalar field whose PPN parameters have the same values as in general relativity.


title: A survey of LSM-Tree based Indexes, Data Systems and KV-stores

abstract: Modern databases typically makes use of the Log Structured Merge-Tree for organizing data in indexes, which is a kind of disk-based data structure. It was proposed to efficiently handle frequent update queries (also called update intensive workloads) databases. In recent years, LSM-Tree has gained popularity and has been adopted by a number of NoSql databases, and key-value stores. Since LSM-Tree was first proposed, researchers and the database community started efforts to improve different components of LSM-Tree. In recent years, Non-volatile Memory, also called Persistent Memory, has also gained significant popularity. This is a class of memory that is non-volatile and byte-addressable at the same time, and hence also termed Storage Class Memory. Apart from that, storage class memory exhibits the combination of the best characteristics of both memory and storage. An overview of the current state of the art in LSM-Tree-based indexes, data systems, and Key-Value stores is provided in this paper.


title: Erosion Study of Tungsten Carbide films under 100 keV Kr+ ion irradiation

abstract: Tungsten carbide (WC) stands out as a crucial material for exploration in extreme environments due to its resistance to radiation and impressive mechanical strength. Widely utilized in cutting tools, high-wear components, and as a potential contender for plasma-facing material in nuclear reactors, WC's erosion behavior under surrogate irradiations is a subject of investigation. In the present work, WC films were synthesized at two different substrate temperatures of 400 K and 600 K using RF sputtering and were then irradiated with 100 keV Kr1+ ions at a fluence of 1x1017 ions/cm2. The crystalline phases of as deposited WC films were confirmed by glancing incidence X-ray diffraction (GIXRD) measurements. Rutherford Backscattering Spectrometry (RBS) was employed to determine the thicknesses of pristine samples and the sputtering rate by measuring the difference in the areal densities of the pristine and irradiated films. The erosion rate of both types of films was found to be ~ 1.6 atoms per incident Kr+ ion. These findings contribute to a foundational comprehension of the radiation tolerance behavior of WC thin films, crucial for their performance in the demanding conditions of extreme radiation.


title: QDyLoRA: Quantized Dynamic Low-Rank Adaptation for Efficient Large Language Model Tuning

abstract: Finetuning large language models requires huge GPU memory, restricting the choice to acquire Larger models. While the quantized version of the Low-Rank Adaptation technique, named QLoRA, significantly alleviates this issue, finding the efficient LoRA rank is still challenging. Moreover, QLoRA is trained on a pre-defined rank and, therefore, cannot be reconfigured for its lower ranks without requiring further fine-tuning steps. This paper proposes QDyLoRA -Quantized Dynamic Low-Rank Adaptation-, as an efficient quantization approach for dynamic low-rank adaptation. Motivated by Dynamic LoRA, QDyLoRA is able to efficiently finetune LLMs on a set of pre-defined LoRA ranks. QDyLoRA enables fine-tuning Falcon-40b for ranks 1 to 64 on a single 32 GB V100-GPU through one round of fine-tuning. Experimental results show that QDyLoRA is competitive to QLoRA and outperforms when employing its optimal rank.


title: Scattering for the magnetic Zakharov system in 3 dimensions

abstract: We consider the global existence and scattering for solutions of magnetic Zakharov system in three-dimensional space. When the initial data is small, we prove the existence of smooth global solutions and scattering results, by combining the space--time resonance method, weighted Sobolev space and dispersive estimates. Moreover, the decay rates for the solutions are also obtained.


title: FedKit: Enabling Cross-Platform Federated Learning for Android and iOS

abstract: We present FedKit, a federated learning (FL) system tailored for cross-platform FL research on Android and iOS devices. FedKit pipelines cross-platform FL development by enabling model conversion, hardware-accelerated training, and cross-platform model aggregation. Our FL workflow supports flexible machine learning operations (MLOps) in production, facilitating continuous model delivery and training. We have deployed FedKit in a real-world use case for health data analysis on university campuses, demonstrating its effectiveness. FedKit is open-source at https://github.com/FedCampus/FedKit.


title: Subfield codes of $C_D$-codes over $\mathbb{F}_2[x]/\langle x^3-x \rangle$ are really nice!

abstract: A non-zero $\mathbb{F}$-linear map from a finite-dimensional commutative $\mathbb{F}$-algebra to $\mathbb{F}$ is called an $\mathbb{F}$-valued trace if its kernel does not contain any non-zero ideals. In this article, we utilize an $\mathbb{F}_2$-valued trace of the $\mathbb{F}_2$-algebra $\mathcal{R}_2:=\mathbb{F}_2[x]/\langle x^3-x\rangle$ to study binary subfield code $\mathcal{C}_D^{(2)}$ of $\mathcal{C}_D:=\{\left(x\cdot d\right)_{d\in D}: x\in \mathcal{R}_2^m\}$ for each defining set $D$ derived from a certain simplicial complex. For $m\in \mathbb{N}$ and $X\subseteq \{1, 2, \dots, m\}$, define $\Delta_X:=\{v\in \mathbb{F}_2^m: \Supp(v)\subseteq X\}$ and $D:=(1+u^2)D_1+u^2D_2+(u+u^2)D_3,$ a subset of $\mathcal{R}_2^m,$ where $u=x+\langle x^3-x\rangle, D_1\in \{\Delta_L, \Delta_L^c\},\, D_2\in \{\Delta_M, \Delta_M^c\}$ and $ D_3\in \{\Delta_N, \Delta_N^c\}$, for $L, M, N\subseteq \{1, 2, \dots, m\}.$ The parameters and the Hamming weight distribution of the binary subfield code $\mathcal{C}_D^{(2)}$ of $\mathcal{C}_D$ are determined for each $D.$ These binary subfield codes are minimal under certain mild conditions on the cardinalities of $L, M$ and $N$. Moreover, most of these codes are distance-optimal. Consequently, we obtain a few infinite families of minimal, self-orthogonal and distance-optimal binary linear codes that are either $2$-weight or $4$-weight. It is worth mentioning that we have obtained several new distance-optimal binary linear codes.


title: Large Language Models as Zero-shot Dialogue State Tracker through Function Calling

abstract: Large language models (LLMs) are increasingly prevalent in conversational systems due to their advanced understanding and generative capabilities in general contexts. However, their effectiveness in task-oriented dialogues (TOD), which requires not only response generation but also effective dialogue state tracking (DST) within specific tasks and domains, remains less satisfying. In this work, we propose a novel approach FnCTOD for solving DST with LLMs through function calling. This method improves zero-shot DST, allowing adaptation to diverse domains without extensive data collection or model tuning. Our experimental results demonstrate that our approach achieves exceptional performance with both modestly sized open-source and also proprietary LLMs: with in-context prompting it enables various 7B or 13B parameter models to surpass the previous state-of-the-art (SOTA) achieved by ChatGPT, and improves ChatGPT's performance beating the SOTA by 5.6% average joint goal accuracy (JGA). Individual model results for GPT-3.5 and GPT-4 are boosted by 4.8% and 14%, respectively. We also show that by fine-tuning on a small collection of diverse task-oriented dialogues, we can equip modestly sized models, specifically a 13B parameter LLaMA2-Chat model, with function-calling capabilities and DST performance comparable to ChatGPT while maintaining their chat capabilities. We have made the code publicly available at https://github.com/facebookresearch/FnCTOD


title: Character covering number of $\mathrm{PSL}_2 (q)$

abstract: For a group $G$ and a character $\chi$ of $G$, let $c(\chi)$ denote the set of all irreducible characters of $G$, occurring in $\chi$. We prove that whenever $q\geq 8$, all non-trivial irreducible character $\chi$ of $\mathrm{PSL}_2(q)$ satisfies $c(\chi^4)=\mathrm{Irr}\left(\mathrm{PSL}_2(q)\right)$ if $q=2^{2m+1}$ and $c(\chi^3)=\mathrm{Irr}\left(\mathrm{PSL}_2(q)\right)$ otherwise.


title: Adversarial Curriculum Graph Contrastive Learning with Pair-wise Augmentation

abstract: Graph contrastive learning (GCL) has emerged as a pivotal technique in the domain of graph representation learning. A crucial aspect of effective GCL is the caliber of generated positive and negative samples, which is intrinsically dictated by their resemblance to the original data. Nevertheless, precise control over similarity during sample generation presents a formidable challenge, often impeding the effective discovery of representative graph patterns. To address this challenge, we propose an innovative framework: Adversarial Curriculum Graph Contrastive Learning (ACGCL), which capitalizes on the merits of pair-wise augmentation to engender graph-level positive and negative samples with controllable similarity, alongside subgraph contrastive learning to discern effective graph patterns therein. Within the ACGCL framework, we have devised a novel adversarial curriculum training methodology that facilitates progressive learning by sequentially increasing the difficulty of distinguishing the generated samples. Notably, this approach transcends the prevalent sparsity issue inherent in conventional curriculum learning strategies by adaptively concentrating on more challenging training data. Finally, a comprehensive assessment of ACGCL is conducted through extensive experiments on six well-known benchmark datasets, wherein ACGCL conspicuously surpasses a set of state-of-the-art baselines.


title: Pressure-stabilized fixed-stress iterative solutions of compositional poromechanics

abstract: We consider the numerical behavior of the fixed-stress splitting method for coupled poromechanics as undrained regimes are approached. We explain that pressure stability is related to the splitting error of the scheme, not the fact that the discrete saddle point matrix never appears in the fixed-stress approach. This observation reconciles previous results regarding the pressure stability of the splitting method. Using examples of compositional poromechanics with application to geological CO$_2$ sequestration, we see that solutions obtained using the fixed-stress scheme with a low order finite element-finite volume discretization which is not inherently inf-sup stable can exhibit the same pressure oscillations obtained with the corresponding fully implicit scheme. Moreover, pressure jump stabilization can effectively remove these spurious oscillations in the fixed-stress setting, while also improving the efficiency of the scheme in terms of the number of iterations required at every time step to reach convergence.


title: Theoretical Understanding of Learning from Adversarial Perturbations

abstract: It is not fully understood why adversarial examples can deceive neural networks and transfer between different networks. To elucidate this, several studies have hypothesized that adversarial perturbations, while appearing as noises, contain class features. This is supported by empirical evidence showing that networks trained on mislabeled adversarial examples can still generalize well to correctly labeled test samples. However, a theoretical understanding of how perturbations include class features and contribute to generalization is limited. In this study, we provide a theoretical framework for understanding learning from perturbations using a one-hidden-layer network trained on mutually orthogonal samples. Our results highlight that various adversarial perturbations, even perturbations of a few pixels, contain sufficient class features for generalization. Moreover, we reveal that the decision boundary when learning from perturbations matches that from standard samples except for specific regions under mild conditions. The code is available at https://github.com/s-kumano/learning-from-adversarial-perturbations.


title: The Standard Model quark/lepton masses and the Cabibbo-Kobayashi-Maskawa mixing in an ${\rm SU}(8)$ theory

abstract: The origins of Standard Model (SM) quark/lepton masses and the Cabibbo-Kobayashi-Maskawa (CKM) mixing pattern are described in an ${\rm SU}(8)$ theory, where three-generational SM fermions transform differently. A realistic symmetry breaking pattern with three intermediate scales is described, along which all vectorlike electrically charged fermions become massive. A set of $d=5$ operators that explicitly break the emergent global symmetries are analyzed to generate the observed three-generational SM quark/lepton mass hierarchies as well as the CKM mixing pattern. All SM flavors are identified in the spectrum.


title: Local antimagic orientation of graphs with positive real numbers as the labels

abstract: An undirected graph $G$ is said to admits a local antimagic orientation if there exists an orientation $D$ and a bijection between $E(G)$ and $\{1,2,\ldots,|E(G)|\}$ such that any two adjacent vertices have distinct vertex sums, where the vertex sum of a vertex is the sum of the labels of the in-edges minus that of the out-edges incident to the vertex. Chang, Jing, and Wang \cite{CJW20} conjectured that every connected graph admits a local antimagic orientation. In this paper, we give an affirmative answer to this conjecture.


title: Privacy for Fairness: Information Obfuscation for Fair Representation Learning with Local Differential Privacy

abstract: As machine learning (ML) becomes more prevalent in human-centric applications, there is a growing emphasis on algorithmic fairness and privacy protection. While previous research has explored these areas as separate objectives, there is a growing recognition of the complex relationship between privacy and fairness. However, previous works have primarily focused on examining the interplay between privacy and fairness through empirical investigations, with limited attention given to theoretical exploration. This study aims to bridge this gap by introducing a theoretical framework that enables a comprehensive examination of their interrelation. We shall develop and analyze an information bottleneck (IB) based information obfuscation method with local differential privacy (LDP) for fair representation learning. In contrast to many empirical studies on fairness in ML, we show that the incorporation of LDP randomizers during the encoding process can enhance the fairness of the learned representation. Our analysis will demonstrate that the disclosure of sensitive information is constrained by the privacy budget of the LDP randomizer, thereby enabling the optimization process within the IB framework to effectively suppress sensitive information while preserving the desired utility through obfuscation. Based on the proposed method, we further develop a variational representation encoding approach that simultaneously achieves fairness and LDP. Our variational encoding approach offers practical advantages. It is trained using a non-adversarial method and does not require the introduction of any variational prior. Extensive experiments will be presented to validate our theoretical results and demonstrate the ability of our proposed approach to achieve both LDP and fairness while preserving adequate utility.


title: One-Bit Quantization and Sparsification for Multiclass Linear Classification via Regularized Regression

abstract: We study the use of linear regression for multiclass classification in the over-parametrized regime where some of the training data is mislabeled. In such scenarios it is necessary to add an explicit regularization term, $\lambda f(w)$, for some convex function $f(\cdot)$, to avoid overfitting the mislabeled data. In our analysis, we assume that the data is sampled from a Gaussian Mixture Model with equal class sizes, and that a proportion $c$ of the training labels is corrupted for each class. Under these assumptions, we prove that the best classification performance is achieved when $f(\cdot) = \|\cdot\|^2_2$ and $\lambda \to \infty$. We then proceed to analyze the classification errors for $f(\cdot) = \|\cdot\|_1$ and $f(\cdot) = \|\cdot\|_\infty$ in the large $\lambda$ regime and notice that it is often possible to find sparse and one-bit solutions, respectively, that perform almost as well as the one corresponding to $f(\cdot) = \|\cdot\|_2^2$.


title: Fundamental Benefit of Alternating Updates in Minimax Optimization

abstract: The Gradient Descent-Ascent (GDA) algorithm, designed to solve minimax optimization problems, takes the descent and ascent steps either simultaneously (Sim-GDA) or alternately (Alt-GDA). While Alt-GDA is commonly observed to converge faster, the performance gap between the two is not yet well understood theoretically, especially in terms of global convergence rates. To address this theory-practice gap, we present fine-grained convergence analyses of both algorithms for strongly-convex-strongly-concave and Lipschitz-gradient objectives. Our new iteration complexity upper bound of Alt-GDA is strictly smaller than the lower bound of Sim-GDA; i.e., Alt-GDA is provably faster. Moreover, we propose Alternating-Extrapolation GDA (Alex-GDA), a general algorithmic framework that subsumes Sim-GDA and Alt-GDA, for which the main idea is to alternately take gradients from extrapolations of the iterates. We show that Alex-GDA satisfies a smaller iteration complexity bound, identical to that of the Extra-gradient method, while requiring less gradient computations. We also prove that Alex-GDA enjoys linear convergence for bilinear problems, for which both Sim-GDA and Alt-GDA fail to converge at all.


title: Spike-EVPR: Deep Spiking Residual Network with Cross-Representation Aggregation for Event-Based Visual Place Recognition

abstract: Event cameras have been successfully applied to visual place recognition (VPR) tasks by using deep artificial neural networks (ANNs) in recent years. However, previously proposed deep ANN architectures are often unable to harness the abundant temporal information presented in event streams. In contrast, deep spiking networks exhibit more intricate spatiotemporal dynamics and are inherently well-suited to process sparse asynchronous event streams. Unfortunately, directly inputting temporal-dense event volumes into the spiking network introduces excessive time steps, resulting in prohibitively high training costs for large-scale VPR tasks. To address the aforementioned issues, we propose a novel deep spiking network architecture called Spike-EVPR for event-based VPR tasks. First, we introduce two novel event representations tailored for SNN to fully exploit the spatio-temporal information from the event streams, and reduce the video memory occupation during training as much as possible. Then, to exploit the full potential of these two representations, we construct a Bifurcated Spike Residual Encoder (BSR-Encoder) with powerful representational capabilities to better extract the high-level features from the two event representations. Next, we introduce a Shared & Specific Descriptor Extractor (SSD-Extractor). This module is designed to extract features shared between the two representations and features specific to each. Finally, we propose a Cross-Descriptor Aggregation Module (CDA-Module) that fuses the above three features to generate a refined, robust global descriptor of the scene. Our experimental results indicate the superior performance of our Spike-EVPR compared to several existing EVPR pipelines on Brisbane-Event-VPR and DDD20 datasets, with the average Recall@1 increased by 7.61% on Brisbane and 13.20% on DDD20.


title: Understanding Likelihood of Normalizing Flow and Image Complexity through the Lens of Out-of-Distribution Detection

abstract: Out-of-distribution (OOD) detection is crucial to safety-critical machine learning applications and has been extensively studied. While recent studies have predominantly focused on classifier-based methods, research on deep generative model (DGM)-based methods have lagged relatively. This disparity may be attributed to a perplexing phenomenon: DGMs often assign higher likelihoods to unknown OOD inputs than to their known training data. This paper focuses on explaining the underlying mechanism of this phenomenon. We propose a hypothesis that less complex images concentrate in high-density regions in the latent space, resulting in a higher likelihood assignment in the Normalizing Flow (NF). We experimentally demonstrate its validity for five NF architectures, concluding that their likelihood is untrustworthy. Additionally, we show that this problem can be alleviated by treating image complexity as an independent variable. Finally, we provide evidence of the potential applicability of our hypothesis in another DGM, PixelCNN++.


title: CodaMal: Contrastive Domain Adaptation for Malaria Detection in Low-Cost Microscopes

abstract: Malaria is a major health issue worldwide, and its diagnosis requires scalable solutions that can work effectively with low-cost microscopes (LCM). Deep learning-based methods have shown success in computer-aided diagnosis from microscopic images. However, these methods need annotated images that show cells affected by malaria parasites and their life stages. Annotating images from LCM significantly increases the burden on medical experts compared to annotating images from high-cost microscopes (HCM). For this reason, a practical solution would be trained on HCM images which should generalize well on LCM images during testing. While earlier methods adopted a multi-stage learning process, they did not offer an end-to-end approach. In this work, we present an end-to-end learning framework, named CodaMal (Contrastive Domain Adpation for Malaria). In order to bridge the gap between HCM (training) and LCM (testing), we propose a domain adaptive contrastive loss. It reduces the domain shift by promoting similarity between the representations of HCM and its corresponding LCM image, without imposing an additional annotation burden. In addition, the training objective includes object detection objectives with carefully designed augmentations, ensuring the accurate detection of malaria parasites. On the publicly available large-scale M5-dataset, our proposed method shows a significant improvement of 16% over the state-of-the-art methods in terms of the mean average precision metric (mAP), provides 21x speed up during inference, and requires only half learnable parameters than the prior methods. Our code is publicly available.


title: On the entropy corrected thermal features of black holes

abstract: In this work, we investigate the thermal properties of black holes using a new class of generalized entropy functions [K. Ourabah, Class. Quantum Grav., 41, 015010 (2024)]. At the fundamental level, these entropic forms are associated with alternative gravitational laws, within an entropic gravity framework. Our investigation revolves around three distinct entropy functions associated with the Yukawa Potential Correction, Non-local Gravity Correction, and Gradient Field Gravity Correction. Through comparative analysis, we study how such entropic constructs impact the thermodynamic behavior of black holes. For each case, we derive the stability thermodynamic conditions associated with the respective entropic constructs.


title: Leveraging junk information to enhance the quantum error mitigation

abstract: Noise in quantum information processing poses a significant obstacle to achieving precise results. Quantum error mitigation techniques are crucial for improving the accuracy of experimental expectation values in this process. In the experiments, it is commonly observed that some measured events violate certain principles, such as symmetry constraints. These events can be considered junk information and should be discarded in a post-selection process. In this work, we introduce a quantum error mitigation method named Self-Trained Quantum Noise Filter (SQNF), which leverages the junk information to differentiate errors from the experimental population distributions, thereby aiming to approximate the error-free distribution. Our numerical results demonstrate that the proposed method can significantly reduce the infidelity of population distributions compared to the traditional post-selection method. Notably, the infidelity reduction is achieved without additional experimental resource consumption. Our method is scalable and applicable to multi-qubit computing systems.


title: Emoji Driven Crypto Assets Market Reactions

abstract: In the burgeoning realm of cryptocurrency, social media platforms like Twitter have become pivotal in influencing market trends and investor sentiments. In our study, we leverage GPT-4 and a fine-tuned transformer-based BERT model for a multimodal sentiment analysis, focusing on the impact of emoji sentiment on cryptocurrency markets. By translating emojis into quantifiable sentiment data, we correlate these insights with key market indicators like BTC Price and the VCRIX index. Our architecture's analysis of emoji sentiment demonstrated a distinct advantage over FinBERT's pure text sentiment analysis in such predicting power. This approach may be fed into the development of trading strategies aimed at utilizing social media elements to identify and forecast market trends. Crucially, our findings suggest that strategies based on emoji sentiment can facilitate the avoidance of significant market downturns and contribute to the stabilization of returns. This research underscores the practical benefits of integrating advanced AI-driven analyses into financial strategies, offering a nuanced perspective on the interplay between digital communication and market dynamics in an academic context.


title: Understanding Self-Distillation and Partial Label Learning in Multi-Class Classification with Label Noise

abstract: Self-distillation (SD) is the process of training a student model using the outputs of a teacher model, with both models sharing the same architecture. Our study theoretically examines SD in multi-class classification with cross-entropy loss, exploring both multi-round SD and SD with refined teacher outputs, inspired by partial label learning (PLL). By deriving a closed-form solution for the student model's outputs, we discover that SD essentially functions as label averaging among instances with high feature correlations. Initially beneficial, this averaging helps the model focus on feature clusters correlated with a given instance for predicting the label. However, it leads to diminishing performance with increasing distillation rounds. Additionally, we demonstrate SD's effectiveness in label noise scenarios and identify the label corruption condition and minimum number of distillation rounds needed to achieve 100% classification accuracy. Our study also reveals that one-step distillation with refined teacher outputs surpasses the efficacy of multi-step SD using the teacher's direct output in high noise rate regimes.


title: GaussianHair: Hair Modeling and Rendering with Light-aware Gaussians

abstract: Hairstyle reflects culture and ethnicity at first glance. In the digital era, various realistic human hairstyles are also critical to high-fidelity digital human assets for beauty and inclusivity. Yet, realistic hair modeling and real-time rendering for animation is a formidable challenge due to its sheer number of strands, complicated structures of geometry, and sophisticated interaction with light. This paper presents GaussianHair, a novel explicit hair representation. It enables comprehensive modeling of hair geometry and appearance from images, fostering innovative illumination effects and dynamic animation capabilities. At the heart of GaussianHair is the novel concept of representing each hair strand as a sequence of connected cylindrical 3D Gaussian primitives. This approach not only retains the hair's geometric structure and appearance but also allows for efficient rasterization onto a 2D image plane, facilitating differentiable volumetric rendering. We further enhance this model with the "GaussianHair Scattering Model", adept at recreating the slender structure of hair strands and accurately capturing their local diffuse color in uniform lighting. Through extensive experiments, we substantiate that GaussianHair achieves breakthroughs in both geometric and appearance fidelity, transcending the limitations encountered in state-of-the-art methods for hair reconstruction. Beyond representation, GaussianHair extends to support editing, relighting, and dynamic rendering of hair, offering seamless integration with conventional CG pipeline workflows. Complementing these advancements, we have compiled an extensive dataset of real human hair, each with meticulously detailed strand geometry, to propel further research in this field.


title: The common basis complex and the partial decomposition poset

abstract: For a finite-dimensional vector space $V$, the common basis complex of $V$ is the simplicial complex whose vertices are the proper non-zero subspaces of $V$, and $\sigma$ is a simplex if and only if there exists a basis $B$ of $V$ that contains a basis of $S$ for all $S\in \sigma$. This complex was introduced by Rognes in 1992 in connection with stable buildings. In this article, we prove that the common basis complex is homotopy equivalent to the proper part of the poset of partial direct sum decompositions of $V$. Moreover, we establish this result in a more general combinatorial context, including the case of free groups, matroids, vector spaces with non-degenerate sesquilinear forms, and free modules over commutative Hermite rings, such as local rings or Dedekind domains.


title: Pressure-Induced Split of the Density Wave Transitions in La$_3$Ni$_2$O$_{7-\delta}$

abstract: The unveiling of superconductivity in La$_3$Ni$_2$O$_{7-\delta}$ under pressure, following the suppression of a high-temperature density wave (DW) state, has attracted considerable attention. Notably, the nature of this competing DW order remains elusive, presenting a crucial question that demands further investigation. Here, we employ the muon-spin rotation/relaxation ($\mu$SR) technique combined with dipole-field numerical analysis to probe the magnetic response of La$_3$Ni$_2$O$_{7-\delta}$ as a function of hydrostatic pressure. At ambient pressure, $\mu$SR experiments reveal commensurate static magnetic order below $T_{\rm N} \simeq 151$K. The comparison of the observed internal magnetic fields with dipole-field calculations reveals the magnetic structure's compatibility with a stripe-type arrangement of Ni moments ($\simeq0.3-0.7$$\mu_{\rm B}$), characterized by alternating lines of magnetic moments and non-magnetic stripes. Experiments under pressure (up to $p\simeq2.3$~GPa) demonstrate an increase of the magnetic ordering temperature at a rate ${\rm d}T_{\rm N}/{\rm d}p\simeq 2.8$ K/GPa. This trend is opposite in sign and significantly smaller in magnitude compared to the changes observed in the DW order of unknown origin reported by Wang et al. [arXiv:2309.17378]. Our findings reveal that the ground state of the La$_3$Ni$_2$O$_{7-\delta}$ system is characterized by the coexistence of two distinct orders -- the spin density wave and, most likely, charge density wave -- with a notable pressure-induced separation between them.


title: The tidal deformation and atmosphere of WASP-12b from its phase curve

abstract: Ultra-hot Jupiters present a unique opportunity to understand the physics and chemistry of planets at extreme conditions. WASP-12b stands out as an archetype of this class of exoplanets. We performed comprehensive analyses of the transits, occultations, and phase curves of WASP-12b by combining new CHEOPS observations with previous TESS and Spitzer data to measure the planet's tidal deformation, atmospheric properties, and orbital decay rate. The planet was modeled as a triaxial ellipsoid parameterized by the second-order fluid Love number, $h_2$, which quantifies its radial deformation and provides insight into the interior structure. We measured the tidal deformation of WASP-12b and estimated a Love number of $h_2=1.55_{-0.49}^{+0.45}$ (at 3.2$\sigma$) from its phase curve. We measured occultation depths of $333\pm24$ppm and $493\pm29$ppm in the CHEOPS and TESS bands, respectively, while the dayside emission spectrum indicates that CHEOPS and TESS probe similar pressure levels in the atmosphere at a temperature of 2900K. We also estimated low geometric albedos of $0.086\pm0.017$ and $0.01\pm0.023$ in the CHEOPS and TESS passbands, respectively, suggesting the absence of reflective clouds in the dayside of the WASP-12b. The CHEOPS occultations do not show strong evidence for variability in the dayside atmosphere of the planet. Finally, we refine the orbital decay rate by 12% to a value of -30.23$\pm$0.82 ms/yr. WASP-12b becomes the second exoplanet, after WASP-103b, for which the Love number has been measured (at 3$sigma$) from the effect of tidal deformation in the light curve. However, constraining the core mass fraction of the planet requires measuring $h_2$ with a higher precision. This can be achieved with high signal-to-noise observations with JWST since the phase curve amplitude, and consequently the induced tidal deformation effect, is higher in the infrared.


title: RPMixer: Shaking Up Time Series Forecasting with Random Projections for Large Spatial-Temporal Data

abstract: Spatial-temporal forecasting systems play a crucial role in addressing numerous real-world challenges. In this paper, we investigate the potential of addressing spatial-temporal forecasting problems using general time series forecasting models, i.e., models that do not leverage the spatial relationships among the nodes. We propose a all-Multi-Layer Perceptron (all-MLP) time series forecasting architecture called RPMixer. The all-MLP architecture was chosen due to its recent success in time series forecasting benchmarks. Furthermore, our method capitalizes on the ensemble-like behavior of deep neural networks, where each individual block within the network behaves like a base learner in an ensemble model, particularly when identity mapping residual connections are incorporated. By integrating random projection layers into our model, we increase the diversity among the blocks' outputs, thereby improving the overall performance of the network. Extensive experiments conducted on the largest spatial-temporal forecasting benchmark datasets demonstrate that the proposed method outperforms alternative methods, including both spatial-temporal graph models and general forecasting models.


title: Reduced Order Model Enhanced Source Iteration with Synthetic Acceleration for Parametric Radiative Transfer Equation

abstract: Applications such as uncertainty quantification and optical tomography, require solving the radiative transfer equation (RTE) many times for various parameters. Efficient solvers for RTE are highly desired. Source Iteration with Synthetic Acceleration (SISA) is a popular and successful iterative solver for RTE. Synthetic Acceleration (SA) acts as a preconditioning step to accelerate the convergence of Source Iteration (SI). After each source iteration, classical SA strategies introduce a correction to the macroscopic particle density by solving a low order approximation to a kinetic correction equation. For example, Diffusion Synthetic Acceleration (DSA) uses the diffusion limit. However, these strategies may become less effective when the underlying low order approximations are not accurate enough. Furthermore, they do not exploit low rank structures concerning the parameters of parametric problems. To address these issues, we propose enhancing SISA with data-driven ROMs for the parametric problem and the corresponding kinetic correction equation. First, the ROM for the parametric problem can be utilized to obtain an improved initial guess. Second, the ROM for the kinetic correction equation can be utilized to design a novel SA strategy called ROMSAD. In the early stage, ROMSAD adopts a ROM based approximation, which builds on the kinetic description of the correction equation and leverages low rank structures concerning the parameters. This ROM-based approximation has greater efficiency than DSA in the early stage of SI. In the later stage, ROMSAD automatically switches to DSA to leverage its robustness. Additionally, we propose an approach to construct the ROM for the kinetic correction equation without directly solving it. In a series of of numerical tests, we compare the performance of the proposed methods with SI-DSA and DSA preconditioned GMRES solver.


title: A simple pole-shifting gain matrix $K$ which avoids solving Lyapunov equations

abstract: It is well known that if $A\in\mathbb{C}^{N\times N}$ and $B\in\mathbb{C}^{N\times M}$ form a controllable pair (in the sense that the Kalman matrix $[B\ |\ AB\ | \ \dots\ |\ A^{N-1}B]$ has full rank) then, there exists $K\in\mathbb{C}^{M\times N}$ such that the matrix $A+BK$ has only eigenvalues with negative real parts. The matrix $K$ is not unique, and is usually defined by a solution of a Lyapunov equation, which, in case of large $N$, is not easily manageable from the computational point of view. In this work, we show that, for general matrices $A$ and $B$, if they satisfy the controllability Kalman rank condition, then $$K=-\overline{B}^\top\sum_{k=1}^N\left[(\overline{A}^\top+\gamma_kI)^{-1}\right]\left\{\sum_{k=1}^N\left[(A+\gamma_kI)^{-1}B\overline{B}^\top(\overline{A}^\top+\gamma_kI)^{-1}\right]\right\}^{-1}$$ ensures that the matrix $A+BK$ has all the eigenvalues with the real part less than $-\gamma_1$. Here, $0<\gamma_1<\gamma_2<\dots<\gamma_N$ are $N$ positive numbers, large enough such that $A+\gamma_kI$ is invertible, for each $k$.


title: Electronic structure-property relationship in an Al0.5TiZrPdCuNi high-entropy alloy

abstract: The valence band (VB) structure of an Al0.5TiZrPdCuNi high-entropy alloy (HEA) obtained from X-ray photoelectron spectroscopy has been compared to that recently calculated by Odbadrakh et al, 2019. Both experimental and theoretical VBs show split-band structures typical of alloys composed from the early (TE) and late (TL) transition metals. Accordingly, several properties of this alloy (both in the glassy and crystalline state) associated with the electronic structure (ES), are compared with those of similar TE-TL alloys. The comparison shows in addition to the usual dependence on the total TL content strong effect of alloying with Al on the density of states at the Fermi level, N(EF) and on the magnetic susceptibility of Al0.5TiZrPdCuNi HEA, which is like that of conventional glassy alloys, such as Zr-Cu-Al ones. Despite some similarity between the shapes of theoretical and corresponding experimental VBs there are significant quantitative differences between them which should be taken into account in any future studies of ES in HEAs and other compositionally complex alloys (CCA).


title: Make a Cheap Scaling: A Self-Cascade Diffusion Model for Higher-Resolution Adaptation

abstract: Diffusion models have proven to be highly effective in image and video generation; however, they still face composition challenges when generating images of varying sizes due to single-scale training data. Adapting large pre-trained diffusion models for higher resolution demands substantial computational and optimization resources, yet achieving a generation capability comparable to low-resolution models remains elusive. This paper proposes a novel self-cascade diffusion model that leverages the rich knowledge gained from a well-trained low-resolution model for rapid adaptation to higher-resolution image and video generation, employing either tuning-free or cheap upsampler tuning paradigms. Integrating a sequence of multi-scale upsampler modules, the self-cascade diffusion model can efficiently adapt to a higher resolution, preserving the original composition and generation capabilities. We further propose a pivot-guided noise re-schedule strategy to speed up the inference process and improve local structural details. Compared to full fine-tuning, our approach achieves a 5X training speed-up and requires only an additional 0.002M tuning parameters. Extensive experiments demonstrate that our approach can quickly adapt to higher resolution image and video synthesis by fine-tuning for just 10k steps, with virtually no additional inference time.


title: Developing an Optimal Model for Predicting the Severity of Wheat Stem Rust (Case study of Arsi and Bale Zone)

abstract: This research utilized three types of artificial neural network (ANN) methodologies, namely Backpropagation Neural Network (BPNN) with varied training, transfer, divide, and learning functions; Radial Basis Function Neural Network (RBFNN); and General Regression Neural Network (GRNN), to forecast the severity of stem rust. It considered parameters such as mean maximum temperature, mean minimum temperature, mean rainfall, mean average temperature, mean relative humidity, and different wheat varieties. The statistical analysis revealed that GRNN demonstrated effective predictive capability and required less training time compared to the other models. Additionally, the results indicated that total seasonal rainfall positively influenced the development of wheat stem rust. Keywords: Wheat stem rust, Back propagation neural network, Radial Basis Function Neural Network, General Regression Neural Network.


title: Online Signed Sampling of Bandlimited Graph Signals

abstract: The theory of sampling and recovery of bandlimited graph signals has been extensively studied. However, in many cases, the observation of a signal is quite coarse. For example, users only provide simple comments such as "like" or "dislike" for a product on an e-commerce platform. This is a particular scenario where only the sign information of a graph signal can be measured. In this paper, we are interested in how to sample based on sign information in an online manner, by which the direction of the original graph signal can be estimated. The online signed sampling problem of a graph signal can be formulated as a Markov decision process in a finite horizon. Unfortunately, it is intractable for large size graphs. We propose a low-complexity greedy signed sampling algorithm (GSS) as well as a stopping criterion. Meanwhile, we prove that the objective function is adaptive monotonic and adaptive submodular, so that the performance is close enough to the global optimum with a lower bound. Finally, we demonstrate the effectiveness of the GSS algorithm by both synthesis and realworld data.


title: Mechanised uniform interpolation for modal logics K, GL, and iSL

abstract: The uniform interpolation property in a given logic can be understood as the definability of propositional quantifiers. We mechanise the computation of these quantifiers and prove correctness in the Coq proof assistant for three modal logics, namely: (1) the modal logic K, for which a pen-and-paper proof exists; (2) G\"odel-L\"ob logic GL, for which our formalisation clarifies an important point in an existing, but incomplete, sequent-style proof; and (3) intuitionistic strong L\"ob logic iSL, for which this is the first proof-theoretic construction of uniform interpolants. Our work also yields verified programs that allow one to compute the propositional quantifiers on any formula in this logic.


title: Moving and fusion of Majorana zero modes in the presence of nonadiabatic transitions

abstract: We perform simulations for moving and non-Abelian fusion of Majorana zero modes in topological superconducting quantum wires. We display interesting behaviors of nonadiabatic transition associated with the moving through mini-gate-controlled multiple-segments modulations. Owing to breaking of the initial fermion parity induced by nonadiabatic transitions, deviation from the standard fusion rule is analyzed. Moreover, we develop a measurement scheme to infer the amount of fermion parity breaking and nonadiabatic transition probability to excited states, based on the characteristic spectrum of measurement current by a uantum-point-contact detector, in measuring the charge occupation dynamics in a fusion-outcome-probing quantum dot.


title: Comparing Hallucination Detection Metrics for Multilingual Generation

abstract: While many hallucination detection techniques have been evaluated on English text, their effectiveness in multilingual contexts remains unknown. This paper assesses how well various factual hallucination detection metrics (lexical metrics like ROUGE and Named Entity Overlap, and Natural Language Inference (NLI)-based metrics) identify hallucinations in generated biographical summaries across languages. We compare how well automatic metrics correlate to each other and whether they agree with human judgments of factuality. Our analysis reveals that while the lexical metrics are ineffective, NLI-based metrics perform well, correlating with human annotations in many settings and often outperforming supervised models. However, NLI metrics are still limited, as they do not detect single-fact hallucinations well and fail for lower-resource languages. Therefore, our findings highlight the gaps in exisiting hallucination detection methods for non-English languages and motivate future research to develop more robust multilingual detection methods for LLM hallucinations.


title: Cosmic ray acceleration and non-thermal emission from fast luminous optical transient sources

abstract: Fast blue optical transients (FBOTs) represent a new class of highly energetic sources observed from radio to X-rays. High luminosity, light curves and spectra of the sources can be understood if they are associated with supernova-like or tidal disruption events. Radio observations of the transient sources revealed a mildly relativistic expansion of some of the remnants. The high power and mildly relativistic shock velocities are providing favorable conditions for very high energy particle acceleration. In this paper we present a model of particle acceleration in mildly relativistic magnetohydrodynamic (MHD) outflow of the transient source. To construct the non-thermal radiation and cosmic ray spectra in a broad range of energies we combined the microscopic particle-in-cell (PIC) simulations of electron and proton injection at mildly relativistic shock with Monte Carlo technique for high energy particle transport and acceleration. The kinetic PIC simulations provided the energy partition parameter $\epsilon_{e}$ used to fit the observed non-thermal radio emission using the magnetic field amplification mechanisms modelled with Monte Carlo simulations. The model allowed to describe the radio-spectrum of CSS161010 and it's X-ray luminosity. The high X-ray luminosity of AT2018 and AT2020mrf detected during the first weeks can be connected to the jet interaction with the stellar companion in a binary system. The model predicts that FBOTs can accelerate cosmic rays to energies above 10 PeV with a possible upper limit of maximum energy of 100 PeV. With the expected event rate of FBOTs they can contribute to the very high energy cosmic rays population in galaxies.


title: A higher genus circle method and an application to geometric Manin's conjecture

abstract: Browning and Vishe used the Hardy-Littlewood circle method to show the moduli space of rational curves on smooth hypersurfaces of low degree is irreducible and of the expected dimension. We reinterpret the circle method geometrically and prove a generalization for higher genus smooth projective curves. In particular, we explain how the geometry of numbers can be understood via the Beauville-Laszlo theorem in terms of vector bundles on curves and their slopes, allowing us to prove a higher genus variant of Davenport's shrinking lemma. As a corollary, we apply this result to show the Fujita invariant of any proper subvariety of a smooth hypersurface of low degree is less than 1.


title: Extracting $H_{0}$ and $r_{d}$ in Pacif Parametrization Models through Late-Time Dataset

abstract: This study examines five models derived from the Pacif parametrization scheme of the Hubble parameter ($H$), yielding various linear to quintic forms of the deceleration parameter (DP). Our goal is to explore the impact of these DP variations on late-time evolution and their potential to alleviate cosmological tensions. To enhance model constraints, we introduce non-diagonal elements into the covariance matrix to better capture statistical properties by simulating data point correlations. We also test the sensitivity of $H_{0}$ and $r_{d}$ to the Pacif parametrization scheme, treating the sound horizon $r_{d}$ as a free parameter to avoid imposing a CMB prior. This allows late-time data to constrain $r_{d}$ alongside other cosmological parameters, incorporating recent Baryon Acoustic Oscillations (BAO) measurements and Hubble data from Cosmic Chronometers Methods, Type Ia Supernovae (SNIa), Gamma-Ray Bursts (GRBs), and Quasars over a redshift range of \(0.106 < z < 2.33\). Our analysis provides optimal fit values for $H_{0}$ and $r_{d}$, showing notable consistency with Planck CMB data. By using the Akaike information criterion, we analyze the models and conclude that all models have good agreement with the most recent observations.


title: Active Preference Optimization for Sample Efficient RLHF

abstract: Reinforcement Learning from Human Feedback (RLHF) is pivotal in aligning Large Language Models (LLMs) with human preferences. Although aligned generative models have shown remarkable abilities in various tasks, their reliance on high-quality human preference data creates a costly bottleneck in the practical application of RLHF. One primary reason is that current methods rely on uniformly picking prompt-generation pairs from a dataset of prompt-generations, to collect human feedback, resulting in sub-optimal alignment under a constrained budget, which highlights the criticality of adaptive strategies in efficient alignment. Recent works [Mehta et al., 2023, Muldrew et al., 2024] have tried to address this problem by designing various heuristics based on generation uncertainty. However, either the assumptions in [Mehta et al., 2023] are restrictive, or [Muldrew et al., 2024] do not provide any rigorous theoretical guarantee. To address these, we reformulate RLHF within contextual preference bandit framework, treating prompts as contexts, and develop an active-learning algorithm, $\textit{Active Preference Optimization}$ ($\texttt{APO}$), which enhances model alignment by querying preference data from the most important samples, achieving superior performance for small sample budget. We analyze the theoretical performance guarantees of $\texttt{APO}$ under the BTL preference model showing that the suboptimality gap of the policy learned via $\texttt{APO}$ scales as $O(1/\sqrt{T})$ for a budget of $T$. We also show that collecting preference data by choosing prompts randomly leads to a policy that suffers a constant sub-optimality. We perform detailed experimental evaluations on practical preference datasets to validate $\texttt{APO}$'s efficacy over the existing methods, establishing it as a sample-efficient and practical solution of alignment in a cost-effective and scalable manner.


title: NUTs, Bolts and Stokes Phenomena in the No-Boundary Wave Function

abstract: In this note, we revisit and extend the analysis of the no-boundary wave function for the minisuperspace model in which the universe is described by a biaxial Bianchi IX metric. As matter content, we simply assume a positive cosmological constant. We find that two Stokes phenomena occur, at large squashing parameters of the spatial section of the universe. These Stokes phenomena eliminate potentially dominant Taub-Bolt-de Sitter saddle point geometries and are crucial for the consistency of the model. They also imply that phase transitions occur at certain levels of squashing, where NUT and Bolt saddle points exchange dominance.


title: Late-time transition of $M_B$ inferred via neural networks

abstract: The strengthening of tensions in the cosmological parameters has led to a reconsideration of fundamental aspects of standard cosmology. The tension in the Hubble constant can also be viewed as a tension between local and early Universe constraints on the absolute magnitude $M_B$ of Type Ia supernova. In this work, we reconsider the possibility of a variation of this parameter in a model-independent way. We employ neural networks to agnostically constrain the value of the absolute magnitude as well as assess the impact and statistical significance of a variation in $M_B$ with redshift from the Pantheon+ compilation, together with a thorough analysis of the neural network architecture. We find an indication for a transition redshift at the $z\approx 1$ region.


title: Automated resummation of electroweak Sudakov logarithms in diboson production at future colliders

abstract: At energies that are large with respect to the electroweak scale, the electroweak corrections to scattering processes involve large logarithms that have to be resummed to obtain decent predictions. Soft-collinear effective theory (SCET) has been proposed as a suitable framework to allow for this resummation, while retaining non-logarithmic corrections in a consistent way. In this paper, we investigate the approximations needed to use this approach for the calculation of electroweak corrections to off-shell diboson production at high-energy colliders. Upon implementing the method into a Monte-Carlo integration code, we provide resummed predictions for cross sections and distributions at a 3 TeV lepton collider and a 100 TeV proton collider.


title: Resilience of the quadratic Littlewood-Offord problem

abstract: We study the statistical resilience of high-dimensional data. Our results provide estimates as to the effects of adversarial noise over the anti-concentration properties of the quadratic Radamecher chaos $\boldsymbol{\xi}^{\mathsf{T}} M \boldsymbol{\xi}$, where $M$ is a fixed (high-dimensional) matrix and $\boldsymbol{\xi}$ is a conformal Rademacher vector. Specifically, we pursue the question of how many adversarial sign-flips can $\boldsymbol{\xi}$ sustain without "inflating" $\sup_{x\in \mathbb{R}} \mathbb{P} \left\{\boldsymbol{\xi}^{\mathsf{T}} M \boldsymbol{\xi} = x\right\}$ and thus "de-smooth" the original distribution resulting in a more "grainy" and adversarially biased distribution. Our results provide lower bound estimations for the statistical resilience of the quadratic and bilinear Rademacher chaos; these are shown to be asymptotically tight across key regimes.

categories: math.PR cs.IT cs.LG math.CO math.IT stat.ML


title: A Survey of Resilient Coordination for Cyber-Physical Systems Against Malicious Attacks

abstract: Cyber-physical systems (CPSs) facilitate the integration of physical entities and cyber infrastructures through the utilization of pervasive computational resources and communication units, leading to improved efficiency, automation, and practical viability in both academia and industry. Due to its openness and distributed characteristics, a critical issue prevalent in CPSs is to guarantee resilience in presence of malicious attacks. This paper conducts a comprehensive survey of recent advances on resilient coordination for CPSs. Different from existing survey papers, we focus on the node injection attack and propose a novel taxonomy according to the multi-layered framework of CPS. Furthermore, miscellaneous resilient coordination problems are discussed in this survey. Specifically, some preliminaries and the fundamental problem settings are given at the beginning. Subsequently, based on a multi-layered framework of CPSs, promising results of resilient consensus are classified and reviewed from three perspectives: physical structure, communication mechanism, and network topology. Next, two typical application scenarios, i.e., multi-robot systems and smart grids are exemplified to extend resilient consensus to other coordination tasks. Particularly, we examine resilient containment and resilient distributed optimization problems, both of which demonstrate the applicability of resilient coordination approaches. Finally, potential avenues are highlighted for future research.


title: Optimistic Estimation of Convergence in Markov Chains with the Average-Mixing Time

abstract: The convergence rate of a Markov chain to its stationary distribution is typically assessed using the concept of total variation mixing time. However, this worst-case measure often yields pessimistic estimates and is challenging to infer from observations. In this paper, we advocate for the use of the average-mixing time as a more optimistic and demonstrably easier-to-estimate alternative. We further illustrate its applicability across a range of settings, from two-point to countable spaces, and discuss some practical implications.


title: Multiple localized-itinerant dualities in magnetism of 5f electron systems. The case of UPt$_2$Si$_2$

abstract: The paper deals with the U based compound UPt$_2$Si$_2$ (UPS). The material was first treated as a localized 5f-electron system. Later, an opposite opinion of a predominantly itinerant nature of the system was put forward. The most recent publications treat UPS as a dual material. We suggest a material specific theoretical model based on the density functional theory plus Hubbard $U$ (DFT+$U$) calculations that describes the set of fundamental ground-state properties and high magnetic field experiment. The ground state properties include antiferromagnetic magnetic structure, magnetic easy axis, and the value of the U atomic moment. The in-field experiment shows the presence of a strong metamagnetic transition for the field parallel to the easy axis in contrast to the hard field direction where such a feature is absent. On the other hand, comparable induced magnetization values are obtained for both easy and hard field directions. Within the framework of the suggested model we show that the compound possesses well-formed atomic moments built by electrons treated as delocalized. To understand the experimental high-field properties we estimate exchange energy, magnetic anisotropy energy, and Zeeman energy. All three energies are shown to have comparable values what is crucial for the interpretation of the experiment. At all steps of the study we devote special attention to revealing and emphasizing the dual itinerant-localized properties of the material. The obtained forms of the duality are different: well defined atomic moments formed by the itinerant electrons, interplay of the single-site and two-site anisotropies, strong localization of two of the 5f electrons in contrast to the itinerant nature of the 5f electrons contributing to the states around the Fermi level.


title: Observation of electronic coherence created at conical intersections and its decoherence in aqueous solution

abstract: Electronic quantum coherence is a prerequisite for charge migration in molecules and emerging molecular quantum technologies. It also underlies new forms of spectroscopy and can enhance molecular function. Whether conical intersections can create electronic coherence and for how long electronic coherence can survive in aqueous environments has remained elusive and controversial, respectively. Here, we use X-ray spectroscopy to realize a breakthrough on both of these topics. We find that electronic relaxation from the $^1$B$_{2\rm{u}}$($\pi\pi^*$) state of pyrazine through conical intersections (CIs) induces previously unobserved electronic and vibrational quantum coherences between the $^1$B$_{3\rm{u}}$(n$\pi^*$) and $^1$A$_{\rm{u}}$(n$\pi^*$) states in the gas phase, which correspond to an electronic ring current. These coherences are entirely suppressed when pyrazine is dissolved in water. These observations, supported by the latest advances in multiconfigurational electronic-structure calculations and non-adiabatic dynamics simulations, confirm that CIs can create electronic coherences and that aqueous solvation can decohere them in less than 40 fs. This study opens the door to the investigation of the broad class of electronic coherences created during light-induced molecular dynamics and to quantify their susceptibility to aqueous solvation.


title: Line-shape study of CO perturbed by N${_2}$ with mid-infrared frequency comb-based Fourier-transform spectroscopy

abstract: We developed a mid-infrared optical frequency comb-based Fourier-transform spectrometer and performed a line-shape study of the fundamental vibrational band of CO perturbed by N${_2}$, which is crucial for atmospheric science and astronomical observations. The comb-based FTS enabled us to measure the whole vibrational band with high resolution and precision at several pressures between 10 and 400 Torr. Observed absorption profiles were fitted with the speed-dependent Voigt profile. Collisional broadening, speed-dependent collisional width and shift coefficients are derived. The reliability of our results is established from considerations of systematic errors and comparison with previous studies.


title: Human Goal Recognition as Bayesian Inference: Investigating the Impact of Actions, Timing, and Goal Solvability

abstract: Goal recognition is a fundamental cognitive process that enables individuals to infer intentions based on available cues. Current goal recognition algorithms often take only observed actions as input, but here we use a Bayesian framework to explore the role of actions, timing, and goal solvability in goal recognition. We analyze human responses to goal-recognition problems in the Sokoban domain, and find that actions are assigned most importance, but that timing and solvability also influence goal recognition in some cases, especially when actions are uninformative. We leverage these findings to develop a goal recognition model that matches human inferences more closely than do existing algorithms. Our work provides new insight into human goal recognition and takes a step towards more human-like AI models.


title: Can Transformers Predict Vibrations?

abstract: Highly accurate time-series vibration prediction is an important research issue for electric vehicles (EVs). EVs often experience vibrations when driving on rough terrains, known as torsional resonance. This resonance, caused by the interaction between motor and tire vibrations, puts excessive loads on the vehicle's drive shaft. However, current damping technologies only detect resonance after the vibration amplitude of the drive shaft torque reaches a certain threshold, leading to significant loads on the shaft at the time of detection. In this study, we propose a novel approach to address this issue by introducing Resoformer, a transformer-based model for predicting torsional resonance. Resoformer utilizes time-series of the motor rotation speed as input and predicts the amplitude of torsional vibration at a specified quantile occurring in the shaft after the input series. By calculating the attention between recursive and convolutional features extracted from the measured data points, Resoformer improves the accuracy of vibration forecasting. To evaluate the model, we use a vibration dataset called VIBES (Dataset for Forecasting Vibration Transition in EVs), consisting of 2,600 simulator-generated vibration sequences. Our experiments, conducted on strong baselines built on the VIBES dataset, demonstrate that Resoformer achieves state-of-the-art results. In conclusion, our study answers the question "Can Transformers Forecast Vibrations?" While traditional transformer architectures show low performance in forecasting torsional resonance waves, our findings indicate that combining recurrent neural network and temporal convolutional network using the transformer architecture improves the accuracy of long-term vibration forecasting.