title: Collective Evaluation Problem

abstract: This study focuses on situations where a finite set of alternatives is evaluated by collecting evaluations from several individuals, some of whom may not evaluate specific alternatives. The collection of subsets of alternatives that individuals (can) evaluate is referred to as an evaluability profile. For a given evaluability profile, we define a collective evaluation function whose inputs are the evaluation orders of individuals on the subsets of alternatives that they evaluate. We investigate the properties of collective evaluation functions, which are modifications of those introduced in previous studies. We identify the necessary and sufficient conditions on the evaluability profile that ensure the existence of collective evaluation functions satisfying four different combinations of these properties.


title: REPLAY: Modeling Time-Varying Temporal Regularities of Human Mobility for Location Prediction over Sparse Trajectories

abstract: Location prediction forecasts a user's location based on historical user mobility traces. To tackle the intrinsic sparsity issue of real-world user mobility traces, spatiotemporal contexts have been shown as significantly useful. Existing solutions mostly incorporate spatiotemporal distances between locations in mobility traces, either by feeding them as additional inputs to Recurrent Neural Networks (RNNs) or by using them to search for informative past hidden states for prediction. However, such distance-based methods fail to capture the time-varying temporal regularities of human mobility, where human mobility is often more regular in the morning than in other periods, for example; this suggests the usefulness of the actual timestamps besides the temporal distances. Against this background, we propose REPLAY, a general RNN architecture learning to capture the time-varying temporal regularities for location prediction. Specifically, REPLAY not only resorts to the spatiotemporal distances in sparse trajectories to search for the informative past hidden states, but also accommodates the time-varying temporal regularities by incorporating smoothed timestamp embeddings using Gaussian weighted averaging with timestamp-specific learnable bandwidths, which can flexibly adapt to the temporal regularities of different strengths across different timestamps. Our extensive evaluation compares REPLAY against a sizable collection of state-of-the-art techniques on two real-world datasets. Results show that REPLAY consistently and significantly outperforms state-of-the-art methods by 7.7\%-10.9\% in the location prediction task, and the bandwidths reveal interesting patterns of the time-varying temporal regularities.


title: Cross-domain Chinese Sentence Pattern Parsing

abstract: Sentence Pattern Structure (SPS) parsing is a syntactic analysis method primarily employed in language teaching.Existing SPS parsers rely heavily on textbook corpora for training, lacking cross-domain capability.To overcome this constraint, this paper proposes an innovative approach leveraging large language models (LLMs) within a self-training framework. Partial syntactic rules from a source domain are combined with target domain sentences to dynamically generate training data, enhancing the adaptability of the parser to diverse domains.Experiments conducted on textbook and news domains demonstrate the effectiveness of the proposed method, outperforming rule-based baselines by 1.68 points on F1 metrics.


title: Federated Contextual Cascading Bandits with Asynchronous Communication and Heterogeneous Users

abstract: We study the problem of federated contextual combinatorial cascading bandits, where $|\mathcal{U}|$ agents collaborate under the coordination of a central server to provide tailored recommendations to the $|\mathcal{U}|$ corresponding users. Existing works consider either a synchronous framework, necessitating full agent participation and global synchronization, or assume user homogeneity with identical behaviors. We overcome these limitations by considering (1) federated agents operating in an asynchronous communication paradigm, where no mandatory synchronization is required and all agents communicate independently with the server, (2) heterogeneous user behaviors, where users can be stratified into $J \le |\mathcal{U}|$ latent user clusters, each exhibiting distinct preferences. For this setting, we propose a UCB-type algorithm with delicate communication protocols. Through theoretical analysis, we give sub-linear regret bounds on par with those achieved in the synchronous framework, while incurring only logarithmic communication costs. Empirical evaluation on synthetic and real-world datasets validates our algorithm's superior performance in terms of regrets and communication costs.


title: Chain-of-Discussion: A Multi-Model Framework for Complex Evidence-Based Question Answering

abstract: Open-ended question answering requires models to find appropriate evidence to form well-reasoned, comprehensive and helpful answers. In practical applications, models also need to engage in extended discussions on potential scenarios closely relevant to the question. With augmentation of retrieval module, open-source Large Language Models (LLMs) can produce coherent answers often with different focuses, but are still sub-optimal in terms of reliable evidence selection and in-depth question analysis. In this paper, we propose a novel Chain-of-Discussion framework to leverage the synergy among multiple open-source LLMs aiming to provide \textbf{more correct} and \textbf{more comprehensive} answers for open-ended QA, although they are not strong enough individually. Our experiments show that discussions among multiple LLMs play a vital role in enhancing the quality of answers. We release our data and code at \url{https://github.com/kobayashikanna01/Chain-of-Discussion}.


title: Equational Bit-Vector Solving via Strong Gr\"obner Bases

abstract: Bit-vectors, which are integers in a finite number of bits, are ubiquitous in software and hardware systems. In this work, we consider the satisfiability modulo theories (SMT) of bit-vectors. Unlike normal integers, the arithmetics of bit-vectors are modular upon integer overflow. Therefore, the SMT solving of bit-vectors needs to resolve the underlying modular arithmetics. In the literature, two prominent approaches for SMT solving are bit-blasting (that transforms the SMT problem into boolean satisfiability) and integer solving (that transforms the SMT problem into integer properties). Both approaches ignore the algebraic properties of the modular arithmetics and hence could not utilize these properties to improve the efficiency of SMT solving. In this work, we consider the equational theory of bit-vectors and capture the algebraic properties behind them via strong Gr\"obner bases. First, we apply strong Gr\"obner bases to the quantifier-free equational theory of bit-vectors and propose a novel algorithmic improvement in the key computation of multiplicative inverse modulo a power of two. Second, we resolve the important case of invariant generation in quantified equational bit-vector properties via strong Gr\"obner bases and linear congruence solving. Experimental results over an extensive range of benchmarks show that our approach outperforms existing methods in both time efficiency and memory consumption.


title: Finer: Investigating and Enhancing Fine-Grained Visual Concept Recognition in Large Vision Language Models

abstract: Recent advances in instruction-tuned Large Vision-Language Models (LVLMs) have imbued the models with the ability to generate high-level, image-grounded explanations with ease. While such capability is largely attributed to the rich world knowledge contained within the Large Language Models (LLMs), our work reveals their shortcomings in fine-grained visual categorization (FGVC) across six different benchmark settings. Most recent state-of-the-art LVLMs like LLaVa-1.5, InstructBLIP and GPT-4V not only severely deteriorate in terms of classification performance, e.g., average drop of 65.58 in EM for Stanford Dogs for LLaVA-1.5, but also struggle to generate an accurate explanation with detailed attributes based on the concept that appears within an input image despite their capability to generate holistic image-level descriptions. In-depth analyses show that instruction-tuned LVLMs exhibit modality gap, showing discrepancy when given textual and visual inputs that correspond to the same concept, preventing the image modality from leveraging the rich parametric knowledge within the LLMs. In an effort to further the community's endeavor in this direction, we propose a multiple granularity attribute-centric evaluation benchmark, Finer, which aims to establish a ground to evaluate LVLMs' fine-grained visual comprehension ability and provide significantly improved explainability.


title: Polynomial-Time Computation of Exact $\Phi$-Equilibria in Polyhedral Games

abstract: It is a well-known fact that correlated equilibria can be computed in polynomial time in a large class of concisely represented games using the celebrated Ellipsoid Against Hope algorithm (Papadimitriou and Roughgarden, 2008; Jiang and Leyton-Brown, 2015). However, the landscape of efficiently computable equilibria in sequential (extensive-form) games remains unknown. The Ellipsoid Against Hope does not apply directly to these games, because they do not have the required "polynomial type" property. Despite this barrier, Huang and von Stengel (2008) altered the algorithm to compute exact extensive-form correlated equilibria. In this paper, we generalize the Ellipsoid Against Hope and develop a simple algorithmic framework for efficiently computing saddle-points in bilinear zero-sum games, even when one of the dimensions is exponentially large. Moreover, the framework only requires a "good-enough-response" oracle, which is a weakened notion of a best-response oracle. Using this machinery, we develop a general algorithmic framework for computing exact linear $\Phi$-equilibria in any polyhedral game (under mild assumptions), including correlated equilibria in normal-form games, and extensive-form correlated equilibria in extensive-form games. This enables us to give the first polynomial-time algorithm for computing exact linear-deviation correlated equilibria in extensive-form games, thus resolving an open question by Farina and Pipis (2023). Furthermore, even for the cases for which a polynomial time algorithm for exact equilibria was already known, our framework provides a conceptually simpler solution.


title: Effects of group size and noise on cooperation in population evolution of dynamic groups

abstract: In a large population, the agents temporally form group of the Public Goods Game (PGG) one after another, and size of one group is randomly distributed at $g\in [g_l,g_h]$. Players in it have two strategies to be chosen to cooperate, or to defect for playing the PGG. Based on this structure we investigate the evolution of cooperation in PGG as a function of the noise level underlying strategy adoptions with the group size distribution. In the process of the evolution, the payoffs of cooperators(defectors) have related to the strategy selection implemented by the death-birth process. With a smaller group size $g$, different noise value $K$ induces different dynamic behavior with the increase of multiplication factor $r$. These cooperative behavior can be analytically solved. For a greater group size $g$, the system finally evolve to the bistable state(AllC and hybrid state with cooperators and defectors)starting from different initial concentrations of cooperation. The numerical computation also fit well with the simulation results. We focus on the bistable phenomenon in the equilibrium for a given value of $K$ and a greater group size when the intrusion of one C(D)-player into D(C)-population is investigated from upwards(downwards) branch after experiencing a unstable cooperative evolution. Here, the hysteresis phenomenon can be observed. Further, when one D-player invades into the C-population, the critical value $r_c$ can be obtained in the simulation and the mathematical relationship between the critical value $r_c$ and noise $K$ is analysed.


title: Gradient-Guided Modality Decoupling for Missing-Modality Robustness

abstract: Multimodal learning with incomplete input data (missing modality) is practical and challenging. In this work, we conduct an in-depth analysis of this challenge and find that modality dominance has a significant negative impact on the model training, greatly degrading the missing modality performance. Motivated by Grad-CAM, we introduce a novel indicator, gradients, to monitor and reduce modality dominance which widely exists in the missing-modality scenario. In aid of this indicator, we present a novel Gradient-guided Modality Decoupling (GMD) method to decouple the dependency on dominating modalities. Specifically, GMD removes the conflicted gradient components from different modalities to achieve this decoupling, significantly improving the performance. In addition, to flexibly handle modal-incomplete data, we design a parameter-efficient Dynamic Sharing (DS) framework which can adaptively switch on/off the network parameters based on whether one modality is available. We conduct extensive experiments on three popular multimodal benchmarks, including BraTS 2018 for medical segmentation, CMU-MOSI, and CMU-MOSEI for sentiment analysis. The results show that our method can significantly outperform the competitors, showing the effectiveness of the proposed solutions. Our code is released here: https://github.com/HaoWang420/Gradient-guided-Modality-Decoupling.


title: Data-freeWeight Compress and Denoise for Large Language Models

abstract: Large Language Models (LLMs) are reshaping the research landscape in artificial intelligence, particularly as model parameters scale up significantly, unlocking remarkable capabilities across various domains. Nevertheless, the scalability of model parameters faces constraints due to limitations in GPU memory and computational speed. To address these constraints, various weight compression methods have emerged, such as Pruning and Quantization. Given the low-rank nature of weight matrices in language models, the reduction of weights through matrix decomposition undoubtedly holds significant potential and promise. In this paper, drawing upon the intrinsic structure of LLMs, we propose a novel approach termed Data-free Joint Rank-k Approximation for compressing the parameter matrices. Significantly, our method is characterized by without necessitating additional involvement of any corpus, while simultaneously preserving orthogonality in conjunction with pruning and quantization methods. We achieve a model pruning of 80% parameters while retaining 93.43% of the original performance without any calibration data. Additionally, we explore the fundamental properties of the weight matrix of LLMs undergone Rank-k Approximation and conduct comprehensive experiments to elucidate our hypothesis.


title: Continuous Power Beaming to Lunar Far Side from EMLP-2 Halo Orbit

abstract: This paper focuses on FSO-based wireless power transmission (WPT) from Earth-Moon Lagrangian Point-2 (EMLP-2) to a receiver optical antenna equipped with solar cells that can be located anywhere on the lunar far side (LFS). Different solar-powered satellite (SPS) configurations which are EMLP-2 located single stable satellite and EMLP-2 halo orbit revolving single, double, and triple satellites are evaluated in terms of 100% LFS surface coverage percentage (SCP) and continuous Earth visibility. It is found that an equidistant triple satellite scheme on EMLP-2 halo orbit with a semi-major axis length of 15,000 km provides full SCP for LFS and it is essential for the continuous LFS wireless power transmission. In our proposed dynamic cislunar space model, geometric and temporal parameters of the Earth-Moon systems are used in affine transformations. Our dynamic model enables us to determine the full coverage time rate of a specific region such as the LFS southern pole. The outcomes show that the equidistant double satellite scheme provides SCP=100% during 88.60% time of these satellites' single revolution around the EMLP-2 halo orbit. Finally, the probability density function (PDF) of the random harvested power $P_H$ is determined and it validates the simulation data extracted from the stable EMLP-2 satellite and revolving satellite around EMLP-2 halo orbit for minimum and maximum LoS distances. Although the pointing devices to mitigate random misalignment errors are considered for the stable and revolving SPSs, better pointing accuracy is considered for the stable satellite. Our simulations show that the probability of $P_H\le$41.6 W is around 0.5 for the stable satellite whereas the CDF=0.99 for the revolving satellite case for a transmit power of 1 kW.


title: Self-Supervised Speech Quality Estimation and Enhancement Using Only Clean Speech

abstract: Speech quality estimation has recently undergone a paradigm shift from human-hearing expert designs to machine-learning models. However, current models rely mainly on supervised learning, which is time-consuming and expensive for label collection. To solve this problem, we propose VQScore, a self-supervised metric for evaluating speech based on the quantization error of a vector-quantized-variational autoencoder (VQ-VAE). The training of VQ-VAE relies on clean speech; hence, large quantization errors can be expected when the speech is distorted. To further improve correlation with real quality scores, domain knowledge of speech processing is incorporated into the model design. We found that the vector quantization mechanism could also be used for self-supervised speech enhancement (SE) model training. To improve the robustness of the encoder for SE, a novel self-distillation mechanism combined with adversarial training is introduced. In summary, the proposed speech quality estimation method and enhancement models require only clean speech for training without any label requirements. Experimental results show that the proposed VQScore and enhancement model are competitive with supervised baselines. The code will be released after publication.


title: Estimating Stochastic Block Models in the Presence of Covariates

abstract: In the standard stochastic block model for networks, the probability of a connection between two nodes, often referred to as the edge probability, depends on the unobserved communities each of these nodes belongs to. We consider a flexible framework in which each edge probability, together with the probability of community assignment, are also impacted by observed covariates. We propose a computationally tractable two-step procedure to estimate the conditional edge probabilities as well as the community assignment probabilities. The first step relies on a spectral clustering algorithm applied to a localized adjacency matrix of the network. In the second step, k-nearest neighbor regression estimates are computed on the extracted communities. We study the statistical properties of these estimators by providing non-asymptotic bounds.


title: Algorithms for Halfplane Coverage and Related Problems

abstract: Given in the plane a set of points and a set of halfplanes, we consider the problem of computing a smallest subset of halfplanes whose union covers all points. In this paper, we present an $O(n^{4/3}\log^{5/3}n\log^{O(1)}\log n)$-time algorithm for the problem, where $n$ is the total number of all points and halfplanes. This improves the previously best algorithm of $n^{10/3}2^{O(\log^*n)}$ time by roughly a quadratic factor. For the special case where all halfplanes are lower ones, our algorithm runs in $O(n\log n)$ time, which improves the previously best algorithm of $n^{4/3}2^{O(\log^*n)}$ time and matches an $\Omega(n\log n)$ lower bound. Further, our techniques can be extended to solve a star-shaped polygon coverage problem in $O(n\log n)$ time, which in turn leads to an $O(n\log n)$-time algorithm for computing an instance-optimal $\epsilon$-kernel of a set of $n$ points in the plane. Agarwal and Har-Peled presented an $O(nk\log n)$-time algorithm for this problem in SoCG 2023, where $k$ is the size of the $\epsilon$-kernel; they also raised an open question whether the problem can be solved in $O(n\log n)$ time. Our result thus answers the open question affirmatively.


title: Achieving $\tilde{O}(1/\epsilon)$ Sample Complexity for Constrained Markov Decision Process

abstract: We consider the reinforcement learning problem for the constrained Markov decision process (CMDP), which plays a central role in satisfying safety or resource constraints in sequential learning and decision-making. In this problem, we are given finite resources and a MDP with unknown transition probabilities. At each stage, we take an action, collecting a reward and consuming some resources, all assumed to be unknown and need to be learned over time. In this work, we take the first step towards deriving optimal problem-dependent guarantees for the CMDP problems. We derive a logarithmic regret bound, which translates into a $O(\frac{1}{\Delta\cdot\eps}\cdot\log^2(1/\eps))$ sample complexity bound, with $\Delta$ being a problem-dependent parameter, yet independent of $\eps$. Our sample complexity bound improves upon the state-of-art $O(1/\eps^2)$ sample complexity for CMDP problems established in the previous literature, in terms of the dependency on $\eps$. To achieve this advance, we develop a new framework for analyzing CMDP problems. To be specific, our algorithm operates in the primal space and we resolve the primal LP for the CMDP problem at each period in an online manner, with \textit{adaptive} remaining resource capacities. The key elements of our algorithm are: i) a characterization of the instance hardness via LP basis, ii) an eliminating procedure that identifies one optimal basis of the primal LP, and; iii) a resolving procedure that is adaptive to the remaining resources and sticks to the characterized optimal basis.


title: Confidence Calibration for Recommender Systems and Its Applications

abstract: Despite the importance of having a measure of confidence in recommendation results, it has been surprisingly overlooked in the literature compared to the accuracy of the recommendation. In this dissertation, I propose a model calibration framework for recommender systems for estimating accurate confidence in recommendation results based on the learned ranking scores. Moreover, I subsequently introduce two real-world applications of confidence on recommendations: (1) Training a small student model by treating the confidence of a big teacher model as additional learning guidance, (2) Adjusting the number of presented items based on the expected user utility estimated with calibrated probability.


title: A Provably Accurate Randomized Sampling Algorithm for Logistic Regression

abstract: In statistics and machine learning, logistic regression is a widely-used supervised learning technique primarily employed for binary classification tasks. When the number of observations greatly exceeds the number of predictor variables, we present a simple, randomized sampling-based algorithm for logistic regression problem that guarantees high-quality approximations to both the estimated probabilities and the overall discrepancy of the model. Our analysis builds upon two simple structural conditions that boil down to randomized matrix multiplication, a fundamental and well-understood primitive of randomized numerical linear algebra. We analyze the properties of estimated probabilities of logistic regression when leverage scores are used to sample observations, and prove that accurate approximations can be achieved with a sample whose size is much smaller than the total number of observations. To further validate our theoretical findings, we conduct comprehensive empirical evaluations. Overall, our work sheds light on the potential of using randomized sampling approaches to efficiently approximate the estimated probabilities in logistic regression, offering a practical and computationally efficient solution for large-scale datasets.


title: Deep Rating Elicitation for New Users in Collaborative Filtering

abstract: Recent recommender systems started to use rating elicitation, which asks new users to rate a small seed itemset for inferring their preferences, to improve the quality of initial recommendations. The key challenge of the rating elicitation is to choose the seed items which can best infer the new users' preference. This paper proposes a novel end-to-end Deep learning framework for Rating Elicitation (DRE), that chooses all the seed items at a time with consideration of the non-linear interactions. To this end, it first defines categorical distributions to sample seed items from the entire itemset, then it trains both the categorical distributions and a neural reconstruction network to infer users' preferences on the remaining items from CF information of the sampled seed items. Through the end-to-end training, the categorical distributions are learned to select the most representative seed items while reflecting the complex non-linear interactions. Experimental results show that DRE outperforms the state-of-the-art approaches in the recommendation quality by accurately inferring the new users' preferences and its seed itemset better represents the latent space than the seed itemset obtained by the other methods.


title: A Joint Communication and Computation Design for Probabilistic Semantic Communications

abstract: In this paper, the problem of joint transmission and computation resource allocation for a multi-user probabilistic semantic communication (PSC) network is investigated. In the considered model, users employ semantic information extraction techniques to compress their large-sized data before transmitting them to a multi-antenna base station (BS). Our model represents large-sized data through substantial knowledge graphs, utilizing shared probability graphs between the users and the BS for efficient semantic compression. The resource allocation problem is formulated as an optimization problem with the objective of maximizing the sum of equivalent rate of all users, considering total power budget and semantic resource limit constraints. The computation load considered in the PSC network is formulated as a non-smooth piecewise function with respect to the semantic compression ratio. To tackle this non-convex non-smooth optimization challenge, a three-stage algorithm is proposed where the solutions for the receive beamforming matrix of the BS, transmit power of each user, and semantic compression ratio of each user are obtained stage by stage. Numerical results validate the effectiveness of our proposed scheme.


title: Symmetry-restricted quantum circuits are still well-behaved

abstract: We show that quantum circuits restricted by a symmetry inherit the properties of the whole special unitary group $SU(2^n)$, in particular composition, algebraic and topological closedness and connectedness. It extends prior work on symmetric states to the operators and shows that the operator space follows the same structure as the state space. The well-behavedness is independent of the symmetry requirement imposed on the subgroup. We provide an example of a permutation invariance across all qubits.


title: Oscillatory Hall effect from magnetoelectronic coupling in flexoelectronic silicon

abstract: The magnetoelectronic coupling can be defined as cross-domain coupling between electronic and magnetic properties, where modulation in magnetic properties changes the electronic properties. In this letter, an explicit experimental evidence of magnetoelectronic coupling is presented, which is uncovered from oscillatory Hall effect response in Hall measurement. The strain gradient in a MgO (1.8 nm)/p-Si (~400 nm) freestanding sample leads to transfer of electrons (~5X10^18 cm^-3) from valence to conduction band due to flexoelectronic charge separation in the p-Si layer. The resulting flexoelectronic polarization gives rise to temporal magnetic moment from dynamical multiferroicity. The external magnetic field changes the net temporal magnetic moment, which causes modulations in charge carrier concentration and oscillatory Hall effect. The period of oscillatory Hall response is 1.12 T, which is attributed to the magnitude of temporal magnetic moment. The discovery of oscillatory Hall effect adds a new member to the family of Hall effects.


title: Efficient calculation of magnetocrystalline anisotropy energy using symmetry-adapted Wannier functions

abstract: Magnetocrystalline anisotropy, a crucial factor in magnetic properties and applications like magnetoresistive random-access memory, often requires extensive $k$-point mesh in first-principles calculations. In this study, we develop a Wannier orbital tight-binding model incorporating crystal and spin symmetries and utilize time-reversal symmetry to divide magnetization components. This model enables efficient computation of magnetocrystalline anisotropy. Applying this method to $\mathrm{L1_0}$ $\mathrm{FePt}$ and $\mathrm{FeNi}$, we calculate the dependence of the anisotropic energy on $k$-point mesh size, chemical potential, spin-orbit interaction, and magnetization direction. The results validate the practicality of the models to the energy order of $10~[\mathrm{\mu eV}/f.u.]$.


title: Lower bound for large transversal fluctuations in exactly solvable KPZ models

abstract: The study of transversal fluctuation of the optimal path has been a crucial aspect of the Kadar-Parisi-Zhang (KPZ) universality class. In this paper, we establish a new probability lower bound, with optimal exponential order, for the rare event in which a given level of the optimal path has a large transversal fluctuation. We present our results in both zero and positive temperature settings. The previously known lower bounds were obtained in zero temperature models, and they hold for the maximum transversal fluctuation along the entire geodesic (Hammond-Sarkar'20) or the starting portion of the geodesic at a local scale (Agarwal'23). Our result improves upon these as now the rare event can demand where the large fluctuation occurs exactly along the optimal path, on both local and global scales. Our proof utilizes the coupling method: we first obtain a version of the estimate in the semi-infinite setting using duality and then transfer the result to finite paths using planar monotonicity. Our method differs from the previous works (Agarwal'23, Hammond-Sarkar'20), and in fact, we do not require fine information about the left tail moderate deviation, which played a crucial role in (Agarwal'23, Hammond-Sarkar'20).


title: Unveiling the Truth and Facilitating Change: Towards Agent-based Large-scale Social Movement Simulation

abstract: Social media has emerged as a cornerstone of social movements, wielding significant influence in driving societal change. Simulating the response of the public and forecasting the potential impact has become increasingly important. However, existing methods for simulating such phenomena encounter challenges concerning their efficacy and efficiency in capturing the behaviors of social movement participants. In this paper, we introduce a hybrid framework HiSim for social media user simulation, wherein users are categorized into two types. Core users are driven by Large Language Models, while numerous ordinary users are modeled by deductive agent-based models. We further construct a Twitter-like environment to replicate their response dynamics following trigger events. Subsequently, we develop a multi-faceted benchmark SoMoSiMu-Bench for evaluation and conduct comprehensive experiments across real-world datasets. Experimental results demonstrate the effectiveness and flexibility of our method.


title: On the algebra generated by three commuting matrices: combinatorial cases

abstract: Gerstenhaber proved in 1961 that the unital algebra generated by a pair of commuting $d\times d$ matrices over a field has dimension at most $d$. It is an open problem whether the analogous statement is true for triples of matrices which pairwise commute. We answer this question for special classes of triples of matrices arising from combinatorial data.


title: Transfinite Extension of Nuclear Dimension

abstract: In this paper, we introduce a notion of transfinite nuclear dimension for $C^*$-algebras, which coincides with the nuclear dimension when taking values in natural numbers. We use it to characterise a stronger form of having nuclear dimension at most $\omega$ and moreover, we show that the transfinite nuclear dimension of a uniform Roe algebra is bounded by the transfinite asymptotic dimension of the underlying space. Hence we obtain that the uniform Roe algebra for spaces with asymptotic property C has the corona factorisation property.


title: Red Asymmetry of H$_{\alpha}$ Line Profiles during the flares on the active RS CVn-type star II Pegasi

abstract: Stellar coronal mass ejections (CMEs) have recently attracted much attention for their impacts on stellar evolution and surrounding exoplanets. RS CVn-type stars could produce large flares, and therefore may have frequent CMEs. Here we report the capture of a possible CME or chromospheric condensation on the RS CVn-type star II Pegasi (II Peg) using high-resolution spectroscopic observation. Two flares were detected during the observation, and the low limits of the flare energies are of the order of $10^{33}$ erg and $10^{34}$ erg, respectively. Using mean spectrum subtraction, the H$_{\alpha}$ residual shows red asymmetry during the flares, and the redshifted broad emission components are probably caused by chromospheric condensation or coronal rain. Moreover, a far redshifted extra emission component with a high bulk velocity of 429 km s$^{-1}$ was observed during the second flare and is probably due to a prominence eruption. The velocity greatly exceeds the star's escape velocity, which means that this eruption can develop into a CME. The CME mass is estimated to be 0.83-1.48 $\times 10^{20}$ g, which is slightly larger than the value expected from solar flare-CME extrapolation. The kinetic energy of CME, derived to be 0.76-1.15 $\times 10^{35}$ erg, is less than the kinetic energy extrapolated from solar events. Additionally, we could not completely rule out the possibility of chromospheric condensation resulting in the far redshifted extra emission. Finally, there is a blueshifted broad component in the subtracted H$_{\alpha}$ profile derived using synthesized spectral subtraction when no flare happened, and its behavior is associated with the H$_{\alpha}$ activity features.


title: Event-Triggered Parameterized Control of Nonlinear Systems

abstract: This paper deals with event-triggered parameterized control (ETPC) of nonlinear systems with external disturbances. In this control method, between two successive events, each control input to the plant is a linear combination of a set of linearly independent scalar functions. At each event, the controller updates the coefficients of the parameterized control input so as to minimize the error in approximating a continuous time control signal and communicates the same to the actuator. We design an event-triggering rule that guarantees global uniform ultimate boundedness of trajectories of the closed loop system. We also ensure the absence of Zeno behavior by showing the existence of a uniform positive lower bound on the inter-event times. We illustrate our results through numerical examples, which indicate that the proposed control method leads to a significant improvement in average inter-event time and minimum inter-event time compared to the event-triggered zero-order-hold control.


title: BLO-SAM: Bi-level Optimization Based Overfitting-Preventing Finetuning of SAM

abstract: The Segment Anything Model (SAM), a foundation model pretrained on millions of images and segmentation masks, has significantly advanced semantic segmentation, a fundamental task in computer vision. Despite its strengths, SAM encounters two major challenges. Firstly, it struggles with segmenting specific objects autonomously, as it relies on users to manually input prompts like points or bounding boxes to identify targeted objects. Secondly, SAM faces challenges in excelling at specific downstream tasks, like medical imaging, due to a disparity between the distribution of its pretraining data, which predominantly consists of general-domain images, and the data used in downstream tasks. Current solutions to these problems, which involve finetuning SAM, often lead to overfitting, a notable issue in scenarios with very limited data, like in medical imaging. To overcome these limitations, we introduce BLO-SAM, which finetunes SAM based on bi-level optimization (BLO). Our approach allows for automatic image segmentation without the need for manual prompts, by optimizing a learnable prompt embedding. Furthermore, it significantly reduces the risk of overfitting by training the model's weight parameters and the prompt embedding on two separate subsets of the training dataset, each at a different level of optimization. We apply BLO-SAM to diverse semantic segmentation tasks in general and medical domains. The results demonstrate BLO-SAM's superior performance over various state-of-the-art image semantic segmentation methods.


title: Microscopic optical potential from the relativistic Brueckner-Hartree-Fock theory: Proton-nucleus scattering

abstract: A relativistic microscopic optical model potential for nucleon-nucleus scattering is developed based on the \emph{ab initio} relativistic Brueckner-Hartree-Fock (RBHF) theory with the improved local density approximation, which is abbreviated as the RBOM potential. Both real and imaginary parts of the single-particle potentials in symmetric and asymmetric nuclear matter at various densities are determined uniquely in the full Dirac space. The density distributions of the target nuclei are calculated by the covariant energy density functional theory with the density functional PC-PK1. The central and spin-orbit terms of the optical potentials are quantitatively consistent with the relativistic phenomenological optical potentials. The performance of the RBOM potential is evaluated by considering proton scattering with incident energy $E\leq 200$ MeV on five target nuclei, $\prescript{208}{}{\text{Pb}}$, $\prescript{120}{}{\text{Sn}}$, $\prescript{90}{}{\text{Zr}}$, $\prescript{48}{}{\text{Ca}}$, and $\prescript{40}{}{\text{Ca}}$. Scattering observables including the elastic scattering angular distributions, analyzing powers, spin rotation functions, and reaction cross sections are analyzed. Theoretical predictions show good agreements with the experimental data and the results derived from phenomenological optical potentials. We anticipate that the RBOM potential can provide reference for other phenomenological and microscopic optical model potentials, as well as reliable descriptions for nucleon scattering on exotic nuclei in the era of rare-isotope beams.


title: Zero level modules over twisted affine Lie superalgebras

abstract: In this paper, we characterize a class of simple finite weight modules over twisted affine Lie superalgebras. This is an essential step toward completing the classification of simple finite weight modules over these Lie superalgebras.


title: Sampling Problems on a Quantum Computer

abstract: Due to the advances in the manufacturing of quantum hardware in the recent years, significant research efforts have been directed towards employing quantum methods to solving problems in various areas of interest. Thus a plethora of novel quantum methods have been developed in recent years. In this paper, we provide a survey of quantum sampling methods alongside needed theory and applications of those sampling methods as a starting point for research in this area. This work focuses in particular on Gaussian Boson sampling, quantum Monte Carlo methods, quantum variational Monte Carlo, quantum Boltzmann Machines and quantum Bayesian networks. We strive to provide a self-contained overview over the mathematical background, technical feasibility, applicability for other problems and point out potential areas of future research.


title: Contingency Planning Using Bi-level Markov Decision Processes for Space Missions

abstract: This work focuses on autonomous contingency planning for scientific missions by enabling rapid policy computation from any off-nominal point in the state space in the event of a delay or deviation from the nominal mission plan. Successful contingency planning involves managing risks and rewards, often probabilistically associated with actions, in stochastic scenarios. Markov Decision Processes (MDPs) are used to mathematically model decision-making in such scenarios. However, in the specific case of planetary rover traverse planning, the vast action space and long planning time horizon pose computational challenges. A bi-level MDP framework is proposed to improve computational tractability, while also aligning with existing mission planning practices and enhancing explainability and trustworthiness of AI-driven solutions. We discuss the conversion of a mission planning MDP into a bi-level MDP, and test the framework on RoverGridWorld, a modified GridWorld environment for rover mission planning. We demonstrate the computational tractability and near-optimal policies achievable with the bi-level MDP approach, highlighting the trade-offs between compute time and policy optimality as the problem's complexity grows. This work facilitates more efficient and flexible contingency planning in the context of scientific missions.


title: Trimma: Trimming Metadata Storage and Latency for Hybrid Memory Systems

abstract: Hybrid main memory systems combine both performance and capacity advantages from heterogeneous memory technologies. With larger capacities, higher associativities, and finer granularities, hybrid memory systems currently exhibit significant metadata storage and lookup overheads for flexibly remapping data blocks between the two memory tiers. To alleviate the inefficiencies of existing designs, we propose Trimma, the combination of a multi-level metadata structure and an efficient metadata cache design. Trimma uses a multi-level metadata table to only track truly necessary address remap entries. The saved memory space is effectively utilized as extra DRAM cache capacity to improve performance. Trimma also uses separate formats to store the entries with non-identity and identity mappings. This improves the overall remap cache hit rate, further boosting the performance. Trimma is transparent to software and compatible with various types of hybrid memory systems. When evaluated on a representative DDR4 + NVM hybrid memory system, Trimma achieves up to 2.4$\times$ and on average 58.1\% speedup benefits, compared with a state-of-the-art design that only leverages the unallocated fast memory space for caching. Trimma addresses metadata management overheads and targets future scalable large-scale hybrid memory architectures.


title: Probing new physics with polarization components of the tau lepton in quasielastic $e^- p \to \Lambda_c \tau^-$ scattering process

abstract: Kinematics restrict the ability of rare charm decays to explore the charged Lepton Flavor Violation processes mediated by the quark-level $c\to u \ell \tau$ transition. To fill the gap, we propose exploring new physics (NP) through the quasielastic scattering process $e^-p\to \tau^-\Lambda_c$ and the polarization of the $\tau$ lepton. As analyzing modes for the $\tau$ polarization, we consider the decays $\tau^-\to \pi^-\nu_{\tau}$, $\tau^-\to \rho^-\nu_{\tau}$, and $\tau^- \to \ell^-\bar{\nu}_{\ell}\nu_{\tau}$, and show that the $\tau$ polarization components can be extracted from analyzing the kinematics of the $\tau$ visible decay products. In the framework of a general low-energy effective Lagrangian, we then perform a detailed analysis of the polarization components in various aspects and scrutinize possible NP signals. With one upcoming experimental setup, we finally demonstrate promising event rate can be expected for the cascade process and, even in the worst-case scenario -- no signals is observed at all -- it can still provide a competitive potential for constraining the NP, compared with those from the high-$p_T$ dilepton invariant mass tails at high-energy colliders.


title: On convergence of forecasts in prediction markets

abstract: We propose a dynamic model of a prediction market in which agents predict the values of a sequence of random vectors. The main result shows that if there are agents who make correct (or asymptotically correct) next-period forecasts, then the aggregated market forecasts converge to the next-period conditional expectations of the random vectors.


title: Boosting Graph Pooling with Persistent Homology

abstract: Recently, there has been an emerging trend to integrate persistent homology (PH) into graph neural networks (GNNs) to enrich expressive power. However, naively plugging PH features into GNN layers always results in marginal improvement with low interpretability. In this paper, we investigate a novel mechanism for injecting global topological invariance into pooling layers using PH, motivated by the observation that filtration operation in PH naturally aligns graph pooling in a cut-off manner. In this fashion, message passing in the coarsened graph acts along persistent pooled topology, leading to improved performance. Experimentally, we apply our mechanism to a collection of graph pooling methods and observe consistent and substantial performance gain over several popular datasets, demonstrating its wide applicability and flexibility.


title: CodeS: Towards Building Open-source Language Models for Text-to-SQL

abstract: Language models have shown promising performance on the task of translating natural language questions into SQL queries (Text-to-SQL). However, most of the state-of-the-art (SOTA) approaches rely on powerful yet closed-source large language models (LLMs), such as ChatGPT and GPT-4, which may have the limitations of unclear model architectures, data privacy risks, and expensive inference overheads. To address the limitations, we introduce CodeS, a series of pre-trained language models with parameters ranging from 1B to 15B, specifically designed for the text-to-SQL task. CodeS is a fully open-source language model, which achieves superior accuracy with much smaller parameter sizes. This paper studies the research challenges in building CodeS. To enhance the SQL generation abilities of CodeS, we adopt an incremental pre-training approach using a specifically curated SQL-centric corpus. Based on this, we address the challenges of schema linking and rapid domain adaptation through strategic prompt construction and a bi-directional data augmentation technique. We conduct comprehensive evaluations on multiple datasets, including the widely used Spider benchmark, the newly released BIRD benchmark, robustness-diagnostic benchmarks such as Spider-DK, Spider-Syn, Spider-Realistic, and Dr.Spider, as well as two real-world datasets created for financial and academic applications. The experimental results show that our CodeS achieves new SOTA accuracy and robustness on nearly all challenging text-to-SQL benchmarks.


title: Star-Searcher: A Complete and Efficient Aerial System for Autonomous Target Search in Complex Unknown Environments

abstract: This paper tackles the challenge of autonomous target search using unmanned aerial vehicles (UAVs) in complex unknown environments. To fill the gap in systematic approaches for this task, we introduce Star-Searcher, an aerial system featuring specialized sensor suites, mapping, and planning modules to optimize searching. Path planning challenges due to increased inspection requirements are addressed through a hierarchical planner with a visibility-based viewpoint clustering method. This simplifies planning by breaking it into global and local sub-problems, ensuring efficient global and local path coverage in real-time. Furthermore, our global path planning employs a history-aware mechanism to reduce motion inconsistency from frequent map changes, significantly enhancing search efficiency. We conduct comparisons with state-of-the-art methods in both simulation and the real world, demonstrating shorter flight paths, reduced time, and higher target search completeness. Our approach will be open-sourced for community benefit at https://github.com/SYSU-STAR/STAR-Searcher.


title: C-GAIL: Stabilizing Generative Adversarial Imitation Learning with Control Theory

abstract: Generative Adversarial Imitation Learning (GAIL) trains a generative policy to mimic a demonstrator. It uses on-policy Reinforcement Learning (RL) to optimize a reward signal derived from a GAN-like discriminator. A major drawback of GAIL is its training instability - it inherits the complex training dynamics of GANs, and the distribution shift introduced by RL. This can cause oscillations during training, harming its sample efficiency and final policy performance. Recent work has shown that control theory can help with the convergence of a GAN's training. This paper extends this line of work, conducting a control-theoretic analysis of GAIL and deriving a novel controller that not only pushes GAIL to the desired equilibrium but also achieves asymptotic stability in a 'one-step' setting. Based on this, we propose a practical algorithm 'Controlled-GAIL' (C-GAIL). On MuJoCo tasks, our controlled variant is able to speed up the rate of convergence, reduce the range of oscillation and match the expert's distribution more closely both for vanilla GAIL and GAIL-DAC.


title: Impression-CLIP: Contrastive Shape-Impression Embedding for Fonts

abstract: Fonts convey different impressions to readers. These impressions often come from the font shapes. However, the correlation between fonts and their impression is weak and unstable because impressions are subjective. To capture such weak and unstable cross-modal correlation between font shapes and their impressions, we propose Impression-CLIP, which is a novel machine-learning model based on CLIP (Contrastive Language-Image Pre-training). By using the CLIP-based model, font image features and their impression features are pulled closer, and font image features and unrelated impression features are pushed apart. This procedure realizes co-embedding between font image and their impressions. In our experiment, we perform cross-modal retrieval between fonts and impressions through co-embedding. The results indicate that Impression-CLIP achieves better retrieval accuracy than the state-of-the-art method. Additionally, our model shows the robustness to noise and missing tags.


title: Flow birefringence of cellulose nanocrystal suspensions in three-dimensional flow fields: revisiting the stress-optic law

abstract: This study systematically investigates the flow birefringence of cellulose nanocrystal (CNC) suspensions. The aim is to clarify the importance of the stress component along the camera's optical axis in the stress-optic law (SOL), which describes the relationship between birefringence, the retardation of transmitted polarized light, and the stress field. More than 100 datasets pertaining to the retardation of CNC suspensions (concentrations of 0.1, 0.3, 0.5, and 1.0 wt\%) in a laminar flow field within a rectangular channel (aspect ratios of 0.1, 1, and 3) are systematically obtained. The measured retardation data are compared with the predictions given by the conventional SOL excluding the stress component along the camera's optical axis and by the SOL including these components as second-order terms (2nd-order SOL). The results show that the 2nd-order SOL gives a significantly better agreement with the measurements. Based on the 2nd-order SOL, the retardation at the center of the channel, where the effect of the stress component along the camera's optical axis is most pronounced, is predicted to be proportional to the square of the flow rate, which agrees with the experimental data. The results confirm the importance of considering the stress component along the camera's optical axis in the flow birefringence of CNC suspensions at high flow rates, even for quasi-two-dimensional channel flow.


title: MathGenie: Generating Synthetic Data with Question Back-translation for Enhancing Mathematical Reasoning of LLMs

abstract: Large language models (LLMs) have exhibited great potential in mathematical reasoning. However, there remains a performance gap in this area between existing open-source models and closed-source models such as GPT-4. In this paper, we introduce MathGenie, a novel method for generating diverse and reliable math problems from a small-scale problem-solution dataset (denoted as seed data). We augment the ground-truth solutions of our seed data and train a back-translation model to translate the augmented solutions back into new questions. Subsequently, we generate code-integrated solutions for the new questions. To ensure the correctness of the code-integrated solutions, we employ rationale-based strategy for solution verification. Various pretrained models, ranging from 7B to 70B, are trained on the newly curated data to test the effectiveness of the proposed augmentation technique, resulting in a family of models known as MathGenieLM. These models consistently outperform previous open-source models across five representative mathematical reasoning datasets, achieving state-of-the-art performance. In particular, MathGenieLM-InternLM2 achieves an accuracy of 87.7% on GSM8K and 55.7% on MATH, securing the best overall score among open-source language models.


title: An optimal tradeoff between entanglement and copy complexity for state tomography

abstract: There has been significant interest in understanding how practical constraints on contemporary quantum devices impact the complexity of quantum learning. For the classic question of tomography, recent work tightly characterized the copy complexity for any protocol that can only measure one copy of the unknown state at a time, showing it is polynomially worse than if one can make fully-entangled measurements. While we now have a fairly complete picture of the rates for such tasks in the near-term and fault-tolerant regimes, it remains poorly understood what the landscape in between looks like. In this work, we study tomography in the natural setting where one can make measurements of $t$ copies at a time. For sufficiently small $\epsilon$, we show that for any $t \le d^2$, $\widetilde{\Theta}(\frac{d^3}{\sqrt{t}\epsilon^2})$ copies are necessary and sufficient to learn an unknown $d$-dimensional state $\rho$ to trace distance $\epsilon$. This gives a smooth and optimal interpolation between the known rates for single-copy and fully-entangled measurements. To our knowledge, this is the first smooth entanglement-copy tradeoff known for any quantum learning task, and for tomography, no intermediate point on this curve was known, even at $t = 2$. An important obstacle is that unlike the optimal single-copy protocol, the optimal fully-entangled protocol is inherently biased and thus precludes naive batching approaches. Instead, we devise a novel two-stage procedure that uses Keyl's algorithm to refine a crude estimate for $\rho$ based on single-copy measurements. A key insight is to use Schur-Weyl sampling not to estimate the spectrum of $\rho$, but to estimate the deviation of $\rho$ from the maximally mixed state. When $\rho$ is far from the maximally mixed state, we devise a novel quantum splitting procedure that reduces to the case where $\rho$ is close to maximally mixed.


title: Language-guided Skill Learning with Temporal Variational Inference

abstract: We present an algorithm for skill discovery from expert demonstrations. The algorithm first utilizes Large Language Models (LLMs) to propose an initial segmentation of the trajectories. Following that, a hierarchical variational inference framework incorporates the LLM-generated segmentation information to discover reusable skills by merging trajectory segments. To further control the trade-off between compression and reusability, we introduce a novel auxiliary objective based on the Minimum Description Length principle that helps guide this skill discovery process. Our results demonstrate that agents equipped with our method are able to discover skills that help accelerate learning and outperform baseline skill learning approaches on new long-horizon tasks in BabyAI, a grid world navigation environment, as well as ALFRED, a household simulation environment.


title: Development of a Generalizable Data-driven Turbulence Model: Conditioned Field Inversion and Symbolic Regression

abstract: This paper addresses the issue of predicting separated flows with Reynolds-averaged Navier-Stokes (RANS) turbulence models, which are essential for many engineering tasks. Traditional RANS models usually struggle with this task, so recent efforts have focused on data-driven methods such as field inversion and machine learning (FIML) to correct this issue by adjusting the baseline equations. However, these FIML methods often reduce accuracy in attached boundary layers. To address this issue, we developed a "conditioned field inversion" technique. This method adjusts the corrective factor \b{eta} (used by FIML) in the shear-stress transport (SST) model. It multiplies \b{eta} with a shield function f_d that is off in the boundary layer and on elsewhere. This maintains the accuracy of the baseline model for the attached flows. We applied both conditioned and classic field inversion to the NASA hump and a curved backward-facing step (CBFS), creating two datasets. These datasets were used to train two models: SR-CND (from our new method) and SR-CLS (from the traditional method). The SR-CND model matches the SR-CLS model in predicting separated flows in various scenarios, such as periodic hills, the NLR7301 airfoil, the 3D SAE car model, and the 3D Ahmed body, and significantly outperforms the baseline SST model. Importantly, the SR-CND model maintains accuracy in the attached boundary layers, whereas the SR-CLS model does not. Therefore, the proposed method improves separated flow predictions while maintaining the accuracy of the original model for attached flows, offering a better way to create data-driven turbulence models.


title: What Text Design Characterizes Book Genres?

abstract: This study analyzes the relationship between non-verbal information (e.g., genres) and text design (e.g., font style, character color, etc.) through the classification of book genres using text design on book covers. Text images have both semantic information about the word itself and other information (non-semantic information or visual design), such as font style, character color, etc. When we read a word printed on some materials, we receive impressions or other information from both the word itself and the visual design. Basically, we can understand verbal information only from semantic information, i.e., the words themselves; however, we can consider that text design is helpful for understanding other additional information (i.e., non-verbal information), such as impressions, genre, etc. To investigate the effect of text design, we analyze text design using words printed on book covers and their genres in two scenarios. First, we attempted to understand the importance of visual design for determining the genre (i.e., non-verbal information) of books by analyzing the differences in the relationship between semantic information/visual design and genres. In the experiment, we found that semantic information is sufficient to determine the genre; however, text design is helpful in adding more discriminative features for book genres. Second, we investigated the effect of each text design on book genres. As a result, we found that each text design characterizes some book genres. For example, font style is useful to add more discriminative features for genres of ``Mystery, Thriller \& Suspense'' and ``Christian books \& Bibles.''


title: Linear recurrent sequences providing decomposition law in number fields

abstract: In their recent paper, Rosen, Takeyama, Tasaka, and Yamamoto constructed recurrent sequences providing a decomposition law of primes in a Galois extension. In this paper, we reconstruct their sequences via representation theory of finite groups and obtain an explicit description of the sequences.


title: An Integrated Data Processing Framework for Pretraining Foundation Models

abstract: The ability of the foundation models heavily relies on large-scale, diverse, and high-quality pretraining data. In order to improve data quality, researchers and practitioners often have to manually curate datasets from difference sources and develop dedicated data cleansing pipeline for each data repository. Lacking a unified data processing framework, this process is repetitive and cumbersome. To mitigate this issue, we propose a data processing framework that integrates a Processing Module which consists of a series of operators at different granularity levels, and an Analyzing Module which supports probing and evaluation of the refined data. The proposed framework is easy to use and highly flexible. In this demo paper, we first introduce how to use this framework with some example use cases and then demonstrate its effectiveness in improving the data quality with an automated evaluation with ChatGPT and an end-to-end evaluation in pretraining the GPT-2 model. The code and demonstration videos are accessible on GitHub.


title: Feedback Efficient Online Fine-Tuning of Diffusion Models

abstract: Diffusion models excel at modeling complex data distributions, including those of images, proteins, and small molecules. However, in many cases, our goal is to model parts of the distribution that maximize certain properties: for example, we may want to generate images with high aesthetic quality, or molecules with high bioactivity. It is natural to frame this as a reinforcement learning (RL) problem, in which the objective is to fine-tune a diffusion model to maximize a reward function that corresponds to some property. Even with access to online queries of the ground-truth reward function, efficiently discovering high-reward samples can be challenging: they might have a low probability in the initial distribution, and there might be many infeasible samples that do not even have a well-defined reward (e.g., unnatural images or physically impossible molecules). In this work, we propose a novel reinforcement learning procedure that efficiently explores on the manifold of feasible samples. We present a theoretical analysis providing a regret guarantee, as well as empirical validation across three domains: images, biological sequences, and molecules.


title: Remark on Estimates in Modulation Spaces for Schr\"odinger Evolution Operators with Sub-quadratic Potentials

abstract: In this paper we give an estimate for the solution to the Schr\"odinger equation with sub-quadratic potentials in modulation spaces by the norm of the initial functions in Wiener-Amalgum spaces.


title: Layer-wise Regularized Dropout for Neural Language Models

abstract: Among the various pre-trained neural language models that are popular today, dropout is already an indispensable regularization technique. To solve the inconsistency between training and inference caused by the randomness of dropout, some studies use consistency training to regularize dropout at the output layer. In this paper, we propose a novel Layer-wise Regularized Dropout (LR-Drop), which is specially designed for Transformer-based Language models. Specifically, LR-Drop layer-wise regularizes each Transformer layer using the consistency training strategy. Each training sample passes through the two siamese sub-models sampled by dropout, and then LR-Drop forces the hidden states, multi-head attention matrices, and output distribution of the two siamese sub-models to be consistent. The proposed LR-Drop can be regarded as a "self-distillation" framework, in which each sub-model generated by dropout is the other's "teacher" model and "student" model. Through extensive experiments on 8 natural language understanding datasets, 6 neural machine translation datasets, and 1 abstractive summarization dataset (a total of 15 datasets), we show that LR-Drop achieves superior performances, including state-of-the-art results.


title: Estimation of complex carryover effects in crossover designs with repeated measures

abstract: It has been argued that the models used to analyze data from crossover designs are not appropriate when simple carryover effects are assumed. In this paper, the estimability conditions of the carryover effects are found, and a theoretical result that supports them, additionally, two simulation examples are developed in a non-linear dose-response for a repeated measures crossover trial in two designs: the traditional AB/BA design and a Williams square. Both show that a semiparametric model can detect complex carryover effects and that this estimation improves the precision of treatment effect estimators. We concluded that when there are at least five replicates in each observation period per individual, semiparametric statistical models provide a good estimator of the treatment effect and reduce bias with respect to models that assume either, the absence of carryover or simplex carryover effects. In addition, an application of the methodology is shown and the richness in analysis that is gained by being able to estimate complex carryover effects is evident.


title: LLM Inference Unveiled: Survey and Roofline Model Insights

abstract: The field of efficient Large Language Model (LLM) inference is rapidly evolving, presenting a unique blend of opportunities and challenges. Although the field has expanded and is vibrant, there hasn't been a concise framework that analyzes the various methods of LLM Inference to provide a clear understanding of this domain. Our survey stands out from traditional literature reviews by not only summarizing the current state of research but also by introducing a framework based on roofline model for systematic analysis of LLM inference techniques. This framework identifies the bottlenecks when deploying LLMs on hardware devices and provides a clear understanding of practical problems, such as why LLMs are memory-bound, how much memory and computation they need, and how to choose the right hardware. We systematically collate the latest advancements in efficient LLM inference, covering crucial areas such as model compression (e.g., Knowledge Distillation and Quantization), algorithm improvements (e.g., Early Exit and Mixture-of-Expert), and both hardware and system-level enhancements. Our survey stands out by analyzing these methods with roofline model, helping us understand their impact on memory access and computation. This distinctive approach not only showcases the current research landscape but also delivers valuable insights for practical implementation, positioning our work as an indispensable resource for researchers new to the field as well as for those seeking to deepen their understanding of efficient LLM deployment. The analyze tool, LLM-Viewer, is open-sourced.


title: Where Do We Go from Here? Multi-scale Allocentric Relational Inference from Natural Spatial Descriptions

abstract: When communicating routes in natural language, the concept of {\em acquired spatial knowledge} is crucial for geographic information retrieval (GIR) and in spatial cognitive research. However, NLP navigation studies often overlook the impact of such acquired knowledge on textual descriptions. Current navigation studies concentrate on egocentric local descriptions (e.g., `it will be on your right') that require reasoning over the agent's local perception. These instructions are typically given as a sequence of steps, with each action-step explicitly mentioning and being followed by a landmark that the agent can use to verify they are on the right path (e.g., `turn right and then you will see...'). In contrast, descriptions based on knowledge acquired through a map provide a complete view of the environment and capture its overall structure. These instructions (e.g., `it is south of Central Park and a block north of a police station') are typically non-sequential, contain allocentric relations, with multiple spatial relations and implicit actions, without any explicit verification. This paper introduces the Rendezvous (RVS) task and dataset, which includes 10,404 examples of English geospatial instructions for reaching a target location using map-knowledge. Our analysis reveals that RVS exhibits a richer use of spatial allocentric relations, and requires resolving more spatial relations simultaneously compared to previous text-based navigation benchmarks.


title: Studies of the energy dependence of diboson polarization fractions and the Radiation Amplitude Zero effect in WZ production with the ATLAS detector

abstract: This Letter presents the first study of the energy-dependence of diboson polarization fractions in $WZ \rightarrow \ell\nu \ell'\ell'~(\ell, \ell'=e, \mu)$ production. The data set used corresponds to an integrated luminosity of 140 fb$^{-1}$ of proton-proton collisions at a center-of-mass energy of 13 TeV recorded by the ATLAS detector. Two fiducial regions with an enhanced presence of events featuring two longitudinally-polarized bosons are defined. A non-zero fraction of events with two longitudinally-polarized bosons is measured with an observed significance of 5.3 standard deviations in the region with $100<p_T^Z\leq200$ GeV and 1.6 standard deviations in the region with $p_T^Z>200$ GeV, where $p_T^Z$ is the transverse momentum of the $Z$ boson. This Letter also reports the first study of the Radiation Amplitude Zero effect. Events with two transversely-polarized bosons are analyzed for the $\Delta Y(\ell_W Z)$ and $\Delta Y(WZ)$ distributions defined respectively as the rapidity difference between the lepton from the $W$ boson decay and the $Z$ boson and the rapidity difference between the $W$ boson and the $Z$ boson. Significant suppression of events near zero is observed in both distributions. Unfolded $\Delta Y(\ell_W Z)$ and $\Delta Y(WZ)$ distributions are also measured and compared to theoretical predictions.


title: SPC-NeRF: Spatial Predictive Compression for Voxel Based Radiance Field

abstract: Representing the Neural Radiance Field (NeRF) with the explicit voxel grid (EVG) is a promising direction for improving NeRFs. However, the EVG representation is not efficient for storage and transmission because of the terrific memory cost. Current methods for compressing EVG mainly inherit the methods designed for neural network compression, such as pruning and quantization, which do not take full advantage of the spatial correlation of voxels. Inspired by prosperous digital image compression techniques, this paper proposes SPC-NeRF, a novel framework applying spatial predictive coding in EVG compression. The proposed framework can remove spatial redundancy efficiently for better compression performance.Moreover, we model the bitrate and design a novel form of the loss function, where we can jointly optimize compression ratio and distortion to achieve higher coding efficiency. Extensive experiments demonstrate that our method can achieve 32% bit saving compared to the state-of-the-art method VQRF on multiple representative test datasets, with comparable training time.


title: Unraveling Babel: Exploring Multilingual Activation Patterns of LLMs and Their Applications

abstract: Recently, large language models (LLMs) have achieved tremendous breakthroughs in the field of NLP, but still lack understanding of their internal activities when processing different languages. We designed a method to convert dense LLMs into fine-grained MoE architectures, and then visually studied the multilingual activation patterns of LLMs through expert activation frequency heatmaps. Through comprehensive experiments on different model families, different model sizes, and different variants, we analyzed the distribution of high-frequency activated experts, multilingual shared experts, whether the activation patterns of different languages are related to language families, and the impact of instruction tuning on activation patterns. We further explored leveraging the discovered differences in expert activation frequencies to guide unstructured pruning in two different ways. Experimental results demonstrated that our method significantly outperformed random expert pruning and even exceeded the performance of the original unpruned models in some languages. Additionally, we found that configuring different pruning rates for different layers based on activation level differences could achieve better results. Our findings reveal the multilingual processing mechanisms within LLMs and utilize these insights to offer new perspectives for applications such as model pruning.


title: SPINEPS -- Automatic Whole Spine Segmentation of T2-weighted MR images using a Two-Phase Approach to Multi-class Semantic and Instance Segmentation

abstract: Purpose. To present SPINEPS, an open-source deep learning approach for semantic and instance segmentation of 14 spinal structures (ten vertebra substructures, intervertebral discs, spinal cord, spinal canal, and sacrum) in whole body T2w MRI. Methods. During this HIPPA-compliant, retrospective study, we utilized the public SPIDER dataset (218 subjects, 63% female) and a subset of the German National Cohort (1423 subjects, mean age 53, 49% female) for training and evaluation. We combined CT and T2w segmentations to train models that segment 14 spinal structures in T2w sagittal scans both semantically and instance-wise. Performance evaluation metrics included Dice similarity coefficient, average symmetrical surface distance, panoptic quality, segmentation quality, and recognition quality. Statistical significance was assessed using the Wilcoxon signed-rank test. An in-house dataset was used to qualitatively evaluate out-of-distribution samples. Results. On the public dataset, our approach outperformed the baseline (instance-wise vertebra dice score 0.929 vs. 0.907, p-value<0.001). Training on auto-generated annotations and evaluating on manually corrected test data from the GNC yielded global dice scores of 0.900 for vertebrae, 0.960 for intervertebral discs, and 0.947 for the spinal canal. Incorporating the SPIDER dataset during training increased these scores to 0.920, 0.967, 0.958, respectively. Conclusions. The proposed segmentation approach offers robust segmentation of 14 spinal structures in T2w sagittal images, including the spinal cord, spinal canal, intervertebral discs, endplate, sacrum, and vertebrae. The approach yields both a semantic and instance mask as output, thus being easy to utilize. This marks the first publicly available algorithm for whole spine segmentation in sagittal T2w MR imaging.


title: Generative AI in Vision: A Survey on Models, Metrics and Applications

abstract: Generative AI models have revolutionized various fields by enabling the creation of realistic and diverse data samples. Among these models, diffusion models have emerged as a powerful approach for generating high-quality images, text, and audio. This survey paper provides a comprehensive overview of generative AI diffusion and legacy models, focusing on their underlying techniques, applications across different domains, and their challenges. We delve into the theoretical foundations of diffusion models, including concepts such as denoising diffusion probabilistic models (DDPM) and score-based generative modeling. Furthermore, we explore the diverse applications of these models in text-to-image, image inpainting, and image super-resolution, along with others, showcasing their potential in creative tasks and data augmentation. By synthesizing existing research and highlighting critical advancements in this field, this survey aims to provide researchers and practitioners with a comprehensive understanding of generative AI diffusion and legacy models and inspire future innovations in this exciting area of artificial intelligence.


title: DEYO: DETR with YOLO for End-to-End Object Detection

abstract: The training paradigm of DETRs is heavily contingent upon pre-training their backbone on the ImageNet dataset. However, the limited supervisory signals provided by the image classification task and one-to-one matching strategy result in an inadequately pre-trained neck for DETRs. Additionally, the instability of matching in the early stages of training engenders inconsistencies in the optimization objectives of DETRs. To address these issues, we have devised an innovative training methodology termed step-by-step training. Specifically, in the first stage of training, we employ a classic detector, pre-trained with a one-to-many matching strategy, to initialize the backbone and neck of the end-to-end detector. In the second stage of training, we froze the backbone and neck of the end-to-end detector, necessitating the training of the decoder from scratch. Through the application of step-by-step training, we have introduced the first real-time end-to-end object detection model that utilizes a purely convolutional structure encoder, DETR with YOLO (DEYO). Without reliance on any supplementary training data, DEYO surpasses all existing real-time object detectors in both speed and accuracy. Moreover, the comprehensive DEYO series can complete its second-phase training on the COCO dataset using a single 8GB RTX 4060 GPU, significantly reducing the training expenditure. Source code and pre-trained models are available at https://github.com/ouyanghaodong/DEYO.


title: Adaptive Online Learning of Separable Path Graph Transforms for Intra-prediction

abstract: Current video coding standards, including H.264/AVC, HEVC, and VVC, employ discrete cosine transform (DCT), discrete sine transform (DST), and secondary to Karhunen-Loeve transforms (KLTs) decorrelate the intra-prediction residuals. However, the efficiency of these transforms in decorrelation can be limited when the signal has a non-smooth and non-periodic structure, such as those occurring in textures with intricate patterns. This paper introduces a novel adaptive separable path graph-based transform (GBT) that can provide better decorrelation than the DCT for intra-predicted texture data. The proposed GBT is learned in an online scenario with sequential K-means clustering, which groups similar blocks during encoding and decoding to adaptively learn the GBT for the current block from previously reconstructed areas with similar characteristics. A signaling overhead is added to the bitstream of each coding block to indicate the usage of the proposed graph-based transform. We assess the performance of this method combined with H.264/AVC intra-coding tools and demonstrate that it can significantly outperform H.264/AVC DCT for intra-predicted texture data.


title: Performance Tradeoff Between Overhead and Achievable SNR in RIS Beam Training

abstract: Efficient beam training is the key challenge in the codebook-based configuration of reconfigurable intelligent surfaces (RISs) because the beam training overhead can have a strong impact on the achievable system performance. In this paper, we study the performance tradeoff between overhead and achievable signal-to-noise ratio (SNR) in RIS beam training while taking into account the size of the targeted coverage area, the RIS response time, and the delay for feedback transmissions. Thereby, we consider three common beam training strategies: full search (FS), hierarchical search (HS), and tracking-based search (TS). Our analysis shows that the codebook-based illumination of a given coverage area can be realized with wide- or narrow-beam designs, which result in two different scaling laws for the achievable SNR. Similarly, there are two regimes for the overhead, where the number of pilot symbols required for reliable beam training is dependent on and independent of the SNR, respectively. Based on these insights, we investigate the impact of the beam training overhead on the effective rate and provide an upper bound on the user velocity for which the overhead is negligible. Moreover, when the overhead is not negligible, we show that TS beam training achieves higher effective rates than HS and FS beam training, while HS beam training may or may not outperform FS beam training, depending on the RIS response time, feedback delay, and codebook size. Finally, we present numerical simulation results that verify our theoretical analysis. In particular, our results confirm the existence of the proposed regimes, reveal that fast RISs can lead to negligible overhead for FS beam training, and show that large feedback delays can significantly reduce the performance for HS beam training.


title: Testing The Weak Cosmic Censorship Conjecture in Short Haired Black Holes

abstract: The Weak Cosmic Censorship Conjecture is a hypothesis regarding the properties of event horizons and singularities during the formation of black holes, stating that singularities are always encompassed by the event horizons(TEH) of black holes, thus preventing naked singularities from affecting the causal structure of spacetime. In this paper, we explore the Weak Cosmic Censorship Conjecture in the context of rotating hairy black holes, aiming to understand the impact of hairiness on the conjecture for Kerr black holes. We investigate whether TEH of rotating hairy black holes can be disrupted by incoming test particles and scalar fields. When test particles and scalar fields incident on the rotating hairy black hole are found. In extreme cases, when considering a second order approximation, if the parameter $\kappa$ (The parameter here is a function related to hair strength $\kappa(Q_m^{2k})$.)falls within the range of $0<\kappa<\sqrt{1/3}$, TEH of a hairy black hole can be disrupted. Conversely, in the range of $\sqrt{1/3}<\kappa<1$, TEH of a hairy black hole cannot be disrupted. When considering the second order approximation in near extreme cases, the parameter $\kappa$, within the range of $0<\kappa<1$, can lead to the disruption of TEH in this spacetime. When an incident scalar field is present, in near extreme conditions, TEH of a rotating short hair black hole cannot be disrupted. Therefore, the value of the parameter $\kappa$ reveals the connection between rotating short hair black holes and the weak cosmic censorship conjecture, indicating that the presence of short hair significantly affects TEH of black holes. This will aid in further understanding the nature of rotating short hair black holes.


title: Graph Learning under Distribution Shifts: A Comprehensive Survey on Domain Adaptation, Out-of-distribution, and Continual Learning

abstract: Graph learning plays a pivotal role and has gained significant attention in various application scenarios, from social network analysis to recommendation systems, for its effectiveness in modeling complex data relations represented by graph structural data. In reality, the real-world graph data typically show dynamics over time, with changing node attributes and edge structure, leading to the severe graph data distribution shift issue. This issue is compounded by the diverse and complex nature of distribution shifts, which can significantly impact the performance of graph learning methods in degraded generalization and adaptation capabilities, posing a substantial challenge to their effectiveness. In this survey, we provide a comprehensive review and summary of the latest approaches, strategies, and insights that address distribution shifts within the context of graph learning. Concretely, according to the observability of distributions in the inference stage and the availability of sufficient supervision information in the training stage, we categorize existing graph learning methods into several essential scenarios, including graph domain adaptation learning, graph out-of-distribution learning, and graph continual learning. For each scenario, a detailed taxonomy is proposed, with specific descriptions and discussions of existing progress made in distribution-shifted graph learning. Additionally, we discuss the potential applications and future directions for graph learning under distribution shifts with a systematic analysis of the current state in this field. The survey is positioned to provide general guidance for the development of effective graph learning algorithms in handling graph distribution shifts, and to stimulate future research and advancements in this area.


title: Valuing insurance against small probability risks: A meta-analysis

abstract: The demand for voluntary insurance against low-probability, high-impact risks is lower than expected. To assess the magnitude of the demand, we conduct a meta-analysis of contingent valuation studies using a dataset of experimentally elicited and survey-based estimates. We find that the average stated willingness to pay (WTP) for insurance is 87% of expected losses. We perform a meta-regression analysis to examine the heterogeneity in aggregate WTP across these studies. The meta-regression reveals that information about loss probability and probability levels positively influence relative willingness to pay, whereas respondents' average income and age have a negative effect. Moreover, we identify cultural sub-factors, such as power distance and uncertainty avoidance, that provided additional explanations for differences in WTP across international samples. Methodological factors related to the sampling and data collection process significantly influence the stated WTP. Our results, robust to model specification and publication bias, are relevant to current debates on stated preferences for low-probability risks management.


title: A spectral dominance approach to large random matrices: part II

abstract: This paper is the second of a series devoted to the study of the dynamics of the spectrum of large random matrices. We study general extensions of the partial differential equation arising to characterize the limit spectral measure of the Dyson Brownian motion. We provide a regularizing result for those generalizations. We also show that several results of part I extend to cases in which there is no spectral dominance property. We then provide several modeling extensions of such models as well as several identities for the Dyson Brownian motion.


title: Approximation and perturbations of stable solutions to a stationary mean field game system

abstract: This work introduces a new general approach for the numerical analysis of stable equilibria to second order mean field games systems in cases where the uniqueness of solutions may fail. For the sake of simplicity, we focus on a simple stationary case. We propose an abstract framework to study these solutions by reformulating the mean field game system as an abstract equation in a Banach space. In this context, stable equilibria turn out to be regular solutions to this equation, meaning that the linearized system is well-posed. We provide three applications of this property: we study the sensitivity analysis of stable solutions, establish error estimates for their finite element approximations, and prove the local converge of Newton's method in infinite dimensions.


title: Accelerated basis-set convergence of coupled-cluster excitation energies using the density-based basis-set correction method

abstract: We present the first application to real molecular systems of the recently proposed linear-response theory for the density-based basis-set correction method [J. Chem. Phys. 158, 234107 (2023)]. We apply this approach to accelerate the basis-set convergence of excitation energies in the equation-of-motion coupled-cluster singles doubles (EOM-CCSD) method. We use an approximate linear-response framework which neglects the second-order derivative of the basis-set correction density functional and consists in simply adding to the usual Hamiltonian the one-electron potential generated by the first-order derivative of the functional. This additional basis-set correction potential is evaluated at the Hartree-Fock density, leading to a very computationally cheap basis-set correction. We tested this approach over a set of about 30 excitation energies computed for five small molecular systems and found that the excitation energies from the ground state to Rydberg states are the main source of basis-set error. These excitation energies systematically increase when the size of the basis set is increased, suggesting a biased description in favour of the excited state. Despite the simplicity of the present approach, the results obtained with the basis-set corrected EOM-CCSD method are encouraging as they yield to a mean absolute deviation of 0.02 eV for the aug-cc-pVTZ basis set, while it is of 0.04 eV using the standard EOM-CCSD method. This might open the path to an alternative to explicitly correlated approaches to accelerate the basis-set convergence of excitation energies.


title: TEaR: Improving LLM-based Machine Translation with Systematic Self-Refinement

abstract: Large Language Models (LLMs) have achieved impressive results in Machine Translation (MT). However, careful evaluations by human reveal that the translations produced by LLMs still contain multiple errors. Importantly, feeding back such error information into the LLMs can lead to self-refinement and result in improved translation performance. Motivated by these insights, we introduce a systematic LLM-based self-refinement translation framework, named \textbf{TEaR}, which stands for \textbf{T}ranslate, \textbf{E}stimate, \textbf{a}nd \textbf{R}efine, marking a significant step forward in this direction. Our findings demonstrate that 1) our self-refinement framework successfully assists LLMs in improving their translation quality across a wide range of languages, whether it's from high-resource languages to low-resource ones or whether it's English-centric or centered around other languages; 2) TEaR exhibits superior systematicity and interpretability; 3) different estimation strategies yield varied impacts, directly affecting the effectiveness of the final corrections. Additionally, traditional neural translation models and evaluation models operate separately, often focusing on singular tasks due to their limited capabilities, while general-purpose LLMs possess the capability to undertake both tasks simultaneously. We further conduct cross-model correction experiments to investigate the potential relationship between the translation and evaluation capabilities of general-purpose LLMs. Our code and data are available at https://github.com/fzp0424/self_correct_mt


title: An Automated End-to-End Open-Source Software for High-Quality Text-to-Speech Dataset Generation

abstract: Data availability is crucial for advancing artificial intelligence applications, including voice-based technologies. As content creation, particularly in social media, experiences increasing demand, translation and text-to-speech (TTS) technologies have become essential tools. Notably, the performance of these TTS technologies is highly dependent on the quality of the training data, emphasizing the mutual dependence of data availability and technological progress. This paper introduces an end-to-end tool to generate high-quality datasets for text-to-speech (TTS) models to address this critical need for high-quality data. The contributions of this work are manifold and include: the integration of language-specific phoneme distribution into sample selection, automation of the recording process, automated and human-in-the-loop quality assurance of recordings, and processing of recordings to meet specified formats. The proposed application aims to streamline the dataset creation process for TTS models through these features, thereby facilitating advancements in voice-based technologies.


title: Left-invariant Codazzi tensors and harmonic curvature on Lie groups endowed with a left invariant Lorentzian metric

abstract: A Lorentzian Lie group is a Lie group endowed with a left invariant Lorentzian metric. We study left-invariant Codazzi tensors on Lorentzian Lie groups. We obtain new results on left-invariant Lorentzian metrics with harmonic curvature and non-parallel Ricci operator. In contrast to the Riemannian case, the Ricci operator of a let-invariant Lorentzian metric can be of four types: diagonal, of type $\{n-2,z\bar{z}\}$, of type $\{n,a2\}$ and of type $\{n,a3\}$. We first describe Lorentzian Lie algebras with a non-diagonal Codazzi operator and with these descriptions in mind, we study three classes of Lorentzian Lie groups with harmonic curvature. Namely, we give a complete description of the Lie algebra of Lorentzian Lie groups having harmonic curvature and where the Ricci operator is non-diagonal and its diagonal part consists of one real eigenvalue $\alpha$.


title: Immunization against harmful fine-tuning attacks

abstract: Approaches to aligning large language models (LLMs) with human values has focused on correcting misalignment that emerges from pretraining. However, this focus overlooks another source of misalignment: bad actors might purposely fine-tune LLMs to achieve harmful goals. In this paper, we present an emerging threat model that has arisen from alignment circumvention and fine-tuning attacks. However, lacking in previous works is a clear presentation of the conditions for effective defence. We propose a set of conditions for effective defence against harmful fine-tuning in LLMs called "Immunization conditions," which help us understand how we would construct and measure future defences. Using this formal framework for defence, we offer a synthesis of different research directions that might be persued to prevent harmful fine-tuning attacks and provide a demonstration of how to use these conditions experimentally showing early results of using an adversarial loss to immunize LLama2-7b-chat.


title: Self Supervised Correlation-based Permutations for Multi-View Clustering

abstract: Fusing information from different modalities can enhance data analysis tasks, including clustering. However, existing multi-view clustering (MVC) solutions are limited to specific domains or rely on a suboptimal and computationally demanding two-stage procedure of representation and clustering. We propose an end-to-end deep learning-based MVC framework for general data (image, tabular, etc.). Our approach involves learning meaningful fused data representations with a novel permutation-based canonical correlation objective. Concurrently, we learn cluster assignments by identifying consistent pseudo-labels across multiple views. We demonstrate the effectiveness of our model using ten MVC benchmark datasets. Theoretically, we show that our model approximates the supervised linear discrimination analysis (LDA) representation. Additionally, we provide an error bound induced by false-pseudo label annotations.


title: Scalable Superconductor Neuron with Ternary Synaptic Connections for Ultra-Fast SNN Hardware

abstract: A novel high-fan-in differential superconductor neuron structure designed for ultra-high-performance Spiking Neural Network (SNN) accelerators is presented. Utilizing a high-fan-in neuron structure allows us to design SNN accelerators with more synaptic connections, enhancing the overall network capabilities. The proposed neuron design is based on superconductor electronics fabric, incorporating multiple superconducting loops, each with two Josephson Junctions. This arrangement enables each input data branch to have positive and negative inductive coupling, supporting excitatory and inhibitory synaptic data. Compatibility with synaptic devices and thresholding operation is achieved using a single flux quantum (SFQ) pulse-based logic style. The neuron design, along with ternary synaptic connections, forms the foundation for a superconductor-based SNN inference. To demonstrate the capabilities of our design, we train the SNN using snnTorch, augmenting the PyTorch framework. After pruning, the demonstrated SNN inference achieves an impressive 96.1% accuracy on MNIST images. Notably, the network exhibits a remarkable throughput of 8.92 GHz while consuming only 1.5 nJ per inference, including the energy consumption associated with cooling to 4K. These results underscore the potential of superconductor electronics in developing high-performance and ultra-energy-efficient neural network accelerator architectures.


title: Solution to the Proton Spin Puzzle

abstract: We show that description of the quark and gluon helicities in the Double-Logarithmic Approximation (DLA) solves the proton spin puzzle. First we explain how to solve this problem in the straightforward way by combining the RHIC data and expressions for the helicities calculated in DLA. These expressions are complicated to use, so we approximate the helicities by simpler DL expressions and obtain a tentative solution to the puzzle.


title: Nonlocal-to-local limit in linearized viscoelasticity

abstract: We study the quasistatic evolution of a linear peridynamic Kelvin-Voigt viscoelastic material. More specifically, we consider the gradient flow of a nonlocal elastic energy with respect to a nonlocal viscous dissipation. Following an evolutionary $\Gamma$-convergence approach, we prove that the solutions of the nonlocal problem converge to the solution of the local problem, when the peridynamic horizon tends to $0$, that is, in the nonlocal-to-local limit.