title: Semi-deterministic processes with applications in random billiards

abstract: We study the ergodic properties of two classes of random dynamical systems: a type of Markov chain which we call the \textit{alternating random walk} and a certain stochastic billiard system which describes the motion of a free-moving rough disk bouncing between two parallel rough walls. Our main results characterize the types of Markov transition kernels which make each system ergodic -- in the first case, with respect to uniform measure on the state space, and in the second case, with respect to Lambertian measure (a classic measure from geometric optics). In addition, building on results from \cite{rudzis2022}, we give explicit examples of rough microstructures which produce ergodic dynamics in the second system. Both systems have the property that the transition kernel governing the dynamics is singular with respect to uniform measure on the state space. As a result, these systems occupy a kind of mean in the problem space between diffusive processes, where establishing ergodicity is relatively easy, and physically realistic deterministic systems, where questions of ergodicity are far less approachable.


title: DREAM: Debugging and Repairing AutoML Pipelines

abstract: Deep Learning models have become an integrated component of modern software systems. In response to the challenge of model design, researchers proposed Automated Machine Learning (AutoML) systems, which automatically search for model architecture and hyperparameters for a given task. Like other software systems, existing AutoML systems suffer from bugs. We identify two common and severe bugs in AutoML, performance bug (i.e., searching for the desired model takes an unreasonably long time) and ineffective search bug (i.e., AutoML systems are not able to find an accurate enough model). After analyzing the workflow of AutoML, we observe that existing AutoML systems overlook potential opportunities in search space, search method, and search feedback, which results in performance and ineffective search bugs. Based on our analysis, we design and implement DREAM, an automatic debugging and repairing system for AutoML systems. It monitors the process of AutoML to collect detailed feedback and automatically repairs bugs by expanding search space and leveraging a feedback-driven search strategy. Our evaluation results show that DREAM can effectively and efficiently repair AutoML bugs.


title: A Modified Late Arrival Penalised User Equilibrium Model and Robustness in Data Perturbation

abstract: In this paper, we revisit the LAPUE model with a different focus: we begin by adopting a new penalty function which gives a smooth transition of the boundary between lateness and no lateness and demonstrate the LAPUE model based on the new penalty function has a unique equilibrium and is stable with respect to (w.r.t.) small perturbation of probability distribution under moderate conditions. We then move on to discuss statistical robustness of the modified LAPUE (MLAPUE) model by considering the case that the data to be used for fitting the density function may be perturbed in practice or there is a discrepancy between the probability distribution of the underlying uncertainty constructed with empirical data and the true probability distribution in future, we investigate how the data perturbation may affect the equilibrium. We undertake the analysis from two perspectives: (a) a few data are perturbed by outliers and (b) all data are potentially perturbed. In case (a), we use the well-known influence function to quantify the sensitivity of the equilibrium by the outliers and in case (b) we examine the difference between empirical distributions of the equilibrium based on perturbed data and the equilibrium based on unperturbed data. To examine the performance of the MLAPUE model and our theoretical analysis of statistical robustness, we carry out some numerical experiments, the preliminary results confirm the statistical robustness as desired.


title: Modeling of Memory Mechanisms in Cerebral Cortex and Simulation of Storage Performance

abstract: At the intersection of computation and cognitive science, graph theory is utilized as a formalized description of complex relationships and structures. Traditional graph models are often static, lacking dynamic and autonomous behavioral patterns. They rely on algorithms with a global view, significantly differing from biological neural networks, in which, to simulate information storage and retrieval processes, the limitations of centralized algorithms must be overcome. This study introduces a directed graph model that equips each node with adaptive learning and decision-making capabilities, thereby facilitating decentralized dynamic information storage and modeling and simulation of the brain's memory process. We abstract different storage instances as directed graph paths, transforming the storage of information into the assignment, discrimination, and extraction of different paths. To address writing and reading challenges, each node has a personalized adaptive learning ability. A storage algorithm without a God's eye view is developed, where each node uses its limited neighborhood information to facilitate the extension, formation, solidification, and awakening of directed graph paths, achieving competitive, reciprocal, and sustainable utilization of limited resources. Storage behavior occurs in each node, with adaptive learning behaviors of nodes concretized in a microcircuit centered around a variable resistor, simulating the electrophysiological behavior of neurons. Under the constraints of neurobiology on the anatomy and electrophysiology of biological neural networks, this model offers a plausible explanation for the mechanism of memory realization, providing a comprehensive, system-level experimental validation of the memory trace theory.


title: Infinite Lineability: On the Abundance of Dense Subspaces

abstract: In this paper, we investigate the concept of infinite dense-lineability recently introduced by M. Calder\'on-Moreno, P. Gerlach-Mena and J. Prado-Bassas. We answer a question posed by the authors about the equivalence between infinite (pointwise) dense-lineability and (pointwise) dense-lineability. We prove that the equivalence always holds in first-countable topological vector spaces and under some assumptions about the weight of the topology. However, the equivalence is not always true, as shown in an example. Furthermore, we introduce the notions of infinite $(\alpha,\beta)$-dense-lineability and infinite (strongly) dense-algebrability and obtain some analogous results in these cases. We also obtain a criterion for strongly dense-algebrability for sets of the form $X\setminus Y$, where $X$ is a free algebra and $Y$ is a free subalgebra of $X$.


title: Predicting Evoked Emotions in Conversations

abstract: Understanding and predicting the emotional trajectory in multi-party multi-turn conversations is of great significance. Such information can be used, for example, to generate empathetic response in human-machine interaction or to inform models of pre-emptive toxicity detection. In this work, we introduce the novel problem of Predicting Emotions in Conversations (PEC) for the next turn (n+1), given combinations of textual and/or emotion input up to turn n. We systematically approach the problem by modeling three dimensions inherently connected to evoked emotions in dialogues, including (i) sequence modeling, (ii) self-dependency modeling, and (iii) recency modeling. These modeling dimensions are then incorporated into two deep neural network architectures, a sequence model and a graph convolutional network model. The former is designed to capture the sequence of utterances in a dialogue, while the latter captures the sequence of utterances and the network formation of multi-party dialogues. We perform a comprehensive empirical evaluation of the various proposed models for addressing the PEC problem. The results indicate (i) the importance of the self-dependency and recency model dimensions for the prediction task, (ii) the quality of simpler sequence models in short dialogues, (iii) the importance of the graph neural models in improving the predictions in long dialogues.


title: Speed Limit of Efficient Cavity-Mediated Adiabatic Transfer

abstract: Cavity-mediated adiabatic transfer (CMAT) is a robust way to perform a two-qubit gate between trapped atoms inside an optical cavity. In the previous study by Goto and Ichimura [H. Goto and K. Ichimura, Phys. Rev. A 77, 013816 (2008).], the upper bound of success probability of CMAT was shown where the operation is adiabatically slow. For practical applications, however, it is crucial to operate CMAT as fast as possible without sacrificing the success probability. In this paper, we investigate the operational speed limit of CMAT conditioned on the success probability being close to the upper bound. In CMAT both the adiabatic condition and the decay of atoms and cavity modes limit the operational speed. We show which of these two conditions more severely limits the operational speed in each cavity-QED parameter region, and find that the maximal operational speed is achieved when the influence of cavity decay is dominant compared to spontaneous emission.


title: Order-one strong convergence of numerical methods for SDEs without globally monotone coefficients

abstract: To obtain strong convergence rates of numerical schemes, an overwhelming majority of existing works impose a global monotonicity condition on coefficients of SDEs. On the contrary, a majority of SDEs from applications do not have globally monotone coefficients. As a recent breakthrough, the authors of [Hutzenthaler, Jentzen, Ann. Probab., 2020] originally presented a perturbation theory for stochastic differential equations (SDEs), which is crucial to recovering strong convergence rates of numerical schemes in a non-globally monotone setting. However, only a convergence rate of order $1/2$ was obtained there for time-stepping schemes such as a stopped increment-tamed Euler-Maruyama (SITEM) method. As an open problem, a natural question was raised by the aforementioned work as to whether higher convergence rate than $1/2$ can be obtained when higher order schemes are used. The present work attempts to solve the tough problem. To this end, we develop some new perturbation estimates that are able to reveal the order-one strong convergence of numerical methods. As the first application of the newly developed estimates, we identify the expected order-one pathwise uniformly strong convergence of the SITEM method for additive noise driven SDEs and multiplicative noise driven second order SDEs with non-globally monotone coefficients. As the other application, we propose and analyze a positivity preserving explicit Milstein-type method for Lotka-Volterra competition model driven by multi-dimensional noise, with a pathwise uniformly strong convergence rate of order one recovered under mild assumptions. These obtained results are completely new and significantly improve the existing theory. Numerical experiments are also provided to confirm the theoretical findings.


title: On the Constructor-Blocker Game

abstract: In the Constructor-Blocker game, two players, Constructor and Blocker, alternatively claim unclaimed edges of the complete graph $K_n$. For given graphs $F$ and $H$, Constructor can only claim edges that leave her graph $F$-free, while Blocker has no restrictions. Constructor's goal is to build as many copies of $H$ as she can, while Blocker attempts to stop this. The game ends once there are no more edges that Constructor can claim. The score $g(n,H,F)$ of the game is the number of copies of $H$ in Constructor's graph at the end of the game, when both players play optimally and Constructor plays first. In this paper, we extend results of Patk\'os, Stojakovi\'c and Vizer on $g(n, H, F)$ to many pairs of $H$ and $F$: We determine $g(n, H, F)$ when $H=K_r$ and $\chi(F)>r$, also when both $H$ and $F$ are odd cycles, using Szemer\'edi's Regularity Lemma. We also obtain bounds of $g(n, H, F)$ when $H=K_3$ and $F=K_{2,2}$.


title: Gas-phase molecules in protoplanetary nebulae with the 21 {\mu}m emission feature

abstract: It has been more than 30 years since the enigmatic 21 {\mu}m emission feature was first discovered in protoplanetary nebulae (PPNs). Although dozens of different dust carrier candidates have been proposed, there is as yet no widely accepted one. We present the results of molecular observations toward 21{\mu}m objects using the 10m Submillimeter Telescope of Arizona Radio Observatory at the 1.3 mm band and the 13.7 m telescope of Purple Mountain Observatory at the 3mm band, aiming to investigate whether the gas-phase environments of these unusual sources have some peculiarities compared to normal PPNs. We detect 31 emission lines belonging to seven different molecular species, most of which are the first detection in 21 {\mu}m PPNs. The observations provide clues on the identification of the 21 {\mu}m feature. We report a correlation study between the fractional abundance of gas-phase molecules and the strengths of the 21 {\mu}m emission. Our study shows that given the small sample size, the 21 {\mu}m feature has weak or no correlations with the gas-phase molecules. Future radio observations of high spatial and spectral resolution toward a large sample are desirable to elucidate the 21 {\mu}m emission phenomena.


title: FusionMind -- Improving question and answering with external context fusion

abstract: Answering questions using pre-trained language models (LMs) and knowledge graphs (KGs) presents challenges in identifying relevant knowledge and performing joint reasoning.We compared LMs (fine-tuned for the task) with the previously published QAGNN method for the Question-answering (QA) objective and further measured the impact of additional factual context on the QAGNN performance. The QAGNN method employs LMs to encode QA context and estimate KG node importance, and effectively update the question choice entity representations using Graph Neural Networks (GNNs). We further experimented with enhancing the QA context encoding by incorporating relevant knowledge facts for the question stem. The models are trained on the OpenbookQA dataset, which contains ~6000 4-way multiple choice questions and is widely used as a benchmark for QA tasks. Through our experimentation, we found that incorporating knowledge facts context led to a significant improvement in performance. In contrast, the addition of knowledge graphs to language models resulted in only a modest increase. This suggests that the integration of contextual knowledge facts may be more impactful for enhancing question answering performance compared to solely adding knowledge graphs.


title: Magnetic Anisotropy of Quantum Critical Fluctuation in YBa$_2$Cu$_3$O$_7$ at High Magnetic Fields of up to 100 T

abstract: The investigation of high-temperature superconductors under high magnetic fields is one of the most important topics in condensed matter physics. For YBa$_2$Cu$_3$O$_7$ (YBCO), the measurements of magnetoresistance under a high magnetic field are technically challenging because the required magnetic field ($B$) is 100 T class. The low temperature (from 52 to 150 K) magnetoresistance is measured in optimally-doped YBCO thin films under the condition $B$$\parallel$CuO$_2$-plane up to 103 T by employing the single-turn coil technique and a radio frequency reflection method. The electrical resistivity $\rho$ exhibits $B$-linear behavior in the normal phase in the high magnetic field region. The field slope coefficient $\beta$ (=$d\rho/dB$) becomes converged at low temperatures. The convergency of $\beta$ below $T_c$ indicates the field-induced strange metal phase, which is determined by the quantum critical fluctuation at high magnetic fields. The $\beta$ value difference under the different directions of the magnetic field suggests the strong anisotropy in quantum critical fluctuations in the strange metal phase of YBCO.


title: Horizontal Federated Computer Vision

abstract: In the modern world, the amount of visual data recorded has been rapidly increasing. In many cases, data is stored in geographically distinct locations and thus requires a large amount of time and space to consolidate. Sometimes, there are also regulations for privacy protection which prevent data consolidation. In this work, we present federated implementations for object detection and recognition using a federated Faster R-CNN (FRCNN) and image segmentation using a federated Fully Convolutional Network (FCN). Our FRCNN was trained on 5000 examples of the COCO2017 dataset while our FCN was trained on the entire train set of the CamVid dataset. The proposed federated models address the challenges posed by the increasing volume and decentralized nature of visual data, offering efficient solutions in compliance with privacy regulations.


title: SAFE-SIM: Safety-Critical Closed-Loop Traffic Simulation with Controllable Adversaries

abstract: Evaluating the performance of autonomous vehicle planning algorithms necessitates simulating long-tail safety-critical traffic scenarios. However, traditional methods for generating such scenarios often fall short in terms of controllability and realism and neglect the dynamics of agent interactions. To mitigate these limitations, we introduce SAFE-SIM, a novel diffusion-based controllable closed-loop safety-critical simulation framework. Our approach yields two distinct advantages: 1) the generation of realistic long-tail safety-critical scenarios that closely emulate real-world conditions, and 2) enhanced controllability, enabling more comprehensive and interactive evaluations. We develop a novel approach to simulate safety-critical scenarios through an adversarial term in the denoising process, which allows an adversarial agent to challenge a planner with plausible maneuvers while all agents in the scene exhibit reactive and realistic behaviors. Furthermore, we propose novel guidance objectives and a partial diffusion process that enables a user to control key aspects of the generated scenarios, such as the collision type and aggressiveness of the adversarial driver, while maintaining the realism of the behavior. We validate our framework empirically using the NuScenes dataset, demonstrating improvements in both realism and controllability. These findings affirm that diffusion models provide a robust and versatile foundation for safety-critical, interactive traffic simulation, extending their utility across the broader landscape of autonomous driving. For supplementary videos, visit our project at https://safe-sim.github.io/.


title: R(3,10) <= 41

abstract: We improve the upper bound on the Ramsey number R(3,10) from 42 to 41. Hence R(3,10) is equal to 40 or 41.


title: Generative Model-Driven Synthetic Training Image Generation: An Approach to Cognition in Rail Defect Detection

abstract: Recent advancements in cognitive computing, with the integration of deep learning techniques, have facilitated the development of intelligent cognitive systems (ICS). This is particularly beneficial in the context of rail defect detection, where the ICS would emulate human-like analysis of image data for defect patterns. Despite the success of Convolutional Neural Networks (CNN) in visual defect classification, the scarcity of large datasets for rail defect detection remains a challenge due to infrequent accident events that would result in defective parts and images. Contemporary researchers have addressed this data scarcity challenge by exploring rule-based and generative data augmentation models. Among these, Variational Autoencoder (VAE) models can generate realistic data without extensive baseline datasets for noise modeling. This study proposes a VAE-based synthetic image generation technique for rail defects, incorporating weight decay regularization and image reconstruction loss to prevent overfitting. The proposed method is applied to create a synthetic dataset for the Canadian Pacific Railway (CPR) with just 50 real samples across five classes. Remarkably, 500 synthetic samples are generated with a minimal reconstruction loss of 0.021. A Visual Transformer (ViT) model underwent fine-tuning using this synthetic CPR dataset, achieving high accuracy rates (98%-99%) in classifying the five defect classes. This research offers a promising solution to the data scarcity challenge in rail defect detection, showcasing the potential for robust ICS development in this domain.


title: Dynamics for the corotational energy-critical wave map equation with quantized blow-up rates

abstract: We consider the wave maps from $\mathbb{R}^{1+2}$ into $\mathbb{S}^2\subset \mathbb{R}^3.$ Under an additional assumption of $k$-corotational symmetry, the problem reduces to the one dimensional semilinear wave equation: \begin{equation*} \partial_t^2 u-\partial_r^2 u-\frac{\partial_r u}{r}+k^2 \frac{\sin(2u)}{2r^2}=0. \end{equation*} Given any integer $k\ge 1$ and any integer $m\ge 2k,$ we exhibit a set of initial data $(u_0,u_1)$ with energy arbitrarily close to that of the ground state solution $Q$, such that the corresponding solution $u$ blows up in finite time by concentrating its energy. To be precise, the solution $u$ satisfies \begin{equation*} \lim\limits_{t\rightarrow T} \left\|\left(u(t,r)-Q\left(\frac{r}{\lambda(t)}\right)-u_1^*(r), \partial_t u-u_2^*(r)\right)\right\|_{H\times L^2}=0 \end{equation*} with a quantized speed \begin{equation*} \lambda(t)=c(u_0,u_1)(1+o_{t\to T}(1))\frac{(T-t)^{\frac{m}{k}}}{|\log(T-t)|^{\frac{m}{k(m-k)}}}, \end{equation*} where $\|u\|_{H}:=\int_{\mathbb{R}^2}\left(|\partial_r u|^2+\frac{|u|^2}{r^2}\right).$


title: Energetic Variational Gaussian Process Regression for Computer Experiments

abstract: The Gaussian process (GP) regression model is a widely employed surrogate modeling technique for computer experiments, offering precise predictions and statistical inference for the computer simulators that generate experimental data. Estimation and inference for GP can be performed in both frequentist and Bayesian frameworks. In this chapter, we construct the GP model through variational inference, particularly employing the recently introduced energetic variational inference method by Wang et al. (2021). Adhering to the GP model assumptions, we derive posterior distributions for its parameters. The energetic variational inference approach bridges the Bayesian sampling and optimization and enables approximation of the posterior distributions and identification of the posterior mode. By incorporating a normal prior on the mean component of the GP model, we also apply shrinkage estimation to the parameters, facilitating mean function variable selection. To showcase the effectiveness of our proposed GP model, we present results from three benchmark examples.


title: RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Models

abstract: Retrieval-augmented generation (RAG) has become a main technique for alleviating hallucinations in large language models (LLMs). Despite the integration of RAG, LLMs may still present unsupported or contradictory claims to the retrieved contents. In order to develop effective hallucination prevention strategies under RAG, it is important to create benchmark datasets that can measure the extent of hallucination. This paper presents RAGTruth, a corpus tailored for analyzing word-level hallucinations in various domains and tasks within the standard RAG frameworks for LLM applications. RAGTruth comprises nearly 18,000 naturally generated responses from diverse LLMs using RAG. These responses have undergone meticulous manual annotations at both the individual cases and word levels, incorporating evaluations of hallucination intensity. We not only benchmark hallucination frequencies across different LLMs, but also critically assess the effectiveness of several existing hallucination detection methodologies. Furthermore, we show that using a high-quality dataset such as RAGTruth, it is possible to finetune a relatively small LLM and achieve a competitive level of performance in hallucination detection when compared to the existing prompt-based approaches using state-of-the-art large language models such as GPT-4.


title: Degenerate preconditioned backward-backward splitting for inclusion problem

abstract: In this work, we introduce the notion of warped Yosida regularization and study the asymptotic behavior of the orbit of dynamical systems generated by warped Yosida regularization, which includes Douglas-Rachford dynamical system. We analyze an algorithm where the inclusion problem is first approximated by a regularized one and then the preconditioned regularization parameter is reduced to converge to a solution of the original problem. We propose and investigate backward-backward splitting using degenerate preconditioning for monotone inclusion problems. The applications provide a tool for finding a minima of a preconditioned regularization of the sum of two convex functions.


title: Interpolation on Convex-set Valued Lebesgue Spaces and its Applications

abstract: In this paper, we obtain two interpolation theorems on convex-set valued Lebesgue spaces, which generalize the Marcinkiewicz interpolation theorem and Riesz-Thorin interpolation theorem on classical Lebesgue spaces, respectively. As applications, we obtain the boundedness of convex-set valued fractional averaging operators and fractional maximal operators, and prove the reverse factorization property of matrix weights.


title: Multiwavelength observation of an active M-dwarf star EV Lac and its stellar flare accompanied by a delayed prominence eruption

abstract: We conducted 4-night multiwavelength observations of an active M-dwarf star EV Lac on 2022 October 24$-$27 with simultaneous coverage of soft X-rays (NICER; 0.2$-$12 $\mathrm{keV}$, Swift XRT; 0.2$-$10 $\mathrm{keV}$), near-ultraviolet (Swift UVOT/UVW2; 1600$-$3500 \r{A}), optical photometry (TESS; 6000$-$10000 \r{A}), and optical spectroscopy (Nayuta/MALLS; 6350$-$6800 \r{A}). During the campaign, we detected a flare starting at 12:28 UTC on October 25 with its white-light bolometric energy of $3.4 \times 10^{32}$ erg. At about 1 hour after this flare peak, our $\mathrm{H\alpha}$ spectrum showed a blue-shifted excess component at its corresponding velocity of $\sim 100 \: \mathrm{km \: s^{-1}}$. This may indicate that the prominence erupted with a 1-hour delay of the flare peak. Furthermore, the simultaneous 20-second cadence near-ultraviolet and white-light curves show gradual and rapid brightening behaviors during the rising phase at this flare. The ratio of flux in NUV to white light at the gradual brightening was $\sim 0.49$, which may suggest that the temperature of the blackbody is low ($< 9000 \: \mathrm{K}$) or the maximum energy flux of a nonthermal electron beam is less than $5\times10^{11} \: \mathrm{erg \: cm^{-2} \: s^{-1}}$. Our simultaneous observations of NUV and white-light flare raise the issue of a simple estimation of UV flux from optical continuum data by using a blackbody model.


title: Critical point in heavy-quark region of QCD on fine lattices

abstract: We perform a finite-size scaling analysis of the critical point in the heavy-quark region of QCD at nonzero temperature. Our previous analysis on the Binder cumulant at $N_t=4$ is extended to finer lattices with $N_t=6$ and $8$. The aspect ratio is also extended up to $15$ to suppress the non-singular contribution. High-precision analysis of the Binder cumulant is realized by an efficient Monte-Carlo simulation with the hopping-parameter expansion (HPE). Effects of higher-order terms in the HPE are incorporated by the reweighting method.


title: Multiplayer Battle Game-Inspired Optimizer for Complex Optimization Problems

abstract: Various popular multiplayer battle royale games share a lot of common elements. Drawing from our observations, we summarized these shared characteristics and subsequently proposed a novel heuristic algorithm named multiplayer battle game-inspired optimizer (MBGO). The proposed MBGO streamlines mainstream multiplayer battle royale games into two discrete phases: movement and battle. Specifically, the movement phase incorporates the principles of commonly encountered ``safe zones'' to incentivize participants to relocate to areas with a higher survival potential. The battle phase simulates a range of strategies adopted by players in various situations to enhance the diversity of the population. To evaluate and analyze the performance of the proposed MBGO, we executed it alongside eight other algorithms, including three classics and five latest ones, across multiple diverse dimensions within the CEC2017 and CEC2020 benchmark functions. In addition, we employed several industrial design problems to evaluate the scalability and practicality of the proposed MBGO. The results of the statistical analysis reveal that the novel MBGO demonstrates significant competitiveness, excelling not only in convergence speed, but also in achieving high levels of convergence accuracy across both benchmark functions and real-world problems.


title: 3D Multi-system Bayesian Calibration with Energy Conservation to Study Rapidity-dependent Dynamics of Nuclear Collisions

abstract: Considerable information about the early-stage dynamics of heavy-ion collisions is encoded in the rapidity dependence of measurements. To leverage the large amount of experimental data, we perform a systematic analysis using three-dimensional hydrodynamic simulations of multiple collision systems -- large and small, symmetric and asymmetric. Specifically, we perform fully 3D multi-stage hydrodynamic simulations initialized by a parameterized model for rapidity-dependent energy deposition, which we calibrate on the hadron multiplicity and anisotropic flow coefficients. We utilize Bayesian inference to constrain properties of the early- and late- time dynamics of the system, and highlight the impact of enforcing global energy conservation in our 3D model.


title: Client-wise Modality Selection for Balanced Multi-modal Federated Learning

abstract: Selecting proper clients to participate in the iterative federated learning (FL) rounds is critical to effectively harness a broad range of distributed datasets. Existing client selection methods simply consider the variability among FL clients with uni-modal data, however, have yet to consider clients with multi-modalities. We reveal that traditional client selection scheme in MFL may suffer from a severe modality-level bias, which impedes the collaborative exploitation of multi-modal data, leading to insufficient local data exploration and global aggregation. To tackle this challenge, we propose a Client-wise Modality Selection scheme for MFL (CMSFed) that can comprehensively utilize information from each modality via avoiding such client selection bias caused by modality imbalance. Specifically, in each MFL round, the local data from different modalities are selectively employed to participate in local training and aggregation to mitigate potential modality imbalance of the global model. To approximate the fully aggregated model update in a balanced way, we introduce a novel local training loss function to enhance the weak modality and align the divergent feature spaces caused by inconsistent modality adoption strategies for different clients simultaneously. Then, a modality-level gradient decoupling method is designed to derive respective submodular functions to maintain the gradient diversity during the selection progress and balance MFL according to local modality imbalance in each iteration. Our extensive experiments showcase the superiority of CMSFed over baselines and its effectiveness in multi-modal data exploitation.


title: Explicit Generators for the Stabilizers of Rational Points in Thompson's Group $F$

abstract: We construct explicit finite generating sets for the stabilizers in Thompson's group $F$ of rational points of a unit interval or a Cantor set. Our technique is based on the Reidemeister-Schreier procedure in the context of Schreier graphs of such stabilizers in $F$. It is well known that the stabilizers of dyadic rational points are isomorphic to $F\times F$ and can thus be generated by 4 explicit elements. We show that the stabilizer of every non-dyadic rational point $b\in (0,1)$ is generated by 5 elements that are explicitly calculated as words in generators $x_0, x_1$ of $F$ that depend on the binary expansion of $b$. We also provide an alternative simple proof that the stabilizers of all rational points are finitely presented.


title: Generalizing Single-View 3D Shape Retrieval to Occlusions and Unseen Objects

abstract: Single-view 3D shape retrieval is a challenging task that is increasingly important with the growth of available 3D data. Prior work that has studied this task has not focused on evaluating how realistic occlusions impact performance, and how shape retrieval methods generalize to scenarios where either the target 3D shape database contains unseen shapes, or the input image contains unseen objects. In this paper, we systematically evaluate single-view 3D shape retrieval along three different axes: the presence of object occlusions and truncations, generalization to unseen 3D shape data, and generalization to unseen objects in the input images. We standardize two existing datasets of real images and propose a dataset generation pipeline to produce a synthetic dataset of scenes with multiple objects exhibiting realistic occlusions. Our experiments show that training on occlusion-free data as was commonly done in prior work leads to significant performance degradation for inputs with occlusion. We find that that by first pretraining on our synthetic dataset with occlusions and then finetuning on real data, we can significantly outperform models from prior work and demonstrate robustness to both unseen 3D shapes and unseen objects.


title: Low-cost Geometry-based Eye Gaze Detection using Facial Landmarks Generated through Deep Learning

abstract: Introduction: In the realm of human-computer interaction and behavioral research, accurate real-time gaze estimation is critical. Traditional methods often rely on expensive equipment or large datasets, which are impractical in many scenarios. This paper introduces a novel, geometry-based approach to address these challenges, utilizing consumer-grade hardware for broader applicability. Methods: We leverage novel face landmark detection neural networks capable of fast inference on consumer-grade chips to generate accurate and stable 3D landmarks of the face and iris. From these, we derive a small set of geometry-based descriptors, forming an 8-dimensional manifold representing the eye and head movements. These descriptors are then used to formulate linear equations for predicting eye-gaze direction. Results: Our approach demonstrates the ability to predict gaze with an angular error of less than 1.9 degrees, rivaling state-of-the-art systems while operating in real-time and requiring negligible computational resources. Conclusion: The developed method marks a significant step forward in gaze estimation technology, offering a highly accurate, efficient, and accessible alternative to traditional systems. It opens up new possibilities for real-time applications in diverse fields, from gaming to psychological research.


title: CMB lensing from early-formed dark matter halos

abstract: Some theoretical models for the early Universe predict a spike-type enhancement in the primordial power spectrum on a small scale, which would result in forming early-formed dark matter halos~(EFHs). Some recent studies have claimed to have placed limits on such small scales, which, however, involve uncertainties, such as the physics of substructures and the halo-galaxy relations. In this work, we study the cosmic microwave background~(CMB) lensing effect, considering the existence of EFHs, and investigate the potential to probe the EFHs and the primordial perturbations on scales smaller than $1\mathrm{Mpc}$, complementing these previous studies. We numerically calculate the angular power spectrum of the lensing potential and the lensed CMB anisotropy of temperature, E-mode, and B-mode polarization, including the nonlinear effects of EFHs. We find the possibility that the lensed CMB temperature anisotropy is significantly enhanced on small scales, $\ell>1000$, and could be tested by component decomposition of observed signals through multifrequency observations. Through the calculation with different models of the spiky-type power spectrum, we demonstrate that the accurate measurements of the CMB lensing effect would provide insight into the abundance of EFHs within the limited mass range around $10^{11}~M_\odot$ and the primordial power spectrum on the limited scales around $k\sim 1\mathrm{Mpc}^{-1}$. In particular, we find that the existence of such EFHs can amplify the lensed anisotropy of CMB B-mode polarization even on large scales, $\ell <100$, as the overall enhancement by $\sim 5 \%$ level compared to the standard structure formation model without EFHs. Therefore, future CMB measurements, such as the LiteBIRD satellite, can probe the existence of the EFHs and the spike-type primordial power spectrum through the precise measurement of the large-scale CMB B-mode polarization.


title: Computing greatest common divisor of several parametric univariate polynomials via generalized subresultant polynomials

abstract: In this paper, we tackle the following problem: compute the gcd for several univariate polynomials with parametric coefficients. It amounts to partitioning the parameter space into ``cells'' so that the gcd has a uniform expression over each cell and constructing a uniform expression of gcd in each cell. We tackle the problem as follows. We begin by making a natural and obvious extension of subresultant polynomials of two polynomials to several polynomials. Then we develop the following structural theories about them. 1. We generalize Sylvester's theory to several polynomials, in order to obtain an elegant relationship between generalized subresultant polynomials and the gcd of several polynomials, yielding an elegant algorithm. 2. We generalize Habicht's theory to several polynomials, in order to obtain a systematic relationship between generalized subresultant polynomials and pseudo-remainders, yielding an efficient algorithm. Using the generalized theories, we present a simple (structurally elegant) algorithm which is significantly more efficient (both in the output size and computing time) than algorithms based on previous approaches.


title: A Two-stream Hybrid CNN-Transformer Network for Skeleton-based Human Interaction Recognition

abstract: Human Interaction Recognition is the process of identifying interactive actions between multiple participants in a specific situation. The aim is to recognise the action interactions between multiple entities and their meaning. Many single Convolutional Neural Network has issues, such as the inability to capture global instance interaction features or difficulty in training, leading to ambiguity in action semantics. In addition, the computational complexity of the Transformer cannot be ignored, and its ability to capture local information and motion features in the image is poor. In this work, we propose a Two-stream Hybrid CNN-Transformer Network (THCT-Net), which exploits the local specificity of CNN and models global dependencies through the Transformer. CNN and Transformer simultaneously model the entity, time and space relationships between interactive entities respectively. Specifically, Transformer-based stream integrates 3D convolutions with multi-head self-attention to learn inter-token correlations; We propose a new multi-branch CNN framework for CNN-based streams that automatically learns joint spatio-temporal features from skeleton sequences. The convolutional layer independently learns the local features of each joint neighborhood and aggregates the features of all joints. And the raw skeleton coordinates as well as their temporal difference are integrated with a dual-branch paradigm to fuse the motion features of the skeleton. Besides, a residual structure is added to speed up training convergence. Finally, the recognition results of the two branches are fused using parallel splicing. Experimental results on diverse and challenging datasets, demonstrate that the proposed method can better comprehend and infer the meaning and context of various actions, outperforming state-of-the-art methods.


title: Electrical and thermal transport properties of kagome metals AV$_3$Sb$_5$ (A=K, Rb, Cs)

abstract: The interplay between lattice geometry, band topology and electronic correlations in the newly discovered kagome compounds AV$_3$Sb$_5$ (A=K, Rb, Cs) makes this family a novel playground to investigate emergent quantum phenomena, such as unconventional superconductivity, chiral charge density wave and electronic nematicity. These exotic quantum phases naturally leave nontrivial fingerprints in transport properties of AV$_3$Sb$_5$, both in electrical and thermal channels, which are prominent probes to uncover the underlying mechanisms. In this brief review, we highlight the unusual electrical and thermal transport properties observed in the unconventional charge ordered state of AV3Sb5, including giant anomalous Hall, anomalous Nernst, ambipolar Nernst and anomalous thermal Hall effects. Connections of these anomalous transport properties to time-reversal symmetry breaking, topological and multiband fermiology, as well as electronic nematicity, are also discussed. Finally, a perspective together with challenges of this rapid growing field are given.


title: Study the structure of X(3872) from its lineshape

abstract: We fit the invariant mass distribution of ${X(3872)}\rightarrow{J}/{\psi}\pi^+\pi^-$ from LHCb and ${X(3872)}\rightarrow{D}^{0}\overline{D}^{0*}$ from Belle using the propagator for S-wave threshold states in effective field theory. In this way, we can directly determine the $Z$ which is the probability of finding the compact component in ${X(3872)}$.


title: Toward the theoretically observable limit of electron density distribution by single-crystal synchrotron X-ray diffraction: The case of orbitally ordered Ti-3d^1 in YTiO_3

abstract: The theoretically observable limit of electron density distribution by single-crystal X-ray diffraction is discussed. When F_{orb} and {\delta}F are defined as, respectively, the partial structure factor for an orbital and the deviation of the observed F from the true F, the accuracy of the experimentally observed electron density distribution is chiefly determined by the number of reflections satisfying the condition F_{orb}/F > {\delta}F/F. Since F_{orb}/F, which is generally small for crystals with large F(0,0,0), is constant under a given set of experimental conditions, {\delta}F/F reduction is a unique approach to increasing the number of reflections satisfying F_{orb}/F > {\delta}F/F. The present paper demonstrates how to reduce {\delta}F mathematically and experimentally, and the following topics are covered: the Poisson statistics, accumulation of errors in the total measurement system, multiple diffraction, conversion error from F^2 to F in refinements on quantities in F^2-space, weighting of reflections, and tips. For demonstration, observation of the electron density of the Ti-3d^1 orbital in YTiO_3 by synchrotron single-crystal X-ray diffraction is presented.


title: Real-Time FJ/MAC PDE Solvers via Tensorized, Back-Propagation-Free Optical PINN Training

abstract: Solving partial differential equations (PDEs) numerically often requires huge computing time, energy cost, and hardware resources in practical applications. This has limited their applications in many scenarios (e.g., autonomous systems, supersonic flows) that have a limited energy budget and require near real-time response. Leveraging optical computing, this paper develops an on-chip training framework for physics-informed neural networks (PINNs), aiming to solve high-dimensional PDEs with fJ/MAC photonic power consumption and ultra-low latency. Despite the ultra-high speed of optical neural networks, training a PINN on an optical chip is hard due to (1) the large size of photonic devices, and (2) the lack of scalable optical memory devices to store the intermediate results of back-propagation (BP). To enable realistic optical PINN training, this paper presents a scalable method to avoid the BP process. We also employ a tensor-compressed approach to improve the convergence and scalability of our optical PINN training. This training framework is designed with tensorized optical neural networks (TONN) for scalable inference acceleration and MZI phase-domain tuning for \textit{in-situ} optimization. Our simulation results of a 20-dim HJB PDE show that our photonic accelerator can reduce the number of MZIs by a factor of $1.17\times 10^3$, with only $1.36$ J and $1.15$ s to solve this equation. This is the first real-size optical PINN training framework that can be applied to solve high-dimensional PDEs.


title: Is It Possible to Backdoor Face Forgery Detection with Natural Triggers?

abstract: Deep neural networks have significantly improved the performance of face forgery detection models in discriminating Artificial Intelligent Generated Content (AIGC). However, their security is significantly threatened by the injection of triggers during model training (i.e., backdoor attacks). Although existing backdoor defenses and manual data selection can mitigate those using human-eye-sensitive triggers, such as patches or adversarial noises, the more challenging natural backdoor triggers remain insufficiently researched. To further investigate natural triggers, we propose a novel analysis-by-synthesis backdoor attack against face forgery detection models, which embeds natural triggers in the latent space. We thoroughly study such backdoor vulnerability from two perspectives: (1) Model Discrimination (Optimization-Based Trigger): we adopt a substitute detection model and find the trigger by minimizing the cross-entropy loss; (2) Data Distribution (Custom Trigger): we manipulate the uncommon facial attributes in the long-tailed distribution to generate poisoned samples without the supervision from detection models. Furthermore, to completely evaluate the detection models towards the latest AIGC, we utilize both state-of-the-art StyleGAN and Stable Diffusion for trigger generation. Finally, these backdoor triggers introduce specific semantic features to the generated poisoned samples (e.g., skin textures and smile), which are more natural and robust. Extensive experiments show that our method is superior from three levels: (1) Attack Success Rate: ours achieves a high attack success rate (over 99%) and incurs a small model accuracy drop (below 0.2%) with a low poisoning rate (less than 3%); (2) Backdoor Defense: ours shows better robust performance when faced with existing backdoor defense methods; (3) Human Inspection: ours is less human-eye-sensitive from a comprehensive user study.


title: A Novel Estimation Method for Temperature of Magnetic Nanoparticles Dominated by Brownian Relaxation Based on Magnetic Particle Spectroscopy

abstract: This paper presents a novel method for estimating the temperature of magnetic nanoparticles (MNPs) based on AC magnetization harmonics of MNPs dominated by Brownian relaxation. The difference in the AC magnetization response and magnetization harmonic between the Fokker-Planck equation and the Langevin function was analyzed, and we studied the relationship between the magnetization harmonic and the key factors, such as Brownian relaxation time, temperature, magnetic field strength, core size and hydrodynamic size of MNPs, excitation frequency, and so on. We proposed a compensation function for AC magnetization harmonic with consideration of the key factors and the difference between the Fokker-Planck equation and the Langevin function. Then a temperature estimation model based on the compensation function and the Langevin function was established. By employing the least squares algorithm, the temperature was successfully calculated. The experimental results show that the temperature error is less than 0.035 K in the temperature range from 310 K to 320 K. The temperature estimation model is expected to improve the performance of the magnetic nanoparticle thermometer and be applied to magnetic nanoparticle-mediated hyperthermia.


title: SVFAP: Self-supervised Video Facial Affect Perceiver

abstract: Video-based facial affect analysis has recently attracted increasing attention owing to its critical role in human-computer interaction. Previous studies mainly focus on developing various deep learning architectures and training them in a fully supervised manner. Although significant progress has been achieved by these supervised methods, the longstanding lack of large-scale high-quality labeled data severely hinders their further improvements. Motivated by the recent success of self-supervised learning in computer vision, this paper introduces a self-supervised approach, termed Self-supervised Video Facial Affect Perceiver (SVFAP), to address the dilemma faced by supervised methods. Specifically, SVFAP leverages masked facial video autoencoding to perform self-supervised pre-training on massive unlabeled facial videos. Considering that large spatiotemporal redundancy exists in facial videos, we propose a novel temporal pyramid and spatial bottleneck Transformer as the encoder of SVFAP, which not only enjoys low computational cost but also achieves excellent performance. To verify the effectiveness of our method, we conduct experiments on nine datasets spanning three downstream tasks, including dynamic facial expression recognition, dimensional emotion recognition, and personality recognition. Comprehensive results demonstrate that SVFAP can learn powerful affect-related representations via large-scale self-supervised pre-training and it significantly outperforms previous state-of-the-art methods on all datasets. Codes will be available at https://github.com/sunlicai/SVFAP.


title: Stability for the 2-D plane Poiseuille flow in finite channel

abstract: In this paper, we study the stability for 2-D plane Poiseuille flow $(1-y^2,0)$ in a channel $\mathbb{T}\times (-1,1)$ with Navier-slip boundary condition. We prove that if the initial perturbation for velocity field $u_0$ satisfies that $\|u_0\|_{H^{\frac{7}{2}+}} \leq \epsilon_1 \nu^{2/3}$ for some suitable small $0<\epsilon_1 \ll 1$ independent of viscosity coefficient $\nu$, then the solution to the Navier-Stokes equations is global in time and does not transit from the plane Poiseuille flow. This result improves the result of \cite{DL1} from $3/4$ to $2/3$.


title: Bounds on the minimum distance of locally recoverable codes

abstract: We consider locally recoverable codes (LRCs) and aim to determine the smallest possible length $n=n_q(k,d,r)$ of a linear $[n,k,d]_q$-code with locality $r$. For $k\le 7$ we exactly determine all values of $n_2(k,d,2)$ and for $k\le 6$ we exactly determine all values of $n_2(k,d,1)$. For the ternary field we also state a few numerical results. As a general result we prove that $n_q(k,d,r)$ equals the Griesmer bound if the minimum Hamming distance $d$ is sufficiently large and all other parameters are fixed.


title: Approximation algorithms for Job Scheduling with reconfigurable resources

abstract: We consider here the MultiBot problem for the scheduling and the resource parametrization of jobs related to the production or the transportation of different products inside a given time horizon. Those jobs must meet known in advance demands. The time horizon is divided into several discrete identical periods representing each the time needed to proceed a job. The objective is to find a parametrization and a schedule for the jobs in such a way they require as less resources as possible. Though this problem derived from the applicative context of reconfigurable robots, we focus here on fundamental issues. We show that the resulting strongly NP-hard Multibot problem may be handled in a greedy way with an approximation ratio of $\frac{4}{3}$.


title: SynCDR : Training Cross Domain Retrieval Models with Synthetic Data

abstract: In cross-domain retrieval, a model is required to identify images from the same semantic category across two visual domains. For instance, given a sketch of an object, a model needs to retrieve a real image of it from an online store's catalog. A standard approach for such a problem is learning a feature space of images where Euclidean distances reflect similarity. Even without human annotations, which may be expensive to acquire, prior methods function reasonably well using unlabeled images for training. Our problem constraint takes this further to scenarios where the two domains do not necessarily share any common categories in training data. This can occur when the two domains in question come from different versions of some biometric sensor recording identities of different people. We posit a simple solution, which is to generate synthetic data to fill in these missing category examples across domains. This, we do via category preserving translation of images from one visual domain to another. We compare approaches specifically trained for this translation for a pair of domains, as well as those that can use large-scale pre-trained text-to-image diffusion models via prompts, and find that the latter can generate better replacement synthetic data, leading to more accurate cross-domain retrieval models. Our best SynCDR model can outperform prior art by up to 15\%. Code for our work is available at https://github.com/samarth4149/SynCDR .


title: From Text to Pixels: A Context-Aware Semantic Synergy Solution for Infrared and Visible Image Fusion

abstract: With the rapid progression of deep learning technologies, multi-modality image fusion has become increasingly prevalent in object detection tasks. Despite its popularity, the inherent disparities in how different sources depict scene content make fusion a challenging problem. Current fusion methodologies identify shared characteristics between the two modalities and integrate them within this shared domain using either iterative optimization or deep learning architectures, which often neglect the intricate semantic relationships between modalities, resulting in a superficial understanding of inter-modal connections and, consequently, suboptimal fusion outcomes. To address this, we introduce a text-guided multi-modality image fusion method that leverages the high-level semantics from textual descriptions to integrate semantics from infrared and visible images. This method capitalizes on the complementary characteristics of diverse modalities, bolstering both the accuracy and robustness of object detection. The codebook is utilized to enhance a streamlined and concise depiction of the fused intra- and inter-domain dynamics, fine-tuned for optimal performance in detection tasks. We present a bilevel optimization strategy that establishes a nexus between the joint problem of fusion and detection, optimizing both processes concurrently. Furthermore, we introduce the first dataset of paired infrared and visible images accompanied by text prompts, paving the way for future research. Extensive experiments on several datasets demonstrate that our method not only produces visually superior fusion results but also achieves a higher detection mAP over existing methods, achieving state-of-the-art results.


title: Interpreting the Curse of Dimensionality from Distance Concentration and Manifold Effect

abstract: The characteristics of data like distribution and heterogeneity, become more complex and counterintuitive as the dimensionality increases. This phenomenon is known as curse of dimensionality, where common patterns and relationships (e.g., internal and boundary pattern) that hold in low-dimensional space may be invalid in higher-dimensional space. It leads to a decreasing performance for the regression, classification or clustering models or algorithms. Curse of dimensionality can be attributed to many causes. In this paper, we first summarize five challenges associated with manipulating high-dimensional data, and explains the potential causes for the failure of regression, classification or clustering tasks. Subsequently, we delve into two major causes of the curse of dimensionality, distance concentration and manifold effect, by performing theoretical and empirical analyses. The results demonstrate that nearest neighbor search (NNS) using three typical distance measurements, Minkowski distance, Chebyshev distance, and cosine distance, becomes meaningless as the dimensionality increases. Meanwhile, the data incorporates more redundant features, and the variance contribution of principal component analysis (PCA) is skewed towards a few dimensions. By interpreting the causes of the curse of dimensionality, we can better understand the limitations of current models and algorithms, and drive to improve the performance of data analysis and machine learning tasks in high-dimensional space.


title: MSGNet: Learning Multi-Scale Inter-Series Correlations for Multivariate Time Series Forecasting

abstract: Multivariate time series forecasting poses an ongoing challenge across various disciplines. Time series data often exhibit diverse intra-series and inter-series correlations, contributing to intricate and interwoven dependencies that have been the focus of numerous studies. Nevertheless, a significant research gap remains in comprehending the varying inter-series correlations across different time scales among multiple time series, an area that has received limited attention in the literature. To bridge this gap, this paper introduces MSGNet, an advanced deep learning model designed to capture the varying inter-series correlations across multiple time scales using frequency domain analysis and adaptive graph convolution. By leveraging frequency domain analysis, MSGNet effectively extracts salient periodic patterns and decomposes the time series into distinct time scales. The model incorporates a self-attention mechanism to capture intra-series dependencies, while introducing an adaptive mixhop graph convolution layer to autonomously learn diverse inter-series correlations within each time scale. Extensive experiments are conducted on several real-world datasets to showcase the effectiveness of MSGNet. Furthermore, MSGNet possesses the ability to automatically learn explainable multi-scale inter-series correlations, exhibiting strong generalization capabilities even when applied to out-of-distribution samples.


title: SDIF-DA: A Shallow-to-Deep Interaction Framework with Data Augmentation for Multi-modal Intent Detection

abstract: Multi-modal intent detection aims to utilize various modalities to understand the user's intentions, which is essential for the deployment of dialogue systems in real-world scenarios. The two core challenges for multi-modal intent detection are (1) how to effectively align and fuse different features of modalities and (2) the limited labeled multi-modal intent training data. In this work, we introduce a shallow-to-deep interaction framework with data augmentation (SDIF-DA) to address the above challenges. Firstly, SDIF-DA leverages a shallow-to-deep interaction module to progressively and effectively align and fuse features across text, video, and audio modalities. Secondly, we propose a ChatGPT-based data augmentation approach to automatically augment sufficient training data. Experimental results demonstrate that SDIF-DA can effectively align and fuse multi-modal features by achieving state-of-the-art performance. In addition, extensive analyses show that the introduced data augmentation approach can successfully distill knowledge from the large language model.


title: Geometric BV for twisted Courant sigma models and the BRST power finesse

abstract: We study twisted Courant sigma models, a class of topological field theories arising from the coupling of 3D 0-/2-form BF theory and Chern-Simons theory and containing a 4-form Wess-Zumino term. They are examples of theories featuring a nonlinearly open gauge algebra, where products of field equations appear in the commutator of gauge transformations, and they are reducible gauge systems. We determine the solution to the master equation using a technique, the BRST power finesse, that combines aspects of the AKSZ construction (which applies to the untwisted model) and the general BV-BRST formalism. This allows for a geometric interpretation of the BV coefficients in the interaction terms of the master action in terms of an induced generalised connection on a 4-form twisted (pre-)Courant algebroid, its Gualtieri torsion and the basic curvature tensor. It also produces a frame independent formulation of the model. We show, moreover, that the gauge fixed action is the sum of the classical one and a BRST commutator, as expected from a Schwarz type topological field theory.


title: keqing: knowledge-based question answering is a nature chain-of-thought mentor of LLM

abstract: Large language models (LLMs) have exhibited remarkable performance on various natural language processing (NLP) tasks, especially for question answering. However, in the face of problems beyond the scope of knowledge, these LLMs tend to talk nonsense with a straight face, where the potential solution could be incorporating an Information Retrieval (IR) module and generating response based on these retrieved knowledge. In this paper, we present a novel framework to assist LLMs, such as ChatGPT, to retrieve question-related structured information on the knowledge graph, and demonstrate that Knowledge-based question answering (Keqing) could be a nature Chain-of-Thought (CoT) mentor to guide the LLM to sequentially find the answer entities of a complex question through interpretable logical chains. Specifically, the workflow of Keqing will execute decomposing a complex question according to predefined templates, retrieving candidate entities on knowledge graph, reasoning answers of sub-questions, and finally generating response with reasoning paths, which greatly improves the reliability of LLM's response. The experimental results on KBQA datasets show that Keqing can achieve competitive performance and illustrate the logic of answering each question.


title: The functional volume product under heat flow

abstract: We prove that the functional volume product for even functions is monotone increasing along the Fokker--Planck heat flow. This in particular yields a new proof of the functional Blaschke--Santal\'{o} inequality by K. Ball and also Artstein-Avidan--Klartag--Milman in the even case. This result is the consequence of a new understanding of the regularizing property of the Ornstein--Uhlenbeck semigroup. That is, we establish an improvement of Borell's reverse hypercontractivity inequality for even functions and identify the sharp range of the admissible exponents. As another consequence of successfully identifying the sharp range for the inequality, we derive the sharp $L^p$-$L^q$ inequality for the Laplace transform for even functions. The best constant of the inequality is attained by centered Gaussians, and thus this provides an analogous result to Beckner's sharp Hausdorff--Young inequality. Our technical novelty in the proof is the use of the Brascamp--Lieb inequality for log-concave measures and Cram\'{e}r--Rao's inequality in this context.


title: Training towards significance with the decorrelated event classifier transformer neural network

abstract: Experimental particle physics uses machine learning for many of tasks, where one application is to classify signal and background events. The classification can be used to bin an analysis region to enhance the expected significance for a mass resonance search. In natural language processing, one of the leading neural network architectures is the transformer. In this work, an event classifier transformer is proposed to bin an analysis region, in which the network is trained with special techniques. The techniques developed here can enhance the significance and reduce the correlation between the network's output and the reconstructed mass. It is found that this trained network can perform better than boosted decision trees and feed-forward networks.


title: Deeper and Wider Networks for Performance Metrics Prediction in Communication Networks

abstract: In today's era, users have increasingly high expectations regarding the performance and efficiency of communication networks. Network operators aspire to achieve efficient network planning, operation, and optimization through Digital Twin Networks (DTN). The effectiveness of DTN heavily relies on the network model, with graph neural networks (GNN) playing a crucial role in network modeling. However, existing network modeling methods still lack a comprehensive understanding of communication networks. In this paper, we propose DWNet (Deeper and Wider Networks), a heterogeneous graph neural network modeling method based on data-driven approaches that aims to address end-to-end latency and jitter prediction in network models. This method stands out due to two distinctive features: firstly, it introduces deeper levels of state participation in the message passing process; secondly, it extensively integrates relevant features during the feature fusion process. Through experimental validation and evaluation, our model achieves higher prediction accuracy compared to previous research achievements, particularly when dealing with unseen network topologies during model training. Our model not only provides more accurate predictions but also demonstrates stronger generalization capabilities across diverse topological structures.


title: Brain-Conditional Multimodal Synthesis: A Survey and Taxonomy

abstract: In the era of Artificial Intelligence Generated Content (AIGC), conditional multimodal synthesis technologies (e.g., text-to-image, text-to-video, text-to-audio, etc) are gradually reshaping the natural content in the real world. The key to multimodal synthesis technology is to establish the mapping relationship between different modalities. Brain signals, serving as potential reflections of how the brain interprets external information, exhibit a distinctive One-to-Many correspondence with various external modalities. This correspondence makes brain signals emerge as a promising guiding condition for multimodal content synthesis. Brian-conditional multimodal synthesis refers to decoding brain signals back to perceptual experience, which is crucial for developing practical brain-computer interface systems and unraveling complex mechanisms underlying how the brain perceives and comprehends external stimuli. This survey comprehensively examines the emerging field of AIGC-based Brain-conditional Multimodal Synthesis, termed AIGC-Brain, to delineate the current landscape and future directions. To begin, related brain neuroimaging datasets, functional brain regions, and mainstream generative models are introduced as the foundation of AIGC-Brain decoding and analysis. Next, we provide a comprehensive taxonomy for AIGC-Brain decoding models and present task-specific representative work and detailed implementation strategies to facilitate comparison and in-depth analysis. Quality assessments are then introduced for both qualitative and quantitative evaluation. Finally, this survey explores insights gained, providing current challenges and outlining prospects of AIGC-Brain. Being the inaugural survey in this domain, this paper paves the way for the progress of AIGC-Brain research, offering a foundational overview to guide future work.


title: Wild2Avatar: Rendering Humans Behind Occlusions

abstract: Rendering the visual appearance of moving humans from occluded monocular videos is a challenging task. Most existing research renders 3D humans under ideal conditions, requiring a clear and unobstructed scene. Those methods cannot be used to render humans in real-world scenes where obstacles may block the camera's view and lead to partial occlusions. In this work, we present Wild2Avatar, a neural rendering approach catered for occluded in-the-wild monocular videos. We propose occlusion-aware scene parameterization for decoupling the scene into three parts - occlusion, human, and background. Additionally, extensive objective functions are designed to help enforce the decoupling of the human from both the occlusion and the background and to ensure the completeness of the human model. We verify the effectiveness of our approach with experiments on in-the-wild videos.


title: Magnetic order and strongly-correlated effects in the one-dimensional Ising-Kondo lattice

abstract: We investigate the magnetic order and related strongly-correlated effects in an one-dimensional Ising-Kondo lattice with transverse field. This model is the anisotropic limit of the conventional isotropic Kondo lattice model, in the sense that the itinerant electrons interact with the localized magnetic moments via only longitudinal Kondo exchange. Adopting the numerical density-matrix-renormalization group method, we map out the ground-state phase diagram in various parameter spaces. Depending on the Kondo coupling and filling number, three distinct phases, including a metallic paramagnetic, a metallic ferromagnetic, and a gapped spin-density wave phase, are obtained. The spin-density wave is characterized by an ordering wave vector which coincides with the nesting wave vector of the Fermi surface. This makes the corresponding magnetic transition a spin analog of the Peierls transition occurring in the one-dimensional metal. Moreover, by analyzing the momentum distribution function and charge correlation function, the conduction electrons are shown to behave like free spinless fermions in the ferromagnetic phase. We finally discuss the effect of the repulsive Hubbard interaction between conduction electrons. Our work enriches the Kondo physics and deepens the current understanding of the heavy fermion compounds.


title: Quantized collision invariants on the sphere

abstract: We show that a measurable function $g:\mathbb{S}^{d-1}\to\mathbb{R}$, with $d\geq 3$, satisfies the functional relation \begin{equation*} g(\omega)+g(\omega_*)=g(\omega')+g(\omega_*'), \end{equation*} for all admissible $\omega,\omega_*,\omega',\omega_*'\in\mathbb{S}^{d-1}$ in the sense that \begin{equation*} \omega+\omega_*=\omega'+\omega_*', \end{equation*} if and only if it can be written as \begin{equation*} g(\omega)=A+B\cdot\omega, \end{equation*} for some constants $A\in \mathbb{R}$ and $B\in\mathbb{R}^d$. Such functions form a family of quantized collision invariants which play a fundamental role in the study of hydrodynamic regimes of the Boltzmann--Fermi--Dirac equation near Fermionic condensates, i.e., at low temperatures. In particular, they characterize the elastic collisional dynamics of Fermions near a statistical equilibrium where quantum effects are predominant.


title: GeoGalactica: A Scientific Large Language Model in Geoscience

abstract: Large language models (LLMs) have achieved huge success for their general knowledge and ability to solve a wide spectrum of tasks in natural language processing (NLP). Due to their impressive abilities, LLMs have shed light on potential inter-discipline applications to foster scientific discoveries of a specific domain by using artificial intelligence (AI for science, AI4S). In the meantime, utilizing NLP techniques in geoscience research and practice is wide and convoluted, contributing from knowledge extraction and document classification to question answering and knowledge discovery. In this work, we take the initial step to leverage LLM for science, through a rather straightforward approach. We try to specialize an LLM into geoscience, by further pre-training the model with a vast amount of texts in geoscience, as well as supervised fine-tuning (SFT) the resulting model with our custom collected instruction tuning dataset. These efforts result in a model GeoGalactica consisting of 30 billion parameters. To our best knowledge, it is the largest language model for the geoscience domain. More specifically, GeoGalactica is from further pre-training of Galactica. We train GeoGalactica over a geoscience-related text corpus containing 65 billion tokens, preserving as the largest geoscience-specific text corpus. Then we fine-tune the model with 1 million pairs of instruction-tuning data consisting of questions that demand professional geoscience knowledge to answer. In this technical report, we will illustrate in detail all aspects of GeoGalactica, including data collection, data cleaning, base model selection, pre-training, SFT, and evaluation. We open-source our data curation tools and the checkpoints of GeoGalactica during the first 3/4 of pre-training.


title: Bidirectional Trained Tree-Structured Decoder for Handwritten Mathematical Expression Recognition

abstract: The Handwritten Mathematical Expression Recognition (HMER) task is a critical branch in the field of OCR. Recent studies have demonstrated that incorporating bidirectional context information significantly improves the performance of HMER models. However, existing methods fail to effectively utilize bidirectional context information during the inference stage. Furthermore, current bidirectional training methods are primarily designed for string decoders and cannot adequately generalize to tree decoders, which offer superior generalization capabilities and structural analysis capacity. In order to overcome these limitations, we propose the Mirror-Flipped Symbol Layout Tree (MF-SLT) and Bidirectional Asynchronous Training (BAT) structure. Our method extends the bidirectional training strategy to the tree decoder, allowing for more effective training by leveraging bidirectional information. Additionally, we analyze the impact of the visual and linguistic perception of the HMER model separately and introduce the Shared Language Modeling (SLM) mechanism. Through the SLM, we enhance the model's robustness and generalization when dealing with visual ambiguity, particularly in scenarios with abundant training data. Our approach has been validated through extensive experiments, demonstrating its ability to achieve new state-of-the-art results on the CROHME 2014, 2016, and 2019 datasets, as well as the HME100K dataset. The code used in our experiments will be publicly available.


title: Diff-PCR: Diffusion-Based Correspondence Searching in Doubly Stochastic Matrix Space for Point Cloud Registration

abstract: Efficiently finding optimal correspondences between point clouds is crucial for solving both rigid and non-rigid point cloud registration problems. Existing methods often rely on geometric or semantic feature embedding to establish correspondences and estimate transformations or flow fields. Recently, state-of-the-art methods have employed RAFT-like iterative updates to refine the solution. However, these methods have certain limitations. Firstly, their iterative refinement design lacks transparency, and their iterative updates follow a fixed path during the refinement process, which can lead to suboptimal results. Secondly, these methods overlook the importance of refining or optimizing correspondences (or matching matrices) as a precursor to solving transformations or flow fields. They typically compute candidate correspondences based on distances in the point feature space. However, they only project the candidate matching matrix into some matrix space once with Sinkhorn or dual softmax operations to obtain final correspondences. This one-shot projected matching matrix may be far from the globally optimal one, and these approaches do not consider the distribution of the target matching matrix. In this paper, we propose a novel approach that exploits the Denoising Diffusion Model to predict a searching gradient for the optimal matching matrix within the Doubly Stochastic Matrix Space. During the reverse denoising process, our method iteratively searches for better solutions along this denoising gradient, which points towards the maximum likelihood direction of the target matching matrix. Our method offers flexibility by allowing the search to start from any initial matching matrix provided by the online backbone or white noise. Experimental evaluations on the 3DMatch/3DLoMatch and 4DMatch/4DLoMatch datasets demonstrate the effectiveness of our newly designed framework.


title: BatchEval: Towards Human-like Text Evaluation

abstract: Significant progress has been made in automatic text evaluation with the introduction of large language models (LLMs) as evaluators. However, current sample-wise evaluation paradigm suffers from the following issues: (1) Sensitive to prompt design; (2) Poor resistance to noise; (3) Inferior ensemble performance with static reference. Inspired by the fact that humans treat both criterion definition and inter sample comparison as references for evaluation, we propose BatchEval, a paradigm that conducts batch-wise evaluation iteratively to alleviate the above problems. We explore variants under this paradigm and confirm the optimal settings are two stage procedure with heterogeneous batch composition strategy and decimal scoring format. Comprehensive experiments across 3 LLMs on 4 text evaluation tasks demonstrate that BatchEval outperforms state-of-the-art methods by 10.5% on Pearson correlations with only 64% API cost on average. Further analyses have been conducted to verify the robustness, generalization, and working mechanism of BatchEval.


title: SFGANS Self-supervised Future Generator for human ActioN Segmentation

abstract: The ability to locate and classify action segments in long untrimmed video is of particular interest to many applications such as autonomous cars, robotics and healthcare applications. Today, the most popular pipeline for action segmentation is composed of encoding the frames into feature vectors, which are then processed by a temporal model for segmentation. In this paper we present a self-supervised method that comes in the middle of the standard pipeline and generated refined representations of the original feature vectors. Experiments show that this method improves the performance of existing models on different sub-tasks of action segmentation, even without additional hyper parameter tuning.


title: On the breathing of spectral bands in periodic quantum waveguides with inflating resonators

abstract: We are interested in the lower part of the spectrum of the Dirichlet Laplacian $A^\varepsilon$ in a thin waveguide $\Pi^\varepsilon$ obtained by repeating periodically a pattern, itself constructed by scaling an inner field geometry $\Omega$ by a small factor $\varepsilon>0$. The Floquet-Bloch theory ensures that the spectrum of $A^\varepsilon$ has a band-gap structure. Due to the Dirichlet boundary conditions, these bands all move to $+\infty$ as $O(\varepsilon^{-2})$ when $\varepsilon\to0^+$. Concerning their widths, applying techniques of dimension reduction, we show that the results depend on the dimension of the so-called space of almost standing waves in $\Omega$ that we denote by $\mathrm{X}_\dagger$. Generically, i.e. for most $\Omega$, there holds $\mathrm{X}_\dagger=\{0\}$ and the lower part of the spectrum of $A^\varepsilon$ is very sparse, made of bands of length at most $O(\varepsilon)$ as $\varepsilon\to0^+$. For certain $\Omega$ however, we have $\mathrm{dim}\,\mathrm{X}_\dagger=1$ and then there are bands of length $O(1)$ which allow for wave propagation in $\Pi^\varepsilon$. The main originality of this work lies in the study of the behaviour of the spectral bands when perturbing $\Omega$ around a particular $\Omega_\star$ where $\mathrm{dim}\,\mathrm{X}_\dagger=1$. We show a breathing phenomenon for the spectrum of $A^\varepsilon$: when inflating $\Omega$ around $\Omega_\star$, the spectral bands rapidly expand before shrinking. In the process, a band dives below the normalized threshold $\pi^2/\varepsilon^2$, stops breathing and becomes extremely short as $\Omega$ continues to inflate.


title: TSGAN: An Optical-to-SAR Dual Conditional GAN for Optical based SAR Temporal Shifting

abstract: In contrast to the well-investigated field of SAR-to-Optical translation, this study explores the lesser-investigated domain of Optical-to-SAR translation, a challenging field due to the ill-posed nature of this translation. The complexity arises as a single optical data can have multiple SAR representations based on the SAR viewing geometry. We propose a novel approach, termed SAR Temporal Shifting, which inputs an optical data from the desired timestamp along with a SAR data from a different temporal point but with a consistent viewing geometry as the expected SAR data, both complemented with a change map of optical data during the intervening period. This model modifies the SAR data based on the changes observed in optical data to generate the SAR data for the desired timestamp. Our model, a dual conditional Generative Adversarial Network (GAN), named Temporal Shifting GAN (TSGAN), incorporates a siamese encoder in both the Generator and the Discriminator. To prevent the model from overfitting on the input SAR data, we employed a change weighted loss function. Our approach surpasses traditional translation methods by eliminating the GAN's fiction phenomenon, particularly in unchanged regions, resulting in higher SSIM and PSNR in these areas. Additionally, modifications to the Pix2Pix architecture and the inclusion of attention mechanisms have enhanced the model's performance on all regions of the data. This research paves the way for leveraging legacy optical datasets, the most abundant and longstanding source of Earth imagery data, extending their use to SAR domains and temporal analyses. To foster further research, we provide the code, datasets used in our study, and a framework for generating paired SAR-Optical datasets for new regions of interest. These resources are available on github.com/moienr/TemporalGAN


title: Quantitative unique continuation for real-valued solutions to second order elliptic equations in the plane

abstract: In this article, we study a quantitative form of the Landis conjecture on exponential decay for real-valued solutions to second order elliptic equations with variable coefficients in the plane. In particular, we prove the following qualitative form of Landis conjecture, for $W_1, W_2 \in L^{\infty}(\mathbb R^2;\mathbb R^2)$, $V \in L^{\infty}(\mathbb R^2;\mathbb R)$ and $u \in H_{\mathrm{loc}}^{1}(\mathbb R^2)$ a real-valued weak solution to $-\Delta u - \nabla \cdot ( W_1 u ) +W_2 \cdot \nabla u + V u = 0$ in $\mathbb R^2$, satisfying for $\delta>0$, $|u(x)| \leq \exp(- |x|^{1+\delta})$, $x \in \mathbb R^2$, then $u \equiv 0$. Our methodology of proof is inspired by the one recently developed by Logunov, Malinnikova, Nadirashvili, and Nazarov that have treated the equation $-\Delta u + V u = 0$ in $\mathbb R^2$. Nevertheless, several differences and additional difficulties appear. New weak quantitative maximum principles are established for the construction of a positive multiplier in a suitable perforated domain, depending on the nodal set of $u$. The resulted divergence elliptic equation is then transformed into a non-homogeneous $\partial_{\overline{z}}$ equation thanks to a generalization of Stoilow factorization theorem obtained by the theory of quasiconformal mappings, an approximate type Poincar\'e lemma and the use of the Cauchy transform. Finally, a suitable Carleman estimate applied to the operator $\partial_{\overline{z}}$ is the last ingredient of our proof.


title: A Comprehensive Overview of Fish-Eye Camera Distortion Correction Methods

abstract: The fisheye camera, with its unique wide field of view and other characteristics, has found extensive applications in various fields. However, the fisheye camera suffers from significant distortion compared to pinhole cameras, resulting in distorted images of captured objects. Fish-eye camera distortion is a common issue in digital image processing, requiring effective correction techniques to enhance image quality. This review provides a comprehensive overview of various methods used for fish-eye camera distortion correction. The article explores the polynomial distortion model, which utilizes polynomial functions to model and correct radial distortions. Additionally, alternative approaches such as panorama mapping, grid mapping, direct methods, and deep learning-based methods are discussed. The review highlights the advantages, limitations, and recent advancements of each method, enabling readers to make informed decisions based on their specific needs.


title: Data-driven Energy Efficiency Modelling in Large-scale Networks: An Expert Knowledge and ML-based Approach

abstract: The energy consumption of mobile networks poses a critical challenge. Mitigating this concern necessitates the deployment and optimization of network energy-saving solutions, such as carrier shutdown, to dynamically manage network resources. Traditional optimization approaches encounter complexity due to factors like the large number of cells, stochastic traffic, channel variations, and intricate trade-offs. This paper introduces the simulated reality of communication networks (SRCON) framework, a novel, data-driven modeling paradigm that harnesses live network data and employs a blend of machine learning (ML)- and expert-based models. These mix of models accurately characterizes the functioning of network components, and predicts network energy efficiency and user equipment (UE) quality of service for any energy carrier shutdown configuration in a specific network. Distinguishing itself from existing methods, SRCON eliminates the reliance on expensive expert knowledge, drive testing, or incomplete maps for predicting network performance. This paper details the pipeline employed by SRCON to decompose the large network energy efficiency modeling problem into ML and expert-based submodels. It demonstrates how, by embracing stochasticity, and carefully crafting the relationship between such submodels, the overall computational complexity can be reduced and prediction accuracy enhanced. Results derived from real network data underscore the paradigm shift introduced by SRCON, showcasing significant gains over a state-of-the art method used by a operator for network energy efficiency modeling. The reliability of this local, data-driven modeling of the network proves to be a key asset for network energy-saving optimization.


title: RIS-Enabled Integrated Sensing and Communication for 6G Systems

abstract: The following paper proposes a new target localization system design using an architecture based on reconfigurable intelligent surfaces (RISs) and passive radars (PRs) for integrated sensing and communications systems. The preamble of the communication signal is exploited in order to perform target sensing tasks, which involve detection and localization. The RIS in this case can aid the PR in sensing targets that are otherwise not seen by the PR itself, due to the many obstacles encountered within the propagation channel. Therefore, this work proposes a localization algorithm tailored for the integrated sensing and communications RIS-aided architecture, which is capable of uniquely positioning targets within the scene. The algorithm is capable of detecting the number of targets along with estimating the position of targets via angles and times of arrival. Our simulation results demonstrate the performance of the localization method in terms of different localization and detection metrics and for increasing RIS sizes.


title: Energy-Efficient Power Control for Multiple-Task Split Inference in UAVs: A Tiny Learning-Based Approach

abstract: The limited energy and computing resources of unmanned aerial vehicles (UAVs) hinder the application of aerial artificial intelligence. The utilization of split inference in UAVs garners significant attention due to its effectiveness in mitigating computing and energy requirements. However, achieving energy-efficient split inference in UAVs remains complex considering of various crucial parameters such as energy level and delay constraints, especially involving multiple tasks. In this paper, we present a two-timescale approach for energy minimization in split inference, where discrete and continuous variables are segregated into two timescales to reduce the size of action space and computational complexity. This segregation enables the utilization of tiny reinforcement learning (TRL) for selecting discrete transmission modes for sequential tasks. Moreover, optimization programming (OP) is embedded between TRL's output and reward function to optimize the continuous transmit power. Specifically, we replace the optimization of transmit power with that of transmission time to decrease the computational complexity of OP since we reveal that energy consumption monotonically decreases with increasing transmission time. The replacement significantly reduces the feasible region and enables a fast solution according to the closed-form expression for optimal transmit power. Simulation results show that the proposed algorithm can achieve a higher probability of successful task completion with lower energy consumption.


title: Dissipation of AGN jets in a clumpy interstellar medium

abstract: Accreting supermassive black holes (SMBHs) frequently power jets that interact with the interstellar/circumgalactic medium (ISM/CGM), regulating star-formation in the galaxy. Highly supersonic jets launched by active galactic nuclei (AGN) power a cocoon that confines them and shocks the ambient medium. We build upon the models of narrow conical jets interacting with a smooth ambient medium, to include the effect of dense clouds that are an essential ingredient of a multiphase ISM. The key physical ingredient of this model is that the clouds along the supersonic jet-beam strongly decelerate the jet-head, but the subsonic cocoon easily moves around the clouds without much resistance. We propose scalings for important physical quantities -- cocoon pressure, head & cocoon speed, and jet radius. We obtain, for the first time, the analytic condition on clumpiness of the ambient medium for the jet to dissipate within the cocoon and verify it with numerical simulations of conical jets interacting with a uniform ISM with embedded spherical clouds. A jet is defined to be dissipated when the cocoon speed exceeds the speed of the jet-head. We compare our models to more sophisticated numerical simulations, direct observations of jet-ISM interaction (e.g., quasar J1316+1753), and discuss implications for the Fermi/eROSITA bubbles. Our work also motivates effective subgrid models for AGN jet feedback in a clumpy ISM unresolved by the present generation of cosmological galaxy formation simulations.


title: User Clustering for STAR-RIS Assisted Full-Duplex NOMA Communication Systems

abstract: In contrast to conventional reconfigurable intelligent surface (RIS), simultaneous transmitting and reflecting reconfigurable intelligent surface (STAR-RIS) has been proposed recently to enlarge the serving area from 180o to 360o coverage. This work considers the performance of a STAR-RIS aided full-duplex (FD) non-orthogonal multiple access (NOMA) communication systems. The STAR-RIS is implemented at the cell-edge to assist the cell-edge users, while the cell-center users can communicate directly with a FD base station (BS). We first introduce new user clustering schemes for the downlink and uplink transmissions. Then, based on the proposed transmission schemes closed-form expressions of the ergodic rates in the downlink and uplink modes are derived taking into account the system impairments caused by the self interference at the FD-BS and the imperfect successive interference cancellation (SIC). Moreover, an optimization problem to maximize the total sum-rate is formulated and solved by optimizing the amplitudes and the phase-shifts of the STAR-RIS elements and allocating the transmit power efficiently. The performance of the proposed user clustering schemes and the optimal STAR-RIS design are investigated through numerical results


title: Beyond Chinchilla-Optimal: Accounting for Inference in Language Model Scaling Laws

abstract: Large language model (LLM) scaling laws are empirical formulas that estimate changes in model quality as a result of increasing parameter count and training data. However, these formulas, including the popular DeepMind Chinchilla scaling laws, neglect to include the cost of inference. We modify the Chinchilla scaling laws to calculate the optimal LLM parameter count and pre-training data size to train and deploy a model of a given quality and inference demand. We conduct our analysis both in terms of a compute budget and real-world costs and find that LLM researchers expecting reasonably large inference demand (~1B requests) should train models smaller and longer than Chinchilla-optimal.


title: Teaching Digital Accessibility to Industry Professionals using the Community of Practice Framework: An Experience Report

abstract: Despite recent initiatives aimed at improving accessibility, the field of digital accessibility remains markedly behind contemporary advancements in the software industry as a large number of real world software and web applications continue to fall short of accessibility requirements. A persisting skills deficit within the existing technology workforce has been an enduring impediment, hindering organizations from delivering truly accessible software products. This, in turn, elevates the risk of isolating and excluding a substantial portion of potential users. In this paper, we report lessons learned from a training program for teaching digital accessibility using the Communities of Practice (CoP) framework to industry professionals. We recruited 66 participants from a large multi-national software company and assigned them to two groups: one participating in a CoP and the other using self-paced learning. We report experiences from designing the training program, conducting the actual training, and assessing the efficiency of the two approaches. Based on these findings, we provide recommendations for practitioners in Learning and Development teams and educators in designing accessibility courses for industry professionals.


title: Fault-tolerant quantum computation by hybrid qubits with bosonic cat-code and single photons

abstract: Hybridizing different degrees of freedom or physical platforms potentially offers various advantages in building scalable quantum architectures. We here introduce a fault-tolerant hybrid quantum computation by taking the advantages of both discrete variable (DV) and continuous variable (CV) systems. Particularly, we define a CV-DV hybrid qubit with bosonic cat-code and single photon, which is implementable in current photonic platforms. By the cat-code encoded in the CV part, the dominant loss errors are readily correctable without multi-qubit encoding, while the logical basis is inherently orthogonal due to the DV part. We design fault-tolerant architectures by concatenating hybrid qubits and an outer DV quantum error correction code such as topological codes, exploring their potential merits in developing scalable quantum computation. We demonstrate by numerical simulations that our scheme is at least an order of magnitude more resource-efficient over all previous proposals in photonic platforms, allowing to achieve a record-high loss threshold among existing CV and hybrid approaches. We discuss its realization not only in all-photonic platforms but also in other hybrid platforms including superconduting and trapped-ion systems, which allows us to find various efficient routes towards fault-tolerant quantum computing.


title: Exploring the Need of Accessibility Education in the Software Industry: Insights from a Survey of Software Professionals in India

abstract: A UserWay study in 2021 indicates that an annual global e-commerce revenue loss of approximately $16 billion can be attributed to inaccessible websites and applications. According to the 2023 WebAIM study, only 3.7% of the world's top one million website homepages are fully accessible. This shows that many software developers use poor coding practices that don't adhere to the Web Content Accessibility Guidelines (WCAG). This research centers on software professionals and their role in addressing accessibility. This work seeks to understand (a) who within the software development community actively practices accessibility, (b) when and how accessibility is considered in the software development lifecycle, (c) the various challenges encountered in building accessible software, and (d) the resources required by software professionals to enhance product accessibility. Our survey of 269 software professionals from India sheds light on the pressing need for accessibility education within the software industry. A substantial majority (69.9%, N=269) of respondents express the need for training materials, workshops, and bootcamps to enhance their accessibility skills. We present a list of actionable recommendations that can be implemented within the industry to promote accessibility awareness and skills. We also open source our raw data for further research, encouraging continued exploration in this domain.


title: Multi-scale cross-attention transformer encoder for event classification

abstract: We deploy an advanced Machine Learning (ML) environment, leveraging a multi-scale cross-attention encoder for event classification, towards the identification of the $gg\to H\to hh\to b\bar b b\bar b$ process at the High Luminosity Large Hadron Collider (HL-LHC), where $h$ is the discovered Standard Model (SM)-like Higgs boson and $H$ a heavier version of it (with $m_H>2m_h$). In the ensuing boosted Higgs regime, the final state consists of two fat jets. Our multi-modal network can extract information from the jet substructure and the kinematics of the final state particles through self-attention transformer layers. The diverse learned information is subsequently integrated to improve classification performance using an additional transformer encoder with cross-attention heads. We ultimately prove that our approach surpasses in performance current alternative methods used to establish sensitivity to this process, whether solely based on kinematic analysis or else on a combination of this with mainstream ML approaches. Then, we employ various interpretive methods to evaluate the network results, including attention map analysis and visual representation of Gradient-weighted Class Activation Mapping (Grad-CAM). Finally, we note that the proposed network is generic and can be applied to analyse any process carrying information at different scales. Our code is publicly available for generic use.