title: Provably Convergent Federated Trilevel Learning

abstract: Trilevel learning, also called trilevel optimization (TLO), has been recognized as a powerful modelling tool for hierarchical decision process and widely applied in many machine learning applications, such as robust neural architecture search, hyperparameter optimization, and domain adaptation. Tackling TLO problems has presented a great challenge due to their nested decision-making structure. In addition, existing works on TLO face the following key challenges: 1) they all focus on the non-distributed setting, which may lead to privacy breach; 2) they do not offer any non-asymptotic convergence analysis which characterizes how fast an algorithm converges. To address the aforementioned challenges, this paper proposes an asynchronous federated trilevel optimization method to solve TLO problems. The proposed method utilizes $\mu$-cuts to construct a hyper-polyhedral approximation for the TLO problem and solve it in an asynchronous manner. We demonstrate that the proposed $\mu$-cuts are applicable to not only convex functions but also a wide range of non-convex functions that meet the $\mu$-weakly convex assumption. Furthermore, we theoretically analyze the non-asymptotic convergence rate for the proposed method by showing its iteration complexity to obtain $\epsilon$-stationary point is upper bounded by $\mathcal{O}(\frac{1}{\epsilon^2})$. Extensive experiments on real-world datasets have been conducted to elucidate the superiority of the proposed method, e.g., it has a faster convergence rate with a maximum acceleration of approximately 80$\%$.


title: AiDAC: A Low-Cost In-Memory Computing Architecture with All-Analog Multi-Bit Compute and Interconnect

abstract: Analog in-memory computing (AiMC) is an emerging technology that shows fantastic performance superiority for neural network acceleration. However, as the computational bit-width and scale increase, high-precision data conversion and long-distance data routing will result in unacceptable energy and latency overheads in the AiMC system. In this work, we focus on the potential of in-charge computing and in-time interconnection and show an innovative AiMC architecture, named AiDAC, with three key contributions: (1) AiDAC enhances multibit computing efficiency and reduces data conversion times by grouping capacitors technology; (2) AiDAC first adopts row drivers and column time accumulators to achieve large-scale AiMC arrays integration while minimizing the energy cost of data movements. (3) AiDAC is the first work to support large-scale all-analog multibit vector-matrix multiplication (VMM) operations. The evaluation shows that AiDAC maintains high-precision calculation (less than 0.79% total computing error) while also possessing excellent performance features, such as high parallelism (up to 26.2TOPS), low latency (<20ns/VMM), and high energy efficiency (123.8TOPS/W), for 8bits VMM with 1024 input channels.


title: Regulating Intermediate 3D Features for Vision-Centric Autonomous Driving

abstract: Multi-camera perception tasks have gained significant attention in the field of autonomous driving. However, existing frameworks based on Lift-Splat-Shoot (LSS) in the multi-camera setting cannot produce suitable dense 3D features due to the projection nature and uncontrollable densification process. To resolve this problem, we propose to regulate intermediate dense 3D features with the help of volume rendering. Specifically, we employ volume rendering to process the dense 3D features to obtain corresponding 2D features (e.g., depth maps, semantic maps), which are supervised by associated labels in the training. This manner regulates the generation of dense 3D features on the feature level, providing appropriate dense and unified features for multiple perception tasks. Therefore, our approach is termed Vampire, stands for "Volume rendering As Multi-camera Perception Intermediate feature REgulator". Experimental results on the Occ3D and nuScenes datasets demonstrate that Vampire facilitates fine-grained and appropriate extraction of dense 3D features, and is competitive with existing SOTA methods across diverse downstream perception tasks like 3D occupancy prediction, LiDAR segmentation and 3D objection detection, while utilizing moderate GPU resources. We provide a video demonstration in the supplementary materials and Codes are available at github.com/cskkxjk/Vampire.


title: Almost Uniform Sampling of Independent Sets in Polynomial Time -- Implying NP=RP

abstract: We prove the unexpected result that almost uniform sampling of independent sets in graphs is possible via a probabilistic polynomial time algorithm. Note that our sampling algorithm (if correct) has extremely surprising consequences; the most important one being no less than the unlikely collapse NP=RP.


title: Dual parametric and state estimation for partial differential equations

abstract: Designing estimation algorithms for systems governed by partial differential equations (PDEs) such as fluid flows is challenging due to the high-dimensional and oftentimes nonlinear nature of the dynamics, as well as their dependence on unobserved physical parameters. In this paper, we propose two different lightweight and effective methodologies for real-time state estimation of PDEs in the presence of parametric uncertainties. Both approaches combine a Kalman filter with a data-driven polytopic linear reduced-order model obtained by dynamic mode decomposition (DMD). Using examples involving the nonlinear Burgers and Navier-Stokes equations, we demonstrate accurate estimation of both the state and the unknown physical parameter along system trajectories corresponding to various physical parameter values.

categories: eess.SY cs.SY math.DS math.OC physics.comp-ph physics.flu-dyn


title: $k$-commutativity and measurement reduction for expectation values

abstract: We introduce a notion of commutativity between operators on a tensor product space, nominally Pauli strings on qubits, that interpolates between qubit-wise commutativity and (full) commutativity. We apply this notion, which we call $k$-commutativity, to measuring expectation values of observables in quantum circuits and show a reduction in the number measurements at the cost of increased circuit depth. Last, we discuss the asymptotic measurement complexity of $k$-commutativity for several families of $n$-qubit Hamiltonians, showing examples with $O(1)$, $O(\sqrt{n})$, and $O(n)$ scaling.


title: MixRT: Mixed Neural Representations For Real-Time NeRF Rendering

abstract: Neural Radiance Field (NeRF) has emerged as a leading technique for novel view synthesis, owing to its impressive photorealistic reconstruction and rendering capability. Nevertheless, achieving real-time NeRF rendering in large-scale scenes has presented challenges, often leading to the adoption of either intricate baked mesh representations with a substantial number of triangles or resource-intensive ray marching in baked representations. We challenge these conventions, observing that high-quality geometry, represented by meshes with substantial triangles, is not necessary for achieving photorealistic rendering quality. Consequently, we propose MixRT, a novel NeRF representation that includes a low-quality mesh, a view-dependent displacement map, and a compressed NeRF model. This design effectively harnesses the capabilities of existing graphics hardware, thus enabling real-time NeRF rendering on edge devices. Leveraging a highly-optimized WebGL-based rendering framework, our proposed MixRT attains real-time rendering speeds on edge devices (over 30 FPS at a resolution of 1280 x 720 on a MacBook M1 Pro laptop), better rendering quality (0.2 PSNR higher in indoor scenes of the Unbounded-360 datasets), and a smaller storage size (less than 80% compared to state-of-the-art methods).


title: Neural operator-based super-fidelity: A warm-start approach for accelerating steady-state simulations

abstract: In recent years, using neural networks to speed up the solving of partial differential equations (PDEs) has gained significant traction in both academic and industrial settings. However, the use of neural networks as standalone surrogate models raises concerns about the reliability of solutions due to their dependence on data volume, quality, and training algorithms, especially in precision-critical scientific tasks. This study introduces a novel "super-fidelity" method, which uses neural networks for initial warm-starting in solving steady-state PDEs, ensuring both speed and accuracy. Drawing from super-resolution concepts in computer vision, our approach maps low-fidelity model solutions to high-fidelity targets using a vector-cloud neural network with equivariance (VCNN-e), maintaining all necessary invariance and equivariance properties for scalar and vector solutions. This method adapts well to different spatial resolutions. We tested this approach in two scientific computing scenarios: one with weak nonlinearity, using low Reynolds number flows around elliptical cylinders, and another with strong nonlinearity, using high Reynolds number flows over airfoils. In both cases, our neural operator-based initialization significantly accelerated convergence by at least two-fold, without sacrificing accuracy, compared to traditional methods. Its robustness is confirmed across various iterative algorithms with different linear equation solvers. The approach also demonstrated time savings in multiple simulations, even including model development time. Additionally, we propose an efficient training data generation strategy. Overall, our method offers an efficient way to accelerate steady-state PDE solutions using neural operators without loss of accuracy, especially relevant in precision-focused scientific applications.


title: Enhancing Social Decision-Making of Autonomous Vehicles: A Mixed-Strategy Game Approach With Interaction Orientation Identification

abstract: The integration of Autonomous Vehicles (AVs) into existing human-driven traffic systems poses considerable challenges, especially within environments where human and machine interactions are frequent and complex, such as at unsignalized intersections. To deal with these challenges, we introduce a novel framework predicated on dynamic and socially-aware decision-making game theory to augment the social decision-making prowess of AVs in mixed driving environments. This comprehensive framework is delineated into three primary modules: Interaction Orientation Identification, Mixed-Strategy Game Modeling, and Expert Mode Learning. We introduce 'Interaction Orientation' as a metric to evaluate the social decision-making tendencies of various agents, incorporating both environmental factors and trajectory characteristics. The mixed-strategy game model developed as part of this framework considers the evolution of future traffic scenarios and includes a utility function that balances safety, operational efficiency, and the unpredictability of environmental conditions. To adapt to real-world driving complexities, our framework utilizes a dynamic optimization framework for assimilating and learning from expert human driving strategies. These strategies are compiled into a comprehensive strategy library, serving as a reference for future decision-making processes. The proposed approach is validated through extensive driving datasets and human-in-loop driving experiments, and the results demonstrate marked enhancements in decision timing and precision.


title: Multiband Metallic Ground State in Multilayered Nickelates La$_3$Ni$_2$O$_7$ and La$_4$Ni$_3$O$_{10}$ Probed by $^{139}$La-NMR at Ambient Pressure

abstract: We report a $^{139}$La-NMR study of polycrystalline samples of multi($n$)-layered nickelates, La$_3$Ni$_2$O$_{7-\delta}$ ($n=2$) and La$_4$Ni$_3$O$_{10-\delta}$ ($n=3$), at ambient pressure. Measurements of the nuclear magnetic resonance (NMR) spectra and nuclear spin relaxation rate ($1/T_1$) indicate the emergence of a density wave order with a gap below $T^*\sim150$ K for La$_3$Ni$_2$O$_{7-\delta}$ and $\sim130$ K for La$_4$Ni$_3$O$_{10-\delta}$. The finite value of $1/T_1$ below $T^*$ indicates metallic ground states with the remaining density of states at the Fermi level ($E_{\rm F}$) under the density wave order. These features are attributed to multiple $d$ electron bands with different characteristics. Above $T^*$, the gradual decrease in $1/T_1T$ upon cooling implies the presence of a band with flat dispersion near $E_{\rm F}$. From our microscopic probes, we point out that these nickelates ($n=2$ and $3$) possess similar electronic states despite the difference in the formal valence of the Ni-$d$ electron states, which provides a basis for understanding the novel high-$T_{\rm c}$ superconductivity under high pressures.


title: A Summary of Privacy-Preserving Data Publishing in the Local Setting

abstract: The exponential growth of collected, processed, and shared data has given rise to concerns about individuals' privacy. Consequently, various laws and regulations have been established to oversee how organizations handle and safeguard data. One such method is Statistical Disclosure Control, which aims to minimize the risk of exposing confidential information by de-identifying it. This de-identification is achieved through specific privacy-preserving techniques. However, a trade-off exists: de-identified data can often lead to a loss of information, which might impact the accuracy of data analysis and the predictive capability of models. The overarching goal remains to safeguard individual privacy while preserving the data's interpretability, meaning its overall usefulness. Despite advances in Statistical Disclosure Control, the field continues to evolve, with no definitive solution that strikes an optimal balance between privacy and utility. This survey delves into the intricate processes of de-identification. We outline the current privacy-preserving techniques employed in microdata de-identification, delve into privacy measures tailored for various disclosure scenarios, and assess metrics for information loss and predictive performance. Herein, we tackle the primary challenges posed by privacy constraints, overview predominant strategies to mitigate these challenges, categorize privacy-preserving techniques, offer a theoretical assessment of current comparative research, and highlight numerous unresolved issues in the domain.


title: Initializing Services in Interactive ML Systems for Diverse Users

abstract: This paper studies ML systems that interactively learn from users across multiple subpopulations with heterogeneous data distributions. The primary objective is to provide specialized services for different user groups while also predicting user preferences. Once the users select a service based on how well the service anticipated their preference, the services subsequently adapt and refine themselves based on the user data they accumulate, resulting in an iterative, alternating minimization process between users and services (learning dynamics). Employing such tailored approaches has two main challenges: (i) Unknown user preferences: Typically, data on user preferences are unavailable without interaction, and uniform data collection across a large and diverse user base can be prohibitively expensive. (ii) Suboptimal Local Solutions: The total loss (sum of loss functions across all users and all services) landscape is not convex even if the individual losses on a single service are convex, making it likely for the learning dynamics to get stuck in local minima. The final outcome of the aforementioned learning dynamics is thus strongly influenced by the initial set of services offered to users, and is not guaranteed to be close to the globally optimal outcome. In this work, we propose a randomized algorithm to adaptively select very few users to collect preference data from, while simultaneously initializing a set of services. We prove that under mild assumptions on the loss functions, the expected total loss achieved by the algorithm right after initialization is within a factor of the globally optimal total loss with complete user preference data, and this factor scales only logarithmically in the number of services. Our theory is complemented by experiments on real as well as semi-synthetic datasets.


title: Final parsec evolution in the presence of intermediate mass black holes

abstract: In this short note, we draw attention to the possibility that, under favorable conditions, the final parsec problem could be alleviated by the presence of a moderate population of intermediate mass black holes in the centers of merged galaxies.


title: Average hitting times in some $f$-equitable graphs

abstract: It is known that the average hitting times of simple random walks from any vertex to any other vertex in distance-regular graphs are determined by their intersection array. In this paper, we introduce a new graph classification called $f$-equitable, utilizing both the equitable partition and the function $f$, which represents a generalization of distance-regular graphs. We determine the average hitting times from any vertex to any other vertex in $f$-equitable graphs by using their parameter referred to as the quotient matrix. Furthermore, we prove that there is some function $f$ such that the Cartesian product of two strongly regular graphs is $f$-equitable. We then calculate the quotient matrix for these graphs and determine the average hitting times from any vertex to any other vertex in these graphs. In the same manner, we determine the average hitting times on some generalized Paley graphs.


title: Active contours driven by local and global intensity fitting energy with application to SAR image segmentation and its fast solvers

abstract: In this paper, we propose a novel variational active contour model based on Aubert-Aujol (AA) denoising model, which hybrides geodesic active contour (GAC) model with active contours without edges (ACWE) model and can be used to segment images corrupted by multiplicative gamma noise. We transform the proposed model into classic ROF model by adding a proximity term. Inspired by a fast denosing algorithm proposed by Jia-Zhao recently, we propose two fast fixed point algorithms to solve SAR image segmentation question. Experimental results for real SAR images show that the proposed image segmentation model can efficiently stop the contours at weak or blurred edges, and can automatically detect the exterior and interior boundaries of images with multiplicative gamma noise. The proposed fast fixed point algorithms are robustness to initialization contour, and can further reduce about 15% of the time needed for algorithm proposed by Goldstein-Osher.


title: GCNext: Towards the Unity of Graph Convolutions for Human Motion Prediction

abstract: The past few years has witnessed the dominance of Graph Convolutional Networks (GCNs) over human motion prediction.Various styles of graph convolutions have been proposed, with each one meticulously designed and incorporated into a carefully-crafted network architecture. This paper breaks the limits of existing knowledge by proposing Universal Graph Convolution (UniGC), a novel graph convolution concept that re-conceptualizes different graph convolutions as its special cases. Leveraging UniGC on network-level, we propose GCNext, a novel GCN-building paradigm that dynamically determines the best-fitting graph convolutions both sample-wise and layer-wise. GCNext offers multiple use cases, including training a new GCN from scratch or refining a preexisting GCN. Experiments on Human3.6M, AMASS, and 3DPW datasets show that, by incorporating unique module-to-network designs, GCNext yields up to 9x lower computational cost than existing GCN methods, on top of achieving state-of-the-art performance.


title: Distributed Semi-global Output Feedback Formation Maneuver Control of High-order Multi-agent Systems

abstract: This paper addresses the formation maneuver control problem of leader-follower multi-agent systems with high-order integrator dynamics. A distributed output feedback formation maneuver controller is proposed to achieve desired maneuvers so that the scale, orientation, translation, and shape of formation can be manipulated continuously, where the followers do not need to know or estimate the time-varying maneuver parameters only known to the leaders. Compared with existing relative-measurement-based formation maneuver control, the advantages of the proposed method are that it is output (relative output) feedback based and shows how to realize different types of formation shape. In addition, it can be applied to non-generic and non-convex nominal configurations and the leaders are allowed to be maneuvered. It is worth noting that the proposed method can also be extended to general linear multi-agent systems under some additional conditions. The theoretical results are demonstrated by a simulation example.


title: Predicting Human Translation Difficulty with Neural Machine Translation

abstract: Human translators linger on some words and phrases more than others, and predicting this variation is a step towards explaining the underlying cognitive processes. Using data from the CRITT Translation Process Research Database, we evaluate the extent to which surprisal and attentional features derived from a Neural Machine Translation (NMT) model account for reading and production times of human translators. We find that surprisal and attention are complementary predictors of translation difficulty, and that surprisal derived from a NMT model is the single most successful predictor of production duration. Our analyses draw on data from hundreds of translators operating across 13 language pairs, and represent the most comprehensive investigation of human translation difficulty to date.


title: Re-exploring Control Strategies in a Non-Markovian Open Quantum System by Reinforcement Learning

abstract: In this study, we reexamine a recent optimal control simulation targeting the preparation of a superposition of two excited electronic states in the UV range in a complex molecular system. We revisit this control from the perspective of reinforcement learning, offering an efficient alternative to conventional quantum control methods. The two excited states are addressable by orthogonal polarizations and their superposition corresponds to a right or left localization of the electronic density. The pulse duration spans tens of femtoseconds to prevent excitation of higher excited bright states what leads to a strong perturbation by the nuclear motions. We modify an open source software by L. Giannelli et al., Phys. Lett. A, 434, 128054 (2022) that implements reinforcement learning with Lindblad dynamics, to introduce non-Markovianity of the surrounding either by timedependent rates or more exactly by using the hierarchical equations of motion with the QuTiP-BoFiN package. This extension opens the way to wider applications for non-Markovian environments, in particular when the active system interacts with a highly structured noise.


title: Outer Channel of DNA-Based Data Storage: Capacity and Efficient Coding Schemes

abstract: In this paper, we consider the outer channel for DNA-based data storage, where each DNA string is either correctly transmitted, or being erased, or being corrupted by uniformly distributed random substitution errors, and all strings are randomly shuffled with each other. We first derive the capacity of the outer channel, which surprisingly implies that the uniformly distributed random substitution errors are only as harmful as the erasure errors. Next, we propose efficient coding schemes which encode the bits at the same position of different strings into a codeword. We compute the soft/hard information of each bit, which allows us to independently decode the bits within a codeword, leading to an independent decoding scheme. To improve the decoding performance, we measure the reliability of each string based on the independent decoding result, and perform a further step of decoding over the most reliable strings, leading to a joint decoding scheme. Simulations with low-density parity-check codes confirm that the joint decoding scheme can reduce the frame error rate by more than 3 orders of magnitude compared to the independent decoding scheme, and it can outperform the state-of-the-art decoding scheme in the literature in a wide parameter regions.


title: Existence and qualitative properties of solutions for a Choquard-type equation with Hardy potential

abstract: In this paper, we study the existence and qualitative properties of positive solutions to a Choquard-type equation with Hardy potential. We develop a nonlocal version of concentration-compactness principle involving the Hardy potential to study the existence and the asymptotic behavior of positive solutions by transforming the original problem into a new nonlocal problem in the weighted Sobolev space. Moreover, we obtain the symmetry of solutions by using the moving plane method.


title: Self-supervised Learning for Enhancing Geometrical Modeling in 3D-Aware Generative Adversarial Network

abstract: 3D-aware Generative Adversarial Networks (3D-GANs) currently exhibit artifacts in their 3D geometrical modeling, such as mesh imperfections and holes. These shortcomings are primarily attributed to the limited availability of annotated 3D data, leading to a constrained "valid latent area" for satisfactory modeling. To address this, we present a Self-Supervised Learning (SSL) technique tailored as an auxiliary loss for any 3D-GAN, designed to improve its 3D geometrical modeling capabilities. Our approach pioneers an inversion technique for 3D-GANs, integrating an encoder that performs adaptive spatially-varying range operations. Utilizing this inversion, we introduce the Cyclic Generative Constraint (CGC), aiming to densify the valid latent space. The CGC operates via augmented local latent vectors that maintain the same geometric form, and it imposes constraints on the cycle path outputs, specifically the generator-encoder-generator sequence. This SSL methodology seamlessly integrates with the inherent GAN loss, ensuring the integrity of pre-existing 3D-GAN architectures without necessitating alterations. We validate our approach with comprehensive experiments across various datasets and architectures, underscoring its efficacy. Our project website: https://3dgan-ssl.github.io


title: Anderson transition and mobility edges on hyperbolic lattices

abstract: Hyperbolic lattices, formed by tessellating the hyperbolic plane with regular polygons, exhibit a diverse range of exotic physical phenomena beyond conventional Euclidean lattices. Here, we investigate the impact of disorder on hyperbolic lattices and reveal that the Anderson localization occurs at strong disorder strength, accompanied by the presence of mobility edges. Taking the hyperbolic $\{p,q\}=\{3,8\}$ and $\{p,q\}=\{4,8\}$ lattices as examples, we employ finite-size scaling of both spectral statistics and the inverse participation ratio to pinpoint the transition point and critical exponents. Our findings indicate that the transition points tend to increase with larger values of $\{p,q\}$ or curvature. In the limiting case of $\{\infty, q\}$, we further determine its Anderson transition using the cavity method, drawing parallels with the random regular graph. Our work lays the cornerstone for a comprehensive understanding of Anderson transition and mobility edges in non-Euclidean lattices.


title: SimCalib: Graph Neural Network Calibration based on Similarity between Nodes

abstract: Graph neural networks (GNNs) have exhibited impressive performance in modeling graph data as exemplified in various applications. Recently, the GNN calibration problem has attracted increasing attention, especially in cost-sensitive scenarios. Previous work has gained empirical insights on the issue, and devised effective approaches for it, but theoretical supports still fall short. In this work, we shed light on the relationship between GNN calibration and nodewise similarity via theoretical analysis. A novel calibration framework, named SimCalib, is accordingly proposed to consider similarity between nodes at global and local levels. At the global level, the Mahalanobis distance between the current node and class prototypes is integrated to implicitly consider similarity between the current node and all nodes in the same class. At the local level, the similarity of node representation movement dynamics, quantified by nodewise homophily and relative degree, is considered. Informed about the application of nodewise movement patterns in analyzing nodewise behavior on the over-smoothing problem, we empirically present a possible relationship between over-smoothing and GNN calibration problem. Experimentally, we discover a correlation between nodewise similarity and model calibration improvement, in alignment with our theoretical results. Additionally, we conduct extensive experiments investigating different design factors and demonstrate the effectiveness of our proposed SimCalib framework for GNN calibration by achieving state-of-the-art performance on 14 out of 16 benchmarks.


title: Conceptual Design of a Low-Energy Ion Beam Storage Ring and a Recoil Separator to Study Radiative Neutron Capture by Radioactive Ions

abstract: Recently, the TRIUMF Storage Ring (TRISR), a storage ring for the existing Isotope Separator and Accelerator-I (ISAC-I) radioactive ion beam facility at TRIUMF, was proposed. It may be possible to directly measure neutron-induced radiative capture reactions in inverse kinematics by combining the ring with a high-flux neutron generator as the neutron target. Herein, we present the conceptual design of a low-energy ion storage ring as well as a fusion product extraction system with a Wien filter and recoil separator for detecting neutron capture products based on ion optical calculations and particle-tracking simulations.


title: Negativity and its capacity in JT gravity

abstract: We study the refined R\'{e}nyi negativity in the matrix model of Jackiw-Teitelboim (JT) gravity. We first consider the JT gravity with dynamical branes, which serves as a toy model of the evaporating black hole. By including the backreaction of branes, we find that the refined R\'{e}nyi negativity monotonically decreases at late time of the evaporation. Next we define a novel quantity, which we call ``capacity of negativity,'' as a derivative of the refined R\'{e}nyi negativity with respect to the replica number. We find that the capacity of negativity has two peaks as a function of time, which comes from the exchange of dominance of the different types of replica wormholes.


title: MG-Skip: Random Multi-Gossip Skipping Method for Nonsmooth Distributed Optimization

abstract: Distributed optimization methods with probabilistic local updates have recently gained attention for their provable ability to communication acceleration. Nevertheless, this capability is effective only when the loss function is smooth and the network is sufficiently well-connected. In this paper, we propose the first linear convergent method MG-Skip with probabilistic local updates for nonsmooth distributed optimization. Without any extra condition for the network connectivity, MG-Skip allows for the multiple-round gossip communication to be skipped in most iterations, while its iteration complexity is $\mathcal{O}\left(\kappa \log \frac{1}{\epsilon}\right)$ and communication complexity is only $\mathcal{O}\left(\sqrt{\frac{\kappa}{(1-\rho)}} \log \frac{1}{\epsilon}\right)$, where $\kappa$ is the condition number of the loss function and $\rho$ reflects the connectivity of the network topology. To the best of our knowledge, MG-Skip achieves the best communication complexity when the loss function has the smooth (strongly convex)+nonsmooth (convex) composite form.


title: Topo-MLP : A Simplicial Network Without Message Passing

abstract: Due to their ability to model meaningful higher order relations among a set of entities, higher order network models have emerged recently as a powerful alternative for graph-based network models which are only capable of modeling binary relationships. Message passing paradigm is still dominantly used to learn representations even for higher order network models. While powerful, message passing can have disadvantages during inference, particularly when the higher order connectivity information is missing or corrupted. To overcome such limitations, we propose Topo-MLP, a purely MLP-based simplicial neural network algorithm to learn the representation of elements in a simplicial complex without explicitly relying on message passing. Our framework utilizes a novel Higher Order Neighborhood Contrastive (HONC) loss which implicitly incorporates the simplicial structure into representation learning. Our proposed model's simplicity makes it faster during inference. Moreover, we show that our model is robust when faced with missing or corrupted connectivity structure.


title: Neural Network Approximation for Pessimistic Offline Reinforcement Learning

abstract: Deep reinforcement learning (RL) has shown remarkable success in specific offline decision-making scenarios, yet its theoretical guarantees are still under development. Existing works on offline RL theory primarily emphasize a few trivial settings, such as linear MDP or general function approximation with strong assumptions and independent data, which lack guidance for practical use. The coupling of deep learning and Bellman residuals makes this problem challenging, in addition to the difficulty of data dependence. In this paper, we establish a non-asymptotic estimation error of pessimistic offline RL using general neural network approximation with $\mathcal{C}$-mixing data regarding the structure of networks, the dimension of datasets, and the concentrability of data coverage, under mild assumptions. Our result shows that the estimation error consists of two parts: the first converges to zero at a desired rate on the sample size with partially controllable concentrability, and the second becomes negligible if the residual constraint is tight. This result demonstrates the explicit efficiency of deep adversarial offline RL frameworks. We utilize the empirical process tool for $\mathcal{C}$-mixing sequences and the neural network approximation theory for the H\"{o}lder class to achieve this. We also develop methods to bound the Bellman estimation error caused by function approximation with empirical Bellman constraint perturbations. Additionally, we present a result that lessens the curse of dimensionality using data with low intrinsic dimensionality and function classes with low complexity. Our estimation provides valuable insights into the development of deep offline RL and guidance for algorithm model design.


title: Macroscopic entanglement between ferrimagnetic magnons and atoms via crossed optical cavity

abstract: We consider a two-dimensional opto-magnomechanical (OMM) system including two optical cavity modes, a magnon mode, a phonon mode, and a collection of two-level atoms. In this study, we demonstrate the methodology for generating stationary entanglement between two-level atoms and magnons, which are implemented using two optical cavities inside the setup. Additionally, we investigate the efficiency of transforming entanglement from atom-phonon entanglement to atom-magnon entanglement. The magnons are stimulated by both a bias magnetic field and a microwave magnetic field, and they interact with phonons through the mechanism of magnetostrictive interaction. This interaction generates magnomechanical displacement, which couples to an optical cavity via radiation pressure. We demonstrate that by carefully selecting the frequency detuning of an optical cavity, it is possible to achieve an increase in bipartite entanglements. Furthermore, this improvement is found to be resistant to changes in temperature. The entanglement between atoms and magnons plays a crucial role in the construction of hybrid quantum networks. Our modeling approach exhibits potential applications in the field of magneto-optical trap systems as well.


title: Large Language Models Play StarCraft II: Benchmarks and A Chain of Summarization Approach

abstract: StarCraft II is a challenging benchmark for AI agents due to the necessity of both precise micro level operations and strategic macro awareness. Previous works, such as Alphastar and SCC, achieve impressive performance on tackling StarCraft II , however, still exhibit deficiencies in long term strategic planning and strategy interpretability. Emerging large language model (LLM) agents, such as Voyage and MetaGPT, presents the immense potential in solving intricate tasks. Motivated by this, we aim to validate the capabilities of LLMs on StarCraft II, a highly complex RTS game.To conveniently take full advantage of LLMs` reasoning abilities, we first develop textual StratCraft II environment, called TextStarCraft II, which LLM agent can interact. Secondly, we propose a Chain of Summarization method, including single frame summarization for processing raw observations and multi frame summarization for analyzing game information, providing command recommendations, and generating strategic decisions. Our experiment consists of two parts: first, an evaluation by human experts, which includes assessing the LLMs`s mastery of StarCraft II knowledge and the performance of LLM agents in the game; second, the in game performance of LLM agents, encompassing aspects like win rate and the impact of Chain of Summarization.Experiment results demonstrate that: 1. LLMs possess the relevant knowledge and complex planning abilities needed to address StarCraft II scenarios; 2. Human experts consider the performance of LLM agents to be close to that of an average player who has played StarCraft II for eight years; 3. LLM agents are capable of defeating the built in AI at the Harder(Lv5) difficulty level. We have open sourced the code and released demo videos of LLM agent playing StarCraft II.


title: Adaptive Tracking and Perching for Quadrotor in Dynamic Scenarios

abstract: Perching on the moving platforms is a promising solution to enhance the endurance and operational range of quadrotors, which could benefit the efficiency of a variety of air-ground cooperative tasks. To ensure robust perching, tracking with a steady relative state and reliable perception is a prerequisite. This paper presents an adaptive dynamic tracking and perching scheme for autonomous quadrotors to achieve tight integration with moving platforms. For reliable perception of dynamic targets, we introduce elastic visibility-aware planning to actively avoid occlusion and target loss. Additionally, we propose a flexible terminal adjustment method that adapts the changes in flight duration and the coupled terminal states, ensuring full-state synchronization with the time-varying perching surface at various angles. A relaxation strategy is developed by optimizing the tangential relative speed to address the dynamics and safety violations brought by hard boundary conditions. Moreover, we take SE(3) motion planning into account to ensure no collision between the quadrotor and the platform until the contact moment. Furthermore, we propose an efficient spatiotemporal trajectory optimization framework considering full state dynamics for tracking and perching. The proposed method is extensively tested through benchmark comparisons and ablation studies. To facilitate the application of academic research to industry and to validate the efficiency of our scheme under strictly limited computational resources, we deploy our system on a commercial drone (DJI-MAVIC3) with a full-size sport-utility vehicle (SUV). We conduct extensive real-world experiments, where the drone successfully tracks and perches at 30~km/h (8.3~m/s) on the top of the SUV, and at 3.5~m/s with 60{\deg} inclined into the trunk of the SUV.


title: Point Cloud Part Editing: Segmentation, Generation, Assembly, and Selection

abstract: Ideal part editing should guarantee the diversity of edited parts, the fidelity to the remaining parts, and the quality of the results. However, previous methods do not disentangle each part completely, which means the edited parts will affect the others, resulting in poor diversity and fidelity. In addition, some methods lack constraints between parts, which need manual selections of edited results to ensure quality. Therefore, we propose a four-stage process for point cloud part editing: Segmentation, Generation, Assembly, and Selection. Based on this process, we introduce SGAS, a model for part editing that employs two strategies: feature disentanglement and constraint. By independently fitting part-level feature distributions, we realize the feature disentanglement. By explicitly modeling the transformation from object-level distribution to part-level distributions, we realize the feature constraint. Considerable experiments on different datasets demonstrate the efficiency and effectiveness of SGAS on point cloud part editing. In addition, SGAS can be pruned to realize unsupervised part-aware point cloud generation and achieves state-of-the-art results.


title: Dynamic Loco-manipulation on HECTOR: Humanoid for Enhanced ConTrol and Open-source Research

abstract: Despite their remarkable advancement in locomotion and manipulation, humanoid robots remain challenged by a lack of synchronized loco-manipulation control, hindering their full dynamic potential. In this work, we introduce a versatile and effective approach to controlling and generalizing dynamic locomotion and loco-manipulation on humanoid robots via a Force-and-moment-based Model Predictive Control (MPC). Specifically, we proposed a simplified rigid body dynamics (SRBD) model to take into account both humanoid and object dynamics for humanoid loco-manipulation. This linear dynamics model allows us to directly solve for ground reaction forces and moments via an MPC problem to achieve highly dynamic real-time control. Our proposed framework is highly versatile and generalizable. We introduce HECTOR (Humanoid for Enhanced ConTrol and Open-source Research) platform to demonstrate its effectiveness in hardware experiments. With the proposed framework, HECTOR can maintain exceptional balance during double-leg stance mode, even when subjected to external force disturbances to the body or foot location. In addition, it can execute 3-D dynamic walking on a variety of uneven terrains, including wet grassy surfaces, slopes, randomly placed wood slats, and stacked wood slats up to 6 cm high with the speed of 0.6 m/s. In addition, we have demonstrated dynamic humanoid loco-manipulation over uneven terrain, carrying 2.5 kg load. HECTOR simulations, along with the proposed control framework, are made available as an open-source project. (https://github.com/DRCL-USC/Hector_Simulation).


title: Pinned Billiard Balls Simulation (WXML Autumn 2023 report)

abstract: Systems of pinned billiard balls serve as simplified models of collisions, where all particles remain fixed in their positions while their (pseudo-)velocities evolve in accordance with the laws of conservation of energy and momentum. For some families of ball configurations, Athreya, Burdzy, and Duarte have established the maximum upper bound for the number of pseudo-collisions, thereby demonstrating that the number of collisions is finite. The result has been extended to all ball configurations. In this project, we do extensive simulations to study two specific configurations. First, we consider balls arranged in a half-space and assign a single ball an inward (pseudo-) velocity. Simulations suggest that in the long run, most of the energy is concentrated near the boundary. Second, when the balls are arranged on a flat torus, we find that in the stationary regime, the distributions of the velocity components are i.i.d. normal. Additionally, we find that the components of the velocities in the direction of impact between two touching balls are uncorrelated.


title: A Revisit of Fake News Dataset with Augmented Fact-checking by ChatGPT

abstract: The proliferation of fake news has emerged as a critical issue in recent years, requiring significant efforts to detect it. However, the existing fake news detection datasets are sourced from human journalists, which are likely to have inherent bias limitations due to the highly subjective nature of this task. In this paper, we revisit the existing fake news dataset verified by human journalists with augmented fact-checking by large language models (ChatGPT), and we name the augmented fake news dataset ChatGPT-FC. We quantitatively analyze the distinctions and resemblances between human journalists and LLM in assessing news subject credibility, news creator credibility, time-sensitive, and political framing. Our findings highlight LLM's potential to serve as a preliminary screening method, offering a promising avenue to mitigate the inherent biases of human journalists and enhance fake news detection.


title: Meili: Enabling SmartNIC as a Service in the Cloud

abstract: SmartNICs are touted as an attractive substrate for network application offloading, offering benefits in programmability, host resource saving, and energy efficiency. The current usage restricts offloading to local hosts and confines SmartNIC ownership to individual application teams, resulting in poor resource efficiency and scalability. This paper presents Meili, a novel system that realizes SmartNIC as a service to address these issues. Meili organizes heterogeneous SmartNIC resources as a pool and offers a unified one-NIC abstraction to application developers. This allows developers to focus solely on the application logic while dynamically optimizing their performance needs. Our evaluation on NVIDIA BlueField series and AMD Pensando SmartNICs demonstrates that Meili achieves scalable single-flow throughput with a maximum 8 {\mu}s latency overhead and enhances resource efficiency by 3.07$\times$ compared to standalone deployments and 1.44$\times$ compared to state-of-the-art microservice deployments.


title: Beyond Prototypes: Semantic Anchor Regularization for Better Representation Learning

abstract: One of the ultimate goals of representation learning is to achieve compactness within a class and well-separability between classes. Many outstanding metric-based and prototype-based methods following the Expectation-Maximization paradigm, have been proposed for this objective. However, they inevitably introduce biases into the learning process, particularly with long-tail distributed training data. In this paper, we reveal that the class prototype is not necessarily to be derived from training features and propose a novel perspective to use pre-defined class anchors serving as feature centroid to unidirectionally guide feature learning. However, the pre-defined anchors may have a large semantic distance from the pixel features, which prevents them from being directly applied. To address this issue and generate feature centroid independent from feature learning, a simple yet effective Semantic Anchor Regularization (SAR) is proposed. SAR ensures the interclass separability of semantic anchors in the semantic space by employing a classifier-aware auxiliary cross-entropy loss during training via disentanglement learning. By pulling the learned features to these semantic anchors, several advantages can be attained: 1) the intra-class compactness and naturally inter-class separability, 2) induced bias or errors from feature learning can be avoided, and 3) robustness to the long-tailed problem. The proposed SAR can be used in a plug-and-play manner in the existing models. Extensive experiments demonstrate that the SAR performs better than previous sophisticated prototype-based methods. The implementation is available at https://github.com/geyanqi/SAR.


title: Faster Algorithms for Internal Dictionary Queries

abstract: In this paper, we consider the problem of preprocessing a text $T$ of length $n$ and a dictionary $\mathcal{D}$ to answer multiple types of pattern queries. Inspired by [Charalampopoulos-Kociumaka-Mohamed-Radoszewski-Rytter-Wale\'n ISAAC 2019], we consider the Internal Dictionary, where the dictionary is interval in the sense that every pattern is given as a fragment of $T$. Therefore, the size of $\mathcal{D}$ is proportional to the number of patterns instead of their total length, which could be $\Theta(n \cdot |\mathcal{D}|)$. We propose a new technique to preprocess $T$ and organize the substring structure. In this way, we are able to develop algorithms to answer queries more efficiently than in previous works.


title: Searches for Additional Scalars at Future $e^{+} e^{-}$ Colliders

abstract: We present growing excesses consistent with a 95 GeV scalar. We provide a comprehensive analysis of the Two Higgs Doublet Model and an additional singlet (2HDM+S) at future $e^{+} e^{-}$ collider. In particular, we provide a precise mass reconstruction measurement for the scalar, $m_{S}$, using the recoil mass method through $e^{+} e^{-} \to Z S$ where $Z \to \mu_{+} \mu_{-}$ and $S \to b \bar{b}$ at $\sqrt{s} = 250$~GeV and $\sqrt{s} = 200$~GeV. Furthermore, we employ Deep Neural Network to analyze the properties and behaviour of the scalar particle with a mass most importantly to provide enhanced resolution for the separation between beyond the Standard Model (SM) signal and SM background in the region 95 - 96 GeV in the $S \to b \bar{b}$ for $\mu_{+} \mu_{-}$ channel. A 95 GeV scalar can be observed with $5\sigma$ significance at $15(10)$ fb$^{-1}$ integrated luminosity for $\sqrt{s} = 250(200)$~GeV. This strengthens the discovery of the potential of the future $e^{+} e^{-}$ collider.


title: Sparse is Enough in Fine-tuning Pre-trained Large Language Models

abstract: With the prevalence of pre-training-fine-tuning paradigm, how to efficiently adapt the pre-trained model to the downstream tasks has been an intriguing issue. Parameter-Efficient Fine-Tuning (PEFT) methods have been proposed for low-cost adaptation. Although PEFT has demonstrated effectiveness and been widely applied, the underlying principles are still unclear. In this paper, we adopt the PAC-Bayesian generalization error bound, viewing pre-training as a shift of prior distribution which leads to a tighter bound for generalization error. We validate this shift from the perspectives of oscillations in the loss landscape and the quasi-sparsity in gradient distribution. Based on this, we propose a gradient-based sparse fine-tuning algorithm, named Sparse Increment Fine-Tuning (SIFT), and validate its effectiveness on a range of tasks including the GLUE Benchmark and Instruction-tuning. The code is accessible at https://github.com/song-wx/SIFT/.


title: On recognition algorithms and structure of graphs with restricted induced cycles

abstract: This is my PhD thesis which was defended in May 2021. We call an induced cycle of length at least four a hole. The parity of a hole is the parity of its length. Forbidding holes of certain types in a graph has deep structural implications. In 2006, Chudnovksy, Seymour, Robertson, and Thomas famously proved that a graph is perfect if and only if it does not contain an odd hole or a complement of an odd hole. In 2002, Conforti, Cornu\'{e}jols, Kapoor and Vu\v{s}kov\'{i}c provided a structural description of the class of even-hole-free graphs. In Chapter 3, we provide a structural description of all graphs that contain only holes of length $\ell$ for every $\ell \geq 7$. Analysis of how holes interact with graph structure has yielded detection algorithms for holes of various lengths and parities. In 1991, Bienstock showed it is NP-Hard to test whether a graph G has an even (or odd) hole containing a specified vertex $v \in V(G)$. In 2002, Conforti, Cornu\'{e}jols, Kapoor and Vu\v{s}kov\'{i}c gave a polynomial-time algorithm to recognize even-hole-free graphs using their structure theorem. In 2003, Chudnovsky, Kawarabayashi and Seymour provided a simpler and slightly faster algorithm to test whether a graph contains an even hole. In 2019, Chudnovsky, Scott, Seymour and Spirkl provided a polynomial-time algorithm to test whether a graph contains an odd hole. Later that year, Chudnovsky, Scott and Seymour strengthened this result by providing a polynomial-time algorithm to test whether a graph contains an odd hole of length at least $\ell$ for any fixed integer $\ell \geq 5$. In Chapter 2, we provide a polynomial-time algorithm to test whether a graph contains an even hole of length at least $\ell$ for any fixed integer $\ell \geq 4$.


title: A discrete approach to the prescribed Gaussian curvature problem

abstract: We propose a discrete approach to approximate the solution for the prescribed Gaussian curvature problem in 2-dimensional manifolds, based on the notion of discrete conformality. Our approach gives a convenient way to numerically compute the solution by minimizing a convex functional.


title: Nested homotopy models of finite metric spaces and their spectral homology

abstract: For a real $r\geq 0,$ we consider the notion of $r$-homotopy equivalence in the category quasimetric spaces, which includes metric spaces and directed graphs. We show that for a finite quasimetric space $X$ there is a unique (up to isometry) $r$-homotopy equivalent quasimetric space of the minimal possible cardinality. It is called the $r$-minimal model of $X$. We use this to construct a decomposition of the magnitude-path spectral sequence of a digraph into a direct sum of spectral sequences with certain properties. We also construct an $r$-homotopy invariant ${\rm SH}^r_{n,I}(X)$ of a quasimetric space $X,$ called spectral homology, that generalizes many other invariants: the pages of the magnitude-path spectral sequence, including path homology, magnitude homology, blurred magnitude homology and reachability homology.


title: The rotating solutions beyond the spontaneous scalarization in Einstein-Maxwell-scalar theory

abstract: The Einstein-Maxwell-scalar (EMS) theory with a quartic coupling function features three branches of fundamental black hole (BH) solutions, labeled as cold, hot, and bald black holes. The static bald black holes (the Reissner-Nordstr\"om BH) exhibit an intriguing nonlinear instability beyond the spontaneous scalarization. We study the rotating scalarized black hole solutions in the EMS model with a quartic coupling function through the spectral method numerically. The domain of existence for the scalarized BHs is presented in the spin-charge region. We found that the rotating solutions for both the two scalarized branches possess similar thermodynamic behavior compared to the static case while varying the electric charge. The BH spin enlarges the thermodynamic differences between the cold and hot branches. The profile of the metric function and the scalar field for the scalarized BHs is depicted, which demonstrates that the scalar field concentrates more on the equatorial plane in contrast to the axisymmetric region as the spin increases.


title: Point Cloud Segmentation Using Transfer Learning with RandLA-Net: A Case Study on Urban Areas

abstract: Urban environments are characterized by complex structures and diverse features, making accurate segmentation of point cloud data a challenging task. This paper presents a comprehensive study on the application of RandLA-Net, a state-of-the-art neural network architecture, for the 3D segmentation of large-scale point cloud data in urban areas. The study focuses on three major Chinese cities, namely Chengdu, Jiaoda, and Shenzhen, leveraging their unique characteristics to enhance segmentation performance. To address the limited availability of labeled data for these specific urban areas, we employed transfer learning techniques. We transferred the learned weights from the Sensat Urban and Toronto 3D datasets to initialize our RandLA-Net model. Additionally, we performed class remapping to adapt the model to the target urban areas, ensuring accurate segmentation results. The experimental results demonstrate the effectiveness of the proposed approach achieving over 80\% F1 score for each areas in 3D point cloud segmentation. The transfer learning strategy proves to be crucial in overcoming data scarcity issues, providing a robust solution for urban point cloud analysis. The findings contribute to the advancement of point cloud segmentation methods, especially in the context of rapidly evolving Chinese urban areas.


title: Punctuation restoration Model and Spacing Model for Korean Ancient Document

abstract: In Korean ancient documents, there is no spacing or punctuation, and they are written in classical Chinese characters. This makes it challenging for modern individuals and translation models to accurately interpret and translate them. While China has models predicting punctuation and spacing, applying them directly to Korean texts is problematic due to data differences. Therefore, we developed the first models which predict punctuation and spacing for Korean historical texts and evaluated their performance. Our punctuation restoration model achieved an F1 score of 0.84, and Spacing model achieved a score of 0.96. It has the advantage of enabling inference on low-performance GPUs with less VRAM while maintaining quite high accuracy.


title: ConsistentEE: A Consistent and Hardness-Guided Early Exiting Method for Accelerating Language Models Inference

abstract: Early Exiting is one of the most popular methods to achieve efficient inference. Current early exiting methods adopt the (weighted) sum of the cross entropy loss of all internal classifiers during training, imposing all these classifiers to predict all instances correctly. However, during inference, as long as one internal classifier predicts an instance correctly, it can accelerate without losing accuracy. Thus, there is a notable gap between training and inference. We propose ConsistentEE, an early exiting method that is consistent in training and inference. ConsistentEE formulates the early exiting process as a reinforcement learning problem. A policy network is added to decide whether an instance should exit or continue. The training objective of ConsistentEE only require each instance to be predicted correctly by one internal classifier. Additionally, we introduce the concept Memorize Layer to measure the hardness of an instance. We incorporate memorized layer into reward function design, which allows "easy" instances to focus more on acceleration while "hard" instances to focus more on accuracy. Experimental results show that our method outperforms other baselines on various natural language understanding and generation tasks.


title: EMU/GAMA: Radio detected galaxies are more obscured than optically selected galaxies

abstract: We demonstrate the importance of radio selection in probing heavily obscured galaxy populations. We combine Evolutionary Map of the Universe (EMU) Early Science data in the Galaxy and Mass Assembly (GAMA) G23 field with the GAMA data, providing optical photometry and spectral line measurements, together with Wide-field Infrared Survey Explorer (WISE) infrared (IR) photometry, providing IR luminosities and colours. We investigate the degree of obscuration in star forming galaxies, based on the Balmer decrement (BD), and explore how this trend varies, over a redshift range of 0<z<0.345. We demonstrate that the radio detected population has on average higher levels of obscuration than the parent optical sample, arising through missing the lowest BD and lowest mass galaxies, which are also the lower star formation rate (SFR) and metallicity systems. We discuss possible explanations for this result, including speculation around whether it might arise from steeper stellar initial mass functions in low mass, low SFR galaxies.


title: Teaching Software Ethics to Future Software Engineers

abstract: The importance of teaching software ethics to software engineering (SE) students is more critical now than ever before as software related ethical issues continue to impact society at an alarming rate. Traditional classroom methods, vignettes, role-play games, and quizzes have been employed over the years to teach SE students about software ethics. Recognising the significance of incorporating software ethics knowledge in SE education and the continued need for more efforts in the area of the teaching and learning of SE ethics, we developed an interactive, scenario-based Software Ethics Quiz. Our goal was to teach SE students about ethics in a comprehensive, open, and engaging manner through a combined approach of an online lecture followed by an interactive workshop with the quiz and a debriefing session. The anonymous quiz responses collected showed promising results regarding the engagement and efficacy of the lecture and quiz, with a slightly better rating for the interactive quiz. The voluntary student feedback collected suggested that a majority of the participants found the debrief discussion on the quiz scenarios to be very beneficial for learning about software ethics. In this experience report, we share our experiences, related educational resources including the quiz, and recommendations from lessons learned with the wider education community to keep driving this critical topic forward


title: A Large-Scale Dataset of Search Interests Related to Disease X Originating from Different Geographic Regions

abstract: The World Health Organization added Disease X to their shortlist of blueprint priority diseases to represent a hypothetical, unknown pathogen that could cause a future epidemic. During different virus outbreaks of the past, such as COVID-19, Influenza, Lyme Disease, and Zika virus, researchers from various disciplines utilized Google Trends to mine multimodal components of web behavior to study, investigate, and analyze the global awareness, preparedness, and response associated with these respective virus outbreaks. As the world prepares for Disease X, a dataset on web behavior related to Disease X would be crucial to contribute towards the timely advancement of research in this field. Furthermore, none of the prior works in this field have focused on the development of a dataset to compile relevant web behavior data, which would help to prepare for Disease X. To address these research challenges, this work presents a dataset of web behavior related to Disease X, which emerged from different geographic regions of the world, between February 2018 and August 2023. Specifically, this dataset presents the search interests related to Disease X from 94 geographic regions. The dataset was developed by collecting data using Google Trends. The relevant search interests for all these regions for each month in this time range are available in this dataset. This paper also discusses the compliance of this dataset with the FAIR principles of scientific data management. Finally, an analysis of this dataset is presented to uphold the applicability, relevance, and usefulness of this dataset for the investigation of different research questions in the interrelated fields of Big Data, Data Mining, Healthcare, Epidemiology, and Data Analysis with a specific focus on Disease X.


title: Informatics-based learning of oxygen vacancy ordering principles in oxygen-deficient perovskites

abstract: Ordered oxygen vacancies (OOVs) in perovskites can exhibit long-range order and may be used to direct materials properties through modifications in electronic structures and broken symmetries. Based on the various vacancy patterns observed in previously known compounds, we explore the ordering principles of OOVs in oxygen-deficient perovskite oxides with $AB\mathrm{O}_{2.5}$ stoichiometry to identify other OOV variants. We performed first-principles calculations to assess the OOV stability on a dataset of 50 OOV structures generated from our bespoke algorithm. The algorithm employs uniform planar vacancy patterns on (111) pseudocubic perovskite layers and the approach proves effective for generating stable OOV patterns with minimal computational loads. We find as expected that the major factors determining the stability of OOV structures include coordination preferences of transition metals and elastic penalties resulting from the assemblies of polyhedra. Cooperative rotational modes of polyhedra within OOV structures reduce elastic instabilities by optimizing the bond valence of $A$- and $B$-cations. This finding explains the observed formation of vacancy channels along low-index crystallographic directions in prototypical OOV phases. The identified ordering principles enable us to devise other stable vacancy patterns with longer periodicity for targeted property design in yet to be synthesized compounds.


title: Searching for Intermediate Mass Black Holes in Globular Clusters Through Tidal Disruption Events

abstract: Intermediate mass black holes (IMBHs) may be the link between stellar mass holes and the supermassive variety in the nuclei of galaxies, and globular clusters (GCs) may be one of the most promising environments for their formation. Here we carry out a pilot study of the observability of tidal disruption events (TDEs) from 10^3 Msun < M_BH < 10^5 Msun IMBHs embedded in stellar cusps at the center of GCs. We model the long super-Eddington accretion phase and ensuing optical flare, and derive the disruption rate of main-sequence stars as a function of black hole mass and GC properties with the help of a 1D Fokker-Planck approach. The photospheric emission of the adiabatically expanding outflow dominates the observable radiation and peaks in the NUV/optical bands, outshining the brightness of the (old) stellar population of GCs in Virgo for a period of months to years. A search for TDE events in a sample of nearly 4,000 GCs observed at multiple epochs by the Next Generation Virgo Cluster Survey (NGVS) yields null results. Given our model predictions, this sample is too small to set stringent constraints on the present-day occupation fraction of GCs hosting IMBHs. Naturally, better simulations of the properties of the cluster central stellar distribution, TDE light curves and rates, together with larger surveys of GCs are all needed to gain deeper insights into the presence of IMBHs in GCs.


title: Angle-Displacement Rigidity Theory with Application to Distributed Network Localization

abstract: This paper investigates the localization problem of a network in 2-D and 3-D spaces given the positions of anchor nodes in a global frame and inter-node relative measurements in local coordinate frames. It is assumed that the local frames of different nodes have different unknown orientations. First, an angle-displacement rigidity theory is developed, which can be used to localize all the free nodes by the known positions of the anchor nodes and local relative measurements (local relative position, distance, local relative bearing, angle, or ratio-of-distance measurements). Then, necessary and sufficient conditions for network localizability are given. Finally, a distributed network localization protocol is proposed, which can globally estimate the locations of all the free nodes of a network if the network is infinitesimally angle-displacement rigid. The proposed method unifies local-relative-position-based, distance-based, local-relative-bearing-based, angle-based, and ratio-of-distance-based distributed network localization approaches. The novelty of this work is that the proposed method can be applied in both generic and non-generic configurations with an unknown global coordinate frame in both 2-D and 3-D spaces.


title: Predicting Line-Level Defects by Capturing Code Contexts with Hierarchical Transformers

abstract: Software defects consume 40% of the total budget in software development and cost the global economy billions of dollars every year. Unfortunately, despite the use of many software quality assurance (SQA) practices in software development (e.g., code review, continuous integration), defects may still exist in the official release of a software product. Therefore, prioritizing SQA efforts for the vulnerable areas of the codebase is essential to ensure the high quality of a software release. Predicting software defects at the line level could help prioritize the SQA effort but is a highly challenging task given that only ~3% of lines of a codebase could be defective. Existing works on line-level defect prediction often fall short and cannot fully leverage the line-level defect information. In this paper, we propose Bugsplorer, a novel deep-learning technique for line-level defect prediction. It leverages a hierarchical structure of transformer models to represent two types of code elements: code tokens and code lines. Unlike the existing techniques that are optimized for file-level defect prediction, Bugsplorer is optimized for a line-level defect prediction objective. Our evaluation with five performance metrics shows that Bugsplorer has a promising capability of predicting defective lines with 26-72% better accuracy than that of the state-of-the-art technique. It can rank the first 20% defective lines within the top 1-3% suspicious lines. Thus, Bugsplorer has the potential to significantly reduce SQA costs by ranking defective lines higher.


title: Difficulty-Focused Contrastive Learning for Knowledge Tracing with a Large Language Model-Based Difficulty Prediction

abstract: This paper presents novel techniques for enhancing the performance of knowledge tracing (KT) models by focusing on the crucial factor of question and concept difficulty level. Despite the acknowledged significance of difficulty, previous KT research has yet to exploit its potential for model optimization and has struggled to predict difficulty from unseen data. To address these problems, we propose a difficulty-centered contrastive learning method for KT models and a Large Language Model (LLM)-based framework for difficulty prediction. These innovative methods seek to improve the performance of KT models and provide accurate difficulty estimates for unseen data. Our ablation study demonstrates the efficacy of these techniques by demonstrating enhanced KT model performance. Nonetheless, the complex relationship between language and difficulty merits further investigation.


title: Hierarchical and Incremental Structural Entropy Minimization for Unsupervised Social Event Detection

abstract: As a trending approach for social event detection, graph neural network (GNN)-based methods enable a fusion of natural language semantics and the complex social network structural information, thus showing SOTA performance. However, GNN-based methods can miss useful message correlations. Moreover, they require manual labeling for training and predetermining the number of events for prediction. In this work, we address social event detection via graph structural entropy (SE) minimization. While keeping the merits of the GNN-based methods, the proposed framework, HISEvent, constructs more informative message graphs, is unsupervised, and does not require the number of events given a priori. Specifically, we incrementally explore the graph neighborhoods using 1-dimensional (1D) SE minimization to supplement the existing message graph with edges between semantically related messages. We then detect events from the message graph by hierarchically minimizing 2-dimensional (2D) SE. Our proposed 1D and 2D SE minimization algorithms are customized for social event detection and effectively tackle the efficiency problem of the existing SE minimization algorithms. Extensive experiments show that HISEvent consistently outperforms GNN-based methods and achieves the new SOTA for social event detection under both closed- and open-set settings while being efficient and robust.


title: Thermalization and Annihilation of Dark Matter in Neutron Stars

abstract: The capture of dark matter, and its subsequent annihilation, can heat old, isolated neutron stars. In order for kinetic heating to be achieved, the captured dark matter must undergo sufficient scattering to deposit its kinetic energy in the star. We find that this energy deposit typically occurs quickly, for most of the relevant parameter space. In order for appreciable annihilation heating to also be achieved, the dark matter must reach a state of capture-annihilation equilibrium in the star. We show that this can be fulfilled for all types of dark matter - baryon interactions. This includes cases where the scattering or annihilation cross sections are momentum or velocity suppressed in the non-relativistic limit. Importantly, we find that capture-annihilation equilibrium, and hence maximal annihilation heating, can be achieved without complete thermalization of the captured dark matter. For scattering cross sections that saturate the capture rate, we find that capture-annihilation equilibrium is typically reached on a timescale of less than $1$ year for vector interactions and $10^4$ years for scalar interactions.


title: Maximum Principle for Control System driven by Mixed Fractional Brownian Motion

abstract: In this paper, we study the optimal control problem for system driven by mixed fractional Brownian motion (including a fractional Brownian motion with Hurst parameter $H>1/2$ and the underlying standard Brownian motion). By using Malliavin calculus, we obtain the necessary condition the optimal control should satisfy. Through martingale representation theorem and the properties of the transforms operator, we give out the adjoint backward stochastic differential equation in a natural way. As a straightforward consequence, the maximum principle for control system driven by fractional Brownian motion and an independent Brownian motion is also deduced, which is different to the underlying case. As an application, the linear quadratic case is investigated to illustrate the main results.


title: 3D-LFM: Lifting Foundation Model

abstract: The lifting of 3D structure and camera from 2D landmarks is at the cornerstone of the entire discipline of computer vision. Traditional methods have been confined to specific rigid objects, such as those in Perspective-n-Point (PnP) problems, but deep learning has expanded our capability to reconstruct a wide range of object classes (e.g. C3DPO and PAUL) with resilience to noise, occlusions, and perspective distortions. All these techniques, however, have been limited by the fundamental need to establish correspondences across the 3D training data -- significantly limiting their utility to applications where one has an abundance of "in-correspondence" 3D data. Our approach harnesses the inherent permutation equivariance of transformers to manage varying number of points per 3D data instance, withstands occlusions, and generalizes to unseen categories. We demonstrate state of the art performance across 2D-3D lifting task benchmarks. Since our approach can be trained across such a broad class of structures we refer to it simply as a 3D Lifting Foundation Model (3D-LFM) -- the first of its kind.


title: Analyzing Public Reactions, Perceptions, and Attitudes during the MPox Outbreak: Findings from Topic Modeling of Tweets

abstract: The recent outbreak of the MPox virus has resulted in a tremendous increase in the usage of Twitter. Prior works in this area of research have primarily focused on the sentiment analysis and content analysis of these Tweets, and the few works that have focused on topic modeling have multiple limitations. This paper aims to address this research gap and makes two scientific contributions to this field. First, it presents the results of performing Topic Modeling on 601,432 Tweets about the 2022 Mpox outbreak that were posted on Twitter between 7 May 2022 and 3 March 2023. The results indicate that the conversations on Twitter related to Mpox during this time range may be broadly categorized into four distinct themes - Views and Perspectives about Mpox, Updates on Cases and Investigations about Mpox, Mpox and the LGBTQIA+ Community, and Mpox and COVID-19. Second, the paper presents the findings from the analysis of these Tweets. The results show that the theme that was most popular on Twitter (in terms of the number of Tweets posted) during this time range was Views and Perspectives about Mpox. This was followed by the theme of Mpox and the LGBTQIA+ Community, which was followed by the themes of Mpox and COVID-19 and Updates on Cases and Investigations about Mpox, respectively. Finally, a comparison with related studies in this area of research is also presented to highlight the novelty and significance of this research work.


title: Stable Relay Learning Optimization Approach for Fast Power System Production Cost Minimization Simulation

abstract: Production cost minimization (PCM) simulation is commonly employed for assessing the operational efficiency, economic viability, and reliability, providing valuable insights for power system planning and operations. However, solving a PCM problem is time-consuming, consisting of numerous binary variables for simulation horizon extending over months and years. This hinders rapid assessment of modern energy systems with diverse planning requirements. Existing methods for accelerating PCM tend to sacrifice accuracy for speed. In this paper, we propose a stable relay learning optimization (s-RLO) approach within the Branch and Bound (B&B) algorithm. The proposed approach offers rapid and stable performance, and ensures optimal solutions. The two-stage s-RLO involves an imitation learning (IL) phase for accurate policy initialization and a reinforcement learning (RL) phase for time-efficient fine-tuning. When implemented on the popular SCIP solver, s-RLO returns the optimal solution up to 2 times faster than the default relpscost rule and 1.4 times faster than IL, or exhibits a smaller gap at the predefined time limit. The proposed approach shows stable performance, reducing fluctuations by approximately 50% compared with IL. The efficacy of the proposed s-RLO approach is supported by numerical results.


title: Text-Conditioned Resampler For Long Form Video Understanding

abstract: In this paper we present a text-conditioned video resampler (TCR) module that uses a pre-trained and frozen visual encoder and large language model (LLM) to process long video sequences for a task. TCR localises relevant visual features from the video given a text condition and provides them to a LLM to generate a text response. Due to its lightweight design and use of cross-attention, TCR can process more than 100 frames at a time with plain attention and without optimised implementations. We make the following contributions: (i) we design a transformer-based sampling architecture that can process long videos conditioned on a task, together with a training method that enables it to bridge pre-trained visual and language models; (ii) we identify tasks that could benefit from longer video perception; and (iii) we empirically validate its efficacy on a wide variety of evaluation tasks including NextQA, EgoSchema, and the EGO4D-LTA challenge.


title: Short-Term Multi-Horizon Line Loss Rate Forecasting of a Distribution Network Using Attention-GCN-LSTM

abstract: Accurately predicting line loss rates is vital for effective line loss management in distribution networks, especially over short-term multi-horizons ranging from one hour to one week. In this study, we propose Attention-GCN-LSTM, a novel method that combines Graph Convolutional Networks (GCN), Long Short-Term Memory (LSTM), and a three-level attention mechanism to address this challenge. By capturing spatial and temporal dependencies, our model enables accurate forecasting of line loss rates across multiple horizons. Through comprehensive evaluation using real-world data from 10KV feeders, our Attention-GCN-LSTM model consistently outperforms existing algorithms, exhibiting superior performance in terms of prediction accuracy and multi-horizon forecasting. This model holds significant promise for enhancing line loss management in distribution networks.


title: Exact solution for rotating black holes in parity-violating gravity

abstract: It has recently been pointed out that one can construct invertible conformal transformations with a parity-violating conformal factor, which can be employed to generate a novel class of parity-violating ghost-free metric theories from general relativity. We obtain exact solutions for rotating black holes in such theories by performing the conformal transformation on the Kerr solution in general relativity, which we dub conformal Kerr solutions. We explore the geodesic motion of a test particle in the conformal Kerr spacetime. While null geodesics remain the same as those in the Kerr spacetime, timelike geodesics exhibit interesting differences due to an effective external force caused by the parity-violating conformal factor.


title: MeV Astrophysical Spectroscopic Surveyor (MASS): A Compton Telescope Mission Concept

abstract: We propose a future mission concept, the MeV Astrophysical Spectroscopic Surveyor (MASS), which is a large area Compton telescope using 3D position sensitive cadmium zinc telluride (CZT) detectors optimized for emission line detection. The payload consists of two layers of CZT detectors in a misaligned chessboard layout, with a total geometric area of 4096 cm$^2$ for on-axis observations. The detectors can be operated at room-temperature with an energy resolution of 0.6\% at 0.662 MeV. The in-orbit background is estimated with a mass model. At energies around 1 MeV, a line sensitivity of about $10^{-5}$ photons cm$^{-2}$ s$^{-1}$ can be obtained with a 1 Ms observation. The main science objectives of MASS include nucleosynthesis in astrophysics and high energy astrophysics related to compact objects and transient sources. The payload CZT detectors weigh roughly 40 kg, suggesting that it can be integrated into a micro- or mini-satellite. We have constructed a pathfinder, named as MASS-Cube, to have a direct test of the technique with 4 detector units in space in the near future.


title: How to determine a curve singularity

abstract: We characterize the finite codimension sub-K-algebras of K[[t]] as the solutions of a computable finite family of higher differential operators. For this end, we establish a duality between such a sub-algebras and the finite codimension K-vector spaces of K[u], this ring acts on K[[t]] by differentiation.


title: Global choice is not conservative over local choice for Zermelo set theory

abstract: We prove that Global Choice is not conservative over ZC and that ZF $-$ Union does not prove existence of $x \cup y$ for all $x$ and $y$. Each proof is by constructing a pathological model inside a symmetric extension of $L.$


title: Sign Language Conversation Interpretation Using Wearable Sensors and Machine Learning

abstract: The count of people suffering from various levels of hearing loss reached 1.57 billion in 2019. This huge number tends to suffer on many personal and professional levels and strictly needs to be included with the rest of society healthily. This paper presents a proof of concept of an automatic sign language recognition system based on data obtained using a wearable device of 3 flex sensors. The system is designed to interpret a selected set of American Sign Language (ASL) dynamic words by collecting data in sequences of the performed signs and using machine learning methods. The built models achieved high-quality performances, such as Random Forest with 99% accuracy, Support Vector Machine (SVM) with 99%, and two K-Nearest Neighbor (KNN) models with 98%. This indicates many possible paths toward the development of a full-scale system.


title: The resolutions of generalized co-letterplace ideals and their powers

abstract: We present a natural and explicit multigraded minimal free resolution for each generalized co-letterplace ideal (see Definition 1.1). Our resolution differs significantly from the ones presented in the works of Ene et al. \cite{EHM} and D'Al{`\i} et al. \cite{DFN}. Additionally, we show that each power of a large class of generalized co-letterplace ideals can be represented as the quotient of another generalized co-letterplace ideal by a regular sequence of variable differences. Finally, we provide a new class of simplicial spheres


title: Convergence Visualizer of Decentralized Federated Distillation with Reduced Communication Costs

abstract: Federated learning (FL) achieves collaborative learning without the need for data sharing, thus preventing privacy leakage. To extend FL into a fully decentralized algorithm, researchers have applied distributed optimization algorithms to FL by considering machine learning (ML) tasks as parameter optimization problems. Conversely, the consensus-based multi-hop federated distillation (CMFD) proposed in the authors' previous work makes neural network (NN) models get close with others in a function space rather than in a parameter space. Hence, this study solves two unresolved challenges of CMFD: (1) communication cost reduction and (2) visualization of model convergence. Based on a proposed dynamic communication cost reduction method (DCCR), the amount of data transferred in a network is reduced; however, with a slight degradation in the prediction accuracy. In addition, a technique for visualizing the distance between the NN models in a function space is also proposed. The technique applies a dimensionality reduction technique by approximating infinite-dimensional functions as numerical vectors to visualize the trajectory of how the models change by the distributed learning algorithm.


title: Weil cohomology theories and their motivic Hopf algebroids

abstract: In this paper we discuss a general notion of Weil cohomology theories, both in algebraic geometry and in rigid analytic geometry. We allow our Weil cohomology theories to have coefficients in arbitrary commutative ring spectra. Using the theory of motives, we give three equivalent viewpoints on Weil cohomology theories: as a cohomology theory on smooth varieties, as a motivic spectrum and as a realization functor. We also associate to every Weil cohomology theory a motivic Hopf algebroid generalizing a previous construction of the author for the Betti cohomology. The main result proven in the paper is the connectivity of the motivic Hopf algebroids associated to the classical Weil cohomology theories.


title: Inferring Evidence from Nested Sampling Data via Information Field Theory

abstract: Nested sampling provides an estimate of the evidence of a Bayesian inference problem via probing the likelihood as a function of the enclosed prior volume. However, the lack of precise values of the enclosed prior mass of the samples introduces probing noise, which can hamper high-accuracy determinations of the evidence values as estimated from the likelihood-prior-volume function. We introduce an approach based on information field theory, a framework for non-parametric function reconstruction from data, that infers the likelihood-prior-volume function by exploiting its smoothness and thereby aims to improve the evidence calculation. Our method provides posterior samples of the likelihood-prior-volume function that translate into a quantification of the remaining sampling noise for the evidence estimate, or for any other quantity derived from the likelihood-prior-volume function.


title: Stability of the de-Sitter universe: One-loop nonlocal $f(R)$ gravity

abstract: With the method of the background field expansion, we investigate the one-loop quantization of the Euclidean nonlocal $f(R)$ model in the de-Sitter universe. We obtain the ghost-free condition (GFC) based on the transformation from the Jordan frame to the Einstein frame and the classical stability condition (CSC) satisfied $f^{(0)}_{RR}-\phi_0F^{(0)}_{RR}<0$. We present the on-shell and off-shell one-loop effective action and quantum stability condition (QSC) by utilizing the generalized zeta-function. We find that under the fulfillment of GFC, CSC and QSC are inconsistent.


title: Fast convergence to an approximate solution by message-passing for complex optimizations

abstract: Message-passing (MP) is a powerful tool for finding an approximate solution in optimization. We generalize it to nonlinear product-sum form, and numerically show the fast convergence for the minimum feedback vertex set and the minimum vertex cover known as NP-hard problems. From the linearity of MP in a logarithmic space, it is derived that an equilibrium solution exists in a neighborhood of random initial values. These results will give one of the reason why the convergence is very fast in collective computation based on a common mathematical background.


title: The Quantum Echo in Two-Component Bose-Einstein Condensates

abstract: The development of ultracold atom technology has enabled the precise investigations on quantum dynamics of quantum gases. Recently, inspired by experimental advancement, the $SU(1,1)$ echo, akin to the well-known $SU(2)$ spin echo, has been proposed for single-component Bose-Einstein condensate (BEC). In this paper, we investigate the possibility of quantum echo in the more intricate two-component BEC by fully exploiting its underlying symmetry, which is the Lie group $Sp(4,R)$. We demonstrate that quantum echo can occur for the two-component BEC by applying a driving protocol consisting of two steps in each period. The first step can be any Bogoliubov Hamiltonian, while the second step is a Hamiltonian with interactions turned off, which plays a similar role as the $\pi$-pulse in spin echo. We confirm our theoretical results with numerical calculations for different examples of two-component BEC. We further consider the effect of interactions between the excited boson modes on the quantum echo process and discuss the possible experiment implementation of this quantum echo.


title: EVI-SAM: Robust, Real-time, Tightly-coupled Event-Visual-Inertial State Estimation and 3D Dense Mapping

abstract: Event cameras are bio-inspired, motion-activated sensors that demonstrate substantial potential in handling challenging situations, such as motion blur and high-dynamic range. In this paper, we proposed EVI-SAM to tackle the problem of 6 DoF pose tracking and 3D reconstruction using monocular event camera. A novel event-based hybrid tracking framework is designed to estimate the pose, leveraging the robustness of feature matching and the precision of direct alignment. Specifically, we develop an event-based 2D-2D alignment to construct the photometric constraint, and tightly integrate it with the event-based reprojection constraint. The mapping module recovers the dense and colorful depth of the scene through the image-guided event-based mapping method. Subsequently, the appearance, texture, and surface mesh of the 3D scene can be reconstructed by fusing the dense depth map from multiple viewpoints using truncated signed distance function (TSDF) fusion. To the best of our knowledge, this is the first non-learning work to realize event-based dense mapping. Numerical evaluations are performed on both publicly available and self-collected datasets, which qualitatively and quantitatively demonstrate the superior performance of our method. Our EVI-SAM effectively balances accuracy and robustness while maintaining computational efficiency, showcasing superior pose tracking and dense mapping performance in challenging scenarios. Video Demo: https://youtu.be/Nn40U4e5Si8.


title: Probing the thermodynamics of charged Gauss Bonnet AdS black holes with the Lyapunov exponent

abstract: In this paper, we investigate the thermodynamic properties of charged AdS Gauss-Bonnet black holes and the associations with the Lyapunov exponent. The chaotic features of the black holes and the isobaric heat capacity characterized by Lyapunov exponent are studied to reveal the stability of black hole phases. With the consideration of both timelike and null geodesic, we find the relationship between Lyapunov exponent and Hawking temperature can fully embody the feature of the Small/Large phase transition and the triple point even further. Then we briefly reveal the properties of Lyapunov exponent as an order parameter and explore the black hole shadow with it.


title: Learning flow functions of spiking systems

abstract: We propose a framework for surrogate modelling of spiking systems. These systems are often described by stiff differential equations with high-amplitude oscillations and multi-timescale dynamics, making surrogate models an attractive tool for system design and simulation. We parameterise the flow function of a spiking system using a recurrent neural network architecture, allowing for a direct continuous-time representation of the state trajectories. The spiking nature of the signals makes for a data-heavy and computationally hard training process; thus, we describe two methods to mitigate these difficulties. We demonstrate our framework on two conductance-based models of biological neurons, showing that we are able to train surrogate models which accurately replicate the spiking behaviour.


title: The Role of Likes: How Online Feedback Impacts Users' Mental Health

abstract: Social media usage has been shown to have both positive and negative consequences for users' mental health. Several studies indicated that peer feedback plays an important role in the relationship between social media use and mental health. In this research, we analyse the impact of receiving online feedback on users' emotional experience, social connectedness and self-esteem. In an experimental study, we let users interact with others on a Facebook-like system over the course of a week while controlling for the amount of positive reactions they receive from their peers. We find that experiencing little to no reaction from others does not only elicit negative emotions and stress amongst users, but also induces low levels of self-esteem. In contrast, receiving much positive online feedback, evokes feelings of social connectedness and reduces overall loneliness. On a societal level, our study can help to better understand the mechanisms through which social media use impacts mental health in a positive or negative way. On a methodological level, we provide a new open-source tool for designing and conducting social media experiments.


title: Squeeze film absolute pressure sensors with sub-millipascal sensitivity

abstract: We report on the realization of ultrasensitive absolute pressure sensors based on silicon nitride membrane sandwiches. These sandwiches consist in a pair of highly-pretensioned, ultrathin (50 nm), large area (0.25 mm2) films, suspended parallel to each other and forming an ultrashort (500 nm), open cavity. The compression of a gas in this cavity leads to a strong squeeze film force, resulting in an increase in the membrane mechanical resonance frequencies which is directly proportional to the absolute gas pressure. These sandwiches show a record high responsitivity of >300 Hz/Pa in terms of squeeze film-induced frequency shift, which, combined with high quality factor mechanical resonances (Q>10^6), allows for bringing the sensitivity of absolute squeeze film pressure sensors down to the sub-millipascal level.


title: Generic properties of the Neumann-Poincar\'e operator: simplicity of eigenvalues and cyclic vectors

abstract: Two generic properties of the Neumann--Poincar\'e operator are investigated. We prove that non-zero eigenvalues of the Neumann--Poincar\'e operator on smooth boundaries in three dimensions and higher are generically simple in the sense of Baire category. We also prove that the functions defined by the fundamental solutions to the Laplace operator located at points outside the surface are generically cyclic vectors in the sense that the collection of those points where the functions are not cyclic vectors is of measure zero.


title: Cardiopulmonary responses and muscle strength influence running performance parameters differently at different slopes

abstract: The analysis of trail-running performance appears to be complex and cardio-respiratory and muscular factors could have a variable importance depending on the inclination. Our study aims to determine the role of these parameters in performance. 13 subjects with heterogeneous levels participated in the study. They carried out 7 visits including 3 maximal aerobic speed (MAS) test at 1, 10 and 25% slope on treadmill, 3 endurance tests at 100% of the MAS reached at 1, 10 and 25% and an evaluation on isokinetic ergometer at different speeds (60-180-240 {\textdegree}/s). Gas exchange measured during the incremental tests. We were able to identify 2 groups, a performance and a recreational group. We observe a difference in VO2max, MAS at 1 and 10%, and maximal aerobic ascensional speed (MAaS) at 25%, between the 2 groups but no difference in VO2max and exhaustion time at 100% MAS between the different conditions (1-10-25%). Interestingly, at ventilatory thresholds the metabolic parameters, expressed as absolute or relative values, are similar between conditions (10-25%) while the ascensional speed are different. This study suggests that the measurement of ascensional speed is not as relevant as heart rate for controlling intensity given the variety of slope gradients in trail-running races.


title: A Case Study in CUDA Kernel Fusion: Implementing FlashAttention-2 on NVIDIA Hopper Architecture using the CUTLASS Library

abstract: We provide an optimized implementation of the forward pass of FlashAttention-2, a popular memory-aware scaled dot-product attention algorithm, as a custom fused CUDA kernel targeting NVIDIA Hopper architecture and written using the open-source CUTLASS library. In doing so, we explain the challenges and techniques involved in fusing online-softmax with back-to-back GEMM kernels, utilizing the Hopper-specific Tensor Memory Accelerator (TMA) and Warpgroup Matrix-Multiply-Accumulate (WGMMA) instructions, defining and transforming CUTLASS Layouts and Tensors, overlapping copy and GEMM operations, and choosing optimal tile sizes for the Q, K and V attention matrices while balancing the register pressure and shared memory utilization. In head-to-head benchmarks on a single H100 PCIe GPU for some common choices of hyperparameters, we observe 20-50% higher FLOPs/s over a version of FlashAttention-2 optimized for last-generation NVIDIA Ampere architecture.