title: MSight: An Edge-Cloud Infrastructure-based Perception System for Connected Automated Vehicles

abstract: As vehicular communication and networking technologies continue to advance, infrastructure-based roadside perception emerges as a pivotal tool for connected automated vehicle (CAV) applications. Due to their elevated positioning, roadside sensors, including cameras and lidars, often enjoy unobstructed views with diminished object occlusion. This provides them a distinct advantage over onboard perception, enabling more robust and accurate detection of road objects. This paper presents MSight, a cutting-edge roadside perception system specifically designed for CAVs. MSight offers real-time vehicle detection, localization, tracking, and short-term trajectory prediction. Evaluations underscore the system's capability to uphold lane-level accuracy with minimal latency, revealing a range of potential applications to enhance CAV safety and efficiency. Presently, MSight operates 24/7 at a two-lane roundabout in the City of Ann Arbor, Michigan.


title: Sample Size Considerations in the Design of Orthopaedic Risk-factor Studies

abstract: Sample size calculations play a central role in study design because sample size affects study interpretability, costs, hospital resources, and staff time. For most veterinary orthopaedic risk-factor studies, either the sample size calculation or the post-hoc power calculation assumes the disease status of control subjects is perfectly ascertained, when it may not be. That means control groups may be mixtures of both unaffected cases and some unidentified affected cases. In this study, we demonstrate the consequences of using misclassified groups as control groups on the power of risk association tests, with the intent of showing that control groups with even small misclassification rates can reduce the power of association tests. In addition, we offer a range of correction factors to adjust sample size calculations back to 80% power. This was a simulation study using study designs from published orthopaedic risk-factor studies. The approach was to use their designs but simulate the data to include known proportions of misclassified affected subjects in the control group. The simulated data was used to calculate the power of a risk-association test. We calculated powers for several study designs and misclassification rates and compared them to a reference model. Treating misclassified data as disease-negative only always reduced statistical power compared to the reference power, and power loss increased with increasing misclassification rate. For this study, power could be improved back to 80% by increasing the sample size by a factor of 1.1 to 1.4. Researchers should use caution in calculating sample sizes for risk-factor studies and consider adjustments for estimated misclassification rates.


title: How to Teach Programming in the AI Era? Using LLMs as a Teachable Agent for Debugging

abstract: Large Language Models (LLMs) now excel at generative skills and can create content at impeccable speeds. However, they are imperfect and still make various mistakes. In a Computer Science education context, as these models are widely recognized as "AI pair programmers," it becomes increasingly important to train students on evaluating and debugging the LLM-generated code. In this work, we introduce HypoCompass, a novel system to facilitate deliberate practice on debugging, where human novices play the role of Teaching Assistants and help LLM-powered teachable agents debug code. We enable effective task delegation between students and LLMs in this learning-by-teaching environment: students focus on hypothesizing the cause of code errors, while adjacent skills like code completion are offloaded to LLM-agents. Our evaluations demonstrate that HypoCompass generates high-quality training materials (e.g., bugs and fixes), outperforming human counterparts fourfold in efficiency, and significantly improves student performance on debugging by 12% in the pre-to-post test.


title: Wait-free Trees with Asymptotically-Efficient Range Queries

abstract: Tree data structures, such as red-black trees, quad trees, treaps, or tries, are fundamental tools in computer science. A classical problem in concurrency is to obtain expressive, efficient, and scalable versions of practical tree data structures. We are interested in concurrent trees supporting range queries, i.e., queries that involve multiple consecutive data items. Existing implementations with this capability can list keys in a specific range, but do not support aggregate range queries: for instance, if we want to calculate the number of keys in a range, the only choice is to retrieve a whole list and return its size. This is suboptimal: in the sequential setting, one can augment a balanced search tree with counters and, consequently, perform these aggregate requests in logarithmic rather than linear time. In this paper, we propose a generic approach to implement a broad class of range queries on concurrent trees in a way that is wait-free, asymptotically efficient, and practically scalable. The key idea is a new mechanism for maintaining metadata concurrently at tree nodes, which can be seen as a wait-free variant of hand-over-hand locking (which we call hand-over-hand helping). We implement, test, and benchmark a balanced binary search tree with wait-free insert, delete, contains, and count operations, returning the number of keys in a given range which validates the expected speedups because of our method in practice.


title: Hi Guys or Hi Folks? Benchmarking Gender-Neutral Machine Translation with the GeNTE Corpus

abstract: Gender inequality is embedded in our communication practices and perpetuated in translation technologies. This becomes particularly apparent when translating into grammatical gender languages, where machine translation (MT) often defaults to masculine and stereotypical representations by making undue binary gender assumptions. Our work addresses the rising demand for inclusive language by focusing head-on on gender-neutral translation from English to Italian. We start from the essentials: proposing a dedicated benchmark and exploring automated evaluation methods. First, we introduce GeNTE, a natural, bilingual test set for gender-neutral translation, whose creation was informed by a survey on the perception and use of neutral language. Based on GeNTE, we then overview existing reference-based evaluation approaches, highlight their limits, and propose a reference-free method more suitable to assess gender-neutral translation.


title: Visual Storytelling with Question-Answer Plans

abstract: Visual storytelling aims to generate compelling narratives from image sequences. Existing models often focus on enhancing the representation of the image sequence, e.g., with external knowledge sources or advanced graph structures. Despite recent progress, the stories are often repetitive, illogical, and lacking in detail. To mitigate these issues, we present a novel framework which integrates visual representations with pretrained language models and planning. Our model translates the image sequence into a visual prefix, a sequence of continuous embeddings which language models can interpret. It also leverages a sequence of question-answer pairs as a blueprint plan for selecting salient visual concepts and determining how they should be assembled into a narrative. Automatic and human evaluation on the VIST benchmark (Huang et al., 2016) demonstrates that blueprint-based models generate stories that are more coherent, interesting, and natural compared to competitive baselines and state-of-the-art systems.


title: Tailoring Self-Attention for Graph via Rooted Subtrees

abstract: Attention mechanisms have made significant strides in graph learning, yet they still exhibit notable limitations: local attention faces challenges in capturing long-range information due to the inherent problems of the message-passing scheme, while global attention cannot reflect the hierarchical neighborhood structure and fails to capture fine-grained local information. In this paper, we propose a novel multi-hop graph attention mechanism, named Subtree Attention (STA), to address the aforementioned issues. STA seamlessly bridges the fully-attentional structure and the rooted subtree, with theoretical proof that STA approximates the global attention under extreme settings. By allowing direct computation of attention weights among multi-hop neighbors, STA mitigates the inherent problems in existing graph attention mechanisms. Further we devise an efficient form for STA by employing kernelized softmax, which yields a linear time complexity. Our resulting GNN architecture, the STAGNN, presents a simple yet performant STA-based graph neural network leveraging a hop-aware attention strategy. Comprehensive evaluations on ten node classification datasets demonstrate that STA-based models outperform existing graph transformers and mainstream GNNs. The code is available at https://github.com/LUMIA-Group/SubTree-Attention.


title: Fast protein backbone generation with SE(3) flow matching

abstract: We present FrameFlow, a method for fast protein backbone generation using SE(3) flow matching. Specifically, we adapt FrameDiff, a state-of-the-art diffusion model, to the flow-matching generative modeling paradigm. We show how flow matching can be applied on SE(3) and propose modifications during training to effectively learn the vector field. Compared to FrameDiff, FrameFlow requires five times fewer sampling timesteps while achieving two fold better designability. The ability to generate high quality protein samples at a fraction of the cost of previous methods paves the way towards more efficient generative models in de novo protein design.


title: Efficient Self-Adjusting Search Trees via Lazy Updates

abstract: Self-adjusting data structures are a classic approach to adapting the complexity of operations to the data access distribution. While several self-adjusting variants are known for both binary search trees and B-Trees, existing constructions come with limitations. For instance, existing works on self-adjusting B-Trees do not provide static-optimality and tend to be complex and inefficient to implement in practice. In this paper, we provide a new approach to build efficient self-adjusting search trees based on state-of-the-art non-adaptive structures. We illustrate our approach to obtain a new efficient self-adjusting Interpolation Search Tree (IST) and B-Tree, as well as a new self-adjusting tree called the Log Tree. Of note, our self-adjusting IST has expected complexity in $O(\log \frac{\log m}{\log ac(x)})$, where $m$ is the total number of requests and $ac(x)$ is the number of requests to key $x$. Our technique leads to simple constructions with a reduced number of pointer manipulations: this improves cache efficiency and even allows an efficient concurrent implementation.


title: Image Compression and Decompression Framework Based on Latent Diffusion Model for Breast Mammography

abstract: This research presents a novel framework for the compression and decompression of medical images utilizing the Latent Diffusion Model (LDM). The LDM represents advancement over the denoising diffusion probabilistic model (DDPM) with a potential to yield superior image quality while requiring fewer computational resources in the image decompression process. A possible application of LDM and Torchvision for image upscaling has been explored using medical image data, serving as an alternative to traditional image compression and decompression algorithms. The experimental outcomes demonstrate that this approach surpasses a conventional file compression algorithm, and convolutional neural network (CNN) models trained with decompressed files perform comparably to those trained with original image files. This approach also significantly reduces dataset size so that it can be distributed with a smaller size, and medical images take up much less space in medical devices. The research implications extend to noise reduction in lossy compression algorithms and substitute for complex wavelet-based lossless algorithms.


title: Which model density is best in pair natural orbital local correlation theory?

abstract: Low-scaling electron correlation theory based on the pair natural orbital approximation, PNO-CCSD(T), has become a powerful computational tool. Motivated by the recent discovery of large errors for organometallic molecules, we assess the role of the model density used to discard unimportant contributions. We find that second-order perturbation theory provides the best compromise between cost and accuracy, but coupling between localised occupied orbitals must be accounted for. Errors in the CCSD energy are then well below 1~kcal/mol, even for molecules with moderate multi-reference character, and the primary remaining source of errors lies in the treatment of the (T) energy contribution.


title: Equational proofs of Jacobson's Theorem

abstract: A classical theorem by Jacobson says that a ring in which every element $x$ satisfies the equation $x^n=x$ for some $n>1$ is commutative. According to Birkhoff's Completeness Theorem, if $n$ is fixed, there must be an equational proof of this theorem. But equational proofs have only appeared for some values of $n$ so far. This paper is about finding such a proof in general. We are able to make a reduction to the case that $n$ is a prime power $p^k$ and the ring has characteristic $p$. We then prove the special cases $k=1$ and $k=2$. The general case is reduced to a series of constructive Wedderburn Theorems, which we can prove in many special cases. Several examples of equational proofs are discussed in detail.


title: Subsurface hydrogen storage controlled by small-scale rock heterogeneities

abstract: Subsurface porous rocks have the potential to store large volumes of hydrogen (H$_2$) required for transitioning towards a H$_2$-based energy future. Understanding the flow and trapping behavior of H$_2$ in subsurface storage systems, which is influenced by pore-scale heterogeneities inherent to subsurface rocks, is crucial to reliably evaluate the storage efficiency of a geological formation. In this work, we performed 3D X-ray imaging and flow experiments to investigate the impact of pore-scale heterogeneity on H$_2$ distribution after its cyclic injection (drainage) and withdrawal (imbibition) from a layered rock sample, characterized by varying pore and throat sizes. Our findings reveal that even subtle variations in rock structure and properties significantly influence H$_2$ displacement and storage efficiency. During drainage, H$_2$ follows a path consisting of large pores and throats, bypassing the majority of the low permeability rock layer consisting of smaller pores and throats. This bypassing substantially reduces the H$_2$ storage capacity. Moreover, due to the varying pore and throat sizes in the layered sample, depending on the experimental flow strategy, we observe a higher H$_2$ saturation after imbibition compared to drainage, which is counterintuitive and opposite to that observed in homogeneous rocks. These findings emphasize that small-scale rock heterogeneity, which is often unaccounted for in reservoir-scale models, can play a vital role in the displacement and trapping of H$_2$ in subsurface porous media.


title: Persistent Homology of Configuration Spaces of Trees

abstract: Multiparameter persistence modules come up naturally in topological data analysis and topological robotics. Given a metric graph $(X,\delta)$, the second configuration space of $(X,\delta)$ with proximity parameters (for example, the minimum distance allowed between each pair of robots) can be interpreted as a collection of all possible configurations of two robots moving in $(X,\delta)$. In this project, we study the $2$-parameter persistence modules associated with the second configuration spaces of the star graph ($\mathsf{Star}_k$, $k\geq 3$) and the generalized H-graph ($\mathcal{H}_{m,n}$, $m,n\geq 3$) with the edge length parameter $L_e$ and the restraint parameter $r$. Moreover, we provide the indecomposable direct summands for each persistence module.


title: GestSync: Determining who is speaking without a talking head

abstract: In this paper we introduce a new synchronisation task, Gesture-Sync: determining if a person's gestures are correlated with their speech or not. In comparison to Lip-Sync, Gesture-Sync is far more challenging as there is a far looser relationship between the voice and body movement than there is between voice and lip motion. We introduce a dual-encoder model for this task, and compare a number of input representations including RGB frames, keypoint images, and keypoint vectors, assessing their performance and advantages. We show that the model can be trained using self-supervised learning alone, and evaluate its performance on the LRS3 dataset. Finally, we demonstrate applications of Gesture-Sync for audio-visual synchronisation, and in determining who is the speaker in a crowd, without seeing their faces. The code, datasets and pre-trained models can be found at: \url{https://www.robots.ox.ac.uk/~vgg/research/gestsync}.


title: Online Equitable Ride-sharing Car Distribution in a Congested Traffic

abstract: The usability of ride-sharing services like Uber and Lyft has been considerably improved by advancements in cellular communications. Such a tech-driven transportation system can reduce the number of private cars, in roads with limited physical capacity, effectively match drivers with passengers requesting service, and save drivers and passengers time by optimal scheduling and estimating of the trips. However, the existing services offered by ride-sharing companies may not necessarily reduce congestion, if they are not equitably accessed in urban areas. This paper addresses this important issue by classifying cars as ride-sharing and non-ride-sharing cars and developing a novel dissensus-based traffic evolution dynamics to effectively model their distribution in a shared network of interconnected roads (NOIR). This new dynamics models the ride-sharing car evolution as a non-stationary Markov process with uncertainty matrices decomposed into outflow and tendency probability matrices, where outflow probabilities are constrained by the non-ride-sharing cars behavior, but the tendency probabilities are considered as decision variables (or distributed controls) for achieving an equitable distribution of ride-sharing cars in a congested traffic.


title: Progressive Neural Compression for Adaptive Image Offloading under Timing Constraints

abstract: IoT devices are increasingly the source of data for machine learning (ML) applications running on edge servers. Data transmissions from devices to servers are often over local wireless networks whose bandwidth is not just limited but, more importantly, variable. Furthermore, in cyber-physical systems interacting with the physical environment, image offloading is also commonly subject to timing constraints. It is, therefore, important to develop an adaptive approach that maximizes the inference performance of ML applications under timing constraints and the resource constraints of IoT devices. In this paper, we use image classification as our target application and propose progressive neural compression (PNC) as an efficient solution to this problem. Although neural compression has been used to compress images for different ML applications, existing solutions often produce fixed-size outputs that are unsuitable for timing-constrained offloading over variable bandwidth. To address this limitation, we train a multi-objective rateless autoencoder that optimizes for multiple compression rates via stochastic taildrop to create a compression solution that produces features ordered according to their importance to inference performance. Features are then transmitted in that order based on available bandwidth, with classification ultimately performed using the (sub)set of features received by the deadline. We demonstrate the benefits of PNC over state-of-the-art neural compression approaches and traditional compression methods on a testbed comprising an IoT device and an edge server connected over a wireless network with varying bandwidth.


title: Successive Data Injection in Conditional Quantum GAN Applied to Time Series Anomaly Detection

abstract: Classical GAN architectures have shown interesting results for solving anomaly detection problems in general and for time series anomalies in particular, such as those arising in communication networks. In recent years, several quantum GAN architectures have been proposed in the literature. When detecting anomalies in time series using QGANs, huge challenges arise due to the limited number of qubits compared to the size of the data. To address these challenges, we propose a new high-dimensional encoding approach, named Successive Data Injection (SuDaI). In this approach, we explore a larger portion of the quantum state than that in the conventional angle encoding, the method used predominantly in the literature, through repeated data injections into the quantum state. SuDaI encoding allows us to adapt the QGAN for anomaly detection with network data of a much higher dimensionality than with the existing known QGANs implementations. In addition, SuDaI encoding applies to other types of high-dimensional time series and can be used in contexts beyond anomaly detection and QGANs, opening up therefore multiple fields of application.


title: Adversarial Attacks on Combinatorial Multi-Armed Bandits

abstract: We study reward poisoning attacks on Combinatorial Multi-armed Bandits (CMAB). We first provide a sufficient and necessary condition for the attackability of CMAB, a notion to capture the vulnerability and robustness of CMAB. The attackability condition depends on the intrinsic properties of the corresponding CMAB instance such as the reward distributions of super arms and outcome distributions of base arms. Additionally, we devise an attack algorithm for attackable CMAB instances. Contrary to prior understanding of multi-armed bandits, our work reveals a surprising fact that the attackability of a specific CMAB instance also depends on whether the bandit instance is known or unknown to the adversary. This finding indicates that adversarial attacks on CMAB are difficult in practice and a general attack strategy for any CMAB instance does not exist since the environment is mostly unknown to the adversary. We validate our theoretical findings via extensive experiments on real-world CMAB applications including probabilistic maximum covering problem, online minimum spanning tree, cascading bandits for online ranking, and online shortest path.


title: Optimizing Solution-Samplers for Combinatorial Problems: The Landscape of Policy-Gradient Methods

abstract: Deep Neural Networks and Reinforcement Learning methods have empirically shown great promise in tackling challenging combinatorial problems. In those methods a deep neural network is used as a solution generator which is then trained by gradient-based methods (e.g., policy gradient) to successively obtain better solution distributions. In this work we introduce a novel theoretical framework for analyzing the effectiveness of such methods. We ask whether there exist generative models that (i) are expressive enough to generate approximately optimal solutions; (ii) have a tractable, i.e, polynomial in the size of the input, number of parameters; (iii) their optimization landscape is benign in the sense that it does not contain sub-optimal stationary points. Our main contribution is a positive answer to this question. Our result holds for a broad class of combinatorial problems including Max- and Min-Cut, Max-$k$-CSP, Maximum-Weight-Bipartite-Matching, and the Traveling Salesman Problem. As a byproduct of our analysis we introduce a novel regularization process over vanilla gradient descent and provide theoretical and experimental evidence that it helps address vanishing-gradient issues and escape bad stationary points.


title: Exact Jacobi elliptic solutions of some models for the interaction of long and short waves

abstract: Some systems were recently put forth by Nguyen et. al. as models for studying the interaction of long and short waves in dispersive media. These systems were shown to possess synchronized Jacobi elliptic solutions as well as synchronized solitary wave solutions under certain constraints, i.e., vector solutions where the two components are proportional to one another. In this paper, the exact periodic traveling wave solutions to these systems in general are found to be given by Jacobi elliptic functions. Moreover, these cnoidal wave solutions are unique. Thus, the explicit synchronized solutions under some conditions obtained by Nguyen et. al. are also indeed unique.


title: Identification and Estimation in a Class of Potential Outcomes Models

abstract: This paper develops a class of potential outcomes models characterized by three main features: (i) Unobserved heterogeneity can be represented by a vector of potential outcomes and a type describing the manner in which an instrument determines the choice of treatment; (ii) The availability of an instrumental variable that is conditionally independent of unobserved heterogeneity; and (iii) The imposition of convex restrictions on the distribution of unobserved heterogeneity. The proposed class of models encompasses multiple classical and novel research designs, yet possesses a common structure that permits a unifying analysis of identification and estimation. In particular, we establish that these models share a common necessary and sufficient condition for identifying certain causal parameters. Our identification results are constructive in that they yield estimating moment conditions for the parameters of interest. Focusing on a leading special case of our framework, we further show how these estimating moment conditions may be modified to be doubly robust. The corresponding double robust estimators are shown to be asymptotically normally distributed, bootstrap based inference is shown to be asymptotically valid, and the semi-parametric efficiency bound is derived for those parameters that are root-n estimable. We illustrate the usefulness of our results for developing, identifying, and estimating causal models through an empirical evaluation of the role of mental health as a mediating variable in the Moving To Opportunity experiment.


title: Quality Assurance of A GPT-based Sentiment Analysis System: Adversarial Review Data Generation and Detection

abstract: Large Language Models (LLMs) have been garnering significant attention of AI researchers, especially following the widespread popularity of ChatGPT. However, due to LLMs' intricate architecture and vast parameters, several concerns and challenges regarding their quality assurance require to be addressed. In this paper, a fine-tuned GPT-based sentiment analysis model is first constructed and studied as the reference in AI quality analysis. Then, the quality analysis related to data adequacy is implemented, including employing the content-based approach to generate reasonable adversarial review comments as the wrongly-annotated data, and developing surprise adequacy (SA)-based techniques to detect these abnormal data. Experiments based on Amazon.com review data and a fine-tuned GPT model were implemented. Results were thoroughly discussed from the perspective of AI quality assurance to present the quality analysis of an LLM model on generated adversarial textual data and the effectiveness of using SA on anomaly detection in data quality assurance.


title: Accelerating Deep Neural Network guided MCTS using Adaptive Parallelism

abstract: Deep Neural Network guided Monte-Carlo Tree Search (DNN-MCTS) is a powerful class of AI algorithms. In DNN-MCTS, a Deep Neural Network model is trained collaboratively with a dynamic Monte-Carlo search tree to guide the agent towards actions that yields the highest returns. While the DNN operations are highly parallelizable, the search tree operations involved in MCTS are sequential and often become the system bottleneck. Existing MCTS parallel schemes on shared-memory multi-core CPU platforms either exploit data parallelism but sacrifice memory access latency, or take advantage of local cache for low-latency memory accesses but constrain the tree search to a single thread. In this work, we analyze the tradeoff of these parallel schemes and develop performance models for both parallel schemes based on the application and hardware parameters. We propose a novel implementation that addresses the tradeoff by adaptively choosing the optimal parallel scheme for the MCTS component on the CPU. Furthermore, we propose an efficient method for searching the optimal communication batch size as the MCTS component on the CPU interfaces with DNN operations offloaded to an accelerator (GPU). Using a representative DNN-MCTS algorithm - Alphazero on board game benchmarks, we show that the parallel framework is able to adaptively generate the best-performing parallel implementation, leading to a range of $1.5\times - 3\times$ speedup compared with the baseline methods on CPU and CPU-GPU platforms.


title: Distortion-Aware Phase Retrieval Receiver for High-Order QAM Transmission with Carrierless Intensity-Only Measurements

abstract: We experimentally investigate transmitting high-order quadrature amplitude modulation (QAM) signals with carrierless and intensity-only measurements with phase retrieval (PR) receiving techniques. The intensity errors during measurement, including noise and distortions, are found to be a limiting factor for the precise convergence of the PR algorithm. To improve the PR reconstruction accuracy, we propose a distortion-aware PR scheme comprising both training and reconstruction stages. By estimating and emulating the distortion caused by various channel impairments, the proposed scheme enables enhanced agreement between the estimated and measured amplitudes throughout the PR iteration, thus resulting in improved reconstruction performance to support high-order QAM transmission. With the aid of proposed techniques, we experimentally demonstrate 50-GBaud 16QAM and 32QAM signals transmitting through a standard single-mode optical fiber (SSMF) span of 40 and 80 km, and achieve bit error rates (BERs) below the 6.25% hard decision (HD)-forward error correction (FEC) and 25% soft decision (SD)-FEC thresholds for the two modulation formats, respectively. By tuning the pilot symbol ratio and applying concatenated coding, we also demonstrate that a post-FEC data rate of up to 140 Gb/s can be achieved for both distances at an optimal pilot symbol ratio of 20%.


title: Sub-quadratic (1+\eps)-approximate Euclidean Spanners, with Applications

abstract: We study graph spanners for point-set in the high-dimensional Euclidean space. On the one hand, we prove that spanners with stretch <\sqrt{2} and subquadratic size are not possible, even if we add Steiner points. On the other hand, if we add extra nodes to the graph (non-metric Steiner points), then we can obtain (1+\eps)-approximate spanners of subquadratic size. We show how to construct a spanner of size n^{2-\Omega(\eps^3)}, as well as a directed version of the spanner of size n^{2-\Omega(\eps^2)}. We use our directed spanner to obtain an algorithm for computing (1+\eps)-approximation to Earth-Mover Distance (optimal transport) between two sets of size n in time n^{2-\Omega(\eps^2)}.


title: Understanding the Feature Norm for Out-of-Distribution Detection

abstract: A neural network trained on a classification dataset often exhibits a higher vector norm of hidden layer features for in-distribution (ID) samples, while producing relatively lower norm values on unseen instances from out-of-distribution (OOD). Despite this intriguing phenomenon being utilized in many applications, the underlying cause has not been thoroughly investigated. In this study, we demystify this very phenomenon by scrutinizing the discriminative structures concealed in the intermediate layers of a neural network. Our analysis leads to the following discoveries: (1) The feature norm is a confidence value of a classifier hidden in the network layer, specifically its maximum logit. Hence, the feature norm distinguishes OOD from ID in the same manner that a classifier confidence does. (2) The feature norm is class-agnostic, thus it can detect OOD samples across diverse discriminative models. (3) The conventional feature norm fails to capture the deactivation tendency of hidden layer neurons, which may lead to misidentification of ID samples as OOD instances. To resolve this drawback, we propose a novel negative-aware norm (NAN) that can capture both the activation and deactivation tendencies of hidden layer neurons. We conduct extensive experiments on NAN, demonstrating its efficacy and compatibility with existing OOD detectors, as well as its capability in label-free environments.


title: Task-Adaptive Tokenization: Enhancing Long-Form Text Generation Efficacy in Mental Health and Beyond

abstract: We propose task-adaptive tokenization as a way to adapt the generation pipeline to the specifics of a downstream task and enhance long-form generation in mental health. Inspired by insights from cognitive science, our task-adaptive tokenizer samples variable segmentations from multiple outcomes, with sampling probabilities optimized based on task-specific data. We introduce a strategy for building a specialized vocabulary and introduce a vocabulary merging protocol that allows for the integration of task-specific tokens into the pre-trained model's tokenization step. Through extensive experiments on psychological question-answering tasks in both Chinese and English, we find that our task-adaptive tokenization approach brings a significant improvement in generation performance while using up to 60% fewer tokens. Preliminary experiments point to promising results when using our tokenization approach with very large language models.


title: Resolving the Imbalance Issue in Hierarchical Disciplinary Topic Inference via LLM-based Data Augmentation

abstract: In addressing the imbalanced issue of data within the realm of Natural Language Processing, text data augmentation methods have emerged as pivotal solutions. This data imbalance is prevalent in the research proposals submitted during the funding application process. Such imbalances, resulting from the varying popularity of disciplines or the emergence of interdisciplinary studies, significantly impede the precision of downstream topic models that deduce the affiliated disciplines of these proposals. At the data level, proposals penned by experts and scientists are inherently complex technological texts, replete with intricate terminologies, which augmenting such specialized text data poses unique challenges. At the system level, this, in turn, compromises the fairness of AI-assisted reviewer assignment systems, which raises a spotlight on solving this issue. This study leverages large language models (Llama V1) as data generators to augment research proposals categorized within intricate disciplinary hierarchies, aiming to rectify data imbalances and enhance the equity of expert assignments. We first sample within the hierarchical structure to find the under-represented class. Then we designed a prompt for keyword-based research proposal generation. Our experiments attests to the efficacy of the generated data, demonstrating that research proposals produced using the prompts can effectively address the aforementioned issues and generate high quality scientific text data, thus help the model overcome the imbalanced issue.


title: Surface ferromagnetism in rhombohedral heptalayer graphene moire superlattice

abstract: The topological electronic structure of crystalline materials often gives rise to intriguing surface states, such as Dirac surface states in topological insulators, Fermi arc surface states in Dirac semimetals, and topological superconductivity in iron-based superconductors. Recently, rhombohedral multilayer graphene has emerged as a promising platform for exploring exotic surface states due to its hosting of topologically protected surface flat bands at low energy, with the layer-dependent energy dispersion. These flat bands can promote electron correlations, leading to a plethora of quantum phenomena, including spontaneous symmetry breaking, superconductivity, ferromagnetism, and topological Chern insulators. Nevertheless, the intricate connection between the surface flat bands in rhombohedral multilayer graphene and the highly dispersive high-energy bands hinders the exploration of correlated surface states. Here, we present a method to isolate the surface flat bands of rhombohedral heptalayer (7L) graphene by introducing moire superlattices. The pronounced screening effects observed in the moire potential-modulated rhombohedral 7L graphene indicate its essential three-dimensional (3D) nature. The isolated surface flat bands favor correlated states on the surface in the regions away from charge-neutrality points. Most notably, we observe tunable surface ferromagnetism, manifested as an anomalous Hall effect with hysteresis loops, which is achieved by polarizing surface states using finite displacement fields. Our work establishes rhombohedral multilayer graphene moire superlattice as a unique 3D system for exploring correlated surface states.


title: Spectacular Post-Perihelion Tails of Bright Kreutz Sungrazers

abstract: A vast majority of bright comets between the late 2nd century and the early 18th century, moving in potentially Kreutz orbits according to Hasegawa & Nakano (2001), was first sighted between 2 and 16 days after perihelion, thanks to the spectacular tails that they were then displaying. In this paper I examine the basic properties of the post-perihelion tails of the three brightest Kreutz sungrazers of the 19th and 20th centuries -- the Great March Comet of 1843 (C/1843 D1), the Great September Comet of 1882 (C/1882 R1), and Ikeya-Seki (C/1965 S1). As the pre-perihelion tail of a sungrazer sublimates completely at perihelion, the development of its post-perihelion tail starts from scratch. In the early days after perihelion, the tail length grows rapidly on account of the plasma component. At some point the dust takes over, reaching a peak length weeks later. As the geocentric distance continues to increase and the surface brightness to decline, the tail's shortening sets in. The dust tails of Ikeya-Seki and the 1843 sungrazer contained grains subjected to solar radiation pressure accelerations not exceeding 0.6-0.7 the solar gravitational acceleration, the dust tail of the 1882 sungrazer was more complex. For weeks this comet appeared like a comet in a comet, a result of disintegration of a distant companion near perihelion. Evening Kreutz sungrazers are found to have longer tails than morning ones because of geometry. Other issues are discussed and extensive sets of tail data are provided.


title: Edge Computing-Enabled Road Condition Monitoring: System Development and Evaluation

abstract: Real-time pavement condition monitoring provides highway agencies with timely and accurate information that could form the basis of pavement maintenance and rehabilitation policies. Existing technologies rely heavily on manual data processing, are expensive and therefore, difficult to scale for frequent, networklevel pavement condition monitoring. Additionally, these systems require sending large packets of data to the cloud which requires large storage space, are computationally expensive to process, and results in high latency. The current study proposes a solution that capitalizes on the widespread availability of affordable Micro Electro-Mechanical System (MEMS) sensors, edge computing and internet connection capabilities of microcontrollers, and deployable machine learning (ML) models to (a) design an Internet of Things (IoT)-enabled device that can be mounted on axles of vehicles to stream live pavement condition data (b) reduce latency through on-device processing and analytics of pavement condition sensor data before sending to the cloud servers. In this study, three ML models including Random Forest, LightGBM and XGBoost were trained to predict International Roughness Index (IRI) at every 0.1-mile segment. XGBoost had the highest accuracy with an RMSE and MAPE of 16.89in/mi and 20.3%, respectively. In terms of the ability to classify the IRI of pavement segments based on ride quality according to MAP-21 criteria, our proposed device achieved an average accuracy of 96.76% on I-70EB and 63.15% on South Providence. Overall, our proposed device demonstrates significant potential in providing real-time pavement condition data to State Highway Agencies (SHA) and Department of Transportation (DOTs) with a satisfactory level of accuracy.


title: Market Crowds' Trading Behaviors, Agreement Prices, and the Implications of Trading Volume

abstract: It has been long that literature in financial academics focuses mainly on price and return but much less on trading volume. In the past twenty years, it has already linked both price and trading volume to economic fundamentals, and explored the behavioral implications of trading volume such as investor's attitude toward risks, overconfidence, disagreement, and attention etc. However, what is surprising is how little we really know about trading volume. Here we show that trading volume probability represents the frequency of market crowd's trading action in terms of behavior analysis, and test two adaptive hypotheses relevant to the volume uncertainty associated with price in China stock market. The empirical work reveals that market crowd trade a stock in efficient adaptation except for simple heuristics, gradually tend to achieve agreement on an outcome or an asset price widely on a trading day, and generate such a stationary equilibrium price very often in interaction and competition among themselves no matter whether it is highly overestimated or underestimated. This suggests that asset prices include not only a fundamental value but also private information, speculative, sentiment, attention, gamble, and entertainment values etc. Moreover, market crowd adapt to gain and loss by trading volume increase or decrease significantly in interaction with environment in any two consecutive trading days. Our results demonstrate how interaction between information and news, the trading action, and return outcomes in the three-term feedback loop produces excessive trading volume which includes various internal and external causes.


title: Tail probability of maximal displacement in critical branching L\'{e}vy process with stable branching

abstract: Consider a critical branching L\'{e}vy process $\{X_t, t\ge 0\}$ with branching rate $\beta>0, $ offspring distribution $\{p_k:k\geq 0\}$ and spatial motion $\{\xi_t, \Pi_x\}$. For any $t\ge 0$, let $N_t$ be the collection of particles alive at time $t$, and, for any $u\in N_t$, let $X_u(t)$ be the position of $u$ at time $t$. We study the tail probability of the maximal displacement $M:=\sup_{t>0}\sup_{u\in N_t} X_u(t)$ under the assumption $\lim_{n\to\infty} n^\alpha \sum_{k=n}^\infty p_k =\kappa\in(0,\infty)$ for some $\alpha\in (1,2)$, $\Pi_0(\xi_1)=0$ and $\Pi_0 (|\xi_1|^r)\in (0,\infty)$ for some $r> 2\alpha/(\alpha-1)$. Our main result is a generalization of the main result of Sawyer and Fleischman (1979) for branching Brownian motions and that of Lalley and Shao (2015) for branching random walks, both of which are proved under the assumption $\sum_{k=0}^\infty k^3 p_k<\infty$.


title: Increasing Entropy to Boost Policy Gradient Performance on Personalization Tasks

abstract: In this effort, we consider the impact of regularization on the diversity of actions taken by policies generated from reinforcement learning agents trained using a policy gradient. Policy gradient agents are prone to entropy collapse, which means certain actions are seldomly, if ever, selected. We augment the optimization objective function for the policy with terms constructed from various $\varphi$-divergences and Maximum Mean Discrepancy which encourages current policies to follow different state visitation and/or action choice distribution than previously computed policies. We provide numerical experiments using MNIST, CIFAR10, and Spotify datasets. The results demonstrate the advantage of diversity-promoting policy regularization and that its use on gradient-based approaches have significantly improved performance on a variety of personalization tasks. Furthermore, numerical evidence is given to show that policy regularization increases performance without losing accuracy.


title: Non-radial implosion for compressible Euler and Navier-Stokes in $\mathbb{T}^3$ and $\mathbb{R}^3$

abstract: In this paper we construct smooth, non-radial solutions of the compressible Euler and Navier-Stokes equation that develop an imploding finite time singularity. Our construction is motivated by the works [Merle, Rapha\"{e}l, Rodnianski, and Szeftel, Ann. of Math., 196(2):567-778, 2022, Ann. of Math., 196(2):779-889, 2022], [Buckmaster, Cao-Labora, and G\'{o}mez-Serrano, arXiv:2208.09445, 2022], but is flexible enough to handle both periodic and non-radial initial data.


title: The torsion log-Minkowski problem

abstract: In this paper, we deal with the torsion log-Minkowski problem without symmetry assumptions via an approximation argument.


title: Provable Compositional Generalization for Object-Centric Learning

abstract: Learning representations that generalize to novel compositions of known concepts is crucial for bridging the gap between human and machine perception. One prominent effort is learning object-centric representations, which are widely conjectured to enable compositional generalization. Yet, it remains unclear when this conjecture will be true, as a principled theoretical or empirical understanding of compositional generalization is lacking. In this work, we investigate when compositional generalization is guaranteed for object-centric representations through the lens of identifiability theory. We show that autoencoders that satisfy structural assumptions on the decoder and enforce encoder-decoder consistency will learn object-centric representations that provably generalize compositionally. We validate our theoretical result and highlight the practical relevance of our assumptions through experiments on synthetic image data.


title: A Maclaurin type inequality

abstract: The classical Maclaurin inequality asserts that the elementary symmetric means $$ s_k(y) = \frac{1}{\binom{n}{k}} \sum_{1 \leq i_1 < \dots < i_k \leq n} y_{i_1} \dots y_{i_k}$$ obey the inequality $s_\ell(y)^{1/\ell} \leq s_k(y)^{1/k}$ whenever $1 \leq k \leq \ell \leq n$ and $y = (y_1,\dots,y_n)$ consists of non-negative reals. We establish a variant $$ |s_\ell(y)|^{\frac{1}{\ell}} \ll \frac{\ell^{1/2}}{k^{1/2}} \max (|s_k(y)|^{\frac{1}{k}}, |s_{k+1}(y)|^{\frac{1}{k+1}})$$ of this inequality in which the $y_i$ are permitted to be negative. In this regime the inequality is sharp up to constants. Such an inequality was previously known without the $k^{1/2}$ factor in the denominator.


title: Electromagnetically driven flow in unsupported electrolyte layers: lubrication theory and linear stability of annular flow

abstract: We consider a thin horizontal layer of a non-magnetic electrolyte containing a bulk solution of salt and carrying an electric current. The layer is bounded by two deformable free surfaces loaded with an insoluble surfactant and is placed in a vertical magnetic field. The arising Lorentz force drives the electrolyte in the plane of the layer. We employ the long-wave approximation to derive general two-dimensional hydrodynamic equations describing symmetric pinching-type deformations of the free surfaces. These equations are used to study the azimuthal flow in an annular film spanning the gap between two coaxial cylindrical electrodes. In weakly deformed films, the base azimuthal flow and its linear stability with respect to azimuthally invariant perturbations are studied analytically. For relatively thick layers and weak magnetic fields, the leading mode with the smallest decay rate is found to correspond to a monotonic azimuthal velocity perturbation. The Marangoni effect leads to further stabilisation of the flow while perturbations of the solute concentration in the bulk of the fluid have no influence on the flow stability. In strongly deformed films in the diffusion-dominated regime, the azimuthal flow becomes linearly unstable with respect to an oscillatory mixed mode characterised by the combination of radial and azimuthal velocity perturbations when the voltage applied between electrodes exceeds the critical value.


title: A Lightweight Video Anomaly Detection Model with Weak Supervision and Adaptive Instance Selection

abstract: Video anomaly detection is to determine whether there are any abnormal events, behaviors or objects in a given video, which enables effective and intelligent public safety management. As video anomaly labeling is both time-consuming and expensive, most existing works employ unsupervised or weakly supervised learning methods. This paper focuses on weakly supervised video anomaly detection, in which the training videos are labeled whether or not they contain any anomalies, but there is no information about which frames the anomalies are located. However, the uncertainty of weakly labeled data and the large model size prevent existing methods from wide deployment in real scenarios, especially the resource-limit situations such as edge-computing. In this paper, we develop a lightweight video anomaly detection model. On the one hand, we propose an adaptive instance selection strategy, which is based on the model's current status to select confident instances, thereby mitigating the uncertainty of weakly labeled data and subsequently promoting the model's performance. On the other hand, we design a lightweight multi-level temporal correlation attention module and an hourglass-shaped fully connected layer to construct the model, which can reduce the model parameters to only 0.56\% of the existing methods (e.g. RTFM). Our extensive experiments on two public datasets UCF-Crime and ShanghaiTech show that our model can achieve comparable or even superior AUC score compared to the state-of-the-art methods, with a significantly reduced number of model parameters.


title: Unlearning with Fisher Masking

abstract: Machine unlearning aims to revoke some training data after learning in response to requests from users, model developers, and administrators. Most previous methods are based on direct fine-tuning, which may neither remove data completely nor retain full performances on the remain data. In this work, we find that, by first masking some important parameters before fine-tuning, the performances of unlearning could be significantly improved. We propose a new masking strategy tailored to unlearning based on Fisher information. Experiments on various datasets and network structures show the effectiveness of the method: without any fine-tuning, the proposed Fisher masking could unlearn almost completely while maintaining most of the performance on the remain data. It also exhibits stronger stability compared to other unlearning baselines


title: Semiclassical resolution of the black hole singularity inspired in the minimal uncertainty approach

abstract: We propose a new lapse function that simplifies the Hamiltonian constraint, describing the interior of the black hole in terms of the Ashtekar-Barbero variables, into a more straightforward form. The new Hamiltonian leads to different equations of motion than those found in the literature, but through a suitable transformation between temporal parameters, it is found that such a choice leads us to the classical solutions of the Schwarzschild metric, still preserving the physical singularity. In order to resolve this singularity, and inspired by the minimal uncertainty approach, we modify the classical algebra between the dynamic variables of the model, imposing an effective dynamics within the black hole. As a consequence, one of the dynamic variables, denoted by $p_b$, acquires a minimum value at the singularity $t=0$, and on the other hand, the variable related to the radius of the 2-sphere, $p_c$, leads to the resolution of the classical singularity of the black hole by replacing it with a bounce that connects the interior of the black hole with the interior of the white hole. This bounce occurs in the Planck-scale region, where a new event horizon manifests. Upon crossing this horizon, the nature of the interval changes from spatial to temporal outside the white hole.


title: DiffCPS: Diffusion Model based Constrained Policy Search for Offline Reinforcement Learning

abstract: Constrained policy search (CPS) is a fundamental problem in offline reinforcement learning, which is generally solved by advantage weighted regression (AWR). However, previous methods may still encounter out-of-distribution actions due to the limited expressivity of Gaussian-based policies. On the other hand, directly applying the state-of-the-art models with distribution expression capabilities (i.e., diffusion models) in the AWR framework is intractable since AWR requires exact policy probability densities, which is intractable in diffusion models. In this paper, we propose a novel approach, $\textbf{Diffusion-based Constrained Policy Search}$ (dubbed DiffCPS), which tackles the diffusion-based constrained policy search with the primal-dual method. The theoretical analysis reveals that strong duality holds for diffusion-based CPS problems, and upon introducing parameter approximation, an approximated solution can be obtained after $\mathcal{O}(1/\epsilon)$ number of dual iterations, where $\epsilon$ denotes the representation ability of the parametrized policy. Extensive experimental results based on the D4RL benchmark demonstrate the efficacy of our approach. We empirically show that DiffCPS achieves better or at least competitive performance compared to traditional AWR-based baselines as well as recent diffusion-based offline RL methods. The code is now available at https://github.com/felix-thu/DiffCPS.


title: Uniform sup-norm bounds on average for Siegel cusp forms

abstract: Let $\Gamma\subsetneq \mathrm{Sp}_n(\mathbb{R})$ be an arithmetic subgroup of the symplectic group $\mathrm{Sp}_n(\mathbb{R})$ acting on the Siegel upper half-space $\mathbb{H}_n$ of degree $n$. Consider the $d$-dimensional space of Siegel cusp forms $\mathcal{S}_{\kappa}^n(\Gamma)$ of weight $\kappa$ for $\Gamma$ and let $\{f_j\}_{1\leq j\leq d}$ be a basis of $\mathcal{S}_{\kappa}^n(\Gamma)$ orthonormal with respect to the Petersson inner product. In this paper we show using the heat kernel method that the sup-norm of the quantity $S_{\kappa}^{\Gamma}(Z):=\sum_{j=1}^{d}\det (Y)^{\kappa}\vert{f_j(Z)}\vert^2\,(Z\in\mathbb{H}_n)$ is bounded above by $c_{n,\Gamma} {\kappa}^{n(n+1)/2}$ when $M:=\Gamma\backslash\mathbb{H}_n$ is compact and by $c_{n,\Gamma} {\kappa}^{3n(n+1)/4}$ when $M$ is non-compact of finite volume, where $c_{n,\Gamma}$ denotes a positive real constant depending only on the degree $n$ and the group $\Gamma$. Furthermore, we show that this bound is uniform in the sense that if we fix a group $\Gamma_0$ and take $\Gamma$ to be a subgroup of $\Gamma_0$ of finite index, then the constant $c_{n,\Gamma}$ in these bounds depends only on the degree $n$ and the fixed group $\Gamma_0$.


title: The rotating excitons in two-dimensional materials: Valley Zeeman effect and chirality

abstract: We propose the rotational dynamics of the intralayer and interlayer excitons with their inherent momenta of inertia in the monolayer and bilayer transition metal dichalcogenides, respectively, where the new chirality of exciton is endowed by the rotational angular momentum, namely, the formations of left- and right-handed excitons at the +K and -K valleys, respectively. We find that angular momenta exchange between excitons and its surrounding phononic bath result in the large fluctuation of the effective g-factor and the asymmetry of valley Zeeman splitting observed in most recently experiments, both of which sensitively depend on the magnetic moments provided by the phononic environment. This rotating exciton model not only proposes a new controllable knob in valleytronics, but opens the door to explore the angular momentum exchange of the chiral quasiparticles with the many-body environment.


title: GReAT: A Graph Regularized Adversarial Training Method

abstract: This paper presents GReAT (Graph Regularized Adversarial Training), a novel regularization method designed to enhance the robust classification performance of deep learning models. Adversarial examples, characterized by subtle perturbations that can mislead models, pose a significant challenge in machine learning. Although adversarial training is effective in defending against such attacks, it often overlooks the underlying data structure. In response, GReAT integrates graph based regularization into the adversarial training process, leveraging the data's inherent structure to enhance model robustness. By incorporating graph information during training, GReAT defends against adversarial attacks and improves generalization to unseen data. Extensive evaluations on benchmark datasets demonstrate that GReAT outperforms state of the art methods in robustness, achieving notable improvements in classification accuracy. Specifically, compared to the second best methods, GReAT achieves a performance increase of approximately 4.87% for CIFAR10 against FGSM attack and 10.57% for SVHN against FGSM attack. Additionally, for CIFAR10, GReAT demonstrates a performance increase of approximately 11.05% against PGD attack, and for SVHN, a 5.54% increase against PGD attack. This paper provides detailed insights into the proposed methodology, including numerical results and comparisons with existing approaches, highlighting the significant impact of GReAT in advancing the performance of deep learning models.


title: What do larger image classifiers memorise?

abstract: The success of modern neural networks has prompted study of the connection between memorisation and generalisation: overparameterised models generalise well, despite being able to perfectly fit (memorise) completely random labels. To carefully study this issue, Feldman proposed a metric to quantify the degree of memorisation of individual training examples, and empirically computed the corresponding memorisation profile of a ResNet on image classification bench-marks. While an exciting first glimpse into what real-world models memorise, this leaves open a fundamental question: do larger neural models memorise more? We present a comprehensive empirical analysis of this question on image classification benchmarks. We find that training examples exhibit an unexpectedly diverse set of memorisation trajectories across model sizes: most samples experience decreased memorisation under larger models, while the rest exhibit cap-shaped or increasing memorisation. We show that various proxies for the Feldman memorization score fail to capture these fundamental trends. Lastly, we find that knowledge distillation, an effective and popular model compression technique, tends to inhibit memorisation, while also improving generalisation. Specifically, memorisation is mostly inhibited on examples with increasing memorisation trajectories, thus pointing at how distillation improves generalisation.


title: Negative Object Presence Evaluation (NOPE) to Measure Object Hallucination in Vision-Language Models

abstract: Object hallucination poses a significant challenge in vision-language (VL) models, often leading to the generation of nonsensical or unfaithful responses with non-existent objects. However, the absence of a general measurement for evaluating object hallucination in VL models has hindered our understanding and ability to mitigate this issue. In this work, we present NOPE (Negative Object Presence Evaluation), a novel benchmark designed to assess object hallucination in VL models through visual question answering (VQA). We propose a cost-effective and scalable approach utilizing large language models to generate 29.5k synthetic negative pronoun (NegP) data of high quality for NOPE. We extensively investigate the performance of 10 state-of-the-art VL models in discerning the non-existence of objects in visual questions, where the ground truth answers are denoted as NegP (e.g., "none"). Additionally, we evaluate their standard performance on visual questions on 9 other VQA datasets. Through our experiments, we demonstrate that no VL model is immune to the vulnerability of object hallucination, as all models achieve accuracy below 10\% on NegP. Furthermore, we uncover that lexically diverse visual questions, question types with large scopes, and scene-relevant objects capitalize the risk of object hallucination in VL models.


title: On the Solvability of General Inverse $\sigma_k$ Equations

abstract: We prove that if there exists a $C$-subsolution to a constant coefficients strictly $\Upsilon$-stable general inverse $\sigma_k$ equation, then there exists a unique solution. As a consequence, this result covers all the analytical results of the classical strictly $\Upsilon$-stable general inverse $\sigma_k$ equations, for example, the complex Monge--Amp\`ere equation, the complex Hessian equation, the J-equation, the deformed Hermitian--Yang--Mills equation, etc. Hence, we confirm an analytical conjecture by Collins--Jacob--Yau [arXiv:1508.01934] of the solvability of the deformed Hermitian--Yang--Mills equation. Their conjecture states that the existence of a $C$-subsolution to a supercritical phase deformed Hermitian--Yang--Mills equation gives the solvability.


title: Elastic turbulence in planar channel flows -- Turbulence with no drag and enhanced mixing

abstract: The efficient mixing of different species is a withstanding problem in micro-scale systems, e.g., drug delivery and disease diagnosis devices. There, classic inertial turbulence is hindered by the small geometries and flow rates, and only viscous diffusion remains active. A chaotic fluid motion can be recovered by conferring upon the viscous fluid elastic properties (e.g., through the addition of small amounts of polymers). Elastic turbulence (ET) often occurs in curvilinear channels, while less certain is its existence in straight channels. Here, we show with fully resolved 3D numerical simulations that ET in straight channels can be sustained and that, although it does not increase drag, it provides an additional mixing mechanism on top of the viscous diffusion, which can be measured in experiments. Spanning the Reynolds number across three orders of magnitude, we show that once inertia becomes sub-dominant, all the flows are governed by elasticity and characterised by similar dynamical properties. We therefore propose a unified view of ET and the commonly dubbed elasto-inertial turbulence. Exploiting this novel state for mixing enhancement in microfluidic devices can make them simpler and more efficient.


title: A Critical Look at Classic Test-Time Adaptation Methods in Semantic Segmentation

abstract: Test-time adaptation (TTA) aims to adapt a model, initially trained on training data, to potential distribution shifts in the test data. Most existing TTA studies, however, focus on classification tasks, leaving a notable gap in the exploration of TTA for semantic segmentation. This pronounced emphasis on classification might lead numerous newcomers and engineers to mistakenly assume that classic TTA methods designed for classification can be directly applied to segmentation. Nonetheless, this assumption remains unverified, posing an open question. To address this, we conduct a systematic, empirical study to disclose the unique challenges of segmentation TTA, and to determine whether classic TTA strategies can effectively address this task. Our comprehensive results have led to three key observations. First, the classic batch norm updating strategy, commonly used in classification TTA, only brings slight performance improvement, and in some cases it might even adversely affect the results. Even with the application of advanced distribution estimation techniques like batch renormalization, the problem remains unresolved. Second, the teacher-student scheme does enhance training stability for segmentation TTA in the presence of noisy pseudo-labels. However, it cannot directly result in performance improvement compared to the original model without TTA. Third, segmentation TTA suffers a severe long-tailed imbalance problem, which is substantially more complex than that in TTA for classification. This long-tailed challenge significantly affects segmentation TTA performance, even when the accuracy of pseudo-labels is high. In light of these observations, we conclude that TTA for segmentation presents significant challenges, and simply using classic TTA methods cannot address this problem well.


title: Uniform accuracy of implicit-explicit backward differentiation formulas (IMEX-BDF) for linear hyperbolic relaxation systems

abstract: This work is concerned with the uniform accuracy of implicit-explicit backward differentiation formulas for general linear hyperbolic relaxation systems satisfying the structural stability condition proposed previously by the third author. We prove the uniform stability and accuracy of a class of IMEX-BDF schemes discretized spatially by a Fourier spectral method. The result reveals that the accuracy of the fully discretized schemes is independent of the relaxation time in all regimes. It is verified by numerical experiments on several applications to traffic flows, rarefied gas dynamics and kinetic theory.


title: Investigating Continuous Learning in Spiking Neural Networks

abstract: In this paper, the use of third-generation machine learning, also known as spiking neural network architecture, for continuous learning was investigated and compared to conventional models. The experimentation was divided into three separate phases. The first phase focused on training the conventional models via transfer learning. The second phase trains a Nengo model from their library. Lastly, each conventional model is converted into a spiking neural network and trained. Initial results from phase 1 are inline with known knowledge about continuous learning within current machine learning literature. All models were able to correctly identify the current classes, but they would immediately see a sharp performance drop in previous classes due to catastrophic forgetting. However, the SNN models were able to retain some information about previous classes. Although many of the previous classes were still identified as the current trained classes, the output probabilities showed a higher than normal value to the actual class. This indicates that the SNN models do have potential to overcome catastrophic forgetting but much work is still needed.


title: SteerLM: Attribute Conditioned SFT as an (User-Steerable) Alternative to RLHF

abstract: Model alignment with human preferences is an essential step in making Large Language Models (LLMs) helpful and consistent with human values. It typically consists of supervised fine-tuning (SFT) and reinforcement learning from human feedback (RLHF) stages. However, RLHF faces inherent limitations stemming from a complex training setup and its tendency to align the model with implicit values that end users cannot control at run-time. Moreover, reward models in RLHF stage commonly rely on single-dimensional feedback as opposed to explicit, multifaceted signals that indicate attributes such as helpfulness, humor, and toxicity. To address these limitations, we propose SteerLM, a supervised fine-tuning method that empowers end-users to control responses during inference. SteerLM conditions responses to conform to an explicitly defined multi-dimensional set of attributes, thereby empowering a steerable AI capable of generating helpful and high-quality responses while maintaining customizability. Experiments show that SteerLM trained on open source datasets generates responses that are preferred by human and automatic evaluators to many state-of-the-art baselines trained with RLHF while being much easier to train. Try SteerLM at https://huggingface.co/nvidia/SteerLM-llama2-13B


title: Totally geodesic subvarieties of the moduli space of curves and linear systems

abstract: We construct a linear system on a general curve in a totally geodesic subvariety of the moduli space of curves. As a consequence, we obtain rank bounds for totally geodesic subvarieties of dimension at least two. Furthermore, we classify totally geodesic subvarieties of dimension at least two in strata with at most two zeros.


title: Anyview: Generalizable Indoor 3D Object Detection with Variable Frames

abstract: In this paper, we propose a novel network framework for indoor 3D object detection to handle variable input frame numbers in practical scenarios. Existing methods only consider fixed frames of input data for a single detector, such as monocular RGB-D images or point clouds reconstructed from dense multi-view RGB-D images. While in practical application scenes such as robot navigation and manipulation, the raw input to the 3D detectors is the RGB-D images with variable frame numbers instead of the reconstructed scene point cloud. However, the previous approaches can only handle fixed frame input data and have poor performance with variable frame input. In order to facilitate 3D object detection methods suitable for practical tasks, we present a novel 3D detection framework named AnyView for our practical applications, which generalizes well across different numbers of input frames with a single model. To be specific, we propose a geometric learner to mine the local geometric features of each input RGB-D image frame and implement local-global feature interaction through a designed spatial mixture module. Meanwhile, we further utilize a dynamic token strategy to adaptively adjust the number of extracted features for each frame, which ensures consistent global feature density and further enhances the generalization after fusion. Extensive experiments on the ScanNet dataset show our method achieves both great generalizability and high detection accuracy with a simple and clean architecture containing a similar amount of parameters with the baselines.


title: Infrared Small Target Detection Using Double-Weighted Multi-Granularity Patch Tensor Model With Tensor-Train Decomposition

abstract: Infrared small target detection plays an important role in the remote sensing fields. Therefore, many detection algorithms have been proposed, in which the infrared patch-tensor (IPT) model has become a mainstream tool due to its excellent performance. However, most IPT-based methods face great challenges, such as inaccurate measure of the tensor low-rankness and poor robustness to complex scenes, which will leadto poor detection performance. In order to solve these problems, this paper proposes a novel double-weighted multi-granularity infrared patch tensor (DWMGIPT) model. First, to capture different granularity information of tensor from multiple modes, a multi-granularity infrared patch tensor (MGIPT) model is constructed by collecting nonoverlapping patches and tensor augmentation based on the tensor train (TT) decomposition. Second, to explore the latent structure of tensor more efficiently, we utilize the auto-weighted mechanism to balance the importance of information at different granularity. Then, the steering kernel (SK) is employed to extract local structure prior, which suppresses background interference such as strong edges and noise. Finally, an efficient optimization algorithm based on the alternating direction method of multipliers (ADMM) is presented to solve the model. Extensive experiments in various challenging scenes show that the proposed algorithm is robust to noise and different scenes. Compared with the other eight state-of-the-art methods, different evaluation metrics demonstrate that our method achieves better detection performance in various complex scenes.


title: Continuous Invariance Learning

abstract: Invariance learning methods aim to learn invariant features in the hope that they generalize under distributional shifts. Although many tasks are naturally characterized by continuous domains, current invariance learning techniques generally assume categorically indexed domains. For example, auto-scaling in cloud computing often needs a CPU utilization prediction model that generalizes across different times (e.g., time of a day and date of a year), where `time' is a continuous domain index. In this paper, we start by theoretically showing that existing invariance learning methods can fail for continuous domain problems. Specifically, the naive solution of splitting continuous domains into discrete ones ignores the underlying relationship among domains, and therefore potentially leads to suboptimal performance. To address this challenge, we then propose Continuous Invariance Learning (CIL), which extracts invariant features across continuously indexed domains. CIL is a novel adversarial procedure that measures and controls the conditional independence between the labels and continuous domain indices given the extracted features. Our theoretical analysis demonstrates the superiority of CIL over existing invariance learning methods. Empirical results on both synthetic and real-world datasets (including data collected from production systems) show that CIL consistently outperforms strong baselines among all the tasks.


title: ALECE: An Attention-based Learned Cardinality Estimator for SPJ Queries on Dynamic Workloads (Extended)

abstract: For efficient query processing, DBMS query optimizers have for decades relied on delicate cardinality estimation methods. In this work, we propose an Attention-based LEarned Cardinality Estimator (ALECE for short) for SPJ queries. The core idea is to discover the implicit relationships between queries and underlying dynamic data using attention mechanisms in ALECE's two modules that are built on top of carefully designed featurizations for data and queries. In particular, from all attributes in the database, the data-encoder module obtains organic and learnable aggregations which implicitly represent correlations among the attributes, whereas the query-analyzer module builds a bridge between the query featurizations and the data aggregations to predict the query's cardinality. We experimentally evaluate ALECE on multiple dynamic workloads. The results show that ALECE enables PostgreSQL's optimizer to achieve nearly optimal performance, clearly outperforming its built-in cardinality estimator and other alternatives.


title: Scaling Studies for Efficient Parameter Search and Parallelism for Large Language Model Pre-training

abstract: AI accelerator processing capabilities and memory constraints largely dictate the scale in which machine learning workloads (e.g., training and inference) can be executed within a desirable time frame. Training a state of the art, transformer-based model today requires use of GPU-accelerated high performance computers with high-speed interconnects. As datasets and models continue to increase in size, computational requirements and memory demands for AI also continue to grow. These challenges have inspired the development of distributed algorithm and circuit-based optimization techniques that enable the ability to progressively scale models in multi-node environments, efficiently minimize neural network cost functions for faster convergence, and store more parameters into a set number of available resources. In our research project, we focus on parallel and distributed machine learning algorithm development, specifically for optimizing the data processing and pre-training of a set of 5 encoder-decoder LLMs, ranging from 580 million parameters to 13 billion parameters. We performed a fine-grained study to quantify the relationships between three ML parallelism methods, specifically exploring Microsoft DeepSpeed Zero Redundancy Optimizer (ZeRO) stages.


title: Generalized Neural Collapse for a Large Number of Classes

abstract: Neural collapse provides an elegant mathematical characterization of learned last layer representations (a.k.a. features) and classifier weights in deep classification models. Such results not only provide insights but also motivate new techniques for improving practical deep models. However, most of the existing empirical and theoretical studies in neural collapse focus on the case that the number of classes is small relative to the dimension of the feature space. This paper extends neural collapse to cases where the number of classes are much larger than the dimension of feature space, which broadly occur for language models, retrieval systems, and face recognition applications. We show that the features and classifier exhibit a generalized neural collapse phenomenon, where the minimum one-vs-rest margins is maximized.We provide empirical study to verify the occurrence of generalized neural collapse in practical deep neural networks. Moreover, we provide theoretical study to show that the generalized neural collapse provably occurs under unconstrained feature model with spherical constraint, under certain technical conditions on feature dimension and number of classes.


title: A Glance is Enough: Extract Target Sentence By Looking at A keyword

abstract: This paper investigates the possibility of extracting a target sentence from multi-talker speech using only a keyword as input. For example, in social security applications, the keyword might be "help", and the goal is to identify what the person who called for help is articulating while ignoring other speakers. To address this problem, we propose using the Transformer architecture to embed both the keyword and the speech utterance and then rely on the cross-attention mechanism to select the correct content from the concatenated or overlapping speech. Experimental results on Librispeech demonstrate that our proposed method can effectively extract target sentences from very noisy and mixed speech (SNR=-3dB), achieving a phone error rate (PER) of 26\%, compared to the baseline system's PER of 96%.


title: Complexity of null dynamical systems and Sauer--Shelah lemmas

abstract: The topological entropy of a topological dynamical system, introduced in a foundational paper by Adler, Konheim and McAndrew [Trans. Am. Math. Soc., 1965], is a nonnegative number that measures the uncertainty or disorder of the system. Comparing with positive entropy systems, zero entropy systems are much less understood. In order to distinguish between zero entropy systems, Huang and Ye [Adv. Math., 2009] introduced the concept of maximal pattern entropy of a topological dynamical system. At the heart of their analysis is a Sauer-Shelah type lemma. In the present paper, we provide a shorter and more conceptual proof of a strengthening of this lemma, and discuss its surprising connection between dynamical system, combinatorics and a recent breakthrough in communication complexity. We also improve one of the main results of Huang and Ye on the maximal pattern entropy of zero-dimensional systems, by proving a new Sauer-Shelah type lemma, which unifies and enhances various extremal results on VC-dimension, Natarajan dimension and Steele dimension.


title: An Initial Investigation of Neural Replay Simulator for Over-the-Air Adversarial Perturbations to Automatic Speaker Verification

abstract: Deep Learning has advanced Automatic Speaker Verification (ASV) in the past few years. Although it is known that deep learning-based ASV systems are vulnerable to adversarial examples in digital access, there are few studies on adversarial attacks in the context of physical access, where a replay process (i.e., over the air) is involved. An over-the-air attack involves a loudspeaker, a microphone, and a replaying environment that impacts the movement of the sound wave. Our initial experiment confirms that the replay process impacts the effectiveness of the over-the-air attack performance. This study performs an initial investigation towards utilizing a neural replay simulator to improve over-the-air adversarial attack robustness. This is achieved by using a neural waveform synthesizer to simulate the replay process when estimating the adversarial perturbations. Experiments conducted on the ASVspoof2019 dataset confirm that the neural replay simulator can considerably increase the success rates of over-the-air adversarial attacks. This raises the concern for adversarial attacks on speaker verification in physical access applications.


title: C^2M-DoT: Cross-modal consistent multi-view medical report generation with domain transfer network

abstract: In clinical scenarios, multiple medical images with different views are usually generated simultaneously, and these images have high semantic consistency. However, most existing medical report generation methods only consider single-view data. The rich multi-view mutual information of medical images can help generate more accurate reports, however, the dependence of multi-view models on multi-view data in the inference stage severely limits their application in clinical practice. In addition, word-level optimization based on numbers ignores the semantics of reports and medical images, and the generated reports often cannot achieve good performance. Therefore, we propose a cross-modal consistent multi-view medical report generation with a domain transfer network (C^2M-DoT). Specifically, (i) a semantic-based multi-view contrastive learning medical report generation framework is adopted to utilize cross-view information to learn the semantic representation of lesions; (ii) a domain transfer network is further proposed to ensure that the multi-view report generation model can still achieve good inference performance under single-view input; (iii) meanwhile, optimization using a cross-modal consistency loss facilitates the generation of textual reports that are semantically consistent with medical images. Extensive experimental studies on two public benchmark datasets demonstrate that C^2M-DoT substantially outperforms state-of-the-art baselines in all metrics. Ablation studies also confirmed the validity and necessity of each component in C^2M-DoT.


title: Quantum anomalous Hall state in a fluorinated 1T-MoSe$_2$ monolayer

abstract: The quantum anomalous Hall state with a large band gap and a high Chern number is significant for practical applications in spintronics. By performing first-principles calculations, we investigate electronic properties of the fully fluorinated 1T-MoSe$_{2}$ monolayer. Without considering the spin-orbit coupling, the band structure demonstrates single-spin semi-metallic properties and the trigonal warping around $K_{\pm}$ valleys. The introduction of the spin-orbit coupling opens considerable band gaps of $117.2$ meV around the two valleys, leading to a nontrivial quantum anomalous Hall state with a Chern number of $|C|=2$, which provides two chiral dissipationless transport channels from topological edge states and associated quantized anomalous Hall conductivity. In addition, an effective model is constructed to describe the low-energy physics of the monolayer. Our findings in the MoSe$_{2}$F$_{2}$ monolayer sheds light on large-gap quantum anomalous Hall states in two-dimensional materials with the chemical functionalization, and provides opportunities in designing low-power and noise-tolerant spintronic devices.


title: Macroscopic Manifestations of Traffic Waves in Microscopic Models

abstract: Traffic waves can rise even from single lane car-following behaviour. To better understand and mitigate traffic waves, it is necessary to use analytical tools like mathematical models, data analysis, and micro-simulations that can capture the dynamics of real traffic flow. In this study, we isolate car-following dynamics and present a systematic hierarchy of tests that connect the microscopic scale with the meaningful macroscopic effective state in the presence of waves. This allows insights with precise attributable cause-to-effect relationships of specific observed traffic patterns. We establish a principled way of generating macroscopic flow quantities from microscopic models in the unstable regime. Those quantities are then used to study how the corresponding non-equilibrium wave structures manifest in the fundamental diagram, based on three basic scenarios that can serve as building blocks for understanding more complex micro-simulation studies. Finally, this study gives insight on the shapes of the reduced fundamental diagrams for different commonly used microscopic models.


title: A family of permutationally invariant quantum codes

abstract: We construct a new family of permutationally invariant codes that correct $t$ Pauli errors for any $t\ge 1$. We also show that codes in the new family correct quantum deletion errors as well as spontaneous decay errors. Our construction contains some of the previously known permutationally invariant quantum codes as particular cases, which also admit transversal gates. In many cases, the codes in the new family are shorter than the best previously known explicit permutationally invariant codes for Pauli errors and deletions. Furthermore, our new code family includes a new $((4,2,2))$ optimal single-deletion-correcting code. As a separate result, we generalize the conditions for permutationally invariant codes to correct $t$ Pauli errors from the previously known results for $t=1$ to any number of errors. For small $t$, these conditions can be used to construct new examples of codes by computer.


title: A Complex Systems Approach to Exoplanet Atmospheric Chemistry: New Prospects for Ruling Out the Possibility of Alien Life-As-We-Know-It

abstract: The near-term capability to characterize terrestrial exoplanet atmospheres may bring us closer to discovering alien life through atmospheric data. However, remotely detectable candidate biosignature gases are subject to possible false positive signals as they can also be produced abiotically. To distinguish biological, abiotic and anomalous sources of these atmospheric gases, we take a complex systems approach using chemical reaction network analysis of planetary atmospheres. We simulated 30,000 terrestrial atmospheres, organized in two datasets: Archean Earth-like worlds and modern Earth-like worlds. For Archean Earth-like worlds we study cases where CH4 is produced abiotically via serpentinization, biologically via methanogenesis, or from anomalous sources. We also simulate modern Earth-like atmospheres with and without industrial CFC-12. Network properties like mean degree and average shortest path length effectively distinguish scenarios where CH4 is produced from methanogenesis and serpentinization, with biologically driven networks exhibiting higher connectivity and efficiency. Network analysis also distinguishes modern Earth atmospheres with CFC-12 from those without, with industrially polluted networks showing increased mean degree. Using Bayesian analysis, we demonstrate how atmospheric network property statistics can provide stronger confidence for ruling out biological explanations compared to gas abundance statistics alone. Our results confirm how a network theoretic approach allows distinguishing biological, abiotic and anomalous atmospheric drivers, including ruling out life-as-we-know-it as a possible explanation. Developing statistical inference methods for spectral data that incorporate network properties could significantly strengthen future biosignature detection efforts.


title: Maurer-Cartan characterization, $L_\infty$-algebras, and cohomology of relative Rota-Baxter operators on Lie-Yamaguti algebras

abstract: In this paper, we first construct a differential graded Lie algebra that controls deformations of a Lie-Yamaguti algebra. Furthermore, a relative Rota-Baxter operator on a Lie-Yamaguti algebra is characterized as a Maurer-Cartan element in an appropriate $L_\infty$-algebra that we build through the graded Lie bracket of Lie-Yamaguti algebra's controlling algebra, and gives rise to a twisted $L_\infty$-algebra that controls its deformation. Next we establish the cohomology theory of relative Rota-Baxter operators on Lie-Yamaguti algebras via the Yamaguti cohomology. Then we clarify the relationship between the twisted $L_\infty$-algebra and the cohomology theory. Finally as byproducts, we classify certain deformations on Lie-Yamaguti algebras using the cohomology theory.


title: Cohomology on the centric orbit category of a fusion system

abstract: We study the higher derived limits of mod $p$ cohomology on the centric orbit category of a saturated fusion system on a finite $p$-group. It is an open problem whether all such higher limits vanish. This is known in many cases, including for fusion systems realized by a finite group and for many classes of fusion systems which are not so realized. We prove that the higher limits of $H^j$ vanish provided $j$ is small relative to $p$, by showing that the same is true for the contravariant part of a simple Mackey composition factor of $H^j$ under the same conditions.


title: Asymptotic implementation of multipartite quantum channels and other quantum instruments using local operations and classical communication

abstract: We prove a necessary condition that a quantum channel on a multipartite system may be approximated arbitrarily closely using local operations and classical communication (LOCC). We then extend those arguments to obtain a condition that applies to all quantum instruments, which range from the most refined case, a generalized measurement, to the most coarse-grained, which is a quantum channel. We illustrate these results by a detailed analysis of a quantum instrument that is known not to be implementable by LOCC, but which can be arbitrarily closely approximated within that framework. As one outgrowth of this analysis, we find a quantum measurement that falls into the same category: it cannot be implemented exactly by LOCC, but can be approximated by LOCC arbitrarily closely. This measurement has an infinite number of outcomes, leaving open the question as to whether or not there exists a measurement within this same category but having only a finite number of outcomes.


title: Follow-up radio observations of the $\tau$ Bo\"{o}tis exoplanetary system: Preliminary results from NenuFAR

abstract: Studying the magnetic fields of exoplanets will provide valuable information about their interior structures, atmospheric properties (escape and dynamics), and potential habitability. One of the most promising methods to detect exoplanetary magnetic fields is to study their auroral radio emission. However, there are no confirmed detections of an exoplanet in the radio despite decades of searching. Recently, Turner et al. 2021 reported a tentative detection of circularly polarized bursty emission from the $\tau$ Boo exoplanetary system using LOFAR low-frequency beamformed observations. The likely source of this emission was presumed to be from the $\tau$ Boo planetary system and a possible explanation is radio emission from the exoplanet $\tau$ Boo b, produced via the cyclotron maser mechanism. Assuming the emission is from the planet, Turner et al. 2021 found that the derived planetary magnetic field is compatible with theoretical predictions. The need to confirm this tentative detection is critical as a conclusive detection would have broad implications for exoplanetary science. In this study, we performed a follow-up campaign on the $\tau$ Boo system using the newly commissioned NenuFAR telescope in 2020. We do not detect any bursty emission in the NenuFAR observations. There are many different degenerate explanations for our non-detection. For example, the original bursty signal may have been caused by an unknown instrumental systematic. Alternatively, the planetary emission from $\tau$ Boo b is variable. As planetary radio emission is triggered by the interaction of the planetary magnetosphere with the magnetized stellar wind, the expected intensity of the planetary radio emission varies greatly with stellar rotation and along the stellar magnetic cycle. More observations are needed to fully understand the mystery of the possible variability of the $\tau$ Boo b radio emission.


title: Universal Multi-modal Entity Alignment via Iteratively Fusing Modality Similarity Paths

abstract: The objective of Entity Alignment (EA) is to identify equivalent entity pairs from multiple Knowledge Graphs (KGs) and create a more comprehensive and unified KG. The majority of EA methods have primarily focused on the structural modality of KGs, lacking exploration of multi-modal information. A few multi-modal EA methods have made good attempts in this field. Still, they have two shortcomings: (1) inconsistent and inefficient modality modeling that designs complex and distinct models for each modality; (2) ineffective modality fusion due to the heterogeneous nature of modalities in EA. To tackle these challenges, we propose PathFusion, consisting of two main components: (1) MSP, a unified modeling approach that simplifies the alignment process by constructing paths connecting entities and modality nodes to represent multiple modalities; (2) IRF, an iterative fusion method that effectively combines information from different modalities using the path as an information carrier. Experimental results on real-world datasets demonstrate the superiority of PathFusion over state-of-the-art methods, with 22.4%-28.9% absolute improvement on Hits@1, and 0.194-0.245 absolute improvement on MRR.


title: Molecular De Novo Design through Transformer-based Reinforcement Learning

abstract: In this work, we introduce a method to fine-tune a Transformer-based generative model for molecular de novo design. Leveraging the superior sequence learning capacity of Transformers over Recurrent Neural Networks (RNNs), our model can generate molecular structures with desired properties effectively. In contrast to the traditional RNN-based models, our proposed method exhibits superior performance in generating compounds predicted to be active against various biological targets, capturing long-term dependencies in the molecular structure sequence. The model's efficacy is demonstrated across numerous tasks, including generating analogues to a query structure and producing compounds with particular attributes, outperforming the baseline RNN-based methods. Our approach can be used for scaffold hopping, library expansion starting from a single molecule, and generating compounds with high predicted activity against biological targets.


title: Rotation Matters: Generalized Monocular 3D Object Detection for Various Camera Systems

abstract: Research on monocular 3D object detection is being actively studied, and as a result, performance has been steadily improving. However, 3D object detection performance is significantly reduced when applied to a camera system different from the system used to capture the training datasets. For example, a 3D detector trained on datasets from a passenger car mostly fails to regress accurate 3D bounding boxes for a camera mounted on a bus. In this paper, we conduct extensive experiments to analyze the factors that cause performance degradation. We find that changing the camera pose, especially camera orientation, relative to the road plane caused performance degradation. In addition, we propose a generalized 3D object detection method that can be universally applied to various camera systems. We newly design a compensation module that corrects the estimated 3D bounding box location and heading direction. The proposed module can be applied to most of the recent 3D object detection networks. It increases AP3D score (KITTI moderate, IoU $> 70\%$) about 6-to-10-times above the baselines without additional training. Both quantitative and qualitative results show the effectiveness of the proposed method.


title: Special K-stability and positivity of CM line bundles

abstract: We show that the CM line bundle on a proper family parametrizing specially K-stable varieties with maximal variation is ample. As an application, we show projectivity of any proper subspace of the coarse moduli space of uniformly adiabatically K-stable klt--trivial fibrations over curves constructed in [HH23].


title: Measuring Acoustics with Collaborative Multiple Agents

abstract: As humans, we hear sound every second of our life. The sound we hear is often affected by the acoustics of the environment surrounding us. For example, a spacious hall leads to more reverberation. Room Impulse Responses (RIR) are commonly used to characterize environment acoustics as a function of the scene geometry, materials, and source/receiver locations. Traditionally, RIRs are measured by setting up a loudspeaker and microphone in the environment for all source/receiver locations, which is time-consuming and inefficient. We propose to let two robots measure the environment's acoustics by actively moving and emitting/receiving sweep signals. We also devise a collaborative multi-agent policy where these two robots are trained to explore the environment's acoustics while being rewarded for wide exploration and accurate prediction. We show that the robots learn to collaborate and move to explore environment acoustics while minimizing the prediction error. To the best of our knowledge, we present the very first problem formulation and solution to the task of collaborative environment acoustics measurements with multiple agents.