title: A Setwise Approach for Effective and Highly Efficient Zero-shot Ranking with Large Language Models

abstract: We propose a novel zero-shot document ranking approach based on Large Language Models (LLMs): the Setwise prompting approach. Our approach complements existing prompting approaches for LLM-based zero-shot ranking: Pointwise, Pairwise, and Listwise. Through the first-of-its-kind comparative evaluation within a consistent experimental framework and considering factors like model size, token consumption, latency, among others, we show that existing approaches are inherently characterised by trade-offs between effectiveness and efficiency. We find that while Pointwise approaches score high on efficiency, they suffer from poor effectiveness. Conversely, Pairwise approaches demonstrate superior effectiveness but incur high computational overhead. Our Setwise approach, instead, reduces the number of LLM inferences and the amount of prompt token consumption during the ranking procedure, compared to previous methods. This significantly improves the efficiency of LLM-based zero-shot ranking, while also retaining high zero-shot ranking effectiveness. We make our code and results publicly available at \url{https://github.com/ielab/llm-rankers}.


title: Estimates for stress concentration between two adjacent rigid inclusions in Stokes flow

abstract: In this paper, we establish the estimates for the gradient and the second-order partial derivatives for the Stokes flow in the presence of two closely located strictly convex inclusions in dimension three. Moreover, the blow-up rate of the gradient is showed to be optimal by a pointwise upper bound and a lower bound in the narrowest region. We also show the optimal blow-up rate of Cauchy stress tensor. In dimensions greater than three, the upper bounds of the gradient are established. These results answer the questions raised in [25].


title: One-Shot Sensitivity-Aware Mixed Sparsity Pruning for Large Language Models

abstract: Various Large Language Models~(LLMs) from the Generative Pretrained Transformer(GPT) family have achieved outstanding performances in a wide range of text generation tasks. However, the enormous model sizes have hindered their practical use in real-world applications due to high inference latency. Therefore, improving the efficiencies of LLMs through quantization, pruning, and other means has been a key issue in LLM studies. In this work, we propose a method based on Hessian sensitivity-aware mixed sparsity pruning to prune LLMs to at least 50% sparsity without the need of any retraining. It allocates sparsity adaptively based on sensitivity, allowing us to reduce pruning-induced error while maintaining the overall sparsity level. The advantages of the proposed method exhibit even more when the sparsity is extremely high. Furthermore, our method is compatible with quantization, enabling further compression of LLMs. We have released the available code.


title: Algebraic connectedness and bipartiteness of quantum graphs

abstract: Connectedness and bipartiteness are basic properties of classical graphs, and the purpose of this paper is to investigate the case of quantum graphs. We introduce the notion of connectedness and bipartiteness of quantum graphs in terms of graph homomorphisms. This paper shows that regular tracial quantum graphs have the same algebraic characterization of connectedness and bipartiteness as classical graphs. We also prove the equivalence between bipartiteness and two-colorability of quantum graphs by comparing two notions of graph homomorphisms respecting adjacency matrices or edge spaces. In particular, all kinds of quantum two-colorability are mutually equivalent for regular connected tracial quantum graphs.


title: DepNeCTI: Dependency-based Nested Compound Type Identification for Sanskrit

abstract: Multi-component compounding is a prevalent phenomenon in Sanskrit, and understanding the implicit structure of a compound's components is crucial for deciphering its meaning. Earlier approaches in Sanskrit have focused on binary compounds and neglected the multi-component compound setting. This work introduces the novel task of nested compound type identification (NeCTI), which aims to identify nested spans of a multi-component compound and decode the implicit semantic relations between them. To the best of our knowledge, this is the first attempt in the field of lexical semantics to propose this task. We present 2 newly annotated datasets including an out-of-domain dataset for this task. We also benchmark these datasets by exploring the efficacy of the standard problem formulations such as nested named entity recognition, constituency parsing and seq2seq, etc. We present a novel framework named DepNeCTI: Dependency-based Nested Compound Type Identifier that surpasses the performance of the best baseline with an average absolute improvement of 13.1 points F1-score in terms of Labeled Span Score (LSS) and a 5-fold enhancement in inference efficiency. In line with the previous findings in the binary Sanskrit compound identification task, context provides benefits for the NeCTI task. The codebase and datasets are publicly available at: https://github.com/yaswanth-iitkgp/DepNeCTI


title: Deep Nonlinear Adaptive Control for Unmanned Aerial Systems Operating under Dynamic Uncertainties

abstract: Recent literature in the field of machine learning (ML) control has shown promising theoretical results for a Deep Neural Network (DNN) based Nonlinear Adaptive Controller (DNAC) capable of achieving trajectory tracking for nonlinear systems. Expanding on this work, this paper applies DNAC to the Attitude Control System (ACS) of a quadrotor and shows improvement to attitude control performance under disturbed flying conditions where the model uncertainty is high. Moreover, these results are noteworthy for ML control because they were achieved with no prior training data and an arbitrary system dynamics initialization; simply put, the controller presented in this paper is practically modelless, yet yields the ability to force trajectory tracking for nonlinear systems while rejecting significant undesirable model disturbances learned through a DNN. The combination of ML techniques to learn a system's dynamics and the Lyapunov analysis required to provide stability guarantees leads to a controller with applications in safety-critical systems that may undergo uncertain model changes, as is the case for most aerial systems. Experimental findings are analyzed in the final section of this paper, and DNAC is shown to outperform the trajectory tracking capabilities of PID, MRAC, and the recently developed Deep Model Reference Adaptive Control (DMRAC) schemes.


title: JM3D & JM3D-LLM: Elevating 3D Understanding with Joint Multi-modal Cues

abstract: The rising importance of 3D understanding, pivotal in computer vision, autonomous driving, and robotics, is evident. However, a prevailing trend, which straightforwardly resorted to transferring 2D alignment strategies to the 3D domain, encounters three distinct challenges: (1) Information Degradation: This arises from the alignment of 3D data with mere single-view 2D images and generic texts, neglecting the need for multi-view images and detailed subcategory texts. (2) Insufficient Synergy: These strategies align 3D representations to image and text features individually, hampering the overall optimization for 3D models. (3) Underutilization: The fine-grained information inherent in the learned representations is often not fully exploited, indicating a potential loss in detail. To address these issues, we introduce JM3D, a comprehensive approach integrating point cloud, text, and image. Key contributions include the Structured Multimodal Organizer (SMO), enriching vision-language representation with multiple views and hierarchical text, and the Joint Multi-modal Alignment (JMA), combining language understanding with visual representation. Our advanced model, JM3D-LLM, marries 3D representation with large language models via efficient fine-tuning. Evaluations on ModelNet40 and ScanObjectNN establish JM3D's superiority. The superior performance of JM3D-LLM further underscores the effectiveness of our representation transfer approach. Our code and models are available at https://github.com/Mr-Neko/JM3D.


title: Node Dissimilarity Index for Complex Network Analysis

abstract: We propose a principal component analysis (PCA)-based approach to quantify (the node dissimilarity index, NDI) the extent of dissimilarity among nodes in a network with respect to values incurred for a suite of node-level metrics (like centrality metrics). We subject the dataset (n nodes and their values incurred for four commonly studied centrality metrics: degree, eigenvector, betweenness and closeness) to PCA and retain the m ( <= 4) principal components (with variance >= 1.0). We construct an n-node dissimilarity matrix whose entries are the absolute difference (if m = 1) or Euclidean distance (if M > 1) of the principal component coordinates of the corresponding nodes. We compute NDI (>= 1.0) to be the ratio of the principal Eigenvalue of the node dissimilarity matrix and average of entries in the node dissimilarity matrix. The larger the NDI, the greater the dissimilarity among the node-level metrics (centrality metrics) values considered for analysis.


title: Advancing Test-Time Adaptation for Acoustic Foundation Models in Open-World Shifts

abstract: Test-Time Adaptation (TTA) is a critical paradigm for tackling distribution shifts during inference, especially in visual recognition tasks. However, while acoustic models face similar challenges due to distribution shifts in test-time speech, TTA techniques specifically designed for acoustic modeling in the context of open-world data shifts remain scarce. This gap is further exacerbated when considering the unique characteristics of acoustic foundation models: 1) they are primarily built on transformer architectures with layer normalization and 2) they deal with test-time speech data of varying lengths in a non-stationary manner. These aspects make the direct application of vision-focused TTA methods, which are mostly reliant on batch normalization and assume independent samples, infeasible. In this paper, we delve into TTA for pre-trained acoustic models facing open-world data shifts. We find that noisy, high-entropy speech frames, often non-silent, carry key semantic content. Traditional TTA methods might inadvertently filter out this information using potentially flawed heuristics. In response, we introduce a heuristic-free, learning-based adaptation enriched by confidence enhancement. Noting that speech signals' short-term consistency, we also apply consistency regularization during test-time optimization. Our experiments on synthetic and real-world datasets affirm our method's superiority over existing baselines.


title: Towards Semantic Communication Protocols for 6G: From Protocol Learning to Language-Oriented Approaches

abstract: The forthcoming 6G systems are expected to address a wide range of non-stationary tasks. This poses challenges to traditional medium access control (MAC) protocols that are static and predefined. In response, data-driven MAC protocols have recently emerged, offering ability to tailor their signaling messages for specific tasks. This article presents a novel categorization of these data-driven MAC protocols into three levels: Level 1 MAC. task-oriented neural protocols constructed using multi-agent deep reinforcement learning (MADRL); Level 2 MAC. neural network-oriented symbolic protocols developed by converting Level 1 MAC outputs into explicit symbols; and Level 3 MAC. language-oriented semantic protocols harnessing large language models (LLMs) and generative models. With this categorization, we aim to explore the opportunities and challenges of each level by delving into their foundational techniques. Drawing from information theory and associated principles as well as selected case studies, this study provides insights into the trajectory of data-driven MAC protocols and sheds light on future research directions.


title: Foundation Ark: Accruing and Reusing Knowledge for Superior and Robust Performance

abstract: Deep learning nowadays offers expert-level and sometimes even super-expert-level performance, but achieving such performance demands massive annotated data for training (e.g., Google's proprietary CXR Foundation Model (CXR-FM) was trained on 821,544 labeled and mostly private chest X-rays (CXRs)). Numerous datasets are publicly available in medical imaging but individually small and heterogeneous in expert labels. We envision a powerful and robust foundation model that can be trained by aggregating numerous small public datasets. To realize this vision, we have developed Ark, a framework that accrues and reuses knowledge from heterogeneous expert annotations in various datasets. As a proof of concept, we have trained two Ark models on 335,484 and 704,363 CXRs, respectively, by merging several datasets including ChestX-ray14, CheXpert, MIMIC-II, and VinDr-CXR, evaluated them on a wide range of imaging tasks covering both classification and segmentation via fine-tuning, linear-probing, and gender-bias analysis, and demonstrated our Ark's superior and robust performance over the SOTA fully/self-supervised baselines and Google's proprietary CXR-FM. This enhanced performance is attributed to our simple yet powerful observation that aggregating numerous public datasets diversifies patient populations and accrues knowledge from diverse experts, yielding unprecedented performance yet saving annotation cost. With all codes and pretrained models released at GitHub.com/JLiangLab/Ark, we hope that Ark exerts an important impact on open science, as accruing and reusing knowledge from expert annotations in public datasets can potentially surpass the performance of proprietary models trained on unusually large data, inspiring many more researchers worldwide to share codes and datasets to build open foundation models, accelerate open science, and democratize deep learning for medical imaging.


title: Findability: A Novel Measure of Information Accessibility

abstract: The overwhelming volume of data generated and indexed by search engines poses a significant challenge in retrieving documents from the index efficiently and effectively. Even with a well-crafted query, several relevant documents often get buried among a multitude of competing documents, resulting in reduced accessibility or `findability' of the desired document. Consequently, it is crucial to develop a robust methodology for assessing this dimension of Information Retrieval (IR) system performance. While previous studies have focused on measuring document accessibility disregarding user queries and document relevance, there exists no metric to quantify the findability of a document within a given IR system without resorting to manual labor. This paper aims to address this gap by defining and deriving a metric to evaluate the findability of documents as perceived by end-users. Through experiments, we demonstrate the varying impact of different retrieval models and collections on the findability of documents. Furthermore, we establish the findability measure as an independent metric distinct from retrievability, an accessibility measure introduced in prior literature.


title: Numerical simulation to the time fractional Vakhnenko Parkes equation for modeling the propagation of high frequency waves in relaxation medium

abstract: This article is concerned with solving the time fractional Vakhnenko Parkes equation using the reproducing kernels. Reproducing kernel theory, the normal basis, some important Hilbert spaces, homogenization of constraints, and the orthogonalization process are the main tools of this technique. The main advantage of reproducing kernel method is it is truly meshless. The solutions obtained by the implementation reproducing kernels Hilbert space method on the time-fractional Vakhnenko Parkes equation is in the form of a series. The obtained solution converges to the exact solution uniquely. It is observed that the implemented method is highly effective. The effectiveness of reproducing kernel Hilbert space method is presented through the tables and graphs. The perfectness of this method is tested by taking different error norms and the order of convergence of the errors.


title: Survey on Security Attacks in Connected and Autonomous Vehicular Systems

abstract: Connected and autonomous vehicles, also known as CAVs, are a general trend in the evolution of the automotive industry that can be utilized to make transportation safer, improve the number of mobility options available, user costs will go down and new jobs will be created. However, as our society grows more automated and networked, criminal actors will have additional opportunities to conduct a variety of attacks, putting CAV security in danger. By providing a brief review of the state of cyber security in the CAVs environment, this study aims to draw attention to the issues and concerns associated with security. The first thing it does is categorize the multiple cybersecurity threats and weaknesses in the context of CAVs into three groups: attacks on the vehicles network, attacks on the Internet at large, and other attacks. This is done in accordance with the various communication networks and targets under attack. Next, it considers the possibility of cyber attacks to be an additional form of threat posed by the environment of CAVs. After that, it details the most uptodate defense tactics for securing CAVs and analyzes how effective they are. In addition, it draws some conclusions about the various cyber security and safety requirements of CAVs that are now available, which is beneficial for the use of CAVs in the real world. At the end, we discussed some implications on Adversary Attacks on Autonomous Vehicles. In conclusion, a number of difficulties and unsolved issues for future research are analyzed and explored.


title: Online Parameter Identification of Generalized Non-cooperative Game

abstract: This work studies the parameter identification problem of a generalized non-cooperative game, where each player's cost function is influenced by an observable signal and some unknown parameters. We consider the scenario where equilibrium of the game at some observable signals can be observed with noises, whereas our goal is to identify the unknown parameters with the observed data. Assuming that the observable signals and the corresponding noise-corrupted equilibriums are acquired sequentially, we construct this parameter identification problem as online optimization and introduce a novel online parameter identification algorithm. To be specific, we construct a regularized loss function that balances conservativeness and correctiveness, where the conservativeness term ensures that the new estimates do not deviate significantly from the current estimates, while the correctiveness term is captured by the Karush-Kuhn-Tucker conditions. We then prove that when the players' cost functions are linear with respect to the unknown parameters and the learning rate of the online parameter identification algorithm satisfies \mu_k \propto 1/\sqrt{k}, along with other assumptions, the regret bound of the proposed algorithm is O(\sqrt{K}). Finally, we conduct numerical simulations on a Nash-Cournot problem to demonstrate that the performance of the online identification algorithm is comparable to that of the offline setting.


title: Attentive Multi-Layer Perceptron for Non-autoregressive Generation

abstract: Autoregressive~(AR) generation almost dominates sequence generation for its efficacy. Recently, non-autoregressive~(NAR) generation gains increasing popularity for its efficiency and growing efficacy. However, its efficiency is still bottlenecked by quadratic complexity in sequence lengths, which is prohibitive for scaling to long sequence generation and few works have been done to mitigate this problem. In this paper, we propose a novel MLP variant, \textbf{A}ttentive \textbf{M}ulti-\textbf{L}ayer \textbf{P}erceptron~(AMLP), to produce a generation model with linear time and space complexity. Different from classic MLP with static and learnable projection matrices, AMLP leverages adaptive projections computed from inputs in an attentive mode. The sample-aware adaptive projections enable communications among tokens in a sequence, and model the measurement between the query and key space. Furthermore, we marry AMLP with popular NAR models, deriving a highly efficient NAR-AMLP architecture with linear time and space complexity. Empirical results show that such marriage architecture surpasses competitive efficient NAR models, by a significant margin on text-to-speech synthesis and machine translation. We also test AMLP's self- and cross-attention ability separately with extensive ablation experiments, and find them comparable or even superior to the other efficient models. The efficiency analysis further shows that AMLP extremely reduces the memory cost against vanilla non-autoregressive models for long sequences.


title: Fragmentation of projectile nucleus

abstract: The temperature characteristics of carbon spectator fragments formed in carbon collisions with carbon nuclei at a primary momentum of 4.2 GeV/c per nucleon were presented and discussed on corrected experimental data. As well as studied the multiplicities formed by the spectator protons, deuterons, and tritons in the inelastic nucleus-nucleus interactions. We found that the temperature absorbed by the spectator fragments is dependent on their mass.


title: ACA observation and chemical modelling of phosphorus nitride (PN) towards the hot molecular cores G10.47+0.03 and G31.41+0.31

abstract: Phosphorus (P) is one of the important elements for the formation of life and plays a crucial role in several biochemical processes. Recent spectral line surveys have confirmed the existence of P-bearing molecules, especially PN and PO, in the star-formation regions, but their formation mechanisms are poorly understood. The P-bearing molecule phosphorus nitride (PN) is detected in several star-forming regions, but this molecule has been poorly studied at high gas densities ($\geq$10$^{6}$ cm$^{-3}$) hot molecular cores. In this article, we present the detection of the rotational emission line of PN with transition J = 3$-$2 towards the hot molecular cores G10.47+0.03 and G31.41+0.31, using the Atacama Compact Array (ACA). The estimated column densities of PN for G10.47+0.03 and G31.41+0.31 using the local thermodynamic equilibrium (LTE) model are (3.60$\pm$0.2)$\times$10$^{13}$ cm$^{-2}$ and (9.10$\pm$0.1)$\times$10$^{12}$ cm$^{-2}$ with an excitation temperature of 150$\pm$25 K. The fractional abundance of PN relative to H$_{2}$ is 2.76$\times$10$^{-10}$ for G10.47+0.03 and 5.68$\times$10$^{-11}$ for G31.41+0.031. We compute the two-phase warm-up chemical model of PN to understand the chemical evolution in the environment of hot molecular cores. After chemical modelling, we claim that PN is created in the gas phase via the neutral-neutral reaction between PO and N in the warm-up stage. Similarly, PN is destroyed via the ion-neutral reaction between H$_{3}$O$^{+}$ and PN.


title: Scaling and Evolution of Stellar Magnetic Activity

abstract: Magnetic activity is a ubiquitous feature of stars with convective outer layers, with implications from stellar evolution to planetary atmospheres. Investigating the mechanisms responsible for the observed stellar activity signals from days to billions of years is important in deepening our understanding of the spatial configurations and temporal patterns of stellar dynamos, including that of the Sun. In this paper, we focus on three problems and their possible solutions. We start with direct field measurements and show how they probe the dependence of magnetic flux and its density on stellar properties and activity indicators. Next, we review the current state-of-the-art in physics-based models of photospheric activity patterns and their variation from rotational to activity-cycle timescales. We then outline the current state of understanding in the long-term evolution of stellar dynamos, first by using chromospheric and coronal activity diagnostics, then with model-based implications on magnetic braking, which is the key mechanism by which stars spin down and become inactive as they age. We conclude by discussing possible directions to improve the modeling and analysis of stellar magnetic fields.


title: Efficient Link Prediction via GNN Layers Induced by Negative Sampling

abstract: Graph neural networks (GNNs) for link prediction can loosely be divided into two broad categories. First, \emph{node-wise} architectures pre-compute individual embeddings for each node that are later combined by a simple decoder to make predictions. While extremely efficient at inference time (since node embeddings are only computed once and repeatedly reused), model expressiveness is limited such that isomorphic nodes contributing to candidate edges may not be distinguishable, compromising accuracy. In contrast, \emph{edge-wise} methods rely on the formation of edge-specific subgraph embeddings to enrich the representation of pair-wise relationships, disambiguating isomorphic nodes to improve accuracy, but with the cost of increased model complexity. To better navigate this trade-off, we propose a novel GNN architecture whereby the \emph{forward pass} explicitly depends on \emph{both} positive (as is typical) and negative (unique to our approach) edges to inform more flexible, yet still cheap node-wise embeddings. This is achieved by recasting the embeddings themselves as minimizers of a forward-pass-specific energy function (distinct from the actual training loss) that favors separation of positive and negative samples. As demonstrated by extensive empirical evaluations, the resulting architecture retains the inference speed of node-wise models, while producing competitive accuracy with edge-wise alternatives.


title: OBSUM: An object-based spatial unmixing model for spatiotemporal fusion of remote sensing images

abstract: Spatiotemporal fusion aims to improve both the spatial and temporal resolution of remote sensing images, thus facilitating time-series analysis at a fine spatial scale. However, there are several important issues that limit the application of current spatiotemporal fusion methods. First, most spatiotemporal fusion methods are based on pixel-level computation, which neglects the valuable object-level information of the land surface. Moreover, many existing methods cannot accurately retrieve strong temporal changes between the available high-resolution image at base date and the predicted one. This study proposes an Object-Based Spatial Unmixing Model (OBSUM), which incorporates object-based image analysis and spatial unmixing, to overcome the two abovementioned problems. OBSUM consists of one preprocessing step and three fusion steps, i.e., object-level unmixing, object-level residual compensation, and pixel-level residual compensation. OBSUM can be applied using only one fine image at the base date and one coarse image at the prediction date, without the need of a coarse image at the base date. The performance of OBSUM was compared with five representative spatiotemporal fusion methods. The experimental results demonstrated that OBSUM outperformed other methods in terms of both accuracy indices and visual effects over time-series. Furthermore, OBSUM also achieved satisfactory results in two typical remote sensing applications. Therefore, it has great potential to generate accurate and high-resolution time-series observations for supporting various remote sensing applications.


title: Instruction Tuning with Human Curriculum

abstract: In this work, we (1) introduce Curriculum Instruction Tuning, (2) explore the potential advantages of employing diverse curriculum strategies, and (3) delineate a synthetic instruction-response generation framework that complements our theoretical approach. Distinct from the existing instruction tuning dataset, our generation pipeline is systematically structured to emulate the sequential and orderly characteristic of human learning. Additionally, we describe a methodology for generating instruction-response datasets that extensively span the various stages of human education, from middle school through the graduate level, utilizing educational subject catalogs. Before training, we meticulously organize the instruction data to ensure that questions escalate in difficulty regarding (A) the subject matter and (B) the intricacy of the instructions. The findings of our study reveal that substantial improvements in performance can be achieved through the mere application of curriculum ordering to instruction data (achieving gains of +4.76 on TruthfulQA, +2.98 on MMLU, +2.8 on OpenbookQA, and +1.28 on ARC-hard) compared to random shuffling. This enhancement is achieved without incurring additional computational expenses. Through comprehensive experimentation, we observe that the advantages of our proposed method are consistently evident across nine benchmarks.


title: Crowd Modeling and Control via Cooperative Adaptive Filtering

abstract: This paper introduces a crowd modeling and motion control approach that employs diffusion adaptation within an adaptive network. In the network, nodes collaboratively address specific estimation problems while simultaneously moving as agents governed by certain motion control mechanisms. Our research delves into the behaviors of agents when they encounter spatial constraints. Within this framework, agents pursue several objectives, such as target tracking, coherent motion, and obstacle evasion. Throughout their navigation, they demonstrate a nature of self-organization and self-adjustment that drives them to maintain certain social distances with each other, and adaptively adjust their behaviors in response to the environmental changes. Our findings suggest a promising approach to mitigate the spread of viral pandemics and averting stampedes.


title: Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model

abstract: While large language models have proven effective in a huge range of downstream applications, they often generate text that is problematic or lacks a desired attribute. In this paper, we introduce Reward-Augmented Decoding (RAD), a text generation procedure that uses a small unidirectional reward model to encourage a language model to generate text that has certain properties. Specifically, RAD uses the reward model to score generations as they are produced and rescales sampling probabilities to favor high-reward tokens. By using a unidirectional reward model, RAD can cache activations from prior generation steps to decrease computational overhead. Through experiments on generating non-toxic and sentiment-controlled text, we demonstrate that RAD performs best among methods that change only the generation procedure and matches the performance of state-of-the-art methods that involve re-training the language model. We further validate that RAD is effective on very large language models while incurring a minimal computational overhead.


title: Effective electrical manipulation of topological antiferromagnet by orbital Hall effect

abstract: Electrical control of the non-trivial topology in Weyl antiferromagnet is of great interests to develop next-generation spintronic devices. Recent works suggest that spin Hall effect can switch the topological antiferromagnetic order. However, the switching efficiency remains relatively low. Here, we demonstrate effective manipulation of antiferromagnetic order in Weyl semimetal Mn3Sn by orbital Hall effect originated from metal Mn or oxide CuOx. While Mn3Sn is proven to be able to convert orbit current to spin current by itself, we find that inserting a heavy metal layer like Pt with proper thickness can effectively reduce the critical switching current density by one order of magnitude. In addition, we show that the memristor-like switching behavior of Mn3Sn can mimic the potentiation and depression processes of a synapse with high linearity, which is beneficial for constructing artificial neural network with high accuracy. Our work paves an alternative way to manipulate topological antiferromagnetic order and may inspire more high-performance antiferromagnetic functional devices.


title: Dynamic Prediction of Full-Ocean Depth SSP by Hierarchical LSTM: An Experimental Result

abstract: SSP distribution is an important parameter for underwater positioning, navigation and timing (PNT) because it affects the propagation mode of underwater acoustic signals. To accurate predict future sound speed distribution, we propose a hierarchical long short--term memory (H--LSTM) neural network for future sound speed prediction, which explore the distribution pattern of sound velocity in the time dimension. To verify the feasibility and effectiveness, we conducted both simulations and real experiments. The ocean experiment was held in the South China Sea in April, 2023. Results show that the accuracy of the proposed method outperforms the state--of--the--art methods.


title: Toughness and spectral radius in graphs

abstract: The Brouwer's toughness conjecture states that every $d$-regular connected graph always has $t(G)>\frac{d}{\lambda}-1$ where $\lambda$ is the second largest absolute eigenvalue of the adjacency matrix. In 1988, Enomoto introduced a variation of toughness $\tau(G)$ of a graph $G$. By incorporating the variation of toughness and spectral conditions, we provide spectral conditions for a graph to be $\tau$-tough ($\tau\geq 2$ is an integer) and to be $\tau$-tough ($\frac{1}{\tau}$ is a positive integer) with minimum degree $\delta$, respectively. Additionally, we also investigate a analogous problem concerning balanced bipartite graphs.


title: CWISE J105512.11+544328.3: A Nearby Y Dwarf Spectroscopically Confirmed with Keck/NIRES

abstract: Y dwarfs, the coolest known spectral class of brown dwarfs, overlap in mass and temperature with giant exoplanets, providing unique laboratories for studying low-temperature atmospheres. However, only a fraction of Y dwarf candidates have been spectroscopically confirmed. We present Keck/NIRES near-infrared spectroscopy of the nearby ($d \approx 6-8$ pc) brown dwarf CWISE J105512.11+544328.3. Although its near-infrared spectrum aligns best with the Y0 standard in the $J$-band, no standard matches well across the full $YJHK$ wavelength range. The CWISE J105512.11+544328.3 NH$_3$-$H$ = 0.427 $\pm$ 0.0012 and CH$_4$-$J$ = 0.0385 $\pm$ 0.0007 absorption indices and absolute Spitzer [4.5] magnitude of 15.18 $\pm$ 0.22 are also indicative of an early Y dwarf rather than a late T dwarf. CWISE J105512.11+544328.3 additionally exhibits the bluest Spitzer [3.6]$-$[4.5] color among all spectroscopically confirmed Y dwarfs. Despite this anomalously blue Spitzer color given its low luminosity, CWISE J105512.11+544328.3 does not show other clear kinematic or spectral indications of low metallicity. Atmospheric model comparisons yield a log(g) $\le$ 4.5 and $T_{\rm eff} \approx 500 \pm 150$ K for this source. We classify CWISE J105512.11+544328.3 as a Y0 (pec) dwarf, adding to the remarkable diversity of the Y-type population. JWST spectroscopy would be crucial to understanding the origin of this Y dwarf's unusual preference for low-gravity models and blue 3-5 $\mu$m color.


title: TS-ENAS:Two-Stage Evolution for Cell-based Network Architecture Search

abstract: Neural network architecture search provides a solution to the automatic design of network structures. However, it is difficult to search the whole network architecture directly. Although using stacked cells to search neural network architectures is an effective way to reduce the complexity of searching, these methods do not able find the global optimal neural network structure since the number of layers, cells and connection methods is fixed. In this paper, we propose a Two-Stage Evolution for cell-based Network Architecture Search(TS-ENAS), including one-stage searching based on stacked cells and second-stage adjusting these cells. In our algorithm, a new cell-based search space and an effective two-stage encoding method are designed to represent cells and neural network structures. In addition, a cell-based weight inheritance strategy is designed to initialize the weight of the network, which significantly reduces the running time of the algorithm. The proposed methods are extensively tested and compared on four image classification dataset, Fashion-MNIST, CIFAR10, CIFAR100 and ImageNet and compared with 22 state-of-the-art algorithms including hand-designed networks and NAS networks. The experimental results show that TS-ENAS can more effectively find the neural network architecture with comparative performance.


title: Superconductivity in thin films of RuN

abstract: Superconductivity has been found in RuN films obtained by reactive magnetron sputtering. This is a novel member of the metal nitride superconductors family. The critical temperature of the superconducting transition varies depending on the substrate and ranges from 0.77 K to 1.29 K. The parameters of the crystal lattice of superconducting films have been determined: the lattice is distorted cubic with parameters $a = b = c = 4.5586$ \AA , $\alpha =\beta =\gamma =87.96^\circ$. A zero temperature upper critical magnetic field $H_{c2}(0)$ and the coherence length were found from the experimental data using WHH model. $H_{c2}(0) = 2.3$ T- 4.1 T for different substrates and exceeds the upper paramagnetic limit, as well as $\xi = 12$ nm. An s-wave single band energy gap $\Delta(0) = 0.19$ meV was revealed by self-field critical current experiment at temperatures down to 10 mK, $2\Delta /kT_c =5.5$ exceeding the BCS ratio 3.5.


title: A discontinuous plane wave neural network method for Helmholtz equation and time-harmonic Maxwell's equations

abstract: In this paper we propose a {\it discontinuous} plane wave neural network (DPWNN) method with $hp-$refinement for approximately solving Helmholtz equation and time-harmonic Maxwell equations. In this method, we define a quadratic functional as in the plane wave least square (PWLS) method with $h-$refinement and introduce new discretization sets spanned by element-wise neural network functions with a single hidden layer, where the activation function on each element is chosen as a complex-valued exponential function like the plane wave function. The desired approximate solution is recursively generated by iteratively solving the minimization problem associated with the functional and the sets described above, which is defined by a sequence of approximate minimizers of the underlying residual functionals, where plane wave direction angles and activation coefficients are alternatively computed by iterative algorithms. For the proposed DPWNN method, the plane wave directions are adaptively determined in the iterative process, which is different from that in the standard PWLS method (where the plane wave directions are preliminarily given). Numerical experiments will confirm that this DPWNN method can generate approximate solutions with higher accuracy than the PWLS method.


title: Hypernetwork-based Meta-Learning for Low-Rank Physics-Informed Neural Networks

abstract: In various engineering and applied science applications, repetitive numerical simulations of partial differential equations (PDEs) for varying input parameters are often required (e.g., aircraft shape optimization over many design parameters) and solvers are required to perform rapid execution. In this study, we suggest a path that potentially opens up a possibility for physics-informed neural networks (PINNs), emerging deep-learning-based solvers, to be considered as one such solver. Although PINNs have pioneered a proper integration of deep-learning and scientific computing, they require repetitive time-consuming training of neural networks, which is not suitable for many-query scenarios. To address this issue, we propose a lightweight low-rank PINNs containing only hundreds of model parameters and an associated hypernetwork-based meta-learning algorithm, which allows efficient approximation of solutions of PDEs for varying ranges of PDE input parameters. Moreover, we show that the proposed method is effective in overcoming a challenging issue, known as "failure modes" of PINNs.


title: Docking Peptides into HIV/FIV Protease with Deep Learning and Focused Peptide Docking Methods

abstract: Molecular docking is a structure-based computational drug design technique for predicting the interaction between a small molecule (ligand) and a macromolecule (receptor). Over the past three decades various docking software programs have been developed, mostly for drug-like molecules. With the recent interest in peptides as therapeutic molecules, several peptide docking methods have also been developed. AutoDock CrankPep (ADCP), is a state-of-the-art peptide docking tool that predicts the interaction of peptide with up to 20 amino acids in a user defined region of a macromolecule, i.e.focused docking. Recent advances in deep learning (DL) approaches have shown remarkable success in docking linear peptides composed of natural amino acids only. Unlike ADCP, these methods provide a confidence level in their predictions. Here we explore whether ADCP and various DL methods (AlphaFold2 Monomer, AlphaFold2 Multimer, and OmegaFold) and their prediction confidence metric can be used to discriminate native and non-native substrates for HIV and FIV proteases. We found that ADCP successfully predicts the interactions of native peptides but fails to discriminate non-native ones. This was expected as conventional docking methods report solutions maximizing ligand receptor interactions for any ligand. Surprisingly, DL methods underperform when docking native peptides into these particular docking targets but achieve high success rates with non-native peptides. While AlphaFold managed to successfully dock a few of the native peptides, OmegaFold failed to successfully dock any of them. Overall, none of these methods is currently able to distinguish between native and non-native peptides, warranting further exploration of specialized methodologies.


title: Ergodicity, lack thereof, and the performance of reservoir computing with memristive networks

abstract: Networks composed of nanoscale memristive components, such as nanowire and nanoparticle networks, have recently received considerable attention because of their potential use as neuromorphic devices. In this study, we explore the connection between ergodicity in memristive and nanowire networks, showing that the performance of reservoir devices improves when these networks are tuned to operate at the edge between two global stability points. The lack of ergodicity is associated with the emergence of memory in the system. We measure the level of ergodicity using the Thirumalai-Mountain metric, and we show that in the absence of ergodicity, two memristive systems show improved performance when utilized as reservoir computers (RC). In particular, we highlight that it is also important to let the system synchronize to the input signal in order for the performance of the RC to exhibit improvements over the baseline.


title: Orbit transfer using Theory of Functional Connections via change of variables

abstract: This work shows that a class of astrodynamics problems subject to mission constraints can be efficiently solved using the Theory of Functional Connections (TFC) mathematical framework by a specific change of coordinates. In these problems, the constraints are initially written in non-linear and coupled mathematical forms using classical rectangular coordinates. The symmetries of the constrained problem are used to select a new system of coordinates that transforms the non-linear constraints into linear. This change of coordinates is also used to isolate the components of the constraints. This way the TFC technique can be used to solve the ordinary differential equations governing orbit transfer problems subject to mission constraints. Specifically, this paper shows how to apply the change of coordinates method to the perturbed Hohmann-type and the one-tangent burn transfer problems.


title: Toward Open Repository of Performance Portability of Applications, Benchmarks and Models

abstract: The adoption of heterogeneous computing systems based on diverse architectures to achieve exascale computing power has worsened the performance portability problem of scientific applications that were designed to run on these platforms. To cope with the challenges posed by supercomputing, new performance portability frameworks have been developed alongside advanced methods and metrics to evaluate the performance portability of heterogeneous applications. However, many studies have shown that the new methods and metrics do not produce coherent results which yield clear conclusions that are required for designing the hardware and software architectures of tomorrow's supercomputing systems. We outline a proposal to establish an open repository of performance portability of applications, benchmarks and models which will be standardized, objective, and based on strict operating and reporting guidelines. Such guidelines will ensure a fair, comparable and meaningful measure of the performance portability while the requirement for a detailed disclosure of the obtained results and the configuration settings will ensure the reproducibility of the reported results.


title: Towards End-to-End Unsupervised Saliency Detection with Self-Supervised Top-Down Context

abstract: Unsupervised salient object detection aims to detect salient objects without using supervision signals eliminating the tedious task of manually labeling salient objects. To improve training efficiency, end-to-end methods for USOD have been proposed as a promising alternative. However, current solutions rely heavily on noisy handcraft labels and fail to mine rich semantic information from deep features. In this paper, we propose a self-supervised end-to-end salient object detection framework via top-down context. Specifically, motivated by contrastive learning, we exploit the self-localization from the deepest feature to construct the location maps which are then leveraged to learn the most instructive segmentation guidance. Further considering the lack of detailed information in deepest features, we exploit the detail-boosting refiner module to enrich the location labels with details. Moreover, we observe that due to lack of supervision, current unsupervised saliency models tend to detect non-salient objects that are salient in some other samples of corresponding scenarios. To address this widespread issue, we design a novel Unsupervised Non-Salient Suppression (UNSS) method developing the ability to ignore non-salient objects. Extensive experiments on benchmark datasets demonstrate that our method achieves leading performance among the recent end-to-end methods and most of the multi-stage solutions. The code is available.


title: Measurement of Near-field Thermal Radiation between Multilayered Metamaterials

abstract: The near-field radiative heat transfer (NFRHT) between one-dimensional metamaterials comprising phonon dielectric multilayers was experimented. Large sized (1cm x 1cm) near-field samples were fabricated using SiC, SiO2 and Ge layers at a certain gap distance, and the effect of layer stacking order and phonon resonance quality on the NFRHT was examined. The measured results show good agreement with those obtained theoretically employing the transmission matrix method. Super-Planckian blackbody radiation was observed between the emitters and receivers with identical structures. Measurements demonstrate failure of the effective medium theory (EMT) in predicting the near-field heat flux especially in the presence of bounded surface modes, such as the epsilon-near-zero (ENZ) mode. Analyses also indicate that, in certain cases, the EMT can provide reasonable physical insight into the underlying coupling process from the perspective of homogenized media. The conditions to apply the EMT in the near-field regime was also touched upon.


title: Voltage controlled iontronic switches: a computational method to predict electrowetting in hydrophobically gated nanopores

abstract: Reliable and controllable switches are crucial in nanofluidics and iontronics. Ion channels in nature serve as a rich source of inspiration due to their intricate mechanisms modulated by stimuli like pressure, temperature, chemicals, and voltage. The artificial replication of the properties of these channels is challenging due to their complex chemistry, limited stability range, and intricate moving parts, allosterically modulated. Nonetheless, we can harness some of their gating mechanisms for nanofluidic and iontronic purposes. This theoretical and computational study explores the use of electrowetting in hydrophobic nanopores to control their conductance using an external applied voltage. We employ restrained molecular dynamics to calculate the free energy required for wetting a model nanopore under different voltages. Utilizing a simple theory, we generate free energy profiles across a wide voltage range. We also computed transition rates between conductive and non-conductive states, showing their voltage dependence and how this behaviour can impair memory to the system, resembling the memristor behaviour voltage-gated channels in the brain. These findings offer a promising avenue for designing and controlling hydrophobic nanopores via electrowetting, enabling potential applications in neuromorphic iontronics.


title: CarExpert: Leveraging Large Language Models for In-Car Conversational Question Answering

abstract: Large language models (LLMs) have demonstrated remarkable performance by following natural language instructions without fine-tuning them on domain-specific tasks and data. However, leveraging LLMs for domain-specific question answering suffers from severe limitations. The generated answer tends to hallucinate due to the training data collection time (when using off-the-shelf), complex user utterance and wrong retrieval (in retrieval-augmented generation). Furthermore, due to the lack of awareness about the domain and expected output, such LLMs may generate unexpected and unsafe answers that are not tailored to the target domain. In this paper, we propose CarExpert, an in-car retrieval-augmented conversational question-answering system leveraging LLMs for different tasks. Specifically, CarExpert employs LLMs to control the input, provide domain-specific documents to the extractive and generative answering components, and controls the output to ensure safe and domain-specific answers. A comprehensive empirical evaluation exhibits that CarExpert outperforms state-of-the-art LLMs in generating natural, safe and car-specific answers.


title: Microscopic derivation of transition-state theory for complex quantum systems

abstract: The decay of quantum complex systems through a potential barrier is often described with transition-state theory, also known as RRKM theory in chemistry. Here we derive the basic formula for transition-state theory based on a generic Hamiltonian as might be constructed in a configuration-interaction basis. Two reservoirs of random Hamiltonians from Gaussian orthogonal ensembles are coupled to intermediate states representing the transition states at a barrier. Under the condition that the decay of the reservoirs to open channels is large, an analytic formula for reaction rates is derived. The transition states act as independent Breit-Wigner resonances which contribute additively to the total transition probability, as is well known for electronic conductance through resonant tunneling states. It is also found that the transition probability is independent of the decay properties of the states in the second reservoir over a wide range of decay widths.

categories: nucl-th cond-mat.stat-mech physics.chem-ph quant-ph


title: Comparison of multi-mode Hong-Ou-Mandel interference and multi-slit interference

abstract: Hong-Ou-Mandel (HOM) interference of multi-mode frequency entangled states plays a crucial role in quantum metrology. However, as the number of modes increases, the HOM interference pattern becomes increasingly complex, making it challenging to comprehend intuitively. To overcome this problem, we present the theory and simulation of multi-mode-HOM interference (MM-HOMI) and compare it to multi-slit interference (MSI). We find that these two interferences have a strong mapping relationship and are determined by two factors: the envelope factor and the details factor. The envelope factor is contributed by the single-mode HOM interference (single-slit diffraction) for MM-HOMI (MSI). The details factor is given by $\sin(Nx)/ \sin(x)$ ($[\sin(Nv)/\sin(v)]^2$) for MM-HOMI (MSI), where $N$ is the mode (slit) number and $x (v)$ is the phase spacing of two adjacent spectral modes (slits). As a potential application, we demonstrate that the square root of the maximal Fisher information in MM-HOMI increases linearly with the number of modes, indicating that MM-HOMI is a powerful tool for enhancing precision in time estimation. We also discuss multi-mode Mach-Zehnder interference, multi-mode NOON-state interference, and the extended Wiener-Khinchin theorem. This work may provide an intuitive understanding of MM-HOMI patterns and promote the application of MM-HOMI in quantum metrology.


title: On the canonical equivalence between Jordan and Einstein frames

abstract: A longstanding issue is the classical equivalence between the Jordan and the Einstein frames, which is considered just a field redefinition of the metric tensor and the scalar field. In this work, based on the previous result that the Hamiltonian transformations from the Jordan to the Einstein frame are not canonical on the extended phase space, we study the possibility of the existence of canonical transformations. We show that on the reduced phase space -- defined by suitable gauge fixing of the lapse and shifts functions -- these transformations are Hamiltonian canonical. Poisson brackets are replaced by Dirac's brackets following the Bergman-Dirac's procedure. The Hamiltonian canonical transformations map solutions of the equations of motion in the Jordan frame into solutions of the equations of motion in the Einstein frame.


title: Daniel Bernoulli's Research in Basel and the "Physikalisches Kabinett" in the "Stachelsch\"utzenhaus"

abstract: On 22 September 2023 the inauguration of the "Stachelsch\"utzenhaus" at Basel's Petersplatz (St. Peter's Square) as an EPS Historic Site was hosted by the University of Basel. In the following article we will focus first on Daniel Bernoulli's career path, before discussing his major scientific achievements and finally adding some aspects of the inauguration ceremony (the colloquium talks, the visit of today's laboratories in the Stachelsch\"utzenhaus, and the unveiling of the plaque).


title: Poissonian pair correlation for higher dimensional real sequences

abstract: In this article, we examine the Poissonian pair correlation (PPC) statistic for higher-dimensional real sequences. Specifically, we demonstrate that for $d\geq 3$, for almost all $(\alpha_1,\ldots,\alpha_d) \in \mathbb{R}^d$, the sequence $\big(\{x_n\alpha_1\},\dots,\{x_n\alpha_d\}\big)$ in $[0,1)^d$ has PPC conditionally on the additive energy bound of $(x_n).$ This bound is more relaxed compared to the additive energy bound for one dimension as discussed in [1]. We also establish the metric PPC for $(n^{\theta_1},\ldots,n^{\theta_d})$ provided that the $\theta_i$'s are greater than one. More generally, we derive the PPC for $\big(\{x_n^{(1)}\alpha_1\},\dots,\{x_n^{(d)}\alpha_d\}\big) \in [0,1)^d$ for almost all $(\alpha_1,\ldots,\alpha_d) \in \mathbb{R}^d.$


title: The Treewidth Boundedness Problem for an Inductive Separation Logic of Relations

abstract: The treewidth boundedness problem for a logic asks for the existence of an upper bound on the treewidth of the models of a given formula in that logic. This problem is found to be undecidable for first order logic. We consider a generalization of Separation Logic over relational signatures, interpreted over standard relational structures, and describe an algorithm for the treewidth boundedness problem in the context of this logic.


title: Benchmarking the Sim-to-Real Gap in Cloth Manipulation

abstract: Realistic physics engines play a crucial role for learning to manipulate deformable objects such as garments in simulation. By doing so, researchers can circumvent challenges such as sensing the deformation of the object in the realworld. In spite of the extensive use of simulations for this task, few works have evaluated the reality gap between deformable object simulators and real-world data. We present a benchmark dataset to evaluate the sim-to-real gap in cloth manipulation. The dataset is collected by performing a dynamic as well as a quasi-static cloth manipulation task involving contact with a rigid table. We use the dataset to evaluate the reality gap, computational time, and simulation stability of four popular deformable object simulators: MuJoCo, Bullet, Flex, and SOFA. Additionally, we discuss the benefits and drawbacks of each simulator. The benchmark dataset is open-source. Supplementary material, videos, and code, can be found at https://sites.google.com/view/cloth-sim2real-benchmark.


title: Credibility in Credence Goods Markets

abstract: An expert seller chooses an experiment to influence a client's purchasing decision, but may manipulate the experiment result for personal gain. When credibility surpasses a critical threshold, the expert chooses a fully-revealing experiment and, if possible, manipulates the unfavorable result. In this case, a higher credibility strictly benefits the expert, whereas the client never benefits from the expert's services. We also discuss policies regarding monitoring expert's disclosure and price regulation. When prices are imposed exogenously, monitoring disclosure does not affect the client's highest equilibrium value. A lower price may harm the client when it discourages the expert from disclosing information.


title: A Semiparametric Instrumented Difference-in-Differences Approach to Policy Learning

abstract: Recently, there has been a surge in methodological development for the difference-in-differences (DiD) approach to evaluate causal effects. Standard methods in the literature rely on the parallel trends assumption to identify the average treatment effect on the treated. However, the parallel trends assumption may be violated in the presence of unmeasured confounding, and the average treatment effect on the treated may not be useful in learning a treatment assignment policy for the entire population. In this article, we propose a general instrumented DiD approach for learning the optimal treatment policy. Specifically, we establish identification results using a binary instrumental variable (IV) when the parallel trends assumption fails to hold. Additionally, we construct a Wald estimator, novel inverse probability weighting (IPW) estimators, and a class of semiparametric efficient and multiply robust estimators, with theoretical guarantees on consistency and asymptotic normality, even when relying on flexible machine learning algorithms for nuisance parameters estimation. Furthermore, we extend the instrumented DiD to the panel data setting. We evaluate our methods in extensive simulations and a real data application.


title: The extraction of higher-order radial moments of nuclear charge density from muonic atom spectroscopy

abstract: Muonic atom transitions have been measured for almost all stable nuclei to extract nuclear structure properties, including nuclear charge radii and quadrupole moment. To investigate the possibilities of extracting higher-order radial moments of nuclear charge density %what kind of information of nuclear charge distribution can be extracted precisely from muonic atom spectroscopy, a theory-to-theory benchmark analysis based on a model-independent density distribution, i.e., the Fourier-Bessel series expansion instead of two-parameter Fermi distribution, is performed by taking $^{208}$Pb as an example, where nuclear charge density obtained from the relativistic continuum Hartree-Bogoliubov calculation is used as the benchmark. It is found that the extractions of the higher-order moments, i.e., the fourth and sixth moments in addition to the second moment are feasible with high accuracy. Moreover, the charge form factor in the low-$q$ region can also be well extracted.


title: A Distributed Buffering Drift-Plus-Penalty Algorithm for Coupling Constrained Optimization

abstract: This paper focuses on distributed constrained optimization over time-varying directed networks, where all agents cooperate to optimize the sum of their locally accessible objective functions subject to a coupled inequality constraint consisting of all their local constraint functions. To address this problem, we develop a buffering drift-plus-penalty algorithm, referred to as B-DPP. The proposed B-DPP algorithm utilizes the idea of drift-plus-penalty minimization in centralized optimization to control constraint violation and objective error, and adapts it to the distributed setting. It also innovatively incorporates a buffer variable into local virtual queue updates to acquire flexible and desirable tracking of constraint violation. We show that B-DPP achieves $O(1/\sqrt{t})$ rates of convergence to both optimality and feasibility, which outperform the alternative methods in the literature. Moreover, with a proper buffer parameter, B-DPP is capable of reaching feasibility within a finite number of iterations, which is a pioneering result in the area. Simulations on a resource allocation problem over 5G virtualized networks demonstrate the competitive convergence performance and efficiency of B-DPP.


title: General birationality and Hyperelliptic Theta divisors

abstract: We first state a condition ensuring that having a birational map onto the image is an open property for families of irreducible normal non uniruled varieties. We give then some criteria to ensure general birationality for a family of rational maps, via specializations. Among the applications is a new proof of a result obtained jointly with Luca Cesarano: that, for a general pair $(A,X)$ of an (ample) Hypersurface $X$ in an Abelian Variety $A$, the canonical map $\Phi_X$ of $X$ is birational onto its image if the polarization given by $X$ is not principal. The proof is also based on a careful study of the Theta divisors of the Jacobians of Hyperelliptic curves, and some related geometrical constructions. We investigate these here also in view of their beauty and of their independent interest, as they lead to a description of the rings of Hyperelliptic theta functions.


title: Scene Text Recognition Models Explainability Using Local Features

abstract: Explainable AI (XAI) is the study on how humans can be able to understand the cause of a model's prediction. In this work, the problem of interest is Scene Text Recognition (STR) Explainability, using XAI to understand the cause of an STR model's prediction. Recent XAI literatures on STR only provide a simple analysis and do not fully explore other XAI methods. In this study, we specifically work on data explainability frameworks, called attribution-based methods, that explain the important parts of an input data in deep learning models. However, integrating them into STR produces inconsistent and ineffective explanations, because they only explain the model in the global context. To solve this problem, we propose a new method, STRExp, to take into consideration the local explanations, i.e. the individual character prediction explanations. This is then benchmarked across different attribution-based methods on different STR datasets and evaluated across different STR models.


title: Can Large Language Model Comprehend Ancient Chinese? A Preliminary Test on ACLUE

abstract: Large language models (LLMs) have showcased remarkable capabilities in understanding and generating language. However, their ability in comprehending ancient languages, particularly ancient Chinese, remains largely unexplored. To bridge this gap, we present ACLUE, an evaluation benchmark designed to assess the capability of language models in comprehending ancient Chinese. ACLUE consists of 15 tasks cover a range of skills, spanning phonetic, lexical, syntactic, semantic, inference and knowledge. Through the evaluation of eight state-of-the-art LLMs, we observed a noticeable disparity in their performance between modern Chinese and ancient Chinese. Among the assessed models, ChatGLM2 demonstrates the most remarkable performance, achieving an average score of 37.4%. We have made our code and data public available.


title: Visualizing convolutional neural network for classifying gravitational waves from core-collapse supernovae

abstract: In this study, we employ a convolutional neural network to classify gravitational waves originating from core-collapse supernovae. Training is conducted using spectrograms derived from three-dimensional numerical simulations of waveforms, which are injected onto real noise data from the third observing run of both Advanced LIGO and Advanced Virgo. To gain insights into the decision-making process of the model, we apply class activation mapping techniques to visualize the regions in the input image that are significant for the model's prediction. The class activation maps reveal that the model's predictions predominantly rely on specific features within the input spectrograms, namely, the $g$-mode and low-frequency modes. The visualization of convolutional neural network models provides interpretability to enhance their reliability and offers guidance for improving detection efficiency.


title: Exploratory Data Science on Supercomputers for Quantum Mechanical Calculations

abstract: Literate programming - the bringing together of program code and natural language narratives - has become a ubiquitous approach in the realm of data science. This methodology is appealing as well for the domain of Density Functional Theory (DFT) calculations, particularly for interactively developing new methodologies and workflows. However, effective use of literate programming is hampered by old programming paradigms and the difficulties associated with using High Performance Computing (HPC) resources. Here we present two Python libraries that aim to remove these hurdles. First, we describe the PyBigDFT library, which can be used to setup materials or molecular systems and provides high-level access to the wavelet based BigDFT code. We then present the related remotemanager library, which is able to serialize and execute arbitrary Python functions on remote supercomputers. We show how together these libraries enable transparent access to HPC based DFT calculations and can serve as building blocks for rapid prototyping and data exploration.


title: ARTree: A Deep Autoregressive Model for Phylogenetic Inference

abstract: Designing flexible probabilistic models over tree topologies is important for developing efficient phylogenetic inference methods. To do that, previous works often leverage the similarity of tree topologies via hand-engineered heuristic features which would require pre-sampled tree topologies and may suffer from limited approximation capability. In this paper, we propose a deep autoregressive model for phylogenetic inference based on graph neural networks (GNNs), called ARTree. By decomposing a tree topology into a sequence of leaf node addition operations and modeling the involved conditional distributions based on learnable topological features via GNNs, ARTree can provide a rich family of distributions over the entire tree topology space that have simple sampling algorithms and density estimation procedures, without using heuristic features. We demonstrate the effectiveness and efficiency of our method on a benchmark of challenging real data tree topology density estimation and variational Bayesian phylogenetic inference problems.


title: Neural network scoring for efficient computing

abstract: Much work has been dedicated to estimating and optimizing workloads in high-performance computing (HPC) and deep learning. However, researchers have typically relied on few metrics to assess the efficiency of those techniques. Most notably, the accuracy, the loss of the prediction, and the computational time with regard to GPUs or/and CPUs characteristics. It is rare to see figures for power consumption, partly due to the difficulty of obtaining accurate power readings. In this paper, we introduce a composite score that aims to characterize the trade-off between accuracy and power consumption measured during the inference of neural networks. For this purpose, we present a new open-source tool allowing researchers to consider more metrics: granular power consumption, but also RAM/CPU/GPU utilization, as well as storage, and network input/output (I/O). To our best knowledge, it is the first fit test for neural architectures on hardware architectures. This is made possible thanks to reproducible power efficiency measurements. We applied this procedure to state-of-the-art neural network architectures on miscellaneous hardware. One of the main applications and novelties is the measurement of algorithmic power efficiency. The objective is to allow researchers to grasp their algorithms' efficiencies better. This methodology was developed to explore trade-offs between energy usage and accuracy in neural networks. It is also useful when fitting hardware for a specific task or to compare two architectures more accurately, with architecture exploration in mind.


title: Indirect reciprocity with assessments of group reputation

abstract: Indirect reciprocity unveils how social cooperation is founded upon moral systems. Under the frame of dyadic games based on individual reputations, the "leading-eight" social norms distinguish themselves in promoting and sustaining cooperation. However, in real societies, people constantly interact within larger groups. They are assessed not only by their own behaviors, but also the reputations of the groups they come from and interact with. Here, we study indirect reciprocity in public goods games with group reputations. We show that varying criteria of group reputation assessment destabilize the consensus within leading-eight populations. We find the presence of an optimal, moderately set social assessment criterion that is most conductive to promoting cooperation. As the payoff of group cooperation increases, the assessment criterion evolves to relaxation following two dynamical patterns, indicating that social prosperity encourages people to be tolerate. Our work identifies the role of group reputation assessment to boost cooperation in social populations.


title: Triaxiality dynamics of quadrupole excitation in even-even heavy nuclei

abstract: In the framework free triaxiality model branching ratio reduced E2-transitions probabilities are studied for the full region changes of the triaxiality parameter. The variables of quadrupole deformations $\beta_2$ and $\gamma$ are dynamic. The Davidson potential for $\beta_2$ and $\gamma$ variables was being used. In the free triaxiality model the energy levels was being obtained by taking into account the high-order terms of the rotational energy operator series, which leads energy levels of ground-state-band, $\beta$- and $\gamma$-bands to improve considerably the agreement of the results with experimental data. The quadrupole moment of the nucleus expressed in terms of two internal quadrupole moments: $Q_0$ is quadrupole moment about the symmetry axis, $Q_2$ is the measure of the shape asymmetry about the symmetry axis. The intra/inter-band reduced E2-transition probabilities ground-state-band, $\beta$- and $\gamma$-bands are being presented and are being expressed in terms of four parameters: $\mu_{\beta_2}$, $\mu_\gamma$, $\gamma_0$ and $Q_0$. The influence of $\gamma$-oscillations to the reduced probabilities of E2-transitions takes into account are numerically. The sensitivity of the intra-/inter-band reduced E2-transition probabilities to the triaxiality parameter was analyzed.


title: Order-disorder phase transition and elastic-to-plastic vortex creep crossover in a triclinic iron pnictide superconductor (Ca0.85La0.15)10(Pt3As8)(Fe2As2)5

abstract: Vortex matter in layered high-$T_c$ superconductors, including iron-pnictides, undergo several thermodynamic phase transitions due to the complex interplay of pinning energy, thermal energy and elastic energy. Moreover, the presence of anisotropy makes their vortex physics even more intriguing. Here, we report a detailed vortex dynamics study, using dc magnetization measurements, in a triclinic iron-pnictide superconductor (Ca$_{0.85}$La$_{0.15}$)$_{10}$(Pt$_3$As$_8$)(Fe$_2$As$_2$)$_5$, with a superconducting transition temperature, T$_c$ $\sim$ 31 K. A second magnetization peak (SMP) feature is observed for magnetic field perpendicular ($H$$\parallel$$c$) and parallel ($H$$\parallel$$ab$) to the crystal plane. However, its fundamental origin is quite different in both directions. For $H$$\parallel$$c$, the SMP can be well explained using an elastic-to-plastic vortex creep crossover, using collective creep theory. In addition, a possible rhombic-to-square vortex lattice phase transition is also observed for fields in between the onset-field and peak-field related to the SMP. On the other hand, for $H$$\parallel$$ab$, a clear signature of an order-disorder vortex phase transition is observed in the isothermal $M$($H$) measurements at $T$ $\geq$ 6 K. The disordered phase exhibits the characteristics of entangled pinned vortex-liquid. We construct a comprehensive vortex phase diagram by displaying characteristic temperatures and magnetic fields for both crystal geometries in this unique superconducting compound. Our study sheds light on the intricate vortex dynamics and pinning in an iron-pnictide superconductor with triclinic symmetry.


title: Can the energy of a particle be negative in the absence of external fields?

abstract: We study the question of conditions for the existence of negative-energy states of particles in the absence of external fields in inertial and noninertial frames of reference. We show that in the nonrelativistic case in noninertial reference frames, there always exist domains where the energy of particles is negative. We also show that in the relativistic case, the existence of negative-energy states of point particles does not lead to violations of the energy dominance condition. We consider conditions for the appearance of negative and zero energies of particles in the Milne universe and Rindler space-time.


title: Confinement-induced drift in Marangoni-driven transport of surfactant: a Lagrangian perspective

abstract: Successive drops of coloured ink mixed with surfactant are deposited onto a thin film of water to create marbling patterns in the Japanese art technique of Suminagashi. To understand the physics behind this and other applications where surfactant transports adsorbed passive matter at gas-liquid interfaces, we investigate the Lagrangian trajectories of material particles on the surface of a thin film of a confined viscous liquid under Marangoni-driven spreading by an insoluble surfactant. We study a model problem in which several deposits of exogenous surfactant simultaneously spread on a bounded rectangular surface containing a pre-existing endogenous surfactant. We derive Eulerian and Lagrangian formulations of the equations governing the Marangoni-driven surface flow. Both descriptions show how confinement can induce drift and flow reversal during spreading. The Lagrangian formulation captures trajectories without the need to calculate surfactant concentrations; however, concentrations can still be inferred from the Jacobian of the map from initial to current particle position. We explore a link between thin-film surfactant dynamics and optimal transport theory to find the approximate equilibrium locations of material particles for any given initial condition by solving a Monge-Amp\`ere equation. We find that, as the endogenous surfactant concentration $\delta$ vanishes, the equilibrium shapes of deposits using the Monge-Amp\`ere approximation approach polygons with corners curving in a self-similar manner over lengths scaling as $\delta^{1/2}$. We explore how Suminagashi patterns may be produced by using computationally efficient successive solutions of the Monge-Amp\`ere equation.


title: You Only Train Once: A Unified Framework for Both Full-Reference and No-Reference Image Quality Assessment

abstract: Although recent efforts in image quality assessment (IQA) have achieved promising performance, there still exists a considerable gap compared to the human visual system (HVS). One significant disparity lies in humans' seamless transition between full reference (FR) and no reference (NR) tasks, whereas existing models are constrained to either FR or NR tasks. This disparity implies the necessity of designing two distinct systems, thereby greatly diminishing the model's versatility. Therefore, our focus lies in unifying FR and NR IQA under a single framework. Specifically, we first employ an encoder to extract multi-level features from input images. Then a Hierarchical Attention (HA) module is proposed as a universal adapter for both FR and NR inputs to model the spatial distortion at each encoder stage. Furthermore, considering that different distortions contaminate encoder stages and damage image semantic meaning differently, a Semantic Distortion Aware (SDA) module is proposed to examine feature correlations between shallow and deep layers of the encoder. By adopting HA and SDA, the proposed network can effectively perform both FR and NR IQA. When our proposed model is independently trained on NR or FR IQA tasks, it outperforms existing models and achieves state-of-the-art performance. Moreover, when trained jointly on NR and FR IQA tasks, it further enhances the performance of NR IQA while achieving on-par performance in the state-of-the-art FR IQA. You only train once to perform both IQA tasks. Code will be released at: https://github.com/BarCodeReader/YOTO.


title: Graph Neural Network approaches for single-cell data: A recent overview

abstract: Graph Neural Networks (GNN) are reshaping our understanding of biomedicine and diseases by revealing the deep connections among genes and cells. As both algorithmic and biomedical technologies have advanced significantly, we're entering a transformative phase of personalized medicine. While pioneering tools like Graph Attention Networks (GAT) and Graph Convolutional Neural Networks (Graph CNN) are advancing graph-based learning, the rise of single-cell sequencing techniques is reshaping our insights on cellular diversity and function. Numerous studies have combined GNNs with single-cell data, showing promising results. In this work, we highlight the GNN methodologies tailored for single-cell data over the recent years. We outline the diverse range of graph deep learning architectures that center on GAT methodologies. Furthermore, we underscore the several objectives of GNN strategies in single-cell data contexts, ranging from cell-type annotation, data integration and imputation, gene regulatory network reconstruction, clustering and many others. This review anticipates a future where GNNs become central to single-cell analysis efforts, particularly as vast omics datasets are continuously generated and the interconnectedness of cells and genes enhances our depth of knowledge in biomedicine.


title: Does CLIP's Generalization Performance Mainly Stem from High Train-Test Similarity?

abstract: Foundation models like CLIP are trained on hundreds of millions of samples and effortlessly generalize to new tasks and inputs. Out of the box, CLIP shows stellar zero-shot and few-shot capabilities on a wide range of out-of-distribution (OOD) benchmarks, which prior works attribute mainly to today's large and comprehensive training dataset (like LAION). However, it is questionable how meaningful terms like out-of-distribution generalization are for CLIP as it seems likely that web-scale datasets like LAION simply contain many samples that are similar to common OOD benchmarks originally designed for ImageNet. To test this hypothesis, we retrain CLIP on pruned LAION splits that replicate ImageNet's train-test similarity with respect to common OOD benchmarks. While we observe a performance drop on some benchmarks, surprisingly, CLIP's overall performance remains high. This shows that high train-test similarity is insufficient to explain CLIP's OOD performance, and other properties of the training data must drive CLIP to learn more generalizable representations. Additionally, by pruning data points that are dissimilar to the OOD benchmarks, we uncover a 100M split of LAION ($\frac{1}{4}$th of its original size) on which CLIP can be trained to match its original OOD performance.


title: Learning Unified Representations for Multi-Resolution Face Recognition

abstract: In this work, we propose Branch-to-Trunk network (BTNet), a representation learning method for multi-resolution face recognition. It consists of a trunk network (TNet), namely a unified encoder, and multiple branch networks (BNets), namely resolution adapters. As per the input, a resolution-specific BNet is used and the output are implanted as feature maps in the feature pyramid of TNet, at a layer with the same resolution. The discriminability of tiny faces is significantly improved, as the interpolation error introduced by rescaling, especially up-sampling, is mitigated on the inputs. With branch distillation and backward-compatible training, BTNet transfers discriminative high-resolution information to multiple branches while guaranteeing representation compatibility. Our experiments demonstrate strong performance on face recognition benchmarks, both for multi-resolution identity matching and feature aggregation, with much less computation amount and parameter storage. We establish new state-of-the-art on the challenging QMUL-SurvFace 1: N face identification task. Our code is available at https://github.com/StevenSmith2000/BTNet.


title: SHARPEST: The atmospheric turbulence profiling experiment using Shack-Hartmann sensor at the Subaru telescope

abstract: Atmospheric turbulence profile plays an important role in designing and operating adaptive optics (AO) systems with multiple laser guide stars. To obtain representative free atmospheric profiles and resolved ground layer profiles for future AO systems at the Subaru telescope, we are conducting the SHARPEST (Shack-Hartmann Atmospheric tuRbulence Profiling Experiment at the Subaru Telescope) project. In this project, we develop a turbulence profiler comprising two Shack-Hartmann (SH) sensors to observe a pair of bright stars through the Subaru telescope with high spatial sampling by 2 cm subapertures. We perform two analyses on the SH spot data: variance analysis on the spot scintillation for free atmospheric profiles, and on the spot slope for ground layer profiles. This paper introduces the initial results of free atmospheric profiles as well as total seeing values and wind profiles obtained by the first two engineering runs. The free atmospheric profiles reconstructed by the two independent SH sensors show good agreement. The results are also consistent with simultaneous measurements by another profiler except for turbulence strength at ~1 km, which is explained by an overestimation problem of scintillation-based profilers. Measured total seeing values are also smaller than the simultaneous measurements, possibly due to the difference in ground layer turbulence between the two sites. The wind profiles show good consistency with the direct measurements by a rawinsonde. Through this study, we establish a method to constrain the free atmospheric profile, the total seeing, and the wind profile by analysing data from a single SH sensor with fine subapertures.


title: Chern numbers for the two-body Hofstadter-Hubbard butterfly

abstract: We analyze the two-body spectrum within the Hofstadter-Hubbard model on a square lattice through an exact variational ansatz and study the topological properties of its low-lying two-body bound-state branches. In particular we discuss how the Hofstadter-Hubbard butterfly of the two-body branches evolves as a function of onsite interactions and how to efficiently calculate their Chern numbers using the Fukui-Hatsugai-Suzuki approach. Our numerical results are fully consistent with the simple picture that appears in the strong-coupling limit, where the attraction between fermions forms a composite boson characterized by an effective hopping parameter and an effective magnetic-flux ratio.


title: Entropy stable discontinuous Galerkin schemes for two-fluid relativistic plasma flow equations

abstract: This article proposes entropy stable discontinuous Galerkin schemes (DG) for two-fluid relativistic plasma flow equations. These equations couple the flow of relativistic fluids via electromagnetic quantities evolved using Maxwell's equations. The proposed schemes are based on the Gauss-Lobatto quadrature rule, which has the summation by parts (SBP) property. We exploit the structure of the equations having the flux with three independent parts coupled via nonlinear source terms. We design entropy stable DG schemes for each flux part, coupled with the fact that the source terms do not affect entropy, resulting in an entropy stable scheme for the complete system. The proposed schemes are then tested on various test problems in one and two dimensions to demonstrate their accuracy and stability.


title: Automatic and Computationally Efficient Alignment in Fan- and Cone-beam Tomography

abstract: This work is concerned with fan- and cone-beam computed tomography with circular source trajectory, where the reconstruction inverse problem requires an accurate knowledge of source, detector and rotational axis relative positions and orientations. We address this additional inverse problem as a preceding step of the reconstruction process directly from the acquired projections. In the cone-beam case, we present a method that estimates both the detector shift (orthogonal to both focal and rotational axes) and the in-plane detector rotation (over the focal axis) based on the variable projection optimization approach. In addition and for the fan-beam case, two new strategies with low computational cost are presented to estimate the detector shift based on a fan-beam symmetry condition. The methods are validated with simulated and experimental industrial tomographic data with code examples available for both fan- and cone-beam geometries.


title: Wafer-scale Computing: Advancements, Challenges, and Future Perspectives

abstract: Nowadays, artificial intelligence (AI) technology with large models plays an increasingly important role in both academia and industry. It also brings a rapidly increasing demand for the computing power of the hardware. As the computing demand for AI continues to grow, the growth of hardware computing power has failed to keep up. This has become a significant factor restricting the development of AI. The augmentation of hardware computing power is mainly propelled by the escalation of transistor density and chip area. However, the former is impeded by the termination of the Moore's Law and Dennard scaling, and the latter is significantly restricted by the challenge of disrupting the legacy fabrication equipment and process. In recent years, advanced packaging technologies that have gradually matured are increasingly used to implement bigger chips that integrate multiple chiplets, while still providing interconnections with chip-level density and bandwidth. Compared to conventional high-performance computing paradigms such as multi-accelerator and datacenter-scale computing, Wafer-scale Computing shows remarkable advantages in communication bandwidth, integration density, and programmability potential. Not surprisingly, disruptive Wafer-scale Computing also brings unprecedented design challenges for hardware architecture, design-system-technology co-optimization, power and cooling systems, and compiler tool chain. At present, there are no comprehensive surveys summarizing the current state and design insights of Wafer-scale Computing. This paper aims to take the first step to help academia and industry review existing wafer-scale chips and essential technologies in a one-stop manner. So that people can conveniently grasp the basic knowledge and key points, understand the achievements and shortcomings of existing research, and contribute to this promising research direction.


title: Petal diagram from simple braids

abstract: We construct petal diagrams from simple braids. This approach allows us to confirm a conjecture proposed by Kim, No and Yoo, which states that the petal number of the nontrivial torus knot $T_{r,s}$ ($r<s$) is at most $2s-2\lfloor\frac{s}{r}\rfloor+1$. As a consequence, we deduce that the petal number of a nontrivial torus knot $T_{r,s}$ is equal to $2s-1$ if and only if $r<s<2r$.


title: Energy-Efficient Multi-Codec Bitrate-Ladder Estimation for Adaptive Video Streaming

abstract: With the emergence of multiple modern video codecs, streaming service providers are forced to encode, store, and transmit bitrate ladders of multiple codecs separately, consequently suffering from additional energy costs for encoding, storage, and transmission. To tackle this issue, we introduce an online energy-efficient Multi-Codec Bitrate ladder Estimation scheme (MCBE) for adaptive video streaming applications. In MCBE, quality representations within the bitrate ladder of new-generation codecs (e.g., High Efficiency Video Coding (HEVC), Alliance for Open Media Video 1 (AV1)) that lie below the predicted rate-distortion curve of the Advanced Video Coding (AVC) codec are removed. Moreover, perceptual redundancy between representations of the bitrate ladders of the considered codecs is also minimized based on a Just Noticeable Difference (JND) threshold. Therefore, random forest-based models predict the VMAF score of bitrate ladder representations of each codec. In a live streaming session where all clients support the decoding of AVC, HEVC, and AV1, MCBE achieves impressive results, reducing cumulative encoding energy by 56.45%, storage energy usage by 94.99%, and transmission energy usage by 77.61% (considering a JND of six VMAF points). These energy reductions are in comparison to a baseline bitrate ladder encoding based on current industry practice.


title: On the Feasibility of Cross-Language Detection of Malicious Packages in npm and PyPI

abstract: Current software supply chains heavily rely on open-source packages hosted in public repositories. Given the popularity of ecosystems like npm and PyPI, malicious users started to spread malware by publishing open-source packages containing malicious code. Recent works apply machine learning techniques to detect malicious packages in the npm ecosystem. However, the scarcity of samples poses a challenge to the application of machine learning techniques in other ecosystems. Despite the differences between JavaScript and Python, the open-source software supply chain attacks targeting such languages show noticeable similarities (e.g., use of installation scripts, obfuscated strings, URLs). In this paper, we present a novel approach that involves a set of language-independent features and the training of models capable of detecting malicious packages in npm and PyPI by capturing their commonalities. This methodology allows us to train models on a diverse dataset encompassing multiple languages, thereby overcoming the challenge of limited sample availability. We evaluate the models both in a controlled experiment (where labels of data are known) and in the wild by scanning newly uploaded packages for both npm and PyPI for 10 days. We find that our approach successfully detects malicious packages for both npm and PyPI. Over an analysis of 31,292 packages, we reported 58 previously unknown malicious packages (38 for npm and 20 for PyPI), which were consequently removed from the respective repositories.


title: Wind erosion and transport on planetesimals

abstract: We consider the possibility that aeolian (wind blown) processes occur on small, 1 to 100~km diameter, planetesimals when they were embedded in the protosolar nebula. Drag from a headwind within a protostellar disk is sufficiently large to loft cm and smaller sized particles off the surface of a 10 km diameter asteroid in the inner solar system (at a few AU), and micron sized particles off the surface of a 10 km diameter object in the Transneptunian region. The headwind is sufficiently strong to overcome surface cohesion in the inner solar system, but not in the outer solar system. However, in the outer solar system, surface particles can be redistributed or escape due to impacts from particles that are in the protosolar disk's wind. Based on scaling crater ejecta, we estimate that impacts from particles in the headwind will lead to erosion of mass rather than accretion for planetesimals below about 6 km in diameter. The erosion limit is independent of material strength but proportional to the wind velocity. We explore the sensitivity of splash particle trajectories to particle size, headwind velocity and Reynolds number. Winds from a protostellar disk could account for Kuiper Belt Object (486958) Arrokoth's smooth undulating terrain but only during an epoch of high particle flux and low wind velocity. These conditions could have been present during and just after coalescence of Arrokoth's building blocks.


title: Self-Detoxifying Language Models via Toxification Reversal

abstract: Language model detoxification aims to minimize the risk of generating offensive or harmful content in pretrained language models (PLMs) for safer deployment. Existing methods can be roughly categorized as finetuning-based and decoding-based. However, the former is often resource-intensive, while the latter relies on additional components and potentially compromises the generation fluency. In this paper, we propose a more lightweight approach that enables the PLM itself to achieve "self-detoxification". Our method is built upon the observation that prepending a negative steering prompt can effectively induce PLMs to generate toxic content. At the same time, we are inspired by the recent research in the interpretability field, which formulates the evolving contextualized representations within the PLM as an information stream facilitated by the attention layers. Drawing on this idea, we devise a method to identify the toxification direction from the normal generation process to the one prompted with the negative prefix, and then steer the generation to the reversed direction by manipulating the information movement within the attention layers. Experimental results show that our approach, without any fine-tuning or extra components, can achieve comparable performance with state-of-the-art methods.


title: Reduced Policy Optimization for Continuous Control with Hard Constraints

abstract: Recent advances in constrained reinforcement learning (RL) have endowed reinforcement learning with certain safety guarantees. However, deploying existing constrained RL algorithms in continuous control tasks with general hard constraints remains challenging, particularly in those situations with non-convex hard constraints. Inspired by the generalized reduced gradient (GRG) algorithm, a classical constrained optimization technique, we propose a reduced policy optimization (RPO) algorithm that combines RL with GRG to address general hard constraints. RPO partitions actions into basic actions and nonbasic actions following the GRG method and outputs the basic actions via a policy network. Subsequently, RPO calculates the nonbasic actions by solving equations based on equality constraints using the obtained basic actions. The policy network is then updated by implicitly differentiating nonbasic actions with respect to basic actions. Additionally, we introduce an action projection procedure based on the reduced gradient and apply a modified Lagrangian relaxation technique to ensure inequality constraints are satisfied. To the best of our knowledge, RPO is the first attempt that introduces GRG to RL as a way of efficiently handling both equality and inequality hard constraints. It is worth noting that there is currently a lack of RL environments with complex hard constraints, which motivates us to develop three new benchmarks: two robotics manipulation tasks and a smart grid operation control task. With these benchmarks, RPO achieves better performance than previous constrained RL algorithms in terms of both cumulative reward and constraint violation. We believe RPO, along with the new benchmarks, will open up new opportunities for applying RL to real-world problems with complex constraints.


title: Common Challenges of Deep Reinforcement Learning Applications Development: An Empirical Study

abstract: Machine Learning (ML) is increasingly being adopted in different industries. Deep Reinforcement Learning (DRL) is a subdomain of ML used to produce intelligent agents. Despite recent developments in DRL technology, the main challenges that developers face in the development of DRL applications are still unknown. To fill this gap, in this paper, we conduct a large-scale empirical study of 927 DRL-related posts extracted from Stack Overflow, the most popular Q&A platform in the software community. Through the process of labeling and categorizing extracted posts, we created a taxonomy of common challenges encountered in the development of DRL applications, along with their corresponding popularity levels. This taxonomy has been validated through a survey involving 65 DRL developers. Results show that at least 45% of developers experienced 18 of the 21 challenges identified in the taxonomy. The most frequent source of difficulty during the development of DRL applications are Comprehension, API usage, and Design problems, while Parallel processing, and DRL libraries/frameworks are classified as the most difficult challenges to address, with respect to the time required to receive an accepted answer. We hope that the research community will leverage this taxonomy to develop efficient strategies to address the identified challenges and improve the quality of DRL applications.