title: Beyond the Rotational Deathline: Radio Emission from Ultra-long Period Magnetars

abstract: Motivated by the recent detection of ultra-long period radio transients, we investigate new models of coherent radio emission via low-altitude electron-positron pair production in neutron stars beyond rotationally-powered curvature radiation deathlines. We find that plastic motion (akin to 'continental drift') and qualitatively similar thermoelectric action by temperature gradients in the crusts of slowly rotating, highly magnetized neutron stars could impart mild local magnetospheric twists. Regardless of which mechanism drives twists, we find that particle acceleration initiates pair cascades across charge-starved gaps above a mild critical twist. Cascades are initiated via resonant inverse-Compton scattered photons or curvature radiation, and may produce broadband coherent radio emission. We compute the pair luminosity (maximum allowed radio luminosity) for these two channels, and derive deathlines and 'active zones' in $P-\dot{P}$ space from a variety of considerations. We find these twist-initiated pair cascades only occur for magnetar-like field strengths $B \gtrsim 10^{14}$ G and long periods: $P_{\rm RICS} \gtrsim 120 \; (T/10^{6.5} {\rm K})^{-5} \, {\rm sec}$ and $P_{\rm curv} \gtrsim 150 \; ({\rm v_{\rm pl}}/10^{3} {\, \rm cm \, yr^{-1}})^{-7/6} \, {\rm sec}$. Using a simplified geometric model, we find that plastic motion or thermoelectrically driven twists might naturally reproduce the observed luminosities, timescales, and timing signatures. We further derive 'active zones' in which rotationally-powered pair creation occurs via resonantly scattered photons, beyond standard curvature deathlines for pulsars. All cascades are generically accompanied by simultaneous (non-)thermal X-ray/UV counterparts which might be detectable with current instrumentation.


title: Legal Judgment Reimagined: PredEx and the Rise of Intelligent AI Interpretation in Indian Courts

abstract: In the era of Large Language Models (LLMs), predicting judicial outcomes poses significant challenges due to the complexity of legal proceedings and the scarcity of expert-annotated datasets. Addressing this, we introduce \textbf{Pred}iction with \textbf{Ex}planation (\texttt{PredEx}), the largest expert-annotated dataset for legal judgment prediction and explanation in the Indian context, featuring over 15,000 annotations. This groundbreaking corpus significantly enhances the training and evaluation of AI models in legal analysis, with innovations including the application of instruction tuning to LLMs. This method has markedly improved the predictive accuracy and explanatory depth of these models for legal judgments. We employed various transformer-based models, tailored for both general and Indian legal contexts. Through rigorous lexical, semantic, and expert assessments, our models effectively leverage \texttt{PredEx} to provide precise predictions and meaningful explanations, establishing it as a valuable benchmark for both the legal profession and the NLP community.


title: Optimal Batched Linear Bandits

abstract: We introduce the E$^4$ algorithm for the batched linear bandit problem, incorporating an Explore-Estimate-Eliminate-Exploit framework. With a proper choice of exploration rate, we prove E$^4$ achieves the finite-time minimax optimal regret with only $O(\log\log T)$ batches, and the asymptotically optimal regret with only $3$ batches as $T\rightarrow\infty$, where $T$ is the time horizon. We further prove a lower bound on the batch complexity of linear contextual bandits showing that any asymptotically optimal algorithm must require at least $3$ batches in expectation as $T\rightarrow\infty$, which indicates E$^4$ achieves the asymptotic optimality in regret and batch complexity simultaneously. To the best of our knowledge, E$^4$ is the first algorithm for linear bandits that simultaneously achieves the minimax and asymptotic optimality in regret with the corresponding optimal batch complexities. In addition, we show that with another choice of exploration rate E$^4$ achieves an instance-dependent regret bound requiring at most $O(\log T)$ batches, and maintains the minimax optimality and asymptotic optimality. We conduct thorough experiments to evaluate our algorithm on randomly generated instances and the challenging \textit{End of Optimism} instances \citep{lattimore2017end} which were shown to be hard to learn for optimism based algorithms. Empirical results show that E$^4$ consistently outperforms baseline algorithms with respect to regret minimization, batch complexity, and computational efficiency.


title: The 3D-PC: a benchmark for visual perspective taking in humans and machines

abstract: Visual perspective taking (VPT) is the ability to perceive and reason about the perspectives of others. It is an essential feature of human intelligence, which develops over the first decade of life and requires an ability to process the 3D structure of visual scenes. A growing number of reports have indicated that deep neural networks (DNNs) become capable of analyzing 3D scenes after training on large image datasets. We investigated if this emergent ability for 3D analysis in DNNs is sufficient for VPT with the 3D perception challenge (3D-PC): a novel benchmark for 3D perception in humans and DNNs. The 3D-PC is comprised of three 3D-analysis tasks posed within natural scene images: 1. a simple test of object depth order, 2. a basic VPT task (VPT-basic), and 3. another version of VPT (VPT-Strategy) designed to limit the effectiveness of "shortcut" visual strategies. We tested human participants (N=33) and linearly probed or text-prompted over 300 DNNs on the challenge and found that nearly all of the DNNs approached or exceeded human accuracy in analyzing object depth order. Surprisingly, DNN accuracy on this task correlated with their object recognition performance. In contrast, there was an extraordinary gap between DNNs and humans on VPT-basic. Humans were nearly perfect, whereas most DNNs were near chance. Fine-tuning DNNs on VPT-basic brought them close to human performance, but they, unlike humans, dropped back to chance when tested on VPT-perturb. Our challenge demonstrates that the training routines and architectures of today's DNNs are well-suited for learning basic 3D properties of scenes and objects but are ill-suited for reasoning about these properties like humans do. We release our 3D-PC datasets and code to help bridge this gap in 3D perception between humans and machines.


title: On semiample vector bundles and parallelizable compact complex manifolds

abstract: We provide a characterization of parallelizable compact complex manifolds and their quotients using holomorphic symmetric differentials. In particular we show that compact complex manifolds of Kodaira dimension 0 having strongly semiample cotangent bundle are parallelizable manifolds, while compact complex manifolds of Kodaira dimension 0 having weakly semiample cotangent bundle are quotients of parallelizable manifolds. The main constructions used involve considerations about semiampleness of vector bundles, which are themselves of interest. As a byproduct we prove that compact manifolds having Kodaira dimension 0 and weakly sermiample cotangent bundle have infinite fundamental group, and we conjecture that this should be the case for all compact complex manifolds not of general type with weakly semiample cotangent bundle.


title: STraDa: A Singer Traits Dataset

abstract: There is a limited amount of large-scale public datasets that contain downloadable music audio files and rich lead singer metadata. To provide such a dataset to benefit research in singing voices, we created Singer Traits Dataset (STraDa) with two subsets: automatic-strada and annotated-strada. The automatic-strada contains twenty-five thousand tracks across numerous genres and languages of more than five thousand unique lead singers, which includes cross-validated lead singer metadata as well as other track metadata. The annotated-strada consists of two hundred tracks that are balanced in terms of 2 genders, 5 languages, and 4 age groups. To show its use for model training and bias analysis thanks to its metadata's richness and downloadable audio files, we benchmarked singer sex classification (SSC) and conducted bias analysis.


title: Coding Over Coupon Collector Channels for Combinatorial Motif-Based DNA Storage

abstract: Encoding information in combinations of pre-synthesised deoxyribonucleic acid (DNA) strands (referred to as motifs) is an interesting approach to DNA storage that could potentially circumvent the prohibitive costs of nucleotide-by-nucleotide DNA synthesis. Based on our analysis of an empirical data set from HelixWorks, we propose two channel models for this setup (with and without interference) and analyse their fundamental limits. We propose a coding scheme that approaches those limits by leveraging all information available at the output of the channel, in contrast to earlier schemes developed for a similar setup by Preuss et al. We highlight an important connection between channel capacity curves and the fundamental trade-off between synthesis (writing) and sequencing (reading), and offer a way to mitigate an exponential growth in decoding complexity with the size of the motif library.


title: Stochastic Polyak Step-sizes and Momentum: Convergence Guarantees and Practical Performance

abstract: Stochastic gradient descent with momentum, also known as Stochastic Heavy Ball method (SHB), is one of the most popular algorithms for solving large-scale stochastic optimization problems in various machine learning tasks. In practical scenarios, tuning the step-size and momentum parameters of the method is a prohibitively expensive and time-consuming process. In this work, inspired by the recent advantages of stochastic Polyak step-size in the performance of stochastic gradient descent (SGD), we propose and explore new Polyak-type variants suitable for the update rule of the SHB method. In particular, using the Iterate Moving Average (IMA) viewpoint of SHB, we propose and analyze three novel step-size selections: MomSPS$_{\max}$, MomDecSPS, and MomAdaSPS. For MomSPS$_{\max}$, we provide convergence guarantees for SHB to a neighborhood of the solution for convex and smooth problems (without assuming interpolation). If interpolation is also satisfied, then using MomSPS$_{\max}$, SHB converges to the true solution at a fast rate matching the deterministic HB. The other two variants, MomDecSPS and MomAdaSPS, are the first adaptive step-sizes for SHB that guarantee convergence to the exact minimizer without prior knowledge of the problem parameters and without assuming interpolation. The convergence analysis of SHB is tight and obtains the convergence guarantees of SGD with stochastic Polyak step-sizes as a special case. We supplement our analysis with experiments that validate the theory and demonstrate the effectiveness and robustness of the new algorithms.


title: Do Language Models Understand Morality? Towards a Robust Detection of Moral Content

abstract: The task of detecting moral values in text has significant implications in various fields, including natural language processing, social sciences, and ethical decision-making. Previously proposed supervised models often suffer from overfitting, leading to hyper-specialized moral classifiers that struggle to perform well on data from different domains. To address this issue, we introduce novel systems that leverage abstract concepts and common-sense knowledge acquired from Large Language Models and Natural Language Inference models during previous stages of training on multiple data sources. By doing so, we aim to develop versatile and robust methods for detecting moral values in real-world scenarios. Our approach uses the GPT 3.5 model as a zero-shot ready-made unsupervised multi-label classifier for moral values detection, eliminating the need for explicit training on labeled data. We compare it with a smaller NLI-based zero-shot model. The results show that the NLI approach achieves competitive results compared to the Davinci model. Furthermore, we conduct an in-depth investigation of the performance of supervised systems in the context of cross-domain multi-label moral value detection. This involves training supervised models on different domains to explore their effectiveness in handling data from different sources and comparing their performance with the unsupervised methods. Our contributions encompass a thorough analysis of both supervised and unsupervised methodologies for cross-domain value detection. We introduce the Davinci model as a state-of-the-art zero-shot unsupervised moral values classifier, pushing the boundaries of moral value detection without the need for explicit training on labeled data. Additionally, we perform a comparative evaluation of our approach with the supervised models, shedding light on their respective strengths and weaknesses.


title: Redundancy-aware Action Spaces for Robot Learning

abstract: Joint space and task space control are the two dominant action modes for controlling robot arms within the robot learning literature. Actions in joint space provide precise control over the robot's pose, but tend to suffer from inefficient training; actions in task space boast data-efficient training but sacrifice the ability to perform tasks in confined spaces due to limited control over the full joint configuration. This work analyses the criteria for designing action spaces for robot manipulation and introduces ER (End-effector Redundancy), a novel action space formulation that, by addressing the redundancies present in the manipulator, aims to combine the advantages of both joint and task spaces, offering fine-grained comprehensive control with overactuated robot arms whilst achieving highly efficient robot learning. We present two implementations of ER, ERAngle (ERA) and ERJoint (ERJ), and we show that ERJ in particular demonstrates superior performance across multiple settings, especially when precise control over the robot configuration is required. We validate our results both in simulated and real robotic environments.


title: Every Answer Matters: Evaluating Commonsense with Probabilistic Measures

abstract: Large language models have demonstrated impressive performance on commonsense tasks; however, these tasks are often posed as multiple-choice questions, allowing models to exploit systematic biases. Commonsense is also inherently probabilistic with multiple correct answers. The purpose of "boiling water" could be making tea and cooking, but it also could be killing germs. Existing tasks do not capture the probabilistic nature of common sense. To this end, we present commonsense frame completion (CFC), a new generative task that evaluates common sense via multiple open-ended generations. We also propose a method of probabilistic evaluation that strongly correlates with human judgments. Humans drastically outperform strong language model baselines on our dataset, indicating this approach is both a challenging and useful evaluation of machine common sense.


title: Towards Understanding Task-agnostic Debiasing Through the Lenses of Intrinsic Bias and Forgetfulness

abstract: While task-agnostic debiasing provides notable generalizability and reduced reliance on downstream data, its impact on language modeling ability and the risk of relearning social biases from downstream task-specific data remain as the two most significant challenges when debiasing Pretrained Language Models (PLMs). The impact on language modeling ability can be alleviated given a high-quality and long-contextualized debiasing corpus, but there remains a deficiency in understanding the specifics of relearning biases. We empirically ascertain that the effectiveness of task-agnostic debiasing hinges on the quantitative bias level of both the task-specific data used for downstream applications and the debiased model. We empirically show that the lower bound of the bias level of the downstream fine-tuned model can be approximated by the bias level of the debiased model, in most practical cases. To gain more in-depth understanding about how the parameters of PLMs change during fine-tuning due to the forgetting issue of PLMs, we propose a novel framework which can Propagate Socially-fair Debiasing to Downstream Fine-tuning, ProSocialTuning. Our proposed framework can push the fine-tuned model to approach the bias lower bound during downstream fine-tuning, indicating that the ineffectiveness of debiasing can be alleviated by overcoming the forgetting issue through regularizing successfully debiased attention heads based on the PLMs' bias levels from stages of pretraining and debiasing.


title: Direct optimization of neoclassical ion transport in stellarator reactors

abstract: We directly optimize stellarator neoclassical ion transport while holding neoclassical electron transport at a moderate level, creating a scenario favorable for impurity expulsion and retaining good ion confinement. Traditional neoclassical stellarator optimization has focused on minimizing $\epsilon_\mathrm{eff}$, the geometric factor that characterizes the amount of radial transport due to particles in the $1/\nu$ regime. Under expected reactor-relevant conditions, core electrons will be in the $1/\nu$ regime and core fuel ions will be in the $\sqrt{\nu}$ regime. Traditional optimizations thus minimize electron transport and rely on the radial electric field $\left(E_r\right)$ that develops to confine the ions. This often results in an inward-pointing $E_r$ that drives high-$Z$ impurities into the core, which may be troublesome in future reactors. In our optimizations, we increase the ratio of the thermal transport coefficients $L_{1 1}^{e}/L_{1 1}^{i}$, which previous work has shown can create an outward-pointing $E_r$. This effect is very beneficial for impurity expulsion. We obtain self-consistent density, temperature, and $E_r$ profiles at reactor-relevant conditions for optimized equilibria. These equilibria are expected to enjoy significantly improved impurity transport properties. We conclude by providing several directions of future research that may help further improve the presented optimization algorithm.


title: Fast Redescription Mining Using Locality-Sensitive Hashing

abstract: Redescription mining is a data analysis technique that has found applications in diverse fields. The most used redescription mining approaches involve two phases: finding matching pairs among data attributes and extending the pairs. This process is relatively efficient when the number of attributes remains limited and when the attributes are Boolean, but becomes almost intractable when the data consist of many numerical attributes. In this paper, we present new algorithms that perform the matching and extension orders of magnitude faster than the existing approaches. Our algorithms are based on locality-sensitive hashing with a tailored approach to handle the discretisation of numerical attributes as used in redescription mining.


title: Characterizing segregation in blast rock piles a deep-learning approach leveraging aerial image analysis

abstract: Blasted rock material serves a critical role in various engineering applications, yet the phenomenon of segregation-where particle sizes vary significantly along the gradient of a quarry pile-presents challenges for optimizing quarry material storage and handling. This study introduces an advanced image analysis methodology to characterize such segregation of rock fragments. The accurate delineation of detailed rock fragment size distributions was achieved through the analysis of drone-captured imagery, coupled with the application of an enhanced Unet semantic segmentation model integrated with an expansion-based post-processing technique. The quarry slope was stratified into four vertical sections, with the size distribution of each section quantified via ellipsoid shape approximations. Our results disclose pronounced vertical segregation patterns, with finer particles concentrated in the upper slope regions and coarser particles in the lower. Utilizing relative characteristic diameters, we offered insight into the degree of segregation, thereby illustrating the spatial heterogeneity in fragment size more clearly. The techniques outlined in this study deliver a scalable and accurate method for assessing fragment size distribution, with the potential to better inform resource management and operational decisions in quarry management.


title: A novel robust meta-analysis model using the $t$ distribution for outlier accommodation and detection

abstract: Random effects meta-analysis model is an important tool for integrating results from multiple independent studies. However, the standard model is based on the assumption of normal distributions for both random effects and within-study errors, making it susceptible to outlying studies. Although robust modeling using the $t$ distribution is an appealing idea, the existing work, that explores the use of the $t$ distribution only for random effects, involves complicated numerical integration and numerical optimization. In this paper, a novel robust meta-analysis model using the $t$ distribution is proposed ($t$Meta). The novelty is that the marginal distribution of the effect size in $t$Meta follows the $t$ distribution, enabling that $t$Meta can simultaneously accommodate and detect outlying studies in a simple and adaptive manner. A simple and fast EM-type algorithm is developed for maximum likelihood estimation. Due to the mathematical tractability of the $t$ distribution, $t$Meta frees from numerical integration and allows for efficient optimization. Experiments on real data demonstrate that $t$Meta is compared favorably with related competitors in situations involving mild outliers. Moreover, in the presence of gross outliers, while related competitors may fail, $t$Meta continues to perform consistently and robustly.


title: AgentGym: Evolving Large Language Model-based Agents across Diverse Environments

abstract: Building generalist agents that can handle diverse tasks and evolve themselves across different environments is a long-term goal in the AI community. Large language models (LLMs) are considered a promising foundation to build such agents due to their generalized capabilities. Current approaches either have LLM-based agents imitate expert-provided trajectories step-by-step, requiring human supervision, which is hard to scale and limits environmental exploration; or they let agents explore and learn in isolated environments, resulting in specialist agents with limited generalization. In this paper, we take the first step towards building generally-capable LLM-based agents with self-evolution ability. We identify a trinity of ingredients: 1) diverse environments for agent exploration and learning, 2) a trajectory set to equip agents with basic capabilities and prior knowledge, and 3) an effective and scalable evolution method. We propose AgentGym, a new framework featuring a variety of environments and tasks for broad, real-time, uni-format, and concurrent agent exploration. AgentGym also includes a database with expanded instructions, a benchmark suite, and high-quality trajectories across environments. Next, we propose a novel method, AgentEvol, to investigate the potential of agent self-evolution beyond previously seen data across tasks and environments. Experimental results show that the evolved agents can achieve results comparable to SOTA models. We release the AgentGym suite, including the platform, dataset, benchmark, checkpoints, and algorithm implementations. The AgentGym suite is available on https://github.com/WooooDyy/AgentGym.


title: Position: How Regulation Will Change Software Security Research

abstract: Software security has been an important research topic over the years. The community has proposed processes and tools for secure software development and security analysis. However, a significant number of vulnerabilities remains in real-world software-driven systems and products. To alleviate this problem, legislation is being established to oblige manufacturers, for example, to comply with essential security requirements and to establish appropriate development practices. We argue that software engineering research needs to provide better tools and support that helps industry comply with the new standards while retaining effcient processes. We argue for a stronger cooperation between legal scholars and computer scientists, and for bridging the gap between higher-level regulation and code-level engineering.


title: Learned Feature Importance Scores for Automated Feature Engineering

abstract: Feature engineering has demonstrated substantial utility for many machine learning workflows, such as in the small data regime or when distribution shifts are severe. Thus automating this capability can relieve much manual effort and improve model performance. Towards this, we propose AutoMAN, or Automated Mask-based Feature Engineering, an automated feature engineering framework that achieves high accuracy, low latency, and can be extended to heterogeneous and time-varying data. AutoMAN is based on effectively exploring the candidate transforms space, without explicitly manifesting transformed features. This is achieved by learning feature importance masks, which can be extended to support other modalities such as time series. AutoMAN learns feature transform importance end-to-end, incorporating a dataset's task target directly into feature engineering, resulting in state-of-the-art performance with significantly lower latency compared to alternatives.


title: Two Erd\H{o}s-Hajnal-type theorems for forbidden order-size pairs

abstract: The celebrated Erd\H{o}s-Hajnal conjecture says that any graph without a fixed induced subgraph $H$ contains a very large homogeneous set. A direct analog of this conjecture is not true for hypergraphs. In this paper we present two natural variants of this problem which do hold for hypergraphs. We show that for every $r \geq 3$, $m \geq m_0(r)$ and $0 \leq f \leq \binom{m}{r}$, if an $r$-graph $G$ does not contain $m$ vertices spanning exactly $f$ edges, then $G$ contains much bigger homogeneous sets than what is guaranteed to exist in general $r$-graphs. We also prove that if a $3$-graph $G$ does not contain homogeneous sets of polynomial size, then for every $m \geq 3$ there are $\Omega(m^3)$ values of $f$ such that $G$ contains $m$ vertices spanning exactly $f$ edges. This makes progress on a conjecture of Axenovich, Brada\v{c}, Gishboliner, Mubayi and Weber.


title: Improving Physics-Augmented Continuum Neural Radiance Field-Based Geometry-Agnostic System Identification with Lagrangian Particle Optimization

abstract: Geometry-agnostic system identification is a technique for identifying the geometry and physical properties of an object from video sequences without any geometric assumptions. Recently, physics-augmented continuum neural radiance fields (PAC-NeRF) has demonstrated promising results for this technique by utilizing a hybrid Eulerian-Lagrangian representation, in which the geometry is represented by the Eulerian grid representations of NeRF, the physics is described by a material point method (MPM), and they are connected via Lagrangian particles. However, a notable limitation of PAC-NeRF is that its performance is sensitive to the learning of the geometry from the first frames owing to its two-step optimization. First, the grid representations are optimized with the first frames of video sequences, and then the physical properties are optimized through video sequences utilizing the fixed first-frame grid representations. This limitation can be critical when learning of the geometric structure is difficult, for example, in a few-shot (sparse view) setting. To overcome this limitation, we propose Lagrangian particle optimization (LPO), in which the positions and features of particles are optimized through video sequences in Lagrangian space. This method allows for the optimization of the geometric structure across the entire video sequence within the physical constraints imposed by the MPM. The experimental results demonstrate that the LPO is useful for geometric correction and physical identification in sparse-view settings.


title: Pointer-Guided Pre-Training: Infusing Large Language Models with Paragraph-Level Contextual Awareness

abstract: We introduce "pointer-guided segment ordering" (SO), a novel pre-training technique aimed at enhancing the contextual understanding of paragraph-level text representations in large language models. Our methodology leverages a self-attention-driven pointer network to restore the original sequence of shuffled text segments, addressing the challenge of capturing the structural coherence and contextual dependencies within documents. This pre-training approach is complemented by a fine-tuning methodology that incorporates dynamic sampling, augmenting the diversity of training instances and improving sample efficiency for various downstream applications. We evaluate our method on a diverse set of datasets, demonstrating its efficacy in tasks requiring sequential text classification across scientific literature and financial reporting domains. Our experiments show that pointer-guided pre-training significantly enhances the model's ability to understand complex document structures, leading to state-of-the-art performance in downstream classification tasks.


title: Circuit-level fault tolerance of cat codes

abstract: Bosonic codes offer the possibility of storing quantum information in a single infinite-dimensional physical system endowed with the capability to correct errors, thereby reducing the number of physical components needed to protect against noise. Much of the current efforts in bosonic codes are on correcting only loss errors, while deferring the correction of phase errors -- perhaps actively suppressed -- to subsequent layers of encoding with standard qubit codes. Rotationally symmetric bosonic codes, which include the well-known cat and binomial codes, are capable of simultaneous correction of both loss and phase errors, offer an alternate route that deals with arbitrary errors already at the base layer. Grimsmo et al. [PRX 10, 011058 (2020)] analyzed the family of such codes and proposed general error-correction circuits to correct both loss and phase errors, reporting high noise thresholds in the presence of loss and phase errors on the input, while the error-correction circuits remain noiseless. A proper assessment, however, requires consideration of circuit-level noise, where the individual circuit components can themselves be faulty and introduce errors on the encoded information. Here, we carry out such a circuit-level analysis, and assess the performance of the error-correction circuits for the storage of information encoded with cat codes. While the circuits of Grimsmo et al.~are formally fault tolerant even under circuit-level noise, the thresholds are significantly worse. We show how, through waiting-time optimization and the use of squeezing, we can restore the noise requirements to ones plausibly achievable with near-term quantum hardware. Our circuit-level analysis also reveals important features of the error-correction circuits not visible in the earlier ideal-circuit perspective.


title: Sparse Multi-baseline SAR Cross-modal 3D Reconstruction of Vehicle Targets

abstract: Multi-baseline SAR 3D imaging faces significant challenges due to data sparsity. In recent years, deep learning techniques have achieved notable success in enhancing the quality of sparse SAR 3D imaging. However, previous work typically rely on full-aperture high-resolution radar images to supervise the training of deep neural networks (DNNs), utilizing only single-modal information from radar data. Consequently, imaging performance is limited, and acquiring full-aperture data for multi-baseline SAR is costly and sometimes impractical in real-world applications. In this paper, we propose a Cross-Modal Reconstruction Network (CMR-Net), which integrates differentiable render and cross-modal supervision with optical images to reconstruct highly sparse multi-baseline SAR 3D images of vehicle targets into visually structured and high-resolution images. We meticulously designed the network architecture and training strategies to enhance network generalization capability. Remarkably, CMR-Net, trained solely on simulated data, demonstrates high-resolution reconstruction capabilities on both publicly available simulation datasets and real measured datasets, outperforming traditional sparse reconstruction algorithms based on compressed sensing and other learning-based methods. Additionally, using optical images as supervision provides a cost-effective way to build training datasets, reducing the difficulty of method dissemination. Our work showcases the broad prospects of deep learning in multi-baseline SAR 3D imaging and offers a novel path for researching radar imaging based on cross-modal learning theory.


title: MARLander: A Local Path Planning for Drone Swarms using Multiagent Deep Reinforcement Learning

abstract: Achieving safe and precise landings for a swarm of drones poses a significant challenge, primarily attributed to conventional control and planning methods. This paper presents the implementation of multi-agent deep reinforcement learning (MADRL) techniques for the precise landing of a drone swarm at relocated target locations. The system is trained in a realistic simulated environment with a maximum velocity of 3 m/s in training spaces of 4 x 4 x 4 m and deployed utilizing Crazyflie drones with a Vicon indoor localization system. The experimental results revealed that the proposed approach achieved a landing accuracy of 2.26 cm on stationary and 3.93 cm on moving platforms surpassing a baseline method used with a Proportional-integral-derivative (PID) controller with an Artificial Potential Field (APF). This research highlights drone landing technologies that eliminate the need for analytical centralized systems, potentially offering scalability and revolutionizing applications in logistics, safety, and rescue missions.


title: Disk Evolution Study Through Imaging of Nearby Young Stars (DESTINYS): PDS 111, an old T Tauri star with a young-looking disk

abstract: The interplay between T Tauri stars and their circumstellar disks, and how this impacts the onset of planet formation has yet to be established. We studied a seemingly old T Tauri star, PDS 111, and its disk. We analyzed optical, infrared, and sub-millimeter observations obtained with VLT/X-shooter, Mercator/HERMES, TESS, VLT/SPHERE, and ALMA, providing a new view on PDS 111 and its protoplanetary disk. The multi-epoch spectroscopy yields photospheric lines to classify the star, and emission lines to study variability in the hot inner disk and to determine the mass-accretion rate. The SPHERE and ALMA observations are used to characterize the dust distribution of the small and large grains, respectively. PDS 111 is a weak-line T Tauri star with spectral type G2, exhibits strong H$\alpha$ variability and with a low mass-accretion rate of $1-5\times10^{-10}$\,M$_{\odot}$\,yr$^{-1}$. We measured an age of the system of 15.9$^{+1.7}_{-3.7}$ Myr using pre-main sequence tracks. The SPHERE observations show a strongly flaring disk with an asymmetric substructure. The ALMA observations reveal a 30 au cavity in the dust continuum emission with a low contrast asymmetry in the South-West of the disk and a dust disk mass of 45.8\,$M_\oplus$. The $^{12}$CO radial extension is at least three times larger than that of the dust emission. Although the measured age is younger than suggested in literature, PDS 111 still seems relatively old; this provides insight into disk properties at an advanced stage of pre-main sequence evolution. The characteristics of this disk are very similar to its younger counterparts: strongly flaring, an average disk mass, a typical radial extent of the disk gas and dust, and the presence of common substructures. This suggests that disk evolution has not significantly changed the disk properties. These results show similarities with the "Peter Pan disks" around M-dwarfs.


title: Gravitational reheating in Starobinsky inflation

abstract: We investigate the possibility of achieving post-inflationary reheating exclusively through the gravitational interaction in Starobinsky inflation, which itself assumes nothing but gravity. We consider the possibility that the reheating sector couples to gravity via a non-minimal coupling. Our analysis is performed both in a perturbative and in a non-perturbative approach, where particle production is computed from Bogoliubov coefficients. Our findings indicate that, for sufficiently large non-minimal coupling ($\xi\gtrsim~\text{few}\times 10$), non-perturbative particle production allows for temperatures of order $10^{12}$ GeV to be reached while also ensuring that the Universe becomes radiation-dominated. This shows that the gravitational interaction could be the sole responsible for reheating the Universe after inflation, without the need to assume other ad hoc inflaton interactions.


title: Stability of equilibria and bifurcations for a fluid-solid interaction problem

abstract: We study certain significant properties of the equilibrium configurations of a rigid body subject to an undamped elastic restoring force, in the stream of a viscous liquid in an unbounded 3D domain. The motion of the coupled system is driven by a uniform flow at spatial infinity, with constant dimensionless velocity $\lambda$. We show that if $\lambda$ is below a critical value, $\lambda_c$ (say), there is a unique and stable time-independent configuration, where the body is in equilibrium and the flow is steady. We also prove that, if $\lambda<\lambda_c$, no oscillatory flow may occur. Successively, we investigate possible loss of uniqueness by providing necessary and sufficient conditions for the occurrence of a steady bifurcation at some $\lambda_s\ge \lambda_c$.


title: Essentially Sharp Estimates on the Entropy Regularization Error in Discrete Discounted Markov Decision Processes

abstract: We study the error introduced by entropy regularization of infinite-horizon discrete discounted Markov decision processes. We show that this error decreases exponentially in the inverse regularization strength both in a weighted KL-divergence and in value with a problem-specific exponent. We provide a lower bound matching our upper bound up to a polynomial factor. Our proof relies on the correspondence of the solutions of entropy-regularized Markov decision processes with gradient flows of the unregularized reward with respect to a Riemannian metric common in natural policy gradient methods. Further, this correspondence allows us to identify the limit of the gradient flow as the generalized maximum entropy optimal policy, thereby characterizing the implicit bias of the Kakade gradient flow which corresponds to a time-continuous version of the natural policy gradient method. We use this to show that for entropy-regularized natural policy gradient methods the overall error decays exponentially in the square root of the number of iterations improving existing sublinear guarantees.


title: Scattering of Vortices with Excited Normal Modes

abstract: We consider head-on collisions at critical coupling of vortices modelled by the Abelian-Higgs model. We investigate the 2-vortex scattering, whereby the vortices are excited by the shape mode causing fluctuations in the gauge-invariant quantities. When the vortices are excited with a sufficiently large amplitude the moduli space approximation fails, and we observe an interesting behaviour in which the vortices can become trapped in a quasi-bound state with multiple bounces. We perform a detailed investigation on the behaviour of these excited vortices and sample a phase space of solutions. Interestingly, we find a fractal structure dependent on the initial phase of the mode and velocity of the vortices.


title: Repurposing Language Models into Embedding Models: Finding the Compute-Optimal Recipe

abstract: Text embeddings are essential for many tasks, such as document retrieval, clustering, and semantic similarity assessment. In this paper, we study how to contrastively train text embedding models in a compute-optimal fashion, given a suite of pre-trained decoder-only language models. Our innovation is an algorithm that produces optimal configurations of model sizes, data quantities, and fine-tuning methods for text-embedding models at different computational budget levels. The resulting recipe, which we obtain through extensive experiments, can be used by practitioners to make informed design choices for their embedding models. Specifically, our findings suggest that full fine-tuning and low-rank adaptation fine-tuning produce optimal models at lower and higher computational budgets respectively.


title: Photometric Classification of Stars Around the Milky Way's Central Black Hole: I. Central Parsec

abstract: The presence of young massive stars in the Galactic Centre (GC) raises questions about star formation near the black hole Sagittarius A* (Sgr A*). Additionally, the initial mass function (IMF) in this region appears different from the standard Salpeter/Kroupa law. Extreme extinction and crowding limit our understanding of the stellar population, with spectroscopic data available only for selected bright sources. We aim to improve knowledge about the distribution and IMF of young, massive stars near Sgr A*. Using intermediate band (IB) photometry, we identify candidates for massive young stars through Bayesian inference, a neural network, and a gradient-boosted trees algorithm. We obtained spectral energy distributions for 6590 stars, 1181 of which have been previously classified spectroscopically. We identify 351 stars classified as early types by all three methods, including 155 newly identified candidates. The radial density profiles for late and early-type stars fit broken power laws, with a break radius of 9.2 +- 0.6'' for early-type stars. Late-type stars show a core-like distribution around Sgr A*, while early-type stars' density increases steeply towards the black hole. We infer a top-heavy IMF of young stars near Sgr A* (R < 9''), with a power-law of 1.6 +- 0.1. At greater distances, a standard Salpeter/Kroupa IMF fits the data. IB photometry also constrains the metallicities of late-type stars, estimating metallicities for over 600 stars. The IMF variation with radial distance suggests different star formation mechanisms, with a top-heavy IMF near Sgr A* consistent with disc star formation.


title: Comparing estimators of discriminative performance of time-to-event models

abstract: Predicting the timing and occurrence of events is a major focus of data science applications, especially in the context of biomedical research. Performance for models estimating these outcomes, often referred to as time-to-event or survival outcomes, is frequently summarized using measures of discrimination, in particular time-dependent AUC and concordance. Many estimators for these quantities have been proposed which can be broadly categorized as either semi-parametric estimators or non-parametric estimators. In this paper, we review various estimators' mathematical construction and compare the behavior of the two classes of estimators. Importantly, we identify a previously unknown feature of the class of semi-parametric estimators that can result in vastly over-optimistic out-of-sample estimation of discriminative performance in common applied tasks. Although these semi-parametric estimators are popular in practice, the phenomenon we identify here suggests this class of estimators may be inappropriate for use in model assessment and selection based on out-of-sample evaluation criteria. This is due to the semi-parametric estimators' bias in favor of models that are overfit when using out-of-sample prediction criteria (e.g., cross validation). Non-parametric estimators, which do not exhibit this behavior, are highly variable for local discrimination. We propose to address the high variability problem through penalized regression splines smoothing. The behavior of various estimators of time-dependent AUC and concordance are illustrated via a simulation study using two different mechanisms that produce over-optimistic out-of-sample estimates using semi-parametric estimators. Estimators are further compared using a case study using data from the National Health and Nutrition Examination Survey (NHANES) 2011-2014.


title: Majorana zero modes under electron correlation

abstract: In this work, we perform a systematic investigation of the correlated topological superconductors (TSCs), especially their non-trivial Majorana zero modes (MZMs). Compared to the non-interacting MZMs, the emerged correlated MZMs become projected MZMs. To prove this, we study the topological superconducting nanowire under the Hubbard and Hatsugai-Kohmoto interactions. Both of them become correlated TSCs under a magnetic field. Their topological properties are numerically computed by the Wilson loop and entanglement spectrum. We successfully extract the projected MZMs connecting the ground state and excited state through exact diagonalization. We also extend our results to the spinful Kitaev chain. Our results can provide a new perspective and understanding of the correlated MZMs.


title: Parametric Intrusive Reduced Order Models enhanced with Machine Learning Correction Terms

abstract: In this paper, we propose an equation-based parametric Reduced Order Model (ROM), whose accuracy is improved with data-driven terms added into the reduced equations. These additions have the aim of reintroducing contributions that in standard ROMs are not taken into account. In particular, in this work we consider two types of contributions: the turbulence modeling, added through a reduced-order approximation of the eddy viscosity field, and the correction model, aimed to re-introduce the contribution of the discarded modes. Both approaches have been investigated in previous works and the goal of this paper is to extend the model to a parametric setting making use of ad-hoc machine learning procedures. More in detail, we investigate different neural networks' architectures, from simple dense feed-forward to Long-Short Term Memory neural networks, in order to find the most suitable model for the re-introduced contributions. We tested the methods on two test cases with different behaviors: the periodic turbulent flow past a circular cylinder and the unsteady turbulent flow in a channel-driven cavity. In both cases, the parameter considered is the Reynolds number and the machine learning-enhanced ROM considerably improved the pressure and velocity accuracy with respect to the standard ROM.


abstract: As a promising framework for resolving partial differential equations (PDEs), physics-informed neural networks (PINNs) have received widespread attention from industrial and scientific fields. However, lack of expressive ability and initialization pathology issues are found to prevent the application of PINNs in complex PDEs. In this work, we propose Element-wise Multiplication Based Physics-informed Neural Networks (EM-PINNs) to resolve these issues. The element-wise multiplication operation is adopted to transform features into high-dimensional, non-linear spaces, which effectively enhance the expressive capability of PINNs. Benefiting from element-wise multiplication operation, EM-PINNs can eliminate the initialization pathologies of PINNs. The proposed structure is verified on various benchmarks. The results show that EM-PINNs have strong expressive ability.


title: Equivariant Connections and their applications to Yang-Mills equations

abstract: We reduce Yang-Mills equations for $SO^+(p,q)$, $Spin^+(p,q)$ and $SU(n)$ bundles, with constant and isotropic metrics, by developing the concept of $SO^+(p,q)$-equivariance. This allows us to model the electroweak interaction and $SO^+(p,q)$ bundles with a non-linear second order differential equation as well as the weak and strong interaction with a non-linear wave equation.


title: Twists of twisted generalized Weyl algebras

abstract: We study graded twisted tensor products and graded twists of twisted generalized Weyl algebras (TGWAs). We show that the class of TGWAs is closed under these operations assuming mild hypotheses. We generalize a result on cocycle equivalence amongst multiparameter quantized Weyl algebras to the setting of TGWAs. As another application we prove that certain TGWAs of type $A_2$ are noetherian.


title: An improved description of charm fragmentation data

abstract: We consider the fragmentation of heavy quarks into heavy-flavoured hadrons, specifically the production of charmed mesons in $e^+e^-$ collisions, at different centre-of-mass energies. We focus our attention on the ratio of moments of the $D^{*+}$ energy spectrum measured by ALEPH and CLEO. This ratio is believed to provide us with a direct test of perturbative QCD evolution because hadronisation effects should cancel between the numerator and denominator. However, state-of-the-art calculations based on standard (final-state) collinear factorisation fail to describe the experimental data. We show that this discrepancy is considerably reduced if heavy-quark threshold effects are accounted for not only in DGLAP evolution, as it is usually done, but also in the resummed coefficient functions.


title: Positive density for consecutive runs of sums of two squares

abstract: We study the distribution of consecutive sums of two squares in arithmetic progressions. We show that for any odd squarefree modulus $q$, any two reduced congruence classes $a_1$ and $a_2$ mod $q$, and any $r_1,r_2 \ge 1$, a positive density of sums of two squares begin a chain of $r_1$ consecutive sums of two squares, all of which are $a_1$ mod $q$, followed immediately by a chain of $r_2$ consecutive sums of two squares, all of which are $a_2$ mod $q$. This is an analog of the result of Maynard for the sequence of primes, showing that for any reduced congruence class $a$ mod $q$ and for any $r \ge 1$, a positive density of primes begin a sequence of $r$ consecutive primes, all of which are $a$ mod $q$.


title: Confabulation: The Surprising Value of Large Language Model Hallucinations

abstract: This paper presents a systematic defense of large language model (LLM) hallucinations or 'confabulations' as a potential resource instead of a categorically negative pitfall. The standard view is that confabulations are inherently problematic and AI research should eliminate this flaw. In this paper, we argue and empirically demonstrate that measurable semantic characteristics of LLM confabulations mirror a human propensity to utilize increased narrativity as a cognitive resource for sense-making and communication. In other words, it has potential value. Specifically, we analyze popular hallucination benchmarks and reveal that hallucinated outputs display increased levels of narrativity and semantic coherence relative to veridical outputs. This finding reveals a tension in our usually dismissive understandings of confabulation. It suggests, counter-intuitively, that the tendency for LLMs to confabulate may be intimately associated with a positive capacity for coherent narrative-text generation.


title: An explanation for the absence of echoes in black hole light curve autocorrelations

abstract: The observed radiation from hot gas accreting onto a black hole depends on both the details of the flow and the spacetime geometry. The lensing behavior of a black hole produces a distinctive pattern of autocorrelations within its photon ring that encodes its mass, spin, and inclination. In particular, the time autocorrelation of the light curve is expected to display a series of peaks produced by light echoes of the source, with each peak delayed by the characteristic time lapse $\tau$ between light echoes. However, such peaks are absent from the light curves of observed black holes. Here, we develop an analytical model for such light curves that demonstrates how, even though light echoes always exist in the signal, they do not produce autocorrelation peaks if the characteristic correlation timescale $\lambda_0$ of the source is greater than $\tau$. We validate our model against simulated light curves of a stochastic accretion model ray traced with a general-relativistic code, and then fit the model to an observed light curve for Sgr A*. We infer that $\lambda_0>\tau$, providing an explanation for the absence of light echoes in the time autocorrelations of Sgr A* light curves. Our results highlight the importance for black hole parameter inference of spatially resolving the photon ring via future space-based interferometry.


title: A Voxel-based Approach for Simulating Microbial Decomposition in Soil: Comparison with LBM and Improvement of Morphological Models

abstract: This study presents a new computational approach for simulating the microbial decomposition of organic matter, from 3D micro-computed tomography (micro-CT) images of soil. The method employs a valuated graph of connected voxels to simulate transformation and diffusion processes involved in microbial decomposition within the complex soil matrix. The resulting model can be adapted to simulate any diffusion-transformation processes in porous media. We implemented parallelization strategies and explored different numerical methods, including implicit, explicit, synchronous, and asynchronous schemes. To validate our method, we compared simulation outputs with those provided by LBioS and by Mosaic models. LBioS uses a lattice-Boltzmann method for diffusion and Mosaic takes benefit of Pore Network Geometrical Modelling (PNGM) by means of geometrical primitives such as spheres and ellipsoids. This approach achieved comparable results to traditional LBM-based simulations, but required only one-fourth of the computing time. Compared to Mosaic simulation, the proposed method is slower but more accurate and does not require any calibration. Furthermore, we present a theoretical framework and an application example to enhance PNGM-based simulations. This is accomplished by approximating the diffusional conductance coefficients using stochastic gradient descent and data generated by the current approach.


title: Encoding Semantic Priors into the Weights of Implicit Neural Representation

abstract: Implicit neural representation (INR) has recently emerged as a promising paradigm for signal representations, which takes coordinates as inputs and generates corresponding signal values. Since these coordinates contain no semantic features, INR fails to take any semantic information into consideration. However, semantic information has been proven critical in many vision tasks, especially for visual signal representation. This paper proposes a reparameterization method termed as SPW, which encodes the semantic priors to the weights of INR, thus making INR contain semantic information implicitly and enhancing its representational capacity. Specifically, SPW uses the Semantic Neural Network (SNN) to extract both low- and high-level semantic information of the target visual signal and generates the semantic vector, which is input into the Weight Generation Network (WGN) to generate the weights of INR model. Finally, INR uses the generated weights with semantic priors to map the coordinates to the signal values. After training, we only retain the generated weights while abandoning both SNN and WGN, thus SPW introduces no extra costs in inference. Experimental results show that SPW can improve the performance of various INR models significantly on various tasks, including image fitting, CT reconstruction, MRI reconstruction, and novel view synthesis. Further experiments illustrate that model with SPW has lower weight redundancy and learns more novel representations, validating the effectiveness of SPW.


title: On the zeros of partition functions with multi-spin interactions

abstract: Let $X_1, \ldots, X_n$ be probability spaces, let $X$ be their direct product, let $\phi_1, \ldots, \phi_m: X \longrightarrow {\Bbb C}$ be random variables, each depending only on a few coordinates of a point $x=(x_1, \ldots, x_n)$, and let $f=\phi_1 + \ldots + \phi_m$. The expectation $E\thinspace e^{\lambda f}$, where $\lambda \in {\Bbb C}$, appears in statistical physics as the partition function of a system with multi-spin interactions, and also in combinatorics and computer science, where it is known as the partition function of edge-coloring models, tensor network contractions or a Holant polynomial. Assuming that each $\phi_i$ is 1-Lipschitz in the Hamming metric of $X$, that each $\phi_i(x)$ depends on at most $r \geq 2$ coordinates $x_1, \ldots, x_n$ of $x \in X$, and that for each $j$ there are at most $c \geq 1$ functions $\phi_i$ that depend on the coordinate $x_j$, we prove that $E\thinspace e^{\lambda f} \ne 0$ provided $| \lambda | \leq \ (3 c \sqrt{r-1})^{-1}$ and that the bound is sharp up to a constant factor. Taking a scaling limit, we prove a similar result for functions $\phi_1, \ldots, \phi_m: {\Bbb R}^n \longrightarrow {\Bbb C}$ that are 1-Lipschitz in the $\ell^1$ metric of ${\Bbb R}^n$ and where the expectation is taken with respect to the standard Gaussian measure in ${\Bbb R}^n$. As a corollary, the value of the expectation can be efficiently approximated, provided $\lambda$ lies in a slightly smaller disc.


title: Cogenesis by a sliding pNGB with symmetry non-restoration

abstract: We show that a pseudo-Nambu-Goldstone boson (pNGB) with an initial misalignment angle can drive successful spontaneous baryogenesis, and become a good dark matter candidate if the corresponding global symmetry is non-restored at high temperatures. Considering a dimension-five explicit breaking operator, we find that the pNGB starts its motion with a sliding across rapidly decreasing potential barriers during which the baryon asymmetry is generated and frozen, and later it oscillates as dark matter. It is predicted that the pNGB mass and decay constant are around $5\,{\rm eV}$ and $3\times10^6\,{\rm GeV}$, respectively, while the radial mode has a light mass $O(10)\,{\rm MeV}$ and a small mixing $O(10^{-4})$ with the Higgs boson. Applied to the Majoron in the type-I seesaw model, the heaviest right-handed neutrino is required to be as light as $100\,{\rm GeV}$. These predictions can be tested at kaon experiments, heavy neutral lepton searches, LHC, and future colliders.


title: Exact solutions for analog Hawking effect in dielectric media

abstract: In the framework of the analog Hawking radiation for dielectric media, we analyze a toy-model and also the 2D reduction of the Hopfield model for a specific monotone and realistic profile for the refractive index. We are able to provide exact solutions, which do not require any weak dispersion approximation. The theory of Fuchsian ordinary differential equations is the basic tool for recovering exact solutions, which are rigoroulsy identified, and involve the so-called generalized hypergeometric functions $_4F_3(\alpha_1,\alpha_2,\alpha_3,\alpha_4;\beta_1,\beta_2,\beta_3;z)$. A complete set of connection formulas are available, both for the subcritical case and for the transcritical one, and also the Stokes phenomenon occurring in the problem is fully discussed. From the physical point of view, we focus on the problem of thermality. Under suitable conditions, the Hawking temperature is deduced, and we show that it is in fully agreement with the expression deduced in other frameworks under various approximations.


title: Minimal W-algebras with non-admissible levels and intermediate Lie algebras

abstract: In \cite{Kawasetsu:2018irs}, Kawasetsu proved that the simple W-algebra associated with a minimal nilpotent element $W_{k}(\mathfrak{g},f_\theta)$ is rational and $C_2$-cofinite for $\mathfrak{g}=D_4,E_6,E_7,E_8$ with non-admissible level $k=-h^\vee/6$. In this paper, we study ${W}_{k}(\mathfrak{g},f_\theta)$ algebra for $\mathfrak{g}=E_6,E_7,E_8$ with non-admissible level $k=-h^\vee/6+1$. We determine all irreducible (Ramond twisted) modules, compute their characters and find coset constructions and Hecke operator interpretations. These W-algebras are closely related to intermediate Lie algebras and intermediate vertex subalgebras.


title: Manipulating the Relaxation Time of Boundary-Dissipative Systems through Bond Dissipation

abstract: Relaxation time plays a crucial role in describing the relaxation processes of quantum systems. We study the effect of a type of bond dissipation on the relaxation time of boundary dissipative systems and find that it can change the scaling of the relaxation time $T_c\sim L^{z}$ from $z=3$ to a value significantly less than $3$. We further reveal that the reason such bond dissipation can significantly reduce the relaxation time is that it can selectively target specific states. For Anderson localized systems, the scaling behavior of the relaxation time changes from an exponential form to a power-law form as the system size varies. This is because the bond dissipation we consider can not only select specific states but also disrupt the localization properties. Our work reveals that in open systems, one type of dissipation can be used to regulate the effects produced by another type of dissipation.


title: Shield Synthesis for LTL Modulo Theories

abstract: In recent years, Machine Learning (ML) models have achieved remarkable success in various domains. However, these models also tend to demonstrate unsafe behaviors, precluding their deployment in safety-critical systems. To cope with this issue, ample research focuses on developing methods that guarantee the safe behaviour of a given ML model. A prominent example is shielding which incorporates an external component (a "shield") that blocks unwanted behavior. Despite significant progress, shielding suffers from a main setback: it is currently geared towards properties encoded solely in propositional logics (e.g., LTL) and is unsuitable for richer logics. This, in turn, limits the widespread applicability of shielding in many real-world systems. In this work, we address this gap, and extend shielding to LTL modulo theories, by building upon recent advances in reactive synthesis modulo theories. This allowed us to develop a novel approach for generating shields conforming to complex safety specifications in these more expressive, logics. We evaluated our shields and demonstrate their ability to handle rich data with temporal dynamics. To the best of our knowledge, this is the first approach for synthesizing shields for such expressivity.


title: Numerical Optimization Study of a Constrained Hypersonic Reentry Vehicle

abstract: The trajectory optimization of the atmospheric entry of a reusable launch vehicle is studied. The objective is to maximize the crossrange of the vehicle subject to two control-inequality path constraints, two state-inequality path constraints, and one mixed state-and-control inequality path constraint. In order to determine the complex switching structure in the activity of the path constraints, a recently developed method for solving state-path constrained optimal control problems is used. This recently developed method is designed to algorithmically locate the points of activation and deactivation in the path constraints and partition the domain of the independent variable into subdomains based on these activation and deactivation points. Additionally, in a domain where a state-inequality path constraint is found to be active, the method algorithmically determines and enforces the additional necessary conditions that apply on the constrained arc. A multiple-domain formulation of Legendre-Gauss-Radau direct collocation is then employed to transcribe the optimal control problem into a large sparse nonlinear programming problem. Two studies are performed which analyze a variety of problem formulations of the hypersonic reusable launch vehicle. Key features of the constrained trajectories are presented, and the method used is shown to obtain highly accurate solutions with minimal user intervention.


title: Difference Equations and Integral Families for Witten Diagrams

abstract: We show that tree-level and one-loop Mellin space correlators in anti-de Sitter space obey certain difference equations, which are the direct analog to the differential equations for Feynman loop integrals in the flat space. Finite-difference relations, which we refer to as ``summation-by-parts relations'', in parallel with the integration-by-parts relations for Feynman loop integrals, are derived to reduce the integrals to a basis. We illustrate the general methodology by explicitly deriving the difference equations and summation-by-parts relations for various tree-level and one-loop Witten diagrams up to the four-point bubble level.


title: A Multiscale Perspective on Maximum Marginal Likelihood Estimation

abstract: In this paper, we provide a multiscale perspective on the problem of maximum marginal likelihood estimation. We consider and analyse a diffusion-based maximum marginal likelihood estimation scheme using ideas from multiscale dynamics. Our perspective is based on stochastic averaging; we make an explicit connection between ideas in applied probability and parameter inference in computational statistics. In particular, we consider a general class of coupled Langevin diffusions for joint inference of latent variables and parameters in statistical models, where the latent variables are sampled from a fast Langevin process (which acts as a sampler), and the parameters are updated using a slow Langevin process (which acts as an optimiser). We show that the resulting system of stochastic differential equations (SDEs) can be viewed as a two-time scale system. To demonstrate the utility of such a perspective, we show that the averaged parameter dynamics obtained in the limit of scale separation can be used to estimate the optimal parameter, within the strongly convex setting. We do this by using recent uniform-in-time non-asymptotic averaging bounds. Finally, we conclude by showing that the slow-fast algorithm we consider here, termed Slow-Fast Langevin Algorithm, performs on par with state-of-the-art methods on a variety of examples. We believe that the stochastic averaging approach we provide in this paper enables us to look at these algorithms from a fresh angle, as well as unlocking the path to develop and analyse new methods using well-established averaging principles.


title: Digital Twin Aided RIS Communication: Robust Beamforming and Interference Management

abstract: Reconfigurable intelligent surfaces (RISs) are envisioned to play a key role in future wireless communication networks. However, channel estimation in RIS-aided wireless networks is challenging due to their passive nature and the large number of reflective elements, leading to high channel estimation overhead. Additionally, conventional methods like beam sweeping, which do not rely on explicit channel state information, often struggle in managing interference in multi-user networks. In this paper, we propose a novel approach that leverages digital twins (DTs) of the physical environments to approximate channels using electromagnetic 3D models and ray tracing, thus relaxing the need for channel estimation and extensive over-the-air computations in RIS-aided wireless networks. To address the digital twins channel approximation errors, we further refine this approach with a DT-specific robust transmission design that reliably meets minimum desired rates. The results show that our method secures these rates over 90% of the time, significantly outperforming beam sweeping, which achieves these rates less than 8% of the time due to its poor management of transmitting power and interference.


title: A Note About Majority Colorings of Countable DAGs

abstract: A majority coloring of an undirected graph is a vertex coloring in which for each vertex there are at least as many bi-chromatic edges containing that vertex as monochromatic ones. It is known that for every countable graph a majority 3-coloring always exists. The Unfriendly Partition Conjecture states that every countable graph admits a majority 2-coloring. Since the 3-coloring result extends to countable DAGs, a variant of the conjecture states that 2 colors are enough to majority color every countable DAG. We show that this is false by presenting a DAG for which 3 colors are necessary. Presented construction is strongly based on a StackExchange conversation regarding labellings of infinite graphs that is linked in the references.


title: Probing quantum complexity via universal saturation of stabilizer entropies

abstract: Nonstabilizerness or `magic' is a key resource for quantum computing and a necessary condition for quantum advantage. Non-Clifford operations turn stabilizer states into resourceful states, where the amount of nonstabilizerness is quantified by resource measures such as stabilizer R\'enyi entropies (SREs). Here, we show that SREs saturate their maximum value at a critical number of non-Clifford operations. Close to the critical point SREs show universal behavior. Remarkably, the derivative of the SRE crosses at the same point independent of the number of qubits and can be rescaled onto a single curve. We find that the critical point depends non-trivially on R\'enyi index $\alpha$. For random Clifford circuits doped with T-gates, the critical T-gate density scales independently of $\alpha$. In contrast, for random Hamiltonian evolution, the critical time scales linearly with qubit number for $\alpha>1$, while is a constant for $\alpha<1$. This highlights that $\alpha$-SREs reveal fundamentally different aspects of nonstabilizerness depending on $\alpha$: $\alpha$-SREs with $\alpha<1$ relate to Clifford simulation complexity, while $\alpha>1$ probe the distance to the closest stabilizer state and approximate state certification cost via Pauli measurements. As technical contributions, we observe that the Pauli spectrum of random evolution can be approximated by two highly concentrated peaks which allows us to compute its SRE. Further, we introduce a class of random evolution that can be expressed as random Clifford circuits and rotations, where we provide its exact SRE. Our results opens up new approaches to characterize the complexity of quantum systems.


title: Strong Approximations for Empirical Processes Indexed by Lipschitz Functions

abstract: This paper presents new uniform Gaussian strong approximations for empirical processes indexed by classes of functions based on $d$-variate random vectors ($d\geq1$). First, a uniform Gaussian strong approximation is established for general empirical processes indexed by Lipschitz functions, encompassing and improving on all previous results in the literature. When specialized to the setting considered by Rio (1994), and certain constraints on the function class hold, our result improves the approximation rate $n^{-1/(2d)}$ to $n^{-1/\max\{d,2\}}$, up to the same $\operatorname{polylog} n$ term, where $n$ denotes the sample size. Remarkably, we establish a valid uniform Gaussian strong approximation at the optimal rate $n^{-1/2}\log n$ for $d=2$, which was previously known to be valid only for univariate ($d=1$) empirical processes via the celebrated Hungarian construction (Koml\'os et al., 1975). Second, a uniform Gaussian strong approximation is established for a class of multiplicative separable empirical processes indexed by Lipschitz functions, which address some outstanding problems in the literature (Chernozhukov et al., 2014, Section 3). In addition, two other uniform Gaussian strong approximation results are presented for settings where the function class takes the form of a sequence of Haar basis based on generalized quasi-uniform partitions. We demonstrate the improvements and usefulness of our new strong approximation results with several statistical applications to nonparametric density and regression estimation.


title: Large-scale semi-discrete optimal transport with distributed Voronoi diagrams

abstract: In this article, I propose a numerical method to solve semi-discrete optimal transport problems for gigantic pointsets ($10^8$ points and more). By pushing the limits by several orders of magnitude, it opens the path to new applications in cosmology, fluid simulation and data science to name but a few. The method is based on a new algorithm that computes (generalized) Voronoi diagrams in parallel and in a distributed way. First I make the simple observation that the cells defined by a subgraph of the Delaunay graph contain the Voronoi cells, and that one can deduce the missing edges from the intersections between those cells. Based on this observation, I introduce the Distributed Voronoi Diagram algorithm (DVD) that can be used on a cluster and that exchanges vertices between the nodes as need be. I also report early experimental results, demonstrating that the DVD algorithm has the potential to solve some giga-scale semi-discrete optimal transport problems encountered in computational cosmology.


title: Machine Learning-Driven Microwave Imaging for Soil Moisture Estimation near Leaky Pipe

abstract: Characterizing soil moisture (SM) around drip irrigation pipes is crucial for precise and optimized farming. Machine learning (ML) approaches are particularly suitable for this task as they can reduce uncertainties caused by soil conditions and the drip pipe positions, using features extracted from relevant datasets. This letter addresses local moisture detection in the vicinity of dripping pipes using a portable microwave imaging system. The employed ML approach is fed with two dimensional images generated by two different microwave imaging techniques based on spatio-temporal measurements at various frequency bands. The study investigates the performance of K-Nearest Neighbor (KNN) and Convolutional Neural Networks (CNN) algorithms for moisture classification based on these images, both before and after performing soil clutter reduction. We also explore the potentials of CNN and KNN for moisture estimation around the plant roots and in the presence of pebbles. The results demonstrate the more accurate moisture estimation using CNN when it is applied after clutter reduction considering back projection algorithm (BPA) as the imaging technique.


title: $C^0$-flexibility of Legendrian discs in $\mathbb{R}^5$

abstract: We construct a compactly supported contact homeomorphism of $\mathbb{R}^5$, with the standard contact structure, which maps a Legendrian disc to a smooth nowhere Legendrian disc.


title: Unified Rapid Mass Transfer

abstract: We present a method to obtain rapid mass loss rates in binary systems, specifically at the onset of MT episodes. The method unifies atmospheric (underflow) and $L_1$ stream (overflow) mass rates in a single continuous procedure. The method uses averaged 3D properties of the binaries, such as effective binary potential and effective binary acceleration, to both evolve the donor and obtain properties of the matter at the $L_1$ plane. In the case of underflow, we obtain atmospheric stratification. Our method can be used for binaries with an extensive range of mass ratios, $0.01 \le q \le 100$, and can also be applied to hot donors. The considered examples show that the MT rates obtained with this revised formalism always differ from the optically thin and optically thick MT rates widely used during the computations of binary evolution.


title: Typical representations for $\mathrm{Sp}_4(F)$

abstract: Let $F$ be a non Archimedean local field with odd residual characteristic, and let $K$ be a hyperspecial maximal compact subgroup of the $p$-adic symplectic group $G=\mathrm{Sp}_4(F)$. Let $\mathfrak{s}$ be an inertial class for $G$ in the Bernstein decomposition of the category of smooth representations of $G$, which is attached to a proper Levi subgroup $L$ of $G$. We prove that the $\mathfrak{s}$-typical irreducible representations of $K$ are the irreducible components of $\mathrm{Ind}_{J_{\mathfrak{s}}}^{K}(\lambda_{\mathfrak{s}})$, where $(J_{\mathfrak{s}},\lambda_{\mathfrak{s}})$ is an $\mathfrak{s}$-type for $G$ such that $J_{\mathfrak{s}}\subset K$, and $(J_{\mathfrak{s}},\lambda_{\mathfrak{s}})$ is a $G$-cover of a Bushnell-Kutzko maximal simple type for $L$.


title: DICE: Detecting In-distribution Contamination in LLM's Fine-tuning Phase for Math Reasoning

abstract: The advancement of large language models (LLMs) relies on evaluation using public benchmarks, but data contamination can lead to overestimated performance. Previous researches focus on detecting contamination by determining whether the model has seen the exact same data during training. In this work, we argue that even training on data similar to benchmark data inflates performance on in-distribution tasks without improving overall capacity, which we called In-distribution contamination. To effectively detect in-distribution contamination, we propose DICE, a novel method that leverages the internal states of LLMs to locate-then-detect the contamination. DICE first identifies the most sensitive layer to contamination, then trains a classifier based on the internal states of that layer. Experiments reveal DICE's high accuracy in detecting in-distribution contamination across various LLMs and math reasoning datasets. We also show the generalization capability of the trained DICE detector, which is able to detect contamination across multiple benchmarks with similar distributions. Additionally, we find that the DICE detection scores are positively correlated with the performance of ten LLMs fine-tuned by either us or other organizations on four math reasoning datasets (with $R^2$ values between 0.6 and 0.75). This indicates that the in-distribution contamination problem potentially lead to an overestimation of the true capabilities of many existing models. The code and data are available at https://github.com/THU-KEG/DICE.


title: Flow-induced Oscillations via Hopf Bifurcation in a Fluid-Solid Interaction Problem

abstract: We furnish necessary and sufficient conditions for the occurrence of a Hopf bifurcation in a particularly significant fluid-structure problem, where a Navier-Stokes liquid interacts with a rigid body that is subject to an undamped elastic restoring force. The motion of the coupled system is driven by a uniform flow at spatial infinity, with constant dimensionless velocity $\lambda>0$. In particular, if the relevant linearized operator meets suitable spectral properties, there exists a threshold $\lambda_o>0$ above which a bifurcating time-periodic branch stems out of the branch of steady-state solutions. The most remarkable feature of our result is that no restriction is imposed on the frequency $\omega$ of the bifurcating solution, which may thus coincide with one of the natural structural frequencies $\omega_{\sf n}$ of the body. Therefore, resonance cannot occur as a result of this bifurcation. However, when $\omega\to\omega_{\sf n}$, the amplitude of oscillations may become very large when the fluid density is negligible compared to the mass of the body. To our knowledge, our result is the first {\it rigorous} investigation of the existence of a Hopf bifurcation in a fluid-structure interaction problem.


title: High-Fidelity Electron Spin Gates in a Scalable Diamond Quantum Register

abstract: Diamond is a promising platform for quantum information processing as it can host highly coherent qubits that might allow for the construction of large quantum registers. A prerequisite for such devices is a coherent interaction between electron nitrogen vacancy (NV) spins. Entanglement between dipolar-coupled NV spin pairs has been demonstrated, but with a limited entanglement fidelity and its error sources have not been characterized. Here, we design a robust, easy to implement entangling gate between NV spins in diamond and quantify the influence of multiple error sources on the gate performance. Experimentally, we demonstrate a record gate fidelity of $F=(96.0 \pm 2.5)$ % under ambient conditions. Our identification of the dominant errors paves the way towards NV-NV gates beyond the error correction threshold.


title: A R\'enyi entropy interpretation of anti-concentration and noncentral sections of convex bodies

abstract: We extend Bobkov and Chistyakov's (2015) upper bounds on concentration functions of sums of independent random variables to a multivariate entropic setting. The approach is based on pointwise estimates on densities of sums of independent random vectors uniform on centred Euclidean balls. In this vein, we also obtain sharp bounds on volumes of noncentral sections of isotropic convex bodies.


title: Towards Principled Superhuman AI for Multiplayer Symmetric Games

abstract: Multiplayer games, when the number of players exceeds two, present unique challenges that fundamentally distinguish them from the extensively studied two-player zero-sum games. These challenges arise from the non-uniqueness of equilibria and the risk of agents performing highly suboptimally when adopting equilibrium strategies. While a line of recent works developed learning systems successfully achieving human-level or even superhuman performance in popular multiplayer games such as Mahjong, Poker, and Diplomacy, two critical questions remain unaddressed: (1) What is the correct solution concept that AI agents should find? and (2) What is the general algorithmic framework that provably solves all games within this class? This paper takes the first step towards solving these unique challenges of multiplayer games by provably addressing both questions in multiplayer symmetric normal-form games. We also demonstrate that many meta-algorithms developed in prior practical systems for multiplayer games can fail to achieve even the basic goal of obtaining agent's equal share of the total reward.


title: Legal Documents Drafting with Fine-Tuned Pre-Trained Large Language Model

abstract: With the development of large-scale Language Models (LLM), fine-tuning pre-trained LLM has become a mainstream paradigm for solving downstream tasks of natural language processing. However, training a language model in the legal field requires a large number of legal documents so that the language model can learn legal terminology and the particularity of the format of legal documents. The typical NLP approaches usually rely on many manually annotated data sets for training. However, in the legal field application, it is difficult to obtain a large number of manually annotated data sets, which restricts the typical method applied to the task of drafting legal documents. The experimental results of this paper show that not only can we leverage a large number of annotation-free legal documents without Chinese word segmentation to fine-tune a large-scale language model, but more importantly, it can fine-tune a pre-trained LLM on the local computer to achieve the generating legal document drafts task, and at the same time achieve the protection of information privacy and to improve information security issues.


title: Explicit Steady-State Approximations for Parallel Server Systems with Heterogeneous Servers

abstract: The weighted-workload-task-allocation (WWTA) load-balancing policy is known to be throughput optimal for parallel server systems with heterogeneous servers. This work concerns the heavy traffic approximation of steady-state performance for parallel server systems operating under WWTA policy. Under a relaxed complete-resource-pooling condition, we prove that WWTA achieves a "strong form" of state-space collapse in heavy traffic and that the scaled workload for each server converges in distribution to an exponential random variable, whose parameter is explicitly given by system primitives. Various steady-state performance measures are shown to be approximated from this exponential random variable. Instead of proving a stochastic process limit followed by an interchange of limits - a method that dominates the literature, our method works directly with a pre-limit basic adjoint relationship (BAR) that characterizes the stationary distribution of each pre-limit system.


title: Fundamental effective temperature measurements for eclipsing binary stars -- V. The circumbinary planet system EBLM J0608-59

abstract: EBLM J0608-59 / TOI-1338 / BEBOP-1 is a 12th-magnitude, F9V star in an eclipsing binary with a much fainter M-dwarf companion on a wide, eccentric orbit (P=14.6 d). The binary is orbited by two circumbinary planets: one transiting on a 95-day orbit and one non-transiting on a 215-day orbit. We have used high-precision photometry from the TESS mission combined with direct mass measurements for the two stars published recently to measure the following model-independent radii: $R_1 = 1.32 \pm 0.02 R_{\odot}$, $R_2 = 0.309 \pm 0.004 R_{\odot}$. Using $R_1$ and the parallax from Gaia EDR3 we find that this star's angular diameter is $\theta = 0.0309 \pm 0.0005$ mas. The apparent bolometric flux of the primary star corrected for both extinction and the contribution from the M-dwarf ($<0.4$%) is ${\mathcal F}_{\oplus,0} = (0.417\pm 0.005)\times10^{-9} {\rm \,erg\,cm}^{-2} {\rm \,s}^{-1}$. Hence, this F9V star has an effective temperature $T_{\rm eff,1} = 6031{\rm\,K} \pm 46{\rm \,K\,(rnd.)} \pm 10 {\rm \,K\,(sys.)}$. EBLM J0608-59 is an ideal benchmark star that can be added to the sample of such systems we are establishing for "end-to-end" tests of the stellar parameters measured by large-scale spectroscopic surveys.


title: Why Study the Spherical Convexity of Non-Homogeneous Quadratic Functions, and What Makes It Surprising?

abstract: This paper presents necessary, sufficient, and equivalent conditions for the spherical convexity of non-homogeneous quadratic functions. In addition to motivating this study and identifying useful criteria for determining whether such functions are spherically convex, we discovered surprising properties that distinguish spherically convex quadratic functions from their geodesically convex counterparts in both hyperbolic and Euclidean spaces. Since spherically convex functions over the entire sphere are constant, we restricted our focus to proper spherically convex subsets of the sphere. Although most of our results pertain to non-homogeneous quadratic functions on the spherically convex set of unit vectors with positive coordinates, we also present findings for more general spherically convex sets. Beyond the general non-homogeneous quadratic functions, we consider explicit special cases where the matrix in the function's definition is of a specific type, such as positive, diagonal, and Z-matrix.


title: Diffusion-based image inpainting with internal learning

abstract: Diffusion models are now the undisputed state-of-the-art for image generation and image restoration. However, they require large amounts of computational power for training and inference. In this paper, we propose lightweight diffusion models for image inpainting that can be trained on a single image, or a few images. We show that our approach competes with large state-of-the-art models in specific cases. We also show that training a model on a single image is particularly relevant for image acquisition modality that differ from the RGB images of standard learning databases. We show results in three different contexts: texture images, line drawing images, and materials BRDF, for which we achieve state-of-the-art results in terms of realism, with a computational load that is greatly reduced compared to concurrent methods.


title: CDMamba: Remote Sensing Image Change Detection with Mamba

abstract: Recently, the Mamba architecture based on state space models has demonstrated remarkable performance in a series of natural language processing tasks and has been rapidly applied to remote sensing change detection (CD) tasks. However, most methods enhance the global receptive field by directly modifying the scanning mode of Mamba, neglecting the crucial role that local information plays in dense prediction tasks (e.g., CD). In this article, we propose a model called CDMamba, which effectively combines global and local features for handling CD tasks. Specifically, the Scaled Residual ConvMamba (SRCM) block is proposed to utilize the ability of Mamba to extract global features and convolution to enhance the local details, to alleviate the issue that current Mamba-based methods lack detailed clues and are difficult to achieve fine detection in dense prediction tasks. Furthermore, considering the characteristics of bi-temporal feature interaction required for CD, the Adaptive Global Local Guided Fusion (AGLGF) block is proposed to dynamically facilitate the bi-temporal interaction guided by other temporal global/local features. Our intuition is that more discriminative change features can be acquired with the guidance of other temporal features. Extensive experiments on three datasets demonstrate that our proposed CDMamba outperforms the current state-of-the-art methods. Our code will be open-sourced at https://github.com/zmoka-zht/CDMamba.


title: Aligning Agents like Large Language Models

abstract: Training agents to behave as desired in complex 3D environments from high-dimensional sensory information is challenging. Imitation learning from diverse human behavior provides a scalable approach for training an agent with a sensible behavioral prior, but such an agent may not perform the specific behaviors of interest when deployed. To address this issue, we draw an analogy between the undesirable behaviors of imitation learning agents and the unhelpful responses of unaligned large language models (LLMs). We then investigate how the procedure for aligning LLMs can be applied to aligning agents in a 3D environment from pixels. For our analysis, we utilize an academically illustrative part of a modern console game in which the human behavior distribution is multi-modal, but we want our agent to imitate a single mode of this behavior. We demonstrate that we can align our agent to consistently perform the desired mode, while providing insights and advice for successfully applying this approach to training agents. Project webpage at https://adamjelley.github.io/aligning-agents-like-llms .


title: Controlling wall particle interactions with activity

abstract: We calculate the effective forces on hard disks near walls embedded inside active nematic liquid crystals. When the disks are sufficiently close to the wall and the flows are sufficiently slow, we can obtain exact expressions for the effective forces. We find these forces and the dynamics of disks near the wall depend both on the properties of the active nematic and on the anchoring conditions on the disks and the wall. Our results show that the presence of active stresses attract planar anchored disks to walls if the activity is extensile, and repel them if contractile. For normal anchored disks the reverse is true; they are attracted in contractile systems, and repelled in extensile ones.


title: Gaining Cross-Platform Parallelism for HAL's Molecular Dynamics Package using SYCL

abstract: Molecular dynamics simulations are one of the methods in scientific computing that benefit from GPU acceleration. For those devices, SYCL is a promising API for writing portable codes. In this paper, we present the case study of "HAL's MD package" that has been successfully migrated from CUDA to SYCL. We describe the different strategies that we followed in the process of porting the code. Following these strategies, we achieved code portability across major GPU vendors. Depending on the actual kernels, both significant performance improvements and regressions are observed. As a side effect of the migration process, we obtained impressing speedups also for execution on CPUs.


title: Stirling permutation codes. II

abstract: In the context of Stirling polynomials, Gessel and Stanley introduced the definition of Stirling permutation, which has attracted extensive attention over the past decades. Recently, we introduced Stirling permutation code and provided numerous equidistribution results as applications. The purpose of the present work is to further analyse Stirling permutation code. First, we derive an expansion formula expressing the joint distribution of the types $A$ and $B$ descent statistics over the hyperoctahedral group, and we also find an interlacing property involving the zeros of its coefficient polynomials. Next, we prove a strong connection between signed permutations in the hyperoctahedral group and Stirling permutations. Furthermore, we investigate unified generalizations of the trivariate second-order Eulerian polynomials and ascent-plateau polynomials. Using Stirling permutation codes, we provide expansion formulas for eight-variable and seventeen-variable polynomials, which imply several $e$-positive expansions and clarify the connections among several statistics. Our results generalize the results of B\'ona, Chen-Fu, Dumont, Janson, Haglund-Visontai and Petersen.


title: Sound Event Bounding Boxes

abstract: Sound event detection is the task of recognizing sounds and determining their extent (onset/offset times) within an audio clip. Existing systems commonly predict sound presence confidence in short time frames. Then, thresholding produces binary frame-level presence decisions, with the extent of individual events determined by merging consecutive positive frames. In this paper, we show that frame-level thresholding degrades the prediction of the event extent by coupling it with the system's sound presence confidence. We propose to decouple the prediction of event extent and confidence by introducing SEBBs, which format each sound event prediction as a tuple of a class type, extent, and overall confidence. We also propose a change-detection-based algorithm to convert legacy frame-level outputs into SEBBs. We find the algorithm significantly improves the performance of DCASE 2023 Challenge systems, boosting the state of the art from .644 to .686 PSDS1.


title: Systematic analysis of jellyfish galaxy candidates in Fornax, Antlia, and Hydra from the S-PLUS survey: A self-supervised visual identification aid

abstract: We study 51 jellyfish galaxy candidates in the Fornax, Antlia, and Hydra clusters. These candidates are identified using the JClass scheme based on the visual classification of wide-field, twelve-band optical images obtained from the Southern Photometric Local Universe Survey. A comprehensive astrophysical analysis of the jellyfish (JClass > 0), non-jellyfish (JClass = 0), and independently organized control samples is undertaken. We develop a semi-automated pipeline using self-supervised learning and similarity search to detect jellyfish galaxies. The proposed framework is designed to assist visual classifiers by providing more reliable JClasses for galaxies. We find that jellyfish candidates exhibit a lower Gini coefficient, higher entropy, and a lower 2D S\'ersic index as the jellyfish features in these galaxies become more pronounced. Jellyfish candidates show elevated star formation rates (including contributions from the main body and tails) by $\sim$1.75 dex, suggesting a significant increase in the SFR caused by the ram-pressure stripping phenomenon. Galaxies in the Antlia and Fornax clusters preferentially fall towards the cluster's centre, whereas only a mild preference is observed for Hydra galaxies. Our self-supervised pipeline, applied in visually challenging cases, offers two main advantages: it reduces human visual biases and scales effectively for large datasets. This versatile framework promises substantial enhancements in morphology studies for future galaxy image surveys.


title: ValueBench: Towards Comprehensively Evaluating Value Orientations and Understanding of Large Language Models

abstract: Large Language Models (LLMs) are transforming diverse fields and gaining increasing influence as human proxies. This development underscores the urgent need for evaluating value orientations and understanding of LLMs to ensure their responsible integration into public-facing applications. This work introduces ValueBench, the first comprehensive psychometric benchmark for evaluating value orientations and value understanding in LLMs. ValueBench collects data from 44 established psychometric inventories, encompassing 453 multifaceted value dimensions. We propose an evaluation pipeline grounded in realistic human-AI interactions to probe value orientations, along with novel tasks for evaluating value understanding in an open-ended value space. With extensive experiments conducted on six representative LLMs, we unveil their shared and distinctive value orientations and exhibit their ability to approximate expert conclusions in value-related extraction and generation tasks. ValueBench is openly accessible at https://github.com/Value4AI/ValueBench.


title: mCSQA: Multilingual Commonsense Reasoning Dataset with Unified Creation Strategy by Language Models and Humans

abstract: It is very challenging to curate a dataset for language-specific knowledge and common sense in order to evaluate natural language understanding capabilities of language models. Due to the limitation in the availability of annotators, most current multilingual datasets are created through translation, which cannot evaluate such language-specific aspects. Therefore, we propose Multilingual CommonsenseQA (mCSQA) based on the construction process of CSQA but leveraging language models for a more efficient construction, e.g., by asking LM to generate questions/answers, refine answers and verify QAs followed by reduced human efforts for verification. Constructed dataset is a benchmark for cross-lingual language-transfer capabilities of multilingual LMs, and experimental results showed high language-transfer capabilities for questions that LMs could easily solve, but lower transfer capabilities for questions requiring deep knowledge or commonsense. This highlights the necessity of language-specific datasets for evaluation and training. Finally, our method demonstrated that multilingual LMs could create QA including language-specific knowledge, significantly reducing the dataset creation cost compared to manual creation. The datasets are available at https://huggingface.co/datasets/yusuke1997/mCSQA.