title: MotionGS : Compact Gaussian Splatting SLAM by Motion Filter

abstract: With their high-fidelity scene representation capability, the attention of SLAM field is deeply attracted by the Neural Radiation Field (NeRF) and 3D Gaussian Splatting (3DGS). Recently, there has been a surge in NeRF-based SLAM, while 3DGS-based SLAM is sparse. A novel 3DGS-based SLAM approach with a fusion of deep visual feature, dual keyframe selection and 3DGS is presented in this paper. Compared with the existing methods, the proposed tracking is achieved by feature extraction and motion filter on each frame. The joint optimization of poses and 3D Gaussians runs through the entire mapping process. Additionally, the coarse-to-fine pose estimation and compact Gaussian scene representation are implemented by dual keyframe selection and novel loss functions. Experimental results demonstrate that the proposed algorithm not only outperforms the existing methods in tracking and mapping, but also has less memory usage.


title: WIP: A Unit Testing Framework for Self-Guided Personalized Online Robotics Learning

abstract: Our ongoing development and deployment of an online robotics education platform highlighted a gap in providing an interactive, feedback-rich learning environment essential for mastering programming concepts in robotics, which they were not getting with the traditional code-simulate-turn in workflow. Since teaching resources are limited, students would benefit from feedback in real-time to find and fix their mistakes in the programming assignments. To address these concerns, this paper will focus on creating a system for unit testing while integrating it into the course workflow. We facilitate this real-time feedback by including unit testing in the design of programming assignments so students can understand and fix their errors on their own and without the prior help of instructors/TAs serving as a bottleneck. In line with the framework's personalized student-centered approach, this method makes it easier for students to revise, and debug their programming work, encouraging hands-on learning. The course workflow updated to include unit tests will strengthen the learning environment and make it more interactive so that students can learn how to program robots in a self-guided fashion.


title: Gallium Nitride (GaN) based High-Power Multilevel H-Bridge Inverter for Wireless Power Transfer of Electric Vehicles

abstract: This paper presents a design and implementation of a high-power Gallium Nitride (GaN)-based multilevel Hbridge inverter to excite wireless charging coils for the wireless power transfer of electric vehicles (EVs). Compared to the traditional conductive charging, wireless charging technology offers a safer and more convenient way to charge EVs. Due to the increasing demand of fast charging, high-power inverters play a crucial role in exciting the wireless charging coils within a wireless power transfer system. This paper details the system specifications for the wireless charging of EVs, providing theoretical analysis and a control strategy for the modular design of a 75-kW 3-level and 4-level Hbridge inverter. The goal is to deliver a low-distortion excitation voltage to the wireless charging coils. LTspice simulation results, including output voltage, Fast Fourier Transform (FFT) analysis for both 3-level and 4-level H-bridge inverters, are presented to validate the control strategy and demonstrate the elimination of output harmonic components in the modular design. A GaNbased inverter prototype was employed to deliver a 85-kHz power to the wireless charging pads of the wireless power transfer system. Experimental results at two different voltage and power levels, 100V-215W and 150V-489W, validate the successful performance of the GaN inverter in the wireless charging system.


title: Quadratic twists of tiling number elliptic curves

abstract: A positive integer $n$ is called a tiling number if the equilateral triangle can be dissected into $nk^2$ congruent triangles for some integer $k$. An integer $n>3$ is tiling number if and only if at least one of the elliptic curves $E^{(\pm n)}:\pm ny^2=x(x-1)(x+3)$ has positive Mordell-Weil rank. Let $A$ denote one of the two curves. In this paper, using Waldspurger formula and an induction method, for $n\equiv 3,7\mod 24$ positive square-free, as well as some other residue classes, we express the parity of analytic Sha of $A$ in terms of the genus number $g(m):=\#2\mathrm{Cl}(\mathbb{Q}(\sqrt{-m}))$ as $m$ runs over factors of $n$. Together with $2$-descent method which express $\mathrm{dim}_{\mathbb{F}_2}\mathrm{Sel}_2(A/\mathbb{Q})/A[2]$ in terms of the corank of a matrix of $\mathbb{F}_2$-coefficients, we show that for $n\equiv 3,7\mod 24$ positive square-free, the analytic Sha of $A$ being odd is equivalent to that $\mathrm{Sel}_2(A/\mathbb{Q})/A[2]$ being trivial, as predicted by the BSD conjecture. We also show that, among the residue classes $3$, resp. $7\mod 24$, the subset of $n$ such that both of $E^{(n)}$ and $E^{(-n)}$ have analytic Sha odd is of limit density $0.288\cdots$ and $0.144\cdots$, respectively, in particular, they are non-tiling numbers. This exhibits two new phenomena on tiling number elliptic curves: firstly, the limit density is different from the general phenomenon on elliptic curves predicted by Bhargava-Kane-Lenstra-Poonen-Rains; secondly, the joint distribution has different behavior among different residue classes.


title: XCAT-3.0: A Comprehensive Library of Personalized Digital Twins Derived from CT Scans

abstract: Virtual Imaging Trials (VIT) offer a cost-effective and scalable approach for evaluating medical imaging technologies. Computational phantoms, which mimic real patient anatomy and physiology, play a central role in VIT. However, the current libraries of computational phantoms face limitations, particularly in terms of sample size and diversity. Insufficient representation of the population hampers accurate assessment of imaging technologies across different patient groups. Traditionally, phantoms were created by manual segmentation, which is a laborious and time-consuming task, impeding the expansion of phantom libraries. This study presents a framework for realistic computational phantom modeling using a suite of four deep learning segmentation models, followed by three forms of automated organ segmentation quality control. Over 2500 computational phantoms with up to 140 structures illustrating a sophisticated approach to detailed anatomical modeling are released. Phantoms are available in both voxelized and surface mesh formats. The framework is aggregated with an in-house CT scanner simulator to produce realistic CT images. The framework can potentially advance virtual imaging trials, facilitating comprehensive and reliable evaluations of medical imaging technologies. Phantoms may be requested at https://cvit.duke.edu/resources/, code, model weights, and sample CT images are available at https://xcat-3.github.io.


title: On M\=adhava and his correction terms for the M\=adhava-Leibniz series for $\pi$

abstract: This paper is intended to serve two purposes: one, to present an account of the life of Sangamagr\=ama M\=adhava, the founder of the Kerala school of astronomy and mathematics which flourished during the 15th - 18th centuries, based on modern historical scholarship and two, to present a critical study of the three enigmatic correction terms, attributed to M\=adhava, for obtaining more accurate values of $\pi$ while computing its value using the M\=adhava-Leibniz series. For the second purpose, we have collected together the original Sanskrit verses describing the correction terms, their English translations and their presentations in modern notations. The Kerala rationale for these correction terms are also critically examined. The general conclusion in this regard is that, even though the correction terms give high precision approximations to the value of $\pi$, the rationale presented by Kerala authors is not strong enough to convince modern mathematical scholarship. The author has extended M\=adhava's results by presenting higher order correction terms which yield better approximations to $\pi$ than the correction terms attributed to M\=adhava. The various infinite series representations of $\pi$ obtained by M\=adhava and his disciples from the basic M\=adhava-Leibniz series using M\=adhava's correction terms are also discussed. A few more such series representations using the better correction terms developed by the author are also presented. The various conjectures regarding how M\=adhava might have originally arrived at the correction terms are also discussed in the paper.


title: AquaLoRA: Toward White-box Protection for Customized Stable Diffusion Models via Watermark LoRA

abstract: Diffusion models have achieved remarkable success in generating high-quality images. Recently, the open-source models represented by Stable Diffusion (SD) are thriving and are accessible for customization, giving rise to a vibrant community of creators and enthusiasts. However, the widespread availability of customized SD models has led to copyright concerns, like unauthorized model distribution and unconsented commercial use. To address it, recent works aim to let SD models output watermarked content for post-hoc forensics. Unfortunately, none of them can achieve the challenging white-box protection, wherein the malicious user can easily remove or replace the watermarking module to fail the subsequent verification. For this, we propose \texttt{\method} as the first implementation under this scenario. Briefly, we merge watermark information into the U-Net of Stable Diffusion Models via a watermark Low-Rank Adaptation (LoRA) module in a two-stage manner. For watermark LoRA module, we devise a scaling matrix to achieve flexible message updates without retraining. To guarantee fidelity, we design Prior Preserving Fine-Tuning (PPFT) to ensure watermark learning with minimal impacts on model distribution, validated by proofs. Finally, we conduct extensive experiments and ablation studies to verify our design.


title: An Inverse Theorem for the Perron--Frobenius Theorem

abstract: The Perron--Frobenius theorem in infinite-dimensional Hilbert spaces can be breifly stated as follows: Given a Hilbert cone in a real Hilbert space, a bounded positive self-adjoint operator $A$ is ergodic with respect to this cone if and only if the maximum eigenvalue $\|A\|$ of $A$ is simple, and the corresponding eigenvector is strictly positive with respect to this cone. This paper addresses the inverse problem of the Perron--Frobenius theorem: Does there exist a Hilbert cone such that a given bounded positive self-adjoint operator $A$ becomes ergodic when its maximum eigenvalue $\|A\|$ is simple? We provide an affirmative answer to this question in this paper. Furthermore, we conduct a detailed analysis of a specialized Hilbert cone introduced to obtain this result. Additionally, we provide an illustrative example of an application of the obtained results to the heat semigroup generated by the magnetic Schr\"odinger operator


title: Slow entropy and variational dynamical systems

abstract: We define variational properties for dynamical systems with subexponential complexity, and study these properties in certain specific examples. By computing the value of slow entropy directly, we show that Sturmian systems are not variational, while a class of interval exchange transformations are variational


title: Spatial Models for Crowdsourced Internet Access Network Performance Measurements

abstract: Despite significant investments in access network infrastructure, universal access to high-quality Internet connectivity remains a challenge. Policymakers often rely on large-scale, crowdsourced measurement datasets to assess the distribution of access network performance across geographic areas. These decisions typically rest on the assumption that Internet performance is uniformly distributed within predefined social boundaries, such as zip codes, census tracts, or community areas. However, this assumption may not be valid for two reasons: (1) crowdsourced measurements often exhibit non-uniform sampling densities within geographic areas; and (2) predefined social boundaries may not align with the actual boundaries of Internet infrastructure. In this paper, we model Internet performance as a spatial process. We apply and evaluate a series of statistical techniques to: (1) aggregate Internet performance over a geographic region; (2) overlay interpolated maps with various sampling boundary choices; and (3) spatially cluster boundary units to identify areas with similar performance characteristics. We evaluated the effectiveness of these using a 17-month-long crowdsourced dataset from Ookla Speedtest. We evaluate several leading interpolation methods at varying spatial scales. Further, we examine the similarity between the resulting boundaries for smaller realizations of the dataset. Our findings suggest that our combination of techniques achieves a 56% gain in similarity score over traditional methods that rely on aggregates over raw measurement values for performance summarization. Our work highlights an urgent need for more sophisticated strategies in understanding and addressing Internet access disparities.


title: RuleFuser: Injecting Rules in Evidential Networks for Robust Out-of-Distribution Trajectory Prediction

abstract: Modern neural trajectory predictors in autonomous driving are developed using imitation learning (IL) from driving logs. Although IL benefits from its ability to glean nuanced and multi-modal human driving behaviors from large datasets, the resulting predictors often struggle with out-of-distribution (OOD) scenarios and with traffic rule compliance. On the other hand, classical rule-based predictors, by design, can predict traffic rule satisfying behaviors while being robust to OOD scenarios, but these predictors fail to capture nuances in agent-to-agent interactions and human driver's intent. In this paper, we present RuleFuser, a posterior-net inspired evidential framework that combines neural predictors with classical rule-based predictors to draw on the complementary benefits of both, thereby striking a balance between performance and traffic rule compliance. The efficacy of our approach is demonstrated on the real-world nuPlan dataset where RuleFuser leverages the higher performance of the neural predictor in in-distribution (ID) scenarios and the higher safety offered by the rule-based predictor in OOD scenarios.


title: Microstructured optical fibres for quantum applications: perspective

abstract: Recent progress in the development and applications of microstructured optical fibres for quantum technologies is summarised. The optical nonlinearity of solid-core and gas-filled hollow-core fibres provides a valuable medium for the generation of quantum resource states, as well as for quantum frequency conversion between the operating wavelengths of existing quantum photonic material architectures. The low loss, low latency and low dispersion of hollow-core fibres make these fibres particularly attractive for both short- and long-distance links in quantum networks. Hollow-core fibres also promise to replace free-space optical components in a wide range of atomic experiments.


title: Enhancing Automata Learning with Statistical Machine Learning: A Network Security Case Study

abstract: Intrusion detection systems are crucial for network security. Verification of these systems is complicated by various factors, including the heterogeneity of network platforms and the continuously changing landscape of cyber threats. In this paper, we use automata learning to derive state machines from network-traffic data with the objective of supporting behavioural verification of intrusion detection systems. The most innovative aspect of our work is addressing the inability to directly apply existing automata learning techniques to network-traffic data due to the numeric nature of such data. Specifically, we use interpretable machine learning (ML) to partition numeric ranges into intervals that strongly correlate with a system's decisions regarding intrusion detection. These intervals are subsequently used to abstract numeric ranges before automata learning. We apply our ML-enhanced automata learning approach to a commercial network intrusion detection system developed by our industry partner, RabbitRun Technologies. Our approach results in an average 67.5% reduction in the number of states and transitions of the learned state machines, while achieving an average 28% improvement in accuracy compared to using expertise-based numeric data abstraction. Furthermore, the resulting state machines help practitioners in verifying system-level security requirements and exploring previously unknown system behaviours through model checking and temporal query checking. We make our implementation and experimental data available online.


title: Selling Correlated Information Products

abstract: How do consultants price expertise? This paper studies a problem of selling information products (expertise) to a buyer (client) who faces decision-making problem under uncertainty. The client is privately informed about the type of expertise she needs and her willingness to pay (WTP) for additional information. A monopolist seller (consultant) designs and sells information products as Blackwell experiments over the underlying states associated with each client-specific desired expertise. Because there is correlation across states, a client with high WTP may find it profitable to purchase information about a low type's state, whenever correlation is sufficiently high. I find that the consultant can extract full (socially efficient) surplus whenever such (marginal) gains do not exceed the (marginal) costs of buying cheaper, but noisier information. Otherwise, unlike typical results in mechanism design, I find that buyers with low and sufficiently high value for information get no information rents, and only the "middle" types enjoy positive surplus. Common pricing structures observed in practice, like flat/hourly rates or value-based fees, are obtained as optimal contracts if correlation across states is sufficiently high or low, respectively.


title: OpenRLHF: An Easy-to-use, Scalable and High-performance RLHF Framework

abstract: As large language models (LLMs) continue to grow by scaling laws, reinforcement learning from human feedback (RLHF) has gained significant attention due to its outstanding performance. However, unlike pretraining or fine-tuning a single model, scaling reinforcement learning from human feedback (RLHF) for training large language models poses coordination challenges across four models. We present OpenRLHF, an open-source framework enabling efficient RLHF scaling. Unlike existing RLHF frameworks that co-locate four models on the same GPUs, OpenRLHF re-designs scheduling for the models beyond 70B parameters using Ray, vLLM, and DeepSpeed, leveraging improved resource utilization and diverse training approaches. Integrating seamlessly with Hugging Face, OpenRLHF provides an out-of-the-box solution with optimized algorithms and launch scripts, which ensures user-friendliness. OpenRLHF implements RLHF, DPO, rejection sampling, and other alignment techniques. Empowering state-of-the-art LLM development, OpenRLHF's code is available at https://github.com/OpenLLMAI/OpenRLHF.


title: On \'Sankara Varman's (correct) and M\=adhava's (incorrect) values for the circumferences of circles

abstract: This paper examines what computational procedures \'Sankara Varman (1774-1839) and Sangamagrama M\=adhava (c. 1340 - 1425), astronomer-mathematicians of the Kerala school, might have used to arrive at their respective values for the circumferences of certain special circles (a circle of diameter $10^{17}$ by the former and a circle of diameter $9\times 10^{11}$ by the latter). It is shown that if we choose the M\=adhava-Gregory series for $\tfrac{\pi}{6}=\arctan (\tfrac{1}{\sqrt{3}})$ to compute $\pi$ and then use it compute the circumference of a circle of diameter $10^{17}$ and perform the computations by ignoring the fractional parts in the results of every operation we get the value stated by \'Sankara Varman. It is also shown that, except in an unlikely case, none of the series representations of $\pi$ attributed to M\=adhava produce the value for the circumference attributed to him. The question how M\=adhava did arrive at his value still remains unanswered.


title: Detecting Multimodal Situations with Insufficient Context and Abstaining from Baseless Predictions

abstract: Despite the widespread adoption of Vision-Language Understanding (VLU) benchmarks such as VQA v2, OKVQA, A-OKVQA, GQA, VCR, SWAG, and VisualCOMET, our analysis reveals a pervasive issue affecting their integrity: these benchmarks contain samples where answers rely on assumptions unsupported by the provided context. Training models on such data foster biased learning and hallucinations as models tend to make similar unwarranted assumptions. To address this issue, we collect contextual data for each sample whenever available and train a context selection module to facilitate evidence-based model predictions. Strong improvements across multiple benchmarks demonstrate the effectiveness of our approach. Further, we develop a general-purpose Context-AwaRe Abstention (CARA) detector to identify samples lacking sufficient context and enhance model accuracy by abstaining from responding if the required context is absent. CARA exhibits generalization to new benchmarks it wasn't trained on, underscoring its utility for future VLU benchmarks in detecting or cleaning samples with inadequate context. Finally, we curate a Context Ambiguity and Sufficiency Evaluation (CASE) set to benchmark the performance of insufficient context detectors. Overall, our work represents a significant advancement in ensuring that vision-language models generate trustworthy and evidence-based outputs in complex real-world scenarios.


title: Election Polls on Social Media: Prevalence, Biases, and Voter Fraud Beliefs

abstract: Social media platforms allow users to create polls to gather public opinion on diverse topics. However, we know little about what such polls are used for and how reliable they are, especially in significant contexts like elections. Focusing on the 2020 presidential elections in the U.S., this study shows that outcomes of election polls on Twitter deviate from election results despite their prevalence. Leveraging demographic inference and statistical analysis, we find that Twitter polls are disproportionately authored by older males and exhibit a large bias towards candidate Donald Trump relative to representative mainstream polls. We investigate potential sources of biased outcomes from the point of view of inauthentic, automated, and counter-normative behavior. Using social media experiments and interviews with poll authors, we identify inconsistencies between public vote counts and those privately visible to poll authors, with the gap potentially attributable to purchased votes. We also find that Twitter accounts participating in election polls are more likely to be bots, and election poll outcomes tend to be more biased, before the election day than after. Finally, we identify instances of polls spreading voter fraud conspiracy theories and estimate that a couple thousand of such polls were posted in 2020. The study discusses the implications of biased election polls in the context of transparency and accountability of social media platforms.


title: Norm bounds for self-adjoint Toeplitz operators with non-radial symbols on the Fock space

abstract: In this paper we extend Galbis' elegant norm bounds for self-adjoint Toeplitz operators on the Fock space to bounded and integrable symbols which are non-radial. The main ingredients are a transplantation of the remarkable Nicola-Tilli isoperimetric inequality to the realm of Fock-Toeplitz operator theory and a two-dimensional adaption of Galbis' integration and approximation arguments.


title: Lattice renormings of $C_0(X)$ spaces

abstract: Suppose $X$ is a locally compact Polish space, and $G$ is a group of lattice isometries of $C_0(X)$ which satisfies certain conditions. Then we can equip $C_0(X)$ with an equivalent lattice norm $| \! | \! | \cdot | \! | \! |$ so that $G$ is the group of lattice isometries of $(C_0(X), | \! | \! | \cdot | \! | \! |)$. As an application, we show that for any locally compact Polish group $G$ there exists a locally compact Polish space $X$, and an lattice norm $| \! | \! | \cdot | \! | \! |$ on $C_0(X)$, so that $G$ is the group of lattice isometries of $(C_0(X), | \! | \! | \cdot | \! | \! |)$.


title: Artificial Greenhouse Gases as Exoplanet Technosignatures

abstract: Atmospheric pollutants such as CFCs and NO$_{2}$ have been proposed as potential remotely detectable atmospheric technosignature gases. Here we investigate the potential for artificial greenhouse gases including CF$_{4}$, C$_{2}$F$_{6}$, C$_{3}$F$_{8}$, SF$_{6}$, and NF$_{3}$ to generate detectable atmospheric signatures. In contrast to passive incidental byproducts of industrial processes, artificial greenhouse gases would represent an intentional effort to change the climate of a planet with long-lived, low toxicity gases and would possess low false positive potential. An extraterrestrial civilization may be motivated to undertake such an effort to arrest a predicted snowball state on their home world or to terraform an otherwise uninhabitable terrestrial planet within their system. Because artificial greenhouse gases strongly absorb in the thermal mid-infrared window of temperate atmospheres, a terraformed planet will logically possess strong absorption features from these gases at mid-IR wavelengths ($\sim$8-12 $\mu$m), possibly accompanied by diagnostic features in the near-IR. As a proof of concept, we calculate the needed observation time to detect 1 [10](100) ppm of C$_{2}$F$_{6}$/C$_{3}$F$_{8}$/SF$_{6}$ on TRAPPIST-1f with JWST MIRI/LRS and NIRSpec. We find that a combination of 1[10](100) ppm each of C$_{2}$F$_{6}$, C$_{3}$F$_{8}$, and SF$_{6}$ can be detected with an S/N $\geq$ 5 in as few as 25[10](5) transits with MIRI/LRS. We further explore mid-infrared direct-imaging scenarios with the LIFE mission concept and find these gases are more detectable than standard biosignatures at these concentrations. Consequently, artificial greenhouse gases can be readily detected (or excluded) during normal planetary characterization observations with no additional overhead.


title: Enforcing exact permutation and rotational symmetries in the application of quantum neural network on point cloud datasets

abstract: Recent developments in the field of quantum machine learning have promoted the idea of incorporating physical symmetries in the structure of quantum circuits. A crucial milestone in this area is the realization of $S_{n}$-permutation equivariant quantum neural networks (QNN) that are equivariant under permutations of input objects. In this work, we focus on encoding the rotational symmetry of point cloud datasets into the QNN. The key insight of the approach is that all rotationally invariant functions with vector inputs are equivalent to a function with inputs of vector inner products. We provide a novel structure of QNN that is exactly invariant to both rotations and permutations, with its efficacy demonstrated numerically in the problems of two-dimensional image classifications and identifying high-energy particle decays, produced by proton-proton collisions, with the $SO(1,3)$ Lorentz symmetry.


title: Multi-scale Information Sharing and Selection Network with Boundary Attention for Polyp Segmentation

abstract: Polyp segmentation for colonoscopy images is of vital importance in clinical practice. It can provide valuable information for colorectal cancer diagnosis and surgery. While existing methods have achieved relatively good performance, polyp segmentation still faces the following challenges: (1) Varying lighting conditions in colonoscopy and differences in polyp locations, sizes, and morphologies. (2) The indistinct boundary between polyps and surrounding tissue. To address these challenges, we propose a Multi-scale information sharing and selection network (MISNet) for polyp segmentation task. We design a Selectively Shared Fusion Module (SSFM) to enforce information sharing and active selection between low-level and high-level features, thereby enhancing model's ability to capture comprehensive information. We then design a Parallel Attention Module (PAM) to enhance model's attention to boundaries, and a Balancing Weight Module (BWM) to facilitate the continuous refinement of boundary segmentation in the bottom-up process. Experiments on five polyp segmentation datasets demonstrate that MISNet successfully improved the accuracy and clarity of segmentation result, outperforming state-of-the-art methods.


title: Operator systems, contextuality and non-locality

abstract: We introduce an operator system, universal for the probabilistic models of a contextuality scenario, and identify its maximal C*-cover as the right C*-algebra of a canonical ternary ring of operators, arising from a hypergraph version of stochastic operator matrices. We study dilating contextuality scenarios, which have the property that each positive operator representation thereof admits a dilation to a projective representation on a larger Hilbert space, and characterise them via the equality of the aforementioned universal operator system and the operator system arising from the canonical generators of the respective hypergraph C*-algebra. We characterise the no-signalling probabilistic models over a pair of contextuality scenarios of different types, which arise from either the positive operator representations or from the projective representations of these scenarios, in terms of states on operator system tensor products. Generalising the notion of a synchronous no-signalling correlation to the hypergraph framework, we define coherent probabilistic models associated with a given contextuality scenario and characterise various classes thereof via different types of traces of the hypergraph C*-algebra, associated with the scenario. We establish several equivalent formulations of the Connes Embedding Problem in terms of no-signalling probabilistic models and hypergraph operator systems.


title: Dual-color Coherent Perfect Absorber

abstract: Perfect absorption of light critically affects light-matter interaction for various applications. Coherent perfect absorbers (CPA) gain the unique capability of controlling light with light in a linear fashion. Multi-color CPAs [Phys. Rev. Lett. 107, 033901] are highly desirable for broadband and nonlinear light-to-light coherent control, however, the experimental demonstration has still remained elusive. Here we experimentally observe a dual-color version of CPA (DC-CPA) through a second harmonic generation in a single whispering-gallery-mode microcavity. The DC-CPA enables simultaneous perfect absorption of both the incoming fundamental wave and its second harmonic. Similar to its linear counterpart, coherent control in the DC-CPA can be also realized by tuning the relative phase and intensity between the two-colored waves through nonlinear interference instead of the linear one. This scheme breaks the linear boundary of the traditional CPA into a multi-frequency domain and paves the way toward all-optically signal processing and quantum information.


title: Revisiting the Robust Generalization of Adversarial Prompt Tuning

abstract: Understanding the vulnerability of large-scale pre-trained vision-language models like CLIP against adversarial attacks is key to ensuring zero-shot generalization capacity on various downstream tasks. State-of-the-art defense mechanisms generally adopt prompt learning strategies for adversarial fine-tuning to improve the adversarial robustness of the pre-trained model while keeping the efficiency of adapting to downstream tasks. Such a setup leads to the problem of over-fitting which impedes further improvement of the model's generalization capacity on both clean and adversarial examples. In this work, we propose an adaptive Consistency-guided Adversarial Prompt Tuning (i.e., CAPT) framework that utilizes multi-modal prompt learning to enhance the alignment of image and text features for adversarial examples and leverage the strong generalization of pre-trained CLIP to guide the model-enhancing its robust generalization on adversarial examples while maintaining its accuracy on clean ones. We also design a novel adaptive consistency objective function to balance the consistency of adversarial inputs and clean inputs between the fine-tuning model and the pre-trained model. We conduct extensive experiments across 14 datasets and 4 data sparsity schemes (from 1-shot to full training data settings) to show the superiority of CAPT over other state-of-the-art adaption methods. CAPT demonstrated excellent performance in terms of the in-distribution performance and the generalization under input distribution shift and across datasets.


title: Inner-approximate Reachability Computation via Zonotopic Boundary Analysis

abstract: Inner-approximate reachability analysis involves calculating subsets of reachable sets, known as inner-approximations. This analysis is crucial in the fields of dynamic systems analysis and control theory as it provides a reliable estimation of the set of states that a system can reach from given initial states at a specific time instant. In this paper, we study the inner-approximate reachability analysis problem based on the set-boundary reachability method for systems modelled by ordinary differential equations, in which the computed inner-approximations are represented with zonotopes. The set-boundary reachability method computes an inner-approximation by excluding states reached from the initial set's boundary. The effectiveness of this method is highly dependent on the efficient extraction of the exact boundary of the initial set. To address this, we propose methods leveraging boundary and tiling matrices that can efficiently extract and refine the exact boundary of the initial set represented by zonotopes. Additionally, we enhance the exclusion strategy by contracting the outer-approximations in a flexible way, which allows for the computation of less conservative inner-approximations. To evaluate the proposed method, we compare it with state-of-the-art methods against a series of benchmarks. The numerical results demonstrate that our method is not only efficient but also accurate in computing inner-approximations.


title: A Randomized Permutation Whole-Model Test Heuristic for Self-Validated Ensemble Models (SVEM)

abstract: We introduce a heuristic to test the significance of fit of Self-Validated Ensemble Models (SVEM) against the null hypothesis of a constant response. A SVEM model averages predictions from nBoot fits of a model, applied to fractionally weighted bootstraps of the target dataset. It tunes each fit on a validation copy of the training data, utilizing anti-correlated weights for training and validation. The proposed test computes SVEM predictions centered by the response column mean and normalized by the ensemble variability at each of nPoint points spaced throughout the factor space. A reference distribution is constructed by refitting the SVEM model to nPerm randomized permutations of the response column and recording the corresponding standardized predictions at the nPoint points. A reduced-rank singular value decomposition applied to the centered and scaled nPerm x nPoint reference matrix is used to calculate the Mahalanobis distance for each of the nPerm permutation results as well as the jackknife (holdout) Mahalanobis distance of the original response column. The process is repeated independently for each response in the experiment, producing a joint graphical summary. We present a simulation driven power analysis and discuss limitations of the test relating to model flexibility and design adequacy. The test maintains the nominal Type I error rate even when the base SVEM model contains more parameters than observations.


title: Towards Modular LLMs by Building and Reusing a Library of LoRAs

abstract: The growing number of parameter-efficient adaptations of a base large language model (LLM) calls for studying whether we can reuse such trained adapters to improve performance for new tasks. We study how to best build a library of adapters given multi-task data and devise techniques for both zero-shot and supervised task generalization through routing in such library. We benchmark existing approaches to build this library and introduce model-based clustering, MBC, a method that groups tasks based on the similarity of their adapter parameters, indirectly optimizing for transfer across the multi-task dataset. To re-use the library, we present a novel zero-shot routing mechanism, Arrow, which enables dynamic selection of the most relevant adapters for new inputs without the need for retraining. We experiment with several LLMs, such as Phi-2 and Mistral, on a wide array of held-out tasks, verifying that MBC-based adapters and Arrow routing lead to superior generalization to new tasks. We make steps towards creating modular, adaptable LLMs that can match or outperform traditional joint training.


title: Dusk Till Dawn: Self-supervised Nighttime Stereo Depth Estimation using Visual Foundation Models

abstract: Self-supervised depth estimation algorithms rely heavily on frame-warping relationships, exhibiting substantial performance degradation when applied in challenging circumstances, such as low-visibility and nighttime scenarios with varying illumination conditions. Addressing this challenge, we introduce an algorithm designed to achieve accurate self-supervised stereo depth estimation focusing on nighttime conditions. Specifically, we use pretrained visual foundation models to extract generalised features across challenging scenes and present an efficient method for matching and integrating these features from stereo frames. Moreover, to prevent pixels violating photometric consistency assumption from negatively affecting the depth predictions, we propose a novel masking approach designed to filter out such pixels. Lastly, addressing weaknesses in the evaluation of current depth estimation algorithms, we present novel evaluation metrics. Our experiments, conducted on challenging datasets including Oxford RobotCar and Multi-Spectral Stereo, demonstrate the robust improvements realized by our approach. Code is available at: https://github.com/madhubabuv/dtd


title: Harnessing moir\'e ferroelectricity to modulate semiconductor monolayer light emission

abstract: Ferroelectricity has been recently discovered in stacked or twisted van der Waals (vdW) moir\'e systems. The versatility of producing a large array of size-tunable domains and integration with diverse functional materials make them an enticing platform for developing multifunctional devices. Here, we show that ferroelectric polar domains formed in a twisted hexagonal boron nitride (t-hBN) substrate can modulate light emission from an adjacent semiconductor monolayer. The abrupt change in electrostatic potential across the domains produces an in-plane electric field (E-field) and leads to a remarkably large exciton Stark shift in the adjacent MoSe$_2$ monolayer, previously only observable in \textit{p-n} junctions created by the advanced e-beam lithography tools. Both the spectrum and spatial pattern of the light emission from the monolayer are periodically modulated by the remote moir\'e potential imposed by the t-hBN substrate. We further observe a characteristic hysteresis behavior in the light emission as an electric gate erases and restores the domains. Our findings chart an exciting pathway for integrating nanometer-scale moir\'e ferroelectric domains with various optically active functional layers, paving the way for advanced nanophotonic applications.


title: Estimating Photometric Distances to Ultracool Dwarfs in Next Generation Space-based Infrared Surveys: Synthetic Photometry and New Absolute Magnitude Versus Spectral Type Relations for JWST, Euclid, and Roman Filters

abstract: We synthesize JWST NIRCam photometry for the F164N, F187N, F212N narrow filters, F140M, F162M, F182M, F210M medium filters, and F115W, F150W, F200W wide filters, Euclid Near Infrared Spectrometer and Photometer (NISP) photometry for the $Y_E J_E H_E$ filters, and Roman Wide Field Instrument (WFI) photometry for the F106, F129, F146, F158, F184 and F213 filters using SpeX prism spectra and parallaxes of 688 field-age and 151 young ($\lesssim$ 200 Myr) ultracool dwarfs (spectral types M6-T9). We derive absolute magnitude-spectral type polynomial relations that enable the calculation of photometric distances for ultracool dwarfs observed with JWST, and to be observed with Euclid and Roman, in the absence of parallax measurements. Additionally, using the synthesized photometry to generate color-color figures can help distinguish high-redshift galaxies from brown dwarf interlopers in survey datasets. In particular, anticipating the upcoming Euclid Early Release Observations, we provide synthetic Euclid colors for ultracool dwarfs in our sample.


title: Meta Reinforcement Learning for Resource Allocation in Unmanned Aerial Vehicles with MIMO Visible Light Communication

abstract: This paper centers around a multiple-input-multiple-output (MIMO) visible light communication (VLC) system, where an unmanned aerial vehicle (UAV) benefits from a light emitting diode (LED) array to serve photo-diode (PD)-equipped users for illumination and communication simultaneously. Concerning the battery limitation of the UAV and considerable energy consumption of the LED array, a hybrid dimming control scheme is devised at the UAV that effectively controls the number of glared LEDs and thereby mitigates the overall energy consumption. To assess the performance of this system, a radio resource allocation problem is accordingly formulated for jointly optimizing the motion trajectory, transmit beamforming and LED selection at the UAV, assuming that channel state information (CSI) is partially available. By reformulating the optimization problem in Markov decision process (MDP) form, we propose a soft actor-critic (SAC) mechanism that captures the dynamics of the problem and optimizes its parameters. Additionally, regarding the frequent mobility of the UAV and thus remarkable rearrangement of the system, we enhance the trained SAC model by integrating a meta-learning strategy that enables more adaptation to system variations. According to simulations, upgrading a single-LED UAV by an array of 10 LEDs, exhibits 47% and 34% improvements in data rate and energy efficiency, albeit at the expense of 8% more power consumption.


title: LG AI Research & KAIST at EHRSQL 2024: Self-Training Large Language Models with Pseudo-Labeled Unanswerable Questions for a Reliable Text-to-SQL System on EHRs

abstract: Text-to-SQL models are pivotal for making Electronic Health Records (EHRs) accessible to healthcare professionals without SQL knowledge. With the advancements in large language models, these systems have become more adept at translating complex questions into SQL queries. Nonetheless, the critical need for reliability in healthcare necessitates these models to accurately identify unanswerable questions or uncertain predictions, preventing misinformation. To address this problem, we present a self-training strategy using pseudo-labeled unanswerable questions to enhance the reliability of text-to-SQL models for EHRs. This approach includes a two-stage training process followed by a filtering method based on the token entropy and query execution. Our methodology's effectiveness is validated by our top performance in the EHRSQL 2024 shared task, showcasing the potential to improve healthcare decision-making through more reliable text-to-SQL systems.


title: Domain Generalization for Zero-calibration BCIs with Knowledge Distillation-based Phase Invariant Feature Extraction

abstract: The distribution shift of electroencephalography (EEG) data causes poor generalization of braincomputer interfaces (BCIs) in unseen domains. Some methods try to tackle this challenge by collecting a portion of user data for calibration. However, it is time-consuming, mentally fatiguing, and user-unfriendly. To achieve zerocalibration BCIs, most studies employ domain generalization (DG) techniques to learn invariant features across different domains in the training set. However, they fail to fully explore invariant features within the same domain, leading to limited performance. In this paper, we present an novel method to learn domain-invariant features from both interdomain and intra-domain perspectives. For intra-domain invariant features, we propose a knowledge distillation framework to extract EEG phase-invariant features within one domain. As for inter-domain invariant features, correlation alignment is used to bridge distribution gaps across multiple domains. Experimental results on three public datasets validate the effectiveness of our method, showcasing stateof-the-art performance. To the best of our knowledge, this is the first domain generalization study that exploit Fourier phase information as an intra-domain invariant feature to facilitate EEG generalization. More importantly, the zerocalibration BCI based on inter- and intra-domain invariant features has significant potential to advance the practical applications of BCIs in real world.


title: Theory of CP angles measurement

abstract: In the early 80's Sanda-san and collaborators wrote key papers on the direct and clean determination of the unitarity angle $\phi_1$ ($\beta$). This motivated many of us for analogously coming up with ways for direct and clean determinations of the other two unitarity angles, $\phi_2 (\alpha)$ and $\phi_3 (\gamma)$. Current status of these direct determinations as well as our expectations for when Belle-II has 50 $ab^{-1}$ of luminosity and LHCb with some upgrades, will be given. In particular, it is emphasized that for direct determination of $\phi_3$, Belle-II should be able to handle final states in $D^0$ or $\bar D^0$ Dalitz decays, that contain one $\pi^0$ (which are difficult for LHCb) then they may make further inroads in improving the accuracy of $\phi_3$ determination. Early lattice inputs for constraining the unitarity triangle (UT) are briefly recalled. Its crucial role in supporting the Kobayashi-Maskawa theory of CP violation is emphasized. Over the years lattice methods have made significant progress and latest constraints from these for the UT will be discussed as well as compatibility with current direct determinations and some comments on future outlook will be made.


title: Automated Multi-level Preference for MLLMs

abstract: Current multimodal Large Language Models (MLLMs) suffer from ``hallucination'', occasionally generating responses that are not grounded in the input images. To tackle this challenge, one promising path is to utilize reinforcement learning from human feedback (RLHF), which steers MLLMs towards learning superior responses while avoiding inferior ones. We rethink the common practice of using binary preferences (i.e., superior, inferior), and find that adopting multi-level preferences (e.g., superior, medium, inferior) is better for two benefits: 1) It narrows the gap between adjacent levels, thereby encouraging MLLMs to discern subtle differences. 2) It further integrates cross-level comparisons (beyond adjacent-level comparisons), thus providing a broader range of comparisons with hallucination examples. To verify our viewpoint, we present the Automated Multi-level Preference (AMP) framework for MLLMs. To facilitate this framework, we first develop an automated dataset generation pipeline that provides high-quality multi-level preference datasets without any human annotators. Furthermore, we design the Multi-level Direct Preference Optimization (MDPO) algorithm to robustly conduct complex multi-level preference learning. Additionally, we propose a new hallucination benchmark, MRHal-Bench. Extensive experiments across public hallucination and general benchmarks, as well as our MRHal-Bench, demonstrate the effectiveness of our proposed method. Code is available at https://github.com/takomc/amp.


title: Learning the liveability of cities from migrants: Combinatiorial-Hodge-theory approach

abstract: Migration is a major decision to leave one place and move to another, and involves job and life changes. The migration flow of people provides relational information across places about which is better to live by ``voting with their feet'' (Tiebout, 1956; Douglas, 1997). From the people's votes, in a ``democratic'' process, we quantify a descriptive statistic of liveable cities by a potential of migration flow in Combinatorial Hodge theory. As a case study, we measure the liveability of municipalities in Japan for specific populations such as families with small children and women of reproductive age. Using these potentials as dependent variables, we perform a regression analysis to identify the factors relevant to liveability. Additionally, using the aformentioned theoretical framework, we analytically derive the expression of the utility as a function of given flow data, which was numerically estimated in previous studies (Douglas & Wall, 1993; Douglas, 1997; Douglas & Wall, 2000; Wall, 2001; Nakajima & Tabuchi, 2011). The proposed method extracts a consistent metric of interval scale from the non-transitive, pairwise comparison between locations and provides valuable statistics for urban planning by policymakers.


title: On the Computation of Square Roots and Inverse Square Roots of Gram Matrices for Surface Integral Equations in Electromagnetics

abstract: Surface integral equations (SIEs)-based boundary element methods are widely used for analyzing electromagnetic scattering scenarii. However, after discretization of SIEs, the spectrum and eigenvectors of the boundary element matrices are not usually representative of the spectrum and eigenfunctions of the underlying surface integral operators, which can be problematic for methods that rely heavily on spectral properties. To address this issue, we delineate some efficient algorithms that allow for the computation of matrix square roots and inverse square roots of the Gram matrices corresponding to the discretization scheme, which can be used for revealing the spectrum of standard electromagnetic integral operators. The algorithms, which are based on properly chosen expansions of the square root and inverse square root functions, are quite effective when applied to several of the most relevant Gram matrices used for boundary element discretizations in electromagnetics. Tables containing different sets of expansion coefficients are provided along with comparative numerical experiments that evidence advantages and disadvantages of the different approaches. In addition, to demonstrate the spectrum-revealing properties of the proposed techniques, they are applied to the discretization of the problem of scattering by a sphere for which the analytic spectrum is known.


title: A fast and robust discrete FFT-based solver for computational homogenization

abstract: We propose a new discrete FFT-based method for computational homogenization of micromechanics on a regular grid that is simple, fast and robust. The discretization scheme is based on a tetrahedral stencil that displays three crucial properties. First, and most importantly, the Fourier representation of the associated Green operator is defined for any finite q-vector generated by the periodic boundary conditions and that does not belong to the Reciprocal Lattice of the discrete grids. As shown in the paper, this property guaranties that, for any elastic contrats, even infinite, mechanical equilibrium is always mathematically stable, i.e. free of any unphysical patterns, such as oscillations, ringing or checkerboarding, a property which is not shared by the original Moulinec-Suquet method \cite{moulinec1994fast,moulinec1998numerical} nor by the rotated scheme proposed by Willot \cite{willot2015fourier}. Second, the components of tensorial quantities are all defined on the same location, which permits the use of any elastic anisotropy and any spatial variation of the material fields. Third, convergence to equilibrium using the simplest iterative scheme, the "basic scheme", is fast and the number of iterates stabilizes at high contrasts, so that infinite contrast is obtained without additional computational cost.


title: Moment Lagrangian correspondences are unobstructed after bulk deformation

abstract: We prove that the Lagrangian correspondences induced by the symplectic reduction maps at free zero level sets of the moment maps are unobstructed after bulk deformation, assuming the existence of certain equivariant Kuranishi structures and compatible equivariant CF-perturbations on the moduli spaces of pseudoholomorphic discs.


title: Optimal quantum controls robust against detuning error

abstract: Precise control of quantum systems is one of the most important milestones for achieving practical quantum technologies, such as computation, sensing, and communication. Several factors deteriorate the control precision and thus their suppression is strongly demanded. One of the dominant factors is systematic errors, which are caused by discord between an expected parameter in control and its actual value. Error-robust control sequences, known as composite pulses, have been invented in the field of nuclear magnetic resonance (NMR). These sequences mainly focus on the suppression of errors in one-qubit control. The one-qubit control, which is the most fundamental in a wide range of quantum technologies, often suffers from detuning error. As there are many possible control sequences robust against the detuning error, it will practically be important to find ``optimal" robust controls with respect to several cost functions such as time required for operation, and pulse-area during the operation, which corresponds to the energy necessary for control. In this paper, we utilize the Pontryagin's maximum principle (PMP), a tool for solving optimization problems under inequality constraints, to solve the time and pulse-area optimization problems. We analytically obtain pulse-area optimal controls robust against the detuning error. Moreover, we found that short-CORPSE, which is the shortest known composite pulse so far, is a probable candidate of the time optimal solution according to the PMP. We evaluate the performance of the pulse-area optimal robust control and the short-CORPSE, comparing with that of the direct operation.


title: Graph Feedback Bandits with Similar Arms

abstract: In this paper, we study the stochastic multi-armed bandit problem with graph feedback. Motivated by the clinical trials and recommendation problem, we assume that two arms are connected if and only if they are similar (i.e., their means are close enough). We establish a regret lower bound for this novel feedback structure and introduce two UCB-based algorithms: D-UCB with problem-independent regret upper bounds and C-UCB with problem-dependent upper bounds. Leveraging the similarity structure, we also consider the scenario where the number of arms increases over time. Practical applications related to this scenario include Q\&A platforms (Reddit, Stack Overflow, Quora) and product reviews in Amazon and Flipkart. Answers (product reviews) continually appear on the website, and the goal is to display the best answers (product reviews) at the top. When the means of arms are independently generated from some distribution, we provide regret upper bounds for both algorithms and discuss the sub-linearity of bounds in relation to the distribution of means. Finally, we conduct experiments to validate the theoretical results.


title: Upper Bounds for the Lowest First Zero in Families of Cuspidal Newforms

abstract: Assuming the Generalized Riemann Hypothesis, the non-trivial zeros of $L$-functions lie on the critical line with the real part $1/2$. We find an upper bound of the lowest first zero in families of even cuspidal newforms of prime level tending to infinity. We obtain explicit bounds using the $n$-level densities and results towards the Katz-Sarnak density conjecture. We prove that as the level tends to infinity, there is at least one form with a normalized zero within $1/4$ of the average spacing. We also obtain the first-ever bounds on the percentage of forms in these families with a fixed number of zeros within a small distance near the central point.


title: Path-Integral Formulation of Truncated Wigner Approximation for Bosonic Markovian Open Quantum Systems

abstract: The truncated Wigner approximation (TWA) enables us to calculate bosonic quantum many-body dynamics while accounting for the effects of quantum fluctuations. In this work, we formulate the TWA for bosonic Markovian open quantum systems described by the Gorini-Kossakowski-Sudarshan-Lindblad (GKSL) equation from the coherent-state path-integral approach using the Wigner function. We derive an analytical expression for the GKSL equation in the TWA where we consider a bosonic system with an arbitrary Hamiltonian with jump operators that do not couple different states. We numerically confirm that the time evolution of physical quantities and the non-equal time correlation functions obtained in our formulation agree well with the exact ones in the numerically solvable models.


title: Refined diameter bounds under curvature dimension conditions

abstract: In this article we derive an explicit diameter bound for graphs satisfying the so-called curvature dimension conditions $CD(K,n)$. This refines a recent result due to Liu, M\"unch and Peyerimhoff when the dimension $n$ is finite.


title: A Detailed Study of Dwarf Galaxies in the Core of the Coma Cluster

abstract: In an earlier paper, we determined the morphological types of galaxies in the Coma Cluster using data from the HST/ACS Coma Cluster treasury survey. We found that of the 132 members, 51 are non dwarfs and 81 are dwarfs. We define dwarfs to have a absolute luminosity $M_{F814W}\geq -18.5$ as in \cite{2012ApJ...746..136M}. In this paper, we determine the morphological types of these dwarf galaxies and make a detailed study of their properties. Using GALFIT, we determine the structural properties of our sample and with spectroscopic redshifts, we determined memberships and distances to identify dwarfs. A visual examination of the residual images reveals that our sample of 78 dwarf galaxies comprises of: dwarf lenticular (\textit{dS0}) 22\%, dwarf Elliptical ($dE$) 69\%, dwarf spirals (\textit{dSp}) 4\%, dwarf ring (\textit{dring}) 1\%, dwarf barred spirals (\textit{dSBp}) 3\% and dwarf irregular (\textit{dIrr}) 1\% galaxies. We find that the bulge-disk decomposition (S\'ersic + exponential) fits are good only for the \textit{dS0} galaxies. The remainder of the sample gives good fits only for single S\'ersic fits. The Colour Magnitude Relation (CMR) shows that the $dEs$ are redder and fainter than the rest of the sample (except one $dIrr$ galaxy). The Kormendy relation reveals that $dE$ galaxies have lower surface brightness than the rest of the sample. Our research leads us to the conclusion that dwarf galaxies appear to have a different formation and evolution process than non-dwarf galaxies.


title: Outlier-Robust Long-Term Robotic Mapping Leveraging Ground Segmentation

abstract: Despite the remarkable advancements in deep learning-based perception technologies and simultaneous localization and mapping (SLAM), one can face the failure of these approaches when robots encounter scenarios outside their modeled experiences (here, the term modeling encompasses both conventional pattern finding and data-driven approaches). In particular, because learning-based methods are prone to catastrophic failure when operated in untrained scenes, there is still a demand for conventional yet robust approaches that work out of the box in diverse scenarios, such as real-world robotic services and SLAM competitions. In addition, the dynamic nature of real-world environments, characterized by changing surroundings over time and the presence of moving objects, leads to undesirable data points that hinder a robot from localization and path planning. Consequently, methodologies that enable long-term map management, such as multi-session SLAM and static map building, become essential. Therefore, to achieve a robust long-term robotic mapping system that can work out of the box, first, I propose (i) fast and robust ground segmentation to reject the ground points, which are featureless and thus not helpful for localization and mapping. Then, by employing the concept of graduated non-convexity (GNC), I propose (ii) outlier-robust registration with ground segmentation that overcomes the presence of gross outliers within the feature matching results, and (iii) hierarchical multi-session SLAM that not only uses our proposed GNC-based registration but also employs a GNC solver to be robust against outlier loop candidates. Finally, I propose (iv) instance-aware static map building that can handle the presence of moving objects in the environment based on the observation that most moving objects in urban environments are inevitably in contact with the ground.


title: Elliptic Quantum Toroidal Algebras, Z-algebra Structure and Representations

abstract: We introduce a new elliptic quantum toroidal algebra U_{q,\kappa,p}(g_tor) associated with an arbitrary toroidal algebra g_tor. We show that U_{q,\kappa,p}(g_tor) contains two elliptic quantum algebras associated with a corresponding affine Lie algebra bg as subalgebras. They are analogue of the horizontal and the vertical subalgebras in the quantum toroidal algebra U_{q,\kappa}(g_tor). A Hopf algebroid structure is introduced as a co-algebra structure of U_{q,\kappa,p}(g_tor) using the Drinfeld comultiplication. We also investigate the Z-algebra structure of U_{q,\kappa,p}(g_tor) and show that the Z-algebra governs the irreducibility of the level (k(\not=0),l)-infinite dimensional U_{q,\kappa,p}(g_tor)-modules in the same way as in the elliptic quantum group U_{q,p}(g). As an example, we construct the level (1,l) irreducible representation of U_{q,\kappa,p}(g_tor) for the simply laced gtor. We also construct the level (0,1) representation of U_{q,\kappa,p}(g_N,tor) and discuss a conjecture on its geometric interpretation as an action on the torus equivariant elliptic cohomology of the affine A_{N-1} quiver variety.


title: Automating PTSD Diagnostics in Clinical Interviews: Leveraging Large Language Models for Trauma Assessments

abstract: The shortage of clinical workforce presents significant challenges in mental healthcare, limiting access to formal diagnostics and services. We aim to tackle this shortage by integrating a customized large language model (LLM) into the workflow, thus promoting equity in mental healthcare for the general population. Although LLMs have showcased their capability in clinical decision-making, their adaptation to severe conditions like Post-traumatic Stress Disorder (PTSD) remains largely unexplored. Therefore, we collect 411 clinician-administered diagnostic interviews and devise a novel approach to obtain high-quality data. Moreover, we build a comprehensive framework to automate PTSD diagnostic assessments based on interview contents by leveraging two state-of-the-art LLMs, GPT-4 and Llama-2, with potential for broader clinical diagnoses. Our results illustrate strong promise for LLMs, tested on our dataset, to aid clinicians in diagnostic validation. To the best of our knowledge, this is the first AI system that fully automates assessments for mental illness based on clinician-administered interviews.


title: Accelerating Multilevel Markov Chain Monte Carlo Using Machine Learning Models

abstract: This work presents an efficient approach for accelerating multilevel Markov Chain Monte Carlo (MCMC) sampling for large-scale problems using low-fidelity machine learning models. While conventional techniques for large-scale Bayesian inference often substitute computationally expensive high-fidelity models with machine learning models, thereby introducing approximation errors, our approach offers a computationally efficient alternative by augmenting high-fidelity models with low-fidelity ones within a hierarchical framework. The multilevel approach utilizes the low-fidelity machine learning model (MLM) for inexpensive evaluation of proposed samples thereby improving the acceptance of samples by the high-fidelity model. The hierarchy in our multilevel algorithm is derived from geometric multigrid hierarchy. We utilize an MLM to acclerate the coarse level sampling. Training machine learning model for the coarsest level significantly reduces the computational cost associated with generating training data and training the model. We present an MCMC algorithm to accelerate the coarsest level sampling using MLM and account for the approximation error introduced. We provide theoretical proofs of detailed balance and demonstrate that our multilevel approach constitutes a consistent MCMC algorithm. Additionally, we derive conditions on the accuracy of the machine learning model to facilitate more efficient hierarchical sampling. Our technique is demonstrated on a standard benchmark inference problem in groundwater flow, where we estimate the probability density of a quantity of interest using a four-level MCMC algorithm. Our proposed algorithm accelerates multilevel sampling by a factor of two while achieving similar accuracy compared to sampling using the standard multilevel algorithm.


title: GestFormer: Multiscale Wavelet Pooling Transformer Network for Dynamic Hand Gesture Recognition

abstract: Transformer model have achieved state-of-the-art results in many applications like NLP, classification, etc. But their exploration in gesture recognition task is still limited. So, we propose a novel GestFormer architecture for dynamic hand gesture recognition. The motivation behind this design is to propose a resource efficient transformer model, since transformers are computationally expensive and very complex. So, we propose to use a pooling based token mixer named PoolFormer, since it uses only pooling layer which is a non-parametric layer instead of quadratic attention. The proposed model also leverages the space-invariant features of the wavelet transform and also the multiscale features are selected using multi-scale pooling. Further, a gated mechanism helps to focus on fine details of the gesture with the contextual information. This enhances the performance of the proposed model compared to the traditional transformer with fewer parameters, when evaluated on dynamic hand gesture datasets, NVidia Dynamic Hand Gesture and Briareo datasets. To prove the efficacy of the proposed model, we have experimented on single as well multimodal inputs such as infrared, normals, depth, optical flow and color images. We have also compared the proposed GestFormer in terms of resource efficiency and number of operations. The source code is available at https://github.com/mallikagarg/GestFormer.


title: Towards Knowledge-Infused Automated Disease Diagnosis Assistant

abstract: With the advancement of internet communication and telemedicine, people are increasingly turning to the web for various healthcare activities. With an ever-increasing number of diseases and symptoms, diagnosing patients becomes challenging. In this work, we build a diagnosis assistant to assist doctors, which identifies diseases based on patient-doctor interaction. During diagnosis, doctors utilize both symptomatology knowledge and diagnostic experience to identify diseases accurately and efficiently. Inspired by this, we investigate the role of medical knowledge in disease diagnosis through doctor-patient interaction. We propose a two-channel, knowledge-infused, discourse-aware disease diagnosis model (KI-DDI), where the first channel encodes patient-doctor communication using a transformer-based encoder, while the other creates an embedding of symptom-disease using a graph attention network (GAT). In the next stage, the conversation and knowledge graph embeddings are infused together and fed to a deep neural network for disease identification. Furthermore, we first develop an empathetic conversational medical corpus comprising conversations between patients and doctors, annotated with intent and symptoms information. The proposed model demonstrates a significant improvement over the existing state-of-the-art models, establishing the crucial roles of (a) a doctor's effort for additional symptom extraction (in addition to patient self-report) and (b) infusing medical knowledge in identifying diseases effectively. Many times, patients also show their medical conditions, which acts as crucial evidence in diagnosis. Therefore, integrating visual sensory information would represent an effective avenue for enhancing the capabilities of diagnostic assistants.


title: The Cost of Garbage Collection for State Machine Replication

abstract: State Machine Replication (SMR) protocols form the backbone of many distributed systems. Enterprises and startups increasingly build their distributed systems on the cloud due to its many advantages, such as scalability and cost-effectiveness. One of the first technical questions companies face when building a system on the cloud is which programming language to use. Among many factors that go into this decision is whether to use a language with garbage collection (GC), such as Java or Go, or a language with manual memory management, such as C++ or Rust. Today, companies predominantly prefer languages with GC, like Go, Kotlin, or even Python, due to ease of development; however, there is no free lunch: GC costs resources (memory and CPU) and performance (long tail latencies due to GC pauses). While there have been anecdotal reports of reduced cloud cost and improved tail latencies when switching from a language with GC to a language with manual memory management, so far, there has not been a systematic study of the GC overhead of running an SMR-based cloud system. This paper studies the overhead of running an SMR-based cloud system written in a language with GC. To this end, we design from scratch a canonical SMR system -- a MultiPaxos-based replicated in-memory key-value store -- and we implement it in C++, Java, Rust, and Go. We compare the performance and resource usage of these implementations when running on the cloud under different workloads and resource constraints and report our results. Our findings have implications for the design of cloud systems.


title: MultiPaxos Made Complete

abstract: MultiPaxos, while a fundamental Replicated State Machine algorithm, suffers from a dearth of comprehensive guidelines for achieving a complete and correct implementation. This deficiency has hindered MultiPaxos' practical utility and adoption and has resulted in flawed claims about its capabilities. Our paper aims to bridge the gap between MultiPaxos' complexity and practical implementation through a meticulous and detailed design process spanning more than a year. It carefully dissects each phase of MultiPaxos and offers detailed step-by-step pseudocode -- in addition to a complete open-source implementation -- for all components, including the leader election, the failure detector, and the commit phase. The implementation of our complete design also provides better performance stability, resource usage, and network partition tolerance than naive MultiPaxos versions. Our specification includes a lightweight log compaction approach that avoids taking repeated snapshots, significantly improving resource usage and performance stability. Our failure detector, integrated into the commit phase of the algorithm, uses variable and adaptive heartbeat intervals to settle on a better leader under partial connectivity and network partitions, improving liveness under such conditions.


title: Nilpotent Lie algebras obtained by quivers and Ricci solitons

abstract: Nilpotent Lie groups with left-invariant metrics provide non-trivial examples of Ricci solitons. One typical example is given by the class of two-step nilpotent Lie algebras obtained from simple directed graphs. In this paper, however, we focus on the use of quivers to construct nilpotent Lie algebras. A quiver is a directed graph that allows loops and multiple arrows between two vertices. Utilizing the concept of paths within quivers, we introduce a method for constructing nilpotent Lie algebras from finite quivers without cycles. We prove that for all these Lie algebras, the corresponding simply-connected nilpotent Lie groups admit left-invariant Ricci solitons. The method we introduce constructs a broad family of Ricci soliton nilmanifolds with arbitrarily high degrees of nilpotency.


title: Majorization-minimization Bregman proximal gradient algorithms for nonnegative matrix factorization with the Kullback--Leibler divergence

abstract: Nonnegative matrix factorization (NMF) is a popular method in machine learning and signal processing to decompose a given nonnegative matrix into two nonnegative matrices. In this paper, to solve NMF, we propose new algorithms, called majorization-minimization Bregman proximal gradient algorithm (MMBPG) and MMBPG with extrapolation (MMBPGe). MMBPG and MMBPGe minimize an auxiliary function majorizing the Kullback--Leibler (KL) divergence loss by the existing Bregman proximal gradient algorithms. While existing KL-based NMF methods update each variable alternately, proposed algorithms update all variables simultaneously. The proposed MMBPG and MMBPGe are equipped with a separable Bregman distance that satisfies the smooth adaptable property and that makes its subproblem solvable in closed forms. We also proved that even though these algorithms are designed to minimize an auxiliary function, MMBPG and MMBPGe monotonically decrease the objective function and a potential function, respectively. Using this fact, we show that a sequence generated by MMBPG(e) globally converges to a Karush--Kuhn--Tucker (KKT) point. In numerical experiments, we compared proposed algorithms with existing algorithms on synthetic data.


title: Compact Spin-Polarized Positron Acceleration in Multi-Layer Microhole Array Films

abstract: Compact spin-polarized positron accelerators play a major role in promoting significant positron application research, which typically require high acceleration gradients and polarization degree, both of which, however, are still great challenging. Here, we put forward a novel spin-polarized positron acceleration method which employs an ultrarelativistic high-density electron beam passing through any hole of multi-layer microhole array films to excite strong electrostatic and transition radiation fields. Positrons in the polarized electron-positron pair plasma, filled in the front of the multi-layer films, can be captured, accelerated, and focused by the electrostatic and transition radiation fields, while maintaining high polarization of above 90% and high acceleration gradient of about TeV/m. Multi-layer design allows for capturing more positrons and achieving cascade acceleration. Our method offers a promising solution for accelerator miniaturization, positron injection, and polarization maintaining, and also can be used to accelerate other charged particles.


title: Evaluation of Doppler shifts in $d$-wave superconductor tunneling junctions

abstract: The energy levels of quasiparticles in superconductors experience Doppler shifts due to the influence of a finite current flow. The influence of the Doppler shift is particularly pronounced in unconventional superconductors with gap nodes. In the case of a normal/insulator/superconductor junction of $d$-wave superconductors, a zero-bias conductance peak exhibits a peak shift in an applied magnetic field. Although the shifts have been detected in experiments, the shifts showed different field responses depending on each experiment. In this paper, we evaluate the magnitude of the shift based on realistic junction shapes to elucidate the origin of the variability in experimental Doppler shifts. We find that the peak shift depends on the junction shape; the splitting is significantly suppressed when the junction is formed at a protruding position. Also, the shift is suppressed by the penetration of magnetic flux quanta, resulting in a nonlinear response to the magnetic field. The present results explain the origin of the variability in experimental Doppler shifts.


title: Wind Power Prediction across Different Locations using Deep Domain Adaptive Learning

abstract: Accurate prediction of wind power is essential for the grid integration of this intermittent renewable source and aiding grid planners in forecasting available wind capacity. Spatial differences lead to discrepancies in climatological data distributions between two geographically dispersed regions, consequently making the prediction task more difficult. Thus, a prediction model that learns from the data of a particular climatic region can suffer from being less robust. A deep neural network (DNN) based domain adaptive approach is proposed to counter this drawback. Effective weather features from a large set of weather parameters are selected using a random forest approach. A pre-trained model from the source domain is utilized to perform the prediction task, assuming no source data is available during target domain prediction. The weights of only the last few layers of the DNN model are updated throughout the task, keeping the rest of the network unchanged, making the model faster compared to the traditional approaches. The proposed approach demonstrates higher accuracy ranging from 6.14% to even 28.44% compared to the traditional non-adaptive method.


title: Nearly-circular periodic solutions of perturbed relativistic Kepler problems: the fixed-period and the fixed-energy problems

abstract: The paper studies the existence of periodic solutions of a perturbed relativistic Kepler problem of the type \begin{equation*} \dfrac{\mathrm{d}}{\mathrm{d}t}\left(\frac{m\dot{x}}{\sqrt{1-|\dot{x}|^{2}/c^{2}}}\right) = -\alpha\frac{x}{|x|^{3}} + \varepsilon \, \nabla_{x} U(t,x), \qquad x \in \mathbb{R}^d\setminus\{0\}, \end{equation*} with $d=2$ or $d=3$, bifurcating, for $\varepsilon$ small enough, from the set of circular solutions of the unperturbed system. Both the case of the fixed-period problem (assuming that $U$ is $T$-periodic in time) and the case of the fixed-energy problem (assuming that $U$ is independent of time) are considered.


title: ReasonPix2Pix: Instruction Reasoning Dataset for Advanced Image Editing

abstract: Instruction-based image editing focuses on equipping a generative model with the capacity to adhere to human-written instructions for editing images. Current approaches typically comprehend explicit and specific instructions. However, they often exhibit a deficiency in executing active reasoning capacities required to comprehend instructions that are implicit or insufficiently defined. To enhance active reasoning capabilities and impart intelligence to the editing model, we introduce ReasonPix2Pix, a comprehensive reasoning-attentive instruction editing dataset. The dataset is characterized by 1) reasoning instruction, 2) more realistic images from fine-grained categories, and 3) increased variances between input and edited images. When fine-tuned with our dataset under supervised conditions, the model demonstrates superior performance in instructional editing tasks, independent of whether the tasks require reasoning or not. The code will be available at https://github.com/Jin-Ying/ReasonPix2Pix.


title: Biathlon: Harnessing Model Resilience for Accelerating ML Inference Pipelines

abstract: Machine learning inference pipelines commonly encountered in data science and industries often require real-time responsiveness due to their user-facing nature. However, meeting this requirement becomes particularly challenging when certain input features require aggregating a large volume of data online. Recent literature on interpretable machine learning reveals that most machine learning models exhibit a notable degree of resilience to variations in input. This suggests that machine learning models can effectively accommodate approximate input features with minimal discernible impact on accuracy. In this paper, we introduce Biathlon, a novel ML serving system that leverages the inherent resilience of models and determines the optimal degree of approximation for each aggregation feature. This approach enables maximum speedup while ensuring a guaranteed bound on accuracy loss. We evaluate Biathlon on real pipelines from both industry applications and data science competitions, demonstrating its ability to meet real-time latency requirements by achieving 5.3x to 16.6x speedup with almost no accuracy loss.


title: BrainStorm @ iREL at SMM4H 2024: Leveraging Translation and Topical Embeddings for Annotation Detection in Tweets

abstract: The proliferation of LLMs in various NLP tasks has sparked debates regarding their reliability, particularly in annotation tasks where biases and hallucinations may arise. In this shared task, we address the challenge of distinguishing annotations made by LLMs from those made by human domain experts in the context of COVID-19 symptom detection from tweets in Latin American Spanish. This paper presents BrainStorm @ iREL's approach to the SMM4H 2024 Shared Task, leveraging the inherent topical information in tweets, we propose a novel approach to identify and classify annotations, aiming to enhance the trustworthiness of annotated data.


title: Elliptic Quantum Groups

abstract: We expose the elliptic quantum groups in the Drinfeld realization associated with both the affine Lie algebra \g and the toroidal algebra \g_tor. There the level-0 and level \not=0 representations appear in a unified way so that one can define the vertex operators as intertwining operators of them. The vertex operators are key for many applications such as a derivation of the elliptic weight functions, integral solutions of the (elliptic) q-KZ equation and a formulation of algebraic analysis of the elliptic solvable lattice models. Identifying the elliptic weight functions with the elliptic stable envelopes we make a correspondence between the level-0 representation of the elliptic quantum group and the equivariant elliptic cohomology. We also emphasize a characterization of the elliptic quantum groups as $q$-deformations of the W-algebras.


title: QuaLITi: Quantum Machine Learning Hardware Selection for Inferencing with Top-Tier Performance

abstract: Quantum Machine Learning (QML) is an accelerating field of study that leverages the principles of quantum computing to enhance and innovate within machine learning methodologies. However, Noisy Intermediate-Scale Quantum (NISQ) computers suffer from noise that corrupts the quantum states of the qubits and affects the training and inferencing accuracy. Furthermore, quantum computers have long access queues. A single execution with a pre-defined number of shots can take hours just to reach the top of the wait queue, which is especially disadvantageous to Quantum Machine Learning (QML) algorithms that are iterative in nature. Many vendors provide access to a suite of quantum hardware with varied qubit technologies, number of qubits, coupling architectures, and noise characteristics. However, present QML algorithms do not use them for the training procedure and often rely on local noiseless/noisy simulators due to cost and training timing overhead on real hardware. Additionally, inferencing is generally performed on reduced datasets with fewer datapoints. Taking these constraints into account, we perform a study to maximize the inferencing performance of QML workloads based on the choice of hardware selection. Specifically, we perform a detailed analysis of quantum classifiers (both training and inference through the lens of hardware queue wait times) on Iris and reduced Digits datasets under noise and varied conditions such as different hardware and coupling maps. We show that using multiple readily available hardware for training rather than relying on a single hardware, especially if it has a long queue depth of pending jobs, can lead to a performance impact of only 3-4% while providing up to 45X reduction in training wait time.


title: Trustworthy Actionable Perturbations

abstract: Counterfactuals, or modified inputs that lead to a different outcome, are an important tool for understanding the logic used by machine learning classifiers and how to change an undesirable classification. Even if a counterfactual changes a classifier's decision, however, it may not affect the true underlying class probabilities, i.e. the counterfactual may act like an adversarial attack and ``fool'' the classifier. We propose a new framework for creating modified inputs that change the true underlying probabilities in a beneficial way which we call Trustworthy Actionable Perturbations (TAP). This includes a novel verification procedure to ensure that TAP change the true class probabilities instead of acting adversarially. Our framework also includes new cost, reward, and goal definitions that are better suited to effectuating change in the real world. We present PAC-learnability results for our verification procedure and theoretically analyze our new method for measuring reward. We also develop a methodology for creating TAP and compare our results to those achieved by previous counterfactual methods.


title: Natural Is The Best: Model-Agnostic Code Simplification for Pre-trained Large Language Models

abstract: Pre-trained Large Language Models (LLM) have achieved remarkable successes in several domains. However, code-oriented LLMs are heavy in computational complexity, and quadratically with the length of the input. Toward simplifying the input program of an LLM, the state-of-the-art approach has the strategies to filter the input code tokens based on the attention scores given by the LLM. The decision to simplify the input should not rely on the attention patterns of an LLM, as these patterns are influenced by both the model architecture and the pre-training dataset. Since the model and dataset are part of the solution domain, not the problem domain where the input belongs, the outcome may differ when the model is pre-trained on a different dataset. We propose SlimCode, a model-agnostic code simplification solution for LLMs that depends on the nature of input code tokens. As an empirical study on the LLMs including CodeBERT, CodeT5, and GPT-4 for two main tasks: code search and summarization, we reported that 1) the removal ratio of code has a linear-like relation with the saving ratio on training time, 2) the impact of categorized tokens on code simplification can vary significantly, 3) the impact of categorized tokens on code simplification is task-specific but model-agnostic, and 4) the above findings hold for the paradigm-prompt engineering and interactive in-context learning. The empirical results showed that SlimCode can improve the state-of-the-art technique by 9.46% and 5.15% in terms of MRR and BLEU score on code search and summarization. Moreover, SlimCode is 133 times faster than the state-of-the-art approach. Additionally, SlimCode can reduce the cost of invoking GPT-4 by up to 24% per API query, while still producing comparable results to those with the original code.


title: Designing NLP Systems That Adapt to Diverse Worldviews

abstract: Natural Language Inference (NLI) is foundational for evaluating language understanding in AI. However, progress has plateaued, with models failing on ambiguous examples and exhibiting poor generalization. We argue that this stems from disregarding the subjective nature of meaning, which is intrinsically tied to an individual's \textit{weltanschauung} (which roughly translates to worldview). Existing NLP datasets often obscure this by aggregating labels or filtering out disagreement. We propose a perspectivist approach: building datasets that capture annotator demographics, values, and justifications for their labels. Such datasets would explicitly model diverse worldviews. Our initial experiments with a subset of the SBIC dataset demonstrate that even limited annotator metadata can improve model performance.


title: Adaptive Stabilization Based on Machine Learning for Column Generation

abstract: Column generation (CG) is a well-established method for solving large-scale linear programs. It involves iteratively optimizing a subproblem containing a subset of columns and using its dual solution to generate new columns with negative reduced costs. This process continues until the dual values converge to the optimal dual solution to the original problem. A natural phenomenon in CG is the heavy oscillation of the dual values during iterations, which can lead to a substantial slowdown in the convergence rate. Stabilization techniques are devised to accelerate the convergence of dual values by using information beyond the state of the current subproblem. However, there remains a significant gap in obtaining more accurate dual values at an earlier stage. To further narrow this gap, this paper introduces a novel approach consisting of 1) a machine learning approach for accurate prediction of optimal dual solutions and 2) an adaptive stabilization technique that effectively capitalizes on accurate predictions. On the graph coloring problem, we show that our method achieves a significantly improved convergence rate compared to traditional methods.


title: New insights into the solutions of a class of anisotropic nonlinear Schr\"{o}dinger equations on the plane

abstract: In this paper, we study the following anisotropic nonlinear Schr\"odinger equation on the plane, \[ \begin{cases} {\rm i}\partial_t \Phi+\partial_{xx} \Phi -D_y^{2s} \Phi +|\Phi|^{p-2}\Phi=0,&\quad (t,x,y)\in\mathbb{R} \times \mathbb{R}^2, \Phi(x,y,0)=\Phi_0(x,y),&\quad (x,y)\in\mathbb{R}^2, \end{cases} \] where $D_y^{2s}=\left(-\partial_{yy}\right)^s$ denotes the fractional Laplacian with $0<s<1$ and $2<p<\frac{2(1+s)}{1-s}$. We first study the existence of normalized solutions to this equation in the subcritical, critical, and supercritical cases. To this aim, regularity results and a Pohozaev type identity are necessary. Then, we determine the conditions under which the solutions blow up. Furthermore, we demonstrate the existence of boosted traveling waves when $s\geq1/2$ and their decay at infinity. Additionally, for the delicate case $s=1/2$, we provide a non-existence result of boosted traveling waves and we establish that there is no scattering for small data. Finally, we also study normalized boosted travelling waves in the mass subcritical case. Due to the nature of the equation, we do not impose any radial symmetry on the initial data or on the solutions.


title: LexGen: Domain-aware Multilingual Lexicon Generation

abstract: Lexicon or dictionary generation across domains is of significant societal importance, as it can potentially enhance information accessibility for a diverse user base while preserving language identity. Prior work in the field primarily focuses on bilingual lexical induction, which deals with word alignments using mapping-based or corpora-based approaches. Though initiated by researchers, the research associated with lexicon generation is limited, even more so with domain-specific lexicons. This task becomes particularly important in atypical medical, engineering, and other technical domains, owing to the highly infrequent usage of the terms and negligibly low data availability of technical terms in many low-resource languages. Owing to the research gap in lexicon generation, especially with a limited focus on the domain-specific area, we propose a new model to generate dictionary words for 6 Indian languages in the multi-domain setting. Our model consists of domain-specific and domain-generic layers that encode information, and these layers are invoked via a learnable routing technique. Further, we propose an approach to explicitly leverage the relatedness between these Indian languages toward coherent translation. We also release a new benchmark dataset across 6 Indian languages that span 8 diverse domains that can propel further research in domain-specific lexicon induction. We conduct both zero-shot and few-shot experiments across multiple domains to show the efficacy of our proposed model in generalizing to unseen domains and unseen languages.


title: On General Weighted Extropy of Percentile Ranked Set Sampling

abstract: The extropy measure, first proposed by Lad, Sanfilippo, and Agro in their (2015) paper in Statistical Science, has attracted considerable attention in recent years. Our study introduces a fresh approach to representing weighted extropy in the framework of percentile ranked set sampling. Furthermore, we provide additional insights such as stochastic orders, characterizations, and bounds. Our findings illuminate the comparison between the weighted extropy of percentile ranked set sampling and its equivalent in simple random sampling.


title: Storage and retrieval of von Neumann measurements via indefinite causal order structures

abstract: This work presents the problem of learning an unknown von Neumann measurement of dimension $d$ using indefinite causal structures. In the considered scenario, we have access to $N$ copies of the measurement. We use formalism of process matrices to store information about the given measurement, that later will be used to reproduce its best possible approximation. Our goal is to compute the maximum value of the average fidelity function $F_d(N)$ of our procedure. We prove that $F_d(N) = 1 - \Theta \left( \frac{1}{N^2}\right)$ for arbitrary but fixed dimension $d$. Furthermore, we present the SDP program for computing $F_d(N)$. Basing on the numerical investigation, we show that for the qubit von Neumann measurements using indefinite causal learning structures provide better approximation than quantum networks, starting from $N \ge 3$.


title: A robust solver for H(curl) convection-diffusion and its local Fourier analysis

abstract: In this paper, we present a robust and efficient multigrid solver based on an exponential-fitting discretization for 2D H(curl) convection-diffusion problems. By leveraging an exponential identity, we characterize the kernel of H(curl) convection-diffusion problems and design a suitable hybrid smoother. This smoother incorporates a lexicographic Gauss-Seidel smoother within a downwind type and smoothing over an auxiliary problem, corresponding to H(grad) convection-diffusion problems for kernel correction. We analyze the convergence properties of the smoothers and the two-level method using local Fourier analysis (LFA). The performance of the algorithms demonstrates robustness in both convection-dominated and diffusion-dominated cases.


title: Learning from Imperfect Human Feedback: a Tale from Corruption-Robust Dueling

abstract: This paper studies Learning from Imperfect Human Feedback (LIHF), motivated by humans' potential irrationality or imperfect perception of true preference. We revisit the classic dueling bandit problem as a model of learning from comparative human feedback, and enrich it by casting the imperfection in human feedback as agnostic corruption to user utilities. We start by identifying the fundamental limits of LIHF and prove a regret lower bound of $\Omega(\max\{T^{1/2},C\})$, even when the total corruption $C$ is known and when the corruption decays gracefully over time (i.e., user feedback becomes increasingly more accurate). We then turn to design robust algorithms applicable in real-world scenarios with arbitrary corruption and unknown $C$. Our key finding is that gradient-based algorithms enjoy a smooth efficiency-robustness tradeoff under corruption by varying their learning rates. Specifically, under general concave user utility, Dueling Bandit Gradient Descent (DBGD) of Yue and Joachims (2009) can be tuned to achieve regret $O(T^{1-\alpha} + T^{ \alpha} C)$ for any given parameter $\alpha \in (0, \frac{1}{4}]$. Additionally, this result enables us to pin down the regret lower bound of the standard DBGD (the $\alpha=1/4$ case) as $\Omega(T^{3/4})$ for the first time, to the best of our knowledge. For strongly concave user utility we show a better tradeoff: there is an algorithm that achieves $O(T^{\alpha} + T^{\frac{1}{2}(1-\alpha)}C)$ for any given $\alpha \in [\frac{1}{2},1)$. Our theoretical insights are corroborated by extensive experiments on real-world recommendation data.


title: Fuse & Calibrate: A bi-directional Vision-Language Guided Framework for Referring Image Segmentation

abstract: Referring Image Segmentation (RIS) aims to segment an object described in natural language from an image, with the main challenge being a text-to-pixel correlation. Previous methods typically rely on single-modality features, such as vision or language features, to guide the multi-modal fusion process. However, this approach limits the interaction between vision and language, leading to a lack of fine-grained correlation between the language description and pixel-level details during the decoding process. In this paper, we introduce FCNet, a framework that employs a bi-directional guided fusion approach where both vision and language play guiding roles. Specifically, we use a vision-guided approach to conduct initial multi-modal fusion, obtaining multi-modal features that focus on key vision information. We then propose a language-guided calibration module to further calibrate these multi-modal features, ensuring they understand the context of the input sentence. This bi-directional vision-language guided approach produces higher-quality multi-modal features sent to the decoder, facilitating adaptive propagation of fine-grained semantic information from textual features to visual features. Experiments on RefCOCO, RefCOCO+, and G-Ref datasets with various backbones consistently show our approach outperforming state-of-the-art methods.