title: Comparing Active Learning Performance Driven by Gaussian Processes or Bayesian Neural Networks for Constrained Trajectory Exploration

abstract: Robots with increasing autonomy progress our space exploration capabilities, particularly for in-situ exploration and sampling to stand in for human explorers. Currently, humans drive robots to meet scientific objectives, but depending on the robot's location, the exchange of information and driving commands between the human operator and robot may cause undue delays in mission fulfillment. An autonomous robot encoded with a scientific objective and an exploration strategy incurs no communication delays and can fulfill missions more quickly. Active learning algorithms offer this capability of intelligent exploration, but the underlying model structure varies the performance of the active learning algorithm in accurately forming an understanding of the environment. In this paper, we investigate the performance differences between active learning algorithms driven by Gaussian processes or Bayesian neural networks for exploration strategies encoded on agents that are constrained in their trajectories, like planetary surface rovers. These two active learning strategies were tested in a simulation environment against science-blind strategies to predict the spatial distribution of a variable of interest along multiple datasets. The performance metrics of interest are model accuracy in root mean squared (RMS) error, training time, model convergence, total distance traveled until convergence, and total samples until convergence. Active learning strategies encoded with Gaussian processes require less computation to train, converge to an accurate model more quickly, and propose trajectories of shorter distance, except in a few complex environments in which Bayesian neural networks achieve a more accurate model in the large data regime due to their more expressive functional bases. The paper concludes with advice on when and how to implement either exploration strategy for future space missions.


title: Compositional Sculpting of Iterative Generative Processes

abstract: High training costs of generative models and the need to fine-tune them for specific tasks have created a strong interest in model reuse and composition. A key challenge in composing iterative generative processes, such as GFlowNets and diffusion models, is that to realize the desired target distribution, all steps of the generative process need to be coordinated, and satisfy delicate balance conditions. In this work, we propose Compositional Sculpting: a general approach for defining compositions of iterative generative processes. We then introduce a method for sampling from these compositions built on classifier guidance. We showcase ways to accomplish compositional sculpting in both GFlowNets and diffusion models. We highlight two binary operations $\unicode{x2014}$ the harmonic mean ($p_1 \otimes p_2$) and the contrast ($p_1 \unicode{x25D1}\,p_2$) between pairs, and the generalization of these operations to multiple component distributions. We offer empirical results on image and molecular generation tasks.


title: On well-posed boundary conditions and energy stable finite volume method for the linear shallow water wave equation

abstract: We derive and analyse well-posed boundary conditions for the linear shallow water wave equation. The analysis is based on the energy method and it identifies the number, location and form of the boundary conditions so that the initial boundary value problem is well-posed. A finite volume method is developed based on the summation-by-parts framework with the boundary conditions implemented weakly using penalties. Stability is proven by deriving a discrete energy estimate analogous to the continuous estimate. The continuous and discrete analysis covers all flow regimes. Numerical experiments are presented verifying the analysis.


title: E2Net: Resource-Efficient Continual Learning with Elastic Expansion Network

abstract: Continual Learning methods are designed to learn new tasks without erasing previous knowledge. However, Continual Learning often requires massive computational power and storage capacity for satisfactory performance. In this paper, we propose a resource-efficient continual learning method called the Elastic Expansion Network (E2Net). Leveraging core subnet distillation and precise replay sample selection, E2Net achieves superior average accuracy and diminished forgetting within the same computational and storage constraints, all while minimizing processing time. In E2Net, we propose Representative Network Distillation to identify the representative core subnet by assessing parameter quantity and output similarity with the working network, distilling analogous subnets within the working network to mitigate reliance on rehearsal buffers and facilitating knowledge transfer across previous tasks. To enhance storage resource utilization, we then propose Subnet Constraint Experience Replay to optimize rehearsal efficiency through a sample storage strategy based on the structures of representative networks. Extensive experiments conducted predominantly on cloud environments with diverse datasets and also spanning the edge environment demonstrate that E2Net consistently outperforms state-of-the-art methods. In addition, our method outperforms competitors in terms of both storage and computational requirements.


title: D$^3$Fields: Dynamic 3D Descriptor Fields for Zero-Shot Generalizable Robotic Manipulation

abstract: Scene representation has been a crucial design choice in robotic manipulation systems. An ideal representation should be 3D, dynamic, and semantic to meet the demands of diverse manipulation tasks. However, previous works often lack all three properties simultaneously. In this work, we introduce D$^3$Fields - dynamic 3D descriptor fields. These fields capture the dynamics of the underlying 3D environment and encode both semantic features and instance masks. Specifically, we project arbitrary 3D points in the workspace onto multi-view 2D visual observations and interpolate features derived from foundational models. The resulting fused descriptor fields allow for flexible goal specifications using 2D images with varied contexts, styles, and instances. To evaluate the effectiveness of these descriptor fields, we apply our representation to a wide range of robotic manipulation tasks in a zero-shot manner. Through extensive evaluation in both real-world scenarios and simulations, we demonstrate that D$^3$Fields are both generalizable and effective for zero-shot robotic manipulation tasks. In quantitative comparisons with state-of-the-art dense descriptors, such as Dense Object Nets and DINO, D$^3$Fields exhibit significantly better generalization abilities and manipulation accuracy.


title: ModuLoRA: Finetuning 2-Bit LLMs on Consumer GPUs by Integrating with Modular Quantizers

abstract: We propose a memory-efficient finetuning algorithm for large language models (LLMs) that supports finetuning LLMs with 65B parameters in 2/3/4-bit precision on as little as one 24GB GPU. Our method, modular low-rank adaptation (ModuLoRA), integrates any user-specified weight quantizer with finetuning via low-rank adapters (LoRAs). Our approach relies on a simple quantization-agnostic backward pass that adaptively materializes low-precision LLM weights from a custom black-box quantization module. This approach enables finetuning 2-bit and 3-bit LLMs for the first time -- leveraging state-of-the-art 2-bit QuIP\# quantization and 3-bit OPTQ quantization -- outperforming finetuning that relies on less sophisticated 4-bit and 8-bit methods. In our experiments, \lplora~attains competitive performance on text classification, natural language inference, and instruction following tasks using significantly less memory than existing approaches, and we also surpass the state-of-the-art ROUGE score on a popular summarization task. We release \lplora~together with a series of low-precision models as part of \llmtune, a user-friendly library for quantizing, running, and finetuning LLMs on consumer GPUs.


title: Test-Case-Driven Programming Understanding in Large Language Models for Better Code Generation

abstract: Code generation is to automatically generate source code conforming to a given programming specification, which has received extensive attention especially with the development of large language models (LLMs). Due to the inherent difficulty of code generation, the code generated by LLMs may be not aligned with the specification. To improve the performance of LLMs in code generation, some thought-eliciting prompting techniques have been proposed to guide LLMs for specification understanding. However, it is still hard to produce correct understanding for complicated programming problems, leading to unsatisfactory code generation performance. Also, some feedback-based prompting techniques have been proposed to fix incorrect code using error messages produced by test execution. However, when the generated code deviates significantly from the ground truth, they encounter difficulties in improving performance based on such coarse-grained information. In this work, we propose a novel prompting technique, called {\mu}FiX, to improve the code generation performance of LLMs by devising both sophisticated thought-eliciting prompting and feedback-based prompting and making the first exploration on their synergy. It first exploits test case analysis to obtain specification understanding and enables a self-improvement process to identify and fix the misunderstanding in the thought-eliciting prompting phase. {\mu}FiX further fixes the specification understanding towards the direction reducing the gap between the provided understanding and the actual understanding implicitly utilized by LLMs for code generation in the feedback-based prompting phase. By obtaining as correct understanding as possible with {\mu}FiX, the code generation performance of LLMs can be largely improved.


title: JWST reveals a luminous infrared source at the position of the failed supernova candidate N6946-BH1

abstract: N6946-BH1 is the first plausible candidate for a failed supernova (SN), a peculiar event in which a massive star disappears without the expected bright SN, accompanied by collapse into a black hole (BH). Following a luminous outburst in 2009, the source experienced a significant decline in optical brightness, while maintaining a persistent infrared (IR) presence. While it was proposed to be a potential failed SN, such behavior has been observed in SN impostor events in nearby galaxies. Here, we present late-time observations of BH1, taken 14 years after disappearance, using JWST's NIRCam and MIRI instruments to probe a never-before-observed region of the object's spectral energy distribution. We show for the first time that all previous observations of BH1 (pre- and post-disappearance) are actually a blend of at least 3 sources. In the near-IR, BH1 is notably fainter than the progenitor but retains similar brightness to its state in 2017. In the mid-IR, the flux appears to have brightened compared to the inferred fluxes from the best-fitting progenitor model. The total luminosity of the source is between 13 - 25% that of the progenitor. We also show that the IR SED appears consistent with PAH features that arise when dust is illuminated by near-ultraviolet radiation. At present, the interpretation of N6946-BH1 remains uncertain. The observations match expectations for a stellar merger, but theoretical ambiguity in the failed SN hypothesis makes it hard to dismiss.


title: Non-thermal WIMPy Baryogenesis with Primordial Black Hole

abstract: We consider the possibility that the weakly interacting massive particles produced from the evaporation of primordial black hole can explain both the relic density of dark matter and the baryon asymmetry of the Universe, through their annihilation which violate B and CP-symmetry. We find that the primordial black hole with mass less than $10^7 {\rm g}$ is a good candidate as an source of TeV dark matter with the total annihilation cross section $\left\langle\sigma_a \upsilon\right\rangle \lesssim 10^{-7} \ {\rm GeV}^{-2}$ and the B-violating scattering cross section $\left\langle\sigma_B \upsilon\right\rangle \lesssim 2\times 10^{-9} \ {\rm GeV^{-2}}$. This large annihilation cross section of dark matter in this model would make it available to search them in the indirect search for dark matter such as gamma-ray or neutrino observations.


title: Single-shot deterministic complex amplitude imaging with a single-layer metalens

abstract: Conventional imaging systems can only capture light intensity. Meanwhile, the lost phase information may be critical for a variety of applications such as label-free microscopy and optical metrology. Existing phase retrieval techniques typically require a bulky setup, multi-frame measurements, or prior information of the target scene. Here, we proposed an extremely compact system for complex amplitude imaging, leveraging the extreme versatility of a single-layer metalens to generate spatially-multiplexed and polarization-phase-shifted point spread functions. Combining the metalens with a polarization camera, the system can simultaneously record four polarization shearing interference patterns along both in-plane directions, thus allowing the deterministic reconstruction of the complex amplitude light field in a single shot. Using an incoherent light-emitting diode as the illumination, we experimentally demonstrated speckle-noise-free complex amplitude imaging for both static and moving objects with tailored magnification ratio and field-of-view. The miniaturized and robust system may open the door for complex amplitude imaging in portable devices for point-of-care applications.


title: Solving the Bethe-Salpeter Equation in Real Frequencies at Finite Temperature

abstract: Self-consistent Hartree-Fock approximation combined with solutions of the Bethe-Salpeter equation offers a powerful tool for studies of strong correlation effects arising in condensed matter models, nuclear physics, quantum field theories, and real materials. The standard finite-temperature approach would be to first solve the problem in the Matsubara representation and then apply numerical analytic continuation to the real-frequency axis to link theoretical results with experimental probes, but this ill-conditioned procedure often distorts important spectral features even for very accurate imaginary-frequency data. We demonstrate that the ladder-type finite-temperature Bethe-Salpeter equation in the Hartree-Fock basis for the 3-point vertex function and, ultimately, system's polarization can be accurately solved directly on the real frequency axis using the diagrammatic Monte Carlo technique and series resummation. We illustrate the method by applying it to the homogeneous electron gas model and demonstrate how multiple scattering events renormalize Landau damping.


title: Tides in clouds: control of star formation by long-range gravitational force

abstract: Gravity drives the collapse of molecular clouds through which stars form, yet the exact role of gravity in cloud collapse remains a complex issue. Studies point to a picture where star formation occurs in clusters. In a typical, pc-sized cluster-forming region, the collapse is hierarchical, and the stars should be born from regions of even smaller sizes ($\approx 0.1\;\rm pc$). The origin of this spatial arrangement remains under investigation. Based on a high-quality surface density map towards the Perseus region, we construct a 3D density structure, compute the gravitational potential, and derive eigenvalues of the tidal tensor ($\lambda_{\rm min}$, $\lambda_{\rm mid}$, $\lambda_{\rm max}$, $\lambda_{\rm min} < \lambda_{\rm mid} < \lambda_{\rm max}$), analyze the behavior of gravity at every location and reveal its multiple roles in cloud evolution. We find that fragmentation is limited to several isolated, high-density ``islands''. Surrounding them, is a vast amount of gas ($75 \%$ of the mass, $95 \%$ of the volume) that stays under the influence of extensive tides where fragmentation is suppressed. This gas will be transported towards these regions to fuel star formation. The spatial arrangement of regions under different tides explains the hierarchical and localized pattern of star formation inferred from the observations. Tides were first recognized by Newton, yet this is the first time its dominance in cloud evolution has been revealed. We expect this link between cloud density structure and role gravity to be strengthened by future studies, resulting in a clear view of the star formation process.


title: UVL: A Unified Framework for Video Tampering Localization

abstract: With the development of deep learning technology, various forgery methods emerge endlessly. Meanwhile, methods to detect these fake videos have also achieved excellent performance on some datasets. However, these methods suffer from poor generalization to unknown videos and are inefficient for new forgery methods. To address this challenging problem, we propose UVL, a novel unified video tampering localization framework for synthesizing forgeries. Specifically, UVL extracts common features of synthetic forgeries: boundary artifacts of synthetic edges, unnatural distribution of generated pixels, and noncorrelation between the forgery region and the original. These features are widely present in different types of synthetic forgeries and help improve generalization for detecting unknown videos. Extensive experiments on three types of synthetic forgery: video inpainting, video splicing and DeepFake show that the proposed UVL achieves state-of-the-art performance on various benchmarks and outperforms existing methods by a large margin on cross-dataset.


title: Open Compound Domain Adaptation with Object Style Compensation for Semantic Segmentation

abstract: Many methods of semantic image segmentation have borrowed the success of open compound domain adaptation. They minimize the style gap between the images of source and target domains, more easily predicting the accurate pseudo annotations for target domain's images that train segmentation network. The existing methods globally adapt the scene style of the images, whereas the object styles of different categories or instances are adapted improperly. This paper proposes the Object Style Compensation, where we construct the Object-Level Discrepancy Memory with multiple sets of discrepancy features. The discrepancy features in a set capture the style changes of the same category's object instances adapted from target to source domains. We learn the discrepancy features from the images of source and target domains, storing the discrepancy features in memory. With this memory, we select appropriate discrepancy features for compensating the style information of the object instances of various categories, adapting the object styles to a unified style of source domain. Our method enables a more accurate computation of the pseudo annotations for target domain's images, thus yielding state-of-the-art results on different datasets.


title: Joint Correcting and Refinement for Balanced Low-Light Image Enhancement

abstract: Low-light image enhancement tasks demand an appropriate balance among brightness, color, and illumination. While existing methods often focus on one aspect of the image without considering how to pay attention to this balance, which will cause problems of color distortion and overexposure etc. This seriously affects both human visual perception and the performance of high-level visual models. In this work, a novel synergistic structure is proposed which can balance brightness, color, and illumination more effectively. Specifically, the proposed method, so-called Joint Correcting and Refinement Network (JCRNet), which mainly consists of three stages to balance brightness, color, and illumination of enhancement. Stage 1: we utilize a basic encoder-decoder and local supervision mechanism to extract local information and more comprehensive details for enhancement. Stage 2: cross-stage feature transmission and spatial feature transformation further facilitate color correction and feature refinement. Stage 3: we employ a dynamic illumination adjustment approach to embed residuals between predicted and ground truth images into the model, adaptively adjusting illumination balance. Extensive experiments demonstrate that the proposed method exhibits comprehensive performance advantages over 21 state-of-the-art methods on 9 benchmark datasets. Furthermore, a more persuasive experiment has been conducted to validate our approach the effectiveness in downstream visual tasks (e.g., saliency detection). Compared to several enhancement models, the proposed method effectively improves the segmentation results and quantitative metrics of saliency detection. The source code will be available at https://github.com/woshiyll/JCRNet.


title: Counterfactual Density Estimation using Kernel Stein Discrepancies

abstract: Causal effects are usually studied in terms of the means of counterfactual distributions, which may be insufficient in many scenarios. Given a class of densities known up to normalizing constants, we propose to model counterfactual distributions by minimizing kernel Stein discrepancies in a doubly robust manner. This enables the estimation of counterfactuals over large classes of distributions while exploiting the desired double robustness. We present a theoretical analysis of the proposed estimator, providing sufficient conditions for consistency and asymptotic normality, as well as an examination of its empirical performance.


title: Crossed products and C*-covers of semi-Dirichlet operator algebras

abstract: In this paper, we show that the semi-Dirichlet C*-covers of a semi-Dirichlet operator algebra form a complete lattice, establishing that there is a maximal semi-Dirichlet C*-cover. Given an operator algebra dynamical system we prove a dilation theory that shows that the full crossed product is isomorphic to the relative full crossed product with respect to this maximal semi-Dirichlet cover. In this way, we can show that every semi-Dirichlet dynamical system has a semi-Dirichlet full crossed product.


title: A Spectral Approach for Learning Spatiotemporal Neural Differential Equations

abstract: Rapidly developing machine learning methods has stimulated research interest in computationally reconstructing differential equations (DEs) from observational data which may provide additional insight into underlying causative mechanisms. In this paper, we propose a novel neural-ODE based method that uses spectral expansions in space to learn spatiotemporal DEs. The major advantage of our spectral neural DE learning approach is that it does not rely on spatial discretization, thus allowing the target spatiotemporal equations to contain long range, nonlocal spatial interactions that act on unbounded spatial domains. Our spectral approach is shown to be as accurate as some of the latest machine learning approaches for learning PDEs operating on bounded domains. By developing a spectral framework for learning both PDEs and integro-differential equations, we extend machine learning methods to apply to unbounded DEs and a larger class of problems.


title: Higher Chow cycles on some K3 surfaces with involution

abstract: We construct, for each 2<r<18, an explicit family of higher Chow cycles of type (2,1) on a family of lattice-polarized K3 surfaces of generic Picard rank r, and prove that the indecomposable part of this cycle is non-torsion for very general members of the family. These are the first explicit examples of such families in middle Picard rank. Our construction is based on singular double plane model of K3 surfaces, and the proof of indecomposability is done by a degeneration method.


title: Mask4Former: Mask Transformer for 4D Panoptic Segmentation

abstract: Accurately perceiving and tracking instances over time is essential for the decision-making processes of autonomous agents interacting safely in dynamic environments. With this intention, we propose Mask4Former for the challenging task of 4D panoptic segmentation of LiDAR point clouds. Mask4Former is the first transformer-based approach unifying semantic instance segmentation and tracking of sparse and irregular sequences of 3D point clouds into a single joint model. Our model directly predicts semantic instances and their temporal associations without relying on hand-crafted non-learned association strategies such as probabilistic clustering or voting-based center prediction. Instead, Mask4Former introduces spatio-temporal instance queries that encode the semantic and geometric properties of each semantic tracklet in the sequence. In an in-depth study, we find that promoting spatially compact instance predictions is critical as spatio-temporal instance queries tend to merge multiple semantically similar instances, even if they are spatially distant. To this end, we regress 6-DOF bounding box parameters from spatio-temporal instance queries, which are used as an auxiliary task to foster spatially compact predictions. Mask4Former achieves a new state-of-the-art on the SemanticKITTI test set with a score of 68.4 LSTQ.


title: Let's Chat to Find the APIs: Connecting Human, LLM and Knowledge Graph through AI Chain

abstract: API recommendation methods have evolved from literal and semantic keyword matching to query expansion and query clarification. The latest query clarification method is knowledge graph (KG)-based, but limitations include out-of-vocabulary (OOV) failures and rigid question templates. To address these limitations, we propose a novel knowledge-guided query clarification approach for API recommendation that leverages a large language model (LLM) guided by KG. We utilize the LLM as a neural knowledge base to overcome OOV failures, generating fluent and appropriate clarification questions and options. We also leverage the structured API knowledge and entity relationships stored in the KG to filter out noise, and transfer the optimal clarification path from KG to the LLM, increasing the efficiency of the clarification process. Our approach is designed as an AI chain that consists of five steps, each handled by a separate LLM call, to improve accuracy, efficiency, and fluency for query clarification in API recommendation. We verify the usefulness of each unit in our AI chain, which all received high scores close to a perfect 5. When compared to the baselines, our approach shows a significant improvement in MRR, with a maximum increase of 63.9% higher when the query statement is covered in KG and 37.2% when it is not. Ablation experiments reveal that the guidance of knowledge in the KG and the knowledge-guided pathfinding strategy are crucial for our approach's performance, resulting in a 19.0% and 22.2% increase in MAP, respectively. Our approach demonstrates a way to bridge the gap between KG and LLM, effectively compensating for the strengths and weaknesses of both.


title: A dual-branch model with inter- and intra-branch contrastive loss for long-tailed recognition

abstract: Real-world data often exhibits a long-tailed distribution, in which head classes occupy most of the data, while tail classes only have very few samples. Models trained on long-tailed datasets have poor adaptability to tail classes and the decision boundaries are ambiguous. Therefore, in this paper, we propose a simple yet effective model, named Dual-Branch Long-Tailed Recognition (DB-LTR), which includes an imbalanced learning branch and a Contrastive Learning Branch (CoLB). The imbalanced learning branch, which consists of a shared backbone and a linear classifier, leverages common imbalanced learning approaches to tackle the data imbalance issue. In CoLB, we learn a prototype for each tail class, and calculate an inter-branch contrastive loss, an intra-branch contrastive loss and a metric loss. CoLB can improve the capability of the model in adapting to tail classes and assist the imbalanced learning branch to learn a well-represented feature space and discriminative decision boundary. Extensive experiments on three long-tailed benchmark datasets, i.e., CIFAR100-LT, ImageNet-LT and Places-LT, show that our DB-LTR is competitive and superior to the comparative methods.


title: Finite-Key Analysis for Coherent One-Way Quantum Key Distribution

abstract: Coherent-one-way (COW) quantum key distribution (QKD) is a significant communication protocol that has been implemented experimentally and deployed in practical products due to its simple equipment requirements. However, existing security analyses of COW-QKD either provide a short transmission distance or lack immunity against coherent attacks in the finite-key regime. In this paper, we present a tight finite-key security analysis within the universally composable framework for a variant of COW-QKD, which has been proven to extend the secure transmission distance in the asymptotic case. We combine the quantum leftover hash lemma and entropic uncertainty relation to derive the key rate formula. When estimating statistical parameters, we use the recently proposed Kato's inequality to ensure security against coherent attacks and achieve a higher key rate. Our paper confirms the security and feasibility of COW-QKD for practical application and lays the foundation for further theoretical study and experimental implementation.


title: Context-I2W: Mapping Images to Context-dependent Words for Accurate Zero-Shot Composed Image Retrieval

abstract: Different from Composed Image Retrieval task that requires expensive labels for training task-specific models, Zero-Shot Composed Image Retrieval (ZS-CIR) involves diverse tasks with a broad range of visual content manipulation intent that could be related to domain, scene, object, and attribute. The key challenge for ZS-CIR tasks is to learn a more accurate image representation that has adaptive attention to the reference image for various manipulation descriptions. In this paper, we propose a novel context-dependent mapping network, named Context-I2W, for adaptively converting description-relevant Image information into a pseudo-word token composed of the description for accurate ZS-CIR. Specifically, an Intent View Selector first dynamically learns a rotation rule to map the identical image to a task-specific manipulation view. Then a Visual Target Extractor further captures local information covering the main targets in ZS-CIR tasks under the guidance of multiple learnable queries. The two complementary modules work together to map an image to a context-dependent pseudo-word token without extra supervision. Our model shows strong generalization ability on four ZS-CIR tasks, including domain conversion, object composition, object manipulation, and attribute manipulation. It obtains consistent and significant performance boosts ranging from 1.88% to 3.60% over the best methods and achieves new state-of-the-art results on ZS-CIR. Our code is available at https://github.com/Pter61/context-i2w.


title: An algorithm for $g$-invariant on unary Hermitian lattices over imaginary quadratic fields

abstract: Let $E=\mathbb{Q}\big(\sqrt{-d}\big)$ be an imaginary quadratic field for a square-free positive integer $d$, and let $\mathcal{O}$ be its ring of integers. For each positive integer $m$, let $I_m$ be the free Hermitian lattice over $\mathcal{O}$ with an orthonormal basis, let $\mathfrak{S}_d(1)$ be the set consisting of all positive definite integral unary Hermitian lattices over $\mathcal{O}$ that can be represented by some $I_m$, and let $g_d(1)$ be the least positive integer such that all Hermitian lattices in $\mathfrak{S}_d(1)$ can be uniformly represented by $I_{g_d(1)}$. The main results of this work provide an algorithm to calculate the explicit form of $\mathfrak{S}_d(1)$ and the exact value of $g_d(1)$ for every imaginary quadratic field $E$, which can be viewed as a natural extension of the Pythagoras number in the lattice setting.


title: Two-Step Active Learning for Instance Segmentation with Uncertainty and Diversity Sampling

abstract: Training high-quality instance segmentation models requires an abundance of labeled images with instance masks and classifications, which is often expensive to procure. Active learning addresses this challenge by striving for optimum performance with minimal labeling cost by selecting the most informative and representative images for labeling. Despite its potential, active learning has been less explored in instance segmentation compared to other tasks like image classification, which require less labeling. In this study, we propose a post-hoc active learning algorithm that integrates uncertainty-based sampling with diversity-based sampling. Our proposed algorithm is not only simple and easy to implement, but it also delivers superior performance on various datasets. Its practical application is demonstrated on a real-world overhead imagery dataset, where it increases the labeling efficiency fivefold.


title: CLIP-Hand3D: Exploiting 3D Hand Pose Estimation via Context-Aware Prompting

abstract: Contrastive Language-Image Pre-training (CLIP) starts to emerge in many computer vision tasks and has achieved promising performance. However, it remains underexplored whether CLIP can be generalized to 3D hand pose estimation, as bridging text prompts with pose-aware features presents significant challenges due to the discrete nature of joint positions in 3D space. In this paper, we make one of the first attempts to propose a novel 3D hand pose estimator from monocular images, dubbed as CLIP-Hand3D, which successfully bridges the gap between text prompts and irregular detailed pose distribution. In particular, the distribution order of hand joints in various 3D space directions is derived from pose labels, forming corresponding text prompts that are subsequently encoded into text representations. Simultaneously, 21 hand joints in the 3D space are retrieved, and their spatial distribution (in x, y, and z axes) is encoded to form pose-aware features. Subsequently, we maximize semantic consistency for a pair of pose-text features following a CLIP-based contrastive learning paradigm. Furthermore, a coarse-to-fine mesh regressor is designed, which is capable of effectively querying joint-aware cues from the feature pyramid. Extensive experiments on several public hand benchmarks show that the proposed model attains a significantly faster inference speed while achieving state-of-the-art performance compared to methods utilizing the similar scale backbone.


title: Align before Search: Aligning Ads Image to Text for Accurate Cross-Modal Sponsored Search

abstract: Cross-Modal sponsored search displays multi-modal advertisements (ads) when consumers look for desired products by natural language queries in search engines. Since multi-modal ads bring complementary details for query-ads matching, the ability to align ads-specific information in both images and texts is crucial for accurate and flexible sponsored search. Conventional research mainly studies from the view of modeling the implicit correlations between images and texts for query-ads matching, ignoring the alignment of detailed product information and resulting in suboptimal search performance.In this work, we propose a simple alignment network for explicitly mapping fine-grained visual parts in ads images to the corresponding text, which leverages the co-occurrence structure consistency between vision and language spaces without requiring expensive labeled training data. Moreover, we propose a novel model for cross-modal sponsored search that effectively conducts the cross-modal alignment and query-ads matching in two separate processes. In this way, the model matches the multi-modal input in the same language space, resulting in a superior performance with merely half of the training data. Our model outperforms the state-of-the-art models by 2.57% on a large commercial dataset. Besides sponsored search, our alignment method is applicable for general cross-modal search. We study a typical cross-modal retrieval task on the MSCOCO dataset, which achieves consistent performance improvement and proves the generalization ability of our method. Our code is available at https://github.com/Pter61/AlignCMSS/


title: On the Steenrod module structure of $\mathbb{R}$-motivic Spanier-Whitehead duals

abstract: The $\mathbb{R}$-motivic cohomology of an $\mathbb{R}$-motivic spectrum is a module over the $\mathbb{R}$-motivic Steenrod algebra $\mathcal{A}^{\mathbb{R}}$. In this paper, we describe how to recover the $\mathbb{R}$-motivic cohomology of the Spanier-Whitehead dual $\mathrm{DX}$ of an $\mathbb{R}$-motivic finite complex $\mathrm{X}$, as an $\mathcal{A}^{\mathbb{R}}$-module, given the $\mathcal{A}^{\mathbb{R}}$-module structure on the cohomology of $\mathrm{X}$. As an application, we show that 16 out of 128 different $\mathcal{A}^{\mathbb{R}}$-module structures on $\mathcal{A}^{\mathbb{R}}(1):= \langle \mathrm{Sq}^1, \mathrm{Sq}^2 \rangle$ are self-dual.


title: Generative Semi-supervised Learning with Meta-Optimized Synthetic Samples

abstract: Semi-supervised learning (SSL) is a promising approach for training deep classification models using labeled and unlabeled datasets. However, existing SSL methods rely on a large unlabeled dataset, which may not always be available in many real-world applications due to legal constraints (e.g., GDPR). In this paper, we investigate the research question: Can we train SSL models without real unlabeled datasets? Instead of using real unlabeled datasets, we propose an SSL method using synthetic datasets generated from generative foundation models trained on datasets containing millions of samples in diverse domains (e.g., ImageNet). Our main concepts are identifying synthetic samples that emulate unlabeled samples from generative foundation models and training classifiers using these synthetic samples. To achieve this, our method is formulated as an alternating optimization problem: (i) meta-learning of generative foundation models and (ii) SSL of classifiers using real labeled and synthetic unlabeled samples. For (i), we propose a meta-learning objective that optimizes latent variables to generate samples that resemble real labeled samples and minimize the validation loss. For (ii), we propose a simple unsupervised loss function that regularizes the feature extractors of classifiers to maximize the performance improvement obtained from synthetic samples. We confirm that our method outperforms baselines using generative foundation models on SSL. We also demonstrate that our methods outperform SSL using real unlabeled datasets in scenarios with extremely small amounts of labeled datasets. This suggests that synthetic samples have the potential to provide improvement gains more efficiently than real unlabeled data.


title: Scalable Exact Output Synchronization of Discrete-Time Multi-Agent Systems in the Presence of Disturbances and Measurement Noise With Known Frequencies

abstract: This paper aims to achieve scalable exact output and regulated output synchronization for discrete-time multi-agent systems in presence of disturbances and measurement noise with known frequencies. Both homogeneous and heterogeneous multi-agent systems are considered, with parts of agents' states accessible in the latter case. The key contribution of this paper is on the distributed protocol that only uses the information of agent models, rather than the communication network information and the agent number, so as to achieve the scalable exact synchronization under disturbances and measurement noise. The validity of the protocol is verified by numerical simulations with arbitrarily chosen number of agents.


title: The Confidence-Competence Gap in Large Language Models: A Cognitive Study

abstract: Large Language Models (LLMs) have acquired ubiquitous attention for their performances across diverse domains. Our study here searches through LLMs' cognitive abilities and confidence dynamics. We dive deep into understanding the alignment between their self-assessed confidence and actual performance. We exploit these models with diverse sets of questionnaires and real-world scenarios and extract how LLMs exhibit confidence in their responses. Our findings reveal intriguing instances where models demonstrate high confidence even when they answer incorrectly. This is reminiscent of the Dunning-Kruger effect observed in human psychology. In contrast, there are cases where models exhibit low confidence with correct answers revealing potential underestimation biases. Our results underscore the need for a deeper understanding of their cognitive processes. By examining the nuances of LLMs' self-assessment mechanism, this investigation provides noteworthy revelations that serve to advance the functionalities and broaden the potential applications of these formidable language models.


title: T-COL: Generating Counterfactual Explanations for General User Preferences on Variable Machine Learning Systems

abstract: To address the interpretability challenge in machine learning (ML) systems, counterfactual explanations (CEs) have emerged as a promising solution. CEs are unique as they provide workable suggestions to users, in addition to explaining why a certain outcome was predicted. The application of CEs encounters two main challenges: general user preferences and variable ML systems. User preferences tend to be general rather than specific, and CEs need to be adaptable to variable ML models while maintaining robustness even as these models change. Facing these challenges, we present a solution rooted in validated general user preferences, which are derived from thorough user research. We map these preferences to the properties of CEs. Additionally, we introduce a novel method, \uline{T}ree-based \uline{C}onditions \uline{O}ptional \uline{L}inks (T-COL), which incorporates two optional structures and multiple condition groups for generating CEs adaptable to general user preferences. Meanwhile, we employ T-COL to enhance the robustness of CEs with specific conditions, making them more valid even when the ML model is replaced. Our experimental comparisons under different user preferences show that T-COL outperforms all baselines, including Large Language Models which are shown to be able to generate counterfactuals.


title: Rayleigh waves in isotropic elastic materials with micro-voids

abstract: In this paper, we show that a general method introduced by Fu and Mielke allows to give a complete answer on the existence and uniqueness of a subsonic solution describing the propagation of surface waves in an isotropic half space modelled with the linear theory of isotropic elastic materials with micro-voids. Our result is valid for the entire class of materials admitting real wave propagation which include auxetic materials (negative Poisson's ration) and composite materials with negative-stiffness inclusions (negative Young's modulus). Moreover, the used method allows to formulate a simple and complete numerical strategy for the computation of the solution.


title: OSM-Net: One-to-Many One-shot Talking Head Generation with Spontaneous Head Motions

abstract: One-shot talking head generation has no explicit head movement reference, thus it is difficult to generate talking heads with head motions. Some existing works only edit the mouth area and generate still talking heads, leading to unreal talking head performance. Other works construct one-to-one mapping between audio signal and head motion sequences, introducing ambiguity correspondences into the mapping since people can behave differently in head motions when speaking the same content. This unreasonable mapping form fails to model the diversity and produces either nearly static or even exaggerated head motions, which are unnatural and strange. Therefore, the one-shot talking head generation task is actually a one-to-many ill-posed problem and people present diverse head motions when speaking. Based on the above observation, we propose OSM-Net, a \textit{one-to-many} one-shot talking head generation network with natural head motions. OSM-Net constructs a motion space that contains rich and various clip-level head motion features. Each basis of the space represents a feature of meaningful head motion in a clip rather than just a frame, thus providing more coherent and natural motion changes in talking heads. The driving audio is mapped into the motion space, around which various motion features can be sampled within a reasonable range to achieve the one-to-many mapping. Besides, the landmark constraint and time window feature input improve the accurate expression feature extraction and video generation. Extensive experiments show that OSM-Net generates more natural realistic head motions under reasonable one-to-many mapping paradigm compared with other methods.


title: Nonrelativistic expansion of type IIA NS5 brane

abstract: We carry out nonrelativistic expansion for NS5 brane based on a codimension two foliation of type IIA supergravity background. We simultaneously expand the world-volume fields in an appropriate $ 1/c^2 $ expansion together with the background fluxes. When put together, the resulting procedure yields a finite world-volume action for nonrelativistic NS5 brane that is coupled to String Newton-Cartan background.


title: AE-GPT: Using Large Language Models to Extract Adverse Events from Surveillance Reports-A Use Case with Influenza Vaccine Adverse Events

abstract: Though Vaccines are instrumental in global health, mitigating infectious diseases and pandemic outbreaks, they can occasionally lead to adverse events (AEs). Recently, Large Language Models (LLMs) have shown promise in effectively identifying and cataloging AEs within clinical reports. Utilizing data from the Vaccine Adverse Event Reporting System (VAERS) from 1990 to 2016, this study particularly focuses on AEs to evaluate LLMs' capability for AE extraction. A variety of prevalent LLMs, including GPT-2, GPT-3 variants, GPT-4, and Llama 2, were evaluated using Influenza vaccine as a use case. The fine-tuned GPT 3.5 model (AE-GPT) stood out with a 0.704 averaged micro F1 score for strict match and 0.816 for relaxed match. The encouraging performance of the AE-GPT underscores LLMs' potential in processing medical data, indicating a significant stride towards advanced AE detection, thus presumably generalizable to other AE extraction tasks.


title: Ab-initio insights into the physical properties of XIr3 (X = La, Th) superconductors: A comparative analysis

abstract: Here we report the structural, elastic, bonding, thermo-mechanical, optoelectronic and superconducting state properties of recently discovered XIr3 (X = La, Th) superconductors utilizing the density functional theory (DFT). The elastic, bonding, thermal and optical properties of these compounds are investigated for the first time. The calculated lattice and superconducting state parameters are in reasonable agreement to those found in the literature. In the ground state, both the compounds are mechanically stable and possess highly ductile character, high machinability, low Debye temperature, low bond hardness and significantly high melting point. The thermal conductivities of the compounds are found to be very low which suggests that they can be used for thermal insulation purpose. The population analysis and charge density distribution map confirm the presence of both ionic and covalent bonds in the compounds with ionic bond playing dominant roles. The calculated band structure and DOS profiles indicate metallic character. Unlike the significant anisotropy observed in elastic and thermal properties, all the optical constants of these compounds exhibit almost isotropic behavior. The optical constants correspond very well with the electronic band structure and DOS features. We have estimated the superconducting transition temperature of the compounds in this work.


title: Braiding topology of symmetry-protected degeneracy points in non-Hermitian systems

abstract: Degeneracy points in non-Hermitian systems are of great interest. While a homotopic framework exists for understanding their behavior in the absence of symmetry, it does not apply to symmetry-protected degeneracy points with reduced codimension. In this work, utilizing algebraic topology, we provide a systematic classification of these symmetry-protected degenerate points and investigate the braid conservation rule followed by them. Using a model Hamiltonian and circuit simulation, we discover that, contrary to simple annihilation, pairwise-created symmetry-protected degeneracy points merge into a higher-order degeneracy point, which goes beyond the abelian picture. Our findings empower researchers across diverse fields to uncover new phenomena and applications harnessing symmetry-protected non-Hermitian degeneracy points.


title: Tight conic approximation of testing regions for quantum statistical models and measurements

abstract: Quantum statistical models (i.e., families of normalized density matrices) and quantum measurements (i.e., positive operator-valued measures) can be regarded as linear maps: the former, mapping the space of effects to the space of probability distributions; the latter, mapping the space of states to the space of probability distributions. The images of such linear maps are called the testing regions of the corresponding model or measurement. Testing regions are notoriously impractical to treat analytically in the quantum case. Our first result is to provide an implicit outer approximation of the testing region of any given quantum statistical model or measurement in any finite dimension: namely, a region in probability space that contains the desired image, but is defined implicitly, using a formula that depends only on the given model or measurement. The outer approximation that we construct is minimal among all such outer approximations, and close, in the sense that it becomes the maximal inner approximation up to a constant scaling factor. Finally, we apply our approximation formulas to characterize, in a semi-device independent way, the ability to transform one quantum statistical model or measurement into another.


title: Magnetic Field Structure of the Crab Pulsar Wind Nebula Revealed with IXPE

abstract: We report a detailed study of the magnetic-field structure of the Crab pulsar wind nebula, using the X-ray polarization data in 2--8~keV obtained with the Imaging X-ray Polarimetry Explorer. Contamination of the pulsar emission to the data of the nebula region was removed through application of a stringent pulsation phase-cut, extracting a phase range of 0.7--1.0 only. We found that the electric field vector polarization angle (PA) was about $130^{\circ}$ from north to east with the polarization degree (PD) of about 25\% at the pulsar position, indicating that the direction of the toroidal magnetic field is perpendicular to the pulsar spin axis in the region close to the termination shock. The PA gradually deviated from the angle as an increasing function of the distance from the pulsar. There was a region of a low PD to the west of the X-ray torus. Although such a region is expected to be located at the torus edge, where geometrical depolarization due to a steep spatial variation of the PA is expected, the observed low-PD region positionally deviated from the edge. We found that the region of low PD positionally coincided with a dense filament seen in the optical band, and conjecture that the low-PD region may be produced through deflection of the pulsar wind. By comparing the values of the PD at the pulsar position between the data and a model, in which toroidal and turbulent magnetic fields were considered, we estimated the fractional energy of the turbulent magnetic field to be about $2/3$ of the total. We also evaluated a potential polarization of the northern jet in the nebula and derived the PD and PA to be about $30\%$ and $120^{\circ}$, respectively.


title: The Trickle-down Impact of Reward (In-)consistency on RLHF

abstract: Standard practice within Reinforcement Learning from Human Feedback (RLHF) involves optimizing against a Reward Model (RM), which itself is trained to reflect human preferences for desirable generations. A notable subject that is understudied is the (in-)consistency of RMs -- whether they can recognize the semantic changes to different prompts and appropriately adapt their reward assignments -- and their impact on the downstream RLHF model. In this paper, we visit a series of research questions relevant to RM inconsistency: (1) How can we measure the consistency of reward models? (2) How consistent are the existing RMs and how can we improve them? (3) In what ways does reward inconsistency influence the chatbots resulting from the RLHF model training? We propose Contrast Instructions -- a benchmarking strategy for the consistency of RM. Each example in Contrast Instructions features a pair of lexically similar instructions with different ground truth responses. A consistent RM is expected to rank the corresponding instruction and response higher than other combinations. We observe that current RMs trained with the standard ranking objective fail miserably on Contrast Instructions compared to average humans. To show that RM consistency can be improved efficiently without using extra training budget, we propose two techniques ConvexDA and RewardFusion, which enhance reward consistency through extrapolation during the RM training and inference stage, respectively. We show that RLHF models trained with a more consistent RM yield more useful responses, suggesting that reward inconsistency exhibits a trickle-down effect on the downstream RLHF process.


title: On Steinerberger Curvature and Graph Distance Matrices

abstract: Steinerberger proposed a notion of curvature on graphs (J. Graph Theory, 2023). We show that nonnegative curvature is almost preserved under three graph operations. We characterize the distance matrix and its null space after adding an edge between two graphs. Let $D$ be the graph distance matrix and $\mathbf{1}$ be the all-one vector. We provide a way to construct graphs so that the linear system $Dx = \mathbf{1}$ does not have a solution. Let $\eta$ be the Perron eigenvector of $D.$ We provide a lower bound to $\langle\eta,\mathbf{1}\rangle$ when the graph is a tree.


title: Sampling Methods for Inner Product Sketching

abstract: Recently, Bessa et al. (PODS 2023) showed that sketches based on coordinated weighted sampling theoretically and empirically outperform popular linear sketching methods like Johnson-Lindentrauss projection and CountSketch for the ubiquitous problem of inner product estimation. We further develop this finding by introducing and analyzing two alternative sampling-based methods. In contrast to the computationally expensive algorithm in Bessa et al., our methods run in linear time (to compute the sketch) and perform better in practice, significantly beating linear sketching on a variety of tasks. For example, they provide state-of-the-art results for estimating the correlation between columns in unjoined tables, a problem that we show how to reduce to inner product estimation in a black-box way. While based on known sampling techniques (threshold and priority sampling) we introduce significant new theoretical analysis to prove approximation guarantees for our methods.


title: FireFly v2: Advancing Hardware Support for High-Performance Spiking Neural Network with a Spatiotemporal FPGA Accelerator

abstract: Spiking Neural Networks (SNNs) are expected to be a promising alternative to Artificial Neural Networks (ANNs) due to their strong biological interpretability and high energy efficiency. Specialized SNN hardware offers clear advantages over general-purpose devices in terms of power and performance. However, there's still room to advance hardware support for state-of-the-art (SOTA) SNN algorithms and improve computation and memory efficiency. As a further step in supporting high-performance SNNs on specialized hardware, we introduce FireFly v2, an FPGA SNN accelerator that can address the issue of non-spike operation in current SOTA SNN algorithms, which presents an obstacle in the end-to-end deployment onto existing SNN hardware. To more effectively align with the SNN characteristics, we design a spatiotemporal dataflow that allows four dimensions of parallelism and eliminates the need for membrane potential storage, enabling on-the-fly spike processing and spike generation. To further improve hardware acceleration performance, we develop a high-performance spike computing engine as a backend based on a systolic array operating at 500-600MHz. To the best of our knowledge, FireFly v2 achieves the highest clock frequency among all FPGA-based implementations. Furthermore, it stands as the first SNN accelerator capable of supporting non-spike operations, which are commonly used in advanced SNN algorithms. FireFly v2 has doubled the throughput and DSP efficiency when compared to our previous version of FireFly and it exhibits 1.33 times the DSP efficiency and 1.42 times the power efficiency compared to the current most advanced FPGA accelerators.


title: Adaptive Real-Time Numerical Differentiation with Variable-Rate Forgetting and Exponential Resetting

abstract: Digital PID control requires a differencing operation to implement the D gain. In order to suppress the effects of noisy data, the traditional approach is to filter the data, where the frequency response of the filter is adjusted manually based on the characteristics of the sensor noise. The present paper considers the case where the characteristics of the sensor noise change over time in an unknown way. This problem is addressed by applying adaptive real-time numerical differentiation based on adaptive input and state estimation (AISE). The contribution of this paper is to extend AISE to include variable-rate forgetting with exponential resetting, which allows AISE to more rapidly respond to changing noise characteristics while enforcing the boundedness of the covariance matrix used in recursive least squares.


title: Respondent-Driven Sampling: An Overview in the Context of Human Trafficking

abstract: Respondent-driven sampling (RDS) is both a sampling strategy and an estimation method. It is commonly used to study individuals that are difficult to access with standard sampling techniques. As with any sampling strategy, RDS has advantages and challenges. This article examines recent work using RDS in the context of human trafficking. We begin with an overview of the RDS process and methodology, then discuss RDS in the particular context of trafficking. We end with a description of recent work and potential future directions.


title: Leveraging Untrustworthy Commands for Multi-Robot Coordination in Unpredictable Environments: A Bandit Submodular Maximization Approach

abstract: We study the problem of multi-agent coordination in unpredictable and partially-observable environments with untrustworthy external commands. The commands are actions suggested to the robots, and are untrustworthy in that their performance guarantees, if any, are unknown. Such commands may be generated by human operators or machine learning algorithms and, although untrustworthy, can often increase the robots' performance in complex multi-robot tasks. We are motivated by complex multi-robot tasks such as target tracking, environmental mapping, and area monitoring. Such tasks are often modeled as submodular maximization problems due to the information overlap among the robots. We provide an algorithm, Meta Bandit Sequential Greedy (MetaBSG), which enjoys performance guarantees even when the external commands are arbitrarily bad. MetaBSG leverages a meta-algorithm to learn whether the robots should follow the commands or a recently developed submodular coordination algorithm, Bandit Sequential Greedy (BSG) [1], which has performance guarantees even in unpredictable and partially-observable environments. Particularly, MetaBSG asymptotically can achieve the better performance out of the commands and the BSG algorithm, quantifying its suboptimality against the optimal time-varying multi-robot actions in hindsight. Thus, MetaBSG can be interpreted as robustifying the untrustworthy commands. We validate our algorithm in simulated scenarios of multi-target tracking.


title: ACT2G: Attention-based Contrastive Learning for Text-to-Gesture Generation

abstract: Recent increase of remote-work, online meeting and tele-operation task makes people find that gesture for avatars and communication robots is more important than we have thought. It is one of the key factors to achieve smooth and natural communication between humans and AI systems and has been intensively researched. Current gesture generation methods are mostly based on deep neural network using text, audio and other information as the input, however, they generate gestures mainly based on audio, which is called a beat gesture. Although the ratio of the beat gesture is more than 70% of actual human gestures, content based gestures sometimes play an important role to make avatars more realistic and human-like. In this paper, we propose a attention-based contrastive learning for text-to-gesture (ACT2G), where generated gestures represent content of the text by estimating attention weight for each word from the input text. In the method, since text and gesture features calculated by the attention weight are mapped to the same latent space by contrastive learning, once text is given as input, the network outputs a feature vector which can be used to generate gestures related to the content. User study confirmed that the gestures generated by ACT2G were better than existing methods. In addition, it was demonstrated that wide variation of gestures were generated from the same text by changing attention weights by creators.


title: Doppler Time-of-Flight Rendering

abstract: We introduce Doppler time-of-flight (D-ToF) rendering, an extension of ToF rendering for dynamic scenes, with applications in simulating D-ToF cameras. D-ToF cameras use high-frequency modulation of illumination and exposure, and measure the Doppler frequency shift to compute the radial velocity of dynamic objects. The time-varying scene geometry and high-frequency modulation functions used in such cameras make it challenging to accurately and efficiently simulate their measurements with existing ToF rendering algorithms. We overcome these challenges in a twofold manner: To achieve accuracy, we derive path integral expressions for D-ToF measurements under global illumination and form unbiased Monte Carlo estimates of these integrals. To achieve efficiency, we develop a tailored time-path sampling technique that combines antithetic time sampling with correlated path sampling. We show experimentally that our sampling technique achieves up to two orders of magnitude lower variance compared to naive time-path sampling. We provide an open-source simulator that serves as a digital twin for D-ToF imaging systems, allowing imaging researchers, for the first time, to investigate the impact of modulation functions, material properties, and global illumination on D-ToF imaging performance.


title: Learning to Terminate in Object Navigation

abstract: This paper tackles the critical challenge of object navigation in autonomous navigation systems, particularly focusing on the problem of target approach and episode termination in environments with long optimal episode length in Deep Reinforcement Learning (DRL) based methods. While effective in environment exploration and object localization, conventional DRL methods often struggle with optimal path planning and termination recognition due to a lack of depth information. To overcome these limitations, we propose a novel approach, namely the Depth-Inference Termination Agent (DITA), which incorporates a supervised model called the Judge Model to implicitly infer object-wise depth and decide termination jointly with reinforcement learning. We train our judge model along with reinforcement learning in parallel and supervise the former efficiently by reward signal. Our evaluation shows the method is demonstrating superior performance, we achieve a 9.3% gain on success rate than our baseline method across all room types and gain 51.2% improvements on long episodes environment while maintaining slightly better Success Weighted by Path Length (SPL). Code and resources, visualization are available at: https://github.com/HuskyKingdom/DITA_acml2023


title: Proton deflectometry analysis in magnetized plasmas: magnetic field reconstruction in one dimension

abstract: Proton deflectometry is increasingly used in magnetized high-energy-density plasmas to observe electromagnetic fields. We describe a reconstruction algorithm to recover the electromagnetic fields from proton fluence data in 1-D. The algorithm is verified against analytic solutions and applied to example data. Secondly, we study the role of source fluence uncertainty for 1-D reconstructions. We show that reconstruction boundary conditions can be used to constrain the source fluence profile, and use this to develop a reconstruction using a specified pair of boundary conditions on the magnetic field. From these considerations we experimentally demonstrate a hybrid mesh-fluence reconstruction technique where fields are reconstructed from fluence data in an interior region with boundary conditions supplied by direct mesh measurements at the boundary.


title: CoinRun: Solving Goal Misgeneralisation

abstract: Goal misgeneralisation is a key challenge in AI alignment -- the task of getting powerful Artificial Intelligences to align their goals with human intentions and human morality. In this paper, we show how the ACE (Algorithm for Concept Extrapolation) agent can solve one of the key standard challenges in goal misgeneralisation: the CoinRun challenge. It uses no new reward information in the new environment. This points to how autonomous agents could be trusted to act in human interests, even in novel and critical situations.


title: Large Language Model Soft Ideologization via AI-Self-Consciousness

abstract: Large language models (LLMs) have demonstrated human-level performance on a vast spectrum of natural language tasks. However, few studies have addressed the LLM threat and vulnerability from an ideology perspective, especially when they are increasingly being deployed in sensitive domains, e.g., elections and education. In this study, we explore the implications of GPT soft ideologization through the use of AI-self-consciousness. By utilizing GPT self-conversations, AI can be granted a vision to "comprehend" the intended ideology, and subsequently generate finetuning data for LLM ideology injection. When compared to traditional government ideology manipulation techniques, such as information censorship, LLM ideologization proves advantageous; it is easy to implement, cost-effective, and powerful, thus brimming with risks.


title: Magnetism and magnetocaloric properties of Co$_{1-x}$Mn$_x$Cr$_2$O$_4$

abstract: Co$_{1-x}$Mn$_x$Cr$_2$O$_4$ crystallizes as a normal spinel in the cubic $Fd \overline{3}m$ space group, and the end members have been reported to display a region of collinear ferrimagnetism as well as a low-temperature spin-spiral state with variable coherence lengths from 3 nm to 10 nm in polycrystalline samples. Here, we present the synthesis of the entire solid solution, and data showing that the ferrimagnetic ordering temperature as well as the spin-spiral lock-in temperature are tunable with the Co/Mn ratio. The peak magnetocaloric entropy change was determined to be $\Delta S_M$ = -5.63 J kg$^{-1}$ K$^{-1}$ in an applied magnetic field change of $\Delta H$ = 0 T to 5 T for the Mn end-member at the ferrimagnetic ordering temperature. Using density functional theory (DFT), we explore the shortcomings of the magnetic deformation proxy to identify trends in $\Delta S_M$ across composition in this spinel system, and explore future extensions of theory to address these discrepancies.


title: Subsurface cosmogenic and radiogenic production of ^{42}Ar

abstract: Radioactive decays from ^{42}Ar and its progeny ^{42}K are potential background sources in large-scale liquid-argon-based neutrino and dark matter experiments. In the atmosphere, ^{42}Ar is produced primarily by cosmogenic activation on ^{40}Ar. The use of low radioactivity argon from cosmogenically shielded underground sources can expand the reach and sensitivity of liquid-argon-based rare event searches. We estimate ^{42}Ar production underground by nuclear reactions induced by natural radioactivity and cosmic-ray muon-induced interactions. At 3,000 mwe, ^{42}Ar production rate is 1.8E-3 atoms per ton of crust per year, 7 orders of magnitude smaller than the ^{39}Ar production rate at a similar depth in the crust. By comparing the calculated production rate of ^{42}Ar to that of ^{39}Ar for which the concentration has been measured in an underground gas sample, we estimate the activity of ^{42}Ar in gas extracted from 3,000 mwe depth to be less than 2 decays per ton of argon per year.


title: Precise Well-plate Placing Utilizing Contact During Sliding with Tactile-based Pose Estimation for Laboratory Automation

abstract: Micro well-plates are an apparatus commonly used in chemical and biological experiments that are a few centimeters thick and contain wells or divets. In this paper, we aim to solve the task of placing the well-plate onto a well-plate holder (referred to as holder). This task is challenging due to the holder's raised grooves being a few millimeters in height, with a clearance of less than 1 mm between the well-plate and holder, thus requiring precise control during placing. Our placing task has the following challenges: 1) The holder's detected pose is uncertain; 2) the required accuracy is at the millimeter to sub-millimeter level due to the raised groove's shallow height and small clearance; 3) the holder is not fixed to a desk and is susceptible to movement from external forces. To address these challenges, we developed methods including a) using tactile sensors for accurate pose estimation of the grasped well-plate to handle issue (1); b) sliding the well-plate onto the target holder while maintaining contact with the holder's groove and estimating its orientation for accurate alignment. This allows for high precision control (addressing issue (2)) and prevents displacement of the holder during placement (addressing issue (3)). We demonstrate a high success rate for the well-plate placing task, even under noisy observation of the holder's pose.


title: Distributionally Robust Quickest Change Detection using Wasserstein Uncertainty Sets

abstract: The problem of quickest detection of a change in the distribution of a sequence of independent observations is considered. It is assumed that the pre-change distribution is known (accurately estimated), while the only information about the post-change distribution is through a (small) set of labeled data. This post-change data is used in a data-driven minimax robust framework, where an uncertainty set for the post-change distribution is constructed using the Wasserstein distance from the empirical distribution of the data. The robust change detection problem is studied in an asymptotic setting where the mean time to false alarm goes to infinity, for which the least favorable post-change distribution within the uncertainty set is the one that minimizes the Kullback-Leibler divergence between the post- and the pre-change distributions. It is shown that the density corresponding to the least favorable distribution is an exponentially tilted version of the pre-change density and can be calculated efficiently. A Cumulative Sum (CuSum) test based on the least favorable distribution, which is referred to as the distributionally robust (DR) CuSum test, is then shown to be asymptotically robust. The results are extended to the case where the post-change uncertainty set is a finite union of multiple Wasserstein uncertainty sets, corresponding to multiple post-change scenarios, each with its own labeled data. The proposed method is validated using synthetic and real data examples.


title: Random and Safe Cache Architecture to Defeat Cache Timing Attacks

abstract: Caches have been exploited to leak secret information due to the different times they take to handle memory accesses. Cache timing attacks include non-speculative cache side and covert channel attacks and cache-based speculative execution attacks. We first present a systematic view of the attack and defense space and show that no existing defense has addressed all cache timing attacks, which we do in this paper. We propose Random and Safe (RaS) cache architectures to decorrelate cache state changes from memory requests. RaS fills the cache with ``safe'' cache lines that are likely to be used in the future, rather than with demand-fetched, security-sensitive lines. RaS lifts the restriction on cache fills for accesses that become safe when speculative execution is resolved and authorized. Our RaS-Spec design against cache-based speculative execution attacks has a low 3.8% average performance overhead. RaS+ variants against both speculative and non-speculative attacks have security-performance trade-offs ranging from 7.9% to 45.2% average overhead.


title: Distill to Delete: Unlearning in Graph Networks with Knowledge Distillation

abstract: Graph unlearning has emerged as a pivotal method to delete information from a pre-trained graph neural network (GNN). One may delete nodes, a class of nodes, edges, or a class of edges. An unlearning method enables the GNN model to comply with data protection regulations (i.e., the right to be forgotten), adapt to evolving data distributions, and reduce the GPU-hours carbon footprint by avoiding repetitive retraining. Existing partitioning and aggregation-based methods have limitations due to their poor handling of local graph dependencies and additional overhead costs. More recently, GNNDelete offered a model-agnostic approach that alleviates some of these issues. Our work takes a novel approach to address these challenges in graph unlearning through knowledge distillation, as it distills to delete in GNN (D2DGN). It is a model-agnostic distillation framework where the complete graph knowledge is divided and marked for retention and deletion. It performs distillation with response-based soft targets and feature-based node embedding while minimizing KL divergence. The unlearned model effectively removes the influence of deleted graph elements while preserving knowledge about the retained graph elements. D2DGN surpasses the performance of existing methods when evaluated on various real-world graph datasets by up to $43.1\%$ (AUC) in edge and node unlearning tasks. Other notable advantages include better efficiency, better performance in removing target elements, preservation of performance for the retained elements, and zero overhead costs. Notably, our D2DGN surpasses the state-of-the-art GNNDelete in AUC by $2.4\%$, improves membership inference ratio by $+1.3$, requires $10.2\times10^6$ fewer FLOPs per forward pass and up to $\mathbf{3.2}\times$ faster.


title: A bialgebra theory for transposed Poisson algebras via anti-pre-Lie bialgebras and anti-pre-Lie-Poisson bialgebras

abstract: The approach for Poisson bialgebras characterized by Manin triples with respect to the invariant bilinear forms on both the commutative associative algebras and the Lie algebras is not available for giving a bialgebra theory for transposed Poisson algebras. Alternatively, we consider Manin triples with respect to the commutative 2-cocycles on the Lie algebras instead. Explicitly, we first introduce the notion of anti-pre-Lie bialgebras as the equivalent structure of Manin triples of Lie algebras with respect to the commutative 2-cocycles. Then we introduce the notion of anti-pre-Lie Poisson bialgebras, characterized by Manin triples of transposed Poisson algebras with respect to the bilinear forms which are invariant on the commutative associative algebras and commutative 2-cocycles on the Lie algebras, giving a bialgebra theory for transposed Poisson algebras. Finally the coboundary cases and the related structures such as analogues of the classical Yang-Baxter equation and $\mathcal O$-operators are studied.


title: Using Weak Supervision and Data Augmentation in Question Answering

abstract: The onset of the COVID-19 pandemic accentuated the need for access to biomedical literature to answer timely and disease-specific questions. During the early days of the pandemic, one of the biggest challenges we faced was the lack of peer-reviewed biomedical articles on COVID-19 that could be used to train machine learning models for question answering (QA). In this paper, we explore the roles weak supervision and data augmentation play in training deep neural network QA models. First, we investigate whether labels generated automatically from the structured abstracts of scholarly papers using an information retrieval algorithm, BM25, provide a weak supervision signal to train an extractive QA model. We also curate new QA pairs using information retrieval techniques, guided by the clinicaltrials.gov schema and the structured abstracts of articles, in the absence of annotated data from biomedical domain experts. Furthermore, we explore augmenting the training data of a deep neural network model with linguistic features from external sources such as lexical databases to account for variations in word morphology and meaning. To better utilize our training data, we apply curriculum learning to domain adaptation, fine-tuning our QA model in stages based on characteristics of the QA pairs. We evaluate our methods in the context of QA models at the core of a system to answer questions about COVID-19.


title: Matrix Multiplication Verification Using Coding Theory

abstract: We study the Matrix Multiplication Verification Problem (MMV) where the goal is, given three $n \times n$ matrices $A$, $B$, and $C$ as input, to decide whether $AB = C$. A classic randomized algorithm by Freivalds (MFCS, 1979) solves MMV in $\widetilde{O}(n^2)$ time, and a longstanding challenge is to (partially) derandomize it while still running in faster than matrix multiplication time (i.e., in $o(n^{\omega})$ time). To that end, we give two algorithms for MMV in the case where $AB - C$ is sparse. Specifically, when $AB - C$ has at most $O(n^{\delta})$ non-zero entries for a constant $0 \leq \delta < 2$, we give (1) a deterministic $O(n^{\omega - \varepsilon})$-time algorithm for constant $\varepsilon = \varepsilon(\delta) > 0$, and (2) a randomized $\widetilde{O}(n^2)$-time algorithm using $\delta/2 \cdot \log_2 n + O(1)$ random bits. The former algorithm is faster than the deterministic algorithm of K\"{u}nnemann (ESA, 2018) when $\delta \geq 1.056$, and the latter algorithm uses fewer random bits than the algorithm of Kimbrel and Sinha (IPL, 1993), which runs in the same time and uses $\log_2 n + O(1)$ random bits (in turn fewer than Freivalds's algorithm). We additionally study the complexity of MMV. We first show that all algorithms in a natural class of deterministic linear algebraic algorithms for MMV (including ours) require $\Omega(n^{\omega})$ time. We also show a barrier to proving a super-quadratic running time lower bound for matrix multiplication (and hence MMV) under the Strong Exponential Time Hypothesis (SETH). Finally, we study relationships between natural variants and special cases of MMV (with respect to deterministic $\widetilde{O}(n^2)$-time reductions).


title: Systematic Sampling and Validation of Machine Learning-Parameterizations in Climate Models

abstract: Progress in hybrid physics-machine learning (ML) climate simulations has been limited by the difficulty of obtaining performant coupled (i.e. online) simulations. While evaluating hundreds of ML parameterizations of subgrid closures (here of convection and radiation) offline is straightforward, online evaluation at the same scale is technically challenging. Our software automation achieves an order-of-magnitude larger sampling of online modeling errors than has previously been examined. Using this, we evaluate the hybrid climate model performance and define strategies to improve it. We show that model online performance improves when incorporating memory, a relative humidity input feature transformation, and additional input variables. We also reveal substantial variation in online error and inconsistencies between offline vs. online error statistics. The implication is that hundreds of candidate ML models should be evaluated online to detect the effects of parameterization design choices. This is considerably more sampling than tends to be reported in the current literature.


title: LAE-ST-MoE: Boosted Language-Aware Encoder Using Speech Translation Auxiliary Task for E2E Code-switching ASR

abstract: Recently, to mitigate the confusion between different languages in code-switching (CS) automatic speech recognition (ASR), the conditionally factorized models, such as the language-aware encoder (LAE), explicitly disregard the contextual information between different languages. However, this information may be helpful for ASR modeling. To alleviate this issue, we propose the LAE-ST-MoE framework. It incorporates speech translation (ST) tasks into LAE and utilizes ST to learn the contextual information between different languages. It introduces a task-based mixture of expert modules, employing separate feed-forward networks for the ASR and ST tasks. Experimental results on the ASRU 2019 Mandarin-English CS challenge dataset demonstrate that, compared to the LAE-based CTC, the LAE-ST-MoE model achieves a 9.26% mix error reduction on the CS test with the same decoding parameter. Moreover, the well-trained LAE-ST-MoE model can perform ST tasks from CS speech to Mandarin or English text.


title: BEVHeight++: Toward Robust Visual Centric 3D Object Detection

abstract: While most recent autonomous driving system focuses on developing perception methods on ego-vehicle sensors, people tend to overlook an alternative approach to leverage intelligent roadside cameras to extend the perception ability beyond the visual range. We discover that the state-of-the-art vision-centric bird's eye view detection methods have inferior performances on roadside cameras. This is because these methods mainly focus on recovering the depth regarding the camera center, where the depth difference between the car and the ground quickly shrinks while the distance increases. In this paper, we propose a simple yet effective approach, dubbed BEVHeight++, to address this issue. In essence, we regress the height to the ground to achieve a distance-agnostic formulation to ease the optimization process of camera-only perception methods. By incorporating both height and depth encoding techniques, we achieve a more accurate and robust projection from 2D to BEV spaces. On popular 3D detection benchmarks of roadside cameras, our method surpasses all previous vision-centric methods by a significant margin. In terms of the ego-vehicle scenario, our BEVHeight++ possesses superior over depth-only methods. Specifically, it yields a notable improvement of +1.9% NDS and +1.1% mAP over BEVDepth when evaluated on the nuScenes validation set. Moreover, on the nuScenes test set, our method achieves substantial advancements, with an increase of +2.8% NDS and +1.7% mAP, respectively.


title: A More General Theory of Diagnosis from First Principles

abstract: Model-based diagnosis has been an active research topic in different communities including artificial intelligence, formal methods, and control. This has led to a set of disparate approaches addressing different classes of systems and seeking different forms of diagnoses. In this paper, we resolve such disparities by generalising Reiter's theory to be agnostic to the types of systems and diagnoses considered. This more general theory of diagnosis from first principles defines the minimal diagnosis as the set of preferred diagnosis candidates in a search space of hypotheses. Computing the minimal diagnosis is achieved by exploring the space of diagnosis hypotheses, testing sets of hypotheses for consistency with the system's model and the observation, and generating conflicts that rule out successors and other portions of the search space. Under relatively mild assumptions, our algorithms correctly compute the set of preferred diagnosis candidates. The main difficulty here is that the search space is no longer a powerset as in Reiter's theory, and that, as consequence, many of the implicit properties (such as finiteness of the search space) no longer hold. The notion of conflict also needs to be generalised and we present such a more general notion. We present two implementations of these algorithms, using test solvers based on satisfiability and heuristic search, respectively, which we evaluate on instances from two real world discrete event problems. Despite the greater generality of our theory, these implementations surpass the special purpose algorithms designed for discrete event systems, and enable solving instances that were out of reach of existing diagnosis approaches.


title: MSF-Model: Modeling Metastable Failures in Replicated Storage Systems

abstract: Metastable failure is a recent abstraction of a pattern of failures that occurs frequently in real-world distributed storage systems. In this paper, we propose a formal analysis and modeling of metastable failures in replicated storage systems. We focus on a foundational problem in distributed systems -- the problem of consensus -- to have an impact on a large class of systems. Our main contribution is the development of a queuing-based analytical model, MSF-Model, that can be used to characterize and predict metastable failures. MSF-Model integrates novel modeling concepts that allow modeling metastable failures which was interactable to model prior to our work. We also perform real experiments to reproduce and validate our model. Our real experiments show that MSF-Model predicts metastable failures with high accuracy by comparing the real experiment with the predictions from the queuing-based model.


title: On inverse problems for a strongly damped wave equation on compact manifolds

abstract: We consider a strongly damped wave equation on compact manifolds, both with and without boundaries, and formulate the corresponding inverse problems. For closed manifolds, we prove that the metric can be uniquely determined, up to an isometry, from the knowledge of the source-to-solution map. Similarly, for manifolds with boundaries, we prove that the metric can be uniquely determined, up to an isometry, from partial knowledge of the Dirichlet-to-Neumann map. The key point is to retrieve the spectral information of the Laplace-Beltrami operator, from the Laplace transform of the measurements. Further we show that the metric can be determined up to an isometry, using a single measurement in both scenarios.


title: Full Breit Hamiltonian in the Multiwavelets Framework

abstract: New techniques in core-electron spectroscopy are necessary to resolve the structures of oxides of $f$-elements and other strongly correlated materials that are present only as powders and not as single crystals. Thus, accurate quantum chemical methods need to be developed to calculate core spectroscopic properties in such materials. In this contribution, we present an important development in this direction, extending our fully adaptive real-space multiwavelet basis framework to tackle the 4-component Dirac-Coulomb-Breit Hamiltonian. We show that Multiwavelets are able to reproduce one-dimensional grid-based approaches. They are however a fully three-dimensional approach which can later on be extended to molecules and materials. Our Multiwavelet implementation attained precise results irrespective of the chosen nuclear model, provided that the error threshold is tight enough and the chosen polynomial basis is sufficiently large. Furthermore, our results confirmed that in two-electron species, the magnetic and Gauge contributions from $s$-orbitals are identical in magnitude and can account for the experimental evidence from $K$ and $L$ edges.


title: A Novel Electrochemical Flow-Cell for Operando XAS Investigations On X-ray Opaque Supports

abstract: Improvement of electrochemical technologies is one of the most popular topics in the field of renewable energy. However, this process requires a deep understanding of the electrode electrolyte interface behavior under operando conditions. X-ray absorption spectroscopy (XAS) is widely employed to characterize electrode materials, providing element-selective oxidation state and local structure. Several existing cells allow studies as close as possible to realistic operating conditions, but most of them rely on the deposition of the electrodes on conductive and X-ray transparent materials, from where the radiation impinges the sample. In this work, we present a new electrochemical flow-cell for operando XAS that can be used with X-ray opaque substrates, since the signal is effectively detected from the electrode surface, as the radiation passes through a thin layer of electrolyte. The electrolyte can flow over the electrode, reducing bubble formation and avoiding strong reactant concentration gradients. We show that high-quality data can be obtained under operando conditions, thanks to the high efficiency of the cell from the hard X-ray regime down to 4 keV. We report as a case study the operando XAS investigation at the Fe and Ni K-edges on Ni-doped maghemite films, epitaxially grown on Pt substrates. The effect of the Ni content on the catalytic performances for the oxygen evolution reaction is discussed.


title: Generation of Spatiotemporal Vortex Pulses by Simple Diffractive Grating

abstract: Spatiotemporal vortex pulses are wave packets that carry transverse orbital angular momentum, exhibiting exotic structured wavefronts that can twist through space and time. Existing methods to generate these pulses require complex setups like spatial light modulators or computer-optimized structures. Here, we demonstrate a new approach to generate spatiotemporal vortex pulses using just a simple diffractive grating. The key is constructing a phase vortex in frequency-momentum space by leveraging symmetry, resonance, and diffraction. Our approach is applicable to any wave system. We use a liquid surface wave platform to directly demonstrate and observe the real-time generation and evolution of spatiotemporal vortex pulses. This straightforward technique provides opportunities to explore pulse dynamics and potential applications across different disciplines.


title: Intergenerational Equity in Models of Climate Change Mitigation: Stochastic Interest Rates introduce Adverse Effects, but (Non-linear) Funding Costs can Improve Intergenerational Equity

abstract: Assessing the costs of climate change is essential to finding efficient pathways for the transition to a net-zero emissions economy, which is necessary to stabilise global temperatures at any level. In evaluating the benefits and costs of climate change mitigation, the discount rate converting future damages and costs into net-present values influences the timing of mitigation. Here, we amend the DICE model with a stochastic interest rate model to consider the uncertainty of discount rates in the future. Since abatement reduces future damages, changing interest rates renders abatement investments more or less beneficial. Stochastic interest rates will hence lead to a stochastic abatement strategy. We introduce a simple stochastic abatement model and show that this can increase intergenerational inequality concerning cost and risk. Analysing the sensitivities of the model calibration analytically and numerically exhibits that intergenerational inequality is a consequence of the DICE model calibration (and maybe that of IAMs in general). We then show that introducing funding of abatement costs reduces the variation of future cash-flows, which occur at different times but are off-setting in their net-present value. This effect can be interpreted as improving intergenerational effort sharing, which might be neglected in classical optimisation. This mechanism is amplified, including dependence of the interest rate risk on the amount of debt to be financed, i.e. considering the limited capacity of funding sources. As an alternative policy optimisation method, we propose limiting the total cost of damages and abatement below a fixed level relative to GDP - this modification induces equality between generations compared to their respective economic welfare, inducing early and fast mitigation of climate change to keep the total cost of climate change below 3% of global GDP.


title: Rationality problem for norm one tori for $A_5$ and ${\rm PSL}_2(\mathbb{F}_8)$ extensions

abstract: We give a complete answer to the rationality problem (up to stable $k$-equivalence) for norm one tori $T=R^{(1)}_{K/k}(\mathbb{G}_m)$ of $K/k$ whose Galois closures $L/k$ are $A_5\simeq {\rm PSL}_2(\mathbb{F}_4)$ and ${\rm PSL}_2(\mathbb{F}_8)$ extensions. In particular, we prove that $T$ is stably $k$-rational for $G={\rm Gal}(L/k)\simeq {\rm PSL}_2(\mathbb{F}_{8})$, $H={\rm Gal}(L/K)\simeq (C_2)^3$ and $H\simeq (C_2)^3\rtimes C_7$ where $C_n$ is the cyclic group of order $n$. Based on the result, we conjecture that $T$ is stably $k$-rational for $G\simeq {\rm PSL}_2(\mathbb{F}_{2^d})$, $H\simeq (C_2)^d$ and $H\simeq (C_2)^d\rtimes C_{2^d-1}$. Some other cases $G\simeq A_n$, $S_n$, ${\rm GL}_n(\mathbb{F}_{p^d})$, ${\rm SL}_n(\mathbb{F}_{p^d})$, ${\rm PGL}_n(\mathbb{F}_{p^d})$, ${\rm PSL}_n(\mathbb{F}_{p^d})$ and $H\lneq G$ are also investigated for small $n$ and $p^d$.


title: Stackelberg Batch Policy Learning

abstract: Batch reinforcement learning (RL) defines the task of learning from a fixed batch of data lacking exhaustive exploration. Worst-case optimality algorithms, which calibrate a value-function model class from logged experience and perform some type of pessimistic evaluation under the learned model, have emerged as a promising paradigm for batch RL. However, contemporary works on this stream have commonly overlooked the hierarchical decision-making structure hidden in the optimization landscape. In this paper, we adopt a game-theoretical viewpoint and model the policy learning diagram as a two-player general-sum game with a leader-follower structure. We propose a novel stochastic gradient-based learning algorithm: StackelbergLearner, in which the leader player updates according to the total derivative of its objective instead of the usual individual gradient, and the follower player makes individual updates and ensures transition-consistent pessimistic reasoning. The derived learning dynamic naturally lends StackelbergLearner to a game-theoretic interpretation and provides a convergence guarantee to differentiable Stackelberg equilibria. From a theoretical standpoint, we provide instance-dependent regret bounds with general function approximation, which shows that our algorithm can learn a best-effort policy that is able to compete against any comparator policy that is covered by batch data. Notably, our theoretical regret guarantees only require realizability without any data coverage and strong function approximation conditions, e.g., Bellman closedness, which is in contrast to prior works lacking such guarantees. Through comprehensive experiments, we find that our algorithm consistently performs as well or better as compared to state-of-the-art methods in batch RL benchmark and real-world datasets.


title: Cloth2Body: Generating 3D Human Body Mesh from 2D Clothing

abstract: In this paper, we define and study a new Cloth2Body problem which has a goal of generating 3D human body meshes from a 2D clothing image. Unlike the existing human mesh recovery problem, Cloth2Body needs to address new and emerging challenges raised by the partial observation of the input and the high diversity of the output. Indeed, there are three specific challenges. First, how to locate and pose human bodies into the clothes. Second, how to effectively estimate body shapes out of various clothing types. Finally, how to generate diverse and plausible results from a 2D clothing image. To this end, we propose an end-to-end framework that can accurately estimate 3D body mesh parameterized by pose and shape from a 2D clothing image. Along this line, we first utilize Kinematics-aware Pose Estimation to estimate body pose parameters. 3D skeleton is employed as a proxy followed by an inverse kinematics module to boost the estimation accuracy. We additionally design an adaptive depth trick to align the re-projected 3D mesh better with 2D clothing image by disentangling the effects of object size and camera extrinsic. Next, we propose Physics-informed Shape Estimation to estimate body shape parameters. 3D shape parameters are predicted based on partial body measurements estimated from RGB image, which not only improves pixel-wise human-cloth alignment, but also enables flexible user editing. Finally, we design Evolution-based pose generation method, a skeleton transplanting method inspired by genetic algorithms to generate diverse reasonable poses during inference. As shown by experimental results on both synthetic and real-world data, the proposed framework achieves state-of-the-art performance and can effectively recover natural and diverse 3D body meshes from 2D images that align well with clothing.


title: Semi-device-independent certification of quantum non-Markovianity using sequential Random Access Codes

abstract: The characterization of multi-time correlations in open quantum systems is of fundamental importance. In this work, we investigate multi-time processes using the process matrix formalism and show that the presence of a quantum non-Markovian environment plays a significant role in enhancing the communication capacity in sequential prepare-transform-measure Quantum Random Access Codes (QRAC). The correlated environment enables a quantum advantage to multiple parties, even with projective measurements. In particular, we show that the Markovian and classical non-Markovian processes, i.e. quantum processes with classical feedback from the environment, do not yield sequential quantum advantage. In contrast, it is possible to achieve an advantage in the presence of a quantum non-Markovian environment. Therefore this approach allows a semi-device-independent certification of quantum non-Markovianity. As opposed to entanglement-detection criteria which require the knowledge of the complete process, this method allows to certify the presence of a quantum non-Markovian environment from the observed measurement statistics. Moreover, quantum memory ameliorates the unambiguous certifiable region of unsharp instruments in a semi-device-independent manner.