title: HalluciDet: Hallucinating RGB Modality for Person Detection Through Privileged Information

abstract: A powerful way to adapt a visual recognition model to a new domain is through image translation. However, common image translation approaches only focus on generating data from the same distribution as the target domain. Given a cross-modal application, such as pedestrian detection from aerial images, with a considerable shift in data distribution between infrared (IR) to visible (RGB) images, a translation focused on generation might lead to poor performance as the loss focuses on irrelevant details for the task. In this paper, we propose HalluciDet, an IR-RGB image translation model for object detection. Instead of focusing on reconstructing the original image on the IR modality, it seeks to reduce the detection loss of an RGB detector, and therefore avoids the need to access RGB data. This model produces a new image representation that enhances objects of interest in the scene and greatly improves detection performance. We empirically compare our approach against state-of-the-art methods for image translation and for fine-tuning on IR, and show that our HalluciDet improves detection accuracy in most cases by exploiting the privileged information encoded in a pre-trained RGB detector. Code: https://github.com/heitorrapela/HalluciDet


title: Giant 2D Skyrmion Topological Hall Effect with Ultrawide Temperature Window and Low-Current Manipulation in 2D Room-Temperature Ferromagnetic Crystals

abstract: The discovery and manipulation of topological Hall effect (THE), an abnormal magnetoelectric response mostly related to the Dzyaloshinskii-Moriya interaction (DMI), are promising for next-generation spintronic devices based on topological spin textures such as magnetic skyrmions. However, most skyrmions and THE are stabilized in a narrow temperature window either below or over room temperature with high critical current manipulation. It is still elusive and challenging to achieve large THE with both wide temperature window till room temperature and low critical current manipulation. Here, by using controllable, naturally-oxidized, sub-20 and sub-10 nm 2D van der Waals room-temperature ferromagnetic Fe3GaTe2-x crystals, robust 2D THE with ultrawide temperature window ranging in three orders of magnitude from 2 to 300 K is reported, combining with giant THE of ~5.4 micro-ohm cm at 10 K and ~0.15 micro-ohm cm at 300 K which is 1-3 orders of magnitude larger than that of all known room-temperature 2D skyrmion systems. Moreover, room-temperature current-controlled THE is also realized with a low critical current density of ~6.2*10^5 A cm^-2. First-principles calculations unveil natural oxidation-induced highly-enhanced 2D interfacial DMI reasonable for robust giant THE. This work paves the way to room-temperature, electrically-controlled 2D THE-based practical spintronic devices.


title: Learning to Rank Onset-Occurring-Offset Representations for Micro-Expression Recognition

abstract: This paper focuses on the research of micro-expression recognition (MER) and proposes a flexible and reliable deep learning method called learning to rank onset-occurring-offset representations (LTR3O). The LTR3O method introduces a dynamic and reduced-size sequence structure known as 3O, which consists of onset, occurring, and offset frames, for representing micro-expressions (MEs). This structure facilitates the subsequent learning of ME-discriminative features. A noteworthy advantage of the 3O structure is its flexibility, as the occurring frame is randomly extracted from the original ME sequence without the need for accurate frame spotting methods. Based on the 3O structures, LTR3O generates multiple 3O representation candidates for each ME sample and incorporates well-designed modules to measure and calibrate their emotional expressiveness. This calibration process ensures that the distribution of these candidates aligns with that of macro-expressions (MaMs) over time. Consequently, the visibility of MEs can be implicitly enhanced, facilitating the reliable learning of more discriminative features for MER. Extensive experiments were conducted to evaluate the performance of LTR3O using three widely-used ME databases: CASME II, SMIC, and SAMM. The experimental results demonstrate the effectiveness and superior performance of LTR3O, particularly in terms of its flexibility and reliability, when compared to recent state-of-the-art MER methods.


title: AdS$_3$ Einstein Gravity and Boundary Description: Pedagogical Review

abstract: We review the various aspects of the 3D Einstein gravity theory with a negative cosmological constant and its boundary description. We also explore its connections to CFTs, modular symmetry, and holography. It is worth noting that this particular theory is topological in nature, which means that all the physical degrees of freedom are located on the boundary. Additionally, we can derive the boundary description on a torus, which takes the form of a 2D Schwarzian theory. This observation suggests that the relevant degrees of freedom for the theory can be described using this 2D theory. Because of the renormalizability of the 3D gravity theory, one can probe the quantum regime. This suggests that it is possible to investigate quantum phenomena. Unlike the conventional CFTs, when considering the AdS$_3$ background, the boundary theory loses modular symmetry. This represents a departure from the usual behavior of CFT and is quite intriguing. The Weyl transformation induces anomaly in CFTs, and we indicate that applying this transformation to the 2D Schwarzian theory leads to similar results. Summing over all geometries with the asymptotic AdS$_3$ boundary condition is equivalent to summing over a modular group. The partition function is one-loop exact and therefore an analytical expression from the summation. This theory holds potential applications in Quantum Information and is a recurring theme in the study of holography, where gravitational theories are connected with CFTs.


title: How Nested Bars Enhance, Modulate, and are Destroyed by Gas Inflows

abstract: Gas flows in the presence of two independently-rotating nested bars remain not fully understood, which is likely to play an important role in fueling the central black hole. We use high-resolution hydrodynamical simulations with detailed models of subgrid physics to study this problem. Our results show that the inner bar in double-barred galaxies can help drive gas flow from the nuclear ring to the center. In contrast, gas inflow usually stalls at the nuclear ring in single-barred galaxies. The inner bar causes a quasi-periodic inflow with a frequency determined by the difference between the two bar pattern speeds. We find that the star formation rate is higher in the model with two bars than in that with one bar. The inner bar in our model gradually weakens and dissolves due to gas inflow over a few billion years. Star formation produces metal-rich/$\alpha$-poor stars which slows the weakening of the inner bar, but does not halt its eventual decay. We also present a qualitative comparison of the gas morphology and kinematics in our simulations with those of observed double-barred galaxies.


title: Machine learning prediction of self-assembly and analysis of molecular structure dependence on the critical packing parameter

abstract: Amphiphilic molecules spontaneously form self-assembly structures based on physical conditions such as molecular structure, concentration, and temperature. These structures exhibit various useful functions according to their morphology. The concept of the critical packing parameter serves to correlate self-organized structures with chemical composition. However, unless both molecular arrangement and self-assembly patterns are understood, direct computational utilization for molecular design remains challenging. In this study, we attempt to predict the self-assembled structure of a molecule directly from its chemical structure and analyze factors influencing it using machine learning. Dissipative particle dynamics simulations were used to reproduce many self-assembly structures composed of various chemical structures, and their critical packing parameters were calculated. A machine learning model was built using the chemical structures as input data and the critical packing parameters as output data.As a result, both Random Forest and a type of Recurrent Neural Network known as GRU demonstrated high predictive accuracy. It has been revealed through feature importance analysis and dependence on sample size that the amphiphilic nature of molecules significantly influences the self-assembly structures. Additionally, the importance of selecting an appropriate molecular structure representation for each algorithm has been emphasized. The results of this research will help to further streamline product development in the fields of materials science, materials chemistry, and medical materials.


title: Label-free Node Classification on Graphs with Large Language Models (LLMS)

abstract: In recent years, there have been remarkable advancements in node classification achieved by Graph Neural Networks (GNNs). However, they necessitate abundant high-quality labels to ensure promising performance. In contrast, Large Language Models (LLMs) exhibit impressive zero-shot proficiency on text-attributed graphs. Yet, they face challenges in efficiently processing structural data and suffer from high inference costs. In light of these observations, this work introduces a label-free node classification on graphs with LLMs pipeline, LLM-GNN. It amalgamates the strengths of both GNNs and LLMs while mitigating their limitations. Specifically, LLMs are leveraged to annotate a small portion of nodes and then GNNs are trained on LLMs' annotations to make predictions for the remaining large portion of nodes. The implementation of LLM-GNN faces a unique challenge: how can we actively select nodes for LLMs to annotate and consequently enhance the GNN training? How can we leverage LLMs to obtain annotations of high quality, representativeness, and diversity, thereby enhancing GNN performance with less cost? To tackle this challenge, we develop an annotation quality heuristic and leverage the confidence scores derived from LLMs to advanced node selection. Comprehensive experimental results validate the effectiveness of LLM-GNN. In particular, LLM-GNN can achieve an accuracy of 74.9% on a vast-scale dataset \products with a cost less than 1 dollar.


title: Score-based Diffusion Models With Self-supervised Learning For Accelerated 3D Multi-contrast Cardiac Magnetic Resonance Imaging

abstract: Long scan time significantly hinders the widespread applications of three-dimensional multi-contrast cardiac magnetic resonance (3D-MC-CMR) imaging. This study aims to accelerate 3D-MC-CMR acquisition by a novel method based on score-based diffusion models with self-supervised learning. Specifically, we first establish a mapping between the undersampled k-space measurements and the MR images, utilizing a self-supervised Bayesian reconstruction network. Secondly, we develop a joint score-based diffusion model on 3D-MC-CMR images to capture their inherent distribution. The 3D-MC-CMR images are finally reconstructed using the conditioned Langenvin Markov chain Monte Carlo sampling. This approach enables accurate reconstruction without fully sampled training data. Its performance was tested on the dataset acquired by a 3D joint myocardial T1 and T1rho mapping sequence. The T1 and T1rho maps were estimated via a dictionary matching method from the reconstructed images. Experimental results show that the proposed method outperforms traditional compressed sensing and existing self-supervised deep learning MRI reconstruction methods. It also achieves high quality T1 and T1rho parametric maps close to the reference maps obtained by traditional mapping sequences, even at a high acceleration rate of 14.


title: Mechanical structure of the nucleon and the baryon octet: Twist-2 case

abstract: We investigate the gravitational form factors (GFFs) of the nucleon and the baryon octet, decomposed into their flavor components, utilizing a pion mean-field approach grounded in the large $N_c$ limit of Quantum Chromodynamics (QCD). Our focus is on the contributions from the twist-2 operators to the flavor-triplet and octet GFFs, and we decompose the mass, angular momentum, and $D$-term form factors of the nucleon into their respective flavors. The strange quark contributions are found to be relatively mild for the mass and angular momentum form factors, while providing significant corrections to the $D$-term form factor. In the course of examining the flavor decomposition of the GFFs, we uncover that the effects of twist-4 operators play a crucial role. While the gluonic contributions are suppressed by the packing fraction of the instanton vacuum in the twist-2 case, contributions from twist-4 operators are of order unity, necessitating its explicit consideration.


title: Visual Abductive Reasoning Meets Driving Hazard Prediction

abstract: This paper addresses the problem of predicting hazards that drivers may encounter while driving a car. We formulate it as a task of anticipating impending accidents using a single input image captured by car dashcams. Unlike existing approaches to driving hazard prediction that rely on computational simulations or anomaly detection from videos, this study focuses on high-level inference from static images. The problem needs predicting and reasoning about future events based on uncertain observations, which falls under visual abductive reasoning. To enable research in this understudied area, a new dataset named the DHPR (Driving Hazard Prediction and Reasoning) dataset is created. The dataset consists of 15K dashcam images of street scenes, and each image is associated with a tuple containing car speed, a hypothesized hazard description, and visual entities present in the scene. These are annotated by human annotators, who identify risky scenes and provide descriptions of potential accidents that could occur a few seconds later. We present several baseline methods and evaluate their performance on our dataset, identifying remaining issues and discussing future directions. This study contributes to the field by introducing a novel problem formulation and dataset, enabling researchers to explore the potential of multi-modal AI for driving hazard prediction.


title: EasyPhoto: Your Smart AI Photo Generator

abstract: Stable Diffusion web UI (SD-WebUI) is a comprehensive project that provides a browser interface based on Gradio library for Stable Diffusion models. In this paper, We propose a novel WebUI plugin called EasyPhoto, which enables the generation of AI portraits. By training a digital doppelganger of a specific user ID using 5 to 20 relevant images, the finetuned model (according to the trained LoRA model) allows for the generation of AI photos using arbitrary templates. Our current implementation supports the modification of multiple persons and different photo styles. Furthermore, we allow users to generate fantastic template image with the strong SDXL model, enhancing EasyPhoto's capabilities to deliver more diverse and satisfactory results. The source code for EasyPhoto is available at: https://github.com/aigc-apps/sd-webui-EasyPhoto. We also support a webui-free version by using diffusers: https://github.com/aigc-apps/EasyPhoto. We are continuously enhancing our efforts to expand the EasyPhoto pipeline, making it suitable for any identification (not limited to just the face), and we enthusiastically welcome any intriguing ideas or suggestions.


title: LauraGPT: Listen, Attend, Understand, and Regenerate Audio with GPT

abstract: Generative Pre-trained Transformer (GPT) models have achieved remarkable performance on various natural language processing tasks. However, there has been limited research on applying similar frameworks to audio tasks. Previously proposed large language models for audio tasks either lack sufficient quantitative evaluations, or are limited to tasks for recognizing and understanding audio content, or significantly underperform existing state-of-the-art (SOTA) models. In this paper, we propose LauraGPT, a unified GPT model for audio recognition, understanding, and generation. LauraGPT is a versatile language model that can process both audio and text inputs and generate outputs in either modalities. It can perform a wide range of tasks related to content, semantics, paralinguistics, and audio-signal analysis. Some of its noteworthy tasks include automatic speech recognition, speech-to-text translation, text-to-speech synthesis, machine translation, speech enhancement, automated audio captioning, speech emotion recognition, and spoken language understanding. To achieve this goal, we use a combination of continuous and discrete features for audio. We encode input audio into continuous representations using an audio encoder and decode output audio from discrete codec codes. We then fine-tune a large decoder-only Transformer-based language model on multiple audio-to-text, text-to-audio, audio-to-audio, and text-to-text tasks using a supervised multitask learning approach. Extensive experiments show that LauraGPT achieves competitive or superior performance compared to existing SOTA models on various audio processing benchmarks.


title: Modeling non-uniform uncertainty in Reaction Prediction via Boosting and Dropout

abstract: Reaction prediction has been recognized as a critical task in synthetic chemistry, where the goal is to predict the outcome of a reaction based on the given reactants. With the widespread adoption of generative models, the Variational Autoencoder(VAE) framework has typically been employed to tackle challenges in reaction prediction, where the reactants are encoded as a condition for the decoder, which then generates the product. Despite effectiveness, these conditional VAE (CVAE) models still fail to adequately account for the inherent uncertainty in reaction prediction, which primarily stems from the stochastic reaction process. The principal limitations are twofold. Firstly, in these CVAE models, the prior is independent of the reactants, leading to a default wide and assumed uniform distribution variance of the generated product. Secondly, reactants with analogous molecular representations are presumed to undergo similar electronic transition processes, thereby producing similar products. This hinders the ability to model diverse reaction mechanisms effectively. Since the variance in outcomes is inherently non-uniform, we are thus motivated to develop a framework that generates reaction products with non-uniform uncertainty. Firstly, we eliminate the latent variable in previous CVAE models to mitigate uncontrol-label noise. Instead, we introduce randomness into product generation via boosting to ensemble diverse models and cover the range of potential outcomes, and through dropout to secure models with minor variations. Additionally, we design a ranking method to union the predictions from boosting and dropout, prioritizing the most plausible products. Experimental results on the largest reaction prediction benchmark USPTO-MIT show the superior performance of our proposed method in modeling the non-uniform uncertainty compared to baselines.


title: Terrain-Aware Quadrupedal Locomotion via Reinforcement Learning

abstract: In nature, legged animals have developed the ability to adapt to challenging terrains through perception, allowing them to plan safe body and foot trajectories in advance, which leads to safe and energy-efficient locomotion. Inspired by this observation, we present a novel approach to train a Deep Neural Network (DNN) policy that integrates proprioceptive and exteroceptive states with a parameterized trajectory generator for quadruped robots to traverse rough terrains. Our key idea is to use a DNN policy that can modify the parameters of the trajectory generator, such as foot height and frequency, to adapt to different terrains. To encourage the robot to step on safe regions and save energy consumption, we propose foot terrain reward and lifting foot height reward, respectively. By incorporating these rewards, our method can learn a safer and more efficient terrain-aware locomotion policy that can move a quadruped robot flexibly in any direction. To evaluate the effectiveness of our approach, we conduct simulation experiments on challenging terrains, including stairs, stepping stones, and poles. The simulation results demonstrate that our approach can successfully direct the robot to traverse such tough terrains in any direction. Furthermore, we validate our method on a real legged robot, which learns to traverse stepping stones with gaps over 25.5cm.


title: Surgical Gym: A high-performance GPU-based platform for reinforcement learning with surgical robots

abstract: Recent advances in robot-assisted surgery have resulted in progressively more precise, efficient, and minimally invasive procedures, sparking a new era of robotic surgical intervention. This enables doctors, in collaborative interaction with robots, to perform traditional or minimally invasive surgeries with improved outcomes through smaller incisions. Recent efforts are working toward making robotic surgery more autonomous which has the potential to reduce variability of surgical outcomes and reduce complication rates. Deep reinforcement learning methodologies offer scalable solutions for surgical automation, but their effectiveness relies on extensive data acquisition due to the absence of prior knowledge in successfully accomplishing tasks. Due to the intensive nature of simulated data collection, previous works have focused on making existing algorithms more efficient. In this work, we focus on making the simulator more efficient, making training data much more accessible than previously possible. We introduce Surgical Gym, an open-source high performance platform for surgical robot learning where both the physics simulation and reinforcement learning occur directly on the GPU. We demonstrate between 100-5000x faster training times compared with previous surgical learning platforms. The code is available at: https://github.com/SamuelSchmidgall/SurgicalGym.


title: AG-CRC: Anatomy-Guided Colorectal Cancer Segmentation in CT with Imperfect Anatomical Knowledge

abstract: When delineating lesions from medical images, a human expert can always keep in mind the anatomical structure behind the voxels. However, although high-quality (though not perfect) anatomical information can be retrieved from computed tomography (CT) scans with modern deep learning algorithms, it is still an open problem how these automatically generated organ masks can assist in addressing challenging lesion segmentation tasks, such as the segmentation of colorectal cancer (CRC). In this paper, we develop a novel Anatomy-Guided segmentation framework to exploit the auto-generated organ masks to aid CRC segmentation from CT, namely AG-CRC. First, we obtain multi-organ segmentation (MOS) masks with existing MOS models (e.g., TotalSegmentor) and further derive a more robust organ of interest (OOI) mask that may cover most of the colon-rectum and CRC voxels. Then, we propose an anatomy-guided training patch sampling strategy by optimizing a heuristic gain function that considers both the proximity of important regions (e.g., the tumor or organs of interest) and sample diversity. Third, we design a novel self-supervised learning scheme inspired by the topology of tubular organs like the colon to boost the model performance further. Finally, we employ a masked loss scheme to guide the model to focus solely on the essential learning region. We extensively evaluate the proposed method on two CRC segmentation datasets, where substantial performance improvement (5% to 9% in Dice) is achieved over current state-of-the-art medical image segmentation models, and the ablation studies further evidence the efficacy of every proposed component.


title: DORIS-MAE: Scientific Document Retrieval using Multi-level Aspect-based Queries

abstract: In scientific research, the ability to effectively retrieve relevant documents based on complex, multifaceted queries is critical. Existing evaluation datasets for this task are limited, primarily due to the high cost and effort required to annotate resources that effectively represent complex queries. To address this, we propose a novel task, Scientific DOcument Retrieval using Multi-level Aspect-based quEries (DORIS-MAE), which is designed to handle the complex nature of user queries in scientific research. We developed a benchmark dataset within the field of computer science, consisting of 100 human-authored complex query cases. For each complex query, we assembled a collection of 100 relevant documents and produced annotated relevance scores for ranking them. Recognizing the significant labor of expert annotation, we also introduce Anno-GPT, a scalable framework for validating the performance of Large Language Models (LLMs) on expert-level dataset annotation tasks. LLM annotation of the DORIS-MAE dataset resulted in a 500x reduction in cost, without compromising quality. Furthermore, due to the multi-tiered structure of these complex queries, the DORIS-MAE dataset can be extended to over 4,000 sub-query test cases without requiring additional annotation. We evaluated 17 recent retrieval methods on DORIS-MAE, observing notable performance drops compared to traditional datasets. This highlights the need for better approaches to handle complex, multifaceted queries in scientific research. Our dataset and codebase are available at https://github.com/Real-Doris-Mae/Doris-Mae-Dataset.


abstract: With the growing demand for video applications, many advanced learned video compression methods have been developed, outperforming traditional methods in terms of objective quality metrics such as PSNR. Existing methods primarily focus on objective quality but tend to overlook perceptual quality. Directly incorporating perceptual loss into a learned video compression framework is nontrivial and raises several perceptual quality issues that need to be addressed. In this paper, we investigated these issues in learned video compression and propose a novel High Visual-Fidelity Learned Video Compression framework (HVFVC). Specifically, we design a novel confidence-based feature reconstruction method to address the issue of poor reconstruction in newly-emerged regions, which significantly improves the visual quality of the reconstruction. Furthermore, we present a periodic compensation loss to mitigate the checkerboard artifacts related to deconvolution operation and optimization. Extensive experiments have shown that the proposed HVFVC achieves excellent perceptual quality, outperforming the latest VVC standard with only 50% required bitrate.


title: The Cost of Down-Scaling Language Models: Fact Recall Deteriorates before In-Context Learning

abstract: How does scaling the number of parameters in large language models (LLMs) affect their core capabilities? We study two natural scaling techniques -- weight pruning and simply training a smaller or larger model, which we refer to as dense scaling -- and their effects on two core capabilities of LLMs: (a) recalling facts presented during pre-training and (b) processing information presented in-context during inference. By curating a suite of tasks that help disentangle these two capabilities, we find a striking difference in how these two abilities evolve due to scaling. Reducing the model size by more than 30\% (via either scaling approach) significantly decreases the ability to recall facts seen in pre-training. Yet, a 60--70\% reduction largely preserves the various ways the model can process in-context information, ranging from retrieving answers from a long context to learning parameterized functions from in-context exemplars. The fact that both dense scaling and weight pruning exhibit this behavior suggests that scaling model size has an inherently disparate effect on fact recall and in-context learning.


title: VoiceExtender: Short-utterance Text-independent Speaker Verification with Guided Diffusion Model

abstract: Speaker verification (SV) performance deteriorates as utterances become shorter. To this end, we propose a new architecture called VoiceExtender which provides a promising solution for improving SV performance when handling short-duration speech signals. We use two guided diffusion models, the built-in and the external speaker embedding (SE) guided diffusion model, both of which utilize a diffusion model-based sample generator that leverages SE guidance to augment the speech features based on a short utterance. Extensive experimental results on the VoxCeleb1 dataset show that our method outperforms the baseline, with relative improvements in equal error rate (EER) of 46.1%, 35.7%, 10.4%, and 5.7% for the short utterance conditions of 0.5, 1.0, 1.5, and 2.0 seconds, respectively.


title: Hypergraph Analysis Based on a Compatible Tensor Product Structure

abstract: We propose a tensor product structure that is compatible with the hypergraph structure. We define the algebraic connectivity of the $(m+1)$-uniform hypergraph in this product, and prove the relationship with the vertex connectivity. We introduce some connectivity optimization problem into the hypergraph, and solve them with the algebraic connectivity. We introduce the Laplacian eigenmap algorithm to the hypergraph under our tensor product.


title: Exploration in Booster Reuse Employing Aerosurfaces

abstract: A new idea for reusing rockets, based on the Energia 2 launch vehicle, using deployable wings is proposed. A mission design is planned with an expected maximum altitude of 500 m. Following that systems engineering was used to manage the design process of separate components, which in turn led to the manufacturing plans for the separate components. The sizing studies were used to determine how big each component would need to be, and a weight and balances sheet was used to determine the position of the wings for optimal static margin and stability percentage. A derivation was made using basic Newtonian mechanics for determining the maximum mass of the rocket given a target altitude. Following that Computer Assisted Design (CAD) drawings were created of critical components before outlining the necessary structural tests and the flight test plan. A MatLab script to determine static stability was used which confirmed the stability of the booster at angle of attacks from 0 to 5 degrees. A MatLab script to determine glide ratio and range was used on the booster and Energia 2 to show scalability, and which was found feasible.


title: Invariant Relations: A Bridge from Programs to Equations

abstract: Great advances in program analysis would be enabled if it were possible to derive the function of a program from inputs to outputs (or from initial states to final states, depending on how we model program semantics). Efforts to do so have always stalled against the difficulty to derive the function of loops; the expedient solution to capture the function of loops by unrolling them an arbitrary number of iterations is clearly inadequate. In this paper, we propose a relations-based method to derive the function of a C-like program, including programs that have loops nested to an arbitrary level. To capture the semantics of loops, we use the concept of invariant relation.


title: Automatic and Efficient Customization of Neural Networks for ML Applications

abstract: ML APIs have greatly relieved application developers of the burden to design and train their own neural network models -- classifying objects in an image can now be as simple as one line of Python code to call an API. However, these APIs offer the same pre-trained models regardless of how their output is used by different applications. This can be suboptimal as not all ML inference errors can cause application failures, and the distinction between inference errors that can or cannot cause failures varies greatly across applications. To tackle this problem, we first study 77 real-world applications, which collectively use six ML APIs from two providers, to reveal common patterns of how ML API output affects applications' decision processes. Inspired by the findings, we propose ChameleonAPI, an optimization framework for ML APIs, which takes effect without changing the application source code. ChameleonAPI provides application developers with a parser that automatically analyzes the application to produce an abstract of its decision process, which is then used to devise an application-specific loss function that only penalizes API output errors critical to the application. ChameleonAPI uses the loss function to efficiently train a neural network model customized for each application and deploys it to serve API invocations from the respective application via existing interface. Compared to a baseline that selects the best-of-all commercial ML API, we show that ChameleonAPI reduces incorrect application decisions by 43%.


title: Tight Rates in Supervised Outlier Transfer Learning

abstract: A critical barrier to learning an accurate decision rule for outlier detection is the scarcity of outlier data. As such, practitioners often turn to the use of similar but imperfect outlier data from which they might transfer information to the target outlier detection task. Despite the recent empirical success of transfer learning approaches in outlier detection, a fundamental understanding of when and how knowledge can be transferred from a source to a target outlier detection task remains elusive. In this work, we adopt the traditional framework of Neyman-Pearson classification -- which formalizes supervised outlier detection -- with the added assumption that one has access to some related but imperfect outlier data. Our main results are as follows: We first determine the information-theoretic limits of the problem under a measure of discrepancy that extends some existing notions from traditional balanced classification; interestingly, unlike in balanced classification, seemingly very dissimilar sources can provide much information about a target, thus resulting in fast transfer. We then show that, in principle, these information-theoretic limits are achievable by adaptive procedures, i.e., procedures with no a priori information on the discrepancy between source and target outlier distributions.


title: Improving Adversarial Attacks on Latent Diffusion Model

abstract: Adversarial attacks on Latent Diffusion Model (LDM), the state-of-the-art image generative model, have been adopted as effective protection against malicious finetuning of LDM on unauthorized images. We show that these attacks add an extra error to the score function of adversarial examples predicted by LDM. LDM finetuned on these adversarial examples learns to lower the error by a bias, from which the model is attacked and predicts the score function with biases. Based on the dynamics, we propose to improve the adversarial attack on LDM by Attacking with Consistent score-function Errors (ACE). ACE unifies the pattern of the extra error added to the predicted score function. This induces the finetuned LDM to learn the same pattern as a bias in predicting the score function. We then introduce a well-crafted pattern to improve the attack. Our method outperforms state-of-the-art methods in adversarial attacks on LDM.


title: PatchProto Networks for Few-shot Visual Anomaly Classification

abstract: The visual anomaly diagnosis can automatically analyze the defective products, which has been widely applied in industrial quality inspection. The anomaly classification can classify the defective products into different categories. However, the anomaly samples are hard to access in practice, which impedes the training of canonical machine learning models. This paper studies a practical issue that anomaly samples for training are extremely scarce, i.e., few-shot learning (FSL). Utilizing the sufficient normal samples, we propose PatchProto networks for few-shot anomaly classification. Different from classical FSL methods, PatchProto networks only extract CNN features of defective regions of interest, which serves as the prototypes for few-shot learning. Compared with basic few-shot classifier, the experiment results on MVTec-AD dataset show PatchProto networks significantly improve the few-shot anomaly classification accuracy.


title: SeeDS: Semantic Separable Diffusion Synthesizer for Zero-shot Food Detection

abstract: Food detection is becoming a fundamental task in food computing that supports various multimedia applications, including food recommendation and dietary monitoring. To deal with real-world scenarios, food detection needs to localize and recognize novel food objects that are not seen during training, demanding Zero-Shot Detection (ZSD). However, the complexity of semantic attributes and intra-class feature diversity poses challenges for ZSD methods in distinguishing fine-grained food classes. To tackle this, we propose the Semantic Separable Diffusion Synthesizer (SeeDS) framework for Zero-Shot Food Detection (ZSFD). SeeDS consists of two modules: a Semantic Separable Synthesizing Module (S$^3$M) and a Region Feature Denoising Diffusion Model (RFDDM). The S$^3$M learns the disentangled semantic representation for complex food attributes from ingredients and cuisines, and synthesizes discriminative food features via enhanced semantic information. The RFDDM utilizes a novel diffusion model to generate diversified region features and enhances ZSFD via fine-grained synthesized features. Extensive experiments show the state-of-the-art ZSFD performance of our proposed method on two food datasets, ZSFooD and UECFOOD-256. Moreover, SeeDS also maintains effectiveness on general ZSD datasets, PASCAL VOC and MS COCO. The code and dataset can be found at https://github.com/LanceZPF/SeeDS.


title: A dimension-reduced variational approach for solving physics-based inverse problems using generative adversarial network priors and normalizing flows

abstract: We propose a novel modular inference approach combining two different generative models -- generative adversarial networks (GAN) and normalizing flows -- to approximate the posterior distribution of physics-based Bayesian inverse problems framed in high-dimensional ambient spaces. We dub the proposed framework GAN-Flow. The proposed method leverages the intrinsic dimension reduction and superior sample generation capabilities of GANs to define a low-dimensional data-driven prior distribution. Once a trained GAN-prior is available, the inverse problem is solved entirely in the latent space of the GAN using variational Bayesian inference with normalizing flow-based variational distribution, which approximates low-dimensional posterior distribution by transforming realizations from the low-dimensional latent prior (Gaussian) to corresponding realizations of a low-dimensional variational posterior distribution. The trained GAN generator then maps realizations from this approximate posterior distribution in the latent space back to the high-dimensional ambient space. We also propose a two-stage training strategy for GAN-Flow wherein we train the two generative models sequentially. Thereafter, GAN-Flow can estimate the statistics of posterior-predictive quantities of interest at virtually no additional computational cost. The synergy between the two types of generative models allows us to overcome many challenges associated with the application of Bayesian inference to large-scale inverse problems, chief among which are describing an informative prior and sampling from the high-dimensional posterior. We demonstrate the efficacy and flexibility of GAN-Flow on various physics-based inverse problems of varying ambient dimensionality and prior knowledge using different types of GANs and normalizing flows.


title: EMO: Earth Mover Distance Optimization for Auto-Regressive Language Modeling

abstract: Neural language models are probabilistic models of human text. They are predominantly trained using maximum likelihood estimation (MLE), which is equivalent to minimizing the forward cross-entropy between the empirical data distribution and the model distribution. However, various degeneration phenomena are still widely observed when decoding from the distributions learned by such models. We establish that the forward cross-entropy is suboptimal as a distance metric for aligning human and model distribution due to its (1) recall-prioritization (2) negative diversity ignorance and (3) train-test mismatch. In this paper, we propose Earth Mover Distance Optimization (EMO) for auto-regressive language modeling. EMO capitalizes on the inherent properties of earth mover distance to address the aforementioned challenges. Due to the high complexity of direct computation, we further introduce a feasible upper bound for EMO to ease end-to-end training. Upon extensive evaluation of language models trained using EMO and MLE. We find that EMO demonstrates a consistently better language modeling performance than MLE across domains. Moreover, EMO demonstrates noteworthy enhancements in downstream performance with minimal fine-tuning on merely 25,000 sentences. This highlights the tremendous potential of EMO as a lightweight calibration method for enhancing large-scale pre-trained language models.


title: Lipschitz regularity for a priori bounded minimizers of integral functionals with nonstandard growth

abstract: We establish the Lipschitz regularity of the a priori bounded local minimizers of integral functionals with non autonomous energy densities satisfying non standard growth conditions under a sharp bound on the gap between the growth and the ellipticity exponent.


title: Robustness-enhanced Uplift Modeling with Adversarial Feature Desensitization

abstract: Uplift modeling has shown very promising results in online marketing. However, most existing works are prone to the robustness challenge in some practical applications. In this paper, we first present a possible explanation for the above phenomenon. We verify that there is a feature sensitivity problem in online marketing using different real-world datasets, where the perturbation of some key features will seriously affect the performance of the uplift model and even cause the opposite trend. To solve the above problem, we propose a novel robustness-enhanced uplift modeling framework with adversarial feature desensitization (RUAD). Specifically, our RUAD can more effectively alleviate the feature sensitivity of the uplift model through two customized modules, including a feature selection module with joint multi-label modeling to identify a key subset from the input features and an adversarial feature desensitization module using adversarial training and soft interpolation operations to enhance the robustness of the model against this selected subset of features. Finally, we conduct extensive experiments on a public dataset and a real product dataset to verify the effectiveness of our RUAD in online marketing. In addition, we also demonstrate the robustness of our RUAD to the feature sensitivity, as well as the compatibility with different uplift models.


title: DNA-Based Data Storage Systems: A Review of Implementations and Code Constructions

abstract: In this review paper, we delve into the nascent field of molecular data storage, focusing on system implementations and code constructions. We start by providing an overview of basic concepts in synthetic and computational biology. Afterwards, we proceed with a review of the diverse approaches followed to implement such systems. In the process, we identify new problems in communication and coding theory, and discuss some relevant results pertaining to DNA sequence profiles, coded trace reconstruction, coding for DNA punchcard systems and coding for unique reconstruction.


title: Geometric model for weighted projective lines of type $(p,q)$

abstract: We give a geometric model for the category of coherent sheaves over the weighted projective line of type $(p,q)$ in terms of an annulus with marked points on its boundary. We establish a bijection between indecomposable sheaves over the weighted projective line and certain homotopy classes of oriented curves in the annulus, and prove that the dimension of extension group between indecomposable sheaves equals to the positive intersection number between the corresponding curves. By using the geometric model, we provide a combinatorial description for the titling graph of tilting bundles, which is composed by quadrilaterals (or degenerated to a line). Moreover, we obtain that the automorphism group of the coherent sheaf category is isomorphic to the mapping class group of the marked annulus, and show the compatibility of their actions on the tilting graph of coherent sheaves and on the triangulation of the geometric model respectively. A geometric description of the perpendicular category with respect to an exceptional sheaf is presented at the end of the paper.


title: Serving Deep Learning Model in Relational Databases

abstract: Serving deep learning (DL) models on relational data has become a critical requirement across diverse commercial and scientific domains, sparking growing interest recently. In this visionary paper, we embark on a comprehensive exploration of representative architectures to address the requirement. We highlight three pivotal paradigms: The state-of-the-artDL-Centricarchitecture offloadsDL computations to dedicated DL frameworks. The potential UDF-Centric architecture encapsulates one or more tensor computations into User Defined Functions (UDFs) within the database system. The potentialRelation-Centricarchitecture aims to represent a large-scale tensor computation through relational operators. While each of these architectures demonstrates promise in specific use scenarios, we identify urgent requirements for seamless integration of these architectures and the middle ground between these architectures. We delve into the gaps that impede the integration and explore innovative strategies to close them. We present a pathway to establish a novel database system for enabling a broad class of data-intensive DL inference applications.


title: Optical system for extremely large spectroscopic survey telescope

abstract: This article presents research work on a spectroscopic survey telescope. Our idea is as follows: for such a telescope, a pure reflecting optical system is designed, which should have an aperture and a field of view (FOV) both as large as possible and excellent image quality, and then a strip lensm (lens-prism) atmospheric dispersion corrector (S-ADC) is added, only for correcting the atmospheric dispersion. Given the fund limitation and the simplicity of scaling up, some 12-m telescopes are designed as examples. Su, Korsch, and Meinel put forward the four-mirror Nasmyth systems I and II, which are used in this paper. FOVs of 1.5{\deg}, 2{\deg}, and 2.5{\deg} are selected. For all systems, the image qualities are excellent. Because the S-ADC relaxes the optical glass size restriction, this 12-m telescope with a FOV of 2.5{\deg} can be magnified in proportion to a 16-m telescope. Its etendue (from French \'etendue) and focal surface will now be the largest in the world. In such a telescope, a pure reflecting optical system can also be obtained. A subsequent coud\'e system is designed with excellent image quality.


title: Tree-GPT: Modular Large Language Model Expert System for Forest Remote Sensing Image Understanding and Interactive Analysis

abstract: This paper introduces a novel framework, Tree-GPT, which incorporates Large Language Models (LLMs) into the forestry remote sensing data workflow, thereby enhancing the efficiency of data analysis. Currently, LLMs are unable to extract or comprehend information from images and may generate inaccurate text due to a lack of domain knowledge, limiting their use in forestry data analysis. To address this issue, we propose a modular LLM expert system, Tree-GPT, that integrates image understanding modules, domain knowledge bases, and toolchains. This empowers LLMs with the ability to comprehend images, acquire accurate knowledge, generate code, and perform data analysis in a local environment. Specifically, the image understanding module extracts structured information from forest remote sensing images by utilizing automatic or interactive generation of prompts to guide the Segment Anything Model (SAM) in generating and selecting optimal tree segmentation results. The system then calculates tree structural parameters based on these results and stores them in a database. Upon receiving a specific natural language instruction, the LLM generates code based on a thought chain to accomplish the analysis task. The code is then executed by an LLM agent in a local environment and . For ecological parameter calculations, the system retrieves the corresponding knowledge from the knowledge base and inputs it into the LLM to guide the generation of accurate code. We tested this system on several tasks, including Search, Visualization, and Machine Learning Analysis. The prototype system performed well, demonstrating the potential for dynamic usage of LLMs in forestry research and environmental sciences.


title: Review of Machine Learning Techniques for Power Electronics Control and Optimization

abstract: In the rapidly advancing landscape of contemporary technology, power electronics assume a pivotal role across diverse applications, ranging from renewable energy systems to electric vehicles and consumer electronics. The efficacy and precision of these power electronics systems stand as cornerstones of their functionality. Within this context, the integration of machine learning techniques assumes paramount significance. This article endeavors to present an extensive and comprehensive review of the machine learning techniques that find application in power electronics control and optimization. Through meticulous exploration, we aim to elucidate the profound potential of these methods in shaping the future of power electronics control and optimization.


title: Importance of physical information on the prediction of heavy-ion fusion cross section with machine learning

abstract: In this work, the Light Gradient Boosting Machine (LightGBM), which is a modern decision tree based machine-learning algorithm, is used to study the fusion cross section (CS) of heavy-ion reaction. Several basic quantities (e.g., mass number and proton number of projectile and target) and the CS obtained from phenomenological formula are fed into the LightGBM algorithm to predict the CS. It is found that, on the validation set, the mean absolute error (MAE) which measures the average magnitude of the absolute difference between $log_{10}$ of the predicted CS and experimental CS is 0.129 by only using the basic quantities as the input, this value is smaller than 0.154 obtained from the empirical coupled channel model. MAE can be further reduced to 0.08 by including an physical-informed input feature. The MAE on the test set (it consists of 280 data points from 18 reaction systems that not included in the training set) is about 0.19 and 0.53 by including and excluding the physical-informed feature, respectively. We further verify the LightGBM predictions by comparing the CS of $^{ 40,48}{\rm Ca }$+$^{78}{\rm Ni}$ obtained from the density-constrained time-dependent Hartree-Fock approach. Our study demonstrates the importance of physical information in predicting fusion cross section of heavy-ion reaction with machine learning.


title: Twin Graph-based Anomaly Detection via Attentive Multi-Modal Learning for Microservice System

abstract: Microservice architecture has sprung up over recent years for managing enterprise applications, due to its ability to independently deploy and scale services. Despite its benefits, ensuring the reliability and safety of a microservice system remains highly challenging. Existing anomaly detection algorithms based on a single data modality (i.e., metrics, logs, or traces) fail to fully account for the complex correlations and interactions between different modalities, leading to false negatives and false alarms, whereas incorporating more data modalities can offer opportunities for further performance gain. As a fresh attempt, we propose in this paper a semi-supervised graph-based anomaly detection method, MSTGAD, which seamlessly integrates all available data modalities via attentive multi-modal learning. First, we extract and normalize features from the three modalities, and further integrate them using a graph, namely MST (microservice system twin) graph, where each node represents a service instance and the edge indicates the scheduling relationship between different service instances. The MST graph provides a virtual representation of the status and scheduling relationships among service instances of a real-world microservice system. Second, we construct a transformer-based neural network with both spatial and temporal attention mechanisms to model the inter-correlations between different modalities and temporal dependencies between the data points. This enables us to detect anomalies automatically and accurately in real-time. The source code of MSTGAD is publicly available at https://github.com/alipay/microservice_system_twin_graph_based_anomaly_detection.


title: Non-separable Mean Field Games for Pedestrian Flow: Generalized Hughes Model

abstract: In this paper, we present a new generalized Hughes model designed to intelligently depict pedestrian congestion dynamics, allowing pedestrian groups to either navigate through or circumvent high-density regions. First, we describe the microscopic settings of the model. The corresponding optimization problems are deterministic and can be formulated by a closed-loop model predictive control strategy. This microscopic setup leads in the mean-field limit to the Generalized Hughes model which is a class of non-separable mean field games system, i.e., Fokker-Planck equation and viscous Hamilton-Jacobi Bellman equation are coupled in a forward-backward structure. We give an overview on the mean field games in connection to our intelligent fluid model. Therefore, we show the existence of weak solutions to the Generalized Hughes model and analyze the vanishing viscosity limit of weak solutions. Finally, we illustrate the generalized Hughes model with various numerical experiments.


title: Integrating Contrastive Learning into a Multitask Transformer Model for Effective Domain Adaptation

abstract: While speech emotion recognition (SER) research has made significant progress, achieving generalization across various corpora continues to pose a problem. We propose a novel domain adaptation technique that embodies a multitask framework with SER as the primary task, and contrastive learning and information maximisation loss as auxiliary tasks, underpinned by fine-tuning of transformers pre-trained on large language models. Empirical results obtained through experiments on well-established datasets like IEMOCAP and MSP-IMPROV, illustrate that our proposed model achieves state-of-the-art performance in SER within cross-corpus scenarios.


title: EdgeFD: An Edge-Friendly Drift-Aware Fault Diagnosis System for Industrial IoT

abstract: Recent transfer learning (TL) approaches in industrial intelligent fault diagnosis (FD) mostly follow the "pre-train and fine-tuning" paradigm to address data drift, which emerges from variable working conditions. However, we find that this approach is prone to the phenomenon known as catastrophic forgetting. Furthermore, performing frequent models fine-tuning on the resource-constrained edge nodes can be computationally expensive and unnecessary, given the excellent transferability demonstrated by existing models. In this work, we propose the Drift-Aware Weight Consolidation (DAWC), a method optimized for edge deployments, mitigating the challenges posed by frequent data drift in the industrial Internet of Things (IIoT). DAWC efficiently manages multiple data drift scenarios, minimizing the need for constant model fine-tuning on edge devices, thereby conserving computational resources. By detecting drift using classifier confidence and estimating parameter importance with the Fisher Information Matrix, a tool that measures parameter sensitivity in probabilistic models, we introduce a drift detection module and a continual learning module to gradually equip the FD model with powerful generalization capabilities. Experimental results demonstrate that our proposed DAWC achieves superior performance compared to existing techniques while also ensuring compatibility with edge computing constraints. Additionally, we have developed a comprehensive diagnosis and visualization platform.


title: Multi-scale MRI reconstruction via dilated ensemble networks

abstract: As aliasing artefacts are highly structural and non-local, many MRI reconstruction networks use pooling to enlarge filter coverage and incorporate global context. However, this inadvertently impedes fine detail recovery as downsampling creates a resolution bottleneck. Moreover, real and imaginary features are commonly split into separate channels, discarding phase information particularly important to high frequency textures. In this work, we introduce an efficient multi-scale reconstruction network using dilated convolutions to preserve resolution and experiment with a complex-valued version using complex convolutions. Inspired by parallel dilated filters, multiple receptive fields are processed simultaneously with branches that see both large structural artefacts and fine local features. We also adopt dense residual connections for feature aggregation to efficiently increase scale and the deep cascade global architecture to reduce overfitting. The real-valued version of this model outperformed common reconstruction architectures as well as a state-of-the-art multi-scale network whilst being three times more efficient. The complex-valued network yielded better qualitative results when more phase information was present.


title: Offline Imitation Learning with Variational Counterfactual Reasoning

abstract: In offline imitation learning (IL), an agent aims to learn an optimal expert behavior policy without additional online environment interactions. However, in many real-world scenarios, such as robotics manipulation, the offline dataset is collected from suboptimal behaviors without rewards. Due to the scarce expert data, the agents usually suffer from simply memorizing poor trajectories and are vulnerable to variations in the environments, lacking the capability of generalizing to new environments. To automatically generate high-quality expert data and improve the generalization ability of the agent, we propose a framework named \underline{O}ffline \underline{I}mitation \underline{L}earning with \underline{C}ounterfactual data \underline{A}ugmentation (OILCA) by doing counterfactual inference. In particular, we leverage identifiable variational autoencoder to generate \textit{counterfactual} samples for expert data augmentation. We theoretically analyze the influence of the generated expert data and the improvement of generalization. Moreover, we conduct extensive experiments to demonstrate that our approach significantly outperforms various baselines on both \textsc{DeepMind Control Suite} benchmark for in-distribution performance and \textsc{CausalWorld} benchmark for out-of-distribution generalization. Our code is available at \url{https://github.com/ZexuSun/OILCA-NeurIPS23}.


title: Numerical simulation of defect states and electron transport mechanisms in amorphous oxide thin film transistors

abstract: Physics based numerical simulation has been carried out to probe the sub-gap density of states (DOS) and underlying electron transport properties of amorphous oxide based thin film transistors (TFTs). The DOS model of TFTs consists of exponential band tails, Gaussian shallow donor levels and deep acceptor states. Electrical transport and various TFT performance parameters are found to be critically dependent on the sub-gap DOS. At low gate bias, when Fermi level lies below the conduction band mobility edge, defect states mediated trap limited conduction is found to be the dominant transport mechanism. However, at relatively higher gate bias, percolation conduction above the mobility edge becomes prevalent. Such possible crossover of electron transport is well corroborated by gate bias dependent band bending and induced free electron density in the channel layer. Such studies are important to unravel the critical role of sub-gap DOS on the electrical performance and charge transport processes of disordered amorphous oxide TFTs.


title: Enhancing Virtual Distillation with Circuit Cutting for Quantum Error Mitigation

abstract: Virtual distillation is a technique that aims to mitigate errors in noisy quantum computers. It works by preparing multiple copies of a noisy quantum state, bridging them through a circuit, and conducting measurements. As the number of copies increases, this process allows for the estimation of the expectation value with respect to a state that approaches the ideal pure state rapidly. However, virtual distillation faces a challenge in realistic scenarios: preparing multiple copies of a quantum state and bridging them through a circuit in a noisy quantum computer will significantly increase the circuit size and introduce excessive noise, which will degrade the performance of virtual distillation. To overcome this challenge, we propose an error mitigation strategy that uses circuit-cutting technology to cut the entire circuit into fragments. With this approach, the fragments responsible for generating the noisy quantum state can be executed on a noisy quantum device, while the remaining fragments are efficiently simulated on a noiseless classical simulator. By running each fragment circuit separately on quantum and classical devices and recombining their results, we can reduce the noise accumulation and enhance the effectiveness of the virtual distillation technique. Our strategy has good scalability in terms of both runtime and computational resources. We demonstrate our strategy's effectiveness through noisy simulation and experiments on a real quantum device.


title: Time-dependent mediators in survival analysis: Graphical representation of causal assumptions

abstract: We study time-dependent mediators in survival analysis using a treatment separation approach due to Didelez [2019] and based on earlier work by Robins and Richardson [2011]. This approach avoids nested counterfactuals and crossworld assumptions which are otherwise common in mediation analysis. The causal model of treatment, mediators, covariates, confounders and outcome is represented by causal directed acyclic graphs (DAGs). However, the DAGs tend to be very complex when we have measurements at a large number of time points. We therefore suggest using so-called rolled graphs in which a node represents an entire coordinate process instead of a single random variable, leading us to far simpler graphical representations. The rolled graphs are not necessarily acyclic; they can be analyzed by $\delta$-separation which is the appropriate graphical separation criterion in this class of graphs and analogous to $d$-separation. In particular, $\delta$-separation is a graphical tool for evaluating if the conditions of the mediation analysis are met or if unmeasured confounders influence the estimated effects. We also state a mediational g-formula. This is similar to the approach in Vansteelandt et al. [2019] although that paper has a different conceptual basis. Finally, we apply this framework to a statistical model based on a Cox model with an added treatment effect.survival analysis; mediation; causal inference; graphical models; local independence graphs


title: Complexity and order in approximate quantum error-correcting codes

abstract: We establish rigorous connections between quantum circuit complexity and approximate quantum error correction (AQEC) properties, covering both all-to-all and geometric scenarios including lattice systems. To this end, we introduce a type of code parameter that we call subsystem variance, which is closely related to the optimal AQEC precision. Our key finding is that if the subsystem variance is below an $O(k/n)$ threshold then any state in the code subspace must obey certain circuit complexity lower bounds, which identify nontrivial ``phases'' of codes. Based on our results, we propose $O(k/n)$ as a boundary between subspaces that should and should not count as AQEC codes. This theory of AQEC provides a versatile framework for understanding the quantum complexity and order of many-body quantum systems, offering new insights for wide-ranging physical scenarios, in particular topological order and critical quantum systems which are of outstanding importance in many-body and high energy physics. We observe from various different perspectives that roughly $O(1/n)$ represents a common, physically significant ``scaling threshold'' of subsystem variance for features associated with nontrivial quantum order.

categories: quant-ph cond-mat.str-el hep-th math-ph math.MP


title: DP-starJ: A Differential Private Scheme towards Analytical Star-Join Queries

abstract: Star-join query is the fundamental task in data warehouse and has wide applications in On-line Analytical Processing (OLAP) scenarios. Due to the large number of foreign key constraints and the asymmetric effect in the neighboring instance between the fact and dimension tables, even those latest DP efforts specifically designed for join, if directly applied to star-join query, will suffer from extremely large estimation errors and expensive computational cost. In this paper, we are thus motivated to propose DP-starJ, a novel Differentially Private framework for star-Join queries. DP-starJ consists of a series of strategies tailored to specific features of star-join, including 1) we unveil the different effect of fact and dimension tables on the neighboring database instances, and accordingly revisit the definitions tailored to different cases of star-join; 2) we propose Predicate Mechanism (PM), which utilizes predicate perturbation to inject noise into the join procedure instead of the results; 3) to further boost the robust performance, we propose a DP-compliant star-join algorithm for various types of star-join tasks based on PM. We provide both theoretical analysis and empirical study, which demonstrate the superiority of the proposed methods over the state-of-the-art solutions in terms of accuracy, efficiency, and scalability.


title: UFD-PRiME: Unsupervised Joint Learning of Optical Flow and Stereo Depth through Pixel-Level Rigid Motion Estimation

abstract: Both optical flow and stereo disparities are image matches and can therefore benefit from joint training. Depth and 3D motion provide geometric rather than photometric information and can further improve optical flow. Accordingly, we design a first network that estimates flow and disparity jointly and is trained without supervision. A second network, trained with optical flow from the first as pseudo-labels, takes disparities from the first network, estimates 3D rigid motion at every pixel, and reconstructs optical flow again. A final stage fuses the outputs from the two networks. In contrast with previous methods that only consider camera motion, our method also estimates the rigid motions of dynamic objects, which are of key interest in applications. This leads to better optical flow with visibly more detailed occlusions and object boundaries as a result. Our unsupervised pipeline achieves 7.36% optical flow error on the KITTI-2015 benchmark and outperforms the previous state-of-the-art 9.38% by a wide margin. It also achieves slightly better or comparable stereo depth results. Code will be made available.


title: On the n-matings of polynomials

abstract: We introduce the notion of n-mating in this work, which includes the classical mating of polynomials as a special case. The new notion brings further links between the polynomial world and the rational world than the classical one, as well as a natural classification of rational maps according to their n-unmatability. We classify the hyperbolic 2-matings according to the (non-)existence of orientation-reversing equators for them. For rational maps admitting orientation-reversing equators, we describe their dynamics via matings of half polynomials. There are diverse types of n-matings from the bicritical family and the degree-2 capture family exhibited in our explorations, which demonstrates the ubiquity of them. Finally we consider the postcritical realization programme of rational maps (among the atomic and mating family respectively). The compositive trick is exploited to deal with problems in the programme.


title: Generalized Robust Test-Time Adaptation in Continuous Dynamic Scenarios

abstract: Test-time adaptation (TTA) adapts the pre-trained models to test distributions during the inference phase exclusively employing unlabeled test data streams, which holds great value for the deployment of models in real-world applications. Numerous studies have achieved promising performance on simplistic test streams, characterized by independently and uniformly sampled test data originating from a fixed target data distribution. However, these methods frequently prove ineffective in practical scenarios, where both continual covariate shift and continual label shift occur simultaneously, i.e., data and label distributions change concurrently and continually over time. In this study, a more challenging Practical Test-Time Adaptation (PTTA) setup is introduced, which takes into account the concurrent presence of continual covariate shift and continual label shift, and we propose a Generalized Robust Test-Time Adaptation (GRoTTA) method to effectively address the difficult problem. We start by steadily adapting the model through Robust Parameter Adaptation to make balanced predictions for test samples. To be specific, firstly, the effects of continual label shift are eliminated by enforcing the model to learn from a uniform label distribution and introducing recalibration of batch normalization to ensure stability. Secondly, the continual covariate shift is alleviated by employing a source knowledge regularization with the teacher-student model to update parameters. Considering the potential information in the test stream, we further refine the balanced predictions by Bias-Guided Output Adaptation, which exploits latent structure in the feature space and is adaptive to the imbalanced label distribution. Extensive experiments demonstrate GRoTTA outperforms the existing competitors by a large margin under PTTA setting, rendering it highly conducive for adoption in real-world applications.


title: An Exploration of Task-decoupling on Two-stage Neural Post Filter for Real-time Personalized Acoustic Echo Cancellation

abstract: Deep learning based techniques have been popularly adopted in acoustic echo cancellation (AEC). Utilization of speaker representation has extended the frontier of AEC, thus attracting many researchers' interest in personalized acoustic echo cancellation (PAEC). Meanwhile, task-decoupling strategies are widely adopted in speech enhancement. To further explore the task-decoupling approach, we propose to use a two-stage task-decoupling post-filter (TDPF) in PAEC. Furthermore, a multi-scale local-global speaker representation is applied to improve speaker extraction in PAEC. Experimental results indicate that the task-decoupling model can yield better performance than a single joint network. The optimal approach is to decouple the echo cancellation from noise and interference speech suppression. Based on the task-decoupling sequence, optimal training strategies for the two-stage model are explored afterwards.


title: Reinforced UI Instruction Grounding: Towards a Generic UI Task Automation API

abstract: Recent popularity of Large Language Models (LLMs) has opened countless possibilities in automating numerous AI tasks by connecting LLMs to various domain-specific models or APIs, where LLMs serve as dispatchers while domain-specific models or APIs are action executors. Despite the vast numbers of domain-specific models/APIs, they still struggle to comprehensively cover super diverse automation demands in the interaction between human and User Interfaces (UIs). In this work, we build a multimodal model to ground natural language instructions in given UI screenshots as a generic UI task automation executor. This metadata-free grounding model, consisting of a visual encoder and a language decoder, is first pretrained on well studied document understanding tasks and then learns to decode spatial information from UI screenshots in a promptable way. To facilitate the exploitation of image-to-text pretrained knowledge, we follow the pixel-to-sequence paradigm to predict geometric coordinates in a sequence of tokens using a language decoder. We further propose an innovative Reinforcement Learning (RL) based algorithm to supervise the tokens in such sequence jointly with visually semantic metrics, which effectively strengthens the spatial decoding capability of the pixel-to-sequence paradigm. Extensive experiments demonstrate our proposed reinforced UI instruction grounding model outperforms the state-of-the-art methods by a clear margin and shows the potential as a generic UI task automation API.


title: Ultrafast Carrier Relaxation and Second Harmonic Generation in a Higher-Fold Weyl Fermionic System PtAl

abstract: In topological materials, shielding of bulk and surface states by crystalline symmetries has provided hitherto unknown access to electronic states in condensed matter physics. Interestingly, photo-excited carriers relax on an ultrafast timescale, demonstrating large transient mobility that could be harnessed for the development of ultrafast optoelectronic devices. In addition, these devices are much more effective than topologically trivial systems because topological states are resilient to the corresponding symmetry-invariant perturbations. By using optical pump probe measurements, we systematically describe the relaxation dynamics of a topologically nontrivial chiral single crystal, PtAl. Based on the experimental data on transient reflectivity and electronic structures, it has been found that the carrier relaxation process involves both acoustic and optical phonons with oscillation frequencies of 0.06 and 2.94 THz, respectively, in picosecond time scale. PtAl with a space group of $P$$2_{1}$3 allows only one non-zero susceptibility element i.e. $d_{14}$, in second harmonic generation (SHG) with a large value of 468(1) pm/V, which is significantly higher than that observed in standard GaAs(111) and ZnTe(110) crystals. The intensity dependence of the SHG signal in PtAl reveals a non-perturbative origin. The present study on PtAl provides deeper insight into topological states which will be useful for ultrafast optoelectronic devices.


title: some properties for asymptotically tracially approximation of C*-algebras

abstract: Let $\Omega$ be a class of unital $\rm C^{*}$-algebras. The class of ${\rm C^*}$-algebras which are asymptotical tracially in $\Omega$, denoted by ${\rm AT}\Omega$. In this paper, we will show that the following class of ${\rm C^*}$-algebras in the class $\Omega$ are inherited by simple unital ${\rm C^*}$-algebras in the class $\rm T\Omega$ $(1)$ the class of real rank zero ${\rm C^*}$-algebras, $(2)$ the class of ${\rm C^*}$-algebras with the radius of comparison $n$, and $(3)$ the class of $\rm AT\Omega$. As an application, let $\Omega$ be a class of unital ${\rm C^*}$-algebras which have generalized tracial rank at most one (or has tracial topological rank zero, or has tracial topological rank one). Let $A$ be a unital separable simple ${\rm C^*}$-algebra such that $A\in \rm AT\Omega$, then $A$ has generalized tracial rank at most one (or has tracial topological rank zero, or has tracial topological rank one).


title: A Comprehensive Survey on Deep Neural Image Deblurring

abstract: Image deblurring tries to eliminate degradation elements of an image causing blurriness and improve the quality of an image for better texture and object visualization. Traditionally, prior-based optimization approaches predominated in image deblurring, but deep neural networks recently brought a major breakthrough in the field. In this paper, we comprehensively review the recent progress of the deep neural architectures in both blind and non-blind image deblurring. We outline the most popular deep neural network structures used in deblurring applications, describe their strengths and novelties, summarize performance metrics, and introduce broadly used datasets. In addition, we discuss the current challenges and research gaps in this domain and suggest potential research directions for future works.


title: A comparison of co-temporal vector magnetograms obtained with HMI/SDO and SP/Hinode

abstract: An accurate measurement of magnetic field is very important for understanding the formation and evolution of solar magnetic fields. Currently there are two types of solar magnetic field measurement instruments: the filter-based magnetographs and the Stokes polarimeters. The former gives high temporal resolution magnetograms and the latter provides more accurate measurements of magnetic fields. Calibrating the magnetograms obtained by filter-based magnetographs with those obtained by Stokes polarimeters is a good way to combine the advantages of the two types. Our previous studies have shown that, compared to the magnetograms obtained by the Spectro-Polarimeter (SP) on board Hinode, those magnetograms obtained by both the filter-based Solar Magnetic Field Telescope (SMFT) of the Huairou Solar Observing Station (HSOS) and by the filter-based Michelson Doppler Imager (MDI) aboard SOHO have underestimated the flux densities in their magnetograms and systematic center-to-limb variations present in the magnetograms of both instruments. Here, using a sample of 75 vector magnetograms of stable alpha sunspots, we compare the vector magnetograms obtained by the Helioseismic and Magnetic Imager (HMI) aboard SDO with co-temporal vector magnetograms obtained by SP/Hinode. Our analysis shows that both the longitudinal and transverse flux densities in the HMI/SDO magnetograms are very close to those in the SP/Hinode magnetograms and the systematic center-to-limb variations in the HMI/SDO magnetograms are very minor. Our study suggests that using the filter-based magnetograph to construct a low spectral resolution Stokes profile, as done by HMI/SDO, can largely remove the disadvantages of the filter-type measurements and yet still possess the advantage of high temporal resolution.


title: Memory-Constrained Semantic Segmentation for Ultra-High Resolution UAV Imagery

abstract: Amidst the swift advancements in photography and sensor technologies, high-definition cameras have become commonplace in the deployment of Unmanned Aerial Vehicles (UAVs) for diverse operational purposes. Within the domain of UAV imagery analysis, the segmentation of ultra-high resolution images emerges as a substantial and intricate challenge, especially when grappling with the constraints imposed by GPU memory-restricted computational devices. This paper delves into the intricate problem of achieving efficient and effective segmentation of ultra-high resolution UAV imagery, while operating under stringent GPU memory limitation. The strategy of existing approaches is to downscale the images to achieve computationally efficient segmentation. However, this strategy tends to overlook smaller, thinner, and curvilinear regions. To address this problem, we propose a GPU memory-efficient and effective framework for local inference without accessing the context beyond local patches. In particular, we introduce a novel spatial-guided high-resolution query module, which predicts pixel-wise segmentation results with high quality only by querying nearest latent embeddings with the guidance of high-resolution information. Additionally, we present an efficient memory-based interaction scheme to correct potential semantic bias of the underlying high-resolution information by associating cross-image contextual semantics. For evaluation of our approach, we perform comprehensive experiments over public benchmarks and achieve superior performance under both conditions of small and large GPU memory usage limitations. We will release the model and codes in the future.


title: A Holistic Evaluation of Piano Sound Quality

abstract: This paper aims to develop a holistic evaluation method for piano sound quality to assist in purchasing decisions. Unlike previous studies that focused on the effect of piano performance techniques on sound quality, this study evaluates the inherent sound quality of different pianos. To derive quality evaluation systems, the study uses subjective questionnaires based on a piano sound quality dataset. The method selects the optimal piano classification models by comparing the fine-tuning results of different pre-training models of Convolutional Neural Networks (CNN). To improve the interpretability of the models, the study applies Equivalent Rectangular Bandwidth (ERB) analysis. The results reveal that musically trained individuals are better able to distinguish between the sound quality differences of different pianos. The best fine-tuned CNN pre-trained backbone achieves a high accuracy of 98.3\% as the piano classifier. However, the dataset is limited, and the audio is sliced to increase its quantity, resulting in a lack of diversity and balance, so we use focal loss to reduce the impact of data imbalance. To optimize the method, the dataset will be expanded, or few-shot learning techniques will be employed in future research.


title: Subspace Identification for Multi-Source Domain Adaptation

abstract: Multi-source domain adaptation (MSDA) methods aim to transfer knowledge from multiple labeled source domains to an unlabeled target domain. Although current methods achieve target joint distribution identifiability by enforcing minimal changes across domains, they often necessitate stringent conditions, such as an adequate number of domains, monotonic transformation of latent variables, and invariant label distributions. These requirements are challenging to satisfy in real-world applications. To mitigate the need for these strict assumptions, we propose a subspace identification theory that guarantees the disentanglement of domain-invariant and domain-specific variables under less restrictive constraints regarding domain numbers and transformation properties, thereby facilitating domain adaptation by minimizing the impact of domain shifts on invariant variables. Based on this theory, we develop a Subspace Identification Guarantee (SIG) model that leverages variational inference. Furthermore, the SIG model incorporates class-aware conditional alignment to accommodate target shifts where label distributions change with the domains. Experimental results demonstrate that our SIG model outperforms existing MSDA techniques on various benchmark datasets, highlighting its effectiveness in real-world applications.


title: Activate and Reject: Towards Safe Domain Generalization under Category Shift

abstract: Albeit the notable performance on in-domain test points, it is non-trivial for deep neural networks to attain satisfactory accuracy when deploying in the open world, where novel domains and object classes often occur. In this paper, we study a practical problem of Domain Generalization under Category Shift (DGCS), which aims to simultaneously detect unknown-class samples and classify known-class samples in the target domains. Compared to prior DG works, we face two new challenges: 1) how to learn the concept of ``unknown'' during training with only source known-class samples, and 2) how to adapt the source-trained model to unseen environments for safe model deployment. To this end, we propose a novel Activate and Reject (ART) framework to reshape the model's decision boundary to accommodate unknown classes and conduct post hoc modification to further discriminate known and unknown classes using unlabeled test data. Specifically, during training, we promote the response to the unknown by optimizing the unknown probability and then smoothing the overall output to mitigate the overconfidence issue. At test time, we introduce a step-wise online adaptation method that predicts the label by virtue of the cross-domain nearest neighbor and class prototype information without updating the network's parameters or using threshold-based mechanisms. Experiments reveal that ART consistently improves the generalization capability of deep networks on different vision tasks. For image classification, ART improves the H-score by 6.1% on average compared to the previous best method. For object detection and semantic segmentation, we establish new benchmarks and achieve competitive performance.


title: Delocalization of light in photonic lattices with unbounded potentials

abstract: In classical mechanics, a particle cannot escape from an unbounded potential well. Naively, one would expect a similar result to hold in wave mechanics, since high barriers make tunneling difficult. However, this is not always the case and it is known that wave delocalization can arise in certain models with incommensurate unbounded potentials sustaining critical states, i.e. states neither fully extended nor fully localized. Here we introduce a different and broader class of unbounded potentials, which are not quasi-periodic and do not require any specially-tailored shape, where wave delocalization is observed. The results are illustrated by considering light dynamics in synthetic photonic lattices, which should provide a feasible platform for the experimental observation of wave delocalization in unbounded potentials.


title: Zero-shot Cross-lingual Transfer without Parallel Corpus

abstract: Recently, although pre-trained language models have achieved great success on multilingual NLP (Natural Language Processing) tasks, the lack of training data on many tasks in low-resource languages still limits their performance. One effective way of solving that problem is to transfer knowledge from rich-resource languages to low-resource languages. However, many previous works on cross-lingual transfer rely heavily on the parallel corpus or translation models, which are often difficult to obtain. We propose a novel approach to conduct zero-shot cross-lingual transfer with a pre-trained model. It consists of a Bilingual Task Fitting module that applies task-related bilingual information alignment; a self-training module generates pseudo soft and hard labels for unlabeled data and utilizes them to conduct self-training. We got the new SOTA on different tasks without any dependencies on the parallel corpus or translation models.


title: Task Aware Modulation using Representation Learning: An Approach for Few Shot Learning in Heterogeneous Systems

abstract: We present a Task-aware modulation using Representation Learning (TAM-RL) framework that enhances personalized predictions in few-shot settings for heterogeneous systems when individual task characteristics are not known. TAM-RL extracts embeddings representing the actual inherent characteristics of these entities and uses these characteristics to personalize the predictions for each entity/task. Using real-world hydrological and flux tower benchmark data sets, we show that TAM-RL can significantly outperform existing baseline approaches such as MAML and multi-modal MAML (MMAML) while being much faster and simpler to train due to less complexity. Specifically, TAM-RL eliminates the need for sensitive hyper-parameters like inner loop steps and inner loop learning rate, which are crucial for model convergence in MAML, MMAML. We further present an empirical evaluation via synthetic data to explore the impact of heterogeneity amongst the entities on the relative performance of MAML, MMAML, and TAM-RL. We show that TAM-RL significantly improves predictive performance for cases where it is possible to learn distinct representations for different tasks.


title: Baxterization for the dynamical Yang-Baxter equation

abstract: The Baxterization process for the dynamical Yang-Baxter equation is studied. We introduce the local dynamical Hecke ,Temperley-Lieb and Birman-Murakami-Wenzl operators, then by inserting spectral parameters, from each representation of these operators, we get dynamical R matrix under some conditions. As applications, we reformulate trigonometric degeneration of elliptic quantum group representations and also get dynamical R matrix for critical ADE integrable lattice models. Through Baxterization, we construct some one dimensional integrable systems that are dynamical version of the Heisenberg spin chain.


title: Current Trends and Advances in Quantum Navigation for Maritime Applications: A Comprehensive Review

abstract: This paper presents a comprehensive review of the current state of the art in quantum navigation systems, with a specific focus on their application in maritime navigation. Quantum technologies have the potential to revolutionise navigation and positioning systems due to their ability to provide highly accurate and secure information. The review covers the principles of quantum navigation and highlights the latest developments in quantum-enhanced sensors, atomic clocks, and quantum communication protocols. The paper also discusses the challenges and opportunities of using quantum technologies in maritime navigation, including the effects that the maritime environment and the specificity of marine applications can have on the performance of quantum sensors. Finally, the paper concludes with a discussion on the future of quantum navigation systems and their potential impact on the maritime industry. This review aims at providing a valuable resource for researchers and engineers interested in the development and deployment of quantum navigation systems.


title: Dominance and multi-locus interaction

abstract: Dominance is usually considered a constant value that describes the relative difference in fitness or phenotype between heterozygotes and the average of homozygotes at a focal polymorphic locus. However, the observed dominance can vary with the genetic background of the focal locus. Here, alleles at other loci modify the observed phenotype through position effects or dominance modifiers that are sometimes associated with pathogen resistance, lineage, sex, or mating type. Theoretical models have illustrated how variable dominance appears in the context of multi-locus interaction (epistasis). Here, we review empirical evidence for variable dominance and how the observed patterns may be captured by proposed epistatic models. We highlight how integrating epistasis and dominance is crucial for comprehensively understanding adaptation and speciation.


title: Kawaii Game Vocalics: A Preliminary Model

abstract: Kawaii is the Japanese concept of cute++, a global export with local characteristics. Recent work has explored kawaii as a feature of user experience (UX) with social robots, virtual characters, and voice assistants, i.e., kawaii vocalics. Games have a long history of incorporating characters that use voice as a means of expressing kawaii. Nevertheless, no work to date has evaluated kawaii game voices or mapped out a model of kawaii game vocalics. In this work, we explored whether and how a model of kawaii vocalics maps onto game character voices. We conducted an online perceptions study (N=157) using 18 voices from kawaii characters in Japanese games. We replicated the results for computer voice and discovered nuanced relationships between gender and age, especially youthfulness, agelessness, gender ambiguity, and gender neutrality. We provide our initial model and advocate for future work on character visuals and within play contexts.


title: Understanding and Analyzing the Influential Factors on Relocation of Shared Bikes

abstract: To enhance the service quality of bikesharing programs, bike fleet relocation is widely applied to redistribute bikes from bike sufficient areas to bike shortage areas thereby making a better bike-rider balance across different areas. In this study, a network flow model is proposed to solve the optimal relocation problem of shared bikes, and is implemented with the actual dockless shared bike usage data from Yishun, Singapore, to demonstrate its effectiveness. A series of sensitivity analyses are performed to test the impact of the relocation cost, the number of bikes and truck trikes, and the usage price on bike relocation. The results reveal an apparent connection between the profitability of the system and the analyzed factors. This work offers a modeling framework to start and operate a bikesharing service by determining the number of bikes and trikes as well as price schemes. Some bikesharing regulation policies are also suggested.


title: Meaningful play and malicious delight: Exploring maldaimonic game UX

abstract: Maldaimonia is a new experiential concept that refers to self-actualization and self-expression through egocentric, destructive, and/or exploitative activities. Still, it is unclear whether maldaimonia is an actual facet of real experience. As a subversive orientation, it may be rare or socially challenging to discuss openly. However, video games provide a space in which people can be expressive in different ways without the same repercussions as in real life. Indeed, game spaces may be one of the few contexts in which to study maldaimonic experiences. In this study, we examined whether and how maldaimonia exists as a feature of game user experiences by analyzing critical self-reports of gaming activities, confirming its existence. We contribute this new construct to work on "dark play" in games research.


title: Efficient solution strategies for cabin noise assessment of a wave resolving aircraft fuselage model

abstract: For the purpose of high-fidelity aircraft cabin noise simulations during early design phases, we study three efficient solving approaches for the fully coupled finite element model of an aircraft fuselage segment. Obtaining an efficient solution with respect to consumed computational time and resources is challenging within a conventional simulation pipeline, as large-scale and complex vibroacoustic models demand crucially high computational costs with increasing frequency. In this contribution, we adopt (1) frequency and domain-adaptive discretisation, (2) domain-decomposition techniques, and (3) model order reduction with rational Arnoldi Krylov subspace methods for an aircraft fuselage model. The three approaches have shown remarkable advantage thereby reducing the solving time as well as the memory requirement that are essential when solving large-scale models. While the discretisation and the model order reduction approaches accelerate the solving process by efficiently handling the complexity of the system to be solved, domain-decomposition techniques further handle the aspect of reducing the overall memory consumption. Finally with the help of active research aircraft models, we implement and showcase the achieved efficiency.


title: Investigating the Influence of Legal Case Retrieval Systems on Users' Decision Process

abstract: Given a specific query case, legal case retrieval systems aim to retrieve a set of case documents relevant to the case at hand. Previous studies on user behavior analysis have shown that information retrieval (IR) systems can significantly influence users' decisions by presenting results in varying orders and formats. However, whether such influence exists in legal case retrieval remains largely unknown. This study presents the first investigation into the influence of legal case retrieval systems on the decision-making process of legal users. We conducted an online user study involving more than ninety participants, and our findings suggest that the result distribution of legal case retrieval systems indeed affect users' judgements on the sentences in cases. Notably, when users are presented with biased results that involve harsher sentences, they tend to impose harsher sentences on the current case as well. This research highlights the importance of optimizing the unbiasedness of legal case retrieval systems.


title: Evidence for a toroidal electric dipole mode in nuclei

abstract: Dipole toroidal modes appear in many fields of physics. In nuclei, such a mode was predicted more than 50 years ago, but clear experimental evidence was lacking so far. Using a combination of high-resolution inelastic scattering experiments with photons, electrons and protons, we identify for the first time candidates for toroidal dipole excitations in the nucleus $^{58}$Ni and demonstrate that transverse electron scattering form factors represent a relevant experimental observable to prove their nature.


title: Super Synthesis Pros., or why CHI PLAY needs research synthesis

abstract: Games user research is a-booming -- or maybe a-goomba-ing -- with a boundless parade of papers popping up from every nook and pipe. We may need a super power -- or super method -- from another world. I outline three motivations for jump-starting research synthesis in games user research. I argue that: research synthesis will validate this field of study and enrich primary research (meta-scholarship); we must level up both primary and secondary research (education); and we should reflect this epistemological stance in community structures and adopt established tools and protocols (standardization). I offer power-ups to get the toads rolling.


title: Metastable Patterns in one- and two-component dipolar Bose-Einstein Condensates

abstract: In this paper we study metastable states in single- and two-component dipolar Bose-Einstein condensates. We show that this system supports a rich spectrum of symmetries that are remarkably stable despite not being ground states. In a parameter region where striped phases are ground states, we find such metastable states that are energetically favourable compared to triangular and honeycomb lattices. Among these metastable states we report a peculiar ring-lattice state, which is led by the competition between triangular and honeycomb symmetries and rarely seen in other systems. In the case of dipolar mixtures we show that via tuning the miscibility these states can be stabilized in a broader domain by utilising inter-species interactions.