title: Joint Detection and Classification of Communication and Radar Signals in Congested RF Environments Using YOLOv8

abstract: In this paper, we present a comprehensive study on the application of YOLOv8, a state-of-the-art computer vision (CV) model, to the challenging problem of joint detection and classification of signals in a highly dynamic and congested RF environment. Using our synthetic RF datasets, we explored three different scenarios with congested communication and radar signals. In the first study, we applied YOLOv8 to detect and classify multiple digital modulation signals coexisting within a highly congested and dynamic spectral environment with significant overlap in both frequency and time domains. The trained model was able to achieve an impressive mean average precision (mAP) of 0.888 at an IoU threshold of 50%, signifying its robustness against spectral congestion. The second part of our research focuses on the detection and classification of multiple polyphase pulse radar signals, including Frank code and P1 through P4 codes. We were able to successfully train YOLOv8 to deliver a nearly perfect mAP50 score of 0.995 in a densely populated signal environment, further showcasing its capability in radar signal processing. In the last scenario, we demonstrated that the model can also be applied to the multi-target detection problem for continuous-wave radar. The synthetic datasets used in these experiments reflect a realistic mix of communication and radar signals with varying degrees of interference and congestion - a setup that has been overlooked by many past research efforts, which have primarily focused on ML-based classification of digital communication signal modulation schemes. Our study demonstrated the potential of advanced CV models in addressing spectrum sensing challenges in congested and dynamic RF environments involving both communication and radar signals. We hope our findings will spur further collaborative efforts to tackle the complexities of congested RF spectrum environments.


title: CMDBench: A Benchmark for Coarse-to-fine Multimodal Data Discovery in Compound AI Systems

abstract: Compound AI systems (CASs) that employ LLMs as agents to accomplish knowledge-intensive tasks via interactions with tools and data retrievers have garnered significant interest within database and AI communities. While these systems have the potential to supplement typical analysis workflows of data analysts in enterprise data platforms, unfortunately, CASs are subject to the same data discovery challenges that analysts have encountered over the years -- silos of multimodal data sources, created across teams and departments within an organization, make it difficult to identify appropriate data sources for accomplishing the task at hand. Existing data discovery benchmarks do not model such multimodality and multiplicity of data sources. Moreover, benchmarks of CASs prioritize only evaluating end-to-end task performance. To catalyze research on evaluating the data discovery performance of multimodal data retrievers in CASs within a real-world setting, we propose CMDBench, a benchmark modeling the complexity of enterprise data platforms. We adapt existing datasets and benchmarks in open-domain -- from question answering and complex reasoning tasks to natural language querying over structured data -- to evaluate coarse- and fine-grained data discovery and task execution performance. Our experiments reveal the impact of data retriever design on downstream task performance -- a 46% drop in task accuracy on average -- across various modalities, data sources, and task difficulty. The results indicate the need to develop optimization strategies to identify appropriate LLM agents and retrievers for efficient execution of CASs over enterprise data.


title: A Blueprint Architecture of Compound AI Systems for Enterprise

abstract: Large Language Models (LLMs) have showcased remarkable capabilities surpassing conventional NLP challenges, creating opportunities for use in production use cases. Towards this goal, there is a notable shift to building compound AI systems, wherein LLMs are integrated into an expansive software infrastructure with many components like models, retrievers, databases and tools. In this paper, we introduce a blueprint architecture for compound AI systems to operate in enterprise settings cost-effectively and feasibly. Our proposed architecture aims for seamless integration with existing compute and data infrastructure, with ``stream'' serving as the key orchestration concept to coordinate data and instructions among agents and other components. Task and data planners, respectively, break down, map, and optimize tasks and data to available agents and data sources defined in respective registries, given production constraints such as accuracy and latency.


title: A note on the Nearly Dispersability of Odd Toroidal Grids

abstract: The \emph{matching book thickness} $mbt(G)$ of $G$ is the minimum integer $m$ such that an $m$-page matching book embedding exists. A graph $G$ is called \emph{dispersable} if $mbt(G)=\Delta(G)$, \emph{nearly dispersable} if $mbt(G)=\Delta(G)+1$. Recently, the authors determined the nearly dispersability of odd toroidal grids $T_{s,t}$. In this note, we further present a brief proof for this result.


title: VeriSplit: Secure and Practical Offloading of Machine Learning Inferences across IoT Devices

abstract: Many Internet-of-Things (IoT) devices rely on cloud computation resources to perform machine learning inferences. This is expensive and may raise privacy concerns for users. Consumers of these devices often have hardware such as gaming consoles and PCs with graphics accelerators that are capable of performing these computations, which may be left idle for significant periods of time. While this presents a compelling potential alternative to cloud offloading, concerns about the integrity of inferences, the confidentiality of model parameters, and the privacy of users' data mean that device vendors may be hesitant to offload their inferences to a platform managed by another manufacturer. We propose VeriSplit, a framework for offloading machine learning inferences to locally-available devices that address these concerns. We introduce masking techniques to protect data privacy and model confidentiality, and a commitment-based verification protocol to address integrity. Unlike much prior work aimed at addressing these issues, our approach does not rely on computation over finite field elements, which may interfere with floating-point computation supports on hardware accelerators and require modification to existing models. We implemented a prototype of VeriSplit and our evaluation results show that, compared to performing computation locally, our secure and private offloading solution can reduce inference latency by 28%--83%.


title: Semi-supervised Video Semantic Segmentation Using Unreliable Pseudo Labels for PVUW2024

abstract: Pixel-level Scene Understanding is one of the fundamental problems in computer vision, which aims at recognizing object classes, masks and semantics of each pixel in the given image. Compared with image scene parsing, video scene parsing introduces temporal information, which can effectively improve the consistency and accuracy of prediction,because the real-world is actually video-based rather than a static state. In this paper, we adopt semi-supervised video semantic segmentation method based on unreliable pseudo labels. Then, We ensemble the teacher network model with the student network model to generate pseudo labels and retrain the student network. Our method achieves the mIoU scores of 63.71% and 67.83% on development test and final test respectively. Finally, we obtain the 1st place in the Video Scene Parsing in the Wild Challenge at CVPR 2024.


title: Generalization Bound and New Algorithm for Clean-Label Backdoor Attack

abstract: The generalization bound is a crucial theoretical tool for assessing the generalizability of learning methods and there exist vast literatures on generalizability of normal learning, adversarial learning, and data poisoning. Unlike other data poison attacks, the backdoor attack has the special property that the poisoned triggers are contained in both the training set and the test set and the purpose of the attack is two-fold. To our knowledge, the generalization bound for the backdoor attack has not been established. In this paper, we fill this gap by deriving algorithm-independent generalization bounds in the clean-label backdoor attack scenario. Precisely, based on the goals of backdoor attack, we give upper bounds for the clean sample population errors and the poison population errors in terms of the empirical error on the poisoned training dataset. Furthermore, based on the theoretical result, a new clean-label backdoor attack is proposed that computes the poisoning trigger by combining adversarial noise and indiscriminate poison. We show its effectiveness in a variety of settings.


title: Robust Visual Tracking via Iterative Gradient Descent and Threshold Selection

abstract: Visual tracking fundamentally involves regressing the state of the target in each frame of a video. Despite significant progress, existing regression-based trackers still tend to experience failures and inaccuracies. To enhance the precision of target estimation, this paper proposes a tracking technique based on robust regression. Firstly, we introduce a novel robust linear regression estimator, which achieves favorable performance when the error vector follows i.i.d Gaussian-Laplacian distribution. Secondly, we design an iterative process to quickly solve the problem of outliers. In fact, the coefficients are obtained by Iterative Gradient Descent and Threshold Selection algorithm (IGDTS). In addition, we expend IGDTS to a generative tracker, and apply IGDTS-distance to measure the deviation between the sample and the model. Finally, we propose an update scheme to capture the appearance changes of the tracked object and ensure that the model is updated correctly. Experimental results on several challenging image sequences show that the proposed tracker outperformance existing trackers.


title: MoS2-based optical bistability in silver-Bragg reflector multilayer structure at visible light band

abstract: In this paper, we present a theoretical analysis of the optical bistability in a metallic silver-Bragg reflector structure by embedding bilayer MoS2 at the visible band. The nonlinear OB is achieved due to the nonlinear conductivity of the bilayer MoS2 and the excitation of the optical Tamm state at the interface between the silver and the Bragg reflector. It is found that the hysteresis behaviour and the threshold width of the OB can be effectively tuned by varying the incident light wavelength. In addition, the optical bistable behaviour of the structure can be adjusted by varying the position of the MoS2 inset in the defect layer, incident angle and the structural parameters of the spacer layer. Although the current threshold cannot be commercialized, we believe that this solution will provide a meaningful path reference for low threshold bistability in the visible light band.


title: Auditing for Racial Discrimination in the Delivery of Education Ads

abstract: Digital ads on social-media platforms play an important role in shaping access to economic opportunities. Our work proposes and implements a new third-party auditing method that can evaluate racial bias in the delivery of ads for education opportunities. Third-party auditing is important because it allows external parties to demonstrate presence or absence of bias in social-media algorithms. Education is a domain with legal protections against discrimination and concerns of racial-targeting, but bias induced by ad delivery algorithms has not been previously explored in this domain. Prior audits demonstrated discrimination in platforms' delivery of ads to users for housing and employment ads. These audit findings supported legal action that prompted Meta to change their ad-delivery algorithms to reduce bias, but only in the domains of housing, employment, and credit. In this work, we propose a new methodology that allows us to measure racial discrimination in a platform's ad delivery algorithms for education ads. We apply our method to Meta using ads for real schools and observe the results of delivery. We find evidence of racial discrimination in Meta's algorithmic delivery of ads for education opportunities, posing legal and ethical concerns. Our results extend evidence of algorithmic discrimination to the education domain, showing that current bias mitigation mechanisms are narrow in scope, and suggesting a broader role for third-party auditing of social media in areas where ensuring non-discrimination is important.


title: Model Predictive Control and Reinforcement Learning: A Unified Framework Based on Dynamic Programming

abstract: In this paper we describe a new conceptual framework that connects approximate Dynamic Programming (DP), Model Predictive Control (MPC), and Reinforcement Learning (RL). This framework centers around two algorithms, which are designed largely independently of each other and operate in synergy through the powerful mechanism of Newton's method. We call them the off-line training and the on-line play algorithms. The names are borrowed from some of the major successes of RL involving games; primary examples are the recent (2017) AlphaZero program (which plays chess, [SHS17], [SSS17]), and the similarly structured and earlier (1990s) TD-Gammon program (which plays backgammon, [Tes94], [Tes95], [TeG96]). In these game contexts, the off-line training algorithm is the method used to teach the program how to evaluate positions and to generate good moves at any given position, while the on-line play algorithm is the method used to play in real time against human or computer opponents. Significantly, the synergy between off-line training and on-line play also underlies MPC (as well as other major classes of sequential decision problems), and indeed the MPC design architecture is very similar to the one of AlphaZero and TD-Gammon. This conceptual insight provides a vehicle for bridging the cultural gap between RL and MPC, and sheds new light on some fundamental issues in MPC. These include the enhancement of stability properties through rollout, the treatment of uncertainty through the use of certainty equivalence, the resilience of MPC in adaptive control settings that involve changing system parameters, and the insights provided by the superlinear performance bounds implied by Newton's method.


title: Low threshold optical bistability based on MoS2 in asymmetric Fabry-Perot cavity structure in visible light band

abstract: This article theoretically proposes a multi-layer Fabry-Perot cavity structure based on nonlinear MoS2, whose cavity is composed of asymmetric photonic crystals. In this structure, we observed a low threshold optical bistability phenomenon on the order of a in the visible light band, which is caused by the large third-order nonlinear conductivity of the bilayer MoS2 and the Fabry-Perot cavity resonance. Research has found that when light is incident from two different directions in an asymmetric Fabry-Perot cavity, the optical bistability exhibits not exactly the same behavior. In addition, we further investigated and found that the optical bistability behavior in this simple multi-layer structure is closely related to parameters such as incident wavelength, Fabry-Perot cavity length, and refractive index of the photonic crystal dielectric. This work provides a new approach for the implementation of low threshold optical bistable devices in the visible light band, which is expected to be applied in nonlinear optical fields such as all optical switches and all optical logic devices.


title: Artificial General Intelligence (AGI) for the oil and gas industry: a review

abstract: Artificial General Intelligence (AGI) is set to profoundly impact the oil and gas industry by introducing unprecedented efficiencies and innovations. This paper explores AGI's foundational principles and its transformative applications, particularly focusing on the advancements brought about by large language models (LLMs) and extensive computer vision systems in the upstream sectors of the industry. The integration of Artificial Intelligence (AI) has already begun reshaping the oil and gas landscape, offering enhancements in production optimization, downtime reduction, safety improvements, and advancements in exploration and drilling techniques. These technologies streamline logistics, minimize maintenance costs, automate monotonous tasks, refine decision-making processes, foster team collaboration, and amplify profitability through error reduction and actionable insights extraction. Despite these advancements, the deployment of AI technologies faces challenges, including the necessity for skilled professionals for implementation and the limitations of model training on constrained datasets, which affects the models' adaptability across different contexts. The advent of generative AI, exemplified by innovations like ChatGPT and the Segment Anything Model (SAM), heralds a new era of high-density innovation. These developments highlight a shift towards natural language interfaces and domain-knowledge-driven AI, promising more accessible and tailored solutions for the oil and gas industry. This review articulates the vast potential AGI holds for tackling complex operational challenges within the upstream oil and gas industry, requiring near-human levels of intelligence. We discussed the promising applications, the hurdles of large-scale AGI model deployment, and the necessity for domain-specific knowledge in maximizing the benefits of these technologies.


title: Model-based Analysis of Mining Fairness in a Blockchain

abstract: Mining fairness in blockchain refers to the equality between the computational resources invested in mining and the block rewards received. There exists a dilemma where increasing the blockchain's transaction processing capacity damages mining fairness, consequently undermining its decentralization. This dilemma remains unresolved even with methods such as GHOST, indicating that mining fairness is an inherent bottleneck to the system's transaction processing capacity. Despite its significance, there have been insufficient studies quantitatively analyzing mining fairness. In this paper, we propose a method to calculate mining fairness. Initially, we approximate a complex blockchain network using a simple mathematical model, assuming that no more than two blocks are generated per round. Within this model, we quantitatively determine local mining fairness and derive several measures of global mining fairness based on local mining fairness. We validated that our calculation method accurately computes mining fairness in networks with a small number of miners. Furthermore, we analyzed various networks from the perspective of mining fairness.


title: Multi-variable Adversarial Time-Series Forecast Model

abstract: Short-term industrial enterprises power system forecasting is an important issue for both load control and machine protection. Scientists focus on load forecasting but ignore other valuable electric-meters which should provide guidance of power system protection. We propose a new framework, multi-variable adversarial time-series forecasting model, which regularizes Long Short-term Memory (LSTM) models via an adversarial process. The novel model forecasts all variables (may in different type, such as continue variables, category variables, etc.) in power system at the same time and helps trade-off process between forecasting accuracy of single variable and variable-variable relations. Experiments demonstrate the potential of the framework through qualitative and quantitative evaluation of the generated samples. The predict results of electricity consumption of industrial enterprises by multi-variable adversarial time-series forecasting model show that the proposed approach is able to achieve better prediction accuracy. We also applied this model to real industrial enterprises power system data we gathered from several large industrial enterprises via advanced power monitors, and got impressed forecasting results.


title: Hydrogen and Battery Based Energy Storage System (ESS) for Future DC Microgrids

abstract: In this paper, a hydrogen-based energy storage system (ESS) is proposed for DC microgrids, which can potentially be integrated with battery ESS to meet the needs of future grids with high renewable penetration. Hydrogen-based ESS can provide a stable energy supply for a long time but has a slower response than battery ESSs. However, a combination of battery and hydrogen storage provides stable energy for an extended period of time and can easily handle the sudden demands and surpluses of the microgrid. One of the main challenges in this system is the integration of power electronics with fuel cell technology to convert renewable energy into electricity seamlessly. This paper proposes a system that uses an isolated DC-DC converter to activate clean hydrogen production using an electrolyzer and then pressurize the hydrogen to store in a tank. The pressured hydrogen becomes an essential input to the fuel cell, which regulates and transforms it into electricity. The electricity produced is then transferred to the grid using a DC-DC boost converter. A Simulink model of the hybrid system with a 1 kV DC bus voltage is used to demonstrate the hydrogen production and fuel cell behavior based on the demand and surplus power of the loads. The proposed system simulates aspects of the power conversion, electrolyzer, storage tank, and fuel cell needed for the proposed hybrid ESS. Due to its economic feasibility, the polymer electrolyte membrane (PEM) is the primary technology considered for the electrolyzer and fuel cell.


title: Efficient Neural Light Fields (ENeLF) for Mobile Devices

abstract: Novel view synthesis (NVS) is a challenge in computer vision and graphics, focusing on generating realistic images of a scene from unobserved camera poses, given a limited set of authentic input images. Neural radiance fields (NeRF) achieved impressive results in rendering quality by utilizing volumetric rendering. However, NeRF and its variants are unsuitable for mobile devices due to the high computational cost of volumetric rendering. Emerging research in neural light fields (NeLF) eliminates the need for volumetric rendering by directly learning a mapping from ray representation to pixel color. NeLF has demonstrated its capability to achieve results similar to NeRF but requires a more extensive, computationally intensive network that is not mobile-friendly. Unlike existing works, this research builds upon the novel network architecture introduced by MobileR2L and aggressively applies a compression technique (channel-wise structure pruning) to produce a model that runs efficiently on mobile devices with lower latency and smaller sizes, with a slight decrease in performance.


title: Robust Fair Clustering with Group Membership Uncertainty Sets

abstract: We study the canonical fair clustering problem where each cluster is constrained to have close to population-level representation of each group. Despite significant attention, the salient issue of having incomplete knowledge about the group membership of each point has been superficially addressed. In this paper, we consider a setting where errors exist in the assigned group memberships. We introduce a simple and interpretable family of error models that require a small number of parameters to be given by the decision maker. We then present an algorithm for fair clustering with provable robustness guarantees. Our framework enables the decision maker to trade off between the robustness and the clustering quality. Unlike previous work, our algorithms are backed by worst-case theoretical guarantees. Finally, we empirically verify the performance of our algorithm on real world datasets and show its superior performance over existing baselines.


title: Kolmogorov-Arnold Network for Satellite Image Classification in Remote Sensing

abstract: In this research, we propose the first approach for integrating the Kolmogorov-Arnold Network (KAN) with various pre-trained Convolutional Neural Network (CNN) models for remote sensing (RS) scene classification tasks using the EuroSAT dataset. Our novel methodology, named KCN, aims to replace traditional Multi-Layer Perceptrons (MLPs) with KAN to enhance classification performance. We employed multiple CNN-based models, including VGG16, MobileNetV2, EfficientNet, ConvNeXt, ResNet101, and Vision Transformer (ViT), and evaluated their performance when paired with KAN. Our experiments demonstrated that KAN achieved high accuracy with fewer training epochs and parameters. Specifically, ConvNeXt paired with KAN showed the best performance, achieving 94% accuracy in the first epoch, which increased to 96% and remained consistent across subsequent epochs. The results indicated that KAN and MLP both achieved similar accuracy, with KAN performing slightly better in later epochs. By utilizing the EuroSAT dataset, we provided a robust testbed to investigate whether KAN is suitable for remote sensing classification tasks. Given that KAN is a novel algorithm, there is substantial capacity for further development and optimization, suggesting that KCN offers a promising alternative for efficient image analysis in the RS field.


title: An Optimal Functional It\^{o}'s Formula For L\'{e}vy Processes

abstract: Several versions of It\^{o}'s formula have been obtained in the setting of the functional stochastic calculus. In this regard, we present a local time-space version that works for arbitrary bounded and continuous functionals of L\'{e}vy processes and which does not depend on a functional's H\"{o}lder continuity.


title: From Effectiveness to Efficiency: Comparative Evaluation of Code Generated by LCGMs for Bilingual Programming Questions

abstract: Large Code Generation Models (LCGMs) have garnered significant attention and achieved promising results across various programming tasks. However, concerns arise regarding performance when using non-English prompts, as these models are primarily trained on English-centric corpora, and most programming language tokens resemble English. Existing benchmarks often rely on English programming questions and limited manual unit test cases, inadequately assessing LCGM-generated code quality. This paper investigates code quality differences, specifically effectiveness and efficiency, when employing different natural languages as inputs, focusing on Chinese and English due to their prominent corpora and LCGM availability. Evaluating LCGM-generated code quality under bilingual inputs presents three challenges: (1) lack of high-quality bilingual programming question datasets, (2) insufficient unit test cases for comprehensive correctness verification, and (3) limited support for comparing generated code performance. To address these challenges, we curated a test suite of 52 bilingual programming questions and developed automated input generators for each. We enhanced correctness verification by sampling larger unit test cases and estimated code performance by profiling execution time relative to input size growth. Using this framework, we conducted an empirical study on six state-of-the-art LCGMs. The results revealed that LCGM-generated code exhibits varying bilingual correctness on an average of 10.5% of tasks, with 39.5% of correct code showing diverse bilingual performance differences. Our findings suggested LCGMs may not consistently generate high-quality code across different languages, providing insights for future research directions.


title: Deep learning enables automated assessments of inflammatory response in zebrafish exposed to different pollutants

abstract: In the field of environmental toxicology, rapid and precise assessment of the inflammatory response to pollutants in biological models is critical. This study leverages the power of deep learning to enable automated assessments of zebrafish, a model organism widely used for its translational relevance to human disease pathways. We present an innovative approach to assessing inflammatory responses in zebrafish exposed to various pollutants through an end-to-end deep learning model. The model employs a Unet-based architecture to automatically process high-throughput lateral zebrafish images, segmenting specific regions and quantifying neutrophils as inflammation markers. Alongside imaging, qPCR analysis offers gene expression insights, revealing the molecular impact of exposure on inflammatory pathways. Moreover, the deep learning model was packaged as a user-friendly executable file (.exe), facilitating widespread application by enabling use on virtually any computer without the need for specialized software or training.


title: Multipath Exploitation for Fluctuating Target Detection in RIS-Assisted ISAC Systems

abstract: Integrated sensing and communication (ISAC) systems are typically deployed in multipath environments, which is usually deemed as a challenging issue for wireless communications. However, the multipath propagation can also provide extra illumination and observation perspectives for radar sensing, which offers spatial diversity gain for detecting targets with spatial radar cross-section (RCS) fluctuations. In this letter, we propose to utilize reconfigurable intelligent surfaces (RIS) in ISAC systems to provide high-quality and controllable multipath propagation for improving the performance of fluctuating target detection and simultaneously enhancing the quality of communication services. To effectively exploit the spatial diversity offered by RIS-empowered multipath, the dual-functional transmit beamforming and the RIS reflection beamforming are jointly designed to maximize the expectation of radar signal-to-noise ratio (SNR). To solve the resulting complex non-convex optimization problem, we develop an efficient alternating optimization algorithm that utilizes majorization-minimization (MM) and alternating direction method of multipliers (ADMM) algorithms. Simulation results illustrate the advantages of multipath exploitation and the proposed beamforming design algorithm for fluctuating target detection in RIS-assisted ISAC systems.


title: LongSkywork: A Training Recipe for Efficiently Extending Context Length in Large Language Models

abstract: We introduce LongSkywork, a long-context Large Language Model (LLM) capable of processing up to 200,000 tokens. We provide a training recipe for efficiently extending context length of LLMs. We identify that the critical element in enhancing long-context processing capability is to incorporate a long-context SFT stage following the standard SFT stage. A mere 200 iterations can convert the standard SFT model into a long-context model. To reduce the effort in collecting and annotating data for long-context language modeling, we develop two novel methods for creating synthetic data. These methods are applied during the continual pretraining phase as well as the Supervised Fine-Tuning (SFT) phase, greatly enhancing the training efficiency of our long-context LLMs. Our findings suggest that synthetic long-context SFT data can surpass the performance of data curated by humans to some extent. LongSkywork achieves outstanding performance on a variety of long-context benchmarks. In the Needle test, a benchmark for long-context information retrieval, our models achieved perfect accuracy across multiple context spans. Moreover, in realistic application scenarios, LongSkywork-13B demonstrates performance on par with Claude2.1, the leading long-context model, underscoring the effectiveness of our proposed methods.


title: LLMs Could Autonomously Learn Without External Supervision

abstract: In the quest for super-human performance, Large Language Models (LLMs) have traditionally been tethered to human-annotated datasets and predefined training objectives-a process that is both labor-intensive and inherently limited. This paper presents a transformative approach: Autonomous Learning for LLMs, a self-sufficient learning paradigm that frees models from the constraints of human supervision. This method endows LLMs with the ability to self-educate through direct interaction with text, akin to a human reading and comprehending literature. Our approach eliminates the reliance on annotated data, fostering an Autonomous Learning environment where the model independently identifies and reinforces its knowledge gaps. Empirical results from our comprehensive experiments, which utilized a diverse array of learning materials and were evaluated against standard public quizzes, reveal that Autonomous Learning outstrips the performance of both Pre-training and Supervised Fine-Tuning (SFT), as well as retrieval-augmented methods. These findings underscore the potential of Autonomous Learning to not only enhance the efficiency and effectiveness of LLM training but also to pave the way for the development of more advanced, self-reliant AI systems.


title: Smooth orbit equivalence rigidity for dissipative geodesic flows

abstract: Let $M$ be a smooth closed orientable surface. A Gaussian thermostat on $M$ can be seen as the geodesic flow of a certain metric connection with torsion. These flows may not preserve any smooth volume form. We prove that if two Gaussian thermostats on $M$ with negative thermostat curvature are related by a smooth orbit equivalence isotopic to the identity, then the two background metrics are conformally equivalent via a smooth diffeomorphism of $M$ isotopic to the identity. We also give a relationship between the thermostat forms themselves. Finally, we prove the same result for Anosov magnetic flows.


title: Emergent Ferroelectric Nematic and Heliconical Ferroelectric Nematic States in an Achiral "Straight" Polar Rod Mesogen

abstract: Ferroelectric nematic liquid crystals (NFLCs) are distinguished by their remarkable polarization characteristics and diverse physical phenomena, sparking significant interest and excitement within the scientific community. To date, over 150 NFLC molecules have been developed; however, there are no reports regarding straight linear polar molecules with a parallel alignment of the permanent dipole moment and the molecular axis. The straight polar mesogen nBOE exhibited an enantiotropic NF phase with a wide temperature window (up to 100 K) despite having a longer alkyl chain (up to n = 6) than the critical alkyl chain length of conventional models. Interestingly, nBOE with a medium length alkyl chain displayed an exotic phase sequence of NF-HCNF-SmCF during the elimination of positional displacement among adjacent molecules. Furthermore, we demonstrate the reflective color modulation of the HCNFLC over the entire VIS-NIR spectral regime by ultralow E-field (up to 0.14 V um^-1).


title: SuperGaussian: Repurposing Video Models for 3D Super Resolution

abstract: We present a simple, modular, and generic method that upsamples coarse 3D models by adding geometric and appearance details. While generative 3D models now exist, they do not yet match the quality of their counterparts in image and video domains. We demonstrate that it is possible to directly repurpose existing (pretrained) video models for 3D super-resolution and thus sidestep the problem of the shortage of large repositories of high-quality 3D training models. We describe how to repurpose video upsampling models, which are not 3D consistent, and combine them with 3D consolidation to produce 3D-consistent results. As output, we produce high quality Gaussian Splat models, which are object centric and effective. Our method is category agnostic and can be easily incorporated into existing 3D workflows. We evaluate our proposed SuperGaussian on a variety of 3D inputs, which are diverse both in terms of complexity and representation (e.g., Gaussian Splats or NeRFs), and demonstrate that our simple method significantly improves the fidelity of the final 3D models. Check our project website for details: supergaussian.github.io


title: Portfolio Optimization with Robust Covariance and Conditional Value-at-Risk Constraints

abstract: The measure of portfolio risk is an important input of the Markowitz framework. In this study, we explored various methods to obtain a robust covariance estimators that are less susceptible to financial data noise. We evaluated the performance of large-cap portfolio using various forms of Ledoit Shrinkage Covariance and Robust Gerber Covariance matrix during the period of 2012 to 2022. Out-of-sample performance indicates that robust covariance estimators can outperform the market capitalization-weighted benchmark portfolio, particularly during bull markets. The Gerber covariance with Mean-Absolute-Deviation (MAD) emerged as the top performer. However, robust estimators do not manage tail risk well under extreme market conditions, for example, Covid-19 period. When we aim to control for tail risk, we should add constraint on Conditional Value-at-Risk (CVaR) to make more conservative decision on risk exposure. Additionally, we incorporated unsupervised clustering algorithm K-means to the optimization algorithm (i.e. Nested Clustering Optimization, NCO). It not only helps mitigate numerical instability of the optimization algorithm, but also contributes to lower drawdown as well.

categories: q-fin.PM econ.EM math.OC q-fin.MF stat.ML


title: DISCRET: Synthesizing Faithful Explanations For Treatment Effect Estimation

abstract: Designing faithful yet accurate AI models is challenging, particularly in the field of individual treatment effect estimation (ITE). ITE prediction models deployed in critical settings such as healthcare should ideally be (i) accurate, and (ii) provide faithful explanations. However, current solutions are inadequate: state-of-the-art black-box models do not supply explanations, post-hoc explainers for black-box models lack faithfulness guarantees, and self-interpretable models greatly compromise accuracy. To address these issues, we propose DISCRET, a self-interpretable ITE framework that synthesizes faithful, rule-based explanations for each sample. A key insight behind DISCRET is that explanations can serve dually as database queries to identify similar subgroups of samples. We provide a novel RL algorithm to efficiently synthesize these explanations from a large search space. We evaluate DISCRET on diverse tasks involving tabular, image, and text data. DISCRET outperforms the best self-interpretable models and has accuracy comparable to the best black-box models while providing faithful explanations. DISCRET is available at https://github.com/wuyinjun-1993/DISCRET-ICML2024.


title: Policy Iteration for exploratory Hamilton--Jacobi--Bellman equations

abstract: We study the policy iteration algorithm (PIA) for entropy-regularized stochastic control problems on an infinite time horizon with a large discount rate, focusing on two main scenarios. First, we analyze PIA with bounded coefficients where the controls applied to the diffusion term satisfy a smallness condition. We demonstrate the convergence of PIA based on a uniform $\mathcal{C}^{2,\alpha}$ estimate for the value sequence generated by PIA, and provide a quantitative convergence analysis for this scenario. Second, we investigate PIA with unbounded coefficients but no control over the diffusion term. In this scenario, we first provide the well-posedness of the exploratory Hamilton--Jacobi--Bellman equation with linear growth coefficients and polynomial growth reward function. By such a well-posedess result we achieve PIA's convergence by establishing a quantitative locally uniform $\mathcal{C}^{1,\alpha}$ estimates for the generated value sequence.


title: Compact dwarfs made of light-quark nuggets

abstract: Utilizing an equivparticle model with both linear confinement and leading-order perturbative interactions, we obtain systematically the properties of strangelets and nonstrange quark matter ($ud$QM) nuggets at various baryon ($A$) and charge ($Z$) numbers, where the detailed single-quark-energy levels are fixed by solving Dirac equations in mean-field approximation (MFA). We then examine the structures of compact dwarfs made of light strangelets or $ud$QM nuggets forming body-centered cubic lattices in a uniform electron background. Despite the strangelets and $ud$QM nuggets generally become more stable at larger $A$, the compact dwarfs are still stable since the fusion reactions between those objects do not take place in the presence of a Coulomb barrier, which is similar to the cases of light nuclei in normal white dwarfs. If $ud$QM dwarfs or strangelet dwarfs are covered with normal matter, their masses and radii become larger but do not exceed those of ordinary white dwarfs. Finally, we investigate the radial oscillation frequencies of $ud$QM dwarfs and strangelet dwarfs, and find that their frequencies are typically higher than traditional white dwarfs. The stability of compact dwarfs are then analysised by examining radial oscillation frequencies of the fundamental mode, where compact dwarfs covered by normal matter are still stable.


title: Efficient Monte Carlo Tree Search via On-the-Fly State-Conditioned Action Abstraction

abstract: Monte Carlo Tree Search (MCTS) has showcased its efficacy across a broad spectrum of decision-making problems. However, its performance often degrades under vast combinatorial action space, especially where an action is composed of multiple sub-actions. In this work, we propose an action abstraction based on the compositional structure between a state and sub-actions for improving the efficiency of MCTS under a factored action space. Our method learns a latent dynamics model with an auxiliary network that captures sub-actions relevant to the transition on the current state, which we call state-conditioned action abstraction. Notably, it infers such compositional relationships from high-dimensional observations without the known environment model. During the tree traversal, our method constructs the state-conditioned action abstraction for each node on-the-fly, reducing the search space by discarding the exploration of redundant sub-actions. Experimental results demonstrate the superior sample efficiency of our method compared to vanilla MuZero, which suffers from expansive action space.


title: Making Recommender Systems More Knowledgeable: A Framework to Incorporate Side Information

abstract: Session-based recommender systems typically focus on using only the triplet (user_id, timestamp, item_id) to make predictions of users' next actions. In this paper, we aim to utilize side information to help recommender systems catch patterns and signals otherwise undetectable. Specifically, we propose a general framework for incorporating item-specific side information into the recommender system to enhance its performance without much modification on the original model architecture. Experimental results on several models and datasets prove that with side information, our recommender system outperforms state-of-the-art models by a considerable margin and converges much faster. Additionally, we propose a new type of loss to regularize the attention mechanism used by recommender systems and evaluate its influence on model performance. Furthermore, through analysis, we put forward a few insights on potential further improvements.


title: EMIT: Micro-Invasive Database Configuration Tuning

abstract: The process of database knob tuning has always been a challenging task. Recently, database knob tuning methods has emerged as a promising solution to mitigate these issues. However, these methods still face certain limitations.On one hand, when applying knob tuning algorithms to optimize databases in practice, it either requires frequent updates to the database or necessitates acquiring database workload and optimizing through workload replay. The former approach involves constant exploration and updating of database configurations, inevitably leading to a decline in database performance during optimization. The latter, on the other hand, requires the acquisition of workload data, which could lead to data leakage issues. Moreover, the hyperparameter configuration space for database knobs is vast, making it challenging for optimizers to converge. These factors significantly hinder the practical implementation of database tuning. To address these concerns, we proposes an efficient and micro-invasive knob tuning method. This method relies on workload synthesis on cloned databases to simulate the workload that needs tuning, thus minimizing the intrusion on the database. And we utilizing a configuration replacement strategy to filter configuration candidates that perform well under the synthesized workload to find best configuration. And during the tuning process, we employ a knowledge transfer method to extract a common high-performance space, to boost the convergence of the optimizer.


title: Maximum $k$-Plex Search: An Alternated Reduction-and-Bound Method

abstract: $k$-plexes relax cliques by allowing each vertex to disconnect to at most $k$ vertices. Finding a maximum $k$-plex in a graph is a fundamental operator in graph mining and has been receiving significant attention from various domains. The state-of-the-art algorithms all adopt the branch-reduction-and-bound (BRB) framework where a key step, called reduction-and-bound (RB), is used for narrowing down the search space. A common practice of RB in existing works is SeqRB, which sequentially conducts the reduction process followed by the bounding process once at a branch. However, these algorithms suffer from the efficiency issues. In this paper, we propose a new alternated reduction-and-bound method AltRB for conducting RB. AltRB first partitions a branch into two parts and then alternatively and iteratively conducts the reduction process and the bounding process at each part of a branch. With newly-designed reduction rules and bounding methods, AltRB is superior to SeqRB in effectively narrowing down the search space in both theory and practice. Further, to boost the performance of BRB algorithms, we develop efficient and effective pre-processing methods which reduce the size of the input graph and heuristically compute a large $k$-plex as the lower bound. We conduct extensive experiments on 664 real and synthetic graphs. The experimental results show that our proposed algorithm kPEX with AltRB and novel pre-processing techniques runs up to two orders of magnitude faster and solves more instances than state-of-the-art algorithms.


title: Magnetic Feshbach resonances in ultracold atom-molecule collisions

abstract: We report numerically exact quantum scattering calculations on magnetic Feshbach resonances in ultracold, strongly anisotropic atom-molecule [Rb($^2$S) + SrF($^2\Sigma^+$)] collisions based on state-of-the-art ab initio potential energy surfaces. We find broad resonances mediated by the intermolecular spin-exchange interaction, as well as narrow resonances due to the intramolecular spin-rotation interaction, which are unique to atom-molecule collisions. Remarkably, the density of resonances in atom-molecule collisions is not much higher than that in atomic collisions despite the presence of a dense manifold of molecular rotational states, which can be rationalized by analyzing the adiabatic states of the collision complex.


title: A Multi-Graph Convolutional Neural Network Model for Short-Term Prediction of Turning Movements at Signalized Intersections

abstract: Traffic flow forecasting is a crucial first step in intelligent and proactive traffic management. Traffic flow parameters are volatile and uncertain, making traffic flow forecasting a difficult task if the appropriate forecasting model is not used. Additionally, the non-Euclidean data structure of traffic flow parameters is challenging to analyze from both spatial and temporal perspectives. State-of-the-art deep learning approaches use pure convolution, recurrent neural networks, and hybrid methods to achieve this objective efficiently. However, many of the approaches in the literature rely on complex architectures that can be difficult to train. This complexity also adds to the black-box nature of deep learning. This study introduces a novel deep learning architecture, referred to as the multigraph convolution neural network (MGCNN), for turning movement prediction at intersections. The proposed architecture combines a multigraph structure, built to model temporal variations in traffic data, with a spectral convolution operation to support modeling the spatial variations in traffic data over the graphs. The proposed model was tested using twenty days of flow and traffic control data collected from an arterial in downtown Chattanooga, TN, with ten signalized intersections. The model's ability to perform short-term predictions over 1, 2, 3, 4, and 5 minutes into the future was evaluated against four baseline state-of-the-art models. The results showed that our proposed model is superior to the other baseline models in predicting turning movements with a mean squared error (MSE) of 0.9


title: Model-Driven Security Analysis of Self-Sovereign Identity Systems

abstract: Best practices of self-sovereign identity (SSI) are being intensively explored in academia and industry. Reusable solutions obtained from best practices are generalized as architectural patterns for systematic analysis and design reference, which significantly boosts productivity and increases the dependability of future implementations. For security-sensitive projects, architects make architectural decisions with careful consideration of security issues and solutions based on formal analysis and experiment results. In this paper, we propose a model-driven security analysis framework for analyzing architectural patterns of SSI systems with respect to a threat model built on our investigation of real-world security concerns. Our framework mechanizes a modeling language to formalize patterns and threats with security properties in temporal logic and automatically generates programs for verification via model checking. Besides, we present typical vulnerable patterns verified by SecureSSI, a standalone integrated development environment, integrating commonly used pattern and attacker models to practicalize our framework.


title: Log-Scale Quantization in Distributed First-Order Methods: Gradient-based Learning from Distributed Data

abstract: Decentralized strategies are of interest for learning from large-scale data over networks. This paper studies learning over a network of geographically distributed nodes/agents subject to quantization. Each node possesses a private local cost function, collectively contributing to a global cost function, which the proposed methodology aims to minimize. In contrast to many existing literature, the information exchange among nodes is quantized. We adopt a first-order computationally-efficient distributed optimization algorithm (with no extra inner consensus loop) that leverages node-level gradient correction based on local data and network-level gradient aggregation only over nearby nodes. This method only requires balanced networks with no need for stochastic weight design. It can handle log-scale quantized data exchange over possibly time-varying and switching network setups. We analyze convergence over both structured networks (for example, training over data-centers) and ad-hoc multi-agent networks (for example, training over dynamic robotic networks). Through analysis and experimental validation, we show that (i) structured networks generally result in a smaller optimality gap, and (ii) logarithmic quantization leads to smaller optimality gap compared to uniform quantization.


title: Compositional 4D Dynamic Scenes Understanding with Physics Priors for Video Question Answering

abstract: For vision-language models (VLMs), understanding the dynamic properties of objects and their interactions within 3D scenes from video is crucial for effective reasoning. In this work, we introduce a video question answering dataset SuperCLEVR-Physics that focuses on the dynamics properties of objects. We concentrate on physical concepts -- velocity, acceleration, and collisions within 4D scenes, where the model needs to fully understand these dynamics properties and answer the questions built on top of them. From the evaluation of a variety of current VLMs, we find that these models struggle with understanding these dynamic properties due to the lack of explicit knowledge about the spatial structure in 3D and world dynamics in time variants. To demonstrate the importance of an explicit 4D dynamics representation of the scenes in understanding world dynamics, we further propose NS-4Dynamics, a Neural-Symbolic model for reasoning on 4D Dynamics properties under explicit scene representation from videos. Using scene rendering likelihood combining physical prior distribution, the 4D scene parser can estimate the dynamics properties of objects over time to and interpret the observation into 4D scene representation as world states. By further incorporating neural-symbolic reasoning, our approach enables advanced applications in future prediction, factual reasoning, and counterfactual reasoning. Our experiments show that our NS-4Dynamics suppresses previous VLMs in understanding the dynamics properties and answering questions about factual queries, future prediction, and counterfactual reasoning. Moreover, based on the explicit 4D scene representation, our model is effective in reconstructing the 4D scenes and re-simulate the future or counterfactual events.


title: Room-temperature bulk plasticity and tunable dislocation densities in KTaO3

abstract: We report room-temperature bulk plasticity mediated by dislocations in single-crystal cubic KTaO3, contrasting the conventional knowledge that single-crystal KTaO3 is susceptible to brittle cleavage. A mechanics-based combinatorial experimental approach using cyclic Brinell indentation, scratching, and uniaxial bulk compression consistently demonstrates room-temperature dislocation plasticity in KTaO3 from the mesoscale to the macroscale. This approach also delivers tunable dislocation densities and plastic zone sizes. Scanning transmission electron microscopy analysis underpins the activated slip system to be <110>{1-10}. Given the growing significance of KTaO3 as an emerging electronic oxide and the increasing interest in dislocations for tuning physical properties of oxides, our findings are expected to trigger synergistic research interest in KTaO3 with dislocations.


title: Iwasawa's main conjecture for Rankin-Selberg motives in the anticyclotomic case

abstract: In this article, we study the Iwasawa theory for cuspidal automorphic representations of $\mathrm{GL}(n)\times\mathrm{GL}(n+1)$ over CM fields along anticyclotomic directions, in the framework of the Gan-Gross-Prasad conjecture for unitary groups. We prove one-side divisibility of the corresponding Iwasawa main conjecture: when the global root number is $1$, the $p$-adic $L$-function belongs to the characteristic ideal of the Iwasawa Bloch-Kato Selmer group; when the global root number is $-1$, the square of the characteristic ideal of a certain Iwasawa module is contained in the characteristic ideal of the torsion part of the Iwasawa Bloch-Kato Selmer group (analogous to Perrin-Riou's Heegner point main conjecture).


title: SAM-LAD: Segment Anything Model Meets Zero-Shot Logic Anomaly Detection

abstract: Visual anomaly detection is vital in real-world applications, such as industrial defect detection and medical diagnosis. However, most existing methods focus on local structural anomalies and fail to detect higher-level functional anomalies under logical conditions. Although recent studies have explored logical anomaly detection, they can only address simple anomalies like missing or addition and show poor generalizability due to being heavily data-driven. To fill this gap, we propose SAM-LAD, a zero-shot, plug-and-play framework for logical anomaly detection in any scene. First, we obtain a query image's feature map using a pre-trained backbone. Simultaneously, we retrieve the reference images and their corresponding feature maps via the nearest neighbor search of the query image. Then, we introduce the Segment Anything Model (SAM) to obtain object masks of the query and reference images. Each object mask is multiplied with the entire image's feature map to obtain object feature maps. Next, an Object Matching Model (OMM) is proposed to match objects in the query and reference images. To facilitate object matching, we further propose a Dynamic Channel Graph Attention (DCGA) module, treating each object as a keypoint and converting its feature maps into feature vectors. Finally, based on the object matching relations, an Anomaly Measurement Model (AMM) is proposed to detect objects with logical anomalies. Structural anomalies in the objects can also be detected. We validate our proposed SAM-LAD using various benchmarks, including industrial datasets (MVTec Loco AD, MVTec AD), and the logical dataset (DigitAnatomy). Extensive experimental results demonstrate that SAM-LAD outperforms existing SoTA methods, particularly in detecting logical anomalies.


title: Intelligent Text-Conditioned Music Generation

abstract: CLIP (Contrastive Language-Image Pre-Training) is a multimodal neural network trained on (text, image) pairs to predict the most relevant text caption given an image. It has been used extensively in image generation by connecting its output with a generative model such as VQGAN, with the most notable example being OpenAI's DALLE-2. In this project, we apply a similar approach to bridge the gap between natural language and music. Our model is split into two steps: first, we train a CLIP-like model on pairs of text and music over contrastive loss to align a piece of music with its most probable text caption. Then, we combine the alignment model with a music decoder to generate music. To the best of our knowledge, this is the first attempt at text-conditioned deep music generation. Our experiments show that it is possible to train the text-music alignment model using contrastive loss and train a decoder to generate music from text prompts.


title: Prompt Framework for Role-playing: Generation and Evaluation

abstract: Large language models (LLM) have demonstrated remarkable abilities in generating natural language, understanding user instruction, and mimicking human language use. These capabilities have garnered considerable interest in applications such as role-playing. However, the process of collecting individual role scripts (or profiles) data and manually evaluating the performance can be costly. We introduce a framework that uses prompts to leverage the state-of-the-art (SOTA) LLMs to construct role-playing dialogue datasets and evaluate the role-playing performance. Additionally, we employ recall-oriented evaluation Rouge-L metric to support the result of the LLM evaluator.


title: Transforming Computer Security and Public Trust Through the Exploration of Fine-Tuning Large Language Models

abstract: Large language models (LLMs) have revolutionized how we interact with machines. However, this technological advancement has been paralleled by the emergence of "Mallas," malicious services operating underground that exploit LLMs for nefarious purposes. Such services create malware, phishing attacks, and deceptive websites, escalating the cyber security threats landscape. This paper delves into the proliferation of Mallas by examining the use of various pre-trained language models and their efficiency and vulnerabilities when misused. Building on a dataset from the Common Vulnerabilities and Exposures (CVE) program, it explores fine-tuning methodologies to generate code and explanatory text related to identified vulnerabilities. This research aims to shed light on the operational strategies and exploitation techniques of Mallas, leading to the development of more secure and trustworthy AI applications. The paper concludes by emphasizing the need for further research, enhanced safeguards, and ethical guidelines to mitigate the risks associated with the malicious application of LLMs.


title: Correlation Matching Transformation Transformers for UHD Image Restoration

abstract: This paper proposes UHDformer, a general Transformer for Ultra-High-Definition (UHD) image restoration. UHDformer contains two learning spaces: (a) learning in high-resolution space and (b) learning in low-resolution space. The former learns multi-level high-resolution features and fuses low-high features and reconstructs the residual images, while the latter explores more representative features learning from the high-resolution ones to facilitate better restoration. To better improve feature representation in low-resolution space, we propose to build feature transformation from the high-resolution space to the low-resolution one. To that end, we propose two new modules: Dual-path Correlation Matching Transformation module (DualCMT) and Adaptive Channel Modulator (ACM). The DualCMT selects top C/r (r is greater or equal to 1 which controls the squeezing level) correlation channels from the max-pooling/mean-pooling high-resolution features to replace low-resolution ones in Transformers, which can effectively squeeze useless content to improve the feature representation in low-resolution space to facilitate better recovery. The ACM is exploited to adaptively modulate multi-level high-resolution features, enabling to provide more useful features to low-resolution space for better learning. Experimental results show that our UHDformer reduces about ninety-seven percent model sizes compared with most state-of-the-art methods while significantly improving performance under different training sets on 3 UHD image restoration tasks, including low-light image enhancement, image dehazing, and image deblurring. The source codes will be made available at https://github.com/supersupercong/UHDformer.


title: On Non-asymptotic Theory of Recurrent Neural Networks in Temporal Point Processes

abstract: Temporal point process (TPP) is an important tool for modeling and predicting irregularly timed events across various domains. Recently, the recurrent neural network (RNN)-based TPPs have shown practical advantages over traditional parametric TPP models. However, in the current literature, it remains nascent in understanding neural TPPs from theoretical viewpoints. In this paper, we establish the excess risk bounds of RNN-TPPs under many well-known TPP settings. We especially show that an RNN-TPP with no more than four layers can achieve vanishing generalization errors. Our technical contributions include the characterization of the complexity of the multi-layer RNN class, the construction of $\tanh$ neural networks for approximating dynamic event intensity functions, and the truncation technique for alleviating the issue of unbounded event sequences. Our results bridge the gap between TPP's application and neural network theory.


title: MGI: Multimodal Contrastive pre-training of Genomic and Medical Imaging

abstract: Medicine is inherently a multimodal discipline. Medical images can reflect the pathological changes of cancer and tumors, while the expression of specific genes can influence their morphological characteristics. However, most deep learning models employed for these medical tasks are unimodal, making predictions using either image data or genomic data exclusively. In this paper, we propose a multimodal pre-training framework that jointly incorporates genomics and medical images for downstream tasks. To address the issues of high computational complexity and difficulty in capturing long-range dependencies in genes sequence modeling with MLP or Transformer architectures, we utilize Mamba to model these long genomic sequences. We aligns medical images and genes using a self-supervised contrastive learning approach which combines the Mamba as a genetic encoder and the Vision Transformer (ViT) as a medical image encoder. We pre-trained on the TCGA dataset using paired gene expression data and imaging data, and fine-tuned it for downstream tumor segmentation tasks. The results show that our model outperformed a wide range of related methods.


title: Diff-Mosaic: Augmenting Realistic Representations in Infrared Small Target Detection via Diffusion Prior

abstract: Recently, researchers have proposed various deep learning methods to accurately detect infrared targets with the characteristics of indistinct shape and texture. Due to the limited variety of infrared datasets, training deep learning models with good generalization poses a challenge. To augment the infrared dataset, researchers employ data augmentation techniques, which often involve generating new images by combining images from different datasets. However, these methods are lacking in two respects. In terms of realism, the images generated by mixup-based methods lack realism and are difficult to effectively simulate complex real-world scenarios. In terms of diversity, compared with real-world scenes, borrowing knowledge from another dataset inherently has a limited diversity. Currently, the diffusion model stands out as an innovative generative approach. Large-scale trained diffusion models have a strong generative prior that enables real-world modeling of images to generate diverse and realistic images. In this paper, we propose Diff-Mosaic, a data augmentation method based on the diffusion model. This model effectively alleviates the challenge of diversity and realism of data augmentation methods via diffusion prior. Specifically, our method consists of two stages. Firstly, we introduce an enhancement network called Pixel-Prior, which generates highly coordinated and realistic Mosaic images by harmonizing pixels. In the second stage, we propose an image enhancement strategy named Diff-Prior. This strategy utilizes diffusion priors to model images in the real-world scene, further enhancing the diversity and realism of the images. Extensive experiments have demonstrated that our approach significantly improves the performance of the detection network. The code is available at https://github.com/YupeiLin2388/Diff-Mosaic


title: Improving GFlowNets for Text-to-Image Diffusion Alignment

abstract: Diffusion models have become the de-facto approach for generating visual data, which are trained to match the distribution of the training dataset. In addition, we also want to control generation to fulfill desired properties such as alignment to a text description, which can be specified with a black-box reward function. Prior works fine-tune pretrained diffusion models to achieve this goal through reinforcement learning-based algorithms. Nonetheless, they suffer from issues including slow credit assignment as well as low quality in their generated samples. In this work, we explore techniques that do not directly maximize the reward but rather generate high-reward images with relatively high probability -- a natural scenario for the framework of generative flow networks (GFlowNets). To this end, we propose the Diffusion Alignment with GFlowNet (DAG) algorithm to post-train diffusion models with black-box property functions. Extensive experiments on Stable Diffusion and various reward specifications corroborate that our method could effectively align large-scale text-to-image diffusion models with given reward information.


title: Dynamical dark energy in the light of DESI 2024 data

abstract: The recent result from the DESI (Dark Energy Spectroscopic Instrument) data release 1 (DR1) combined with the cosmic microwave background and supernova data shows a preference for the dynamical dark energy over the cosmological constant [1]. For this analysis, the Chevallier-Polarski-Linder (CPL) parameterization of the dark energy equation of state has been used. Though CPL parametrization is the most popular parametrization of dark energy equation of state (EoS) recent studies have questioned its choice of prior and degeneracy. In this work, we propose a new parametrization of the dark energy equation of state motivated by its ability to cross the phantom barrier crossing. At a high redshift limit, this parametrization takes the form of CPL parametrization. We have used the Bayesian model selection criteria in which this parametrisation shows a moderate positive preference over the $\Lambda$CDM model. Contrary to the DESI2024 results our model suggests the current value of the dark energy equation of state to be phantom today with two phantom barrier crossings one at $z\simeq 0.4$ from deep phantom to quintessence which matches with the finding from the DESI2024 result and another phantom barrier crossing very recently at $z\simeq0.1$ from quintessence to phantom. The proposed model also weakens the Hubble tension significantly to $\approx 2 \sigma$ while comparing with the result from [2] and to $\approx 1.4 \sigma$ while comparing with [3].


title: BreakBRD Galaxies III: Evolutionary Clues Through an Analysis of Gas Content

abstract: By combining newly obtained deep GBT 21cm observations with optical spectroscopic data, we present an analysis of the gas content of BreakBRD galaxies, a population denoted by their blue star-forming centers and red quenched disks that do not appear to follow the typical inside-out evolution of spiral galaxies. We confirm previous results that the neutral atomic hydrogen (HI) gas fractions of BreakBRDs are on-average lower than those of typical galaxies on the star-forming sequence (SFS), and find that their \ion{H}{1} fractions are generally higher than Green Valley (GV) galaxies. HI depletion times for BreakBRDs are roughly an order of magnitude lower than those of SFS galaxies, in stark contrast with GV galaxies that typically have much longer depletion times than SFS galaxies. The nuclear gas-phase metallicities of BreakBRDs have a broader distribution than SFS galaxies and are skewed towards slightly above-average values. BreakBRDs are systematically offset from the Baryonic Tully-Fisher Relation towards lower baryonic mass at a given rotation velocity. They also have higher typical HI asymmetries than SFS galaxies, and of those galaxies with spatially resolved gas velocity fields from the SDSS-IV MaNGA survey, two-thirds are either highly distorted or completely misaligned relative to the stellar disk. Evidence supports a scenario where BreakBRDs are in an early phase of quenching, and there is mixed evidence that their behavior is related to past merger activity.


title: T2LM: Long-Term 3D Human Motion Generation from Multiple Sentences

abstract: In this paper, we address the challenging problem of long-term 3D human motion generation. Specifically, we aim to generate a long sequence of smoothly connected actions from a stream of multiple sentences (i.e., paragraph). Previous long-term motion generating approaches were mostly based on recurrent methods, using previously generated motion chunks as input for the next step. However, this approach has two drawbacks: 1) it relies on sequential datasets, which are expensive; 2) these methods yield unrealistic gaps between motions generated at each step. To address these issues, we introduce simple yet effective T2LM, a continuous long-term generation framework that can be trained without sequential data. T2LM comprises two components: a 1D-convolutional VQVAE, trained to compress motion to sequences of latent vectors, and a Transformer-based Text Encoder that predicts a latent sequence given an input text. At inference, a sequence of sentences is translated into a continuous stream of latent vectors. This is then decoded into a motion by the VQVAE decoder; the use of 1D convolutions with a local temporal receptive field avoids temporal inconsistencies between training and generated sequences. This simple constraint on the VQ-VAE allows it to be trained with short sequences only and produces smoother transitions. T2LM outperforms prior long-term generation models while overcoming the constraint of requiring sequential data; it is also competitive with SOTA single-action generation models.


title: Representing Animatable Avatar via Factorized Neural Fields

abstract: For reconstructing high-fidelity human 3D models from monocular videos, it is crucial to maintain consistent large-scale body shapes along with finely matched subtle wrinkles. This paper explores the observation that the per-frame rendering results can be factorized into a pose-independent component and a corresponding pose-dependent equivalent to facilitate frame consistency. Pose adaptive textures can be further improved by restricting frequency bands of these two components. In detail, pose-independent outputs are expected to be low-frequency, while highfrequency information is linked to pose-dependent factors. We achieve a coherent preservation of both coarse body contours across the entire input video and finegrained texture features that are time variant with a dual-branch network with distinct frequency components. The first branch takes coordinates in canonical space as input, while the second branch additionally considers features outputted by the first branch and pose information of each frame. Our network integrates the information predicted by both branches and utilizes volume rendering to generate photo-realistic 3D human images. Through experiments, we demonstrate that our network surpasses the neural radiance fields (NeRF) based state-of-the-art methods in preserving high-frequency details and ensuring consistent body contours.


title: COS-Mix: Cosine Similarity and Distance Fusion for Improved Information Retrieval

abstract: This study proposes a novel hybrid retrieval strategy for Retrieval-Augmented Generation (RAG) that integrates cosine similarity and cosine distance measures to improve retrieval performance, particularly for sparse data. The traditional cosine similarity measure is widely used to capture the similarity between vectors in high-dimensional spaces. However, it has been shown that this measure can yield arbitrary results in certain scenarios. To address this limitation, we incorporate cosine distance measures to provide a complementary perspective by quantifying the dissimilarity between vectors. Our approach is experimented on proprietary data, unlike recent publications that have used open-source datasets. The proposed method demonstrates enhanced retrieval performance and provides a more comprehensive understanding of the semantic relationships between documents or items. This hybrid strategy offers a promising solution for efficiently and accurately retrieving relevant information in knowledge-intensive applications, leveraging techniques such as BM25 (sparse) retrieval , vector (Dense) retrieval, and cosine distance based retrieval to facilitate efficient information retrieval.


title: An Information Compensation Framework for Zero-Shot Skeleton-based Action Recognition

abstract: Zero-shot human skeleton-based action recognition aims to construct a model that can recognize actions outside the categories seen during training. Previous research has focused on aligning sequences' visual and semantic spatial distributions. However, these methods extract semantic features simply. They ignore that proper prompt design for rich and fine-grained action cues can provide robust representation space clustering. In order to alleviate the problem of insufficient information available for skeleton sequences, we design an information compensation learning framework from an information-theoretic perspective to improve zero-shot action recognition accuracy with a multi-granularity semantic interaction mechanism. Inspired by ensemble learning, we propose a multi-level alignment (MLA) approach to compensate information for action classes. MLA aligns multi-granularity embeddings with visual embedding through a multi-head scoring mechanism to distinguish semantically similar action names and visually similar actions. Furthermore, we introduce a new loss function sampling method to obtain a tight and robust representation. Finally, these multi-granularity semantic embeddings are synthesized to form a proper decision surface for classification. Significant action recognition performance is achieved when evaluated on the challenging NTU RGB+D, NTU RGB+D 120, and PKU-MMD benchmarks and validate that multi-granularity semantic features facilitate the differentiation of action clusters with similar visual features.


title: Monte Carlo simulation of UV-driven synthesis of complex organic molecules on icy grain surfaces

abstract: Complex organic molecules (COMs) have been widely observed in molecular clouds and protostellar environments. One of the formation mechanisms of COMs is radical reactions on the icy grain surface driven by UV irradiation. While many experiments have reported that various COMs can be synthesized under such ice conditions, the majority of the reaction processes are unclear. Complementary numerical simulations are necessary to unveil the synthetic process behind the formation of COMs. In this study, we develop a chemical reaction simulation using a Monte Carlo method. To explore the complex reaction network of COM synthesis, the model was designed to eliminate the need to prepare reaction pathways and to keep computational costs low. With this simulation, we investigate the chemical reactions occurring on icy dust surfaces during and after UV irradiation, assuming a protoplanetary disk environment. We aim to reveal the types of organic molecules produced in a disk and the formation mechanisms of COMs, in particular, amino acids and sugars. The results show that photodissociation and subsequent radical-radical reactions cause random rearrangement of the covalent bonds in the initial molecules composed of methanol, formaldehyde, ammonia, and water. Consequently, highly complex molecules such as amino acids and sugars were produced in a wide range of the initial conditions. We found that the final abundances of amino acids and sugars have extremely similar dependence on the atomic ratios of the initial molecules, which peak at C/H~0.1-0.3 and O/H~0.3-0.5, although the amino acids abundance is usually more than ten times higher than that of sugars. To understand this dependence, a semi-analytical formula was derived. Additionally, parameter surveys have suggested that the decomposition reactions of amino acids and sugars undergo a rapid transition within the threshold of a given parameter.


title: The role of coherent airflow structures on the incipient aeolian entrainment of coarse particles

abstract: The role of coherent airflow structures capable of setting gravel-size particles in motion is studied theoretically and experimentally. Specifically, a micromechanical model based on energy conservation is proposed to describe the incipient motion of large particles ranging from rocking (incomplete entrainment) to incipient rolling (full entrainment). Wind tunnel experiments were conducted on an aerodynamically rough bed surface under near-threshold airflow conditions. Synchronous signals of airflow velocities upwind of the test particles and particle displacement are measured using a hot film anemometer and a laser distance sensor, respectively, from which coherent airflow structures (extracted via quadrant analysis) and particle movements are interlinked. It is suggested that the incipient motion of gravel-size particles (rocking and rolling) may result from sufficiently energetic sweep events corresponding to aerodynamic drag forces in excess of the local micro-topography resistance. However, full entrainment in rolling mode should satisfy the presented work-based criterion. Furthermore, using an appropriate probabilistic frame, the proposed criterion may be suitable for describing processes of energy transfer from the wind to the granular soil surface, ranging from the creep transport of gravels to the "mechanical sieving" of mega-ripples, as well as the transport of light anthropogenic debris (such as plastics).


title: Equivariant Seiberg-Witten theory

abstract: We introduce and study equivariant Seiberg-Witten invariants for $4$-manifolds equipped with a smooth action of a finite group $G$. Our invariants come in two types: cohomological, valued in the group cohomology of $G$ and $K$-theoretic, valued in the representation ring of $G$. We establish basic properties of the invariants such as wall-crossing and vanishing of the invariants for $G$-invariant positive scalar curvature metrics. We establish a relation between the equivariant Seiberg-Witten invariants and families Seiberg-Witten invariants. Sufficient conditions are found under which equivariant transversality can be achieved leading to smooth moduli spaces on which $G$ acts. In the zero-dimensional case this yields a further invariant of the $G$-action valued in a refinement of the Burnside ring of $G$. We prove localisation formulas in cohomology and $K$-theory, relating the equivariant Seiberg-Witten invariants to moduli spaces of $G$-invariant solutions. We give an explicit formula for the invariants for holomorphic group actions on K\"ahler surfaces. We also prove a gluing formula for the invariants of equivariant connected sums. Various applications and consequences of the theory are considered.


title: $\mathcal{O}(VE)$ time algorithms for the Grundy (First-Fit) chromatic number of block graphs and graphs with sufficiently large girth

abstract: The Grundy (or First-Fit) chromatic number of a graph $G=(V,E)$, denoted by $\Gamma(G)$ (or $\chi_{_{\sf FF}}(G)$), is the maximum number of colors used by a First-Fit (greedy) coloring of $G$. To determine $\Gamma(G)$ is NP-complete for various classes of graphs. Also there exists a constant $c>0$ such that the Grundy number is hard to approximate within the ratio $c$. We first obtain an $\mathcal{O}(VE)$ algorithm to determine the Grundy number of block graphs i.e. graphs in which every biconnected component is complete subgraph. We prove that the Grundy number of a general graph $G$ with cut-vertices is upper bounded by the Grundy number of a block graph corresponding to $G$. This provides a reasonable upper bound for the Grundy number of graphs with cut-vertices. Next, define $\Delta_2(G)={\max}_{u\in G}~ {\max}_{v\in N(u):d(v)\leq d(u)} d(v)$. We obtain an $\mathcal{O}(VE)$ algorithm to determine $\Gamma(G)$ for graphs $G$ whose girth $g$ is at least $2\Delta_2(G)+1$. This algorithm provides a polynomial time approximation algorithm within ratio $\min \{1, (g+1)/(2\Delta_2(G)+2)\}$ for $\Gamma(G)$ of general graphs $G$ with girth $g$.


title: Ultrasound Report Generation with Cross-Modality Feature Alignment via Unsupervised Guidance

abstract: Automatic report generation has arisen as a significant research area in computer-aided diagnosis, aiming to alleviate the burden on clinicians by generating reports automatically based on medical images. In this work, we propose a novel framework for automatic ultrasound report generation, leveraging a combination of unsupervised and supervised learning methods to aid the report generation process. Our framework incorporates unsupervised learning methods to extract potential knowledge from ultrasound text reports, serving as the prior information to guide the model in aligning visual and textual features, thereby addressing the challenge of feature discrepancy. Additionally, we design a global semantic comparison mechanism to enhance the performance of generating more comprehensive and accurate medical reports. To enable the implementation of ultrasound report generation, we constructed three large-scale ultrasound image-text datasets from different organs for training and validation purposes. Extensive evaluations with other state-of-the-art approaches exhibit its superior performance across all three datasets. Code and dataset are valuable at this link.


title: FuRL: Visual-Language Models as Fuzzy Rewards for Reinforcement Learning

abstract: In this work, we investigate how to leverage pre-trained visual-language models (VLM) for online Reinforcement Learning (RL). In particular, we focus on sparse reward tasks with pre-defined textual task descriptions. We first identify the problem of reward misalignment when applying VLM as a reward in RL tasks. To address this issue, we introduce a lightweight fine-tuning method, named Fuzzy VLM reward-aided RL (FuRL), based on reward alignment and relay RL. Specifically, we enhance the performance of SAC/DrQ baseline agents on sparse reward tasks by fine-tuning VLM representations and using relay RL to avoid local minima. Extensive experiments on the Meta-world benchmark tasks demonstrate the efficacy of the proposed method. Code is available at: https://github.com/fuyw/FuRL.


title: A detailed analysis of the origin of deep-decoupling oscillations

abstract: The variability of the strength of the Atlantic Meridional Overturning Circulation is influenced substantially by the formation of deep water in the North Atlantic. In many ocean models, so-called deep-decoupling oscillations have been found, whose timescale depends on the characteristics of convective vertical mixing processes. Their precise origin and sensitivity to the representation of mixing have remained unclear so far. To study this problem, we revisit a conceptual Welander model for the evolution of temperature and salinity in two vertically stacked boxes for surface and deep water, which interact through diffusion and/or convective adjustment. The model is known to exhibit several types of deep-decoupling oscillations, with phases of weak diffusive mixing interspersed with strong convective mixing, when the switching between them is assumed to be instantaneous. We present a comprehensive study of oscillations in Welander's model with non-instantaneous switching between mixing phases, as described by a smooth switching function. A dynamical systems approach allows us to distinguish four types of oscillations, in terms of their phases of diffusive versus convective mixing, and to identify the regions in the relevant parameter plane where they exist. The characteristic deep-decoupling oscillations still exist for non-instantaneous switching, but they require switching that is considerably faster than needed for sustaining oscillatory behaviour. Furthermore, we demonstrate how a gradual freshwater influx can lead to transitions between different vertical mixing oscillations. Notably, the convective mixing phase becomes shorter and even disappears, resulting in long periods of much reduced deep water formation. The results are relevant for the interpretation of ocean-climate variability in models and (proxy) observations.


title: Fluctuations of the connectivity threshold and largest nearest-neighbour link

abstract: Consider a random uniform sample of $n$ points in a compact region $A$ of Euclidean $d$-space, $d \geq 2$, with a smooth or (when $d=2$) polygonal boundary. Fix $k \in {\bf N}$. Let $T_{n,k}$ be the threshold $r$ at which the geometric graph on these $n$ vertices with distance parameter $r$ becomes $k$-connected. We show that if $d=2$ then $n (\pi/|A|) T_{n,1}^2 - \log n$ is asymptotically standard Gumbel. For $(d,k) \neq (2,1)$, it is $n (\theta_d/|A|) T_{n,k}^d - (2-2/d) \log n - (4-2k-2/d) \log \log n$ that converges in distribution to a nondegenerate limit, where $\theta_d$ is the volume of the unit ball. The limit is Gumbel with scale parameter 2 except when $(d,k)=(2,2)$ where the limit is two component extreme value distributed. The different cases reflect the fact that boundary effects are more more important in some cases than others. We also give similar results for the largest $k$-nearest neighbour link $U_{n,k}$ in the sample, and show $T_{n,k}=U_{n,k}$ with high probability. We provide estimates on rates of convergence and give similar results for Poisson samples in $A$. Finally, we give similar results even for non-uniform samples, with a less explicit sequence of centring constants.


title: Level proximal subdifferential, variational convexity, and pointwise Lipschitz smoothness

abstract: Level proximal subdifferential was introduced by Rockafellar recently as a tool for studying proximal mappings of possibly nonconvex functions. In this paper we give a systematic study of level proximal subdifferntial, characterize variational convexity of the function by locally firm nonexpansiveness of proximal mappings or locally relative monotonicity of level proximal subdifferential, and investigate pointwise Lipschitz smoothness of the function. Integration and single-valuedness of level proximal subdifferential are also examined.


title: Interplay between thermal and compositional gradients decides the microstructure during thermomigration: a phase-field study

abstract: The presence of thermal gradients in alloys often leads to non-uniformity in concentration profiles, which can induce the thermomigration of microstructural features such as precipitates. To investigate such microstructural changes, we present a phase-field model that incorporates coupling between concentration and thermal gradients. First, we simulated the evolution of non-uniform concentration profiles in the single-phase regions of Fe-C and Fe-N alloy systems due to imposed thermal gradients. To validate our model with the classical experiments performed by Darken and Oriani, we studied the evolution of spatially varying concentration profiles where thermal gradients encompass single-phase and two-phase regions. We developed a parameterized thermodynamic description of the two-phase region of a binary alloy to systematically study the effect of interactions between chemically-driven and thermal gradient-driven diffusion of solute on the evolution of precipitates. Our simulations show how thermal gradient, precipitate size, and interparticle distance influence the migration and associated morphological changes of precipitates. The composition profiles and migration rates obtained from single-particle simulations show an exact match with our analytical model. We use twoparticle simulations to show conditions under which thermomigration induces the growth of the smaller particle and shrinkage of the larger one in contrast to the isothermal Ostwald ripening behavior. Our multiparticle simulations show similar behavior during coarsening. Moreover, in the presence of a thermal gradient, there is a shift in the center of mass of the precipitates towards the high-temperature region. Thus, our study offers new insights into the phenomena of microstructure evolution in the presence of thermal gradient.


title: Cluster-robust jackknife and bootstrap inference for binary response models

abstract: We study cluster-robust inference for binary response models. Inference based on the most commonly-used cluster-robust variance matrix estimator (CRVE) can be very unreliable. We study several alternatives. Conceptually the simplest of these, but also the most computationally demanding, involves jackknifing at the cluster level. We also propose a linearized version of the cluster-jackknife variance matrix estimator as well as linearized versions of the wild cluster bootstrap. The linearizations are based on empirical scores and are computationally efficient. Throughout we use the logit model as a leading example. We also discuss a new Stata software package called logitjack which implements these procedures. Simulation results strongly favor the new methods, and two empirical examples suggest that it can be important to use them in practice.


title: Extended Scotogenic Model of Neutrino Mass and Proton Decay

abstract: The current article presents an extension of the classical scotogenic neutrino mass paradigm, where the three issues in particle physics: dark matter, smallness of neutrino mass, and stability of the proton are interconnected. The scenario encompasses the neutrino mass as well as the proton decay as a consequence of an existence of the dark matter. The study successfully achieves the correlation between the naturally small neutrino masses and naturally long proton lifetime in the present paradigm. Furthermore, all relevant cosmological, collider, and flavor physics constraints are incorporated in the detailed analysis. The scotogenic fermionic dark matter with the mass in the range from $100$ GeV to $10$ TeV successfully satisfies all relevant constraints. The valid range of $2.51\times 10^{-5} < \lambda < 2\times 10^{-3}$ is obtained for the 2HDM $\lambda$ coupling. We give a brief discussion, as well as, outline some of the future prospects.


title: A catalogue of merging clusters of galaxies: cluster partners, merging subclusters, and post-collision clusters

abstract: Clusters of galaxies are merging during the formation of large-scale structures in the Universe. Based on optical survey data, we identify a large sample of pre-mergers of galaxy clusters and merging subclusters in rich clusters. We find 39,382 partners within a velocity difference of 1500 km/s and a projected separation of 5r_{500} around 33,126 main clusters, where r_{500} is the radius of the main cluster. Based on the galaxy distribution inside rich clusters with more than 30 member galaxy candidates, we identify subclusters by modeling the smoothed optical distribution with a two-component profile, and a coupling factor is obtained for merging subclusters in 7845 clusters. In addition, we find 3446 post-collision mergers according to the deviations of brightest cluster galaxies from other member galaxies, most of which have been partially validated by using the Chandra and XMM-Newton X-ray images. Two new bullet-like clusters have been identified by using the optical and X-ray images. The large samples of merging clusters of galaxies presented here are important databases for studying the hierarchical structure formation, cluster evolution, and the physics of intergalactic medium.


title: Study of the alpha-particle monopole transition form factor

abstract: The 4He monopole form factor is studied by computing the transition matrix element of the electromagnetic charge operator between the 4He ground-state and the p+3H and n+3He scattering states. The nuclear wave functions are calculated using the hyperspherical harmonic method, by starting from Hamiltonians including two- and three-body forces derived in chiral effective field theory. The electromagnetic charge operator retains, beyond the leading order (impulse approximation) term, also higher order contributions, as relativistic corrections and meson-exchange currents. The results for the monopole form factor are in fairly agreement with recent MAMI data. Comparison with other theoretical calculations are also provided.


title: Enhancing Zero-shot Text-to-Speech Synthesis with Human Feedback

abstract: In recent years, text-to-speech (TTS) technology has witnessed impressive advancements, particularly with large-scale training datasets, showcasing human-level speech quality and impressive zero-shot capabilities on unseen speakers. However, despite human subjective evaluations, such as the mean opinion score (MOS), remaining the gold standard for assessing the quality of synthetic speech, even state-of-the-art TTS approaches have kept human feedback isolated from training that resulted in mismatched training objectives and evaluation metrics. In this work, we investigate a novel topic of integrating subjective human evaluation into the TTS training loop. Inspired by the recent success of reinforcement learning from human feedback, we propose a comprehensive sampling-annotating-learning framework tailored to TTS optimization, namely uncertainty-aware optimization (UNO). Specifically, UNO eliminates the need for a reward model or preference data by directly maximizing the utility of speech generations while considering the uncertainty that lies in the inherent variability in subjective human speech perception and evaluations. Experimental results of both subjective and objective evaluations demonstrate that UNO considerably improves the zero-shot performance of TTS models in terms of MOS, word error rate, and speaker similarity. Additionally, we present a remarkable ability of UNO that it can adapt to the desired speaking style in emotional TTS seamlessly and flexibly.


title: Generalized Exponentiated Gradient Algorithms and Their Application to On-Line Portfolio Selection

abstract: This paper introduces a novel family of generalized exponentiated gradient (EG) updates derived from an Alpha-Beta divergence regularization function. Collectively referred to as EGAB, the proposed updates belong to the category of multiplicative gradient algorithms for positive data and demonstrate considerable flexibility by controlling iteration behavior and performance through three hyperparameters: $\alpha$, $\beta$, and the learning rate $\eta$. To enforce a unit $l_1$ norm constraint for nonnegative weight vectors within generalized EGAB algorithms, we develop two slightly distinct approaches. One method exploits scale-invariant loss functions, while the other relies on gradient projections onto the feasible domain. As an illustration of their applicability, we evaluate the proposed updates in addressing the online portfolio selection problem (OLPS) using gradient-based methods. Here, they not only offer a unified perspective on the search directions of various OLPS algorithms (including the standard exponentiated gradient and diverse mean-reversion strategies), but also facilitate smooth interpolation and extension of these updates due to the flexibility in hyperparameter selection. Simulation results confirm that the adaptability of these generalized gradient updates can effectively enhance the performance for some portfolios, particularly in scenarios involving transaction costs.