title: Tunable Intracavity Coherent Up-conversion with Giant Nonlinearity in a Polar Fluidic Medium

abstract: We demonstrate a novel microcavity-based photon up-conversion using second harmonic generation (SHG) from a polar nematic fluid media doped with a laser dye. The present idea is based on coherent light generation via simultaneous frequency doubling and stimulated emission (lasing) inside a microcavity. The polar nematic fluid equips very high even-order optical nonlinearity due to the polar symmetry and large dipole moment along the molecular long axis. At the same time, its inherent fluidic nature allows us to easily functionalize the media just by doping, in the present case, with an emissive laser dye. Our demonstrated system exhibits a giant nonlinear optical response to input light, while enabling spectral narrowing and multiple-signal output of up-converted light, that is not attainable though the simple SH-conversion of input light. Furthermore, susceptibility of the liquid crystal offers dynamic modulation capabilities under external stimulus, such as signal switching with electric field application or wavelength tuning through temperature variation. Such a brand-new type of simple coherent flexible up-conversion system must be promising as a new principle for easy-accessible and down-scalable wavelength conversion devices.


title: Observation Denoising in CYRUS Soccer Simulation 2D Team For RoboCup 2024

abstract: In the Soccer Simulation 2D environment, accurate observation is crucial for effective decision making. However, challenges such as partial observation and noisy data can hinder performance. To address these issues, we propose a denoising algorithm that leverages predictive modeling and intersection analysis to enhance the accuracy of observations. Our approach aims to mitigate the impact of noise and partial data, leading to improved gameplay performance. This paper presents the framework, implementation, and preliminary results of our algorithm, demonstrating its potential in refining observations in Soccer Simulation 2D. Cyrus 2D Team is using a combination of Helios, Gliders, and Cyrus base codes.


title: An arbitrary order Reconstructed Discontinuous Approximation to Fourth-order Curl Problem

abstract: We present an arbitrary order discontinuous Galerkin finite element method for solving the fourth-order curl problem using a reconstructed discontinuous approximation method. It is based on an arbitrarily high-order approximation space with one unknown per element in each dimension. The discrete problem is based on the symmetric IPDG method. We prove a priori error estimates under the energy norm and the L^2 norm and show numerical results to verify the theoretical analysis.


title: ATLAS: Improving Lay Summarisation with Attribute-based Control

abstract: Lay summarisation aims to produce summaries of scientific articles that are comprehensible to non-expert audiences. However, previous work assumes a one-size-fits-all approach, where the content and style of the produced summary are entirely dependent on the data used to train the model. In practice, audiences with different levels of expertise will have specific needs, impacting what content should appear in a lay summary and how it should be presented. Aiming to address this, we propose ATLAS, a novel abstractive summarisation approach that can control various properties that contribute to the overall "layness" of the generated summary using targeted control attributes. We evaluate ATLAS on a combination of biomedical lay summarisation datasets, where it outperforms state-of-the-art baselines using mainstream summarisation metrics. Additional analyses provided on the discriminatory power and emergent influence of our selected controllable attributes further attest to the effectiveness of our approach.


title: Engineering 2D square lattice Hubbard models in 90$^\circ$ twisted Ge/SnX (X=S, Se) moir\'e supperlattices

abstract: Due to the large-period superlattices emerging in moir\'e two-dimensional (2D) materials, electronic states in such systems exhibit low energy flat bands that can be used to simulate strongly correlated physics in a highly tunable setup. While many investigations have thus far focused on moir\'e flat bands and emergent correlated electron physics in triangular, honeycomb and quasi-one-dimensional lattices, tunable moir\'e realizations of square lattices subject to strong correlations remain elusive. Here we propose a feasible scheme to construct moire square lattice systems by twisting two layers of 2D materials in a rectangular lattice by 90 degrees. We demonstrate such scheme with twisted Ge/SnX (X=S,Se) moir\'e superlattices and theoretical calculate their electronic structures from first principles. We show that the lowest conduction flat band in these systems can be described by a square lattice Hubbard model with parameters which can be controlled by varying the choice of host materials, number of layers, and external electric fields. In particular, twisted double bilayer GeSe realizes a square lattice Hubbard model with strong frustration due to the next nearest neighbour hopping that could lead to unconventional superconductivity, in close analogy to the Hubbard model for copper-oxygen planes of cuprate high-temperature superconductors. The basic concept of using 90-degree twisted 2D materials with rectangular unit cell to realize the square lattice Hubbard model works in general and therefore we establish those systems as tunable platforms to simulate correlation physics in such a geometries.


title: A note on accurate pressure calculations of Coulomb systems with periodic boundary conditions

abstract: In this note, we address some issues concerning the accurate pressure calculation of Coulomb systems with periodic boundary conditions. First, we prove that the formulas for the excess part of the pressure with Ewald summation also reduce to the ensemble average of one-third of the ratio between the potential energy and the volume so that the comments on our previous work in a recent paper by [Onegin~\emph{et al}.,~J. Phys. A: Math.~Theor.~57 (2024) 205002] are incorrect. Second, we demonstrate that in charge non-neutral systems, the pressure expression must be corrected to include interactions with the neutralizing background. This addresses the issues about pressure computation in LAMMPS raised in the paper by Onegin {\it et al.}. Numerical experiments are performed to verify that the pressure obtained via Ewald summation with corrected terms agrees with the average pressure using thermodynamics for the non-neutral OCP system, and are independent of the splitting parameter in the Ewald summation.


title: Domain Generalization Guided by Large-Scale Pre-Trained Priors

abstract: Domain generalization (DG) aims to train a model from limited source domains, allowing it to generalize to unknown target domains. Typically, DG models only employ large-scale pre-trained models during the initialization of fine-tuning. However, large-scale pre-trained models already possess the ability to resist domain shift. If we reference pre-trained models continuously during fine-tuning to maintain this ability, it could further enhance the generalization ability of the DG model. For this purpose, we introduce a new method called Fine-Tune with Large-scale pre-trained Priors (FT-LP), which incorporates the pre-trained model as a prior into the DG fine-tuning process, ensuring that the model refers to its pre-trained model at each optimization step. FT-LP comprises a theoretical framework and a simple implementation strategy. In theory, we verify the rationality of FT-LP by introducing a generalization error bound with the pre-trained priors for DG. In implementation, we utilize an encoder to simulate the model distribution, enabling the use of FT-LP when only pre-trained weights are available. In summary, we offer a new fine-tuning method for DG algorithms to utilize pre-trained models throughout the fine-tuning process. Through experiments on various datasets and DG models, our proposed method exhibits significant improvements, indicating its effectiveness.


title: Separating the "Chirp" from the "Chat": Self-supervised Visual Grounding of Sound and Language

abstract: We present DenseAV, a novel dual encoder grounding architecture that learns high-resolution, semantically meaningful, and audio-visually aligned features solely through watching videos. We show that DenseAV can discover the ``meaning'' of words and the ``location'' of sounds without explicit localization supervision. Furthermore, it automatically discovers and distinguishes between these two types of associations without supervision. We show that DenseAV's localization abilities arise from a new multi-head feature aggregation operator that directly compares dense image and audio representations for contrastive learning. In contrast, many other systems that learn ``global'' audio and video representations cannot localize words and sound. Finally, we contribute two new datasets to improve the evaluation of AV representations through speech and sound prompted semantic segmentation. On these and other datasets we show DenseAV dramatically outperforms the prior art on speech and sound prompted semantic segmentation. DenseAV outperforms the previous state-of-the-art, ImageBind, on cross-modal retrieval using fewer than half of the parameters. Project Page: \href{https://aka.ms/denseav}{https://aka.ms/denseav}


title: Ctrl-V: Higher Fidelity Video Generation with Bounding-Box Controlled Object Motion

abstract: With recent advances in video prediction, controllable video generation has been attracting more attention. Generating high fidelity videos according to simple and flexible conditioning is of particular interest. To this end, we propose a controllable video generation model using pixel level renderings of 2D or 3D bounding boxes as conditioning. In addition, we also create a bounding box predictor that, given the initial and ending frames' bounding boxes, can predict up to 15 bounding boxes per frame for all the frames in a 25-frame clip. We perform experiments across 3 well-known AV video datasets: KITTI, Virtual-KITTI 2 and BDD100k.


title: CCSI: Continual Class-Specific Impression for Data-free Class Incremental Learning

abstract: In real-world clinical settings, traditional deep learning-based classification methods struggle with diagnosing newly introduced disease types because they require samples from all disease classes for offline training. Class incremental learning offers a promising solution by adapting a deep network trained on specific disease classes to handle new diseases. However, catastrophic forgetting occurs, decreasing the performance of earlier classes when adapting the model to new data. Prior proposed methodologies to overcome this require perpetual storage of previous samples, posing potential practical concerns regarding privacy and storage regulations in healthcare. To this end, we propose a novel data-free class incremental learning framework that utilizes data synthesis on learned classes instead of data storage from previous classes. Our key contributions include acquiring synthetic data known as Continual Class-Specific Impression (CCSI) for previously inaccessible trained classes and presenting a methodology to effectively utilize this data for updating networks when introducing new classes. We obtain CCSI by employing data inversion over gradients of the trained classification model on previous classes starting from the mean image of each class inspired by common landmarks shared among medical images and utilizing continual normalization layers statistics as a regularizer in this pixel-wise optimization process. Subsequently, we update the network by combining the synthesized data with new class data and incorporate several losses, including an intra-domain contrastive loss to generalize the deep network trained on the synthesized data to real data, a margin loss to increase separation among previous classes and new ones, and a cosine-normalized cross-entropy loss to alleviate the adverse effects of imbalanced distributions in training data.


title: Best Response Strategies for Asymmetric Sensing in Linear-Quadratic Differential Games

abstract: In this paper, we revisit the two-player continuous-time infinite-horizon linear quadratic differential game problem, where one of the players can sample the state of the system only intermittently due to a sensing constraint while the other player can do so continuously. Under these asymmetric sensing limitations between the players, we analyze the optimal sensing and control strategies for the player at a disadvantage while the other player continues to play its security strategy. We derive an optimal sensor policy within the class of stationary randomized policies. Finally, using simulations, we show that the expected cost accrued by the first player approaches its security level as its sensing limitation is relaxed.


title: Heterogeneous Treatment Effects in Panel Data

abstract: We address a core problem in causal inference: estimating heterogeneous treatment effects using panel data with general treatment patterns. Many existing methods either do not utilize the potential underlying structure in panel data or have limitations in the allowable treatment patterns. In this work, we propose and evaluate a new method that first partitions observations into disjoint clusters with similar treatment effects using a regression tree, and then leverages the (assumed) low-rank structure of the panel data to estimate the average treatment effect for each cluster. Our theoretical results establish the convergence of the resulting estimates to the true treatment effects. Computation experiments with semi-synthetic data show that our method achieves superior accuracy compared to alternative approaches, using a regression tree with no more than 40 leaves. Hence, our method provides more accurate and interpretable estimates than alternative methods.


abstract: The non-Abelian two-dimensional Toda lattice and matrix sine-Gordon equations with self-consistent sources are established and solved. Two families of quasideterminant solutions are presented for the non-Abelian two-dimensional Toda lattice with self-consistent sources. By employing periodic and quasi-periodic reductions, a matrix sine-Gordon equation with self-consistent sources is constructed for the first time, for which exact solutions in terms of quasideterminants are derived.


title: Gauss curvature flow to the $L_p$-Gaussian chord Minkowski problem

abstract: Recently, Huang and Qin \cite{HY01} introduced Gaussian chord measure and $L_p$-Gaussian chord measure by variational methods. Meanwhile, they posed Gaussian chord Minkowski problem and used variational methods to obtain an origin-symmetric normalized measure solution for the Gaussian chord Minkowski problem. Motivated by the forgoing works of $L_p$-Gaussian chord measure, we can not only propose the $L_p$-Gaussian chord Minkowski problem, but also obtain its smooth solutions. Specially, we provide a smooth even solution for $p=0$. In this paper, we obtain the existence of smooth even solutions to the $L_p$-Gaussian chord Minkowski problem with $p\geq 0$ and $q>2$ by method of a Gauss curvature flow.


title: What is my quantum computer good for? Quantum capability learning with physics-aware neural networks

abstract: Quantum computers have the potential to revolutionize diverse fields, including quantum chemistry, materials science, and machine learning. However, contemporary quantum computers experience errors that often cause quantum programs run on them to fail. Until quantum computers can reliably execute large quantum programs, stakeholders will need fast and reliable methods for assessing a quantum computer's capability-i.e., the programs it can run and how well it can run them. Previously, off-the-shelf neural network architectures have been used to model quantum computers' capabilities, but with limited success, because these networks fail to learn the complex quantum physics that determines real quantum computers' errors. We address this shortcoming with a new quantum-physics-aware neural network architecture for learning capability models. Our architecture combines aspects of graph neural networks with efficient approximations to the physics of errors in quantum programs. This approach achieves up to $\sim50\%$ reductions in mean absolute error on both experimental and simulated data, over state-of-the-art models based on convolutional neural networks.


title: A Generalized Version of Chung's Lemma and its Applications

abstract: Chung's lemma is a classical tool for establishing asymptotic convergence rates of (stochastic) optimization methods under strong convexity-type assumptions and appropriate polynomial diminishing step sizes. In this work, we develop a generalized version of Chung's lemma, which provides a simple non-asymptotic convergence framework for a more general family of step size rules. We demonstrate broad applicability of the proposed generalized Chung's lemma by deriving tight non-asymptotic convergence rates for a large variety of stochastic methods. In particular, we obtain partially new non-asymptotic complexity results for stochastic optimization methods, such as stochastic gradient descent and random reshuffling, under a general $(\theta,\mu)$-Polyak-Lojasiewicz (PL) condition and for various step sizes strategies, including polynomial, constant, exponential, and cosine step sizes rules. Notably, as a by-product of our analysis, we observe that exponential step sizes can adapt to the objective function's geometry, achieving the optimal convergence rate without requiring exact knowledge of the underlying landscape. Our results demonstrate that the developed variant of Chung's lemma offers a versatile, systematic, and streamlined approach to establish non-asymptotic convergence rates under general step size rules.


title: Exponential Conic Relaxations for Signomial Geometric Programming

abstract: Signomial geometric programming (SGP) is a computationally challenging, NP-Hard class of nonconvex nonlinear optimization problems. SGP can be solved iteratively using a sequence of convex relaxations; consequently, the strength of such relaxations is an important factor to this iterative approach. Motivated by recent advances in solving exponential conic programming (ECP) problems, this paper develops a novel convex relaxation for SGP. Unlike existing work on relaxations, the base model in this paper does not assume bounded variables. However, bounded variables or monomial terms can be used to strengthen the relaxation by means of additional valid linear inequalities. We show how to embed the ECP relaxation in an iterative algorithm for SGP; leveraging recent advances in interior point method solvers, our computational experiments demonstrate the practical effectiveness of this approach.


title: A Comprehensive Evaluation of Parameter-Efficient Fine-Tuning on Automated Program Repair

abstract: Automated Program Repair (APR) aims to fix bugs by generating patches. And existing work has demonstrated that "pre-training and fine-tuning" paradigm enables Large Language Models (LLMs) improve fixing capabilities on APR. However, existing work mainly focuses on Full-Model Fine-Tuning (FMFT) for APR and limited research has been conducted on the execution-based evaluation of Parameter-Efficient Fine-Tuning (PEFT) for APR. Comparing to FMFT, PEFT can reduce computing resource consumption without compromising performance and has been widely adopted to other software engineering tasks. To fill this gap, we enhance the existing APR dataset by employing prompt engineering to create an instruction dataset, APR-INSTRUCTION, at first. Secondly, we fine-tune four pre-trained LLMs using four different PEFT methods with APR-INSTRUCTION. The best fine-tuned model fixes 58% more bugs than the state-of-the-art LLM-based APR techniques. The results also show that $(IA)^3$ improves the creativity of LLMs more effectively through fine-tuning and achieves the highest fixing capability compared to the other three PEFT methods. Thirdly, we explore the optimal configuration of PEFT hyperparameters, and assess the impact of instruction dataset size, showing that a larger number of parameters and a larger training dataset do not necessarily result in better performance for PEFT. Lastly, we analyze peak memory usage and trainable parameters to show the efficiency of PEFT. This work provides a comprehensive exploration of PEFT on APR and suggests potentially promising directions for extension to other software engineering downstream tasks. APR-INSTRUCTION, PEFT weights, and the fine-tuning code are publicly available as open-source resources.


title: Spectroscopic factors of resonance states with the Gamow shell model

abstract: We provide an investigation of the spectroscopic factor of resonance states in $A =5-8$ nuclei, utilizing the Gamow shell model (GSM). Within the GSM, the configuration mixing is taken into account exactly with the shell model framework, and the continuum coupling is addressed via the complex-energy Berggren ensemble, which treats bound, resonance, and non-resonant continuum single-particle states on an equal footing. As a result, both the configuration mixing and continuum coupling are meticulously considered in the GSM. We first calculate the low-lying states of helium isotopes and isotones with the GSM, and the results are compared with that of \textit{ab initio} no-core shell model (NCSM) calculations. The results indicate that GSM can reproduce the low-lying resonance states more accurately than the no-core shell model. Following this, we delve into the spectroscopic factors of the resonance states as computed through both GSM and NCSM, concurrently conducting systematic calculations of overlap functions pertinent to these resonance states. Finally, the calculated overlap function and spectroscopic factor of $^6$He$(0_1^+)$ $\otimes \nu p_{3/2} \to $ $^7$He$(3/2_1^-)$ with GSM are compared with the results from \textit{ab initio} NCSM, variational Monte Carlo, and Green's function Monte Carlo calculations, as well as avaliable experimental data. The results assert that wave function asymptotes can only be reproduced in GSM, where resonance and continuum coupling are precisely addressed.


title: PaRa: Personalizing Text-to-Image Diffusion via Parameter Rank Reduction

abstract: Personalizing a large-scale pretrained Text-to-Image (T2I) diffusion model is challenging as it typically struggles to make an appropriate trade-off between its training data distribution and the target distribution, i.e., learning a novel concept with only a few target images to achieve personalization (aligning with the personalized target) while preserving text editability (aligning with diverse text prompts). In this paper, we propose PaRa, an effective and efficient Parameter Rank Reduction approach for T2I model personalization by explicitly controlling the rank of the diffusion model parameters to restrict its initial diverse generation space into a small and well-balanced target space. Our design is motivated by the fact that taming a T2I model toward a novel concept such as a specific art style implies a small generation space. To this end, by reducing the rank of model parameters during finetuning, we can effectively constrain the space of the denoising sampling trajectories towards the target. With comprehensive experiments, we show that PaRa achieves great advantages over existing finetuning approaches on single/multi-subject generation as well as single-image editing. Notably, compared to the prevailing fine-tuning technique LoRA, PaRa achieves better parameter efficiency (2x fewer learnable parameters) and much better target image alignment.


title: The Invertibility of Cellular Automata with Menory: Correcting Errors and New Conclusions

abstract: Cellular automata with memory (CAM) are widely used in fields such as image processing, pattern recognition, simulation, and cryptography. The invertibility of CAM is generally considered to be chaotic. Paper [Invertible behavior in elementary cellular automata with memory, Juan C. Seck-Tuoh-Mora et al., Information Sciences, 2012] presented necessary and sufficient conditions for the invertibility of elementary CAM, but it contains a critical error: it classifies identity CAM as non-invertible, whereas identity CAM is undoubtedly invertible. By integrating Amoroso's algorithm and cycle graphs, we provide the correct necessary and sufficient conditions for the invertibility of one-dimensional CAM. Additionally, we link CAM to a specific type of cellular automaton that is isomorphic to CAM, behaves identically, and has easily determinable invertibility. This makes it a promising alternative tool for CAM applications.


title: Predicting edge-localized monovacancy defects in zigzag graphene nanoribbons from Floquet quasienergy spectrum

abstract: In this work, we prescribe a theoretical framework aiming at predicting the position of monovacancy defects at the edges of zigzag graphene nanoribbons (ZGNRs) using Floquet-Bloch formalism, which can be experimentally observed through time- and angle-resolved photoemission spectroscopy (tr-ARPES). Our methodology involves an in-depth investigation of the Floquet quasienergy band spectrum influenced by light with varying polarization across a range of frequencies. Particularly under the influence of circularly polarized light with a frequency comparable to the bandwidth of the system, our findings suggest a promising approach for locating monovacancy defects at either edge, a challenge that proves intricate to predict from the ARPES spectrum of ZGNRs with monovacancy defects. This has been achieved by analyzing the orientation of the Floquet edge state and the appearance of new Dirac points in the vicinity of the Fermi level. The real-world applications of these captivating characteristics underscore the importance and pertinence of our theoretical framework, paving the way for additional exploration and practical use. Our approach, employing the Floquet formalism, is not limited to monovacancy-type defects; rather, it can be expanded to encompass various types of vacancy defects.


title: How Alignment and Jailbreak Work: Explain LLM Safety through Intermediate Hidden States

abstract: Large language models (LLMs) rely on safety alignment to avoid responding to malicious user inputs. Unfortunately, jailbreak can circumvent safety guardrails, resulting in LLMs generating harmful content and raising concerns about LLM safety. Due to language models with intensive parameters often regarded as black boxes, the mechanisms of alignment and jailbreak are challenging to elucidate. In this paper, we employ weak classifiers to explain LLM safety through the intermediate hidden states. We first confirm that LLMs learn ethical concepts during pre-training rather than alignment and can identify malicious and normal inputs in the early layers. Alignment actually associates the early concepts with emotion guesses in the middle layers and then refines them to the specific reject tokens for safe generations. Jailbreak disturbs the transformation of early unethical classification into negative emotions. We conduct experiments on models from 7B to 70B across various model families to prove our conclusion. Overall, our paper indicates the intrinsical mechanism of LLM safety and how jailbreaks circumvent safety guardrails, offering a new perspective on LLM safety and reducing concerns. Our code is available at https://github.com/ydyjya/LLM-IHS-Explanation.


title: Anomaly Multi-classification in Industrial Scenarios: Transferring Few-shot Learning to a New Task

abstract: In industrial scenarios, it is crucial not only to identify anomalous items but also to classify the type of anomaly. However, research on anomaly multi-classification remains largely unexplored. This paper proposes a novel and valuable research task called anomaly multi-classification. Given the challenges in applying few-shot learning to this task, due to limited training data and unique characteristics of anomaly images, we introduce a baseline model that combines RelationNet and PatchCore. We propose a data generation method that creates pseudo classes and a corresponding proxy task, aiming to bridge the gap in transferring few-shot learning to industrial scenarios. Furthermore, we utilize contrastive learning to improve the vanilla baseline, achieving much better performance than directly fine-tune a ResNet. Experiments conducted on MvTec AD and MvTec3D AD demonstrate that our approach shows superior performance in this novel task.


title: ICU-Sepsis: A Benchmark MDP Built from Real Medical Data

abstract: We present ICU-Sepsis, an environment that can be used in benchmarks for evaluating reinforcement learning (RL) algorithms. Sepsis management is a complex task that has been an important topic in applied RL research in recent years. Therefore, MDPs that model sepsis management can serve as part of a benchmark to evaluate RL algorithms on a challenging real-world problem. However, creating usable MDPs that simulate sepsis care in the ICU remains a challenge due to the complexities involved in acquiring and processing patient data. ICU-Sepsis is a lightweight environment that models personalized care of sepsis patients in the ICU. The environment is a tabular MDP that is widely compatible and is challenging even for state-of-the-art RL algorithms, making it a valuable tool for benchmarking their performance. However, we emphasize that while ICU-Sepsis provides a standardized environment for evaluating RL algorithms, it should not be used to draw conclusions that guide medical practice.


title: Sustainable Wireless Networks via Reconfigurable Intelligent Surfaces (RISs): Overview of the ETSI ISG RIS

abstract: Reconfigurable Intelligent Surfaces (RISs) are a novel form of ultra-low power devices that are capable to increase the communication data rates as well as the cell coverage in a cost- and energy-efficient way. This is attributed to their programmable operation that enables them to dynamically manipulate the wireless propagation environment, a feature that has lately inspired numerous research investigations and applications. To pave the way to the formal standardization of RISs, the European Telecommunications Standards Institute (ETSI) launched the Industry Specification Group (ISG) on the RIS technology in September 2021. This article provides a comprehensive overview of the status of the work conducted by the ETSI ISG RIS, covering typical deployment scenarios of reconfigurable metasurfaces, use cases and operating applications, requirements, emerging hardware architectures and operating modes, as well as the latest insights regarding future directions of RISs and the resulting smart wireless environments.


title: Distributionally robust stochastic optimal control

abstract: The main goal of this paper is to discuss the construction of distributionally robust counterparts of stochastic optimal control problems. Randomized and non-randomized policies are considered. In particular, necessary and sufficient conditions for the existence of non-randomized policies are given.


title: GTR: Improving Large 3D Reconstruction Models through Geometry and Texture Refinement

abstract: We propose a novel approach for 3D mesh reconstruction from multi-view images. Our method takes inspiration from large reconstruction models like LRM that use a transformer-based triplane generator and a Neural Radiance Field (NeRF) model trained on multi-view images. However, in our method, we introduce several important modifications that allow us to significantly enhance 3D reconstruction quality. First of all, we examine the original LRM architecture and find several shortcomings. Subsequently, we introduce respective modifications to the LRM architecture, which lead to improved multi-view image representation and more computationally efficient training. Second, in order to improve geometry reconstruction and enable supervision at full image resolution, we extract meshes from the NeRF field in a differentiable manner and fine-tune the NeRF model through mesh rendering. These modifications allow us to achieve state-of-the-art performance on both 2D and 3D evaluation metrics, such as a PSNR of 28.67 on Google Scanned Objects (GSO) dataset. Despite these superior results, our feed-forward model still struggles to reconstruct complex textures, such as text and portraits on assets. To address this, we introduce a lightweight per-instance texture refinement procedure. This procedure fine-tunes the triplane representation and the NeRF color estimation model on the mesh surface using the input multi-view images in just 4 seconds. This refinement improves the PSNR to 29.79 and achieves faithful reconstruction of complex textures, such as text. Additionally, our approach enables various downstream applications, including text- or image-to-3D generation.


title: Black hole in a generalized Chaplygin-Jacobi dark fluid: shadow and light deflection angle

abstract: We investigate a generalized Chaplygin-like gas with an anisotropic equation of state, characterizing a dark fluid within which a static spherically symmetric black hole is assumed. By solving the Einstein equations for this black hole spacetime, we explicitly derive the metric function. The spacetime is parametrized by two critical parameters, $\mathcal{B}$ and $\alpha$, which measure the deviation from the Schwarzschild black hole and the extent of the dark fluid's anisotropy, respectively. We explore the behavior of light rays in the vicinity of the black hole by calculating its shadow and comparing our results with the Event Horizon Telescope observations. This comparison constrains the parameters to $0 \leq \mathcal{B} < 0.03$ and $0 < \alpha < 0.1$. Additionally, we calculate the deflection angles to determine the extent to which light is bent by the black hole. These calculations are further utilized to formulate possible Einstein rings, estimating the angular radius of the rings to be approximately $37.6\,\mathrm{\mu as}$. Throughout this work, we present analytical solutions wherever feasible, and employ reliable approximations where necessary to provide comprehensive insights into the spacetime characteristics and their observable effects.


title: A Superalignment Framework in Autonomous Driving with Large Language Models

abstract: Over the last year, significant advancements have been made in the realms of large language models (LLMs) and multi-modal large language models (MLLMs), particularly in their application to autonomous driving. These models have showcased remarkable abilities in processing and interacting with complex information. In autonomous driving, LLMs and MLLMs are extensively used, requiring access to sensitive vehicle data such as precise locations, images, and road conditions. These data are transmitted to an LLM-based inference cloud for advanced analysis. However, concerns arise regarding data security, as the protection against data and privacy breaches primarily depends on the LLM's inherent security measures, without additional scrutiny or evaluation of the LLM's inference outputs. Despite its importance, the security aspect of LLMs in autonomous driving remains underexplored. Addressing this gap, our research introduces a novel security framework for autonomous vehicles, utilizing a multi-agent LLM approach. This framework is designed to safeguard sensitive information associated with autonomous vehicles from potential leaks, while also ensuring that LLM outputs adhere to driving regulations and align with human values. It includes mechanisms to filter out irrelevant queries and verify the safety and reliability of LLM outputs. Utilizing this framework, we evaluated the security, privacy, and cost aspects of eleven large language model-driven autonomous driving cues. Additionally, we performed QA tests on these driving prompts, which successfully demonstrated the framework's efficacy.


title: Distributed Combinatorial Optimization of Downlink User Assignment in mmWave Cell-free Massive MIMO Using Graph Neural Networks

abstract: Millimeter wave (mmWave) cell-free massive MIMO (CF mMIMO) is a promising solution for future wireless communications. However, its optimization is non-trivial due to the challenging channel characteristics. We show that mmWave CF mMIMO optimization is largely an assignment problem between access points (APs) and users due to the high path loss of mmWave channels, the limited output power of the amplifier, and the almost orthogonal channels between users given a large number of AP antennas. The combinatorial nature of the assignment problem, the requirement for scalability, and the distributed implementation of CF mMIMO make this problem difficult. In this work, we propose an unsupervised machine learning (ML) enabled solution. In particular, a graph neural network (GNN) customized for scalability and distributed implementation is introduced. Moreover, the customized GNN architecture is hierarchically permutation-equivariant (HPE), i.e., if the APs or users of an AP are permuted, the output assignment is automatically permuted in the same way. To address the combinatorial problem, we relax it to a continuous problem, and introduce an information entropy-inspired penalty term. The training objective is then formulated using the augmented Lagrangian method (ALM). The test results show that the realized sum-rate outperforms that of the generalized serial dictatorship (GSD) algorithm and is very close to the upper bound in a small network scenario, while the upper bound is impossible to obtain in a large network scenario.


title: Heart Sound Segmentation Using Deep Learning Techniques

abstract: Heart disease remains a leading cause of mortality worldwide. Auscultation, the process of listening to heart sounds, can be enhanced through computer-aided analysis using Phonocardiogram (PCG) signals. This paper presents a novel approach for heart sound segmentation and classification into S1 (LUB) and S2 (DUB) sounds. We employ FFT-based filtering, dynamic programming for event detection, and a Siamese network for robust classification. Our method demonstrates superior performance on the PASCAL heart sound dataset compared to existing approaches.


title: DomainRAG: A Chinese Benchmark for Evaluating Domain-specific Retrieval-Augmented Generation

abstract: Retrieval-Augmented Generation (RAG) offers a promising solution to address various limitations of Large Language Models (LLMs), such as hallucination and difficulties in keeping up with real-time updates. This approach is particularly critical in expert and domain-specific applications where LLMs struggle to cover expert knowledge. Therefore, evaluating RAG models in such scenarios is crucial, yet current studies often rely on general knowledge sources like Wikipedia to assess the models' abilities in solving common-sense problems. In this paper, we evaluated LLMs by RAG settings in a domain-specific context, college enrollment. We identified six required abilities for RAG models, including the ability in conversational RAG, analyzing structural information, faithfulness to external knowledge, denoising, solving time-sensitive problems, and understanding multi-document interactions. Each ability has an associated dataset with shared corpora to evaluate the RAG models' performance. We evaluated popular LLMs such as Llama, Baichuan, ChatGLM, and GPT models. Experimental results indicate that existing closed-book LLMs struggle with domain-specific questions, highlighting the need for RAG models to solve expert problems. Moreover, there is room for RAG models to improve their abilities in comprehending conversational history, analyzing structural information, denoising, processing multi-document interactions, and faithfulness in expert knowledge. We expect future studies could solve these problems better.


title: Holding the fields constant: A shape-calculus approach to electromagnetic forces

abstract: Using the mathematical theory of shape calculus as tool, we perform a rigorous investigation of the virtual work principle for the computation of electromagnetic forces in static settings. The main goal is to shed light on the widely held belief that the virtual work principle entails passively advecting the fields with the virtual displacement when computing deformation-dependent field energies gradients. The adjoint approach to differentiation of functionals under variational constraints provides a mathematical justification for this belief. However, it also shows that passively advecting the actual electromagnetic fields is sufficient only in the case of linear materials. In the general case, also fields arising as solutions of adjoint variational problems have to be taken into account.


title: Phase-Subtractive Interference and Noise-Resistant Quantum Imaging with Two Undetected Photons

abstract: We present a quantum interference phenomenon in which four-photon quantum states generated by two independent sources are used to create a two-photon interference pattern without detecting two of the photons. Contrary to the common perception, the interference pattern can be made fully independent of phases acquired by the photons detected to construct it. However, it still contains information about spatially dependent phases acquired by the two undetected photons. This phenomenon can also be observed with fermionic particles. We show that the phenomenon can be applied to develop an interferometric, quantum phase imaging technique that is immune to uncontrollable phase fluctuations in the interferometer and allows image acquisition without detecting the photons illuminating the object.


title: Single channel PICOSEC Micromegas detector with improved time resolution

abstract: This paper presents design guidelines and experimental verification of a single-channel PICOSEC Micromegas (MM) detector with an improved time resolution. The design encompasses the detector board, vessel, auxiliary mechanical parts, and electrical connectivity for high voltage (HV) and signals, focusing on improving stability, reducing noise, and ensuring signal integrity to optimize timing performance. A notable feature is the simple and fast reassembly procedure, facilitating quick replacement of detector internal components that allows for an efficient measurement strategy involving different detector components. The paper also examines the influence of parasitics on the output signal integrity. To validate the design, a prototype assembly and three interchangeable detector boards with varying readout pad diameters were manufactured. The detectors were initially tested in the laboratory environment. Finally, the timing performance of detectors with different pad sizes was verified using a Minimum Ionizing Particle (MIP) beam test. Notably, a record time resolution for a PICOSEC Micromegas detector technology with a CsI photocathode of 12.5$\pm$0.8 ps was achieved with a 10 mm diameter readout pad size detector.


title: Visual Prompt Tuning in Null Space for Continual Learning

abstract: Existing prompt-tuning methods have demonstrated impressive performances in continual learning (CL), by selecting and updating relevant prompts in the vision-transformer models. On the contrary, this paper aims to learn each task by tuning the prompts in the direction orthogonal to the subspace spanned by previous tasks' features, so as to ensure no interference on tasks that have been learned to overcome catastrophic forgetting in CL. However, different from the orthogonal projection in the traditional CNN architecture, the prompt gradient orthogonal projection in the ViT architecture shows completely different and greater challenges, i.e., 1) the high-order and non-linear self-attention operation; 2) the drift of prompt distribution brought by the LayerNorm in the transformer block. Theoretically, we have finally deduced two consistency conditions to achieve the prompt gradient orthogonal projection, which provide a theoretical guarantee of eliminating interference on previously learned knowledge via the self-attention mechanism in visual prompt tuning. In practice, an effective null-space-based approximation solution has been proposed to implement the prompt gradient orthogonal projection. Extensive experimental results demonstrate the effectiveness of anti-forgetting on four class-incremental benchmarks with diverse pre-trained baseline models, and our approach achieves superior performances to state-of-the-art methods. Our code is available at https://github.com/zugexiaodui/VPTinNSforCL.


title: Do LLMs Exhibit Human-Like Reasoning? Evaluating Theory of Mind in LLMs for Open-Ended Responses

abstract: Theory of Mind (ToM) reasoning entails recognizing that other individuals possess their own intentions, emotions, and thoughts, which is vital for guiding one's own thought processes. Although large language models (LLMs) excel in tasks such as summarization, question answering, and translation, they still face challenges with ToM reasoning, especially in open-ended questions. Despite advancements, the extent to which LLMs truly understand ToM reasoning and how closely it aligns with human ToM reasoning remains inadequately explored in open-ended scenarios. Motivated by this gap, we assess the abilities of LLMs to perceive and integrate human intentions and emotions into their ToM reasoning processes within open-ended questions. Our study utilizes posts from Reddit's ChangeMyView platform, which demands nuanced social reasoning to craft persuasive responses. Our analysis, comparing semantic similarity and lexical overlap metrics between responses generated by humans and LLMs, reveals clear disparities in ToM reasoning capabilities in open-ended questions, with even the most advanced models showing notable limitations. To enhance LLM capabilities, we implement a prompt tuning method that incorporates human intentions and emotions, resulting in improvements in ToM reasoning performance. However, despite these improvements, the enhancement still falls short of fully achieving human-like reasoning. This research highlights the deficiencies in LLMs' social reasoning and demonstrates how integrating human intentions and emotions can boost their effectiveness.


title: Injecting Undetectable Backdoors in Deep Learning and Language Models

abstract: As ML models become increasingly complex and integral to high-stakes domains such as finance and healthcare, they also become more susceptible to sophisticated adversarial attacks. We investigate the threat posed by undetectable backdoors in models developed by insidious external expert firms. When such backdoors exist, they allow the designer of the model to sell information to the users on how to carefully perturb the least significant bits of their input to change the classification outcome to a favorable one. We develop a general strategy to plant a backdoor to neural networks while ensuring that even if the model's weights and architecture are accessible, the existence of the backdoor is still undetectable. To achieve this, we utilize techniques from cryptography such as cryptographic signatures and indistinguishability obfuscation. We further introduce the notion of undetectable backdoors to language models and extend our neural network backdoor attacks to such models based on the existence of steganographic functions.


title: MS-HuBERT: Mitigating Pre-training and Inference Mismatch in Masked Language Modelling methods for learning Speech Representations

abstract: In recent years, self-supervised pre-training methods have gained significant traction in learning high-level information from raw speech. Among these methods, HuBERT has demonstrated SOTA performance in automatic speech recognition (ASR). However, HuBERT's performance lags behind data2vec due to disparities in pre-training strategies. In this paper, we propose (i) a Swap method to address pre-training and inference mismatch observed in HuBERT and (ii) incorporates Multicluster masked prediction loss for more effective utilization of the models capacity. The resulting method is, MS-HuBERT, an end-to-end self-supervised pre-training method for learning robust speech representations. It beats vanilla HuBERT on the ASR Librispeech benchmark on average by a 5% margin when evaluated on different finetuning splits. Additionally, we demonstrate that the learned embeddings obtained during pre-training encode essential information for improving performance of content based tasks such as ASR.


title: Macroscopic Market Making Games

abstract: In continuation of the macroscopic market making \`a la Avellaneda-Stoikov as a control problem, this paper explores its stochastic game. Concerning the price competition, each agent is compared with the best quote from the others. We start with the linear case. While constructing the solution directly, the ordering property and the dimension reduction in the equilibrium are revealed. For the non-linear case, extending the decoupling approach, we introduce a multidimensional characteristic equation to study the well-posedness of forward-backward stochastic differential equations. Properties of coefficients in the characteristic equation are obtained via non-smooth analysis. In addition to novel well-posedness results, the linear price impact arises and the impact function can be further decomposed into two parts in some examples.


title: Movable Antenna Assisted OAM Wireless Communications With Misaligned Transceiver

abstract: The vortex electromagnetic wave carried by multiple orthogonal orbital angular momentum (OAM) modes in the same frequency band can be applied to the field of wireless communications, which greatly increases the spectrum efficiency. The uniform circular array (UCA) is the classical structure to generate and receive vortex electromagnetic waves with multiple OAM-modes. However, when the transmit and receive UCAs are misaligned, there will be interference among the OAM-modes and the signal cannot be recovered at the receiver. In order to solve this problem, we propose movable antenna (MA) assisted OAM wireless communications scheme. We estimate the rotation angle between transmit and receive UCAs and feed it back to the transmitter. Then, the MA at the transmitter adjusts the rotation angle to achieve alignment of the UCA at both the receiver and transmitter. Simulation results show that our scheme can significantly improve the spectrum efficiency.


title: Multi-color and TESS photometric investigation of four lo mass-ratio contact binary systems

abstract: We present the TESS and BVRcIc light curves solution of four low mass-ratio contact binary systems TIC 159102550), V1068 Her, MW Pav and TIC 321576458. Except MW Pav, all three systems have been studied for the first time. The period analysis of TIC 159102550 show anti-correlation between primary and secondary minima and no long term variation is reported. The systems V1068 Her and MW Pav show increasing orbital period trends. Data for TIC 321576458 is too few to determine any periodic variations. The light curve analysis using Wilson-Divinney model shows that systems are low mass-ratio contact binaries. Out of four targets, two systems TIC 159102550 and V1068 Her, are shallow contact binary systems with fill-out factor of 20% and 14%, respectively. The two contact binaries MW Pav and TIC 321576458 are in deep contact state with fill-out factor 63% and 61%, respectively. V1068 Her shows EB-type light curve, however the temperature difference between the primary secondary component is only 17K, which indicates that system is in thermal contact. To understand the evolutionary status of these systems, the components are plotted on the mass-luminosity diagram. The primary companions are in the ZAMS zone while the secondary components of all the systems are away from TAMS which indicates that secondary is more evolved than the primary components. V1068 Her and MW Pav are expected to evolve into a single rapidly rotating star provided that they meet the well-know Hut's criterion. Through statistical investigation of more than hundred low mass-ratio contact binary systems including our targets, we have found that all of the low mass-ratio contact binaries have undergone the mass-ratio inversion process. Based on our sample, the relationship between mass ratio and spin and orbital angular momentum ratio has been updated and proposed a new value of qmin = 0.0388 for Darwin's stability.


title: Quality of Approximate Balanced Truncation

abstract: Model reduction is a powerful tool in dealing with numerical simulation of large scale dynamic systems for studying complex physical systems. Two major types of model reduction methods for linear time-invariant dynamic systems are Krylov subspace-based methods and balanced truncation-based methods. The methods of the second type are much more theoretically sound than the first type in that there is a fairly tight global error bound on the approximation error between the original system and the reduced one. It is noted that the error bound is established based upon the availability of the exact controllability and observability Gramians. However, numerically, the Gramians are not available and have to be numerically calculated, and for a large scale system, a viable option is to compute low-rank approximations of the Gramians from which an approximate balanced truncation is then performed. Hence, rigorously speaking, the existing global error bound is not applicable to any reduced system obtained via approximate Gramians. The goal of this paper is to address this issue by establishing global error bounds for reduced systems via approximate balanced truncation.


title: General Distribution Learning: A theoretical framework for Deep Learning

abstract: There remain numerous unanswered research questions on deep learning (DL) within the classical learning theory framework. These include the remarkable generalization capabilities of overparametrized neural networks (NNs), the efficient optimization performance despite non-convexity of objectives, the mechanism of flat minima for generalization, and the exceptional performance of deep architectures in solving physical problems. This paper introduces General Distribution Learning (GD Learning), a novel theoretical learning framework designed to address a comprehensive range of machine learning and statistical tasks, including classification, regression and parameter estimation. Departing from traditional statistical machine learning, GD Learning focuses on the true underlying distribution. In GD Learning, learning error, corresponding to the expected error in classical statistical learning framework, is divided into fitting errors due to models and algorithms, as well as sampling errors introduced by limited sampling data. The framework significantly incorporates prior knowledge, especially in scenarios characterized by data scarcity, thereby enhancing performance. Within the GD Learning framework, we demonstrate that the global optimal solutions in non-convex optimization can be approached by minimizing the gradient norm and the non-uniformity of the eigenvalues of the model's Jacobian matrix. This insight leads to the development of the gradient structure control algorithm. GD Learning also offers fresh insights into the questions on deep learning, including overparameterization and non-convex optimization, bias-variance trade-off, and the mechanism of flat minima.


title: Achieving High Capacity Transmission With N-Dimensional Quasi-Fractal UCA

abstract: The vortex electromagnetic wave carried by multiple orthogonal orbital angular momentum (OAM) modes in the same frequency band can be applied to the field of wireless communications, which greatly increases the spectrum efficiency. The uniform circular array (UCA) is widely used to generate and receive vortex electromagnetic waves with multiple OAM-modes. However, the maximum number of orthogonal OAM-modes based on UCA is usually limited to the number of array-elements of the UCA antenna, leaving how to utilize more OAM-modes to achieve higher channel capacity with a fixed number of arrayelements as an intriguing question. In this paper, we propose an N-dimensional quasi-fractal UCA (ND QF-UCA) antenna structure in different fractal geometry layouts to break through the limits of array-elements number on OAM-modes number. We develop the N-dimensional OAM modulation (NOM) and demodulation (NOD) schemes for OAM multiplexing transmission with the OAM-modes number exceeding the array-elements number, which is beyond the traditional concept of multiple antenna based wireless communications. Then, we investigate different dimensional multiplexing transmission schemes based on the corresponding QF-UCA antenna structure with various array-element layouts and evaluate the optimal layout type and dimension to obtain the highest channel capacity with a fixed number of array-elements. Simulation results show that our proposed schemes can obtain a higher spectrum efficiency, surpassing those of alternative array-element layouts of QF-UCA and the traditional multiple antenna systems.


title: SRC-Net: Bi-Temporal Spatial Relationship Concerned Network for Change Detection

abstract: Change detection (CD) in remote sensing imagery is a crucial task with applications in environmental monitoring, urban development, and disaster management. CD involves utilizing bi-temporal images to identify changes over time. The bi-temporal spatial relationships between features at the same location at different times play a key role in this process. However, existing change detection networks often do not fully leverage these spatial relationships during bi-temporal feature extraction and fusion. In this work, we propose SRC-Net: a bi-temporal spatial relationship concerned network for CD. The proposed SRC-Net includes a Perception and Interaction Module that incorporates spatial relationships and establishes a cross-branch perception mechanism to enhance the precision and robustness of feature extraction. Additionally, a Patch-Mode joint Feature Fusion Module is introduced to address information loss in current methods. It considers different change modes and concerns about spatial relationships, resulting in more expressive fusion features. Furthermore, we construct a novel network using these two relationship concerned modules and conducted experiments on the LEVIR-CD and WHU Building datasets. The experimental results demonstrate that our network outperforms state-of-the-art (SOTA) methods while maintaining a modest parameter count. We believe our approach sets a new paradigm for change detection and will inspire further advancements in the field. The code and models are publicly available at https://github.com/Chnja/SRCNet.


title: Ab initio valence-space in-medium similarity renormalization group calculations for neutron-rich P, Cl, and K isotopes

abstract: Neutron-rich P, Cl, and K isotopes, particularly those with neutron numbers around $N=28$, have attracted extensive experimental and theoretical interest. We utilize the \textit{ab initio} valence-space in-medium similarity renormalization group approach, based on chiral nucleon-nucleon and three-nucleon forces, to investigate the exotic properties of these isotopes. Systematic calculations of the low-lying spectra are performed. A key finding is the level inversion between $3/2_1^+$ and $1/2_1^+$ states in odd-$A$ isotopes, attributed to the inversion of $\pi 0d_{3/2}$ and $\pi 1s_{1/2}$ single-particle states.\textit{Ab initio} calculations, which incorporate the three-nucleon forces, correlate closely with existing experimental data. Further calculations of effective proton single-particle energies provide deeper insights into the shell evolution for $Z=14$ and $16$ sub-shells. Our results indicate that the three-body force plays important roles in the shell evolution for $Z=14$ and $16$ sub-shells with neutron numbers ranging from 20 to 28. Additionally, systematic \textit{ab initio} calculations are conducted for the low-lying spectra of odd-odd nuclei. The results align with experimental data and provide new insights for future research into these isotopes, up to and beyond the drip line.


title: Certified Robustness to Data Poisoning in Gradient-Based Training

abstract: Modern machine learning pipelines leverage large amounts of public data, making it infeasible to guarantee data quality and leaving models open to poisoning and backdoor attacks. However, provably bounding model behavior under such attacks remains an open problem. In this work, we address this challenge and develop the first framework providing provable guarantees on the behavior of models trained with potentially manipulated data. In particular, our framework certifies robustness against untargeted and targeted poisoning as well as backdoor attacks for both input and label manipulations. Our method leverages convex relaxations to over-approximate the set of all possible parameter updates for a given poisoning threat model, allowing us to bound the set of all reachable parameters for any gradient-based learning algorithm. Given this set of parameters, we provide bounds on worst-case behavior, including model performance and backdoor success rate. We demonstrate our approach on multiple real-world datasets from applications including energy consumption, medical imaging, and autonomous driving.


title: Efficient Beamforming Feedback Information-Based Wi-Fi Sensing by Feature Selection

abstract: Wi-Fi sensing leveraging plain-text beamforming feedback information (BFI) in multiple-input-multiple-output (MIMO) systems attracts increasing attention. However, due to the implicit relationship between BFI and the channel state information (CSI), quantifying the sensing capability of BFI poses a challenge in building efficient BFI-based sensing algorithms. In this letter, we first derive a mathematical model of BFI, characterizing its relationship with CSI explicitly, and then develop a closed-form expression of BFI for 2x2 MIMO systems. To enhance the efficiency of BFI-based sensing by selecting only the most informative features, we quantify the sensing capacity of BFI using the Cramer-Rao bound (CRB) and then propose an efficient CRB-based BFI feature selection algorithm. Simulation results verify that BFI and CSI exhibit comparable sensing capabilities and that the proposed algorithm halves the number of features, reducing 20% more parameters than baseline methods, at the cost of only slightly increasing positioning errors.


title: Text-aware and Context-aware Expressive Audiobook Speech Synthesis

abstract: Recent advances in text-to-speech have significantly improved the expressiveness of synthetic speech. However, a major challenge remains in generating speech that captures the diverse styles exhibited by professional narrators in audiobooks without relying on manually labeled data or reference speech. To address this problem, we propose a text-aware and context-aware(TACA) style modeling approach for expressive audiobook speech synthesis. We first establish a text-aware style space to cover diverse styles via contrastive learning with the supervision of the speech style. Meanwhile, we adopt a context encoder to incorporate cross-sentence information and the style embedding obtained from text. Finally, we introduce the context encoder to two typical TTS models, VITS-based TTS and language model-based TTS. Experimental results demonstrate that our proposed approach can effectively capture diverse styles and coherent prosody, and consequently improves naturalness and expressiveness in audiobook speech synthesis.


title: Flow of Reasoning: Efficient Training of LLM Policy with Divergent Thinking

abstract: Divergent thinking, the cognitive process of generating diverse solutions, is a hallmark of human creativity and problem-solving. For machines, sampling diverse solution trajectories in complex reasoning problems is crucial for robust outcomes, data augmentation, and enhanced model generalization. Large language models (LLMs) often struggle with generating high-quality, diverse reasoning. While supervised fine-tuning helps with quality, it requires extensive supervision data to capture the full diversity of solutions. Alternatively, reinforcement learning methods like PPO aim to find limited highest-reward solutions while neglecting the solution diversity, akin to convergent thinking. To address these limitations, we propose Flow of Reasoning (FoR) -- an efficient LLM training approach enabling diverse reasoning with minimal data. FoR formulates multi-step LLM reasoning as a Markovian flow from an initial state to terminal states. The formulation allows to adapt principled GFlowNet approaches to train the LLM as a policy, which is able to sample multiple reasoning paths with probabilities proportional to the unnormalized reward. Empirical results show that, with limited training data (e.g., 15 examples), FoR can discover diverse high-quality solutions that excel greatly beyond current state-of-the-art methods across three tasks, including embodied reasoning (BlocksWorld), math puzzle solving (Game24), and logical reasoning (PrOntoQA). Code is available at https://github.com/Yu-Fangxu/FoR.


title: Splitting of abelian varieties in motivic stable homotopy category

abstract: In this paper, we discuss the motivic stable homotopy type of abelian varieties. For an abelian variety over a field $k$ with a rational point, it always splits off a top-dimensional cell in motivic stable homotopy category $\text{SH}(k)$. Let $k = \mathbb{R}$, there is a concrete splitting which is determined by the motive of X and the real points $X(\mathbb{R})$ in $\text{SH}(\mathbb{R})_\mathbb{Q}$. We will also discuss this splitting from a viewpoint of the Chow-Witt correspondences.


title: Finding irregular subgraphs via local adjustments

abstract: For a graph $H$, let $m(H,k)$ denote the number of vertices of degree $k$ in $H$. A conjecture of Alon and Wei states that for any $d\geq 3$, every $n$-vertex $d$-regular graph contains a spanning subgraph $H$ satisfying $|m(H,k)-\frac{n}{d+1}|\leq 2$ for every $0\leq k \leq d$. This holds easily when $d\leq 2$. An asymptotic version of this conjecture was initially established by Frieze, Gould, Karo\'nski and Pfender, subsequently improved by Alon and Wei, and most recently enhanced by Fox, Luo and Pham, approaching its complete range. All of these approaches relied on probabilistic methods. In this paper, we provide a novel framework to study this conjecture, based on localized deterministic techniques which we call local adjustments. We prove two main results. Firstly, we show that every $n$-vertex $d$-regular graph contains a spanning subgraph $H$ satisfying $|m(H,k)-\frac{n}{d+1}|\leq 2d^2$ for all $0\leq k \leq d$, which provides the first bound independent of the value of $n$. Secondly, we confirm the case $d=3$ of the Alon-Wei Conjecture in a strong form. Both results can be generalized to multigraphs and yield efficient algorithms for finding the desired subgraphs $H$. Furthermore, we explore a generalization of the Alon-Wei Conjecture for multigraphs and its connection to the Faudree-Lehel Conjecture concerning irregularity strength.


title: Chern insulator phase realized in dual-gate-tuned MnBi2Te4 thin films grown by molecular beam epitaxy

abstract: The intrinsic magnetic order, large topological-magnetic gap and rich topological phases make MnBi2Te4 a wonderful platform to study exotic topological quantum states such as axion insulator and Chern insulator. To realize and manipulate these topological phases in a MnBi2Te4 thin film, precise manipulation of the electric field across the film is essential, which requires a dual-gate structure. In this work, we achieve dual-gate tuning of MnBi2Te4 thin films grown with molecular beam epitaxy on SrTiO3(111) substrates by applying the substrate and an AlOx layer as the gate dielectrics of bottom and top gates, respectively. Under magnetic field of 9T and temperature of 20 mK, the Hall and longitudinal resistivities of the films show inversed gate-voltage dependence, for both top- and bottom-gates, signifying the existence of the dissipationless edge state contributed by Chern insulator phase in the ferromagnetic configuration. The maximum of the Hall resistivity only reaches 0.8 h/e2, even with dual-gate tuning, probably due to the high density of bulk carriers introduced by secondary phases. In the antiferromagnetic state under zero magnetic field, the films show normal insulator behavior. The dual-gated MnBi2Te4 thin films lay the foundation for developing devices based on electrically tunable topological quantum states.


title: Evolution-aware VAriance (EVA) Coreset Selection for Medical Image Classification

abstract: In the medical field, managing high-dimensional massive medical imaging data and performing reliable medical analysis from it is a critical challenge, especially in resource-limited environments such as remote medical facilities and mobile devices. This necessitates effective dataset compression techniques to reduce storage, transmission, and computational cost. However, existing coreset selection methods are primarily designed for natural image datasets, and exhibit doubtful effectiveness when applied to medical image datasets due to challenges such as intra-class variation and inter-class similarity. In this paper, we propose a novel coreset selection strategy termed as Evolution-aware VAriance (EVA), which captures the evolutionary process of model training through a dual-window approach and reflects the fluctuation of sample importance more precisely through variance measurement. Extensive experiments on medical image datasets demonstrate the effectiveness of our strategy over previous SOTA methods, especially at high compression rates. EVA achieves 98.27% accuracy with only 10% training data, compared to 97.20% for the full training set. None of the compared baseline methods can exceed Random at 5% selection rate, while EVA outperforms Random by 5.61%, showcasing its potential for efficient medical image analysis.


title: SinkLoRA: Enhanced Efficiency and Chat Capabilities for Long-Context Large Language Models

abstract: Extending the functionality of the Transformer model to accommodate longer sequence lengths has become a critical challenge. This extension is crucial not only for improving tasks such as language translation and long-context processing but also for enabling novel applications like chatbots, code generation, and multimedia content creation. The primary obstacle is the self-attention mechanism, which scales quadratically with sequence length in terms of computation time and memory requirements. LongLoRA proposed shifted sparse attention (S\(^2\)-Attn), effectively enabling context extension and leading to non-trivial computation savings with similar performance to fine-tuning with vanilla attention. However, LongLoRA is still not as efficient as vanilla attention, reaching only 39\% of the perplexity improvement compared to full attention. This inefficiency is due to the cyclic shift applied within different attention head patterns, causing either chaos in the attention head structure or unnecessary information exchange between token groups. To address these issues, We propose \textbf{SinkLoRA}, which features better work partitioning. Specifically, (1) we developed SF-Attn with a segmentation and reassembly algorithm to proportionally return cyclically shifted groups of attention heads to their un-shifted state together with global attention of "sink attention tokens", achieving 92\% of the perplexity improvement compared to full attention after fine tuning, and (2) applied a SOTA KV cache compression algorithm H$_2$O to accelerate inference. Furthermore, We conducted supervised fine-tuning with SinkLoRA using a self collected LongAlpaca-plus dataset. All our code, models, datasets, and demos are available at \url{https://github.com/Dexter-GT-86/SinkLoRA}.


title: Metrics sonification: The introduction of new ways to present bibliometric data using publication data of Loet Leydesdorff as an example

abstract: The visualization of publication and citation data is popular in bibliometrics. Although less common, the representation of empirical data as sound is an alternative form of presentation (in other fields than bibliometrics). In this representation, the data are mapped into sound and listened to by an audience. Approaches for the sonification of data have been developed in many fields since decades. Since sonification has several advantages for the presentation of data, this study is intended to introduce sonification to bibliometrics named as 'metrics sonification'. Metrics sonification is defined as the sonification of bibliometric information (measurements, data or results) for their empirical analysis and/or presentation. In this study, we used metadata of publications by Loet Leydesdorff (named as Loet in the following) to sonify their properties. Loet was a giant in the field of scientometrics, who passed away in 2023. The track based on Loet's publications can be listened to on SoundCloud using the following link: https://on.soundcloud.com/oxBTA32x4EgwvKVz5. The track has been composed in F minor; this key was chosen to express the sad occasion. The quantitative part of the track includes a parameter mapping (a sonification) of three properties of his publications: (1) publication output, (2) open access publication, and (3) citation impact of publications. The qualitative part (spoken audio) focuses on explanations of the parameter mapping and descriptions of the mapped papers (based on their titles and abstracts). The sonification of Loet's publications presented in this study is only one possible type of metrics sonification application. As the great number of projects from other disciplines have demonstrated, many other types of applications are possible in bibliometrics.


title: Thermodynamically consistent accreted crust of neutron stars: The role of proton shell effects

abstract: Observations of accreting neutron stars are widely used to constrain the microphysical properties of superdense matter. A key ingredient in this analysis is the heating associated with nuclear reactions in the outer layers of the neutron star (crust), as well as the equation of state and composition of these layers. As recently shown, the neutron hydrostatic/diffusion (nHD) condition is valid in the inner part of the crust, where some of the neutrons are not bound to the nuclei, and this condition should be properly incorporated into crustal models. Here we construct models of the accreted crust of a neutron star, taking into account the nHD condition and proton shell effects in nuclei. For numerical illustration, we employ the recently proposed compressible liquid drop model, which incorporates shell effects. However, our approach is general and can also be used in future studies relying on more sophisticated nuclear physics models.


title: Towards Expressive Zero-Shot Speech Synthesis with Hierarchical Prosody Modeling

abstract: Recent research in zero-shot speech synthesis has made significant progress in speaker similarity. However, current efforts focus on timbre generalization rather than prosody modeling, which results in limited naturalness and expressiveness. To address this, we introduce a novel speech synthesis model trained on large-scale datasets, including both timbre and hierarchical prosody modeling. As timbre is a global attribute closely linked to expressiveness, we adopt a global vector to model speaker timbre while guiding prosody modeling. Besides, given that prosody contains both global consistency and local variations, we introduce a diffusion model as the pitch predictor and employ a prosody adaptor to model prosody hierarchically, further enhancing the prosody quality of the synthesized speech. Experimental results show that our model not only maintains comparable timbre quality to the baseline but also exhibits better naturalness and expressiveness.


title: From Basic to Extra Features: Hypergraph Transformer Pretrain-then-Finetuning for Balanced Clinical Predictions on EHR

abstract: Electronic Health Records (EHRs) contain rich patient information and are crucial for clinical research and practice. In recent years, deep learning models have been applied to EHRs, but they often rely on massive features, which may not be readily available for all patients. We propose HTP-Star, which leverages hypergraph structures with a pretrain-then-finetune framework for modeling EHR data, enabling seamless integration of additional features. Additionally, we design two techniques, namely (1) Smoothness-inducing Regularization and (2) Group-balanced Reweighting, to enhance the model's robustness during fine-tuning. Through experiments conducted on two real EHR datasets, we demonstrate that HTP-Star consistently outperforms various baselines while striking a balance between patients with basic and extra features.


title: Simulating Parton Fragmentation on Quantum Computers

abstract: Parton fragmentation functions (FFs) are indispensable for understanding processes of hadron production ubiquitously existing in high-energy collisions, but their first principle determination has never been realized due to the insurmountable difficulties in encoding their operator definition using traditional lattice methodology. We propose a framework that makes a first step for evaluating FFs utilizing quantum computing methodology. The key element is to construct a semi-inclusive hadron operator for filtering out hadrons of desired types in a collection of particles encoded in the quantum state. We illustrate the framework by elaborating on the Nambu-Jona-Lasinio model with numeral simulations. Remarkably, We show that the semi-inclusive hadron operator can be constructed efficiently with a variational quantum algorithm. Moreover, we develop error mitigation techniques tailed for accurately calculating the FFs in the presence of quantum noises. Our work opens a new avenue for investigating QCD hadronization on near-term quantum computers.


title: Takagi-van der Waerden functions in metric spaces and its Lipschitz derivatives

abstract: We introduce the Takagi-van der Waerden function with parameters $a{>}b{>}0$ by setting $f_{a,b}(x)=\sum\limits_{n=1}^\infty b^n d\big(x,S_n\big)$, where $S_n$ is a maximal $\frac1{a^n}$-separated set in a metric space $X$ without isolated points. So, if $X=\mathbb R$ and $S_n=\frac1{a^n}\mathbb Z$ then $f_{2,1}$ is the Takagi function and $f_{10,1}$ is the van der Waerden function which are the famous examples of nowhere differentiable functions. Then we prove that the big Lipschitz derivative $\mathrm{Lip} f_{a,b}=+\infty$ if $a>b>2$. Moreover, if $X$ is a normed space then the little Lipschitz derivative $\mathrm{lip} f_{a,b}=+\infty$ for large enough $a>b$. Thus, we prove that for any open set $A$ in a metric (normed) space $X$ there exists a continuous function $f$ such that $\mathrm{Lip} f(x)=+\infty$ (and $\mathrm{lip} f(x)=+\infty$) exactly on $A$.


title: Understanding Open Source Contributor Profiles in Popular Machine Learning Libraries

abstract: With the increasing popularity of machine learning (ML), many open-source software (OSS) contributors are attracted to developing and adopting ML approaches. Comprehensive understanding of ML contributors is crucial for successful ML OSS development and maintenance. Without such knowledge, there is a risk of inefficient resource allocation and hindered collaboration in ML OSS projects. Existing research focuses on understanding the difficulties and challenges perceived by ML contributors by user surveys. There is a lack of understanding of ML contributors based on their activities tracked from software repositories. In this paper, we aim to understand ML contributors by identifying contributor profiles in ML libraries. We further study contributors' OSS engagement from three aspects: workload composition, work preferences, and technical importance. By investigating 7,640 contributors from 6 popular ML libraries (TensorFlow, PyTorch, Keras, MXNet, Theano, and ONNX), we identify four contributor profiles: Core-Afterhour, Core-Workhour, Peripheral-Afterhour, and Peripheral-Workhour. We find that: 1) project experience, authored files, collaborations, and geographical location are significant features of all profiles; 2) contributors in Core profiles exhibit significantly different OSS engagement compared to Peripheral profiles; 3) contributors' work preferences and workload compositions significantly impact project popularity; 4) long-term contributors evolve towards making fewer, constant, balanced and less technical contributions.


title: Provable Optimization for Adversarial Fair Self-supervised Contrastive Learning

abstract: This paper studies learning fair encoders in a self-supervised learning (SSL) setting, in which all data are unlabeled and only a small portion of them are annotated with sensitive attribute. Adversarial fair representation learning is well suited for this scenario by minimizing a contrastive loss over unlabeled data while maximizing an adversarial loss of predicting the sensitive attribute over the data with sensitive attribute. Nevertheless, optimizing adversarial fair representation learning presents significant challenges due to solving a non-convex non-concave minimax game. The complexity deepens when incorporating a global contrastive loss that contrasts each anchor data point against all other examples. A central question is ``{\it can we design a provable yet efficient algorithm for solving adversarial fair self-supervised contrastive learning}?'' Building on advanced optimization techniques, we propose a stochastic algorithm dubbed SoFCLR with a convergence analysis under reasonable conditions without requring a large batch size. We conduct extensive experiments to demonstrate the effectiveness of the proposed approach for downstream classification with eight fairness notions.


title: FlightBench: A Comprehensive Benchmark of Spatial Planning Methods for Quadrotors

abstract: Spatial planning in cluttered environments is crucial for mobile systems, particularly agile quadrotors. Existing methods, both optimization-based and learning-based, often focus only on success rates in specific environments and lack a unified platform with tasks of varying difficulty. To address this, we introduce FlightBench, the first comprehensive open-source benchmark for 3D spatial planning on quadrotors, comparing classical optimization-based methods with emerging learning-based approaches. We also develop a suite of task difficulty metrics and evaluation metrics to quantify the characteristics of tasks and the performance of planning algorithms. Extensive experiments demonstrate the significant advantages of learning-based methods for high-speed flight and real-time planning, while highlighting the need for improvements in complex conditions, such as navigating large corners or dealing with view occlusion. We also conduct analytical experiments to justify the effectiveness of our proposed metrics. Additionally, we show that latency randomization effectively enhances performance in real-world deployments. The source code is available at \url{https://github.com/thu-uav/FlightBench}.


title: Peer Review as A Multi-Turn and Long-Context Dialogue with Role-Based Interactions

abstract: Large Language Models (LLMs) have demonstrated wide-ranging applications across various fields and have shown significant potential in the academic peer-review process. However, existing applications are primarily limited to static review generation based on submitted papers, which fail to capture the dynamic and iterative nature of real-world peer reviews. In this paper, we reformulate the peer-review process as a multi-turn, long-context dialogue, incorporating distinct roles for authors, reviewers, and decision makers. We construct a comprehensive dataset containing over 26,841 papers with 92,017 reviews collected from multiple sources, including the top-tier conference and prestigious journal. This dataset is meticulously designed to facilitate the applications of LLMs for multi-turn dialogues, effectively simulating the complete peer-review process. Furthermore, we propose a series of metrics to evaluate the performance of LLMs for each role under this reformulated peer-review setting, ensuring fair and comprehensive evaluations. We believe this work provides a promising perspective on enhancing the LLM-driven peer-review process by incorporating dynamic, role-based interactions. It aligns closely with the iterative and interactive nature of real-world academic peer review, offering a robust foundation for future research and development in this area. We open-source the dataset at https://github.com/chengtan9907/ReviewMT.


title: Realtime observation of a tungsten-promoted size regulation mechanism in a rhodium catalyst at atomic resolution

abstract: The static and genuine structure of small rhodium and rhodium/tungsten nanoparticles on an alumina support can be imaged with atomic resolution even if single digit atom clusters are investigated. Low dose rate electron microscopy is key to the achievement and can generally be applied to investigate any similar material. In such conditions it becomes feasible to identify the chemical composition of nanocrystals from quantitative contrast analyses alone by counting atoms. The ability to fully characterize an unaltered, initial state of the objects allows targeting structural excitations or conformational changes induced by the electron beam itself. For the specific case of catalytic Rh:W particles we stimulate a tungsten-promoted size regulation mechanism in real time that is driven by Oswald ripening and can be understood by a strong binding of tungsten atoms to the oxygen atoms of the support, which builds up strain as the cluster sizes increase.


title: MoPS: Modular Story Premise Synthesis for Open-Ended Automatic Story Generation

abstract: A story premise succinctly defines a story's main idea, foundation, and trajectory. It serves as the initial trigger in automatic story generation. Existing sources of story premises are limited by a lack of diversity, uneven quality, and high costs that make them difficult to scale. In response, we introduce Modular Story Premise Synthesis (MoPS) which breaks down story premises into modules like background and persona for automated design and generation. MoPS consists of three phases: (1) Precollect a consistent set of candidates for each module to form a nested dictionary. (2) Extract a key path from the nested dictionary as the premise design. (3) Instruct an LLM to integrate the design into a coherent premise sentence. Thorough evaluations demonstrate that our synthesized premises excel in diversity, fascination, completeness, and originality compared to those induced from large language models and captured from public story datasets. Similarly, the extended novels and scripts generated from our premises also exhibit higher quality. In supplementary materials, we provide the MoPS code suite, along with 7.6k generated premises and 1k extended stories. Code: https://github.com/GAIR-NLP/MoPS.


title: Diverse 3D Human Pose Generation in Scenes based on Decoupled Structure

abstract: This paper presents a novel method for generating diverse 3D human poses in scenes with semantic control. Existing methods heavily rely on the human-scene interaction dataset, resulting in a limited diversity of the generated human poses. To overcome this challenge, we propose to decouple the pose and interaction generation process. Our approach consists of three stages: pose generation, contact generation, and putting human into the scene. We train a pose generator on the human dataset to learn rich pose prior, and a contact generator on the human-scene interaction dataset to learn human-scene contact prior. Finally, the placing module puts the human body into the scene in a suitable and natural manner. The experimental results on the PROX dataset demonstrate that our method produces more physically plausible interactions and exhibits more diverse human poses. Furthermore, experiments on the MP3D-R dataset further validates the generalization ability of our method.


title: SPA-SVC: Self-supervised Pitch Augmentation for Singing Voice Conversion

abstract: Diffusion-based singing voice conversion (SVC) models have shown better synthesis quality compared to traditional methods. However, in cross-domain SVC scenarios, where there is a significant disparity in pitch between the source and target voice domains, the models tend to generate audios with hoarseness, posing challenges in achieving high-quality vocal outputs. Therefore, in this paper, we propose a Self-supervised Pitch Augmentation method for Singing Voice Conversion (SPA-SVC), which can enhance the voice quality in SVC tasks without requiring additional data or increasing model parameters. We innovatively introduce a cycle pitch shifting training strategy and Structural Similarity Index (SSIM) loss into our SVC model, effectively enhancing its performance. Experimental results on the public singing datasets M4Singer indicate that our proposed method significantly improves model performance in both general SVC scenarios and particularly in cross-domain SVC scenarios.


title: Visualizing uniform lattice-scale pair density wave in single-layer FeSe/SrTiO3 films

abstract: Typical BCS superconductors are microscopically homogeneous in real space governed by the coherent Cooper pairs with high phase stiffness of superfluid density, which is characterized by a coherence length. However, a periodic oscillation of superconducting order parameter may develop driven by breaking the time-reversal or translational invariance. To date, such modulated orders were specific to each material systems, with a periodicity much larger than the lattice constant. Here we report the direct observation of a uniform lattice-scale pair density wave (PDW) in single-layer FeSe/SrTiO3 films, enforced by peculiar interfacial structure of crystal symmetries breaking. Our spectroscopic imaging scanning tunneling microscopy unravels a spatial modulation of Cooper-pairing gap within a single unit-cell, depending on inequivalent atomic sites. Prominent periodic variation of superfluid density is visualized via Josephson current by a superconducting tip, indicating a real-space oscillation of phase stiffness. Such a lattice-scale superconducting modulation, which coexists with a larger length scale of PDW order, indicates the lattice-scale variation of both pairing strength and phase stiffness. Our findings provide new insights into the intertwined density-wave orders of quasiparticle character in correlated electronic systems, and provoke future studies on the unconventional pairing interaction and phase stiffness in the two-dimensional limit.

categories: cond-mat.supr-con cond-mat.mes-hall cond-mat.mtrl-sci cond-mat.str-el


title: A Low Rank Neural Representation of Entropy Solutions

abstract: We construct a new representation of entropy solutions to nonlinear scalar conservation laws with a smooth convex flux function in a single spatial dimension. The representation is a generalization of the method of characteristics and posseses a compositional form. While it is a nonlinear representation, the embedded dynamics of the solution in the time variable is linear. This representation is then discretized as a manifold of implicit neural representations where the feedforward neural network architecture has a low rank structure. Finally, we show that the low rank neural representation with a fixed number of layers and a small number of coefficients can approximate any entropy solution regardless of the complexity of the shock topology, while retaining the linearity of the embedded dynamics.


title: Fractal dimension of star clusters

abstract: Quantitative analysis of the structure of star clusters is crucial for understanding their formation and evolution. In this article, we explore the application of fractal dimension analysis to study the evolution of star clusters. Fractal dimension, a concept from fractal geometry, provides a quantitative measure of the complexity and self-similarity of geometric objects. By considering star clusters as complex networks, we employ the box covering method to calculate their fractal dimension. Our methodology combines the well-established Minimum Spanning Tree (MST) and Box-Covering (BC) methods. Using these methods, the fractal structure of the clusters was determined. It was revealed that star clusters disintegrate at a fractal dimension of 1.3 and obey a power law. It should be noted that the obtained result was compared with the results of the McLuster.


title: Two Power Allocation and Beamforming Strategies for Active IRS-aided Wireless Network via Machine Learning

abstract: This paper models an active intelligent reflecting surface (IRS) -assisted wireless communication network, which has the ability to adjust power between BS and IRS. We aim to maximize the signal-to-noise ratio of user by jointly designing power allocation (PA) factor, active IRS phase shift matrix, and beamforming vector of BS, subject to a total power constraint. To tackle this non-convex problem, we solve this problem by alternately optimizing these variables. Firstly, the PA factor is designed via polynomial regression method. Next, BS beamforming vector and IRS phase shift matrix are obtained by Dinkelbach's transform and successive convex approximation methods. To reduce the high computational complexity of the above proposed algorithm, we maximize achievable rate (AR) and use closed-form fractional programming method to transform the original problem into an equivalent form. Then, we address this problem by iteratively optimizing auxiliary variables, BS and IRS beamformings. Simulation results show that the proposed algorithms can effectively improve the AR performance compared to fixed PA strategies, aided by passive IRS, and without IRS.


title: Decision-Focused Surrogate Modeling for Mixed-Integer Linear Optimization

abstract: Mixed-integer optimization is at the core of many online decision-making systems that demand frequent updates of decisions in real time. However, due to their combinatorial nature, mixed-integer linear programs (MILPs) can be difficult to solve, rendering them often unsuitable for time-critical online applications. To address this challenge, we develop a data-driven approach for constructing surrogate optimization models in the form of linear programs (LPs) that can be solved much more efficiently than the corresponding MILPs. We train these surrogate LPs in a decision-focused manner such that for different model inputs, they achieve the same or close to the same optimal solutions as the original MILPs. One key advantage of the proposed method is that it allows the incorporation of all the original MILP's linear constraints, which significantly increases the likelihood of obtaining feasible predicted solutions. Results from two computational case studies indicate that this decision-focused surrogate modeling approach is highly data-efficient and provides very accurate predictions of the optimal solutions. In these examples, it outperforms more commonly used neural-network-based optimization proxies.


title: Single Gateway Placement in Wireless Mesh Networks

abstract: Wireless Mesh Networks (WMNs) are crucial for various sectors due to their adaptability and scalability, providing robust connectivity where traditional wired networks are impractical. WMNs facilitate smart city initiatives, disaster recovery efforts, and industrial automation, playing a pivotal role in modern networking applications. Their versatility also extends to rural connectivity, highlighting their relevance in diverse scenarios. Recent research in WMNs has focused on optimizing gateway placement and selection to enhance network performance and ensure efficient data transmission. This paper introduces a novel approach to maximize average throughput by strategically positioning gateways within the mesh topology. Inspired by Coulomb's law, which has been used in network analysis, this approach aims to improve network performance through strategic gateway positioning. Comprehensive simulations and analyses demonstrate the effectiveness of the proposed method in enhancing both throughput and network efficiency. By leveraging physics-based models like Coulomb's law, the study offers an objective means to optimize gateway placement, a critical component in WMN design. These findings provide valuable insights for network designers and operators, guiding informed decision-making for gateway deployment across various WMN deployments. This research significantly contributes to the ongoing evolution of WMN optimization strategies, reaffirming the essential role of gateway placement in establishing resilient and efficient wireless communication infrastructures.


title: An Investigation of Noise Robustness for Flow-Matching-Based Zero-Shot TTS

abstract: Recently, zero-shot text-to-speech (TTS) systems, capable of synthesizing any speaker's voice from a short audio prompt, have made rapid advancements. However, the quality of the generated speech significantly deteriorates when the audio prompt contains noise, and limited research has been conducted to address this issue. In this paper, we explored various strategies to enhance the quality of audio generated from noisy audio prompts within the context of flow-matching-based zero-shot TTS. Our investigation includes comprehensive training strategies: unsupervised pre-training with masked speech denoising, multi-speaker detection and DNSMOS-based data filtering on the pre-training data, and fine-tuning with random noise mixing. The results of our experiments demonstrate significant improvements in intelligibility, speaker similarity, and overall audio quality compared to the approach of applying speech enhancement to the audio prompt.