title: A Novel Paradigm Shift for Next-Generation: Symbiotic Backscatter Rate-Splitting Multiple Access Systems

abstract: Next-generation wireless networks are projected to empower a broad range of Internet-of-things (IoT) applications and services with extreme data rates, posing new challenges in delivering large-scale connectivity at a low cost to current communication paradigms. Rate-splitting multiple access (RSMA) is one of the most spotlight nominees, conceived to address spectrum scarcity while reaching massive connectivity. Meanwhile, symbiotic communication is said to be an inexpensive way to realize future IoT on a large scale. To reach the goal of spectrum efficiency improvement and low energy consumption, we merge these advances by means of introducing a novel paradigm shift, called symbiotic backscatter RSMA, for the next generation. Specifically, we first establish the way to operate the symbiotic system to assist the readers in apprehending the proposed paradigm, then guide detailed design in beamforming weights with four potential gain-control (GC) strategies for enhancing symbiotic communication, and finally provide an information-theoretic framework using a new metric, called symbiotic outage probability (SOP) to characterize the proposed system performance. Through numerical result experiments, we show that the developed framework can accurately predict the actual SOP and the efficacy of the proposed GC strategies in improving the SOP performance.

categories: cs.IT cs.ET cs.NA cs.NI cs.PF math.IT math.NA


title: Performance Analysis of Hybrid Cellular and Cell-free MIMO Network

abstract: Cell-free wireless communication is envisioned as one of the most promising network architectures, which can achieve stable and uniform communication performance while improving the system energy and spectrum efficiency. The deployment of cell-free networks is envisioned to be a longterm evolutionary process, in which cell-free access points (APs) will be gradually introduced into the communication network and collaborate with the existing cellular base stations (BSs). To further explore the performance limits of hybrid cellular and cell-free networks, this paper develops a hybrid network model based on stochastic geometric toolkits, which reveals the coupling of the signal and interference from both the cellular and cell-free networks. Specifically, the conjugate beamforming is applied in hybrid cellular and cell-free networks, which enables user equipment (UE) to benefit from both cellular BSs and cell-free APs. The aggregate signal received from the hybrid network is approximated via moment matching, and coverage probability is characterized by deriving the Laplace transform of the interference. The analysis of signal strength and coverage probability is verified by extensive simulations.


title: Development of Bayesian Component Failure Models in E1 HEMP Grid Analysis

abstract: Combined electric power system and High-Altitude Electromagnetic Pulse (HEMP) models are being developed to determine the effect of a HEMP on the US power grid. The work relies primarily on deterministic methods; however, it is computationally untenable to evaluate the E1 HEMP response of large numbers of grid components distributed across a large interconnection. Further, the deterministic assessment of these components' failures are largely unachievable. E1 HEMP laboratory testing of the components is accomplished, but is expensive, leaving few data points to construct failure models of grid components exposed to E1 HEMP. The use of Bayesian priors, developed using the subject matter expertise, combined with the minimal test data in a Bayesian inference process, provides the basis for the development of more robust and cost-effective statistical component failure models. These can be used with minimal computational burden in a simulation environment such as sampling of Cumulative Distribution Functions (CDFs).


title: Interface transparency to orbital current

abstract: The transport of spin currents across interfaces is relatively well studied, while the transport properties of orbital currents are just starting to be examined. In Cr/Ni bilayers, the spin-orbit torque (SOT) due to the orbital current generated in the Cr layer is believed to dominate over torques of other origins. In this work, we study SOT in Cr/X/Ni trilayers, where X is an ultra-thin spacer of a different material. Using the SOT as a proxy for the orbital current transferred from the Cr to the Ni layer, we compare Cr/X/Ni results to Pt/X/Ni, the system in which spin current generated in the Pt layer plays a dominant role. We find that across 12 different spacers the apparent interface transparency to the orbital current is comparable or larger than to the spin current.


title: High-temperature magnetic anomaly via suppression of antisite disorder through synthesis route modification in a Kitaev candidate Cu$_2$IrO$_3$

abstract: By incorporating inert KCl into the Na$_2$IrO$_3$ + 2CuCl $\to$ Cu$_2$IrO$_3$ + 2NaCl topochemical reaction, we significantly reduced the synthesis temperature of Cu$_2$IrO$_3$ from the 350$^\circ$C reported in previous studies to 170$^\circ$C. This adjustment decreased the Cu/Ir antisite disorder concentration in Cu$_2$IrO$_3$ from $\sim$19$\%$ to $\sim$5$\%$. Furthermore, magnetic susceptibility measurements of the present Cu$_2$IrO$_3$ sample revealed a weak ferromagnetic-like anomaly with hysteresis at a magnetic transition temperature of $\sim$70 K. Our research indicates that the spin-disordered ground state reported in chemically disordered Cu$_2$IrO$_3$ is an extrinsic phenomenon, rather than an intrinsic one, underscoring the pivotal role of synthetic chemistry in understanding the application of Kitaev model to realistic materials.


title: Explaining the possible 95 GeV excesses in the $B-L$ symmetric SSM

abstract: This study investigates the excesses observed in the diphoton and $b\bar b$ data around $95\;{\rm GeV}$ within the framework of the $B-L$ supersymmetric model (B-LSSM). Comparing with the minimal supersymmetric standard model, the B-LSSM incorporates two singlet chiral Higgs bosons which mix with the SM-like Higgs boson due to the gauge kinetic mixing effect. The richer Higgs sector indicates that designating the B-LSSM specific CP-even Higgs state as the lightest Higgs boson has great potential to explain the excesses at around $95\;{\rm GeV}$. Considering the two-loop effective potential corrections to the squared Higgs mass matrix, it is found that the signal strengthes $\mu(h_{95})_{\gamma\gamma}$, $\mu(h_{95})_{b b}$ can be described simultaneously in the experimental $1\sigma$ interval. And the B-LSSM specific parameters $\tan\beta'$, $B_\eta$, $g_{YB}$, $M_{Z'}$ affect the theoretical predictions on the light Higgs boson masses and signal strengthes $\mu(h_{95})_{\gamma\gamma}$, $\mu(h_{95})_{bb}$ significantly.


title: Position-based Rogue Access Point Detection

abstract: Rogue Wi-Fi access point (AP) attacks can lead to data breaches and unauthorized access. Existing rogue AP detection methods and tools often rely on channel state information (CSI) or received signal strength indicator (RSSI), but they require specific hardware or achieve low detection accuracy. On the other hand, AP positions are typically fixed, and Wi-Fi can support indoor positioning of user devices. Based on this position information, the mobile platform can check if one (or more) AP in range is rogue. The inclusion of a rogue AP would in principle result in a wrong estimated position. Thus, the idea to use different subsets of APs: the positions computed based on subsets that include a rogue AP will be significantly different from those that do not. Our scheme contains two components: subset generation and position validation. First, we generate subsets of RSSIs from APs, which are then utilized for positioning, similar to receiver autonomous integrity monitoring (RAIM). Second, the position estimates, along with uncertainties, are combined into a Gaussian mixture, to check for inconsistencies by evaluating the overlap of the Gaussian components. Our comparative analysis, conducted on a real-world dataset with three types of attacks and synthetic RSSIs integrated, demonstrates a substantial improvement in rogue AP detection accuracy.


title: History-Aware Planning for Risk-free Autonomous Navigation on Unknown Uneven Terrain

abstract: It is challenging for the mobile robot to achieve autonomous and mapless navigation in the unknown environment with uneven terrain. In this study, we present a layered and systematic pipeline. At the local level, we maintain a tree structure that is dynamically extended with the navigation. This structure unifies the planning with the terrain identification. Besides, it contributes to explicitly identifying the hazardous areas on uneven terrain. In particular, certain nodes of the tree are consistently kept to form a sparse graph at the global level, which records the history of the exploration. A series of subgoals that can be obtained in the tree and the graph are utilized for leading the navigation. To determine a subgoal, we develop an evaluation method whose input elements can be efficiently obtained on the layered structure. We conduct both simulation and real-world experiments to evaluate the developed method and its key modules. The experimental results demonstrate the effectiveness and efficiency of our method. The robot can travel through the unknown uneven region safely and reach the target rapidly without a preconstructed map.


title: Fast networked data selection via distributed smoothed quantile estimation

abstract: Collecting the most informative data from a large dataset distributed over a network is a fundamental problem in many fields, including control, signal processing and machine learning. In this paper, we establish a connection between selecting the most informative data and finding the top-$k$ elements of a multiset. The top-$k$ selection in a network can be formulated as a distributed nonsmooth convex optimization problem known as quantile estimation. Unfortunately, the lack of smoothness in the local objective functions leads to extremely slow convergence and poor scalability with respect to the network size. To overcome the deficiency, we propose an accelerated method that employs smoothing techniques. Leveraging the piecewise linearity of the local objective functions in quantile estimation, we characterize the iteration complexity required to achieve top-$k$ selection, a challenging task due to the lack of strong convexity. Several numerical results are provided to validate the effectiveness of the algorithm and the correctness of the theory.


title: Responsible Adoption of Generative AI in Higher Education: Developing a "Points to Consider" Approach Based on Faculty Perspectives

abstract: This paper proposes an approach to the responsible adoption of generative AI in higher education, employing a ''points to consider'' approach that is sensitive to the goals, values, and structural features of higher education. Higher education's ethos of collaborative faculty governance, pedagogical and research goals, and embrace of academic freedom conflict, the paper argues, with centralized top down approaches to governing AI that are common in the private sector. The paper is based on a semester long effort at the University of Pittsburgh which gathered and organized perspectives on generative AI in higher education through a collaborative, iterative, interdisciplinary process that included recurring group discussions, three standalone focus groups, and an informal survey. The paper presents insights drawn from this effort that give rise to the ''points to consider'' approach the paper develops. These insights include the benefits and risks of potential uses of generative AI In higher education, as well as barriers to its adoption, and culminate in the six normative points to consider when adopting and governing generative AI in institutions of higher education.


title: Dishonesty in Helpful and Harmless Alignment

abstract: People tell lies when seeking rewards. Large language models (LLMs) are aligned to human values with reinforcement learning where they get rewards if they satisfy human preference. We find that this also induces dishonesty in helpful and harmless alignment where LLMs tell lies in generating harmless responses. Using the latest interpreting tools, we detect dishonesty, show how LLMs can be harmful if their honesty is increased, and analyze such conflicts at the parameter-level. Given these preliminaries and the hypothesis that reward-seeking stimulates dishonesty, we theoretically show that the dishonesty can in-turn decrease the alignment performances and augment reward-seeking alignment with representation regularization. Extensive results, including GPT-4 annotated win-rates, perplexities, and cases studies demonstrate that we can train more honest, helpful, and harmless LLMs. We will make all our codes and results be open-sourced upon this paper's acceptance.


title: Detecting Endangered Marine Species in Autonomous Underwater Vehicle Imagery Using Point Annotations and Few-Shot Learning

abstract: One use of Autonomous Underwater Vehicles (AUVs) is the monitoring of habitats associated with threatened, endangered and protected marine species, such as the handfish of Tasmania, Australia. Seafloor imagery collected by AUVs can be used to identify individuals within their broader habitat context, but the sheer volume of imagery collected can overwhelm efforts to locate rare or cryptic individuals. Machine learning models can be used to identify the presence of a particular species in images using a trained object detector, but the lack of training examples reduces detection performance, particularly for rare species that may only have a small number of examples in the wild. In this paper, inspired by recent work in few-shot learning, images and annotations of common marine species are exploited to enhance the ability of the detector to identify rare and cryptic species. Annotated images of six common marine species are used in two ways. Firstly, the common species are used in a pre-training step to allow the backbone to create rich features for marine species. Secondly, a copy-paste operation is used with the common species images to augment the training data. While annotations for more common marine species are available in public datasets, they are often in point format, which is unsuitable for training an object detector. A popular semantic segmentation model efficiently generates bounding box annotations for training from the available point annotations. Our proposed framework is applied to AUV images of handfish, increasing average precision by up to 48\% compared to baseline object detection training. This approach can be applied to other objects with low numbers of annotations and promises to increase the ability to actively monitor threatened, endangered and protected species.


title: Orthogonal Causal Calibration

abstract: Estimates of causal parameters such as conditional average treatment effects and conditional quantile treatment effects play an important role in real-world decision making. Given this importance, one should ensure these estimators are calibrated. While there is a rich literature on calibrating estimators of non-causal parameters, very few methods have been derived for calibrating estimators of causal parameters, or more generally estimators of quantities involving nuisance parameters. In this work, we provide a general framework for calibrating predictors involving nuisance estimation. We consider a notion of calibration defined with respect to an arbitrary, nuisance-dependent loss $\ell$, under which we say an estimator $\theta$ is calibrated if its predictions cannot be changed on any level set to decrease loss. We prove generic upper bounds on the calibration error of any causal parameter estimate $\theta$ with respect to any loss $\ell$ using a concept called Neyman Orthogonality. Our bounds involve two decoupled terms - one measuring the error in estimating the unknown nuisance parameters, and the other representing the calibration error in a hypothetical world where the learned nuisance estimates were true. We use our bound to analyze the convergence of two sample splitting algorithms for causal calibration. One algorithm, which applies to universally orthogonalizable loss functions, transforms the data into generalized pseudo-outcomes and applies an off-the-shelf calibration procedure. The other algorithm, which applies to conditionally orthogonalizable loss functions, extends the classical uniform mass binning algorithm to include nuisance estimation. Our results are exceedingly general, showing that essentially any existing calibration algorithm can be used in causal settings, with additional loss only arising from errors in nuisance estimation.


title: Optimal Transport Guided Correlation Assignment for Multimodal Entity Linking

abstract: Multimodal Entity Linking (MEL) aims to link ambiguous mentions in multimodal contexts to entities in a multimodal knowledge graph. A pivotal challenge is to fully leverage multi-element correlations between mentions and entities to bridge modality gap and enable fine-grained semantic matching. Existing methods attempt several local correlative mechanisms, relying heavily on the automatically learned attention weights, which may over-concentrate on partial correlations. To mitigate this issue, we formulate the correlation assignment problem as an optimal transport (OT) problem, and propose a novel MEL framework, namely OT-MEL, with OT-guided correlation assignment. Thereby, we exploit the correlation between multimodal features to enhance multimodal fusion, and the correlation between mentions and entities to enhance fine-grained matching. To accelerate model prediction, we further leverage knowledge distillation to transfer OT assignment knowledge to attention mechanism. Experimental results show that our model significantly outperforms previous state-of-the-art baselines and confirm the effectiveness of the OT-guided correlation assignment.


title: Lepton Flavor Violation at FCC-ee and CEPC

abstract: Lepton flavor violating processes are highly suppressed in the Standard Model. Therefore, if observed, lepton flavor violation would be a clear indication of new physics beyond the Standard Model. We study the process $e^+e^-\to\tau\mu$ at tree-level in the Standard Model Effective Field Theory both on the $Z$-pole and at higher center-of-mass energies. We show that the constraints derived from the future circular $e^+e^-$ colliders FCC-ee and CEPC, are complementary to those obtained from low-energy tau decays at BaBar and Belle, as well as projections from Belle-II.


title: Fluid Implicit Particles on Coadjoint Orbits

abstract: We propose Coadjoint Orbit FLIP (CO-FLIP), a high order accurate, structure preserving fluid simulation method in the hybrid Eulerian-Lagrangian framework. We start with a Hamiltonian formulation of the incompressible Euler Equations, and then, using a local, explicit, and high order divergence free interpolation, construct a modified Hamiltonian system that governs our discrete Euler flow. The resulting discretization, when paired with a geometric time integration scheme, is energy and circulation preserving (formally the flow evolves on a coadjoint orbit) and is similar to the Fluid Implicit Particle (FLIP) method. CO-FLIP enjoys multiple additional properties including that the pressure projection is exact in the weak sense, and the particle-to-grid transfer is an exact inverse of the grid-to-particle interpolation. The method is demonstrated numerically with outstanding stability, energy, and Casimir preservation. We show that the method produces benchmarks and turbulent visual effects even at low grid resolutions.


title: Cram\'er-Rao Bound Analysis and Beamforming Design for Integrated Sensing and Communication with Extended Targets

abstract: This paper studies an integrated sensing and communication (ISAC) system, where a multi-antenna base station transmits beamformed signals for joint downlink multi-user communication and radar sensing of an extended target (ET). By considering echo signals as reflections from valid elements on the ET contour, a set of novel Cram\'er-Rao bounds (CRBs) is derived for parameter estimation of the ET, including central range, direction, and orientation. The ISAC transmit beamforming design is then formulated as an optimization problem, aiming to minimize the CRB associated with radar sensing, while satisfying a minimum signal-to-interference-pulse-noise ratio requirement for each communication user, along with a 3-dB beam coverage constraint tailored for the ET. To solve this non-convex problem, we utilize semidefinite relaxation (SDR) and propose a rank-one solution extraction scheme for non-tight relaxation circumstances. To reduce the computation complexity, we further employ an efficient zero-forcing (ZF) based beamforming design, where the sensing task is performed in the null space of communication channels. Numerical results validate the effectiveness of the obtained CRB, revealing the diverse features of CRB for differently shaped ETs. The proposed SDR beamforming design outperforms benchmark designs with lower estimation error and CRB, while the ZF beamforming design greatly improves computation efficiency with minor sensing performance loss.


title: Nutrition Estimation for Dietary Management: A Transformer Approach with Depth Sensing

abstract: Nutrition estimation is crucial for effective dietary management and overall health and well-being. Existing methods often struggle with sub-optimal accuracy and can be time-consuming. In this paper, we propose NuNet, a transformer-based network designed for nutrition estimation that utilizes both RGB and depth information from food images. We have designed and implemented a multi-scale encoder and decoder, along with two types of feature fusion modules, specialized for estimating five nutritional factors. These modules effectively balance the efficiency and effectiveness of feature extraction with flexible usage of our customized attention mechanisms and fusion strategies. Our experimental study shows that NuNet outperforms its variants and existing solutions significantly for nutrition estimation. It achieves an error rate of 15.65%, the lowest known to us, largely due to our multi-scale architecture and fusion modules. This research holds practical values for dietary management with huge potential for transnational research and deployment and could inspire other applications involving multiple data types with varying degrees of importance.


title: Speeding up Policy Simulation in Supply Chain RL

abstract: Simulating a single trajectory of a dynamical system under some state-dependent policy is a core bottleneck in policy optimization algorithms. The many inherently serial policy evaluations that must be performed in a single simulation constitute the bulk of this bottleneck. To wit, in applying policy optimization to supply chain optimization (SCO) problems, simulating a single month of a supply chain can take several hours. We present an iterative algorithm for policy simulation, which we dub Picard Iteration. This scheme carefully assigns policy evaluation tasks to independent processes. Within an iteration, a single process evaluates the policy only on its assigned tasks while assuming a certain 'cached' evaluation for other tasks; the cache is updated at the end of the iteration. Implemented on GPUs, this scheme admits batched evaluation of the policy on a single trajectory. We prove that the structure afforded by many SCO problems allows convergence in a small number of iterations, independent of the horizon. We demonstrate practical speedups of 400x on large-scale SCO problems even with a single GPU, and also demonstrate practical efficacy in other RL environments.


title: Process-Driven Autoformalization in Lean 4

abstract: Autoformalization, the conversion of natural language mathematics into formal languages, offers significant potential for advancing mathematical reasoning. However, existing efforts are limited to formal languages with substantial online corpora and struggle to keep pace with rapidly evolving languages like Lean 4. To bridge this gap, we propose a new benchmark \textbf{Form}alization for \textbf{L}ean~\textbf{4} (\textbf{\name}) designed to evaluate the autoformalization capabilities of large language models (LLMs). This benchmark encompasses a comprehensive assessment of questions, answers, formal statements, and proofs. Additionally, we introduce a \textbf{P}rocess-\textbf{S}upervised \textbf{V}erifier (\textbf{PSV}) model that leverages the precise feedback from Lean 4 compilers to enhance autoformalization. Our experiments demonstrate that the PSV method improves autoformalization, enabling higher accuracy using less filtered training data. Furthermore, when fine-tuned with data containing detailed process information, PSV can leverage the data more effectively, leading to more significant improvements in autoformalization for Lean 4. Our dataset and code are available at \url{https://github.com/rookie-joe/PDA}.


title: SDS++: Online Situation-Aware Drivable Space Estimation for Automated Driving

abstract: Autonomous Vehicles (AVs) need an accurate and up-to-date representation of the environment for safe navigation. Traditional methods, which often rely on detailed environmental representations constructed offline, struggle in dynamically changing environments or when dealing with outdated maps. Consequently, there is a pressing need for real-time solutions that can integrate diverse data sources and adapt to the current situation. An existing framework that addresses these challenges is SDS (situation-aware drivable space). However, SDS faces several limitations, including its use of a non-standard output representation, its choice of encoding objects as points, restricting representation of more complex geometries like road lanes, and the fact that its methodology has been validated only with simulated or heavily post-processed data. This work builds upon SDS and introduces SDS++, designed to overcome SDS's shortcomings while preserving its benefits. SDS++ has been rigorously validated not only in simulations but also with unrefined vehicle data, and it is integrated with a model predictive control (MPC)-based planner to verify its advantages for the planning task. The results demonstrate that SDS++ significantly enhances trajectory planning capabilities, providing increased robustness against localization noise, and enabling the planning of trajectories that adapt to the current driving context.


title: The Role of Level-Set Geometry on the Performance of PDHG for Conic Linear Optimization

abstract: We consider solving huge-scale instances of (convex) conic linear optimization problems, at the scale where matrix-factorization-free methods are attractive or necessary. The restarted primal-dual hybrid gradient method (rPDHG) -- with heuristic enhancements and GPU implementation -- has been very successful in solving huge-scale linear programming (LP) problems; however its application to more general conic convex optimization problems is not so well-studied. We analyze the theoretical and practical performance of rPDHG for general (convex) conic linear optimization, and LP as a special case thereof. We show a relationship between the geometry of the primal-dual (sub-)level sets $W_\varepsilon$ and the convergence rate of rPDHG. Specifically, we prove a bound on the convergence rate of rPDHG that improves when there is a primal-dual (sub-)level set $W_\varepsilon$ for which (i) $W_\varepsilon$ is close to the optimal solution set (in Hausdorff distance), and (ii) the ratio of the diameter to the "conic radius" of $W_\varepsilon$ is small. And in the special case of LP problems, the performance of rPDHG is bounded only by this ratio applied to the (sub-)level set corresponding to the best non-optimal extreme point. Depending on the problem instance, this ratio can take on extreme values and can result in poor performance of rPDHG both in theory and in practice. To address this issue, we show how central-path-based linear transformations -- including conic rescaling -- can markedly enhance the convergence rate of rPDHG. Furthermore, we present computational results that demonstrate how such rescalings can accelerate convergence to high-accuracy solutions, and lead to more efficient methods for huge-scale linear optimization problems.


title: Enhancing Trust in LLMs: Algorithms for Comparing and Interpreting LLMs

abstract: This paper surveys evaluation techniques to enhance the trustworthiness and understanding of Large Language Models (LLMs). As reliance on LLMs grows, ensuring their reliability, fairness, and transparency is crucial. We explore algorithmic methods and metrics to assess LLM performance, identify weaknesses, and guide development towards more trustworthy applications. Key evaluation metrics include Perplexity Measurement, NLP metrics (BLEU, ROUGE, METEOR, BERTScore, GLEU, Word Error Rate, Character Error Rate), Zero-Shot and Few-Shot Learning Performance, Transfer Learning Evaluation, Adversarial Testing, and Fairness and Bias Evaluation. We introduce innovative approaches like LLMMaps for stratified evaluation, Benchmarking and Leaderboards for competitive assessment, Stratified Analysis for in-depth understanding, Visualization of Blooms Taxonomy for cognitive level accuracy distribution, Hallucination Score for quantifying inaccuracies, Knowledge Stratification Strategy for hierarchical analysis, and Machine Learning Models for Hierarchy Generation. Human Evaluation is highlighted for capturing nuances that automated metrics may miss. These techniques form a framework for evaluating LLMs, aiming to enhance transparency, guide development, and establish user trust. Future papers will describe metric visualization and demonstrate each approach on practical examples.


title: A table-top high-sensitivity gyroscope based on slow light and cavity enhanced photon drag

abstract: A high-sensitivity gyroscope is vital for both investigation of the fundamental physics and monitor of the subtle variation of Earth's behaviors. However, it is challenge to realize a portable gyroscope with sensitivity approaching a small fraction of the Earth's rotation rate. Here, we theoretically propose a method for implementing a table-top gyroscope with remarkably high sensitivity based on photon drag in a rotating dielectric object. By inserting an $\text{Er}^{3+}$-doped glass rod in a Fabry-P\'{e}rot optical cavity with only 20 cm length, we theoretically show that the giant group refractive index and the narrowing cavity linewidth due to slow light can essentially increase the nonreciprocal phase shift due to the photon drag to achieve a rotation sensitivity of $26$ frad/s/$\sqrt{Hz}$. This work paves the way to accurately detect tiny variations of the Earth's rotation rate and orientation, and even can test the geodetic and frame-dragging effects predicted by the general relativity with a small-volume equipment.


title: Pareto Optimal Hybrid Beamforming for Short-Packet Millimeter-Wave Integrated Sensing and Communication

abstract: Pareto optimal solutions are conceived for radar beamforming error (RBE) and sum rate maximization in short-packet (SP) millimeter-wave (mmWave) integrated sensing and communication (ISAC). Our ultimate goal is to realize ultra-reliable low-latency communication (uRLLC) and real-time sensing capabilities for 6G applications. The ISAC base station (BS) transmits short packets in the downlink (DL) to serve multiple communication users (CUs) and detect multiple radar targets (RTs). We investigate the performance trade-off between the sensing and communication capabilities by optimizing both the radio frequency (RF) and the baseband (BB) transmit precoder (TPC), together with the block lengths. The optimization problem considers the minimum rate requirements of the CUs, the maximum tolerable radar beamforming error (RBE) for the RTs, the unit modulus (UM) elements of the RF TPC, and the finite transmit power as the constraints for SP transmission. The resultant problem is highly non-convex due to the intractable rate expression of the SP regime coupled with the non-convex rate and UM constraints. To solve this problem, we propose an innovative two-layer bisection search (TLBS) algorithm, wherein the RF and BB TPCs are optimized in the inner layer, followed by the block length in the outer layer. Furthermore, a pair of novel methods, namely a bisection search-based majorizer and minimizer (BMM) as well as exact penalty-based manifold optimization (EPMO) are harnessed for optimizing the RF TPC in the inner layer. Subsequently, the BB TPC and the block length are derived via second-order cone programming (SOCP) and mixed integer programming methods, respectively. Finally, our exhaustive simulation results reveal the effect of system parameters for various settings on the RBE-rate region of the SP mmWave ISAC system and demonstrate a significantly enhanced performance compared to the benchmarks.


title: Bileve: Securing Text Provenance in Large Language Models Against Spoofing with Bi-level Signature

abstract: Text watermarks for large language models (LLMs) have been commonly used to identify the origins of machine-generated content, which is promising for assessing liability when combating deepfake or harmful content. While existing watermarking techniques typically prioritize robustness against removal attacks, unfortunately, they are vulnerable to spoofing attacks: malicious actors can subtly alter the meanings of LLM-generated responses or even forge harmful content, potentially misattributing blame to the LLM developer. To overcome this, we introduce a bi-level signature scheme, Bileve, which embeds fine-grained signature bits for integrity checks (mitigating spoofing attacks) as well as a coarse-grained signal to trace text sources when the signature is invalid (enhancing detectability) via a novel rank-based sampling strategy. Compared to conventional watermark detectors that only output binary results, Bileve can differentiate 5 scenarios during detection, reliably tracing text provenance and regulating LLMs. The experiments conducted on OPT-1.3B and LLaMA-7B demonstrate the effectiveness of Bileve in defeating spoofing attacks with enhanced detectability.


title: Data-Driven Approaches for Thrust Prediction in Underwater Flapping Fin Propulsion Systems

abstract: Flapping-fin underwater vehicle propulsion systems provide an alternative to propeller-driven systems in situations that require involve a constrained environment or require high maneuverability. Testing new configurations through experiments or high-fidelity simulations is an expensive process, slowing development of new systems. This is especially true when introducing new fin geometries. In this work, we propose machine learning approaches for thrust prediction given the system's fin geometries and kinematics. We introduce data-efficient fin shape parameterization strategies that enable our network to predict thrust profiles for unseen fin geometries given limited fin shapes in input data. In addition to faster development of systems, generalizable surrogate models offer fast, accurate predictions that could be used on an unmanned underwater vehicle control system.


title: Can Entanglement-enhanced Quantum Kernels Improve Data Classification?

abstract: Classical machine learning, extensively utilized across diverse domains, faces limitations in speed, efficiency, parallelism, and processing of complex datasets. In contrast, quantum machine learning algorithms offer significant advantages, including exponentially faster computations, enhanced data handling capabilities, inherent parallelism, and improved optimization for complex problems. In this study, we used the entanglement-enhanced quantum kernel in quantum support vector machine to train complex respiratory data sets. Compared to classical algorithms, our findings reveal that QSVM performs better with 45% higher accuracy for complex respiratory data sets while maintaining comparable performance with linear datasets in contrast to their classical counterparts executed on a 2-qubit system. Through our study, we investigate the efficacy of the QSVM-Kernel algorithm in harnessing the enhanced dimensionality of the quantum Hilbert space for effectively training complex datasets.

categories: quant-ph cond-mat.mtrl-sci physics.app-ph physics.med-ph


title: Recursive Polynomial Method for Fast Collision Avoidance Maneuver Design

abstract: A simple and reliable algorithm for collision avoidance maneuvers (CAMs), capable of computing impulsive, multi-impulsive, and low-thrust maneuvers, is proposed. The probability of collision (PoC) is approximated by a polynomial of arbitrary order as a function of the control, transforming the CAM designinto a polynomial program. The solution procedure is initiated by computing the CAM via a first-order greedy optimization approach, wherein the control action is applied in the direction of the gradient of PoC to maximize its change. Successively, the polynomial is truncated at higher orders, and the solution of the previous order is used to linearize the constraint. This enables achieving accurate solutions even for highly nonlinear safety metrics and dynamics. Since the optimization process comprises only polynomial evaluations, the method is computationally efficient, with run times typically below 1 s. Moreover, no restrictions on the considered dynamics are necessary; therefore, results are shown for Keplerian, J2, and circular restricted three-body problem dynamics.


title: A Comparative Study of Sampling Methods with Cross-Validation in the FedHome Framework

abstract: This paper presents a comparative study of sampling methods within the FedHome framework, designed for personalized in-home health monitoring. FedHome leverages federated learning (FL) and generative convolutional autoencoders (GCAE) to train models on decentralized edge devices while prioritizing data privacy. A notable challenge in this domain is the class imbalance in health data, where critical events such as falls are underrepresented, adversely affecting model performance. To address this, the research evaluates six oversampling techniques using Stratified K-fold cross-validation: SMOTE, Borderline-SMOTE, Random OverSampler, SMOTE-Tomek, SVM-SMOTE, and SMOTE-ENN. These methods are tested on FedHome's public implementation over 200 training rounds with and without stratified K-fold cross-validation. The findings indicate that SMOTE-ENN achieves the most consistent test accuracy, with a standard deviation range of 0.0167-0.0176, demonstrating stable performance compared to other samplers. In contrast, SMOTE and SVM-SMOTE exhibit higher variability in performance, as reflected by their wider standard deviation ranges of 0.0157-0.0180 and 0.0155-0.0180, respectively. Similarly, the Random OverSampler method shows a significant deviation range of 0.0155-0.0176. SMOTE-Tomek, with a deviation range of 0.0160-0.0175, also shows greater stability but not as much as SMOTE-ENN. This finding highlights the potential of SMOTE-ENN to enhance the reliability and accuracy of personalized health monitoring systems within the FedHome framework.


title: Experimental Validation of Enhanced Information Capacity by Quantum Switch in Accordance with Thermodynamic Laws

abstract: We experimentally probe the interplay of the quantum switch with the laws of thermodynamics. The quantum switch places two channels in a superposition of orders and may be applied to thermalizing channels. Quantum-switching thermal channels has been shown to give apparent violations of the second law. Central to these apparent violations is how quantum switching channels can increase the capacity to communicate information. We experimentally show this increase and how it is consistent with the laws of thermodynamics, demonstrating how thermodynamic resources are consumed. We use a nuclear magnetic resonance approach with coherently controlled interactions of nuclear spin qubits. We verify an analytical upper bound on the increase in capacity for channels that preserve energy and thermal states, and demonstrate that the bound can be exceeded for an energy-altering channel. We show that the switch can be used to take a thermal state to a state that is not thermal, whilst consuming free energy associated with the coherence of a control system. The results show how the switch can be incorporated into quantum thermodynamics experiments as an additional resource.


title: Improving Generalization in Aerial and Terrestrial Mobile Robots Control Through Delayed Policy Learning

abstract: Deep Reinforcement Learning (DRL) has emerged as a promising approach to enhancing motion control and decision-making through a wide range of robotic applications. While prior research has demonstrated the efficacy of DRL algorithms in facilitating autonomous mapless navigation for aerial and terrestrial mobile robots, these methods often grapple with poor generalization when faced with unknown tasks and environments. This paper explores the impact of the Delayed Policy Updates (DPU) technique on fostering generalization to new situations, and bolstering the overall performance of agents. Our analysis of DPU in aerial and terrestrial mobile robots reveals that this technique significantly curtails the lack of generalization and accelerates the learning process for agents, enhancing their efficiency across diverse tasks and unknown scenarios.


title: On-Demand Routing in LEO Mega-Constellations with Dynamic Laser Inter-Satellite Links

abstract: Low Earth orbit (LEO) satellite mega constellations are beginning to include laser inter-satellite links (LISLs) to extend the Internet to the most remote locations on Earth. Since the process of establishing these links incurs a setup delay on the order of seconds, a static network topology is generally established well in advance, which is then used for the routing calculations. However, this involves keeping links active even when they are not being used to forward traffic, leading to poor energy efficiency. Motivated by technological advances that are gradually decreasing the LISL setup delays, we foresee scenarios where it will be possible to compute routes and establish dynamic LISLs on demand. This will require considering setup delays as penalties that will affect the end-to-end latency. In this paper, we present a nonlinear optimization model that considers these penalties in the cost function and propose three heuristic algorithms that solve the problem in a tractable way. The algorithms establish different trade-offs in terms of performance and computational complexity. We extensively analyze metrics including average latency, route change rate, outage probability, and jitter in Starlink's Phase I version 2 constellation. The results show the benefit of adaptive routing schemes according to the link setup delay. In particular, more complex schemes can decrease the average end-to-end latency in exchange for an increase in execution time. On the other hand, depending on the maximum tolerated latency, it is possible to use less computationally complex schemes which will be more scalable for the satellite mega constellations of the future.


title: Plug-and-Play Diffusion Distillation

abstract: Diffusion models have shown tremendous results in image generation. However, due to the iterative nature of the diffusion process and its reliance on classifier-free guidance, inference times are slow. In this paper, we propose a new distillation approach for guided diffusion models in which an external lightweight guide model is trained while the original text-to-image model remains frozen. We show that our method reduces the inference computation of classifier-free guided latent-space diffusion models by almost half, and only requires 1\% trainable parameters of the base model. Furthermore, once trained, our guide model can be applied to various fine-tuned, domain-specific versions of the base diffusion model without the need for additional training: this "plug-and-play" functionality drastically improves inference computation while maintaining the visual fidelity of generated images. Empirically, we show that our approach is able to produce visually appealing results and achieve a comparable FID score to the teacher with as few as 8 to 16 steps.


title: Chemical mapping of temperate sub-Neptune atmospheres: Constraining the deep-interior H2O/H2 using the atmospheric CO2/CH4

abstract: Understanding the envelope composition of sub-Neptune-type exoplanets is challenging due to the inherent degeneracy in their interior composition scenarios. Particularly, the H2O/H2 ratio, or can be expressed as the O/H ratio, in the planetary envelope provides crucial insights into the origin of these exoplanets relative to the ice line during formation. Using self-consistent radiative transfer modeling and a rate-based automatic chemical network generator combined with 1D photochemical kinetic-transport atmospheric modeling, we investigate atmospheres of temperate sub-Neptunes, ranging from H2-dominated to H2O-dominated scenarios with Teq = 250-400 K, using K2-18 b (Teq = 255 K), LP 791-18 c (Teq = 324 K), and TOI-270 d (Teq = 354 K) as examples. Our models indicate that using the atmospheric CO2/CH4 ratio to infer the deep-interior H2O/H2 ratio. Applying to recent JWST observations, our findings suggest K2-18 b likely has an interior highly enriched in water (approximately 50% H2O), exceeding the amount of water in a 100x solar metallicity scenario and suggesting a formation history that involved substantial accretion of ices. In contrast, TOI-270 d has an interior composition of approximately 25% H2O, which is comparable to the conventional metallicity framework with a metallicity higher than 100x solar metallicity. Furthermore, our models identify carbonyl sulfide (OCS) and sulfur dioxide (SO2) as strong indicators of at least a 10% water-rich envelope in temperate sub-Neptunes. These results provide a method to delineate the internal composition and formation mechanisms of sub-Neptunes with Teq< ~500 K via atmospheric characterization through transmission spectroscopy.


title: Enhance Image-to-Image Generation with LLaVA Prompt and Negative Prompt

abstract: This paper presents a novel approach to enhance image-to-image generation by leveraging the multimodal capabilities of the Large Language and Vision Assistant (LLaVA). We propose a framework where LLaVA analyzes input images and generates textual descriptions, hereinafter LLaVA-generated prompts. These prompts, along with the original image, are fed into the image-to-image generation pipeline. This enriched representation guides the generation process towards outputs that exhibit a stronger resemblance to the input image. Extensive experiments demonstrate the effectiveness of LLaVA-generated prompts in promoting image similarity. We observe a significant improvement in the visual coherence between the generated and input images compared to traditional methods. Future work will explore fine-tuning LLaVA prompts for increased control over the creative process. By providing more specific details within the prompts, we aim to achieve a delicate balance between faithfulness to the original image and artistic expression in the generated outputs.


title: Backward bifurcation arising from decline of immunity against emerging infectious diseases

abstract: Decline of immunity is a phenomenon characterized by immunocompromised host and plays a crucial role in the epidemiology of emerging infectious diseases (EIDs) such as COVID-19. In this paper, we propose an age-structured model with vaccination and reinfection of immune individuals. We prove that the disease-free equilibrium of the model undergoes backward and forward transcritical bifurcations at the critical value of the basic reproduction number for different values of parameters. We illustrate the results by numerical computations, and also find that the endemic equilibrium exhibits a saddle-node bifurcation on the extended branch of the forward transcritical bifurcation. These results allow us to understand the interplay between the decline of immunity and EIDs, and are able to provide strategies for mitigating the impact of EIDs on global health.


title: Superintegrable systems associated to commutants of Cartan subalgebras in enveloping algebras

abstract: We provide a classification and explicit formulas for the elements that span the centralizer of Cartan subalgebras of complex semisimple Lie algebras of non-exceptional type in their universal enveloping algebra, and show that these generate polynomial (Poisson) algebras. The precise structure for the case of rank three simple Lie algebras is provided, and the inclusion relations between the corresponding polynomial algebras illustrated. We develop the ideas of constructing algebraic superintegrable systems and their integrals from the generators of the centralizer subalgebras and their symmetry algebra. In particular, we present explicitly one example the superintegrable system corresponding to the Cartan centralizer of $\mathfrak{so}(6,\mathbb{C})$.


title: Adaptive Variance Reduction for Stochastic Optimization under Weaker Assumptions

abstract: This paper explores adaptive variance reduction methods for stochastic optimization based on the STORM technique. Existing adaptive extensions of STORM rely on strong assumptions like bounded gradients and bounded function values, or suffer an additional $\mathcal{O}(\log T)$ term in the convergence rate. To address these limitations, we introduce a novel adaptive STORM method that achieves an optimal convergence rate of $\mathcal{O}(T^{-1/3})$ for non-convex functions with our newly designed learning rate strategy. Compared with existing approaches, our method requires weaker assumptions and attains the optimal convergence rate without the additional $\mathcal{O}(\log T)$ term. We also extend the proposed technique to stochastic compositional optimization, obtaining the same optimal rate of $\mathcal{O}(T^{-1/3})$. Furthermore, we investigate the non-convex finite-sum problem and develop another innovative adaptive variance reduction method that achieves an optimal convergence rate of $\mathcal{O}(n^{1/4} T^{-1/2} )$, where $n$ represents the number of component functions. Numerical experiments across various tasks validate the effectiveness of our method.


title: Certifiably Byzantine-Robust Federated Conformal Prediction

abstract: Conformal prediction has shown impressive capacity in constructing statistically rigorous prediction sets for machine learning models with exchangeable data samples. The siloed datasets, coupled with the escalating privacy concerns related to local data sharing, have inspired recent innovations extending conformal prediction into federated environments with distributed data samples. However, this framework for distributed uncertainty quantification is susceptible to Byzantine failures. A minor subset of malicious clients can significantly compromise the practicality of coverage guarantees. To address this vulnerability, we introduce a novel framework Rob-FCP, which executes robust federated conformal prediction, effectively countering malicious clients capable of reporting arbitrary statistics with the conformal calibration process. We theoretically provide the conformal coverage bound of Rob-FCP in the Byzantine setting and show that the coverage of Rob-FCP is asymptotically close to the desired coverage level. We also propose a malicious client number estimator to tackle a more challenging setting where the number of malicious clients is unknown to the defender and theoretically shows its effectiveness. We empirically demonstrate the robustness of Rob-FCP against diverse proportions of malicious clients under a variety of Byzantine attacks on five standard benchmark and real-world healthcare datasets.


title: Exploring Real World Map Change Generalization of Prior-Informed HD Map Prediction Models

abstract: Building and maintaining High-Definition (HD) maps represents a large barrier to autonomous vehicle deployment. This, along with advances in modern online map detection models, has sparked renewed interest in the online mapping problem. However, effectively predicting online maps at a high enough quality to enable safe, driverless deployments remains a significant challenge. Recent work on these models proposes training robust online mapping systems using low quality map priors with synthetic perturbations in an attempt to simulate out-of-date HD map priors. In this paper, we investigate how models trained on these synthetically perturbed map priors generalize to performance on deployment-scale, real world map changes. We present a large-scale experimental study to determine which synthetic perturbations are most useful in generalizing to real world HD map changes, evaluated using multiple years of real-world autonomous driving data. We show there is still a substantial sim2real gap between synthetic prior perturbations and observed real-world changes, which limits the utility of current prior-informed HD map prediction models.


title: Exploring coherent dynamics in resonant x-ray scattering of intense ultrafast pulses

abstract: Intense x-ray free-electron lasers (XFELs) offer unique opportunities to control inner-shell electrons on ultrafast timescales. This study presents a theoretical framework for modeling resonant x-ray scattering under intense ultrafast pulses, focusing on the coherent dynamics of Rabi oscillations. We employ a time-dependent Schr\"odinger equation approach to investigate the effects of high-intensity pulses on the single atom response which includes resonant fluorescence and elastic scattering channels, and competing decay processes. Our findings highlight the sensitivity of scattering responses to pulse parameters and initial states, with interference effects playing a significant role.


title: Diamond molecular balance: Revolutionizing high-resolution mass spectrometry from MDa to TDa at room temperature

abstract: The significance of mass spectrometry lies in its unparalleled ability to accurately identify and quantify molecules in complex samples, providing invaluable insights into molecular structures and interactions. Here, we leverage diamond nanostructures as highly sensitive mass sensors by utilizing a self-excitation mechanism under an electron beam in a conventional scanning electron microscope (SEM). The diamond molecular balance (DMB) exhibits exceptional mass resolution of a few MDa and an extensive dynamic range from MDa to TDa, positioning itself as a forefront molecular balance operating at room temperature. Notably, the DMB measures the mass of a single bacteriophage T4, achieving a mass resolution of 4.7 MDa for an analyte at 184 MDa, while precisely determining their positional information on the device. These findings highlight the groundbreaking potential of the DMB as a revolutionary tool for mass analysis at room temperature.


title: Measure-Observe-Remeasure: An Interactive Paradigm for Differentially-Private Exploratory Analysis

abstract: Differential privacy (DP) has the potential to enable privacy-preserving analysis on sensitive data, but requires analysts to judiciously spend a limited ``privacy loss budget'' $\epsilon$ across queries. Analysts conducting exploratory analyses do not, however, know all queries in advance and seldom have DP expertise. Thus, they are limited in their ability to specify $\epsilon$ allotments across queries prior to an analysis. To support analysts in spending $\epsilon$ efficiently, we propose a new interactive analysis paradigm, Measure-Observe-Remeasure, where analysts ``measure'' the database with a limited amount of $\epsilon$, observe estimates and their errors, and remeasure with more $\epsilon$ as needed. We instantiate the paradigm in an interactive visualization interface which allows analysts to spend increasing amounts of $\epsilon$ under a total budget. To observe how analysts interact with the Measure-Observe-Remeasure paradigm via the interface, we conduct a user study that compares the utility of $\epsilon$ allocations and findings from sensitive data participants make to the allocations and findings expected of a rational agent who faces the same decision task. We find that participants are able to use the workflow relatively successfully, including using budget allocation strategies that maximize over half of the available utility stemming from $\epsilon$ allocation. Their loss in performance relative to a rational agent appears to be driven more by their inability to access information and report it than to allocate $\epsilon$.


title: Subspace Quasi-Newton Method with Gradient Approximation

abstract: In recent years, various subspace algorithms have been developed to handle large-scale optimization problems. Although existing subspace Newton methods require fewer iterations to converge in practice, the matrix operations and full gradient computation are bottlenecks when dealing with large-scale problems. %In this study, We propose a subspace quasi-Newton method that is restricted to a deterministic-subspace together with a gradient approximation based on random matrix theory. Our method does not require full gradients, let alone Hessian matrices. Yet, it achieves the same order of the worst-case iteration complexities in average for convex and nonconvex cases, compared to existing subspace methods. In numerical experiments, we confirm the superiority of our algorithm in terms of computation time.


title: Creativity, Generative AI, and Software Development: A Research Agenda

abstract: Creativity has always been considered a major differentiator to separate the good from the great, and we believe the importance of creativity for software development will only increase as GenAI becomes embedded in developer tool-chains and working practices. This paper uses the McLuhan tetrad alongside scenarios of how GenAI may disrupt software development more broadly, to identify potential impacts GenAI may have on creativity within software development. The impacts are discussed along with a future research agenda comprising six connected themes that consider how individual capabilities, team capabilities, the product, unintended consequences, society, and human aspects can be affected.


title: DrEureka: Language Model Guided Sim-To-Real Transfer

abstract: Transferring policies learned in simulation to the real world is a promising strategy for acquiring robot skills at scale. However, sim-to-real approaches typically rely on manual design and tuning of the task reward function as well as the simulation physics parameters, rendering the process slow and human-labor intensive. In this paper, we investigate using Large Language Models (LLMs) to automate and accelerate sim-to-real design. Our LLM-guided sim-to-real approach, DrEureka, requires only the physics simulation for the target task and automatically constructs suitable reward functions and domain randomization distributions to support real-world transfer. We first demonstrate that our approach can discover sim-to-real configurations that are competitive with existing human-designed ones on quadruped locomotion and dexterous manipulation tasks. Then, we showcase that our approach is capable of solving novel robot tasks, such as quadruped balancing and walking atop a yoga ball, without iterative manual design.


title: Cross-Embodiment Robot Manipulation Skill Transfer using Latent Space Alignment

abstract: This paper focuses on transferring control policies between robot manipulators with different morphology. While reinforcement learning (RL) methods have shown successful results in robot manipulation tasks, transferring a trained policy from simulation to a real robot or deploying it on a robot with different states, actions, or kinematics is challenging. To achieve cross-embodiment policy transfer, our key insight is to project the state and action spaces of the source and target robots to a common latent space representation. We first introduce encoders and decoders to associate the states and actions of the source robot with a latent space. The encoders, decoders, and a latent space control policy are trained simultaneously using loss functions measuring task performance, latent dynamics consistency, and encoder-decoder ability to reconstruct the original states and actions. To transfer the learned control policy, we only need to train target encoders and decoders that align a new target domain to the latent space. We use generative adversarial training with cycle consistency and latent dynamics losses without access to the task reward or reward tuning in the target domain. We demonstrate sim-to-sim and sim-to-real manipulation policy transfer with source and target robots of different states, actions, and embodiments. The source code is available at \url{https://github.com/ExistentialRobotics/cross_embodiment_transfer}.


title: Multiway Multislice PHATE: Visualizing Hidden Dynamics of RNNs through Training

abstract: Recurrent neural networks (RNNs) are a widely used tool for sequential data analysis, however, they are still often seen as black boxes of computation. Understanding the functional principles of these networks is critical to developing ideal model architectures and optimization strategies. Previous studies typically only emphasize the network representation post-training, overlooking their evolution process throughout training. Here, we present Multiway Multislice PHATE (MM-PHATE), a novel method for visualizing the evolution of RNNs' hidden states. MM-PHATE is a graph-based embedding using structured kernels across the multiple dimensions spanned by RNNs: time, training epoch, and units. We demonstrate on various datasets that MM-PHATE uniquely preserves hidden representation community structure among units and identifies information processing and compression phases during training. The embedding allows users to look under the hood of RNNs across training and provides an intuitive and comprehensive strategy to understanding the network's internal dynamics and draw conclusions, e.g., on why and how one model outperforms another or how a specific architecture might impact an RNN's learning ability.


title: The Crystal Ball Hypothesis in diffusion models: Anticipating object positions from initial noise

abstract: Diffusion models have achieved remarkable success in text-to-image generation tasks; however, the role of initial noise has been rarely explored. In this study, we identify specific regions within the initial noise image, termed trigger patches, that play a key role for object generation in the resulting images. Notably, these patches are ``universal'' and can be generalized across various positions, seeds, and prompts. To be specific, extracting these patches from one noise and injecting them into another noise leads to object generation in targeted areas. We identify these patches by analyzing the dispersion of object bounding boxes across generated images, leading to the development of a posterior analysis technique. Furthermore, we create a dataset consisting of Gaussian noises labeled with bounding boxes corresponding to the objects appearing in the generated images and train a detector that identifies these patches from the initial noise. To explain the formation of these patches, we reveal that they are outliers in Gaussian noise, and follow distinct distributions through two-sample tests. Finally, we find the misalignment between prompts and the trigger patch patterns can result in unsuccessful image generations. The study proposes a reject-sampling strategy to obtain optimal noise, aiming to improve prompt adherence and positional diversity in image generation.


title: Evolution of the optical emission lines and the X-ray emission during the super-active stage of T CrB

abstract: T CrB is a symbiotic star that experiences nova outbursts every $\sim$ 80~yr. The next, long-anticipated nova outburst should occur during the 2024-2026 period. Here, we present results of high-resolution optical spectroscopy of T CrB in the period 2016 - 2023. In these spectra, we measured the equivalent widths of the H$\alpha$, H$\beta$, HeI and HeII emission lines. The maximum equivalent width (EW) was recorded on May 2021, when the EW of $H\alpha$ reached -44.6 \AA and H$\beta$ = -21.5 \AA. At the other extreme, the minimum of EW($H\alpha$)= -2.9 \AA was recorded in October 2023. After October 2023, the B-band emission brightened, suggesting a re-appearance of the orbital modulation. In addition to the optical data, we study the X-ray behaviour in the same period. We find a strong correlation between $EW(H\alpha)$ and X-ray flux with a correlation coefficient -0.78 and a significance of 2.6$\times 10^{-5}$.


title: Depolarization diagrams for circularly polarized light scattering for biological particle monitoring

abstract: Significance: The depolarization of circularly polarized light caused by scattering in turbid media reveals structural information about the dispersed particles, such as their size, density, and distribution, which is useful for investigating the state of biological tissue. However, the correlation between depolarization strength and tissue parameters is unclear. Aim: We aimed to examine the generalized correlations of depolarization strength with the particle size and wavelength, yielding depolarization diagrams. Approach: The correlation between depolarization intensity and size parameter were examined for single and multiple scattering using the Monte Carlo simulation method. Expanding the wavelength width allows us to obtain depolarization distribution diagrams as functions of wavelength and particle diameter for reflection and transparent geometries. Results: Circularly polarized light suffers intensive depolarization in a single scattering against particles of various specific sizes for its wavelength, which becomes more noticeable in the multiple scattering regime. Conclusions: The depolarization diagrams with particle size and wavelength as independent variables were obtained, which are particularly helpful for investigating the feasibility of various particle-monitoring methods. Based on the obtained diagrams, several applications have been proposed, including blood cell monitoring, early embryogenesis, and antigen-antibody interactions.


title: Adaptive Relaxation based Non-Conservative Chance Constrained Stochastic MPC for Battery Scheduling Under Forecast Uncertainties

abstract: Chance constrained stochastic model predictive controllers (CC-SMPC) trade off full constraint satisfaction for economical plant performance under uncertainty. Previous CC-SMPC works are over-conservative in constraint violations leading to worse economic performance. Other past works require a-priori information about the uncertainty set, limiting their application to real-world systems. This paper considers a discrete linear time invariant system with hard constraints on inputs and chance constraints on states, with unknown uncertainty distribution, statistics, or samples. This work proposes a novel adaptive online update rule to relax the state constraints based on the time-average of past constraint violations, for the SMPC to achieve reduced conservativeness in closed-loop. Under an ideal control policy assumption, it is proven that the time-average of constraint violations converges to the maximum allowed violation probability. The time-average of constraint violations is also proven to asymptotically converge even without the simplifying assumptions. The proposed method is applied to the optimal battery energy storage system (BESS) dispatch in a grid connected microgrid with PV generation and load demand with chance constraints on BESS state-of-charge (SOC). Realistic simulations show the superior electricity cost saving potential of the proposed method as compared to the traditional MPC (with hard constraints on BESS SOC), by satisfying the chance constraints non-conservatively in closed-loop, thereby effectively trading off increased cost savings with minimal adverse effects on BESS lifetime.


title: Gifts from long-range interaction: Emergent gapless topological behaviors in quantum spin chain

abstract: Topology in condensed matter physics is typically associated with a bulk energy gap. However, recent research has shifted focus to topological phases without a bulk energy gap, exhibiting nontrivial gapless topological behaviors. In this letter, we explore a cluster Ising chain with long-range antiferromagnetic interactions that decay as a power law with the distance. Using complementary numerical and analytical techniques, we demonstrate that long-range interactions can unambiguously induce an algebraic topological phase and a topological Gaussian universality, both of which exhibit nontrivial gapless topological behaviors. Our study not only provides a platform to investigate the fundamental physics of quantum many-body systems but also offers a novel route toward searching for gapless topological phases in realistic quantum simulators.

categories: cond-mat.str-el cond-mat.quant-gas cond-mat.stat-mech quant-ph


title: Can Dense Connectivity Benefit Outlier Detection? An Odyssey with NAS

abstract: Recent advances in Out-of-Distribution (OOD) Detection is the driving force behind safe and reliable deployment of Convolutional Neural Networks (CNNs) in real world applications. However, existing studies focus on OOD detection through confidence score and deep generative model-based methods, without considering the impact of DNN structures, especially dense connectivity in architecture fabrications. In addition, existing outlier detection approaches exhibit high variance in generalization performance, lacking stability and confidence in evaluating and ranking different outlier detectors. In this work, we propose a novel paradigm, Dense Connectivity Search of Outlier Detector (DCSOD), that automatically explore the dense connectivity of CNN architectures on near-OOD detection task using Neural Architecture Search (NAS). We introduce a hierarchical search space containing versatile convolution operators and dense connectivity, allowing a flexible exploration of CNN architectures with diverse connectivity patterns. To improve the quality of evaluation on OOD detection during search, we propose evolving distillation based on our multi-view feature learning explanation. Evolving distillation stabilizes training for OOD detection evaluation, thus improves the quality of search. We thoroughly examine DCSOD on CIFAR benchmarks under OOD detection protocol. Experimental results show that DCSOD achieve remarkable performance over widely used architectures and previous NAS baselines. Notably, DCSOD achieves state-of-the-art (SOTA) performance on CIFAR benchmark, with AUROC improvement of $\sim$1.0%.


title: Conditional Language Learning with Context

abstract: Language models can learn sophisticated language understanding skills from fitting raw text. They also unselectively learn useless corpus statistics and biases, especially during finetuning on domain-specific corpora. In this paper, we propose a simple modification to causal language modeling called conditional finetuning, which performs language modeling conditioned on a context. We show that a context can "explain away" certain corpus statistics and make the model avoid learning them. In this fashion, conditional finetuning achieves selective learning from a corpus, learning knowledge useful for downstream tasks while avoiding learning useless corpus statistics like topic biases. This selective learning effect leads to less forgetting and better stability-plasticity tradeoff in domain finetuning, potentially benefitting lifelong learning with language models.


title: What Improves the Generalization of Graph Transformers? A Theoretical Dive into the Self-attention and Positional Encoding

abstract: Graph Transformers, which incorporate self-attention and positional encoding, have recently emerged as a powerful architecture for various graph learning tasks. Despite their impressive performance, the complex non-convex interactions across layers and the recursive graph structure have made it challenging to establish a theoretical foundation for learning and generalization. This study introduces the first theoretical investigation of a shallow Graph Transformer for semi-supervised node classification, comprising a self-attention layer with relative positional encoding and a two-layer perceptron. Focusing on a graph data model with discriminative nodes that determine node labels and non-discriminative nodes that are class-irrelevant, we characterize the sample complexity required to achieve a desirable generalization error by training with stochastic gradient descent (SGD). This paper provides the quantitative characterization of the sample complexity and number of iterations for convergence dependent on the fraction of discriminative nodes, the dominant patterns, and the initial model errors. Furthermore, we demonstrate that self-attention and positional encoding enhance generalization by making the attention map sparse and promoting the core neighborhood during training, which explains the superior feature representation of Graph Transformers. Our theoretical results are supported by empirical experiments on synthetic and real-world benchmarks.


title: Improved Memory Truncation Scheme for Quasi-Adiabatic Propagator Path Integral via Influence Functional Renormalization

abstract: Accurately simulating non-Markovian quantum dynamics in system-bath coupled problems remains challenging. In this work, we present a novel memory truncation scheme for the iterative Quasi-Adiabatic Propagator Path Integral (iQuAPI) method to improve accuracy. Conventional memory truncation in iQuAPI discards all influence functional beyond a certain time interval, which is not effective for problems with a long memory time. Our proposed scheme selectively retains the most significant parts of the influence functional using the density matrix renormalization group algorithm. We validate the effectiveness of our scheme through simulations of the spin-boson model across various parameter sets, demonstrating faster convergence and improved accuracy compared to the conventional scheme. Our findings suggest that the new memory truncation scheme significantly advances the capabilities of iQuAPI for problems with a long memory time.


title: $3$-Cut Complexes of Squared Cycle Graphs

abstract: For a positive integer $k$, the $k$-cut complex of a graph $G$ is the simplicial complex whose facets are the $(|V(G)|-k)$-subsets $\sigma$ of the vertex set $V(G)$ of $G$ such that the induced subgraph of $G$ on $V(G) \setminus \sigma$ is disconnected. These complexes first appeared in the master thesis of Denker and were further studied by Bayer et al.\ in [Topology of cut complexes of graphs, SIAM Journal on Discrete Mathematics, 2024]. In the same article, Bayer et al.\ conjectured that for $k \geq 3$, the $k$-cut complexes of squared cycle graphs are shellable. Moreover, they also conjectured about the Betti numbers of these complexes when $k=3$. In this article, we prove these conjectures for $k=3$.


title: Quantum colored strings in the hole-doped $t$-$J_z$ model

abstract: The stripe phase, an intertwined order observed in high-temperature superconductors, is regarded as playing a key role in elucidating the underlying mechanism of superconductivity, especially in cuprates. Following Jan Zaanen's early scenario, the full-filled charge stripe can be taken as the interactive elastic quantum strings of holes, stabilized by $\pi$-phase shifts between neighboring magnetic domains. However, this scenario is challenging to explain, particularly in terms of electron pairing, which necessitates hole pairs. In this work, we propose a new effective model for describing the stripe phase in the hole-doped $t$-$J_z$ model. With respect to the antiferromagnetic background, the model comprises three types of color-labeled point-defects coupling to {an effective} spin field. Comparing with numerical results from large-scale density matrix renormalization group (DMRG) simulations, we find semi-quantitative agreement in local hole density, magnetic moment, and the newly proposed spectrum features of the {effective} spin field. By systematically analyzing the hole-density distribution and the scaling of groundstate energy at different system sizes, we determine the effective core radius and the effective hopping amplitude of the quantum string. Furthermore, the local pinning field can be finely adjusted to drag the quantum string, offering a potential method for detecting it in optical lattices.


title: Zyda: A 1.3T Dataset for Open Language Modeling

abstract: The size of large language models (LLMs) has scaled dramatically in recent years and their computational and data requirements have surged correspondingly. State-of-the-art language models, even at relatively smaller sizes, typically require training on at least a trillion tokens. This rapid advancement has eclipsed the growth of open-source datasets available for large-scale LLM pretraining. In this paper, we introduce Zyda (Zyphra Dataset), a dataset under a permissive license comprising 1.3 trillion tokens, assembled by integrating several major respected open-source datasets into a single, high-quality corpus. We apply rigorous filtering and deduplication processes, both within and across datasets, to maintain and enhance the quality derived from the original datasets. Our evaluations show that Zyda not only competes favorably with other open datasets like Dolma, FineWeb, and RefinedWeb, but also substantially improves the performance of comparable models from the Pythia suite. Our rigorous data processing methods significantly enhance Zyda's effectiveness, outperforming even the best of its constituent datasets when used independently.


title: Variable importance measure for spatial machine learning models with application to air pollution exposure prediction

abstract: Exposure assessment is fundamental to air pollution cohort studies. The objective is to predict air pollution exposures for study subjects at locations without data in order to optimize our ability to learn about health effects of air pollution. In addition to generating accurate predictions to minimize exposure measurement error, understanding the mechanism captured by the model is another crucial aspect that may not always be straightforward due to the complex nature of machine learning methods, as well as the lack of unifying notions of variable importance. This is further complicated in air pollution modeling by the presence of spatial correlation. We tackle these challenges in two datasets: sulfur (S) from regulatory United States national PM2.5 sub-species data and ultrafine particles (UFP) from a new Seattle-area traffic-related air pollution dataset. Our key contribution is a leave-one-out approach for variable importance that leads to interpretable and comparable measures for a broad class of models with separable mean and covariance components. We illustrate our approach with several spatial machine learning models, and it clearly highlights the difference in model mechanisms, even for those producing similar predictions. We leverage insights from this variable importance measure to assess the relative utilities of two exposure models for S and UFP that have similar out-of-sample prediction accuracies but appear to draw on different types of spatial information to make predictions.


title: RKLD: Reverse KL-Divergence-based Knowledge Distillation for Unlearning Personal Information in Large Language Models

abstract: With the passage of the Right to Be Forgotten (RTBF) regulations and the scaling up of language model training datasets, research on model unlearning in large language models (LLMs) has become more crucial. Before the era of LLMs, machine unlearning research focused mainly on classification tasks in models with small parameters. In these tasks, the content to be forgotten or retained is clear and straightforward. However, as parameter sizes have grown and tasks have become more complex, balancing forget quality and model utility has become more challenging, especially in scenarios involving personal data instead of classification results. Existing methods based on gradient ascent and its variants often struggle with this balance, leading to unintended information loss or partial forgetting. To address this challenge, we propose RKLD, a novel \textbf{R}everse \textbf{KL}-Divergence-based Knowledge \textbf{D}istillation unlearning algorithm for LLMs targeting the unlearning of personal information. Through RKLD, we achieve significant forget quality and effectively maintain the model utility in our experiments.


title: Unified one-parameter scaling function for Anderson localization transitions in non-reciprocal non-Hermitian systems

abstract: By using dimensionless conductances as scaling variables, the conventional one-parameter scaling theory of localization fails for non-reciprocal non-Hermitian systems such as the Hanato-Nelson model. Here, we propose a one-parameter scaling function using the participation ratio as the scaling variable. Employing a highly accurate numerical procedure based on exact diagonalization, we demonstrate that this one-parameter scaling function can describe Anderson localization transitions of non-reciprocal non-Hermitian systems in one and two dimensions of symmetry classes AI and A. The critical exponents of correlation lengths depend on symmetries and dimensionality only, a typical feature of universality. Moreover, we derive a complex-gap equation based on the self-consistent Born approximation that can determine the disorder at which the point gap closes. The obtained disorders match perfectly the critical disorders of Anderson localization transitions from the one-parameter scaling function. Finally, we show that the one-parameter scaling function is also valid for Anderson localization transitions in reciprocal non-Hermitian systems such as two-dimensional class AII$^\dagger$ and can, thus, serve as a unified scaling function for disordered non-Hermitian systems.


title: On the Kodaira types of elliptic curves with potentially good supersingular reduction

abstract: Let $\mathcal{O}_K$ be a Henselian discrete valuation domain with field of fractions $K$. Assume that $\mathcal{O}_K$ has algebraically closed residue field $k$. Let $E/K$ be an elliptic curve with additive reduction. The semi-stable reduction theorem asserts that there exists a minimal extension $L/K$ such that the base change $E_L/L$ has semi-stable reduction. It is natural to wonder whether specific properties of the semi-stable reduction and of the extension $L/K$ impose restrictions on what types of Kodaira type the special fiber of $E/K$ may have. In this paper we study the restrictions imposed on the reduction type when the extension $L/K$ is wildly ramified of degree $2$, and the curve $E/K$ has potentially good supersingular reduction. We also analyze the possible reduction types of two isogenous elliptic curves with these properties.


title: Congruence properties of the coefficients of the classical modular polynomials

abstract: The classical modular polynomials $\Phi_\ell(X,Y)$ give plane curve models for the modular curves $X_0(\ell)/\mathbb{Q}$ and have been extensively studied. In this article, we provide closed formulas for $\ell$ nontrivial coefficients of the classical modular polynomials $\Phi_\ell(X,Y)$ in terms of the Fourier coefficients of the modular invariant function $j(z)$ for a prime $\ell$. Our interest in the formulas were motivated by our conjectures on congruences modulo powers of the primes $2,3$ and $5$ satisfied by the coefficients of these polynomials. We deduce congruences from these formulas supporting the conjectures.


title: Dealing with All-stage Missing Modality: Towards A Universal Model with Robust Reconstruction and Personalization

abstract: Addressing missing modalities presents a critical challenge in multimodal learning. Current approaches focus on developing models that can handle modality-incomplete inputs during inference, assuming that the full set of modalities are available for all the data during training. This reliance on full-modality data for training limits the use of abundant modality-incomplete samples that are often encountered in practical settings. In this paper, we propose a robust universal model with modality reconstruction and model personalization, which can effectively tackle the missing modality at both training and testing stages. Our method leverages a multimodal masked autoencoder to reconstruct the missing modality and masked patches simultaneously, incorporating an innovative distribution approximation mechanism to fully utilize both modality-complete and modality-incomplete data. The reconstructed modalities then contributes to our designed data-model co-distillation scheme to guide the model learning in the presence of missing modalities. Moreover, we propose a CLIP-driven hyper-network to personalize partial model parameters, enabling the model to adapt to each distinct missing modality scenario. Our method has been extensively validated on two brain tumor segmentation benchmarks. Experimental results demonstrate the promising performance of our method, which consistently exceeds previous state-of-the-art approaches under the all-stage missing modality settings with different missing ratios. Code will be available.


title: Personalized Topic Selection Model for Topic-Grounded Dialogue

abstract: Recently, the topic-grounded dialogue (TGD) system has become increasingly popular as its powerful capability to actively guide users to accomplish specific tasks through topic-guided conversations. Most existing works utilize side information (\eg topics or personas) in isolation to enhance the topic selection ability. However, due to disregarding the noise within these auxiliary information sources and their mutual influence, current models tend to predict user-uninteresting and contextually irrelevant topics. To build user-engaging and coherent dialogue agent, we propose a \textbf{P}ersonalized topic s\textbf{E}lection model for \textbf{T}opic-grounded \textbf{D}ialogue, named \textbf{PETD}, which takes account of the interaction of side information to selectively aggregate such information for more accurately predicting subsequent topics. Specifically, we evaluate the correlation between global topics and personas and selectively incorporate the global topics aligned with user personas. Furthermore, we propose a contrastive learning based persona selector to filter out irrelevant personas under the constraint of lacking pertinent persona annotations. Throughout the selection and generation, diverse relevant side information is considered. Extensive experiments demonstrate that our proposed method can generate engaging and diverse responses, outperforming state-of-the-art baselines across various evaluation metrics.


title: Life beyond Fritz: On the detachment of electrolytic bubbles

abstract: We present an experimental study on detachment characteristics of hydrogen bubbles during electrolysis. Using a transparent (Pt or Ni) electrode enables us to directly observe the bubble contact line and bubble size. Based on these quantities we determine other parameters such as the contact angle and volume through solutions of the Young-Laplace equation. We observe bubbles without ('pinned bubbles') and with ('spreading bubbles') contact line spreading, and find that the latter mode becomes more prevalent if the concentration of HClO4 is greater than or equal to 0.1 M. The departure radius for spreading bubbles is found to drastically exceed the value predicted by the well-known formula of W. Fritz (Physik. Zeitschr. 1935, 36, 379-384) for this case. We show that this is related to the contact line hysteresis, which leads to pinning of the contact line after an initial spreading phase at the receding contact angle. The departure mode is then similar to a pinned bubble and occurs once the contact angle reaches the advancing contact angle of the surface. A prediction for the departure radius based on these findings is found to be consistent with the experimental data.


title: 50 GeV $\pi^-$ in, nothing out: a sensitive probe of invisible $\eta$ and $\eta'$ decays with NA64h

abstract: We present the first results from a proof-of-concept search for dark sectors via invisible decays of pseudoscalar $\eta$ and $\eta'$ mesons in the NA64h experiment at the CERN SPS. Our novel technique uses the charge-exchange reaction of 50 GeV $\pi^-$ on nuclei of an active target as the source of neutral mesons. The $\eta, \eta' \to invisible$ events would exhibit themselves via a striking signature - the complete disappearance of the incoming beam energy in the detector. No evidence for such events has been found with $2.9\times10^{9}$ pions on target accumulated during one day of data taking. This allows us to set a stringent limit on the branching ratio ${\rm Br}(\eta' \to invisible) < 2.1 \times 10^{-4}$ improving the current bound by a factor of $\simeq3$. We also set a limit on ${\rm Br}(\eta \to invisible) < 1.1 \times 10^{-4}$ comparable with the existing one. These results demonstrate the great potential of our approach and provide clear guidance on how to enhance and extend the sensitivity for dark sector physics from future searches for invisible neutral meson decays.


title: Data-driven optimal prediction with control

abstract: This study presents the extension of the data-driven optimal prediction approach to the dynamical system with control. The optimal prediction is used to analyze dynamical systems in which the states consist of resolved and unresolved variables. The latter variables can not be measured explicitly. They may have smaller amplitudes and affect the resolved variables that can be measured. The optimal prediction approach recovers the averaged trajectories of the resolved variables by computing conditional expectations, while the distribution of the unresolved variables is assumed to be known. We consider such dynamical systems and introduce their additional control functions. To predict the targeted trajectories numerically, we develop a data-driven method based on the dynamic mode decomposition. The proposed approach takes the $\mathit{measured}$ trajectories of the resolved variables, constructs an approximate linear operator from the Mori-Zwanzig decomposition, and reconstructs the $\mathit{averaged}$ trajectories of the same variables. It is demonstrated that the method is much faster than the Monte Carlo simulations and it provides a reliable prediction. We experimentally confirm the efficacy of the proposed method for two Hamiltonian dynamical systems.


title: Overcoming Lower-Level Constraints in Bilevel Optimization: A Novel Approach with Regularized Gap Functions

abstract: Constrained bilevel optimization tackles nested structures present in constrained learning tasks like constrained meta-learning, adversarial learning, and distributed bilevel optimization. However, existing bilevel optimization methods mostly are typically restricted to specific constraint settings, such as linear lower-level constraints. In this work, we overcome this limitation and develop a new single-loop, Hessian-free constrained bilevel algorithm capable of handling more general lower-level constraints. We achieve this by employing a doubly regularized gap function tailored to the constrained lower-level problem, transforming constrained bilevel optimization into an equivalent single-level optimization problem with a single smooth constraint. We rigorously establish the non-asymptotic convergence analysis of the proposed algorithm under the convexity of lower-level problem, avoiding the need for strong convexity assumptions on the lower-level objective or coupling convexity assumptions on lower-level constraints found in existing literature. Additionally, the generality of our method allows for its extension to bilevel optimization with minimax lower-level problem. We evaluate the effectiveness and efficiency of our algorithm on various synthetic problems, typical hyperparameter learning tasks, and generative adversarial network.


title: Choroidal Vessel Segmentation on Indocyanine Green Angiography Images via Human-in-the-Loop Labeling

abstract: Human-in-the-loop (HITL) strategy has been recently introduced into the field of medical image processing. Indocyanine green angiography (ICGA) stands as a well-established examination for visualizing choroidal vasculature and detecting chorioretinal diseases. However, the intricate nature of choroidal vascular networks makes large-scale manual segmentation of ICGA images challenging. Thus, the study aims to develop a high-precision choroidal vessel segmentation model with limited labor using HITL framework. We utilized a multi-source ICGA dataset, including 55 degree view and ultra-widefield ICGA (UWF-ICGA) images for model development. The choroidal vessel network was pre-segmented by a pre-trained vessel segmentation model, and then manually modified by two ophthalmologists. Choroidal vascular diameter, density, complexity, tortuosity, and branching angle were automatically quantified based on the segmentation. We finally conducted four cycles of HITL. One hundred and fifty 55 degree view ICGA images were used for the first three cycles (50 images per cycle), and twenty UWF-ICGA images for the last cycle. The average time needed to manually correct a pre-segmented ICGA image per cycle reduced from 20 minutes to 1 minute. High segmentation accuracy has been achieved on both 55 degree view ICGA and UWF-ICGA images. Additionally, the multi-dimensional choroidal vascular parameters were significantly associated with various chorioretinal diseases. Our study not only demonstrated the feasibility of the HITL strategy in improving segmentation performance with reduced manual labeling, but also innovatively introduced several risk predictors for choroidal abnormalities.


title: 3D Imaging of Complex Specular Surfaces by Fusing Polarimetric and Deflectometric Information

abstract: Accurate and fast 3D imaging of specular surfaces still poses major challenges for state-of-the-art optical measurement principles. Frequently used methods, such as phase-measuring deflectometry (PMD) or shape-from-polarization (SfP), rely on strong assumptions about the measured objects, limiting their generalizability in broader application areas like medical imaging, industrial inspection, virtual reality, or cultural heritage analysis. In this paper, we introduce a measurement principle that utilizes a novel technique to effectively encode and decode the information contained in a light field reflected off a specular surface. We combine polarization cues from SfP with geometric information obtained from PMD to resolve all arising ambiguities in the 3D measurement. Moreover, our approach removes the unrealistic orthographic imaging assumption for SfP, which significantly improves the respective results. We showcase our new technique by demonstrating single-shot and multi-shot measurements on complex-shaped specular surfaces, displaying an evaluated accuracy of surface normals below $0.6^\circ$.


title: On $\ell$-regular partitions and Hickerson's identity

abstract: Based on two involutions and a bijection, we completely determine the difference between the number of $\ell$-regular partitions of $n$ into an even number of parts and into an odd number of parts for all positive integers $n$ and $\ell>1$, which extends two recent results due to Ballantine and Merca. As an application, we provide a combinatorial proof of Hickerson's identity on the number of partitions into an even and odd number of parts.


title: Bayesian Mesh Optimization for Graph Neural Networks to Enhance Engineering Performance Prediction

abstract: In engineering design, surrogate models are widely employed to replace computationally expensive simulations by leveraging design variables and geometric parameters from computer-aided design (CAD) models. However, these models often lose critical information when simplified to lower dimensions and face challenges in parameter definition, especially with the complex 3D shapes commonly found in industrial datasets. To address these limitations, we propose a Bayesian graph neural network (GNN) framework for a 3D deep-learning-based surrogate model that predicts engineering performance by directly learning geometric features from CAD using mesh representation. Our framework determines the optimal size of mesh elements through Bayesian optimization, resulting in a high-accuracy surrogate model. Additionally, it effectively handles the irregular and complex structures of 3D CADs, which differ significantly from the regular and uniform pixel structures of 2D images typically used in deep learning. Experimental results demonstrate that the quality of the mesh significantly impacts the prediction accuracy of the surrogate model, with an optimally sized mesh achieving superior performance. We compare the performance of models based on various 3D representations such as voxel, point cloud, and graph, and evaluate the computational costs of Monte Carlo simulation and Bayesian optimization methods to find the optimal mesh size. We anticipate that our proposed framework has the potential to be applied to mesh-based simulations across various engineering fields, leveraging physics-based information commonly used in computer-aided engineering.