title: Plug and Play with Prompts: A Prompt Tuning Approach for Controlling Text Generation

abstract: Transformer-based Large Language Models (LLMs) have shown exceptional language generation capabilities in response to text-based prompts. However, controlling the direction of generation via textual prompts has been challenging, especially with smaller models. In this work, we explore the use of Prompt Tuning to achieve controlled language generation. Generated text is steered using prompt embeddings, which are trained using a small language model, used as a discriminator. Moreover, we demonstrate that these prompt embeddings can be trained with a very small dataset, with as low as a few hundred training examples. Our method thus offers a data and parameter efficient solution towards controlling language model outputs. We carry out extensive evaluation on four datasets: SST-5 and Yelp (sentiment analysis), GYAFC (formality) and JIGSAW (toxic language). Finally, we demonstrate the efficacy of our method towards mitigating harmful, toxic, and biased text generated by language models.


title: Enhancing Clinical Efficiency through LLM: Discharge Note Generation for Cardiac Patients

abstract: Medical documentation, including discharge notes, is crucial for ensuring patient care quality, continuity, and effective medical communication. However, the manual creation of these documents is not only time-consuming but also prone to inconsistencies and potential errors. The automation of this documentation process using artificial intelligence (AI) represents a promising area of innovation in healthcare. This study directly addresses the inefficiencies and inaccuracies in creating discharge notes manually, particularly for cardiac patients, by employing AI techniques, specifically large language model (LLM). Utilizing a substantial dataset from a cardiology center, encompassing wide-ranging medical records and physician assessments, our research evaluates the capability of LLM to enhance the documentation process. Among the various models assessed, Mistral-7B distinguished itself by accurately generating discharge notes that significantly improve both documentation efficiency and the continuity of care for patients. These notes underwent rigorous qualitative evaluation by medical expert, receiving high marks for their clinical relevance, completeness, readability, and contribution to informed decision-making and care planning. Coupled with quantitative analyses, these results confirm Mistral-7B's efficacy in distilling complex medical information into concise, coherent summaries. Overall, our findings illuminate the considerable promise of specialized LLM, such as Mistral-7B, in refining healthcare documentation workflows and advancing patient care. This study lays the groundwork for further integrating advanced AI technologies in healthcare, demonstrating their potential to revolutionize patient documentation and support better care outcomes.


title: UniMix: Towards Domain Adaptive and Generalizable LiDAR Semantic Segmentation in Adverse Weather

abstract: LiDAR semantic segmentation (LSS) is a critical task in autonomous driving and has achieved promising progress. However, prior LSS methods are conventionally investigated and evaluated on datasets within the same domain in clear weather. The robustness of LSS models in unseen scenes and all weather conditions is crucial for ensuring safety and reliability in real applications. To this end, we propose UniMix, a universal method that enhances the adaptability and generalizability of LSS models. UniMix first leverages physically valid adverse weather simulation to construct a Bridge Domain, which serves to bridge the domain gap between the clear weather scenes and the adverse weather scenes. Then, a Universal Mixing operator is defined regarding spatial, intensity, and semantic distributions to create the intermediate domain with mixed samples from given domains. Integrating the proposed two techniques into a teacher-student framework, UniMix efficiently mitigates the domain gap and enables LSS models to learn weather-robust and domain-invariant representations. We devote UniMix to two main setups: 1) unsupervised domain adaption, adapting the model from the clear weather source domain to the adverse weather target domain; 2) domain generalization, learning a model that generalizes well to unseen scenes in adverse weather. Extensive experiments validate the effectiveness of UniMix across different tasks and datasets, all achieving superior performance over state-of-the-art methods. The code will be released.


title: Katachi: Decoding the Imprints of Past Star Formation on Present Day Morphology in Galaxies with Interpretable CNNs

abstract: The physical processes responsible for shaping how galaxies form and quench over time leave imprints on both the spatial (galaxy morphology) and temporal (star formation history; SFH) tracers that we use to study galaxies. While the morphology-SFR connection is well studied, the correlation with past star formation activity is not as well understood. To quantify this we present Katachi, an interpretable convolutional neural network (CNN) framework that learns the connection between the factors regulating star formation in galaxies on different spatial and temporal scales. Katachi is trained on 9904 galaxies at 0.02$<$z$<$0.1 in the SDSS-IV MaNGA DR17 sample to predict stellar mass (M$_*$; RMSE 0.22 dex), current star formation rate (SFR; RMSE 0.31 dex) and half-mass time (t$_{50}$; RMSE 0.23 dex). This information allows us to reconstruct non-parametric SFHs for each galaxy from \textit{gri} imaging alone. To quantify the morphological features informing the SFH predictions we use SHAP (SHapley Additive exPlanations). We recover the expected trends of M$_*$ governed by the growth of galaxy bulges, and SFR correlating with spiral arms and other star-forming regions. We also find the SHAP maps of D4000 are more complex than those of M$_*$ and SFR, and that morphology is correlated with t$_{50}$ even at fixed mass and SFR. Katachi serves as a scalable public framework to predict galaxy properties from large imaging surveys including Rubin, Roman, and Euclid, with large datasets of high SNR imaging across limited photometric bands.


title: Towards Optimal Circuit Size for Sparse Quantum State Preparation

abstract: Compared to general quantum states, the sparse states arise more frequently in the field of quantum computation. In this work, we consider the preparation for $n$-qubit sparse quantum states with $s$ non-zero amplitudes and propose two algorithms. The first algorithm uses $O(ns/\log n + n)$ gates, improving upon previous methods by $O(\log n)$. We further establish a matching lower bound for any algorithm which is not amplitude-aware and employs at most $\operatorname{poly}(n)$ ancillary qubits. The second algorithm is tailored for binary strings that exhibit a short Hamiltonian path. An application is the preparation of $U(1)$-invariant state with $k$ down-spins in a chain of length $n$, including Bethe states, for which our algorithm constructs a circuit of size $O\left(\binom{n}{k}\log n\right)$. This surpasses previous results by $O(n/\log n)$ and is close to the lower bound $O\left(\binom{n}{k}\right)$. Both the two algorithms shrink the existing gap theoretically and provide increasing advantages numerically.


title: Generalized Criterion for Identifiability of Additive Noise Models Using Majorization

abstract: The discovery of causal relationships from observational data is very challenging. Many recent approaches rely on complexity or uncertainty concepts to impose constraints on probability distributions, aiming to identify specific classes of directed acyclic graph (DAG) models. In this paper, we introduce a novel identifiability criterion for DAGs that places constraints on the conditional variances of additive noise models. We demonstrate that this criterion extends and generalizes existing identifiability criteria in the literature that employ (conditional) variances as measures of uncertainty in (conditional) distributions. For linear Structural Equation Models, we present a new algorithm that leverages the concept of weak majorization applied to the diagonal elements of the Cholesky factor of the covariance matrix to learn a topological ordering of variables. Through extensive simulations and the analysis of bank connectivity data, we provide evidence of the effectiveness of our approach in successfully recovering DAGs. The code for reproducing the results in this paper is available in Supplementary Materials.


title: Intelligent Reflecting Surface Aided Target Localization With Unknown Transceiver-IRS Channel State Information

abstract: Integrating wireless sensing capabilities into base stations (BSs) has become a widespread trend in the future beyond fifth-generation (B5G)/sixth-generation (6G) wireless networks. In this paper, we investigate intelligent reflecting surface (IRS) enabled wireless localization, in which an IRS is deployed to assist a BS in locating a target in its non-line-of-sight (NLoS) region. In particular, we consider the case where the BS-IRS channel state information (CSI) is unknown. Specifically, we first propose a separate BS-IRS channel estimation scheme in which the BS operates in full-duplex mode (FDM), i.e., a portion of the BS antennas send downlink pilot signals to the IRS, while the remaining BS antennas receive the uplink pilot signals reflected by the IRS. However, we can only obtain an incomplete BS-IRS channel matrix based on our developed iterative coordinate descent-based channel estimation algorithm due to the "sign ambiguity issue". Then, we employ the multiple hypotheses testing framework to perform target localization based on the incomplete estimated channel, in which the probability of each hypothesis is updated using Bayesian inference at each cycle. Moreover, we formulate a joint BS transmit waveform and IRS phase shifts optimization problem to improve the target localization performance by maximizing the weighted sum distance between each two hypotheses. However, the objective function is essentially a quartic function of the IRS phase shift vector, thus motivating us to resort to the penalty-based method to tackle this challenge. Simulation results validate the effectiveness of our proposed target localization scheme and show that the scheme's performance can be further improved by finely designing the BS transmit waveform and IRS phase shifts intending to maximize the weighted sum distance between different hypotheses.


title: Strong Arnold chord conjecture via normalized capacities

abstract: We show that every dynamically convex toric domain in $\mathbb R^4$ admits a $C^1$-neighborhood $\mathcal U$ within the space of star-shaped domains of $\mathbb R^4$ with the following property: for any $X \in \mathcal U$, every Legendrian knot in $\partial X$ admits a Reeb chord with distinct endpoints. A higher dimensional analog is also discussed.


title: STITCH: Augmented Dexterity for Suture Throws Including Thread Coordination and Handoffs

abstract: We present STITCH: an augmented dexterity pipeline that performs Suture Throws Including Thread Coordination and Handoffs. STITCH iteratively performs needle insertion, thread sweeping, needle extraction, suture cinching, needle handover, and needle pose correction with failure recovery policies. We introduce a novel visual 6D needle pose estimation framework using a stereo camera pair and new suturing motion primitives. We compare STITCH to baselines, including a proprioception-only and a policy without visual servoing. In physical experiments across 15 trials, STITCH achieves an average of 2.93 sutures without human intervention and 4.47 sutures with human intervention. See https://sites.google.com/berkeley.edu/stitch for code and supplemental materials.


title: A Fast Analytical Model for Predicting Battery Performance Under Mixed Kinetic Control

abstract: The prediction of battery rate performance traditionally relies on computation-intensive numerical simulations. While simplified analytical models have been developed to accelerate the calculation, they usually assume battery performance to be controlled by a single rate-limiting process, such as solid diffusion or electrolyte transport. Here, we propose an improved analytical model that could be applied to battery discharging under mixed control of mass transport in both solid and electrolyte phases. Compared to previous single-particle models extended to incorporate the electrolyte kinetics, our model is able to predict the effect of salt depletion on diminishing the discharge capacity, a phenomenon that becomes important in thick electrodes and/or at high rates. The model demonstrates good agreement with the full-order simulation over a wide range of cell parameters and offers a speedup of over 600 times at the same time. Furthermore, it could be combined with gradient-based optimization algorithms to very efficiently search for the optimal battery cell configurations while numerical simulation fails at the task due to its inability to accurately evaluate the derivatives of the objective function. The high efficiency and the analytical nature of the model render it a powerful tool for battery cell design and optimization.


title: Gromov-Hausdorff distances from simply connected geodesic spaces to the circle

abstract: We prove that the Gromov-Hausdorff distance from the circle with its geodesic metric to any simply connected geodesic space is never smaller than $\frac{\pi}{4}$. We also prove that this bound is tight through the construction of a simply connected geodesic space $\mathrm{E}$ which attains the lower bound $\frac{\pi}{4}$. We deduce the first statement from a general result that we also establish which gives conditions on how small the Gromov-Hausdorff distance between two geodesic metric spaces $(X, d_X)$ and $(Y, d_Y )$ has to be in order for $\pi_1(X)$ and $\pi_1(Y)$ to be isomorphic.


title: Newton polygons and B\"{o}ttcher coordinates near infinity for polynomial skew products

abstract: Let $f(z,w)=(p(z),q(z,w))$ be a polynomial skew product such that the degrees of $p$ and $q$ are grater than or equal to $2$. Under one or two conditions, we prove that $f$ is conjugate to a monomial map on an invariant region near infinity. The monomial map and the region are determined by the degree of $p$ and a Newton polygon of $q$. Moreover, the region is included in the attracting basin of a superattracting fixed or indeterminacy point at infinity, or in the closure of the attracting basins of two point at infinity.


title: On the price of exact truthfulness in incentive-compatible online learning with bandit feedback: A regret lower bound for WSU-UX

abstract: In one view of the classical game of prediction with expert advice with binary outcomes, in each round, each expert maintains an adversarially chosen belief and honestly reports this belief. We consider a recently introduced, strategic variant of this problem with selfish (reputation-seeking) experts, where each expert strategically reports in order to maximize their expected future reputation based on their belief. In this work, our goal is to design an algorithm for the selfish experts problem that is incentive-compatible (IC, or \emph{truthful}), meaning each expert's best strategy is to report truthfully, while also ensuring the algorithm enjoys sublinear regret with respect to the expert with the best belief. Freeman et al. (2020) recently studied this problem in the full information and bandit settings and obtained truthful, no-regret algorithms by leveraging prior work on wagering mechanisms. While their results under full information match the minimax rate for the classical ("honest experts") problem, the best-known regret for their bandit algorithm WSU-UX is $O(T^{2/3})$, which does not match the minimax rate for the classical ("honest bandits") setting. It was unclear whether the higher regret was an artifact of their analysis or a limitation of WSU-UX. We show, via explicit construction of loss sequences, that the algorithm suffers a worst-case $\Omega(T^{2/3})$ lower bound. Left open is the possibility that a different IC algorithm obtains $O(\sqrt{T})$ regret. Yet, WSU-UX was a natural choice for such an algorithm owing to the limited design room for IC algorithms in this setting.


title: Comment on "Absence of Topological Protection of the Interface States in $\mathbb{Z}_2$ Photonic Crystals"

abstract: In the Letter, Xu et al. reported that edge modes disappear in the expanded structure of Wu-Hu model characterized by Z2 topological index, while appear in the trivial shrunken structure, when the edge cuts through the hexagonal unit cell. They then concluded that these edge modes are defect modes lacking topological protection. Unfortunately, their approach is not justified, rendering the conclusion unsolid.


title: Longtime Asymptotic Behavior of Nonlinear Fokker-Planck Type Equations with Periodic Boundary Conditions

abstract: In this paper, we study the asymptotic behavior of a class of nonlinear Fokker-Planck type equations in a bounded domain with periodic boundary conditions. The system is motivated by our study of grain boundary dynamics, especially under the non-isothermal environments. To obtain the long time behavior of the solutions, in particular, the exponential decay, the kinematic structures of the systems are investigated using novel reinterpretation of the classical entropy method.


title: Quantum and Classical Two-photon Interference of Single Photons with Ultralong Coherence Time

abstract: Two-photon interference (TPI) is a fundamental phenomenon in quantum optics and plays a crucial role in quantum information science and technology. TPI is commonly considered as quantum interference with an upper bound of $100\%$ for both the TPI visibility and the beat visibility in contrast to its classical counterpart with a maximum visibility of $50\%$. However, this is not always the case. Here we report a simultaneous observation of quantum and classical TPI of single photons with ultralong coherence time which is longer than the photon correlation time by five orders of magnitude. We observe a TPI visibility of $94.3\%\pm 0.2\%$ but a beat visibility of $50\%$. Besides an anti-bunching central dip due to single-photon statistics, we observe two bunching side peaks in cross-correlation curves for indistinguishable photons. Using either classical wave superposition theory or quantum field approach, we derive the same expressions for the cross-correlation functions which reproduce and explain the experiments well. We conclude that quantum TPI with a stream of single photons is equivalent to classical TPI, both of which are the fourth-order interference arising from the second-order interference occurring on the time scale of photon coherence time.


title: Semantic Stealth: Adversarial Text Attacks on NLP Using Several Methods

abstract: In various real-world applications such as machine translation, sentiment analysis, and question answering, a pivotal role is played by NLP models, facilitating efficient communication and decision-making processes in domains ranging from healthcare to finance. However, a significant challenge is posed to the robustness of these natural language processing models by text adversarial attacks. These attacks involve the deliberate manipulation of input text to mislead the predictions of the model while maintaining human interpretability. Despite the remarkable performance achieved by state-of-the-art models like BERT in various natural language processing tasks, they are found to remain vulnerable to adversarial perturbations in the input text. In addressing the vulnerability of text classifiers to adversarial attacks, three distinct attack mechanisms are explored in this paper using the victim model BERT: BERT-on-BERT attack, PWWS attack, and Fraud Bargain's Attack (FBA). Leveraging the IMDB, AG News, and SST2 datasets, a thorough comparative analysis is conducted to assess the effectiveness of these attacks on the BERT classifier model. It is revealed by the analysis that PWWS emerges as the most potent adversary, consistently outperforming other methods across multiple evaluation scenarios, thereby emphasizing its efficacy in generating adversarial examples for text classification. Through comprehensive experimentation, the performance of these attacks is assessed and the findings indicate that the PWWS attack outperforms others, demonstrating lower runtime, higher accuracy, and favorable semantic similarity scores. The key insight of this paper lies in the assessment of the relative performances of three prevalent state-of-the-art attack mechanisms.


title: Linguistic Changes in Spontaneous Speech for Detecting Parkinsons Disease Using Large Language Models

abstract: Parkinsons disease is the second most prevalent neurodegenerative disorder with over ten million active cases worldwide and one million new diagnoses per year. Detecting and subsequently diagnosing the disease is challenging because of symptom heterogeneity with respect to complexity, as well as the type and timing of phenotypic manifestations. Typically, language impairment can present in the prodromal phase and precede motor symptoms suggesting that a linguistic-based approach could serve as a diagnostic method for incipient Parkinsons disease. Additionally, improved linguistic models may enhance other approaches through ensemble techniques. The field of large language models is advancing rapidly, presenting the opportunity to explore the use of these new models for detecting Parkinsons disease and to improve on current linguistic approaches with high-dimensional representations of linguistics. We evaluate the application of state-of-the-art large language models to detect Parkinsons disease automatically from spontaneous speech with up to 73% accuracy.


title: Probing Plexciton Emission from 2D Materials on Gold Nanotrenches

abstract: Probing strongly coupled quasiparticle excitations at their intrinsic length scales offers unique insights into their properties and facilitates the design of devices with novel functionalities. In this work, we investigate the formation and emission characteristics of plexcitons, arising from the interaction between surface plasmons in narrow gold nanotrenches and excitons in monolayer WSe2. We study this strong plasmon-exciton coupling in both the far-field and the near-field. Specifically, we observe a Rabi splitting in the far-field reflection spectra of about 80 meV under ambient conditions, consistent with our theoretical modeling. Using a custom-designed near-field probe, we find that plexciton emission originates predominantly from the lower-frequency branch, which we can directly probe and map the local field distribution. We precisely determine the plexciton extension, similar to the trench width, with nanometric precision via collecting spectra at controlled probe locations. Our work opens exciting prospects for nanoscale mapping and engineering of plexcitons in complex nanostructures with potential applications in nanophotonic devices, optoelectronics, and quantum electrodynamics in nanoscale cavities.


title: Quantum Circuit for High Order Perturbation Theory Corrections

abstract: Perturbation theory (PT) might be one of the most powerful and fruitful tools for both physicists and chemists, which has led to a wide variety of applications. Over the past decades, advances in quantum computing provide opportunities for alternatives to classical methods. Recently, a general quantum circuit estimating the low order PT corrections has been proposed. In this article, we revisit the quantum circuits for PT calculations, and develop the methods for higher order PT corrections of eigenenergy, especially the 3rd and 4th order corrections. We present the feasible quantum circuit to estimate each term in these PT corrections. There are two the fundamental operations in the proposed circuit. One approximates the perturbation terms, the other approximates the inverse of unperturbed energy difference. The proposed method can be generalized to higher order PT corrections.


title: Semantic Flow: Learning Semantic Field of Dynamic Scenes from Monocular Videos

abstract: In this work, we pioneer Semantic Flow, a neural semantic representation of dynamic scenes from monocular videos. In contrast to previous NeRF methods that reconstruct dynamic scenes from the colors and volume densities of individual points, Semantic Flow learns semantics from continuous flows that contain rich 3D motion information. As there is 2D-to-3D ambiguity problem in the viewing direction when extracting 3D flow features from 2D video frames, we consider the volume densities as opacity priors that describe the contributions of flow features to the semantics on the frames. More specifically, we first learn a flow network to predict flows in the dynamic scene, and propose a flow feature aggregation module to extract flow features from video frames. Then, we propose a flow attention module to extract motion information from flow features, which is followed by a semantic network to output semantic logits of flows. We integrate the logits with volume densities in the viewing direction to supervise the flow features with semantic labels on video frames. Experimental results show that our model is able to learn from multiple dynamic scenes and supports a series of new tasks such as instance-level scene editing, semantic completions, dynamic scene tracking and semantic adaption on novel scenes. Codes are available at https://github.com/tianfr/Semantic-Flow/.


title: Rendering-Enhanced Automatic Image-to-Point Cloud Registration for Roadside Scenes

abstract: Prior point cloud provides 3D environmental context, which enhances the capabilities of monocular camera in downstream vision tasks, such as 3D object detection, via data fusion. However, the absence of accurate and automated registration methods for estimating camera extrinsic parameters in roadside scene point clouds notably constrains the potential applications of roadside cameras. This paper proposes a novel approach for the automatic registration between prior point clouds and images from roadside scenes. The main idea involves rendering photorealistic grayscale views taken at specific perspectives from the prior point cloud with the help of their features like RGB or intensity values. These generated views can reduce the modality differences between images and prior point clouds, thereby improve the robustness and accuracy of the registration results. Particularly, we specify an efficient algorithm, named neighbor rendering, for the rendering process. Then we introduce a method for automatically estimating the initial guess using only rough guesses of camera's position. At last, we propose a procedure for iteratively refining the extrinsic parameters by minimizing the reprojection error for line features extracted from both generated and camera images using Segment Anything Model (SAM). We assess our method using a self-collected dataset, comprising eight cameras strategically positioned throughout the university campus. Experiments demonstrate our method's capability to automatically align prior point cloud with roadside camera image, achieving a rotation accuracy of 0.202 degrees and a translation precision of 0.079m. Furthermore, we validate our approach's effectiveness in visual applications by substantially improving monocular 3D object detection performance.


title: Zincophilic armor: Phytate ammonium as a multifunctional additive for enhanced performance in aqueous zinc-ion batteries

abstract: Corrosion and the formation of by-products resulting from parasitic side reactions, as well as random dendrite growth, pose significant challenges for aqueous zinc-ion batteries (AZIBs). In this study, phytate ammonium is introduced into the traditional dilute Zinc sulfate electrolyte as a multi-functional additive. Leveraging the inherent zincophilic nature of the phytic anion, a protective layer is formed on the surface of the zinc anode. This layer can effectively manipulate the deposition process, mitigate parasitic reactions, and reduce the accumulation of detrimental by-products. Additionally, the competitive deposition between dissociated ammonium ions and Zn2+ promotes uniform deposition, thereby alleviating dendrite growth. Consequently, the modified electrolyte with a lower volume addition exhibits superior performance. The zinc symmetric battery demonstrates much more reversible plating/stripping, sustaining over 2000 hours at 5 mA cm-2 and 1 mA h cm-2. A high average deposition/stripping efficiency of 99.83% is achieved, indicating the significant boosting effect and practical potential of our strategy for high-performance aqueous zinc-ion batteries.


title: Direct Approach of Indefinite Linear-Quadratic Mean Field Games

abstract: This paper is concerned with an indefinite linear-quadratic (LQ) mean field games of stochastic large-polulation system, where the individual diffusion coefficients can depend on both the state and the control of the agents and the population state average. Moreover, the control weights in the cost functionals could be indefinite. We use a direct approach to derive the $\epsilon$-Nash equilibrium strategy. First, we formally solving an $N$-player game problem within a vast and finite population setting. Subsequently, decoupling or reducing high-dimensional systems by introducing two Riccati equations explicitly yields centralized strategies, contingent on the state of a specific player and the average state of the population. As the population size $N$ approaches infinity, the construction of decentralized strategies becomes feasible. Then, we demonstrated they are an $\epsilon$-Nash equilibrium.


title: Exact Analysis of the Age of Information in the Multi-Source M/GI/1 Queueing System

abstract: We consider a situation that multiple monitoring applications (each with a different sensor-monitor pair) compete for a common service resource such as a communication link. Each sensor reports the latest state of its own time-varying information source to its corresponding monitor, incurring queueing and processing delays at the shared resource. The primary performance metric of interest is the age of information (AoI) of each sensor-monitor pair, which is defined as the elapsed time from the generation of the information currently displayed on the monitor. Although the multi-source first-come first-served (FCFS) M/GI/1 queue is one of the most fundamental model to describe such competing sensors, its exact analysis has been an open problem for years. In this paper, we show that the Laplace-Stieltjes transform (LST) of the stationary distribution of the AoI in this model, as well as the mean AoI, is given by a simple explicit formula, utilizing the double Laplace transform of the transient workload in the M/GI/1 queue.


title: Adapting to Covariate Shift in Real-time by Encoding Trees with Motion Equations

abstract: Input distribution shift presents a significant problem in many real-world systems. Here we present Xenovert, an adaptive algorithm that can dynamically adapt to changes in input distribution. It is a perfect binary tree that adaptively divides a continuous input space into several intervals of uniform density while receiving a continuous stream of input. This process indirectly maps the source distribution to the shifted target distribution, preserving the data's relationship with the downstream decoder/operation, even after the shift occurs. In this paper, we demonstrated how a neural network integrated with Xenovert achieved better results in 4 out of 5 shifted datasets, saving the hurdle of retraining a machine learning model. We anticipate that Xenovert can be applied to many more applications that require adaptation to unforeseen input distribution shifts, even when the distribution shift is drastic.


title: QMix: Quality-aware Learning with Mixed Noise for Robust Retinal Disease Diagnosis

abstract: Due to the complexity of medical image acquisition and the difficulty of annotation, medical image datasets inevitably contain noise. Noisy data with wrong labels affects the robustness and generalization ability of deep neural networks. Previous noise learning methods mainly considered noise arising from images being mislabeled, i.e. label noise, assuming that all mislabeled images are of high image quality. However, medical images are prone to suffering extreme quality issues, i.e. data noise, where discriminative visual features are missing for disease diagnosis. In this paper, we propose a noise learning framework, termed as QMix, that learns a robust disease diagnosis model under mixed noise. QMix alternates between sample separation and quality-aware semisupervised training in each training epoch. In the sample separation phase, we design a joint uncertainty-loss criterion to effectively separate (1) correctly labeled images; (2) mislabeled images with high quality and (3) mislabeled images with low quality. In the semi-supervised training phase, we train a disease diagnosis model to learn robust feature representation from the separated samples. Specifically, we devise a sample-reweighing loss to mitigate the effect of mislabeled images with low quality during training. Meanwhile, a contrastive enhancement loss is proposed to further distinguish mislabeled images with low quality from correctly labeled images. QMix achieved state-of-the-art disease diagnosis performance on five public retinal image datasets and exhibited substantial improvement on robustness against mixed noise.


title: On the exponential integrability of the derivative of intersection and self-intersection local time for Brownian motion and related processes

abstract: We show that the derivative of the intersection and self-intersection local times of alpha-stable processes are exponentially integrable for certain parameter values. This includes the Brownian motion case. We also discuss related results present in the literature for fractional Brownian motion, and in particular give a counter-example to a result in [Guo, J., Hu, Y., and Xiao, Y., Higher-order derivative of intersection local time for two independent fractional Brownian motions, Journal of Theoretical Probability 32, (2019), pp. 1190-1201] related to this question.


title: A Monte-Carlo Simulation on Resonant Scattering of X-ray Line Emission in Supernova Remnants

abstract: Resonant scattering (RS) of X-ray line emission in supernova remnants (SNRs) may modify the observed line profiles and fluxes and has potential impact on estimating the physical properties of the hot gas and hence on understanding the SNR physics, but has not been theoretically modeled ever. Here we present our Monte-Carlo simulation of RS effect on X-ray resonant-line emission, typified by O VII He$\alpha$ r line, from SNRs. We employ the physical conditions characterized by the Sedov-Taylor solution and some basic parameters similar to those in Cygnus Loop. We show that the impact of RS effect is most significant near the edge of the remnant. The line profiles are predicted to be asymmetric because of different temperatures and photon production efficiencies of the expanding gas at different radii. We also predict the surface brightness of the line emission would decrease in the outer projected region but is slightly enhanced in the inner. The G-ratio of the OVII He$\alpha$ triplet can be effectively elevated by RS in the outer region. We show that RS effect of the O VII He$\alpha$ r line in the southwestern boundary region of Cygnus Loop is non-negligible. The observed OVII G-ratio $\sim$1.8 of the region could be achieved with RS taken into account for properly elevated O abundance from the previous estimates. Additional simulation performed for the SNRs in ejecta-dominated phase like Cas A shows that RS in the shocked ejecta may have some apparently effects on the observational properties of oxygen resonant lines.


title: Directed Buy-at-Bulk Spanners

abstract: We present a framework that unifies directed buy-at-bulk network design and directed spanner problems, namely, buy-at-bulk spanners. The goal is to find a minimum-cost routing solution for network design problems that capture economies at scale, while satisfying demands and distance constraints for terminal pairs. A more restricted version of this problem was shown to be $O(2^{{\log^{1-\varepsilon} n}})$-hard to approximate, where $n$ is the number of vertices, under a standard complexity assumption, due to Elkin and Peleg (Theory of Computing Systems, 2007). To the best of our knowledge, our results are the first sublinear factor approximation algorithms for directed buy-at-bulk spanners. Furthermore, these results hold even when we allow the edge lengths to be negative, unlike the previous literature for spanners. Our approximation ratios match the state-of-the-art ratios in special cases, namely, buy-at-bulk network design by Antonakopoulos (WAOA, 2010) and weighted spanners by Grigorescu, Kumar, and Lin (APPROX 2023). Our results are based on new approximation algorithms for the following two problems that are of independent interest: minimum-density distance-constrained junction trees and resource-constrained shortest path with negative consumption.


title: A Riemannian Manifold Approach to Constrained Resource Allocation in ISAC

abstract: This paper introduces a new resource allocation framework for integrated sensing and communication (ISAC) systems, which are expected to be fundamental aspects of sixth-generation networks. In particular, we develop an augmented Lagrangian manifold optimization (ALMO) framework designed to maximize communication sum rate while satisfying sensing beampattern gain targets and base station (BS) transmit power limits. ALMO applies the principles of Riemannian manifold optimization (MO) to navigate the complex, non-convex landscape of the resource allocation problem. It efficiently leverages the augmented Lagrangian method to ensure adherence to constraints. We present comprehensive numerical results to validate our framework, which illustrates the ALMO method's superior capability to enhance the dual functionalities of communication and sensing in ISAC systems. For instance, with 12 antennas and 30 dBm BS transmit power, our proposed ALMO algorithm delivers a 10.1% sum rate gain over a benchmark optimization-based algorithm. This work demonstrates significant improvements in system performance and contributes a new algorithmic perspective to ISAC resource management.


title: Hybrid quantum systems with artificial atoms in solid state

abstract: The development of single-platform qubits, predominant for most of the last few decades, has driven the progress of quantum information technologies but also highlighted the limitations of various platforms. Some inherent issues such as charge/spin noise in materials hinder certain platforms, while increased decoherence upon attempts to scale-up severely impact qubit quality and coupling on others. In addition, a universal solution for coherent information transfer between quantum systems remains lacking. By combining one or more qubit platforms, one could potentially create new hybrid platforms that might alleviate significant issues that current single platform qubits suffer from, and in some cases, even facilitate the conversion of static to flying qubits on the same hybrid platform. While nascent, this is an area of rising importance that could shed new light on robust and scalable qubit development and provide new impetus for research directions. Here, we define the requirements for hybrid systems with artificial atoms in solid state, exemplify them with systems that have been proposed or attempted, and conclude with our outlook for such hybrid quantum systems.


title: Solute strengthening and softening from screw dislocation in BCC tantalum: A first-principles study

abstract: Improving the high-temperature performance and low-temperature plasticity of tantalum (Ta) alloys is a significant scientific challenge. We employed first-principles calculations to study the interaction between screw dislocations and solute atoms in the body centered cubic (BCC) structure of Ta, with a particular focus on solid solution softening and strengthening. We analyzed the impact of various solute elements on the generalized stacking fault energy (GSFE), energy barriers within the single-atom column displacement model, and their interaction with screw dislocations. The results indicate that Hf and Zr, either individually or in combination, exhibit notable solute softening effects in BCC Ta, significantly reducing GSFE, energy barriers, and interaction energies. In contrast, Nb shows relative insensitivity to solute effects, while Mo, W, and Ir demonstrate solute strengthening effects. The calculations suggest that the interaction energy between screw dislocations and solute atoms is a reliable indicator for predicting strengthening and softening effects. Additionally, we extend these predictions to ternary alloys, demonstrating that the strengthening and softening phenomena in these materials can be explained through the electronic work function at the electronic level.


title: Emergence in String Theory and Fermi Gases

abstract: The Emergence Proposal suggests that some Swampland criteria, in particular on large field distances, are a consequence of the emergent nature of dynamics for fields in the infrared. In the context of type II string theory compactified on Calabi-Yau manifolds, it proposes that the cubic tree-level piece of the genus-zero prepotential is emergent from integrating out massive non-perturbative states. For a certain special non-compact Calabi-Yau, the blown-up conifold, it is known that the full all-genus prepotential can be matched onto the Grand Canonical potential of a two-dimensional Fermi gas. We propose here that this should be understood in the context of emergence: the prepotential is induced by integrating out the Fermi gas degrees of freedom. To make contact with the Swampland we need dynamical gravity, so compact Calabi-Yau manifolds. We show that for specifically the cubic term, an integrating out calculation also works for compact cases. In particular, the exact cubic term coefficient can be recovered from integrating out a Fermi gas for any compact Calabi-Yau that is an elliptic fibration over a reflexive toric base. We also propose a general map, for any one-parameter Calabi-Yau, between the Grand Canonical potential of the ultraviolet non-perturbative system and the period. In particular, this map leads to an emergent cubic term in the genus-zero prepotential for any such one-parameter model.


title: Power Series Composition in Near-Linear Time

abstract: We present an algebraic algorithm that computes the composition of two power series in $\mathop{\tilde{\mathrm O}}(n)$ time complexity. The previous best algorithms are $\mathop{\mathrm O}(n^{1+o(1)})$ by Kedlaya and Umans (FOCS 2008) and an $\mathop{\mathrm O}(n^{1.43})$ algebraic algorithm by Neiger, Salvy, Schost and Villard (JACM 2023). Our algorithm builds upon the recent Graeffe iteration approach to manipulate rational power series introduced by Bostan and Mori (SOSA 2021).


title: Estimating granular house price distributions in the Australian market using Gaussian mixtures

abstract: A new methodology is proposed to approximate the time-dependent house price distribution at a fine regional scale using Gaussian mixtures. The means, variances and weights of the mixture components are related to time, location and dwelling type through a non linear function trained by a deep functional approximator. Price indices are derived as means, medians, quantiles or other functions of the estimated distributions. Price densities for larger regions, such as a city, are calculated via a weighted sum of the component density functions. The method is applied to a data set covering all of Australia at a fine spatial and temporal resolution. In addition to enabling a detailed exploration of the data, the proposed index yields lower prediction errors in the practical task of individual dwelling price projection from previous sales values within the three major Australian cities. The estimated quantiles are also found to be well calibrated empirically, capturing the complexity of house price distributions.


title: Floer homology and square pegs

abstract: We construct a version of Lagrangian Floer homology whose chain complex is generated by the inscriptions of a rectangle into a real analytic Jordan curve. By using its associated spectral invariants, we establish that a rectifiable Jordan curve admits inscriptions of a whole interval of rectangles. In particular, it inscribes a square if the area it encloses is more than half that of a circle of equal diameter.


title: GloSoFarID: Global multispectral dataset for Solar Farm IDentification in satellite imagery

abstract: Solar Photovoltaic (PV) technology is increasingly recognized as a pivotal solution in the global pursuit of clean and renewable energy. This technology addresses the urgent need for sustainable energy alternatives by converting solar power into electricity without greenhouse gas emissions. It not only curtails global carbon emissions but also reduces reliance on finite, non-renewable energy sources. In this context, monitoring solar panel farms becomes essential for understanding and facilitating the worldwide shift toward clean energy. This study contributes to this effort by developing the first comprehensive global dataset of multispectral satellite imagery of solar panel farms. This dataset is intended to form the basis for training robust machine learning models, which can accurately map and analyze the expansion and distribution of solar panel farms globally. The insights gained from this endeavor will be instrumental in guiding informed decision-making for a sustainable energy future. https://github.com/yzyly1992/GloSoFarID


title: Adaptive Learning for Multi-view Stereo Reconstruction

abstract: Deep learning has recently demonstrated its excellent performance on the task of multi-view stereo (MVS). However, loss functions applied for deep MVS are rarely studied. In this paper, we first analyze existing loss functions' properties for deep depth based MVS approaches. Regression based loss leads to inaccurate continuous results by computing mathematical expectation, while classification based loss outputs discretized depth values. To this end, we then propose a novel loss function, named adaptive Wasserstein loss, which is able to narrow down the difference between the true and predicted probability distributions of depth. Besides, a simple but effective offset module is introduced to better achieve sub-pixel prediction accuracy. Extensive experiments on different benchmarks, including DTU, Tanks and Temples and BlendedMVS, show that the proposed method with the adaptive Wasserstein loss and the offset module achieves state-of-the-art performance.


title: DLoRA: Distributed Parameter-Efficient Fine-Tuning Solution for Large Language Model

abstract: To enhance the performance of large language models (LLM) on downstream tasks, one solution is to fine-tune certain LLM parameters and make it better align with the characteristics of the training dataset. This process is commonly known as parameter-efficient fine-tuning (PEFT). Due to the scale of LLM, PEFT operations are usually executed in the public environment (e.g., cloud server). This necessitates the sharing of sensitive user data across public environments, thereby raising potential privacy concerns. To tackle these challenges, we propose a distributed PEFT framework called DLoRA. DLoRA enables scalable PEFT operations to be performed collaboratively between the cloud and user devices. Coupled with the proposed Kill and Revive algorithm, the evaluation results demonstrate that DLoRA can significantly reduce the computation and communication workload over the user devices while achieving superior accuracy and privacy protection.


title: Progressive Alignment with VLM-LLM Feature to Augment Defect Classification for the ASE Dataset

abstract: Traditional defect classification approaches are facing with two barriers. (1) Insufficient training data and unstable data quality. Collecting sufficient defective sample is expensive and time-costing, consequently leading to dataset variance. It introduces the difficulty on recognition and learning. (2) Over-dependence on visual modality. When the image pattern and texture is monotonic for all defect classes in a given dataset, the performance of conventional AOI system cannot be guaranteed. In scenarios where image quality is compromised due to mechanical failures or when defect information is inherently difficult to discern, the performance of deep models cannot be guaranteed. A main question is, "how to solve those two problems when they occur at the same time?" The feasible strategy is to explore another feature within dataset and combine an eminent vision-language model (VLM) and Large-Language model (LLM) with their astonishing zero-shot capability. In this work, we propose the special ASE dataset, including rich data description recorded on image, for defect classification, but the defect feature is uneasy to learn directly. Secondly, We present the prompting for VLM-LLM against defect classification with the proposed ASE dataset to activate extra-modality feature from images to enhance performance. Then, We design the novel progressive feature alignment (PFA) block to refine image-text feature to alleviate the difficulty of alignment under few-shot scenario. Finally, the proposed Cross-modality attention fusion (CMAF) module can effectively fuse different modality feature. Experiment results have demonstrated our method's effectiveness over several defect classification methods for the ASE dataset.


title: Predicting the Geothermal Gradient in Colombia: a Machine Learning Approach

abstract: Accurate determination of the geothermal gradient is critical for assessing the geothermal energy potential of a given region. Of particular interest is the case of Colombia, a country with abundant geothermal resources. A history of active oil and gas exploration and production has left drilled boreholes in different geological settings, providing direct measurements of the geothermal gradient. Unfortunately, large regions of the country where geothermal resources might exist lack such measurements. Indirect geophysical measurements are costly and difficult to perform at regional scales. Computational thermal models could be constructed, but they require very detailed knowledge of the underlying geology and uniform sampling of subsurface temperatures to be well-constrained. We present an alternative approach that leverages recent advances in supervised machine learning and available direct measurements to predict the geothermal gradient in regions where only global-scale geophysical datasets and course geological knowledge are available. We find that a Gradient Boosted Regression Tree algorithm yields optimal predictions and extensively validate the trained model. We show that predictions of our model are within 12% accuracy and that independent measurements performed by other authors agree well with our model. Finnally, we present a geothermal gradient map for Colombia that highlights regions where futher exploration and data collection should be performed.


title: Convergence analysis of controlled particle systems arising in deep learning: from finite to infinite sample size

abstract: This paper deals with a class of neural SDEs and studies the limiting behavior of the associated sampled optimal control problems as the sample size grows to infinity. The neural SDEs with N samples can be linked to the N-particle systems with centralized control. We analyze the Hamilton--Jacobi--Bellman equation corresponding to the N-particle system and establish regularity results which are uniform in N. The uniform regularity estimates are obtained by the stochastic maximum principle and the analysis of a backward stochastic Riccati equation. Using these uniform regularity results, we show the convergence of the minima of objective functionals and optimal parameters of the neural SDEs as the sample size N tends to infinity. The limiting objects can be identified with suitable functions defined on the Wasserstein space of Borel probability measures. Furthermore, quantitative algebraic convergence rates are also obtained.


title: A user's guide to Beilinson-Kato's zeta elements

abstract: In his ground-breaking work, K. Kato constructed the Euler system of Beilinson--Kato's zeta elements and proved spectacular results on the Iwasawa main conjecture for elliptic curves and the classical and $p$-adic Birch and Swinnerton-Dyer conjectures by using these elements. The goal of this expository lecture note is to explain how Kato's Euler systems fit into the framework of the arithmetic of elliptic curves and their Iwasawa theory, and we hope that this approach eventually helps the reader to read Kato's original paper more easily and with less pain. It is written for the proceedings of the program "Elliptic curves and the special values of $L$-functions (ONLINE)" in ICTS in August 2021.


title: LGSDF: Continual Global Learning of Signed Distance Fields Aided by Local Updating

abstract: Implicit reconstruction of ESDF (Euclidean Signed Distance Field) involves training a neural network to regress the signed distance from any point to the nearest obstacle, which has the advantages of lightweight storage and continuous querying. However, existing algorithms usually rely on conflicting raw observations as training data, resulting in poor map performance. In this paper, we propose LGSDF, an ESDF continual Global learning algorithm aided by Local updating. At the front end, axis-aligned grids are dynamically updated by pre-processed sensor observations, where incremental fusion alleviates estimation error caused by limited viewing directions. At the back end, a randomly initialized implicit ESDF neural network performs continual self-supervised learning guided by these grids to generate smooth and continuous maps. The results on multiple scenes show that LGSDF can construct more accurate ESDF maps and meshes compared with SOTA (State Of The Art) explicit and implicit mapping algorithms. The source code of LGSDF is publicly available at https://github.com/BIT-DYN/LGSDF.


title: Have You Merged My Model? On The Robustness of Large Language Model IP Protection Methods Against Model Merging

abstract: Model merging is a promising lightweight model empowerment technique that does not rely on expensive computing devices (e.g., GPUs) or require the collection of specific training data. Instead, it involves editing different upstream model parameters to absorb their downstream task capabilities. However, uncertified model merging can infringe upon the Intellectual Property (IP) rights of the original upstream models. In this paper, we conduct the first study on the robustness of IP protection methods in model merging scenarios. We investigate two state-of-the-art IP protection techniques: Quantization Watermarking and Instructional Fingerprint, along with various advanced model merging technologies, such as Task Arithmetic, TIES-MERGING, and so on. Experimental results indicate that current Large Language Model (LLM) watermarking techniques cannot survive in the merged models, whereas model fingerprinting techniques can. Our research aims to highlight that model merging should be an indispensable consideration in the robustness assessment of model IP protection techniques, thereby promoting the healthy development of the open-source LLM community.


title: Measurement of the $CP$ violating phase $\phi_s$ and $\phi_s^{sq\bar{q}}$ at LHCb

abstract: Precise measurements of the $B_s^0 - \overline{B}_s^0$ mixing parameters provide a powerful test of the Standard Model, offering potential hints to new physics. The LHCb collaboration has performed updated measurements of the $CP$-violating phases $\phi_s^{c\bar{c}s}$ and $\phi_s^{s\bar{s}s}$, which supersede previous results. Also, an alternative approach to determine $\Delta \Gamma_s$ is presented, bringing a new tool that may help to resolve the tension observed between measurements made in $B_s^0 \to J/\psi \phi$ by LHC experiments.


title: Unramified Iwasawa module of $\mathbb{Z}_2$-extension of certain quadratic fields with a bounded quotient

abstract: We consider an infinite family of real quadratic fields $k$ where the discriminant has three distinct odd prime factors, and the prime 2 splits. We show that the unramified Iwasawa module $X(k_{\infty})$ associated with the $\mathbb{Z}_2$-extension of $k$ has a bounded quotient. Thus, we also verify Greenberg's conjecture on the vanishing of Iwasawa invariants for such fields and obtain a finer structure for $X(k_{\infty})$.


title: Graph-based Untrained Neural Network Detector for OTFS Systems

abstract: Inter-carrier interference (ICI) caused by mobile reflectors significantly degrades the conventional orthogonal frequency division multiplexing (OFDM) performance in high-mobility environments. The orthogonal time frequency space (OTFS) modulation system effectively represents ICI in the delay-Doppler domain, thus significantly outperforming OFDM. Existing iterative and neural network (NN) based OTFS detectors suffer from high complex matrix operations and performance degradation in untrained environments, where the real wireless channel does not match the one used in the training, which often happens in real wireless networks. In this paper, we propose to embed the prior knowledge of interference extracted from the estimated channel state information (CSI) as a directed graph into a decoder untrained neural network (DUNN), namely graph-based DUNN (GDUNN). We then combine it with Bayesian parallel interference cancellation (BPIC) for OTFS symbol detection, resulting in GDUNN-BPIC. Simulation results show that the proposed GDUNN-BPIC outperforms state-of-the-art OTFS detectors under imperfect CSI.


title: ATFNet: Adaptive Time-Frequency Ensembled Network for Long-term Time Series Forecasting

abstract: The intricate nature of time series data analysis benefits greatly from the distinct advantages offered by time and frequency domain representations. While the time domain is superior in representing local dependencies, particularly in non-periodic series, the frequency domain excels in capturing global dependencies, making it ideal for series with evident periodic patterns. To capitalize on both of these strengths, we propose ATFNet, an innovative framework that combines a time domain module and a frequency domain module to concurrently capture local and global dependencies in time series data. Specifically, we introduce Dominant Harmonic Series Energy Weighting, a novel mechanism for dynamically adjusting the weights between the two modules based on the periodicity of the input time series. In the frequency domain module, we enhance the traditional Discrete Fourier Transform (DFT) with our Extended DFT, designed to address the challenge of discrete frequency misalignment. Additionally, our Complex-valued Spectrum Attention mechanism offers a novel approach to discern the intricate relationships between different frequency combinations. Extensive experiments across multiple real-world datasets demonstrate that our ATFNet framework outperforms current state-of-the-art methods in long-term time series forecasting.


title: Foundations for operator algebraic tricategories

abstract: An operator algebraic tricategory is a higher categorical analogue of an operator algebra. For algebraic tricategories, Gordon, Power, and Street proved that every algebraic tricategory is equivalent to a Gray-category, a result later refined by Gurski. We adapt this result to the context of functional analysis, showing that every operator algebraic tricategory is equivalent to an operator Gray-category. We then categorify the Gelfand-Naimark theorem for operator algebras, inductively proving that every (small) operator algebraic tricategory is equivalent to a concrete operator Gray-category. We also provide several examples of interest for operator algebraic tricategories.


title: Conjugacy class fusion from four maximal subgroups of the Monster

abstract: We determine the conjugacy class fusion from certain maximal subgroups of the Monster to the Monster, to justify the addition of these data to the Character Table Library in the computational algebra system GAP. The maximal subgroups in question are $(\text{PSL}_2(11) {\times} \text{PSL}_2(11)){:}4$, $11^2{:}(5 {\times} 2\text{A}_5)$, $7^2{:}\text{SL}_2(7)$, and $\text{PSL}_2(19){:}2$. Our proofs are supported by reproducible calculations carried out using the Python package mmgroup, a computational construction of the Monster recently developed by Seysen.


title: Fractional type operators on the Heisenberg group

abstract: Let $\rho(\cdot)$ be the Koranyi norm on the Heisenberg group $\mathbb{H}^{n} \equiv (\mathbb{R}^{2n} \times \mathbb{R}, \, \cdot \, )$ defined by \[ \rho(x,t) = \left( |x|^{4} + 16 t^{2} \right)^{1/4}, \,\,\,\, (x,t) \in \mathbb{H}^{n}. \] For $0 \leq \alpha < Q:=2n+2$, $m \in \mathbb{N} \cap \left(1 - \frac{\alpha}{Q}, \infty \right)$, and $m$ positive constants $\alpha_1, ..., \alpha_m$ such that $\alpha_1 + \cdot \cdot \cdot + \alpha_m = Q - \alpha$, we consider the following generalization of the Riesz potential on $\mathbb{H}^{n}$ \[ T_{\alpha, \, m}f(x,t) = \int_{\mathbb{H}^{n}} f(y,s) \prod_{j=1}^{m} \rho\left((A_j y, r_j^{-2} s)^{-1} \cdot ( x, t)\right)^{-\alpha_j} \, dy \, ds, \] where, in the case $0 < \alpha < Q$, the $A_j$'s are matrices belonging to $Sp (2n, \mathbb{R}) \cap SO(2n)$ and $r_j = 1$ for every $j=1, ..., m$; for $\alpha = 0$, we consider $A_j = r_j^{-1} \, I_{2n \times 2n}$ for every $j=1, ..., m$, where the $r_j$'s are positive constants such that $r_{i}^{2} - r_{j}^{2} \neq 0$ if $i \neq j$. In this note we study the behavior of these operators on variable Hardy spaces in $\mathbb{H}^{n}$.


title: HSViT: Horizontally Scalable Vision Transformer

abstract: While the Vision Transformer (ViT) architecture gains prominence in computer vision and attracts significant attention from multimedia communities, its deficiency in prior knowledge (inductive bias) regarding shift, scale, and rotational invariance necessitates pre-training on large-scale datasets. Furthermore, the growing layers and parameters in both ViT and convolutional neural networks (CNNs) impede their applicability to mobile multimedia services, primarily owing to the constrained computational resources on edge devices. To mitigate the aforementioned challenges, this paper introduces a novel horizontally scalable vision transformer (HSViT). Specifically, a novel image-level feature embedding allows ViT to better leverage the inductive bias inherent in the convolutional layers. Based on this, an innovative horizontally scalable architecture is designed, which reduces the number of layers and parameters of the models while facilitating collaborative training and inference of ViT models across multiple nodes. The experimental results depict that, without pre-training on large-scale datasets, HSViT achieves up to 10% higher top-1 accuracy than state-of-the-art schemes, ascertaining its superior preservation of inductive bias. The code is available at https://github.com/xuchenhao001/HSViT.


title: The geometry of high-dimensional phase diagrams: II. The duality between closed and open chemical systems

abstract: Modern materials are often synthesized or operated in complex chemical environments, where there can be numerous elemental species, competing phases, and reaction pathways. When analyzing reactions using the Gibbs free energy, which has a natural variable of composition, it is often cumbersome to solve for the equilibrium states of a complicated heterogeneous mixture of phases. However, if one is interested only in the stability of a single target material, it may be easier to reframe the boundary conditions around only the target material-of-interest, with boundary conditions open to chemical exchange with an external reservoir. The corresponding phase diagram would thus have a chemical potential axis for the open volatile species, rather than a composition axis. Here we discuss how to derive, compute, and interpret phase diagrams with chemical potential axes, which are dual to the more common composition phase diagram. In our ambition to construct high-dimensional phase diagrams featuring any thermodynamic variable on its axes, here we examine the duality between extensive and intensive conjugate variables in equilibrium thermodynamics. This duality manifests from the distinction between closed and open boundary conditions of a thermodynamic system, to the relationship between the Internal Energy and its Legendre transformations, to the point-line duality in calculating convex hulls versus half-space intersections. Here we focus on the duality relationships of chemical work, with extensive composition variables, N, and intensive chemical potentials, {\mu}. In particular, we explore mixed composition-chemical potential diagrams for oxynitride synthesis, lithium-ion cathode stability, and oxidation of high-entropy alloys. We further illustrate how chemical potential diagrams reveal the driving forces for non-equilibrium growth and dissolution kinetics.


title: Fair Lotteries for Participatory Budgeting

abstract: In pursuit of participatory budgeting (PB) outcomes with broader fairness guarantees, we initiate the study of lotteries over discrete PB outcomes. As the projects have heterogeneous costs, the amount spent may not be equal ex ante and ex post. To address this, we develop a technique to bound the amount by which the ex-post spend differs from the ex-ante spend -- the property is termed budget balanced up to one project (BB1). With respect to fairness, we take a best-of-both-worlds perspective, seeking outcomes that are both ex-ante and ex-post fair. Towards this goal, we initiate a study of ex-ante fairness properties in PB, including Individual Fair Share (IFS), Unanimous Fair Share (UFS) and their stronger variants, as well as Group Fair Share (GFS). We show several incompatibility results between these ex-ante fairness notions and existing ex-post concepts based on justified representation. One of our main contributions is a randomized algorithm which simultaneously satisfies ex-ante Strong UFS, ex-post full justified representation (FJR) and ex-post BB1 for PB with binary utilities.


title: Decision Transformer for Wireless Communications: A New Paradigm of Resource Management

abstract: As the next generation of mobile systems evolves, artificial intelligence (AI) is expected to deeply integrate with wireless communications for resource management in variable environments. In particular, deep reinforcement learning (DRL) is an important tool for addressing stochastic optimization issues of resource allocation. However, DRL has to start each new training process from the beginning once the state and action spaces change, causing low sample efficiency and poor generalization ability. Moreover, each DRL training process may take a large number of epochs to converge, which is unacceptable for time-sensitive scenarios. In this paper, we adopt an alternative AI technology, namely, the Decision Transformer (DT), and propose a DT-based adaptive decision architecture for wireless resource management. This architecture innovates through constructing pre-trained models in the cloud and then fine-tuning personalized models at the edges. By leveraging the power of DT models learned over extensive datasets, the proposed architecture is expected to achieve rapid convergence with many fewer training epochs and higher performance in a new context, e.g., similar tasks with different state and action spaces, compared with DRL. We then design DT frameworks for two typical communication scenarios: Intelligent reflecting surfaces-aided communications and unmanned aerial vehicle-aided edge computing. Simulations demonstrate that the proposed DT frameworks achieve over $3$-$6$ times speedup in convergence and better performance relative to the classic DRL method, namely, proximal policy optimization.


title: Quasicrystal bulk and surface energies from density functional theory

abstract: Are quasicrystals stable or metastable? Density functional theory (DFT) is often used to evaluate thermodynamic stability, but quasicrystals are long-range aperiodic and their energies cannot be calculated using conventional ab initio methods. Here, we perform first-principles calculations on quasicrystal nanoparticles of increasing sizes, from which we can directly extrapolate their bulk and surface energies. Using this technique, we determine with high confidence that the icosahedral quasicrystals ScZn7.33 and YbCd5.7 are ground-state phases--revealing that translational symmetry is not a necessary condition for the T = 0 K stability of inorganic solids. Although we find the ScZn7.33 quasicrystal to be thermodynamically stable, we show on a mixed thermodynamic and kinetic phase diagram that its solidification from the melt is nucleation-limited, which illustrates why even stable materials may be kinetically challenging to grow. Our techniques here broadly open the door to first-principles investigations into the structure-bonding-stability relationships of aperiodic materials.


title: The geometry of high-dimensional phase diagrams: III. Engineering relative stability in four dimensions

abstract: Designing thermodynamic conditions to improve (or reduce) the stability of a target material is a key task in materials engineering. For example, during materials synthesis one aims to enhance the stability of a target phase relative to its precursors or competing byproduct phases. If an undesired phase forms in experiment, one aims to destabilize the undesired phase by dissolution or corrosion. When multiple thermodynamic knobs are available to engineer relative stability, it can be difficult to navigate the corresponding high-dimensional phase diagram to identify optimal pathways to promote or destabilize a target phase. We propose that instead of mapping the absolute phase boundaries of a target material, we can invoke a generalized Clausius-Clapeyron relation, which provides a 'compass' to point out which directions on a high-dimensional phase diagram are best to stabilize or destabilize a target phase. Phase boundaries on high-dimensional phase diagrams are also high-dimensional objects, and can represent phase coexistence between numerous phases simultaneously. On a 2D temperature-pressure phase diagram, phase boundaries are 1D lines separating two phases, with a slope given by the Clausius-Clapeyron relation, dP/dT = {\Delta}S/{\Delta}V. Here, we derive a parametric form of the Clausius-Clapeyron relation that readily scales to high-dimensional phase boundaries. The gradient of a phase boundary guides us on how to increase or decrease the relative stability of a target compound, meaning this generalized Clausius-Clapeyron relation enables us to engineer relative stability with respect to multiple thermodynamic conditions simultaneously. Using this approach, we analyze the acid stability of manganese oxide catalysts on a 4-dimensional Pourbaix diagram with axes of pH, redox potential, nanoparticle size, and aqueous [K+] ion concentration.


title: Boundary shape reconstruction with Robin condition: existence result, stability analysis, and inversion via multiple measurements

abstract: This study revisits the problem of identifying the unknown interior Robin boundary of a connected domain using Cauchy data from the exterior region of a harmonic function. It investigates two shape optimization reformulations employing least-squares boundary-data-tracking cost functionals. Firstly, it rigorously addresses the existence of optimal shape solutions, thus filling a gap in the literature. The argumentation utilized in the proof strategy is contingent upon the specific formulation under consideration. Secondly, it demonstrates the ill-posed nature of the two shape optimization formulations by establishing the compactness of the Riesz operator associated with the quadratic shape Hessian corresponding to each cost functional. Lastly, the study employs multiple sets of Cauchy data to address the difficulty of detecting concavities in the unknown boundary. Numerical experiments in two and three dimensions illustrate the numerical procedure relying on Sobolev gradients proposed herein.


title: MeSA-DRL: Memory-Enhanced Deep Reinforcement Learning for Advanced Socially Aware Robot Navigation in Crowded Environments

abstract: Autonomous navigation capabilities play a critical role in service robots operating in environments where human interactions are pivotal, due to the dynamic and unpredictable nature of these environments. However, the variability in human behavior presents a substantial challenge for robots in predicting and anticipating movements, particularly in crowded scenarios. To address this issue, a memory-enabled deep reinforcement learning framework is proposed for autonomous robot navigation in diverse pedestrian scenarios. The proposed framework leverages long-term memory to retain essential information about the surroundings and model sequential dependencies effectively. The importance of human-robot interactions is also encoded to assign higher attention to these interactions. A global planning mechanism is incorporated into the memory-enabled architecture. Additionally, a multi-term reward system is designed to prioritize and encourage long-sighted robot behaviors by incorporating dynamic warning zones. Simultaneously, it promotes smooth trajectories and minimizes the time taken to reach the robot's desired goal. Extensive simulation experiments show that the suggested approach outperforms representative state-of-the-art methods, showcasing its ability to a navigation efficiency and safety in real-world scenarios.


title: Effect of collective spin excitation on electronic transport in topological spin texture

abstract: We develop an efficient real-time simulation method for the spin-charge coupled system in the velocity gauge. This method enables us to compute the real-time simulation for the two-dimensional system with the complex spin texture. We focus on the effect of the collective excitation of the localized spins on the electronic transport properties of the non-trivial topological state in real space. To investigate this effect, we calculate the linear optical conductivity by calculating the real-time evolution of the Kondo lattice model on the triangular lattice, which hosts an all-in/all-out magnetic structure. In the linear conductivity spectra, we observe multiple peaks below the bandgap regime, attributed to the resonant contributions of collective modes similar to the skyrmionic system, alongside broadband modifications resulting from off-resonant spin dynamics. The result shows that the collective excitation, similar to the skyrmionic system, influences the optical response of the electron systems based on symmetry analysis. We elucidate the interference between the contributions from the different spin excitations to the optical conductivity in the multiple spin texture, pointing out the mode-dependent electrical activity. We show the complex interplay between the complex spin texture and the itinerant electrons in the two-dimensional spin-charge coupled system.


title: A secure and private ensemble matcher using multi-vault obfuscated templates

abstract: Given the irrevocability of biometric samples and mounting privacy concerns, biometric template security and secure matching are among the essential features of any well-designed modern biometric system. In this paper, we propose an obfuscation method that hides the biometric template information with just enough chaff. The main idea is to reduce the number of chaff points to a practical level by creating n sub-templates from the original template and hiding each sub-template with m chaff points. During verification, s closest vectors to the biometric query are retrieved from each vault and then combined to generate hash values that are compared with the stored hash value. We demonstrate the effectiveness of synthetic facial images, generated by a Generative Adversarial Network (GAN), as ``random chaff points'' within a secure-vault authorization system. This approach safeguards user identities during training and deployment. We tested our protocol using the AT&T, GT, and LFW face datasets, with the ROC areas under the curve being 0.99, 0.99, and 0.90, respectively. These numbers were close to those of the unprotected templates, showing that our method does not adversely affect accuracy.


title: SoundingActions: Learning How Actions Sound from Narrated Egocentric Videos

abstract: We propose a novel self-supervised embedding to learn how actions sound from narrated in-the-wild egocentric videos. Whereas existing methods rely on curated data with known audio-visual correspondence, our multimodal contrastive-consensus coding (MC3) embedding reinforces the associations between audio, language, and vision when all modality pairs agree, while diminishing those associations when any one pair does not. We show our approach can successfully discover how the long tail of human actions sound from egocentric video, outperforming an array of recent multimodal embedding techniques on two datasets (Ego4D and EPIC-Sounds) and multiple cross-modal tasks.


title: iVPT: Improving Task-relevant Information Sharing in Visual Prompt Tuning by Cross-layer Dynamic Connection

abstract: Recent progress has shown great potential of visual prompt tuning (VPT) when adapting pre-trained vision transformers to various downstream tasks. However, most existing solutions independently optimize prompts at each layer, thereby neglecting the usage of task-relevant information encoded in prompt tokens across layers. Additionally, existing prompt structures are prone to interference from task-irrelevant noise in input images, which can do harm to the sharing of task-relevant information. In this paper, we propose a novel VPT approach, \textbf{iVPT}. It innovatively incorporates a cross-layer dynamic connection (CDC) for input prompt tokens from adjacent layers, enabling effective sharing of task-relevant information. Furthermore, we design a dynamic aggregation (DA) module that facilitates selective sharing of information between layers. The combination of CDC and DA enhances the flexibility of the attention process within the VPT framework. Building upon these foundations, iVPT introduces an attentive reinforcement (AR) mechanism, by automatically identifying salient image tokens, which are further enhanced by prompt tokens in an additive manner. Extensive experiments on 24 image classification and semantic segmentation benchmarks clearly demonstrate the advantage of the proposed iVPT, compared to the state-of-the-art counterparts.


title: Proximity-Induced Exchange Interaction: a New Pathway for Quantum Sensing using Spin Centers in Hexagonal Boron Nitride

abstract: Defects in hexagonal boron nitride (hBN), a two-dimensional van der Waals material, have raised wide range interest for its potential in various quantum applications. Due to hBN's 2D nature, spin center in hBN can be engineered in close proximity to target material, providing advantages over their 3D counterparts, such as nitrogen-vacancy (NV) center in diamond. Here we propose a novel quantum sensing protocol driven by exchange interaction between spin center in hBN and the underlying magnetic substrate induced by magnetic proximity effect. By first-principle calculation, we demonstrate the induced exchange interaction dominates over dipole-dipole interaction by orders of magnitude when in proximity. The interaction remains antiferromagnetic across all stacking configuration between the spin center in hBN and the target van der Waals magnets. Additionally, we explored the scaling behavior of the exchange field as a function of the spatial separation between the spin center and the targets.


title: Maximally Forward-Looking Core Inflation

abstract: Timely monetary policy decision-making requires timely core inflation measures. We create a new core inflation series that is explicitly designed to succeed at that goal. Precisely, we introduce the Assemblage Regression, a generalized nonnegative ridge regression problem that optimizes the price index's subcomponent weights such that the aggregate is maximally predictive of future headline inflation. Ordering subcomponents according to their rank in each period switches the algorithm to be learning supervised trimmed inflation - or, put differently, the maximally forward-looking summary statistic of the realized price changes distribution. In an extensive out-of-sample forecasting experiment for the US and the euro area, we find substantial improvements for signaling medium-term inflation developments in both the pre- and post-Covid years. Those coming from the supervised trimmed version are particularly striking, and are attributable to a highly asymmetric trimming which contrasts with conventional indicators. We also find that this metric was indicating first upward pressures on inflation as early as mid-2020 and quickly captured the turning point in 2022. We also consider extensions, like assembling inflation from geographical regions, trimmed temporal aggregation, and building core measures specialized for either upside or downside inflation risks.


title: Bidirectional Long-Range Parser for Sequential Data Understanding

abstract: The transformer is a powerful data modelling framework responsible for remarkable performance on a wide range of tasks. However, they are limited in terms of scalability as it is suboptimal and inefficient to process long-sequence data. To this purpose we introduce BLRP (Bidirectional Long-Range Parser), a novel and versatile attention mechanism designed to increase performance and efficiency on long-sequence tasks. It leverages short and long range heuristics in the form of a local sliding window approach combined with a global bidirectional latent space synthesis technique. We show the benefits and versatility of our approach on vision and language domains by demonstrating competitive results against state-of-the-art methods on the Long-Range-Arena and CIFAR benchmarks together with ablations demonstrating the computational efficiency.


title: Multi-level Graph Subspace Contrastive Learning for Hyperspectral Image Clustering

abstract: Hyperspectral image (HSI) clustering is a challenging task due to its high complexity. Despite subspace clustering shows impressive performance for HSI, traditional methods tend to ignore the global-local interaction in HSI data. In this study, we proposed a multi-level graph subspace contrastive learning (MLGSC) for HSI clustering. The model is divided into the following main parts. Graph convolution subspace construction: utilizing spectral and texture feautures to construct two graph convolution views. Local-global graph representation: local graph representations were obtained by step-by-step convolutions and a more representative global graph representation was obtained using an attention-based pooling strategy. Multi-level graph subspace contrastive learning: multi-level contrastive learning was conducted to obtain local-global joint graph representations, to improve the consistency of the positive samples between views, and to obtain more robust graph embeddings. Specifically, graph-level contrastive learning is used to better learn global representations of HSI data. Node-level intra-view and inter-view contrastive learning is designed to learn joint representations of local regions of HSI. The proposed model is evaluated on four popular HSI datasets: Indian Pines, Pavia University, Houston, and Xu Zhou. The overall accuracies are 97.75%, 99.96%, 92.28%, and 95.73%, which significantly outperforms the current state-of-the-art clustering methods.


title: DiffCJK: Conditional Diffusion Model for High-Quality and Wide-coverage CJK Character Generation

abstract: Chinese, Japanese, and Korean (CJK), with a vast number of native speakers, have profound influence on society and culture. The typesetting of CJK languages carries a wide range of requirements due to the complexity of their scripts and unique literary traditions. A critical aspect of this typesetting process is that CJK fonts need to provide a set of consistent-looking glyphs for approximately one hundred thousand characters. However, creating such a font is inherently labor-intensive and expensive, which significantly hampers the development of new CJK fonts for typesetting, historical, aesthetic, or artistic purposes. To bridge this gap, we are motivated by recent advancements in diffusion-based generative models and propose a novel diffusion method for generating glyphs in a targeted style from a single conditioned, standard glyph form. Our experiments show that our method is capable of generating fonts of both printed and hand-written styles, the latter of which presents a greater challenge. Moreover, our approach shows remarkable zero-shot generalization capabilities for non-CJK but Chinese-inspired scripts. We also show our method facilitates smooth style interpolation and generates bitmap images suitable for vectorization, which is crucial in the font creation process. In summary, our proposed method opens the door to high-quality, generative model-assisted font creation for CJK characters, for both typesetting and artistic endeavors.


title: Evaluation of an LLM in Identifying Logical Fallacies: A Call for Rigor When Adopting LLMs in HCI Research

abstract: There is increasing interest in the adoption of LLMs in HCI research. However, LLMs may often be regarded as a panacea because of their powerful capabilities with an accompanying oversight on whether they are suitable for their intended tasks. We contend that LLMs should be adopted in a critical manner following rigorous evaluation. Accordingly, we present the evaluation of an LLM in identifying logical fallacies that will form part of a digital misinformation intervention. By comparing to a labeled dataset, we found that GPT-4 achieves an accuracy of 0.79, and for our intended use case that excludes invalid or unidentified instances, an accuracy of 0.90. This gives us the confidence to proceed with the application of the LLM while keeping in mind the areas where it still falls short. The paper describes our evaluation approach, results and reflections on the use of the LLM for our intended task.


title: Generalized measure Black-Scholes equation: Towards option self-similar pricing

abstract: In this work, we give a generalized formulation of the Black-Scholes model. The novelty resides in considering the Black-Scholes model to be valid on 'average', but such that the pointwise option price dynamics depends on a measure representing the investors' 'uncertainty'. We make use of the theory of non-symmetric Dirichlet forms and the abstract theory of partial differential equations to establish well posedness of the problem. A detailed numerical analysis is given in the case of self-similar measures.


title: Spatio-Temporal Attention and Gaussian Processes for Personalized Video Gaze Estimation

abstract: Gaze is an essential prompt for analyzing human behavior and attention. Recently, there has been an increasing interest in determining gaze direction from facial videos. However, video gaze estimation faces significant challenges, such as understanding the dynamic evolution of gaze in video sequences, dealing with static backgrounds, and adapting to variations in illumination. To address these challenges, we propose a simple and novel deep learning model designed to estimate gaze from videos, incorporating a specialized attention module. Our method employs a spatial attention mechanism that tracks spatial dynamics within videos. This technique enables accurate gaze direction prediction through a temporal sequence model, adeptly transforming spatial observations into temporal insights, thereby significantly improving gaze estimation accuracy. Additionally, our approach integrates Gaussian processes to include individual-specific traits, facilitating the personalization of our model with just a few labeled samples. Experimental results confirm the efficacy of the proposed approach, demonstrating its success in both within-dataset and cross-dataset settings. Specifically, our proposed approach achieves state-of-the-art performance on the Gaze360 dataset, improving by $2.5^\circ$ without personalization. Further, by personalizing the model with just three samples, we achieved an additional improvement of $0.8^\circ$. The code and pre-trained models are available at \url{https://github.com/jswati31/stage}.


title: On the Gonality type invariants and the slope of a fibered $3$-fold

abstract: The \textit{slope} of a fibered $3$-folds $f:X \to B$ is a relative numerical invariant defined by $\lambda(f) := K_{f}^{3}/\mathrm{deg}(f_{\ast}\omega_{f})$, where $K_{f}$ is the relative canonical divisor and $\omega_{f}$ is the relative dualizing sheaf. Establishing slope inequalities is a fundamental problem in the geography of fibered spaces. In this paper, we introduce a new invariant called the \textit{minimal covering degree} as a gonality-type invariant and study a lower bound of the slope increasing with the covering gonality and the minimal covering degree of the general fiber of $f$.


title: Network-Constrained Unit Commitment with Flexible Temporal Resolution

abstract: Modern network-constrained unit commitment (NCUC) bears a heavy computational burden due to the ever-growing model scale. This situation becomes more challenging when detailed operational characteristics, complicated constraints, and multiple objectives are considered. We propose a novel simplification method to determine the flexible temporal resolution for acceleration and near-optimal solutions. The flexible temporal resolution is determined by analyzing the impact on generators in each adaptive time period with awareness of congestion effects. Additionally, multiple improvements are employed on the existing NCUC model compatible with flexible temporal resolution to reduce the number of integer variables while preserving the original features. A case study using the IEEE 118-bus and the Polish 2736-bus systems verifies that the proposed method achieves substantial acceleration with low cost variation and high accuracy.


title: Multi-agent Long-term 3D Human Pose Forecasting via Interaction-aware Trajectory Conditioning

abstract: Human pose forecasting garners attention for its diverse applications. However, challenges in modeling the multi-modal nature of human motion and intricate interactions among agents persist, particularly with longer timescales and more agents. In this paper, we propose an interaction-aware trajectory-conditioned long-term multi-agent human pose forecasting model, utilizing a coarse-to-fine prediction approach: multi-modal global trajectories are initially forecasted, followed by respective local pose forecasts conditioned on each mode. In doing so, our Trajectory2Pose model introduces a graph-based agent-wise interaction module for a reciprocal forecast of local motion-conditioned global trajectory and trajectory-conditioned local pose. Our model effectively handles the multi-modality of human motion and the complexity of long-term multi-agent interactions, improving performance in complex environments. Furthermore, we address the lack of long-term (6s+) multi-agent (5+) datasets by constructing a new dataset from real-world images and 2D annotations, enabling a comprehensive evaluation of our proposed model. State-of-the-art prediction performance on both complex and simpler datasets confirms the generalized effectiveness of our method. The code is available at https://github.com/Jaewoo97/T2P.


title: Out-of-Distribution Data: An Acquaintance of Adversarial Examples -- A Survey

abstract: Deep neural networks (DNNs) deployed in real-world applications can encounter out-of-distribution (OOD) data and adversarial examples. These represent distinct forms of distributional shifts that can significantly impact DNNs' reliability and robustness. Traditionally, research has addressed OOD detection and adversarial robustness as separate challenges. This survey focuses on the intersection of these two areas, examining how the research community has investigated them together. Consequently, we identify two key research directions: robust OOD detection and unified robustness. Robust OOD detection aims to differentiate between in-distribution (ID) data and OOD data, even when they are adversarially manipulated to deceive the OOD detector. Unified robustness seeks a single approach to make DNNs robust against both adversarial attacks and OOD inputs. Accordingly, first, we establish a taxonomy based on the concept of distributional shifts. This framework clarifies how robust OOD detection and unified robustness relate to other research areas addressing distributional shifts, such as OOD detection, open set recognition, and anomaly detection. Subsequently, we review existing work on robust OOD detection and unified robustness. Finally, we highlight the limitations of the existing work and propose promising research directions that explore adversarial and OOD inputs within a unified framework.


title: StylizedGS: Controllable Stylization for 3D Gaussian Splatting

abstract: With the rapid development of XR, 3D generation and editing are becoming more and more important, among which, stylization is an important tool of 3D appearance editing. It can achieve consistent 3D artistic stylization given a single reference style image and thus is a user-friendly editing way. However, recent NeRF-based 3D stylization methods face efficiency issues that affect the actual user experience and the implicit nature limits its ability to transfer the geometric pattern styles. Additionally, the ability for artists to exert flexible control over stylized scenes is considered highly desirable, fostering an environment conducive to creative exploration. In this paper, we introduce StylizedGS, a 3D neural style transfer framework with adaptable control over perceptual factors based on 3D Gaussian Splatting (3DGS) representation. The 3DGS brings the benefits of high efficiency. We propose a GS filter to eliminate floaters in the reconstruction which affects the stylization effects before stylization. Then the nearest neighbor-based style loss is introduced to achieve stylization by fine-tuning the geometry and color parameters of 3DGS, while a depth preservation loss with other regularizations is proposed to prevent the tampering of geometry content. Moreover, facilitated by specially designed losses, StylizedGS enables users to control color, stylized scale and regions during the stylization to possess customized capabilities. Our method can attain high-quality stylization results characterized by faithful brushstrokes and geometric consistency with flexible controls. Extensive experiments across various scenes and styles demonstrate the effectiveness and efficiency of our method concerning both stylization quality and inference FPS.


title: LLM Reasoners: New Evaluation, Library, and Analysis of Step-by-Step Reasoning with Large Language Models

abstract: Generating accurate step-by-step reasoning is essential for Large Language Models (LLMs) to address complex problems and enhance robustness and interpretability. Despite the flux of research on developing advanced reasoning approaches, systematically analyzing the diverse LLMs and reasoning strategies in generating reasoning chains remains a significant challenge. The difficulties stem from the lack of two key elements: (1) an automatic method for evaluating the generated reasoning chains on different tasks, and (2) a unified formalism and implementation of the diverse reasoning approaches for systematic comparison. This paper aims to close the gap: (1) We introduce AutoRace for fully automated reasoning chain evaluation. Existing metrics rely on expensive human annotations or pre-defined LLM prompts not adaptable to different tasks. In contrast, AutoRace automatically creates detailed evaluation criteria tailored for each task, and uses GPT-4 for accurate evaluation following the criteria. (2) We develop LLM Reasoners, a library for standardized modular implementation of existing and new reasoning algorithms, under a unified formulation of the search, reward, and world model components. With the new evaluation and library, (3) we conduct extensive study of different reasoning approaches (e.g., CoT, ToT, RAP). The analysis reveals interesting findings about different factors contributing to reasoning, including the reward-guidance, breadth-vs-depth in search, world model, and prompt formats, etc.


title: Fractional Hardy inequalities and capacity density

abstract: We prove that a pointwise fractional Hardy inequality implies a fractional Hardy inequality, defined via a Gagliardo-type seminorm. The proof consists of two main parts. The first one is to characterize the pointwise fractional Hardy inequality in terms of a fractional capacity density condition. The second part is to show the deep open-endedness or self-improvement property of the fractional capacity density, which we accomplish in the setting of a complete geodesic space equipped with a doubling measure. These results are new already in the standard Euclidean setting.