title: Entropic Open-set Active Learning

abstract: Active Learning (AL) aims to enhance the performance of deep models by selecting the most informative samples for annotation from a pool of unlabeled data. Despite impressive performance in closed-set settings, most AL methods fail in real-world scenarios where the unlabeled data contains unknown categories. Recently, a few studies have attempted to tackle the AL problem for the open-set setting. However, these methods focus more on selecting known samples and do not efficiently utilize unknown samples obtained during AL rounds. In this work, we propose an Entropic Open-set AL (EOAL) framework which leverages both known and unknown distributions effectively to select informative samples during AL rounds. Specifically, our approach employs two different entropy scores. One measures the uncertainty of a sample with respect to the known-class distributions. The other measures the uncertainty of the sample with respect to the unknown-class distributions. By utilizing these two entropy scores we effectively separate the known and unknown samples from the unlabeled data resulting in better sampling. Through extensive experiments, we show that the proposed method outperforms existing state-of-the-art methods on CIFAR-10, CIFAR-100, and TinyImageNet datasets. Code is available at \url{https://github.com/bardisafa/EOAL}.


title: Equation of state at neutron-star densities and beyond from perturbative QCD

abstract: We explore the consequences of imposing robust thermodynamic constraints arising from perturbative Quantum Chromodynamics (QCD) when inferring the dense-matter equation-of-state (EOS). We find that the termination density, up to which the EOS modeling is performed in an inference setup, strongly affects the constraining power of the QCD input. This sensitivity in the constraining power arises from EOSs that have a specific form, with drastic softening immediately above the termination density followed by a strong stiffening. We also perform explicit modeling of the EOS down from perturbative-QCD densities to construct a new QCD likelihood function that incorporates additional perturbative-QCD calculations of the sound speed and is insensitive to the termination density, which we make publicly available.


title: Yang-Mills field from fuzzy sphere quantum Kaluza-Klein model

abstract: Using the framework of quantum Riemannian geometry, we show that gravity on the product of spacetime and a fuzzy sphere is equivalent under minimal assumptions to gravity on spacetime, an $su_2$-valued Yang-Mills field $A_{\mu i}$ and real-symmetric-matrix valued Liouville-sigma model field $h_{ij}$ for gravity on the fuzzy sphere. Moreover, a massless real scalar field on the product appears as a tower of scalar fields on spacetime, with one for each internal integer spin $l$ representation of $SU(2)$, minimally coupled to $A_{\mu i}$ and with mass depending on $l$ and the fuzzy sphere size. For discrete values of the deformation parameter, the fuzzy spheres can be reduced to matrix algebras $M_{2j+1}(C)$ for $j$ any non-negative half-integer, and in this case only integer spins $0\le l\le 2j$ appear in the multiplet. Thus, for $j=1$ a massless field on the product appears as a massless $SU(2)$ internal spin 0 field, a massive internal spin 1 field and a massive internal spin 2 field, in mass ratio $0,1,\sqrt{3}$ respectively, which we conjecture could arise in connection with an approximate $SU(2)$ flavour symmetry.


title: WellFactor: Patient Profiling using Integrative Embedding of Healthcare Data

abstract: In the rapidly evolving healthcare industry, platforms now have access to not only traditional medical records, but also diverse data sets encompassing various patient interactions, such as those from healthcare web portals. To address this rich diversity of data, we introduce WellFactor: a method that derives patient profiles by integrating information from these sources. Central to our approach is the utilization of constrained low-rank approximation. WellFactor is optimized to handle the sparsity that is often inherent in healthcare data. Moreover, by incorporating task-specific label information, our method refines the embedding results, offering a more informed perspective on patients. One important feature of WellFactor is its ability to compute embeddings for new, previously unobserved patient data instantaneously, eliminating the need to revisit the entire data set or recomputing the embedding. Comprehensive evaluations on real-world healthcare data demonstrate WellFactor's effectiveness. It produces better results compared to other existing methods in classification performance, yields meaningful clustering of patients, and delivers consistent results in patient similarity searches and predictions.


title: Adaptation using spatially distributed Gaussian Processes

abstract: We consider the accuracy of an approximate posterior distribution in nonparametric regression problems by combining posterior distributions computed on subsets of the data defined by the locations of the independent variables. We show that this approximate posterior retains the rate of recovery of the full data posterior distribution, where the rate of recovery adapts to the smoothness of the true regression function. As particular examples we consider Gaussian process priors based on integrated Brownian motion and the Mat\'ern kernel augmented with a prior on the length scale. Besides theoretical guarantees we present a numerical study of the methods both on synthetic and real world data. We also propose a new aggregation technique, which numerically outperforms previous approaches.


title: On the $p$-torsional rigidity of combinatorial graphs of finite measure

abstract: We study the $p$-\emph{torsion function} and the corresponding $p$-\emph{torsional rigidity} associated with $p$-Laplacians and, more generally, $p$-Schr\"odinger operators, for $1<p<\infty$, on possibly infinite combinatorial graphs of finite measure. We present sufficient criteria for the existence of a summable $p$-torsion function and we derive several upper and lower bounds for the $p$-torsional rigidity. Our methods are mostly based on novel surgery principles. As an application, we also find some new estimates on the bottom of the spectrum of the $p$-Laplacian with Dirichlet conditions, thus complementing some results recently obtained in: Jos\'e M. Maz\'on, Julian Toledo, Torsional rigidity in random walk spaces, in a more general setting. Finally, we prove a Kohler-Jobin inequality for combinatorial graphs.


title: DUSt3R: Geometric 3D Vision Made Easy

abstract: Multi-view stereo reconstruction (MVS) in the wild requires to first estimate the camera parameters e.g. intrinsic and extrinsic parameters. These are usually tedious and cumbersome to obtain, yet they are mandatory to triangulate corresponding pixels in 3D space, which is the core of all best performing MVS algorithms. In this work, we take an opposite stance and introduce DUSt3R, a radically novel paradigm for Dense and Unconstrained Stereo 3D Reconstruction of arbitrary image collections, i.e. operating without prior information about camera calibration nor viewpoint poses. We cast the pairwise reconstruction problem as a regression of pointmaps, relaxing the hard constraints of usual projective camera models. We show that this formulation smoothly unifies the monocular and binocular reconstruction cases. In the case where more than two images are provided, we further propose a simple yet effective global alignment strategy that expresses all pairwise pointmaps in a common reference frame. We base our network architecture on standard Transformer encoders and decoders, allowing us to leverage powerful pretrained models. Our formulation directly provides a 3D model of the scene as well as depth information, but interestingly, we can seamlessly recover from it, pixel matches, relative and absolute camera. Exhaustive experiments on all these tasks showcase that the proposed DUSt3R can unify various 3D vision tasks and set new SoTAs on monocular/multi-view depth estimation as well as relative pose estimation. In summary, DUSt3R makes many geometric 3D vision tasks easy.


title: Morphologies of Bright Complex Fast Radio Bursts with CHIME/FRB Voltage Data

abstract: We present the discovery of twelve thus far non-repeating fast radio burst (FRB) sources, detected by the Canadian Hydrogen Intensity Mapping Experiment (CHIME) telescope. These sources were selected from a database comprising of order $10^3$ CHIME/FRB full-array raw voltage data recordings, based on their exceptionally high brightness and complex morphology. Our study examines the time-frequency characteristics of these bursts, including drifting, microstructure, and periodicities. The events in this sample display a variety of unique drifting phenomenologies that deviate from the linear negative drifting phenomenon seen in many repeating FRBs, and motivate a possible new framework for classifying drifting archetypes. Additionally, we detect microstructure features of duration $\lesssim$ 50 $\mu s$ in seven events, with some as narrow as $\approx$ 7 $\mu s$. We find no evidence of significant periodicities. Furthermore, we report the polarization characteristics of seven events, including their polarization fractions and Faraday rotation measures (RMs). The observed $|\mathrm{RM}|$ values span a wide range of $17.24(2)$ - $328.06(2) \mathrm{~rad~m}^{-2}$, with linear polarization fractions between $0.340(1)$ - $0.946(3)$. The morphological properties of the bursts in our sample appear broadly consistent with predictions from both relativistic shock and magnetospheric models of FRB emission, as well as propagation through discrete ionized plasma structures. We address these models and discuss how they can be tested using our improved understanding of morphological archetypes.


title: Diffusion Reward: Learning Rewards via Conditional Video Diffusion

abstract: Learning rewards from expert videos offers an affordable and effective solution to specify the intended behaviors for reinforcement learning tasks. In this work, we propose Diffusion Reward, a novel framework that learns rewards from expert videos via conditional video diffusion models for solving complex visual RL problems. Our key insight is that lower generative diversity is observed when conditioned on expert trajectories. Diffusion Reward is accordingly formalized by the negative of conditional entropy that encourages productive exploration of expert-like behaviors. We show the efficacy of our method over 10 robotic manipulation tasks from MetaWorld and Adroit with visual input and sparse reward. Moreover, Diffusion Reward could even solve unseen tasks successfully and effectively, largely surpassing baseline methods. Project page and code: https://diffusion-reward.github.io/.


title: V*: Guided Visual Search as a Core Mechanism in Multimodal LLMs

abstract: When we look around and perform complex tasks, how we see and selectively process what we see is crucial. However, the lack of this visual search mechanism in current multimodal LLMs (MLLMs) hinders their ability to focus on important visual details, especially when handling high-resolution and visually crowded images. To address this, we introduce V*, an LLM-guided visual search mechanism that employs the world knowledge in LLMs for efficient visual querying. When combined with an MLLM, this mechanism enhances collaborative reasoning, contextual understanding, and precise targeting of specific visual elements. This integration results in a new MLLM meta-architecture, named Show, sEArch, and TelL (SEAL). We further create V*Bench, a benchmark specifically designed to evaluate MLLMs in their ability to process high-resolution images and focus on visual details. Our study highlights the necessity of incorporating visual search capabilities into multimodal systems. The code is available https://github.com/penghao-wu/vstar.


title: Fast kernel half-space depth for data with non-convex supports

abstract: Data depth is a statistical function that generalizes order and quantiles to the multivariate setting and beyond, with applications spanning over descriptive and visual statistics, anomaly detection, testing, etc. The celebrated halfspace depth exploits data geometry via an optimization program to deliver properties of invariances, robustness, and non-parametricity. Nevertheless, it implicitly assumes convex data supports and requires exponential computational cost. To tackle distribution's multimodality, we extend the halfspace depth in a Reproducing Kernel Hilbert Space (RKHS). We show that the obtained depth is intuitive and establish its consistency with provable concentration bounds that allow for homogeneity testing. The proposed depth can be computed using manifold gradient making faster than halfspace depth by several orders of magnitude. The performance of our depth is demonstrated through numerical simulations as well as applications such as anomaly detection on real data and homogeneity testing.


title: Sub-dimensional magnetic polarons in the one-hole doped SU(3) $t$-$J$ model

abstract: The physics of doped Mott insulators is at the heart of strongly correlated materials and is believed to constitute an essential ingredient for high-temperature superconductivity. In systems with higher SU(N) spin symmetries, even richer magnetic ground states appear at a filling of one particle per site compared to the case of SU(2) spins, but their fate upon doping remains largely unexplored. Here we address this question by studying a single hole in the SU(3) $t$-$J$ model, whose undoped ground state features long-range, diagonal spin stripes. By analyzing both ground state and dynamical properties utilizing the density matrix renormalization group, we establish the appearence of magnetic polarons consisting of chargons and flavor defects, whose dynamics is constrained to a single effective dimension along the ordered diagonal. We semi-analytically describe the system using geometric string theory, where paths of hole motion are the fundamental degrees of freedom. With recent advances in the realization and control of SU(N) Fermi-Hubbard models with ultracold atoms in optical lattices, our results can directly be observed in quantum gas microscopes with single-site resolution. Our work suggests the appearance of intricate ground states at finite doping constituted by emergent, coupled Luttinger liquids along diagonals, and is a first step towards exploring a wealth of physics in doped SU(N) Fermi-Hubbard models on various geometries.


title: Revisiting Foreground and Background Separation in Weakly-supervised Temporal Action Localization: A Clustering-based Approach

abstract: Weakly-supervised temporal action localization aims to localize action instances in videos with only video-level action labels. Existing methods mainly embrace a localization-by-classification pipeline that optimizes the snippet-level prediction with a video classification loss. However, this formulation suffers from the discrepancy between classification and detection, resulting in inaccurate separation of foreground and background (F\&B) snippets. To alleviate this problem, we propose to explore the underlying structure among the snippets by resorting to unsupervised snippet clustering, rather than heavily relying on the video classification loss. Specifically, we propose a novel clustering-based F\&B separation algorithm. It comprises two core components: a snippet clustering component that groups the snippets into multiple latent clusters and a cluster classification component that further classifies the cluster as foreground or background. As there are no ground-truth labels to train these two components, we introduce a unified self-labeling mechanism based on optimal transport to produce high-quality pseudo-labels that match several plausible prior distributions. This ensures that the cluster assignments of the snippets can be accurately associated with their F\&B labels, thereby boosting the F\&B separation. We evaluate our method on three benchmarks: THUMOS14, ActivityNet v1.2 and v1.3. Our method achieves promising performance on all three benchmarks while being significantly more lightweight than previous methods. Code is available at https://github.com/Qinying-Liu/CASE


title: Quasi-Probabilistic Readout Correction of Mid-Circuit Measurements for Adaptive Feedback via Measurement Randomized Compiling

abstract: Quantum measurements are a fundamental component of quantum computing. However, on modern-day quantum computers, measurements can be more error prone than quantum gates, and are susceptible to non-unital errors as well as non-local correlations due to measurement crosstalk. While readout errors can be mitigated in post-processing, it is inefficient in the number of qubits due to a combinatorially-large number of possible states that need to be characterized. In this work, we show that measurement errors can be tailored into a simple stochastic error model using randomized compiling, enabling the efficient mitigation of readout errors via quasi-probability distributions reconstructed from the measurement of a single preparation state in an exponentially large confusion matrix. We demonstrate the scalability and power of this approach by correcting readout errors without matrix inversion on a large number of different preparation states applied to a register of eight superconducting transmon qubits. Moreover, we show that this method can be extended to mid-circuit measurements used for active feedback via quasi-probabilistic error cancellation, and demonstrate the correction of measurement errors on an ancilla qubit used to detect and actively correct bit-flip errors on an entangled memory qubit. Our approach enables the correction of readout errors on large numbers of qubits, and offers a strategy for correcting readout errors in adaptive circuits in which the results of mid-circuit measurements are used to perform conditional operations on non-local qubits in real time.


title: HeadCraft: Modeling High-Detail Shape Variations for Animated 3DMMs

abstract: Current advances in human head modeling allow to generate plausible-looking 3D head models via neural representations. Nevertheless, constructing complete high-fidelity head models with explicitly controlled animation remains an issue. Furthermore, completing the head geometry based on a partial observation, e.g. coming from a depth sensor, while preserving details is often problematic for the existing methods. We introduce a generative model for detailed 3D head meshes on top of an articulated 3DMM which allows explicit animation and high-detail preservation at the same time. Our method is trained in two stages. First, we register a parametric head model with vertex displacements to each mesh of the recently introduced NPHM dataset of accurate 3D head scans. The estimated displacements are baked into a hand-crafted UV layout. Second, we train a StyleGAN model in order to generalize over the UV maps of displacements. The decomposition of the parametric model and high-quality vertex displacements allows us to animate the model and modify it semantically. We demonstrate the results of unconditional generation and fitting to the full or partial observation. The project page is available at https://seva100.github.io/headcraft.


title: Quantum Algorithms for the Pathwise Lasso

abstract: We present a novel quantum high-dimensional linear regression algorithm with an $\ell_1$-penalty based on the classical LARS (Least Angle Regression) pathwise algorithm. Similarly to available classical algorithms for Lasso, our quantum algorithm provides the full regularisation path as the penalty term varies, but quadratically faster per iteration under specific conditions. A quadratic speedup on the number of features $d$ is possible by using the quantum minimum-finding routine from D\"urr and Hoyer (arXiv'96) in order to obtain the joining time at each iteration. We then improve upon this simple quantum algorithm and obtain a quadratic speedup both in the number of features $d$ and the number of observations $n$ by using the approximate quantum minimum-finding routine from Chen and de Wolf (ICALP'23). As one of our main contributions, we construct a quantum unitary to approximately compute the joining times to be searched over by the approximate quantum minimum finding. Since the joining times are no longer exactly computed, it is no longer clear that the resulting approximate quantum algorithm obtains a good solution. As our second main contribution, we prove, via an approximate version of the KKT conditions and a duality gap, that the LARS algorithm (and thus our quantum algorithm) is robust to errors. This means that it still outputs a path that minimises the Lasso cost function up to a small error if the joining times are approximately computed. Moreover, we show that, when the observations are sampled from a Gaussian distribution, our quantum algorithm's complexity only depends polylogarithmically on $n$, exponentially better than the classical LARS algorithm, while keeping the quadratic improvement on $d$. Finally, we propose a dequantised algorithm that also retains the polylogarithmic dependence on $n$, albeit with the linear scaling on $d$ from the standard LARS algorithm.


title: Simple and general bounds on quantum random access codes

abstract: Random access codes are a type of communication task that is widely used in quantum information science. The optimal average success probability that can be achieved through classical strategies is known for any random access code. However, only a few cases are solved exactly for quantum random access codes. In this paper, we provide bounds for the fully general setting of n independent variables, each selected from a d-dimensional classical alphabet and encoded in a D-dimensional quantum system subject to an arbitrary quantum measurement. The bound recovers the exactly known special cases, and we demonstrate numerically that even though the bound is not tight overall, it can still yield a good approximation.


title: Rotationally invariant first passage percolation: Concentration and scaling relations

abstract: For rotationally invariant first passage percolation (FPP) on the plane, we use a multi-scale argument to prove stretched exponential concentration of the first passage times at the scale of the standard deviation. Our results are proved under hypotheses which can be verified for many standard rotationally invariant models of first passage percolation, e.g. Riemannian FPP, Voronoi FPP and the Howard-Newman model. This is the first such tight concentration result known for any model that is not exactly solvable. As a consequence, we prove a version of the so called KPZ relation between the passage time fluctuations and the transversal fluctuations of geodesics as well as up to constant upper and lower bounds for the non-random fluctuations in these models. Similar results have previously been known conditionally under unproven hypotheses, but our results are the first ones that apply to some specific FPP models. Our arguments are expected to be useful in proving a number of other estimates which were hitherto only known conditionally or for exactly solvable models.


title: Optical Quasi-periodic Oscillations in the TESS light curves of three blazars

abstract: We report the time series analysis of TESS light curves of three blazars, BL Lacertae, 1RXS J111741.0+254858, and 1RXS J004519.6+212735, obtained using a customized approach for extracting AGN light curves. We find tentative evidence for quasi-periodic oscillations (QPOs) in these light curves that range from 2 to 6 days. Two methods of analysis are used for assessing their significance: generalized Lomb-Scargle periodograms and weighted wavelet Z-transforms. The different approaches of these methods together ensure a robust measurement of the significance of the claimed periodicities. We can attribute the apparent QPOs to the kink instability model which postulates that the observed QPOs are related to the temporal growth of kinks in the magnetized relativistic jet. We confirm the application of this model to BL Lacertae and extend the kink instability model to the other two BL Lac objects.


title: Two-loop mixed QCD-electroweak amplitudes for $Z+$jet production at the LHC: bosonic corrections

abstract: We present a calculation of the bosonic contribution to the two-loop mixed QCD-electroweak scattering amplitudes for $Z$-boson production in association with one hard jet at hadron colliders. We employ a method to calculate amplitudes in the 't Hooft-Veltman scheme that reduces the amount of spurious non-physical information needed at intermediate stages of the computation, to keep the complexity of the calculation under control. We compute all the relevant Feynman integrals numerically using the Auxiliary Mass Flow method. We evaluate the two-loop scattering amplitudes on a two-dimensional grid in the rapidity and transverse momentum of the $Z$ boson, which has been designed to yield a reliable numerical sampling of the boosted-$Z$ region. This result provides an important building block for improving the theoretical modelling of a key background for monojet searches at the LHC.


title: Non-factorisable Contributions of Strong-Penguin Operators in $\Lambda_b \to \Lambda \ell^+\ell^-$ Decays

abstract: We investigate for the first time a certain class of non-factorisable contributions of the four-quark operators ${\cal O}_{3-6}$ in the weak effective Hamiltonian to the $\Lambda_b \to \Lambda \ell^+\ell^-$ decay amplitude. We focus on the case where a virtual photon is radiated from one of the light constituents of the $\Lambda_b$ baryon, in the kinematic situation of large hadronic recoil with an energetic $\Lambda$ baryon in the final state. The effect on the suitably defined ``non-local form factors'' is calculated using the light-cone sum rule approach for a correlator with an interpolating current for the light $\Lambda$ baryon. We find that this approach requires the introduction of new soft functions that generalise the standard light-cone distribution amplitudes (LCDAs) for the heavy $\Lambda_b$ baryon. We give a heuristic discussion of their properties and a model that relates them to the standard LCDAs. Within this framework, we provide numerical results for the size of the non-local form factors considered.


title: On a sufficient condition for explosion in CMJ branching processes and applications to recursive trees

abstract: We provide sufficient criteria for explosion in Crump-Mode-Jagers branching process, via the process producing an infinite path in finite time. As an application, we deduce a curious phase-transition in the infinite tree associated with a class of recursive tree models with fitness, showing that in one regime every node in the tree has infinite degree, whilst in another, the tree is locally finite, with a unique infinite path. The latter class encompasses many models studied in the literature, including the weighted random recursive tree, the preferential attachment tree with additive fitness, and the Bianconi-Barab\'asi model, or preferential attachment tree with multiplicative fitness.


title: Fundamental charges for dual-unitary circuits

abstract: Dual-unitary quantum circuits have recently attracted attention as an analytically tractable model of many-body quantum dynamics. Consisting of a 1+1D lattice of 2-qudit gates arranged in a 'brickwork' pattern, these models are defined by the constraint that each gate must remain unitary under swapping the roles of space and time. This dual-unitarity restricts the dynamics of local operators in these circuits: the support of any such operator must grow at the effective speed of light of the system, along one or both of the edges of a causal light cone set by the geometry of the circuit. Using this property, it is shown here that for 1+1D dual-unitary circuits the set of width-$w$ conserved densities (constructed from operators supported over $w$ consecutive sites) is in one-to-one correspondence with the set of width-$w$ solitons - operators which, up to a multiplicative phase, are simply spatially translated at the effective speed of light by the dual-unitary dynamics. A number of ways to construct these many-body solitons (explicitly in the case where the local Hilbert space dimension $d=2$) are then demonstrated: firstly, via a simple construction involving products of smaller, constituent solitons; and secondly, via a construction which cannot be understood as simply in terms of products of smaller solitons, but which does have a neat interpretation in terms of products of fermions under a Jordan-Wigner transformation. This provides partial progress towards a characterisation of the microscopic structure of complex many-body solitons (in dual-unitary circuits on qubits), whilst also establishing a link between fermionic models and dual-unitary circuits, advancing our understanding of what kinds of physics can be explored in this framework.


title: TagAlign: Improving Vision-Language Alignment with Multi-Tag Classification

abstract: The crux of learning vision-language models is to extract semantically aligned information from visual and linguistic data. Existing attempts usually face the problem of coarse alignment, e.g., the vision encoder struggles in localizing an attribute-specified object. In this work, we propose an embarrassingly simple approach to better align image and text features with no need of additional data formats other than image-text pairs. Concretely, given an image and its paired text, we manage to parse objects (e.g., cat) and attributes (e.g., black) from the description, which are highly likely to exist in the image. It is noteworthy that the parsing pipeline is fully automatic and thus enjoys good scalability. With these parsed semantics as supervision signals, we can complement the commonly used image-text contrastive loss with the multi-tag classification loss. Extensive experimental results on a broad suite of semantic segmentation datasets substantiate the average 5.2\% improvement of our framework over existing alternatives. Furthermore, the visualization results indicate that attribute supervision makes vision-language models accurately localize attribute-specified objects. Project page can be found at https://qinying-liu.github.io/Tag-Align.


title: DriveLM: Driving with Graph Visual Question Answering

abstract: We study how vision-language models (VLMs) trained on web-scale data can be integrated into end-to-end driving systems to boost generalization and enable interactivity with human users. While recent approaches adapt VLMs to driving via single-round visual question answering (VQA), human drivers reason about decisions in multiple steps. Starting from the localization of key objects, humans estimate object interactions before taking actions. The key insight is that with our proposed task, Graph VQA, where we model graph-structured reasoning through perception, prediction and planning question-answer pairs, we obtain a suitable proxy task to mimic the human reasoning process. We instantiate datasets (DriveLM-Data) built upon nuScenes and CARLA, and propose a VLM-based baseline approach (DriveLM-Agent) for jointly performing Graph VQA and end-to-end driving. The experiments demonstrate that Graph VQA provides a simple, principled framework for reasoning about a driving scene, and DriveLM-Data provides a challenging benchmark for this task. Our DriveLM-Agent baseline performs end-to-end autonomous driving competitively in comparison to state-of-the-art driving-specific architectures. Notably, its benefits are pronounced when it is evaluated zero-shot on unseen objects or sensor configurations. We hope this work can be the starting point to shed new light on how to apply VLMs for autonomous driving. To facilitate future research, all code, data, and models are available to the public.


title: Variational Quantum Multi-Objective Optimization

abstract: Solving combinatorial optimization problems using variational quantum algorithms to be executed on near-term quantum devices has gained a lot of attraction in recent years. Currently, most works have focused on single-objective problems. In contrast, many real-world problems need to consider multiple conflicting objectives simultaneously, which is not well studied using variation quantum algorithms. In multi-objective optimization, one seeks the optimal trade-offs among conflicting objectives - the well-known Pareto set/front. We present a variational quantum multiple-objective optimization (QMOO) algorithm, which allows us to solve multi-objective optimization problems using NISQ computers. At the core of the algorithm is a variational quantum circuit (VQC) tuned to produce a quantum state which is a superposition of Pareto-optimal solutions, solving the original multi-objective optimization problem. The VQC achieves this by incorporating all cost Hamiltonians representing the classical objective functions. We retrieve a set of solutions from the quantum state prepared by the VQC, and utilize the widely-applied hypervolume indicator to determine the quality of it as approximation to the Pareto-front. The variational parameters of the VQC are tuning by maximizing the hypervolume indicator. As many realistic problems are integer optimization problems we formulate the whole scheme for qudit quantum systems. We show the effectiveness of the proposed algorithm on several benchmark problems with up to five objectives.


title: A Dark Sink Enhances the Direct Detection of Freeze-in Dark Matter

abstract: We describe a simple dark sector structure which, if present, has implications for the direct detection of dark matter (DM): the Dark Sink. A Dark Sink transports energy density from the DM into light dark-sector states that do not appreciably contribute to the DM density. As an example, we consider a light, neutral fermion $\psi$ which interacts solely with DM $\chi$ via the exchange of a heavy scalar $\Phi$. We illustrate the impact of a Dark Sink by adding one to a DM freeze-in model in which $\chi$ couples to a light dark photon $\gamma '$ which kinetically mixes with the Standard Model (SM) photon. This freeze-in model (absent the sink) is itself a benchmark for ongoing experiments. In some cases, the literature for this benchmark has contained errors; we correct the predictions and provide them as a public code. We then analyze how the Dark Sink modifies this benchmark, solving coupled Boltzmann equations for the dark-sector energy density and DM yield. We check the contribution of the Dark Sink $\psi$'s to dark radiation; consistency with existing data limits the maximum attainable cross section. For DM with a mass between $\text{MeV} -\mathcal{O}(10\text{ GeV})$, adding the Dark Sink can increase predictions for the direct detection cross section all the way up to the current limits.


title: New Constraints on Axion-Like Particles from IXPE Polarization Data for Magnetars

abstract: We derive new constraints on axion-like particles (ALPs) using precision $X$-ray polarization studies of magnetars. Specifically, we use the first detection of polarized $X$-rays from the magnetars 4U 0142+61 and 1RXS J170849.0-400910 by the Imaging $X$-ray Polarimetry Explorer (IXPE) to place bounds on the product of the ALP-photon and ALP-nucleon couplings, $g_{a\gamma}g_{aN}$, with $g_{aN}$ being responsible for ALP production in the core of the magnetar and $g_{a\gamma}$ controlling the ALP-photon conversion probability in the magnetosphere. These bounds are most sensitive to the magnetar core temperature, and we use two benchmark values of $1\times 10^8$ K and $5\times 10^8$ K to derive our constraints. For the latter choice, our bounds are competitive with the existing bounds on the coupling product coming from a combination of CAST (for $g_{a\gamma}$) and SN1987A (for $g_{aN}$). We advocate for more precise and extensive observational campaigns in the higher end of the $2~-~8~$keV spectral window, where ALP-induced polarization is the strongest. We further advocate for hard $X$-ray polarization studies of young, hot, near-Earth magnetars with strong magnetic fields.


title: Virtual Pets: Animatable Animal Generation in 3D Scenes

abstract: Toward unlocking the potential of generative models in immersive 4D experiences, we introduce Virtual Pet, a novel pipeline to model realistic and diverse motions for target animal species within a 3D environment. To circumvent the limited availability of 3D motion data aligned with environmental geometry, we leverage monocular internet videos and extract deformable NeRF representations for the foreground and static NeRF representations for the background. For this, we develop a reconstruction strategy, encompassing species-level shared template learning and per-video fine-tuning. Utilizing the reconstructed data, we then train a conditional 3D motion model to learn the trajectory and articulation of foreground animals in the context of 3D backgrounds. We showcase the efficacy of our pipeline with comprehensive qualitative and quantitative evaluations using cat videos. We also demonstrate versatility across unseen cats and indoor environments, producing temporally coherent 4D outputs for enriched virtual experiences.


title: Entanglement R\'{e}nyi Negativity of Interacting Fermions from Quantum Monte Carlo Simulations

abstract: Many-body entanglement unveils additional aspects of quantum matter and offers insights into strongly correlated physics. While ground-state entanglement has received much attention in the past decade, the study of mixed-state quantum entanglement using negativity in interacting fermionic systems remains largely unexplored. We demonstrate that the partially transposed density matrix of interacting fermions, similar to their reduced density matrix, can be expressed as a weighted sum of Gaussian states describing free fermions, enabling the calculation of rank-$n$ R\'{e}nyi negativity within the determinant quantum Monte Carlo framework. We conduct the first calculation of the rank-two R\'{e}nyi negativity for the half-filled Hubbard model and the spinless $t$-$V$ model. Our calculation reveals that the area law coefficient of the R\'{e}nyi negativity for the spinless $t$-$V$ model has a logarithmic finite-size scaling at the finite-temperature transition point. Our work contributes to the calculation of entanglement and sets the stage for future studies on quantum entanglement in various fermionic many-body mixed states.


title: Formation of stripes in a mixed-dimensional cold-atom Fermi-Hubbard system

abstract: The relation between d-wave superconductivity and stripes is fundamental to the understanding of ordered phases in cuprates. While experimentally both phases are found in close proximity, numerical studies on the related Fermi-Hubbard model have long been investigating whether stripes precede, compete or coexist with superconductivity. Such stripes are characterised by interleaved charge and spin density wave ordering where fluctuating lines of dopants separate domains of opposite antiferromagnetic order. Here we show first signatures of stripes in a cold-atom Fermi-Hubbard quantum simulator. By engineering a mixed-dimensional system, we increase their typical energy scales to the spin exchange energy, enabling us to access the interesting crossover temperature regime where stripes begin to form. We observe extended, attractive correlations between hole dopants and find an increased probability to form larger structures akin to stripes. In the spin sector, we study correlation functions up to third order and find results consistent with stripe formation. These higher-order correlation measurements pave the way towards an improved microscopic understanding of the emergent properties of stripes and their relation to other competing phases. More generally, our approach has direct relevance for newly discovered high-temperature superconducting materials in which mixed dimensions play an essential role.

categories: cond-mat.quant-gas cond-mat.str-el cond-mat.supr-con quant-ph


title: 3D Pose Estimation of Two Interacting Hands from a Monocular Event Camera

abstract: 3D hand tracking from a monocular video is a very challenging problem due to hand interactions, occlusions, left-right hand ambiguity, and fast motion. Most existing methods rely on RGB inputs, which have severe limitations under low-light conditions and suffer from motion blur. In contrast, event cameras capture local brightness changes instead of full image frames and do not suffer from the described effects. Unfortunately, existing image-based techniques cannot be directly applied to events due to significant differences in the data modalities. In response to these challenges, this paper introduces the first framework for 3D tracking of two fast-moving and interacting hands from a single monocular event camera. Our approach tackles the left-right hand ambiguity with a novel semi-supervised feature-wise attention mechanism and integrates an intersection loss to fix hand collisions. To facilitate advances in this research domain, we release a new synthetic large-scale dataset of two interacting hands, Ev2Hands-S, and a new real benchmark with real event streams and ground-truth 3D annotations, Ev2Hands-R. Our approach outperforms existing methods in terms of the 3D reconstruction accuracy and generalises to real data under severe light conditions.


title: Data Cooperatives for Identity Attestations

abstract: Data cooperatives with fiduciary obligations to members provide a useful source of truthful information regarding a given member whose personal data is managed by the cooperative. Since one of the main propositions the cooperative model is to protect the data privacy of members, we explore the notion of blinded attestations in which the identity of the subject is removed from the attestations issued by the cooperative regarding one of its members. This is performed at the request of the individual member. We propose the use of a legal entity to countersign the blinded attestation, one that has an attorney-client relationship with the cooperative, and which can henceforth become the legal point of contact for inquiries regarding the individual related to the attribute being attested. There are several use-cases for this feature, including the Funds Travel Rule in transactions in digital assets, and the protection of privacy in decentralized social networks.


title: Enhancing Ethereum's Security with LUMEN, a Novel Zero-Knowledge Protocol Generating Transparent and Efficient zk-SNARKs

abstract: This paper proposes a novel recursive polynomial commitment scheme (PCS) and a new polynomial interactive oracle proof (PIOP) protocol, which compile into efficient and transparent zk-SNARKs (zero-knowledge succinct non-interactive arguments of knowledge). The Ethereum blockchain utilizes zero-knowledge Rollups (ZKR) to improve its scalability (the ability to handle a large number of transactions), and ZKR uses zk-SNARKs to validate transactions. The currently used zk-SNARKs rely on a trusted setup ceremony, where a group of participants uses secret information about transactions to generate the public parameters necessary to verify the zk-SNARKs. This introduces a security risk into Ethereum's system. Thus, researchers have been developing transparent zk-SNARKs (which do not require a trusted setup), but those are not as efficient as non-transparent zk-SNARKs, so ZKRs do not use them. In this research, I developed LUMEN, a set of novel algorithms that generate transparent zk-SNARKs that improve Ethereum's security without sacrificing its efficiency. Various techniques were creatively incorporated into LUMEN, including groups with hidden orders, Lagrange basis polynomials, and an amortization strategy. I wrote mathematical proofs for LUMEN that convey its completeness, soundness and zero-knowledgeness, and implemented LUMEN by writing around $8000$ lines of Rust and Python code, which conveyed the practicality of LUMEN. Moreover, my implementation revealed the efficiency of LUMEN (measured in proof size, proof computation time, and verification time), which surpasses the efficiency of existing transparent zk-SNARKs and is on par with that of non-transparent zk-SNARKs. Therefore, LUMEN is a promising solution to improve Ethereum's security while maintaining its efficiency.


title: Electromagnetics with time-varied vacuum permittivity and permeability

abstract: Maxwell equations provide a complete description of the electromagnetic (EM) phenomena, which have been one of the key fundamental-theories of modern physics, such as electromagnetism, optics, quantum theories, etc. The vacuum permittivity and permeability (P&P) in the constitutive relation were regarded as constant, resulting into that the vacuum lightspeed is constant with time. However, neither the Maxwell equations nor any experiments demonstrated that the P&P must be invariable with time. Here, the P&P are assumed as time-varied, achieving a mathematical result exhibits that the P&P are increased with time exponentially. Then, the Maxwell equations of static and covariant EM fields are presented, which include the different constitutive relations. The EM characters in the time-varied case are investigated that, the lightspeed, level EM intensity, and magnetic effect of charge-motion decreases with time. The EM energy transforms into a new energy form caused by the P&P variation, and a new momentum-tensor form caused by propagation is found as well. At last, the Maxwell equations based on the observation results at our time are presented. Meanwhile, since the level EM intensity decreases with time, the energy per frequency is time-decreased, resulting into that the Planck constant decreases exponentially, and correspondingly, the Rydberg constant increases with time. A red-shift of absorption spectrum is predicted based on this finding, which is coincident with the Hubble observation results.


title: Statistical Machine Learning Meets High-Dimensional Spatiotemporal Challenges -- A Case Study of COVID-19 Modeling

abstract: Diverse non-pharmacological interventions (NPIs), serving as the primary approach for COVID-19 control prior to pharmaceutical interventions, showed heterogeneous spatiotemporal effects on pandemic management. Investigating the dynamic compounding impacts of NPIs on pandemic spread is imperative. However, the challenges posed by data availability of high-dimensional human behaviors and the complexity of modeling changing and interrelated factors are substantial. To address these challenges, this study analyzed social media data, COVID-19 case rates, Apple mobility data, and the stringency of stay-at-home policies in the United States throughout the year 2020, aiming to (1) uncover the spatiotemporal variations in NPIs during the COVID-19 pandemic utilizing geospatial big data; (2) develop a statistical machine learning model that incorporates spatiotemporal dependencies and temporal lag effects for the detection of relationships; (3) dissect the impacts of NPIs on the pandemic across space and time. Three indices were computed based on Twitter (currently known as X) data: the Negative and Positive Sentiments Adjusted by Demographics (N-SAD and P-SAD) and the Ratio Adjusted by Demographics (RAD), representing negative sentiment, positive sentiment, and public awareness of COVID-19, respectively. The Multivariate Bayesian Structural Time Series Time Lagged model (MBSTS-TL) was proposed to investigate the effects of NPIs, accounting for spatial dependencies and temporal lag effects. The developed MBSTS-TL model exhibited a high degree of accuracy. Determinants of COVID-19 health impacts transitioned from an emphasis on human mobility during the initial outbreak period to a combination of human mobility and stay-at-home policies during the rapid spread phase, and ultimately to the compound of human mobility, stay-at-home policies, and public awareness of COVID-19.


title: Forecasting and Analysis of CSI 300 Daily Index and S&P 500 Index Based on ARMA and GARCH Models

abstract: In this paper, the ARMA(0,6)-GARCH(1,1) and ARMA(2,6)-eGARCH(1,1) models are constructed by applying ARMA and GARCH models to daily data of the CSI 300 and S&P 500 indices from 2018 to 2021, and the forecasts for the next 7 steps and the corresponding VaR and ES are calculated. After testing the sensitivity of the models, the two index stocks are compared and the corresponding conclusions are presented.


title: Digitalization of Free-Radical Polymerization

abstract: Current paper presents the first attempt of the digitalization of a complex polymerization process representing free-radical polymerization of vinyl monomers in the presence of small additives of stable radicals TEMPO and C60 fullerene. Chain-reaction essence of the chemical process; quantum-chemical concept of elementary reactions; digital-twin presentation of their participants; virtual thermodynamic and kinetic descriptors of the latters; digital polymeryzation passports of individually composed reaction solutions lay the foundation of the digitalization carried out. Polymerization-passport predictions made for a number of solutions with different vinyl monomers and/or different initiating free radicals are fully consistent with chemical reality.


title: Time dependent Vibrational Electronic Coupled Cluster (VECC) theory for non-adiabatic nuclear dynamics

abstract: A time-dependent vibrational electronic coupled-cluster (VECC) approach is proposed to simulate photoelectron/ UV-VIS absorption spectra, as well as time-dependent properties for non-adiabatic vibronic models, going beyond the Born-Oppenheimer approximation. A detailed derivation of the equations of motion and a motivation of the ansatz are presented. The VECC method employs second-quantized bosonic construction operators and a mixed linear and exponential ansatz to form a compact representation of the time-dependent wave-function. Importantly, the method does not require a basis set, has only few user-defined inputs, and has a classical (polynomial) scaling with respect to the number of degrees of freedom (of the vibronic model), resulting in a favourable computational cost. In benchmark applications to small models and molecules the VECC method provides accurate results, compared to Multi-Configurational Time-dependent Hartree (MCTDH) calculations when predicting short-time dynamical properties (i.e. photo-elecron / UV-VIS absorption spectra) for non-adiabatic vibronic models. To illustrate the capabilities the VECC method is also applied successfully to a large vibronic model for hexahelicene with 14 electronic states and 63 normal modes, developed in the group by Santoro.


title: Spatiotemporal risk prediction for infectious disease spread and mortality

abstract: With the outbreak of the COVID-19 pandemic, various studies have focused on predicting the trajectory and risk factors of the virus and its variants. Building on previous work that addressed this problem using genetic and epidemiological data, we introduce a method, Geo Score, that also incorporates geographic, socioeconomic, and demographic data to estimate infection and mortality risk by region and time. We employ gradient descent to find the optimal weights of the factors' significance in determining risk. Such spatiotemporal risk prediction is important for informed public health decision-making so that individuals are aware of the risks of travel during an epidemic or pandemic, and, perhaps more importantly, so that policymakers know how to triage limited resources during a crisis. We apply our method to New York City COVID-19 data from 2020, predicting ZIP code-level COVID-19 risk for 2021.


title: Hydrogel modified evaporation interface for highly stable membrane distillation

abstract: Surface effect of low-surface-tension contaminants accumulating at the evaporation surface can easily induce membrane wetting in the application of membrane distillation, especially in hypersaline scenarios. In this work, we propose a novel strategy to eliminate the surface effect and redistribute contaminants at the evaporation interface with simply incorporating a layer of hydrogel. The as-fabricated composite membrane exhibits remarkable stability, even when exposed to extreme conditions, such as a salt concentration of 5M and surfactant concentration of 8 mM. The breakthrough pressure of the membrane is as high as 20 bars in the presence of surfactants, surpassing commercial hydrophobic membranes by one to two magnitudes. Combined study of density functional theory and molecular dynamics simulations reveals the important role of hydrogel-surfactant interaction in suppressing the surface effect. As a proof of concept, we also demonstrate the stable performance of the membrane in processing synthetic wastewater containing surfactants of 144 mg L-1, mineral oils of 1g L-1 and NaCl of 192 g L-1, showing potential of the membrane in addressing challenges of hypersaline water treatment and zero liquid discharge processes.


title: Gradient-Free Aeroacoustic Shape Optimization Using Large Eddy Simulation

abstract: We present an aeroacoustic shape optimization framework that relies on high-order Flux Reconstruction (FR) spatial discretization, the gradient-free Mesh Adaptive Direct Search (MADS) optimization algorithm, and Large Eddy Simulation (LES). Our parallel implementation ensures that the runtime of each optimization iteration remains consistent, irrespective of the number of design parameters involved in the optimization problem, provided sufficient resources are available. This eliminates the dependence of the runtime of gradient-free algorithms on the number of design variables. The objective is to minimize Sound Pressure Level (SPL) at a near-field observer by computing it directly from the flow field. We evaluate this framework across three different problems. First, an open deep cavity is considered at a free-stream Mach number of $M=0.15$ and Reynolds number of $Re=1500$ based on the cavity's depth, reducing the SPL by $12.86dB$. Next, we optimized tandem cylinders at $Re=1000$ and $M=0.2$, achieving over $11dB$ noise reduction by optimizing cylinder spacing and diameter ratio. Lastly, a baseline NACA0012 airfoil is optimized at $Re=23000$ and $M=0.2$. The shape of the airfoil is optimized to generate a new 4-digit NACA airfoil at an appropriate angle of attack to minimize the SPL while ensuring the baseline time-averaged lift coefficient is maintained and prevent any increase in the baseline time-averaged drag coefficient. The SPL is reduced by $5.66dB$ while the mean drag coefficient is reduced by more than $7\%$. These results highlight the feasibility and effectiveness of our aeroacoustic shape optimization framework.


title: The ground-state potential and dipole moment of carbon monoxide: contributions from electronic correlation, relativistic effects, QED, adiabatic, and non-adiabatic corrections

abstract: The ground X1{\Sigma}+ state potential energy curve (PEC) and dipole moment curve (DMC) of CO molecule have been revisited within the framework of the relativistic coupled-cluster approach, which incorporates non-perturbative single, double, and triple cluster amplitudes (CCSDT) in conjunction with a finite-field methodology. The generalized relativistic pseudo-potential model was used for the effective introducing the relativity in all-electron correlation treatment and accounting the quantum-electrodynamics (QED) corrections within the model-QED-operator approach. The diagonal Born-Oppenheimer correction to PEC has been evaluated using the CCSD approach. The sensitivity of resulting PEC and DMC to variations in basis set parameters and regular intramolecular perturbations were considered as well. The present ab initio results are in a reasonable agreement with their most accurate semi-empirical counterparts.

categories: physics.chem-ph physics.atm-clus physics.comp-ph quant-ph


title: High speed and acceleration micrometric jets induced by GHz streaming: a numerical study with direct numerical simulations

abstract: Gigahertz acoustic streaming microjets, with the capability of achieving fluid speeds up to meters per second, open new avenues for precision fluid and particle manipulation at microscales. However, theoretical and numerical investigations of acoustic streaming at these frequencies remain relatively scarce due to significant challenges including: (i) The inappropriateness of classical approaches, rooted in asymptotic development, for addressing high-speed streaming with flow velocities comparable to the acoustic velocity, and (ii) the numerical cost of direct numerical simulations generally considered as prohibitive. In this paper, we investigate high-frequency bulk acoustic streaming using high-order finite difference direct numerical simulations. First, we demonstrate that high-speed micrometric jets of several meters per second can only be obtained at high frequencies, due to diffraction limits. Second, we establish that the maximum jet streaming speed at a a given actuation power scales with the frequency to the power of 3/2 in the low attenuation limit and linearly with the frequency for strongly attenuated waves. Lastly, our analysis of transient regimes reveals a dramatic reduction in the time required to reach the maximum velocity as the frequency increases, following a power-law relationship of -5/2. This phenomenon results in remarkable accelerations within the Mega-g range at gigahertz frequencies.


title: Enhanced Capacitance in Surfactant Mediated Ion Complexes

abstract: Ion complexes hold the key for various energy transfer and communication systems in nature and industries. Achieving controllable mechanical and electrical properties in these complex systems is highly desirable but remains challenging. In this work, we propose the use of amphiphilic molecules to mediate salt crystallization. The resultant ionic interfaces can be tunable through reduced surface tensions of crystal facets, an additional intermolecular modifier, and the diffusion-limited crystallization during controlled solvent evaporation. Specifically, we utilized the ionic surfactant Sodium Lauryl sulfoacetate (SLSA) to mediate the crystallization of sodium chloride. Citric acid (CA) was adopted as a hydrogen-bond modifier. Systems mediated by SLSA exhibited the highest capacitance, and a significant enhancement of capacitance was also observed in systems with both SLSA and CA. The substantially increased capacitance of these ionic complexes can be attributed to changes in interfacial and crystalline grain structures. Transmission electron microscopy (TEM), optical microscopy (OM), and Finite Element Analysis (FEA) were used to study the effects of surfactant molecules in these ionic complexes. Understanding the role of ionic complexation in defining the thermodynamic and kinetic process of the crystallization process will contribute to better optimization in nucleation and scalability of organic and inorganic crystal production.


title: SEOpinion: Summarization and Exploration Opinion of E-Commerce Websites

abstract: E-Commerce (EC) websites provide a large amount of useful information that exceed human cognitive processing ability. In order to help customers in comparing alternatives when buying a product, previous studies designed opinion summarization systems based on customer reviews. They ignored templates' information provided by manufacturers, although these descriptive information have much product aspects or characteristics. Therefore, this paper proposes a methodology coined as SEOpinion (Summa-rization and Exploration of Opinions) which provides a summary for the product aspects and spots opinion(s) regarding them, using a combination of templates' information with the customer reviews in two main phases. First, the Hierarchical Aspect Extraction (HAE) phase creates a hierarchy of product aspects from the template. Subsequently, the Hierarchical Aspect-based Opinion Summarization (HAOS) phase enriches this hierarchy with customers' opinions; to be shown to other potential buyers. To test the feasibility of using Deep Learning-based BERT techniques with our approach, we have created a corpus by gathering information from the top five EC websites for laptops. The experimental results show that Recurrent Neural Network (RNN) achieves better results (77.4% and 82.6% in terms of F1-measure for the first and second phase) than the Convolutional Neural Network (CNN) and the Support Vector Machine (SVM) technique.


title: A novel particle decomposition scheme to improve parallel performance of fully resolved particulate flow simulations

abstract: This study addresses the challenge of simulating realistic particle systems by proposing a novel particle decomposition scheme that improves the parallel performance of surface resolved particle simulations. Realistic particle systems often involve large numbers of particles and complex particle shapes. The resulting need to account for shape factors requires the inclusion of even more particles to obtain statistically meaningful results. However, the computational cost increases with the number of particles, making efficient parallelization crucial. Therefore, the proposed scheme aims to improve the scalability by optimizing the communication and data management between processors. Through hindered settling experiments, the applicability and performance of the novel particle decomposition scheme are thoroughly investigated using the homogenized lattice Boltzmann method. The results show that the proposed method significantly improves the performance, especially in scenarios with a large number of particles, by reducing communication constraints and improving scalability. This research contributes to the advancement of computational methods for efficient study of complex particle systems and provides valuable insights for future developments in this field.


title: On the relation between the three Reidemeister moves and the three gauge groups

abstract: Quantum theory suggests that the three observed gauge groups U(1), SU(2) and SU(3) are related to the three Reidemeister moves: twists, pokes and slides. The background for the relation is provided. It is then shown that twists generate the group U(1), whereas pokes generate SU(2). Emphasis is placed on proving the relation between slides, the Gell-Mann matrices, and the Lie group SU(3). Consequences for unification are deduced.


title: Negative differential resistance in Josephson junctions coupled to a cavity

abstract: Regions with negative differential resistance can arise in the IV curve of Josephson junctions and this phenomenon plays an essential role for applications, in particular for THz radiation emission. For the measurement of high frequency radiation from Josephson junctions, a cavity - either internal or external - is often used. A cavity may also induce a negative differential resistance region at the lower side of the resonance frequency. We investigate the dynamics of Josephson junctions with a negative differential resistance in the quasi particle tunnel current, i.e. in the McCumber curve. We find that very complicated and unexpected interactions take place. This may be useful for the interpretation of experimental measurements of THz radiation from intrinsic Josephson junctions.


title: Non-minimally coupled scalar field and scaling symmetry in a cosmological background

abstract: We study scaling symmetry in a class of non-minimally coupled scalar field in a background of Friedmann-Robertson-Walker (FRW) spacetime. We use a non-minimally coupling $R L^{(\varphi)}$. We find the corresponding conserved charge of that symmetry and see its role in cosmology, and search for its possible breaking down and its outcomes. A suitable potential $V(\varphi)=\varphi^2/2$ of scalar field is adopted which is necessary to get a scaling symmetric Lagrangian of the system including scalar field, non-minimally coupling to Ricci scalar $R L^{(\varphi)}$ and dark matter dust. We study evolution of the scalar field in the phase space of the model and explore the stability of the obtained critical point. In this manner we derive a relation that relates the cosmological constant and gravitational constant via a unique identity which reflects the scaling symmetry breaking in the space $(a, \varphi)$. And relate the cosmological constant to the vacuum expectation value of the potential energy of $\varphi$. Finally we study the stability of that vacuum expectation value.


title: A Special Lorentz Violation Model and a Special Rainbow Function

abstract: In order to characterize the common feature of the general Lorentz violation models that the local speed of light is variable at ultrahigh energy scale, we introduced a parameter n to characterize the variation of the speed of light between inertial systems. And in order not to violate some fundamental principles and experiments' results, some constraints were imposed on n. Then a coordinate transformation with the parameter n, which meets the symmetry of inertial systems, was naturally obtained. But just to satisfy the symmetry of inertial systems, the expression for n cannot be determined. Inspired by the idea of DSR model, we then discussed a specific expression for n that makes the particle's energy have a limit rather than be infinite derived from the Lorentz model. We found that the modified dispersion relation corresponding to the specific expression for n is deeply associated with the general formula of dispersion relation from the DSR. The motivation of introducing such a parameter n was also discussed. Finally, we discussed the possible LIV effects from astrophysical observations in GRB events and photon annihilation events. Using the data from GRB 190114C we investigated the special dispersion relation obtained in this paper and found that it appears to fit these data better than the two models corresponding to the first or second order approximation of the general formula of dispersion relation. And similar to the other Lorentz violation models corresponding to the subluminal case, the modified dispersion relation obtained in this paper can also result in increasing the energy threshold of photon annihilation reaction, which is expected to be verified by the future energetic photons events.


title: A Non-Causal Reconceptualization of Quantum Field Theory

abstract: Quantum field theory currently has a single standard mathematical characterization (the Standard Model), but no single accepted conceptual framework to interpret the mathematics. Many of these conceptualizations rely on intuitive concepts carried over from classical physics (such as "particle" and "causality"). In this paper, instead of relying on classical concepts we attempt to infer a conceptualization directly from the mathematics. This reconceptualization leads to a physical reinterpretation of the paths involved in the Standard Model's action integral as traces of an accumulative process that occurs within an "extraverse", of which our observable spacetime is a single "slice". We briefly outline a rigorous mathematical model which validates the physical reinterpretation, and leads to predictions that are potentially verifiable by experiment. We contrast our model with other popular interpretations of quantum mechanics. We describe some of the metaphysical consequences of our proposed perspective. Finally we present some speculations about an alternative approach that could possibly lead to a more satisfying, intuitively-graspable theory.


title: Drude weight in presence of nonlocal potentials

abstract: The nonlocal potential contributes an extra term to the velocity operator; I show here that such term affects the formal expression of the Drude weight in a nontrivial way. Notably, the present main result fixes a disturbing discrepancy in the Dreyer-Coh-Stengel sum rule [Phys. Rev. Lett. {\bf 128}, 095901 (2022)].


title: Time-Dependent Density Functional Theory with the Orthogonal Projector Augmented Wave Method

abstract: The projector augmented wave (PAW) method of Bl\"ochl linearly maps smooth pseudo wavefunctions to the highly oscillatory all-electron DFT orbitals. Compared to norm-conserving pseudopotentials (NCPP), PAW has the advantage of lower kinetic energy cutoffs and larger grid spacings at the cost of having to solve for non-orthogonal wavefunctions. We earlier developed orthogonal PAW (OPAW) to allow the use of PAW when orthogonal wavefunctions are required. In OPAW, the pseudo wavefunctions are transformed through the efficient application of powers of the PAW overlap operator with essentially no extra cost compared to NCPP methods. Previously, we applied OPAW to DFT. Here, we take the first step to make OPAW viable for post-DFT methods by implementing it in real-time time-dependent (TD) DFT. Using fourth-order Runge-Kutta for the time-propagation, we compare calculations of absorption spectra for various organic and biological molecules and show that very large grid spacings are sufficient, 0.6-0.8 Bohr in OPAW-TDDFT rather than the 0.4-0.5 Bohr used in traditional NCPP-TDDFT calculations. This reduces the memory and propagation costs by up to a factor of 5. Our method would be directly applicable to any post-DFT methods that require time-dependent propagations such as GW and BSE.


title: Dynamic Topic Language Model on Heterogeneous Children's Mental Health Clinical Notes

abstract: Mental health diseases affect children's lives and well-beings which have received increased attention since the COVID-19 pandemic. Analyzing psychiatric clinical notes with topic models is critical to evaluate children's mental status over time. However, few topic models are built for longitudinal settings, and they fail to keep consistent topics and capture temporal trajectories for each document. To address these challenges, we develop a longitudinal topic model with time-invariant topics and individualized temporal dependencies on the evolving document metadata. Our model preserves the semantic meaning of discovered topics over time and incorporates heterogeneity among documents. In particular, when documents can be categorized, we propose an unsupervised topics learning approach to maximize topic heterogeneity across different document groups. We also present an efficient variational optimization procedure adapted for the multistage longitudinal setting. In this case study, we apply our method to the psychiatric clinical notes from a large tertiary pediatric hospital in Southern California and achieve a 38% increase in the overall coherence of extracted topics. Our real data analysis reveals that children tend to express more negative emotions during state shutdowns and more positive when schools reopen. Furthermore, it suggests that sexual and gender minority (SGM) children display more pronounced reactions to major COVID-19 events and a greater sensitivity to vaccine-related news than non-SGM children. This study examines the progression of children's mental health during the pandemic and offers clinicians valuable insights to recognize the disparities in children's mental health related to their sexual and gender identities.


title: Reversal of Orbital Hall Conductivity and Emergence of Tunable Topological Quantum States in Orbital Hall Insulator

abstract: Recent findings indicate that orbital angular momentum (OAM) has the capability to induce the intrinsic orbital Hall effect (OHE), which is characterized by orbital Chern number in the orbital Hall insulator. Unlike the spin-polarized channel in Quantum anomalous Hall insulator, the OAM is valley-locked, posing challenges in manipulating the corresponding edge state. Here we demonstrate the sign-reversal orbital Chern number through strain engineering by combing the $k \cdot p$ model and first-principles calculation. Under the manipulation of strain, we observe the transfer of non-zero OAM from the valence band to the conduction band, aligning with the orbital contribution in the electronic structure. Our investigation reveals that electrons and holes with OAM exhibit opposing trajectories, resulting in a reversal of the orbital Hall conductivity. Furthermore, we explore the topological quantum state between the sign-reversible OHE.


title: Find the Lady: Permutation and Re-Synchronization of Deep Neural Networks

abstract: Deep neural networks are characterized by multiple symmetrical, equi-loss solutions that are redundant. Thus, the order of neurons in a layer and feature maps can be given arbitrary permutations, without affecting (or minimally affecting) their output. If we shuffle these neurons, or if we apply to them some perturbations (like fine-tuning) can we put them back in the original order i.e. re-synchronize? Is there a possible corruption threat? Answering these questions is important for applications like neural network white-box watermarking for ownership tracking and integrity verification. We advance a method to re-synchronize the order of permuted neurons. Our method is also effective if neurons are further altered by parameter pruning, quantization, and fine-tuning, showing robustness to integrity attacks. Additionally, we provide theoretical and practical evidence for the usual means to corrupt the integrity of the model, resulting in a solution to counter it. We test our approach on popular computer vision datasets and models, and we illustrate the threat and our countermeasure on a popular white-box watermarking method.


title: On Early Detection of Hallucinations in Factual Question Answering

abstract: While large language models (LLMs) have taken great strides towards helping humans with a plethora of tasks like search and summarization, hallucinations remain a major impediment towards gaining user trust. The fluency and coherence of model generations even when hallucinating makes it difficult to detect whether or not a model is hallucinating. In this work, we explore if the artifacts associated with the model generations can provide hints that the generation will contain hallucinations. Specifically, we probe LLMs at 1) the inputs via Integrated Gradients based token attribution, 2) the outputs via the Softmax probabilities, and 3) the internal state via self-attention and fully-connected layer activations for signs of hallucinations on open-ended question answering tasks. Our results show that the distributions of these artifacts differ between hallucinated and non-hallucinated generations. Building on this insight, we train binary classifiers that use these artifacts as input features to classify model generations into hallucinations and non-hallucinations. These hallucination classifiers achieve up to 0.80 AUROC. We further show that tokens preceding a hallucination can predict the subsequent hallucination before it occurs.


title: Large Language Models in Medical Term Classification and Unexpected Misalignment Between Response and Reasoning

abstract: This study assesses the ability of state-of-the-art large language models (LLMs) including GPT-3.5, GPT-4, Falcon, and LLaMA 2 to identify patients with mild cognitive impairment (MCI) from discharge summaries and examines instances where the models' responses were misaligned with their reasoning. Utilizing the MIMIC-IV v2.2 database, we focused on a cohort aged 65 and older, verifying MCI diagnoses against ICD codes and expert evaluations. The data was partitioned into training, validation, and testing sets in a 7:2:1 ratio for model fine-tuning and evaluation, with an additional metastatic cancer dataset from MIMIC III used to further assess reasoning consistency. GPT-4 demonstrated superior interpretative capabilities, particularly in response to complex prompts, yet displayed notable response-reasoning inconsistencies. In contrast, open-source models like Falcon and LLaMA 2 achieved high accuracy but lacked explanatory reasoning, underscoring the necessity for further research to optimize both performance and interpretability. The study emphasizes the significance of prompt engineering and the need for further exploration into the unexpected reasoning-response misalignment observed in GPT-4. The results underscore the promise of incorporating LLMs into healthcare diagnostics, contingent upon methodological advancements to ensure accuracy and clinical coherence of AI-generated outputs, thereby improving the trustworthiness of LLMs for medical decision-making.


title: Auto311: A Confidence-guided Automated System for Non-emergency Calls

abstract: Emergency and non-emergency response systems are essential services provided by local governments and critical to protecting lives, the environment, and property. The effective handling of (non-)emergency calls is critical for public safety and well-being. By reducing the burden through non-emergency callers, residents in critical need of assistance through 911 will receive a fast and effective response. Collaborating with the Department of Emergency Communications (DEC) in Nashville, we analyzed 11,796 non-emergency call recordings and developed Auto311, the first automated system to handle 311 non-emergency calls, which (1) effectively and dynamically predicts ongoing non-emergency incident types to generate tailored case reports during the call; (2) itemizes essential information from dialogue contexts to complete the generated reports; and (3) strategically structures system-caller dialogues with optimized confidence. We used real-world data to evaluate the system's effectiveness and deployability. The experimental results indicate that the system effectively predicts incident type with an average F-1 score of 92.54%. Moreover, the system successfully itemizes critical information from relevant contexts to complete reports, evincing a 0.93 average consistency score compared to the ground truth. Additionally, emulations demonstrate that the system effectively decreases conversation turns as the utterance size gets more extensive and categorizes the ongoing call with 94.49% mean accuracy.


title: Cluster regression model for control of nonlinear dynamics

abstract: In the realm of big data, discerning patterns in nonlinear systems affected by external control inputs is increasingly challenging. Our approach blends the coarse-graining strengths of centroid-based unsupervised clustering with the clarity of sparse regression in a unique way to enhance the closed-loop feedback control of nonlinear dynamical systems. A key innovation in our methodology is the employment of cluster coefficients via a cluster decomposition of time-series measurement data. This approach transcends the conventional emphasis on the proximity of time series measurements to cluster centroids, offering a more nuanced representation of the dynamics within phase space. Capturing the evolving dynamics of these coefficients enable the construction of a robust, deterministic model for the observed states of the system. This model excels in capturing a wide range of dynamics, including periodic and chaotic behaviors, under the influence of external control inputs. Demonstrated in both the low-dimensional Lorenz system and the high-dimensional scenario of a flexible plate immersed in fluid flow, our model showcases its ability to pinpoint critical system features and its adaptability in reaching any observed state. A distinctive feature of our control strategy is the novel hopping technique between cluster states, which successfully averts lobe switching in the Lorenz system and accelerates vortex shedding in fluid-structure interaction systems while maintaining the mean aerodynamic characteristics.


title: WaveCoder: Widespread And Versatile Enhancement For Code Large Language Models By Instruction Tuning

abstract: Recent work demonstrates that, after instruction tuning, Code Large Language Models (Code LLMs) can obtain impressive capabilities to address a wide range of code-related tasks. However, current instruction tuning methods for Code LLMs mainly focus on the traditional code generation task, resulting in poor performance in complex multi-task scenarios. In this paper, we concentrate on multiple code-related tasks and present WaveCoder, a series of Code LLMs trained with Widespread And Versatile Enhanced instruction data. To enable the models to tackle complex code-related tasks, we propose a method to stably generate diverse, high-quality instruction data from open source code dataset in multi-task scenarios and obtain CodeSeaXDataset, a dataset comprising 19,915 instruction instances across 4 code-related tasks, which is aimed at improving the generalization ability of Code LLM. Our experiments demonstrate that WaveCoder models significantly outperform other open-source models in terms of the generalization ability across different code-related tasks. Moreover, WaveCoder-Ultra-6.7B presents the state-of-the-art generalization abilities on a wide range of code-related tasks.


title: Enhancing Neural Theorem Proving through Data Augmentation and Dynamic Sampling Method

abstract: Theorem proving is a fundamental task in mathematics. With the advent of large language models (LLMs) and interactive theorem provers (ITPs) like Lean, there has been growing interest in integrating LLMs and ITPs to automate theorem proving. In this approach, the LLM generates proof steps (tactics), and the ITP checks the applicability of the tactics at the current goal. The two systems work together to complete the proof. In this paper, we introduce DS-Prover, a novel dynamic sampling method for theorem proving. This method dynamically determines the number of tactics to apply to expand the current goal, taking into account the remaining time compared to the total allocated time for proving a theorem. This makes the proof search process more efficient by adjusting the balance between exploration and exploitation as time passes. We also augment the training dataset by decomposing simplification and rewrite tactics with multiple premises into tactics with single premises. This gives the model more examples to learn from and helps it to predict the tactics with premises more accurately. We perform our experiments using the Mathlib dataset of the Lean theorem prover and report the performance on two standard datasets, MiniF2F and ProofNet. Our methods achieve significant performance gains on both datasets. We achieved a state-of-the-art performance (Pass@1) of 14.2% on the ProofNet dataset and a performance of 29.8% on MiniF2F, slightly surpassing the best-reported Pass@1 of 29.6% using Lean.


title: Model adaptive phase space reconstruction

abstract: Phase space reconstruction (PSR) methods allow for the analysis of low-dimensional data with methods from dynamical system theory, but their application to prediction models, like those from machine learning (ML), is limited. Therefore, we present here a model adaptive phase space reconstruction (MAPSR) method that unifies the process of PSR with the modeling of the dynamical system. MAPSR is a differentiable PSR method that enables the use of ML methods and is based on the idea of time delay embedding. For achieving differentiable, continuous, real-valued delays, which can be optimized using gradient descent, the discrete time signal is converted to a continuous time signal. The delay vector, which stores all potential embedding delays and the trainable parameters of the model, are simultaneously updated to achieve an optimal time delay embedding for the observed system. MAPSR does not rely on any threshold or statistical criterion for determining the dimension and the set of delay values for the embedding process. The quality of the reconstruction is evaluated by the prediction loss. We apply the proposed approach to uni- and multivariate time series stemming from regular and chaotic dynamical systems and a turbulent combustor to test the generalizability of the method and compare our results with established PSR methods. We find that for the Lorenz system, the model trained with the MAPSR method is able to predict chaotic time series for nearly 7 to 8 Lyapunov time scales, which is found to be much better compared to other PSR methods (AMI-FNN and PECUZAL methods). For the univariate time series from the turbulent combustor, the long-term prediction error of the model trained using the MAPSR method stays in between that of AMI-FNN and PECUZAL methods for the regime of chaos, and for the regime of intermittency, the MAPSR method outperforms the AMI-FNN and PECUZAL methods.


title: Machine Learning for Anomaly Detection in Particle Physics

abstract: The detection of out-of-distribution data points is a common task in particle physics. It is used for monitoring complex particle detectors or for identifying rare and unexpected events that may be indicative of new phenomena or physics beyond the Standard Model. Recent advances in Machine Learning for anomaly detection have encouraged the utilization of such techniques on particle physics problems. This review article provides an overview of the state-of-the-art techniques for anomaly detection in particle physics using machine learning. We discuss the challenges associated with anomaly detection in large and complex data sets, such as those produced by high-energy particle colliders, and highlight some of the successful applications of anomaly detection in particle physics experiments.


title: Noisy Measurements Are Important, the Design of Census Products Is Much More Important

abstract: McCartan et al. (2023) call for "making differential privacy work for census data users." This commentary explains why the 2020 Census Noisy Measurement Files (NMFs) are not the best focus for that plea. The August 2021 letter from 62 prominent researchers asking for production of the direct output of the differential privacy system deployed for the 2020 Census signaled the engagement of the scholarly community in the design of decennial census data products. NMFs, the raw statistics produced by the 2020 Census Disclosure Avoidance System before any post-processing, are one component of that design-the query strategy output. The more important component is the query workload output-the statistics released to the public. Optimizing the query workload-the Redistricting Data (P.L. 94-171) Summary File, specifically-could allow the privacy-loss budget to be more effectively managed. There could be fewer noisy measurements, no post-processing bias, and direct estimates of the uncertainty from disclosure avoidance for each published statistic.


title: iDMEu: An initiative for Dark Matter in Europe and beyond

abstract: We introduce the initiative for Dark Matter in Europe and beyond (iDMEu), a collective effort by a group of particle and astroparticle physicists to set up an online resource meta-repository, a common discussion platform and a series of meetings on everything concerning Dark Matter. This document serves as a status report as well as a citable item concerning iDMEu.

categories: hep-ph astro-ph.CO astro-ph.GA hep-ex nucl-th


title: Clustering and Uncertainty Analysis to Improve the Machine Learning-based Predictions of SAFARI-1 Control Follower Assembly Axial Neutron Flux Profiles

abstract: The goal of this work is to develop accurate Machine Learning (ML) models for predicting the assembly axial neutron flux profiles in the SAFARI-1 research reactor, trained by measurement data from historical cycles. The data-driven nature of ML models makes them susceptible to uncertainties which are introduced by sources such as noise in training data, incomplete coverage of the domain, extrapolation and imperfect model architectures. To this end, we also aim at quantifying the approximation uncertainties of the ML model predictions. Previous work using Deep Neural Networks (DNNs) has been successful for fuel assemblies in SAFARI-1, however, not as accurate for control follower assemblies. The aim of this work is to improve the ML models for the control assemblies by a combination of supervised and unsupervised ML algorithms. The $k$-means and Affinity Propagation unsupervised ML algorithms are employed to identify clusters in the set of the measured axial neutron flux profiles. Then, regression-based supervised ML models using DNN (with prediction uncertainties quantified with Monte Carlo dropout) and Gaussian Process (GP) are trained for different clusters and the prediction uncertainty is estimated. It was found that applying the proposed procedure improves the prediction accuracy for the control assemblies and reduces the prediction uncertainty. Flux shapes predicted by DNN and GP are very close, and the overall accuracy became comparable to the fuel assemblies. The prediction uncertainty is however smaller for GP models.


title: The Problem of Computational Complexity

abstract: This article presents a general solution to the problem of computational complexity. First, it gives a historical introduction to the problem since the revival of the foundational problems of mathematics at the end of the 19th century. Second, building on the theory of functional relations in mathematics, it provides a theoretical framework where we can rigorously distinguish two pairs of concepts: Between solving a problem and verifying the solution to a problem. Between a deterministic and a non-deterministic model of computation. Third, it presents the theory of computational complexity and the difficulties in solving the P versus NP problem. Finally, it gives a complete proof that a certain decision problem in NP has an algorithmic exponential lower bound thus establishing firmly that P is different from NP. The proof presents a new way of approaching the subject: neither by entering into the unmanageable difficulties of proving this type of lower bound for the known NP-complete problems nor by entering into the difficulties regarding the properties of the many complexity classes established since the mid-1970s.


title: A Fully Explicit Integrator for Modeling Astrophysical Reactive Flows

abstract: Simulating complex astrophysical reacting flows is computationally expensive -- reactions are stiff and typically require implicit integration methods. The reaction update is often the most expensive part of a simulation, which motivates the exploration of more economical methods. In this research note, we investigate how the explicit Runge--Kutta--Chebyshev (RKC) method performs compared to an implicit method when applied to astrophysical reactive flows. These integrators are applied to simulations of X-ray bursts arising from unstable thermonuclear burning of accreted fuel on the surface of neutron stars. We show that the RKC method performs with similar accuracy to our traditional implicit integrator, but is more computationally efficient when run on CPUs.


title: Optimizing Heat Alert Issuance with Reinforcement Learning

abstract: A key strategy in societal adaptation to climate change is the use of alert systems to reduce the adverse health impacts of extreme heat events by prompting preventative action. In this work, we investigate reinforcement learning (RL) as a tool to optimize the effectiveness of such systems. Our contributions are threefold. First, we introduce a novel RL environment enabling the evaluation of the effectiveness of heat alert policies to reduce heat-related hospitalizations. The rewards model is trained from a comprehensive dataset of historical weather, Medicare health records, and socioeconomic/geographic features. We use variational Bayesian techniques to address low-signal effects and spatial heterogeneity, which are commonly encountered in climate & health settings. The transition model incorporates real historical weather patterns enriched by a data augmentation mechanism based on climate region similarity. Second, we use this environment to evaluate standard RL algorithms in the context of heat alert issuance. Our analysis shows that policy constraints are needed to improve the initially poor performance of RL. Lastly, a post hoc contrastive analysis provides insight into scenarios where our modified heat alert-RL policies yield significant gains/losses over the current National Weather Service alert policy in the United States.


title: Benchmarking and Defending Against Indirect Prompt Injection Attacks on Large Language Models

abstract: The integration of large language models (LLMs) with external content has enabled more up-to-date and wide-ranging applications of LLMs, such as Microsoft Copilot. However, this integration has also exposed LLMs to the risk of indirect prompt injection attacks, where an attacker can embed malicious instructions within external content, compromising LLM output and causing responses to deviate from user expectations. To investigate this important but underexplored issue, we introduce the first benchmark for indirect prompt injection attacks, named BIPIA, to evaluate the risk of such attacks. Based on the evaluation, our work makes a key analysis of the underlying reason for the success of the attack, namely the inability of LLMs to distinguish between instructions and external content and the absence of LLMs' awareness to not execute instructions within external content. Building upon this analysis, we develop two black-box methods based on prompt learning and a white-box defense method based on fine-tuning with adversarial training accordingly. Experimental results demonstrate that black-box defenses are highly effective in mitigating these attacks, while the white-box defense reduces the attack success rate to near-zero levels. Overall, our work systematically investigates indirect prompt injection attacks by introducing a benchmark, analyzing the underlying reason for the success of the attack, and developing an initial set of defenses.


title: ZeroShape: Regression-based Zero-shot Shape Reconstruction

abstract: We study the problem of single-image zero-shot 3D shape reconstruction. Recent works learn zero-shot shape reconstruction through generative modeling of 3D assets, but these models are computationally expensive at train and inference time. In contrast, the traditional approach to this problem is regression-based, where deterministic models are trained to directly regress the object shape. Such regression methods possess much higher computational efficiency than generative methods. This raises a natural question: is generative modeling necessary for high performance, or conversely, are regression-based approaches still competitive? To answer this, we design a strong regression-based model, called ZeroShape, based on the converging findings in this field and a novel insight. We also curate a large real-world evaluation benchmark, with objects from three different real-world 3D datasets. This evaluation benchmark is more diverse and an order of magnitude larger than what prior works use to quantitatively evaluate their models, aiming at reducing the evaluation variance in our field. We show that ZeroShape not only achieves superior performance over state-of-the-art methods, but also demonstrates significantly higher computational and data efficiency.


title: Report on 2023 CyberTraining PI Meeting, 26-27 September 2023

abstract: This document describes a two-day meeting held for the Principal Investigators (PIs) of NSF CyberTraining grants. The report covers invited talks, panels, and six breakout sessions. The meeting involved over 80 PIs and NSF program managers (PMs). The lessons recorded in detail in the report are a wealth of information that could help current and future PIs, as well as NSF PMs, understand the future directions suggested by the PI community. The meeting was held simultaneously with that of the PIs of the NSF Cyberinfrastructure for Sustained Scientific Innovation (CSSI) program. This co-location led to two joint sessions: one with NSF speakers and the other on broader impact. Further, the joint poster and refreshment sessions benefited from the interactions between CSSI and CyberTraining PIs.


title: Efficient Architecture Search via Bi-level Data Pruning

abstract: Improving the efficiency of Neural Architecture Search (NAS) is a challenging but significant task that has received much attention. Previous works mainly adopted the Differentiable Architecture Search (DARTS) and improved its search strategies or modules to enhance search efficiency. Recently, some methods have started considering data reduction for speedup, but they are not tightly coupled with the architecture search process, resulting in sub-optimal performance. To this end, this work pioneers an exploration into the critical role of dataset characteristics for DARTS bi-level optimization, and then proposes a novel Bi-level Data Pruning (BDP) paradigm that targets the weights and architecture levels of DARTS to enhance efficiency from a data perspective. Specifically, we introduce a new progressive data pruning strategy that utilizes supernet prediction dynamics as the metric, to gradually prune unsuitable samples for DARTS during the search. An effective automatic class balance constraint is also integrated into BDP, to suppress potential class imbalances resulting from data-efficient algorithms. Comprehensive evaluations on the NAS-Bench-201 search space, DARTS search space, and MobileNet-like search space validate that BDP reduces search costs by over 50% while achieving superior performance when applied to baseline DARTS. Besides, we demonstrate that BDP can harmoniously integrate with advanced DARTS variants, like PC-DARTS and \b{eta}-DARTS, offering an approximately 2 times speedup with minimal performance compromises.


title: Towards Better Visualizing the Decision Basis of Networks via Unfold and Conquer Attribution Guidance

abstract: Revealing the transparency of Deep Neural Networks (DNNs) has been widely studied to describe the decision mechanisms of network inner structures. In this paper, we propose a novel post-hoc framework, Unfold and Conquer Attribution Guidance (UCAG), which enhances the explainability of the network decision by spatially scrutinizing the input features with respect to the model confidence. Addressing the phenomenon of missing detailed descriptions, UCAG sequentially complies with the confidence of slices of the image, leading to providing an abundant and clear interpretation. Therefore, it is possible to enhance the representation ability of explanation by preserving the detailed descriptions of assistant input features, which are commonly overwhelmed by the main meaningful regions. We conduct numerous evaluations to validate the performance in several metrics: i) deletion and insertion, ii) (energy-based) pointing games, and iii) positive and negative density maps. Experimental results, including qualitative comparisons, demonstrate that our method outperforms the existing methods with the nature of clear and detailed explanations and applicability.