title: Navigating Privacy and Copyright Challenges Across the Data Lifecycle of Generative AI

abstract: The advent of Generative AI has marked a significant milestone in artificial intelligence, demonstrating remarkable capabilities in generating realistic images, texts, and data patterns. However, these advancements come with heightened concerns over data privacy and copyright infringement, primarily due to the reliance on vast datasets for model training. Traditional approaches like differential privacy, machine unlearning, and data poisoning only offer fragmented solutions to these complex issues. Our paper delves into the multifaceted challenges of privacy and copyright protection within the data lifecycle. We advocate for integrated approaches that combines technical innovation with ethical foresight, holistically addressing these concerns by investigating and devising solutions that are informed by the lifecycle perspective. This work aims to catalyze a broader discussion and inspire concerted efforts towards data privacy and copyright integrity in Generative AI.


title: Quantum Instrumentation Control Kit -- Defect Arbitrary Waveform Generator (QICK-DAWG): A Quantum Sensing Control Framework for Quantum Defects

abstract: Quantum information communication, sensing, and computation often require complex and expensive instrumentation resulting in a large entry barrier. The Quantum Instrumentation Control Kit (QICK) overcomes this barrier for superconducting qubits with a collection of software and firmware for state-of-the-art radio frequency system on chip (RFSoC's) field programmable gate architecture (FPGA) chips. Here we present a software and firmware extension to QICK, the Quantum Instrumentation Control Kit - Defect Arbitrary Waveform Generator (QICK-DAWG), which is an open-source software and firmware package that supports full quantum control and measurement of nitrogen-vacancy defects in diamond and other quantum defects using RFSoC FPGAs. QICKDAWG extends QICK to the characterization of nitrogen-vacancy defects and other diamond quantum defects by implementing DC-1 GHz readout, AOM or gated laser control, and analog or photon counting readout options. QICK-DAWG also adds pulse sequence programs and data analysis scripts to collect and characterize photoluminescence (PL) intensity, optically detected magnetic resonance (ODMR) spectra, PL readout windows, Rabi oscillations, Ramsay interference spectra, Hahn echo spin-spin relaxation times T$_2$, and spin-lattice relaxation times T$_1$. We demonstrate that QICK-DAWG is a powerful new paradigm of open source quantum hardware that significantly lowers the entry barrier and cost for quantum sensing using quantum defects.


title: Sketch Input Method Editor: A Comprehensive Dataset and Methodology for Systematic Input Recognition

abstract: With the recent surge in the use of touchscreen devices, free-hand sketching has emerged as a promising modality for human-computer interaction. While previous research has focused on tasks such as recognition, retrieval, and generation of familiar everyday objects, this study aims to create a Sketch Input Method Editor (SketchIME) specifically designed for a professional C4I system. Within this system, sketches are utilized as low-fidelity prototypes for recommending standardized symbols in the creation of comprehensive situation maps. This paper also presents a systematic dataset comprising 374 specialized sketch types, and proposes a simultaneous recognition and segmentation architecture with multilevel supervision between recognition and segmentation to improve performance and enhance interpretability. By incorporating few-shot domain adaptation and class-incremental learning, the network's ability to adapt to new users and extend to new task-specific classes is significantly enhanced. Results from experiments conducted on both the proposed dataset and the SPG dataset illustrate the superior performance of the proposed architecture. Our dataset and code are publicly available at https://github.com/GuangmingZhu/SketchIME.


title: Accelerating Level-Value Adjustment for the Polyak Stepsize

abstract: The Polyak stepsize formula has been widely used for convex optimization. However, stepsize computations require the generally unknown optimal value. Dynamic estimations of the optimal value are thus usually needed. In this paper, guided by a decision-based procedure through a novel easy-to-solve ``Polyak Stepsize Violation Detector'' (PSVD) linear constraint satisfaction problem, a series of level values is constructed to successively estimate the optimal value to guarantee convergence for subgradient as well as for approximate subgradient methods. Through a series of empirical tests of convex optimization problems with diverse characteristics, we illustrate the practical advantages of our approach as compared to existing methods.


title: Multidimensional high-harmonic echo spectroscopy: resolving coherent electron dynamics in the EUV regime

abstract: We theoretically propose a multidimensional high-harmonic echo spectroscopy technique which utilizes strong optical fields to resolve coherent electron dynamics spanning an energy range of multiple electron Volts. Using our recently developed semi-perturbative approach, we can describe the coherent valence electron dynamics driven by a sequence of phase-matched and well separated short few-cycle strong infrared laser pulses. The recombination of tunnel-ionized electrons by each pulse coherently populates the valence states of a molecule, which allows for a direct observation of its dynamics via the high harmonic echo signal. The broad bandwidth of the effective dipole between valence states originated from the strong-field excitation results in nontrivial ultra-delayed partial rephasing echo, which is not observed in standard 2D optical spectroscopic techniques. We demonstrate the results of simulations for the anionic molecular system and show that the ultrafast valence electron dynamics can be well captured with femtosecond resolution.


title: Diffusion Models Without Attention

abstract: In recent advancements in high-fidelity image generation, Denoising Diffusion Probabilistic Models (DDPMs) have emerged as a key player. However, their application at high resolutions presents significant computational challenges. Current methods, such as patchifying, expedite processes in UNet and Transformer architectures but at the expense of representational capacity. Addressing this, we introduce the Diffusion State Space Model (DiffuSSM), an architecture that supplants attention mechanisms with a more scalable state space model backbone. This approach effectively handles higher resolutions without resorting to global compression, thus preserving detailed image representation throughout the diffusion process. Our focus on FLOP-efficient architectures in diffusion training marks a significant step forward. Comprehensive evaluations on both ImageNet and LSUN datasets at two resolutions demonstrate that DiffuSSMs are on par or even outperform existing diffusion models with attention modules in FID and Inception Score metrics while significantly reducing total FLOP usage.


title: A User-Focused Approach to Evaluating Probabilistic and Categorical Forecasts

abstract: A user-focused verification approach for evaluating probability forecasts of binary outcomes (also known as probabilistic classifiers) is demonstrated that is (i) based on proper scoring rules, (ii) focuses on user decision thresholds, and (iii) provides actionable insights. It is argued that when categorical performance diagrams and the critical success index are used to evaluate overall predictive performance, rather than the discrimination ability of probabilistic forecasts, they may produce misleading results. Instead, Murphy diagrams are shown to provide better understanding of overall predictive performance as a function of user probabilistic decision threshold. It is illustrated how to select a proper scoring rule, based on the relative importance of different user decision thresholds, and how this choice impacts scores of overall predictive performance and supporting measures of discrimination and calibration. These approaches and ideas are demonstrated using several probabilistic thunderstorm forecast systems as well as synthetic forecast data. Furthermore, a fair method for comparing the performance of probabilistic and categorical forecasts is illustrated using the FIxed Risk Multicategorical (FIRM) score, which is a proper scoring rule directly connected to values on the Murphy diagram. While the methods are illustrated using thunderstorm forecasts, they are applicable for evaluating probabilistic forecasts for any situation with binary outcomes.


title: Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectives

abstract: We present Ego-Exo4D, a diverse, large-scale multimodal multiview video dataset and benchmark challenge. Ego-Exo4D centers around simultaneously-captured egocentric and exocentric video of skilled human activities (e.g., sports, music, dance, bike repair). 740 participants from 13 cities worldwide performed these activities in 123 different natural scene contexts, yielding long-form captures from 1 to 42 minutes each and 1,286 hours of video combined. The multimodal nature of the dataset is unprecedented: the video is accompanied by multichannel audio, eye gaze, 3D point clouds, camera poses, IMU, and multiple paired language descriptions -- including a novel "expert commentary" done by coaches and teachers and tailored to the skilled-activity domain. To push the frontier of first-person video understanding of skilled human activity, we also present a suite of benchmark tasks and their annotations, including fine-grained activity understanding, proficiency estimation, cross-view translation, and 3D hand/body pose. All resources are open sourced to fuel new research in the community. Project page: http://ego-exo4d-data.org/


title: Consensus, dissensus and synergy between clinicians and specialist foundation models in radiology report generation

abstract: Radiology reports are an instrumental part of modern medicine, informing key clinical decisions such as diagnosis and treatment. The worldwide shortage of radiologists, however, restricts access to expert care and imposes heavy workloads, contributing to avoidable errors and delays in report delivery. While recent progress in automated report generation with vision-language models offer clear potential in ameliorating the situation, the path to real-world adoption has been stymied by the challenge of evaluating the clinical quality of AI-generated reports. In this study, we build a state-of-the-art report generation system for chest radiographs, $\textit{Flamingo-CXR}$, by fine-tuning a well-known vision-language foundation model on radiology data. To evaluate the quality of the AI-generated reports, a group of 16 certified radiologists provide detailed evaluations of AI-generated and human written reports for chest X-rays from an intensive care setting in the United States and an inpatient setting in India. At least one radiologist (out of two per case) preferred the AI report to the ground truth report in over 60$\%$ of cases for both datasets. Amongst the subset of AI-generated reports that contain errors, the most frequently cited reasons were related to the location and finding, whereas for human written reports, most mistakes were related to severity and finding. This disparity suggested potential complementarity between our AI system and human experts, prompting us to develop an assistive scenario in which Flamingo-CXR generates a first-draft report, which is subsequently revised by a clinician. This is the first demonstration of clinician-AI collaboration for report writing, and the resultant reports are assessed to be equivalent or preferred by at least one radiologist to reports written by experts alone in 80$\%$ of in-patient cases and 60$\%$ of intensive care cases.


title: Learning Exactly Linearizable Deep Dynamics Models

abstract: Research on control using models based on machine-learning methods has now shifted to the practical engineering stage. Achieving high performance and theoretically guaranteeing the safety of the system is critical for such applications. In this paper, we propose a learning method for exactly linearizable dynamical models that can easily apply various control theories to ensure stability, reliability, etc., and to provide a high degree of freedom of expression. As an example, we present a design that combines simple linear control and control barrier functions. The proposed model is employed for the real-time control of an automotive engine, and the results demonstrate good predictive performance and stable control under constraints.


title: The distribution of volatile elements during rocky planet formation

abstract: Core segregation and atmosphere formation are two of the major processes that redistribute the volatile elements-hydrogen (H), carbon (C), nitrogen (N), and sulfur (S)-in and around rocky planets during their formation. The volatile elements by definition accumulate in gaseous reservoirs and form atmospheres. However, under conditions of early planet formation, these elements can also behave as siderophiles (i.e., iron-loving) and become concentrated in core-forming metals. Current models of core formation suggest that metal-silicate reactions occurred over a wide pressure, temperature, and compositional space to ultimately impose the chemistries of the cores and silicate portions of rocky planets. Additionally, the solubilities of volatile elements in magmas determine their transfer between the planetary interiors and atmospheres, which has recently come into sharper focus in the context of highly irradiated, potentially molten exoplanets. Recently, there has been a significant push to experimentally investigate the metal-silicate and magma-gas exchange coefficients for volatile elements over a wide range of conditions relevant to rocky planet formation. Qualitatively, results from the metal-silicate partitioning studies suggest that cores of rocky planets could be major reservoirs of the volatile elements though significant amounts will remain in mantles. Results from solubility studies imply that under oxidizing conditions, most H and S are sequestered in the magma ocean, while most N is outgassed to the atmosphere, and C is nearly equally distributed between the atmosphere and the interior. Under reducing conditions, nearly all N dissolves in the magma ocean, the atmosphere becomes the dominant C reservoir, while H becomes more equally distributed between the interior and the atmosphere, and S remains dominantly in the interior.


title: Asymptotic stability and cut-off phenomenon for the underdamped Langevin dynamics

abstract: In this article, we provide detailed analysis of the long-time behavior of the underdamped Langevin dynamics. We first provide a necessary condition guaranteeing that the zero-noise dynamical system converges to its unique attractor. We also observed that this condition is sharp for a large class of linear models. We then prove the so-called cut-off phenomenon in the small-noise regime under this condition. This result provides the precise asymptotics of the mixing time of the process and of the distance between the distribution of the process and its stationary measure. The main difficulty of this work relies on the degeneracy of its infinitesimal generator which is not elliptic, thus requiring a new set of methods.


title: Cm$^{15+}$ and Bk$^{16+}$ ion clocks with enhanced sensitivity to new physics

abstract: We perform calculations of electronic structure of Cm$^{15+}$ and Bk$^{16+}$ ions and demonstrate that they have transitions which combine the features of atomic optical clocks with the enhanced sensitivity to the variations of the fine structure constant $\alpha$. The high sensitivity is due to large nuclear charge $Z$, high ionisation degree $Z_i$ and the effect of {\em level crossing}, which enables optical transitions between states of different configurations. These are the $6p_{1/2}-5f_{5/2} $ and $6p_{1/2}-5f_{7/2} $ transitions in the single valence electron approximation. Variation of $\alpha$ may be due to the interaction with scalar and pseudoscalar (axion) dark matter fields. Therefore, Cm$^{15+}$ and Bk$^{16+}$ clocks are promising candidates to search for these fields.


title: MCI Detection using fMRI time series embeddings of Recurrence plots

abstract: The human brain can be conceptualized as a dynamical system. Utilizing resting state fMRI time series imaging, we can study the underlying dynamics at ear-marked Regions of Interest (ROIs) to understand structure or lack thereof. This differential behavior could be key to understanding the neurodegeneration and also to classify between healthy and Mild Cognitive Impairment (MCI) subjects. In this study, we consider 6 brain networks spanning over 160 ROIs derived from Dosenbach template, where each network consists of 25-30 ROIs. Recurrence plot, extensively used to understand evolution of time series, is employed. Representative time series at each ROI is converted to its corresponding recurrence plot visualization, which is subsequently condensed to low-dimensional feature embeddings through Autoencoders. The performance of the proposed method is shown on fMRI volumes of 100 subjects (balanced data), taken from publicly available ADNI dataset. Results obtained show peak classification accuracy of 93% among the 6 brain networks, mean accuracy of 89.3% thereby illustrating promise in the proposed approach.


title: Prompt-Based Exemplar Super-Compression and Regeneration for Class-Incremental Learning

abstract: Replay-based methods in class-incremental learning (CIL) have attained remarkable success, as replaying the exemplars of old classes can significantly mitigate catastrophic forgetting. Despite their effectiveness, the inherent memory restrictions of CIL result in saving a limited number of exemplars with poor diversity, leading to data imbalance and overfitting issues. In this paper, we introduce a novel exemplar super-compression and regeneration method, ESCORT, which substantially increases the quantity and enhances the diversity of exemplars. Rather than storing past images, we compress images into visual and textual prompts, e.g., edge maps and class tags, and save the prompts instead, reducing the memory usage of each exemplar to 1/24 of the original size. In subsequent learning phases, diverse high-resolution exemplars are generated from the prompts by a pre-trained diffusion model, e.g., ControlNet. To minimize the domain gap between generated exemplars and real images, we propose partial compression and diffusion-based data augmentation, allowing us to utilize an off-the-shelf diffusion model without fine-tuning it on the target dataset. Therefore, the same diffusion model can be downloaded whenever it is needed, incurring no memory consumption. Comprehensive experiments demonstrate that our method significantly improves model performance across multiple CIL benchmarks, e.g., 5.0 percentage points higher than the previous state-of-the-art on 10-phase Caltech-256 dataset.


title: Extensible positive loops and vanishing of symplectic cohomology

abstract: The symplectic cohomology of certain symplectic manifolds $W$ with non-compact ends modelled on the positive symplectization of a compact contact manifold $Y$ is shown to vanish whenever there is a positive loop of contactomorphisms of $Y$ which extends to a loop of Hamiltonian diffeomorphisms of $W$. An open string version of this result is also proved: the wrapped Floer cohomology of a Lagrangian $L$ with ideal Legendrian boundary $\Lambda$ is shown to vanish if there is a positive loop $\Lambda_{t}$ based at $\Lambda$ which extends to an exact loop of Lagrangians based at $L$. Various examples of such loops are considered. Applications include the construction of exotic compactly supported symplectomorphisms and exotic fillings of $\Lambda$.


title: An Explorative Study on Document Type Assignment of Review Articles in Web of Science, Scopus and Journals' Website

abstract: Accurately assigning the document type of review articles in citation index databases like Web of Science(WoS) and Scopus is important. This study aims to investigate the document type assignation of review articles in web of Science, Scopus and Journals' website in a large scale. 27,616 papers from 160 journals from 10 review journal series indexed in SCI are analyzed. The document types of these papers labeled on journals' website, and assigned by WoS and Scopus are retrieved and compared to determine the assigning accuracy and identify the possible reasons of wrongly assigning. For the document type labeled on the website, we further differentiate them into explicit review and implicit review based on whether the website directly indicating it is review or not. We find that WoS and Scopus performed similarly, with an average precision of about 99% and recall of about 80%. However, there were some differences between WoS and Scopus across different journal series and within the same journal series. The assigning accuracy of WoS and Scopus for implicit reviews dropped significantly. This study provides a reference for the accuracy of document type assigning of review articles in WoS and Scopus, and the identified pattern for assigning implicit reviews may be helpful to better labeling on website, WoS and Scopus.


title: The impact of sensory characteristics on the willingness to pay for honey

abstract: Honey consumption in Russia has been actively growing in recent years due to the increasing interest in healthy and environment-friendly food products. However, it remains an open question which characteristics of honey are the most significant for consumers and, more importantly, from an economic point of view, for which of them consumers are willing to pay. The purpose of this study was to investigate the role of sensory characteristics in assessing consumers' willingness to pay for honey and to determine which properties and characteristics "natural" honey should have to encourage repeated purchases by target consumers. The study involved a behavioral experiment that included a pre-test questionnaire, blind tasting of honey samples, an in-room test to assess perceived quality, and a closed auction using the Becker-DeGroote-Marschak method. As the result, it was revealed that the correspondence of the expected sensations to the actual taste, taste intensity, duration of the aftertaste and the sensations of tickling in the throat had a positive effect on both the perceived quality of the product and the willingness to pay for it, while perception of off-flavors or added sugar had a negative impact. Using factor analysis, we have combined 21 sensory characteristics of honey into eight components that were sufficient to obtain the flavor portrait of honey by Russian consumers.


title: Beyond Entropy: Style Transfer Guided Single Image Continual Test-Time Adaptation

abstract: Continual test-time adaptation (cTTA) methods are designed to facilitate the continual adaptation of models to dynamically changing real-world environments where computational resources are limited. Due to this inherent limitation, existing approaches fail to simultaneously achieve accuracy and efficiency. In detail, when using a single image, the instability caused by batch normalization layers and entropy loss significantly destabilizes many existing methods in real-world cTTA scenarios. To overcome these challenges, we present BESTTA, a novel single image continual test-time adaptation method guided by style transfer, which enables stable and efficient adaptation to the target environment by transferring the style of the input image to the source style. To implement the proposed method, we devise BeIN, a simple yet powerful normalization method, along with the style-guided losses. We demonstrate that BESTTA effectively adapts to the continually changing target environment, leveraging only a single image on both semantic segmentation and image classification tasks. Remarkably, despite training only two parameters in a BeIN layer consuming the least memory, BESTTA outperforms existing state-of-the-art methods in terms of performance.


title: A Gell-Mann & Low Theorem Perspective on Quantum Computing: New Paradigm for Designing Quantum Algorithm

abstract: The Gell-Mann & Low theorem is a cornerstone of Quantum Field Theory (QFT) and condensed matter physics, and many-body perturbation theory is a foundational tool for treating interactions. However, their integration into quantum algorithms remains a largely unexplored area of research, with current quantum simulation algorithms predominantly operating in the Schr\"odinger picture, leaving the potential of the interaction picture largely untapped. Our Variational Interaction-Picture S-matrix Ansatz (VIPSA) now fills this gap, specifically in the context of the Fermi-Hubbard model -- a canonical paradigm in condensed matter physics which is intricately connected to phenomena such as high-temperature superconductivity and Mott insulator transitions. This work offers a new conceptual perspective for variational quantum computing based upon the Gell-Mann & Low theorem. We achieve this by employing an innovative mathematical technique to explicitly unfold the normalized S-matrix, thereby enabling the systematic reconstruction of the Dyson series on a quantum computer, order by order. This method stands in contrast to the conventional reliance on Trotter expansion for adiabatic time evolution, marking a conceptual shift towards more sophisticated quantum algorithmic design. We leverage the strengths of the recently developed ADAPT-VQE algorithm, tailoring it to reconstruct perturbative terms effectively. Our simulations indicate that this method not only successfully recovers the Dyson series but also exhibits robust and stable convergence. We believe that our approach shows great promise in generalizing to more complex scenarios without increasing algorithmic complexity.


title: Topological Directional Coupler

abstract: Interferometers and beam splitters are fundamental building blocks for photonic neuromorphic and quantum computing machinery. In waveguide-based photonic integrated circuits, beam-splitting is achieved with directional couplers that rely on transition regions where the waveguides are adiabatically bent to suppress back-reflection. We present a novel, compact approach to introducing guided mode coupling. By leveraging multimodal domain walls between microwave topological photonic crystals, we use the photonic-spin-conservation to suppress back-reflection while relaxing the topological protection of the valley degree of freedom to implement tunable beam splitting. Rapid advancements in chip-scale topological photonics suggest that the proposed simultaneous utilization of multiple topological degrees of freedom could benefit the development of novel photonic computing platforms.


title: HKUST at SemEval-2023 Task 1: Visual Word Sense Disambiguation with Context Augmentation and Visual Assistance

abstract: Visual Word Sense Disambiguation (VWSD) is a multi-modal task that aims to select, among a batch of candidate images, the one that best entails the target word's meaning within a limited context. In this paper, we propose a multi-modal retrieval framework that maximally leverages pretrained Vision-Language models, as well as open knowledge bases and datasets. Our system consists of the following key components: (1) Gloss matching: a pretrained bi-encoder model is used to match contexts with proper senses of the target words; (2) Prompting: matched glosses and other textual information, such as synonyms, are incorporated using a prompting template; (3) Image retrieval: semantically matching images are retrieved from large open datasets using prompts as queries; (4) Modality fusion: contextual information from different modalities are fused and used for prediction. Although our system does not produce the most competitive results at SemEval-2023 Task 1, we are still able to beat nearly half of the teams. More importantly, our experiments reveal acute insights for the field of Word Sense Disambiguation (WSD) and multi-modal learning. Our code is available on GitHub.


title: Semiparametric Efficient Inference in Adaptive Experiments

abstract: We consider the problem of efficient inference of the Average Treatment Effect in a sequential experiment where the policy governing the assignment of subjects to treatment or control can change over time. We first provide a central limit theorem for the Adaptive Augmented Inverse-Probability Weighted estimator, which is semiparametric efficient, under weaker assumptions than those previously made in the literature. This central limit theorem enables efficient inference at fixed sample sizes. We then consider a sequential inference setting, deriving both asymptotic and nonasymptotic confidence sequences that are considerably tighter than previous methods. These anytime-valid methods enable inference under data-dependent stopping times (sample sizes). Additionally, we use propensity score truncation techniques from the recent off-policy estimation literature to reduce the finite sample variance of our estimator without affecting the asymptotic variance. Empirical results demonstrate that our methods yield narrower confidence sequences than those previously developed in the literature while maintaining time-uniform error control.


title: Anomalous Electromagnetic Induction Engendered by Singular Gauge Transformation

abstract: The Berry curvature, resembling the magnetic field in reciprocal space, offers a captivating avenue for exploring unique electromagnetic phenomena devoid of real-space analogs. Here, we investigate the emergent electromagnetic induction by solenoidal Berry curvature with its field lines forming loops, links, and knots. In stark contrast to Faraday's law, which dictates that alternating magnetic fields yield alternating electric fields with a net zero average, the alternating Berry curvature can engender directional electromagnetic induction. Such an effect is attributed to the presence of singularities in the Berry curvature, accompanied by a $2\pi$ jump in the Berry flux. Notably, this jump does not trigger a diamagnetic impulse, due to the gauge invariance of the Berry phase modulo $2\pi$. Consequently, the induced electric field maintains finite values under time averaging, manifesting itself as a directional pumping current. Our research sheds light on an anomalous electromagnetic induction effect directly arising from the singular gauge transformation, thereby expanding our comprehension of exotic electromagnetic phenomena.


title: 3D carbon allotropes: Topological quantum materials with obstructed atomic insulating phases, multiple bulk-boundary correspondences, and real topology

abstract: The study of topological phases with unconventional bulk-boundary correspondences and nontrivial real Chern number has garnered significant attention in the topological states of matter. Using the first-principle calculations and theoretical analysis, we perform a high-throughput material screening of the 3D obstructed atomic insulators (OAIs) and 3D real Chern insulators (RCIs) based on the Samara Carbon Allotrope Database (SACADA). Results show that 422 out of 703 3D carbon allotropes are 3D OAIs with multiple bulk-boundary correspondences, including 2D obstructed surface states (OSSs) and 1D hinge states, which are in one dimension and two dimensions lower than the 3D bulk, respectively. The 2D OSSs in these OAIs can be modified when subjected to appropriate boundaries, which benefits the investigation of surface engineering and the development of efficient topological catalysts. These 422 OAIs, which have 2D and 1D boundary states, are excellent platforms for multi-dimensional topological boundaries research. Remarkably, 138 of 422 OAIs are also 3D RCIs, which show a nontrivial real topology in the protection of spacetime inversion symmetry. Our work not only provides a comprehensive list of 3D carbon-based OAIs and RCIs, but also guides their application in various aspects based on multiple bulk-boundary correspondences and real topological phases.


title: Revisiting the two-sample location shift model with a log-concavity assumption

abstract: In this paper, we consider the two-sample location shift model, a classic semiparametric model introduced by Stein (1956). This model is known for its adaptive nature, enabling nonparametric estimation with full parametric efficiency. Existing nonparametric estimators of the location shift often depend on external tuning parameters, which restricts their practical applicability (Van der Vaart and Wellner, 2021). We demonstrate that introducing an additional assumption of log-concavity on the underlying density can alleviate the need for tuning parameters. We propose a one step estimator for location shift estimation, utilizing log-concave density estimation techniques to facilitate tuning-free estimation of the efficient influence function. While we employ a truncated version of the one step estimator for theoretical adaptivity, our simulations indicate that the one step estimators perform best with zero truncation, eliminating the need for tuning during practical implementation.


title: Sculpting ultrastrong light-matter coupling through spatial matter structuring

abstract: The central theme of cavity quantum electrodynamics is the coupling of a single optical mode with a single matter excitation, leading to a doublet of cavity polaritons which govern the optical properties of the coupled structure. Especially in the ultrastrong coupling regime, where the ratio of the vacuum Rabi frequency and the quasi-resonant carrier frequency of light, $\Omega_{\mathrm R}/\omega_{\mathrm c}$, approaches unity, the polariton doublet bridges a large spectral bandwidth $2\Omega_{\mathrm R}$, and further interactions with off-resonant light and matter modes may occur. The resulting multi-mode coupling has recently attracted attention owing to the additional degrees of freedom for designing light-matter coupled resonances, despite added complexity. Here, we experimentally implement a novel strategy to sculpt ultrastrong multi-mode coupling by tailoring the spatial overlap of multiple modes of planar metallic THz resonators and the cyclotron resonances of Landau-quantized two-dimensional electrons, on subwavelength scales. We show that similarly to the selection rules of classical optics, this allows us to suppress or enhance certain coupling pathways and to control the number of light-matter coupled modes, their octave-spanning frequency spectra, and their response to magnetic tuning. This offers novel pathways for controlling dissipation, tailoring quantum light sources, nonlinearities, correlations as well as entanglement in quantum information processing.


title: The essential bound of a polymatroid and its applications to excluded minor problems

abstract: The singleton and doubleton minors of a polymatroid $\rho$ encode a surprising amount of information about the structural complexity of $\rho$. Given any polymatroid $\rho$, we can subtract from it a maximally-separated polymatroid, resulting in a $k$-polymatroid. We introduce a notion of boundedness for $\rho$ that corresponds to $k$. Our results provide an organized framework for thinking about polymatroid excluded minor problems. In particular, let $\mathcal{C}$ denote the minor-closed class of matroids characterized by excluding the uniform matroid $U_{2,b}$ and its dual $U_{b-2,b}$. We show that the list of excluded minors for the class of $k$-polymatroids whose $k$-natural matroids are in $\mathcal{C}$ is finite. We also investigate the more general case of excluding $U_{a,b}$ and its dual $U_{b-a,b}$.


title: An Equivariant Generalization of McDuff's Theorem

abstract: In 1976, Kan and Thurston proved the theorem that any path-connected space $X$ is homology equivalent to the classifying space of some discrete group $G$. In 1979, McDuff proved a homotopy version of it: any path-connected space $X$ has the same weak homotopy type as the classifying space of some discrete monoid $M$. In 1984, Fiedorowicz reproved McDuff's theorem using a largely categorical construction. In this paper we will generalize Fiedorowicz's proof of McDuff's theorem to the equivariant case. Precisely, we will prove that any $G$-connected space $X$ with a $G$-fixed basepoint $x_0$ has the same weak homotopy type as the classifying space of some discrete $G$-monoid.


title: Utilizing Radiomic Feature Analysis For Automated MRI Keypoint Detection: Enhancing Graph Applications

abstract: Graph neural networks (GNNs) present a promising alternative to CNNs and transformers in certain image processing applications due to their parameter-efficiency in modeling spatial relationships. Currently, a major area of research involves the converting non-graph input data for GNN-based models, notably in scenarios where the data originates from images. One approach involves converting images into nodes by identifying significant keypoints within them. Super-Retina, a semi-supervised technique, has been utilized for detecting keypoints in retinal images. However, its limitations lie in the dependency on a small initial set of ground truth keypoints, which is progressively expanded to detect more keypoints. Having encountered difficulties in detecting consistent initial keypoints in brain images using SIFT and LoFTR, we proposed a new approach: radiomic feature-based keypoint detection. Demonstrating the anatomical significance of the detected keypoints was achieved by showcasing their efficacy in improving registration processes guided by these keypoints. Subsequently, these keypoints were employed as the ground truth for the keypoint detection method (LK-SuperRetina). Furthermore, the study showcases the application of GNNs in image matching, highlighting their superior performance in terms of both the number of good matches and confidence scores. This research sets the stage for expanding GNN applications into various other applications, including but not limited to image classification, segmentation, and registration.


title: Pressure-Modulated Structural and Magnetic Phase Transitions in Two-Dimensional FeTe: Tetragonal and Hexagonal Polymorphs

abstract: Two-dimensional (2D) Fe-chalcogenides with rich structures, magnetisms and superconductivities are highly desirable to reveal the torturous transition mechanism and explore their potential applications in spintronics and nanoelectronics. Hydrostatic pressure can effectively stimulate novel phase transitions between various ordered states and to plot the seductive phase diagram. Herein, the structural evolution and transport characteristics of 2D FeTe were systematically investigated under extreme conditions through comparing two distinct symmetries, i.e., tetragonal (t-) and hexagonal (h-) FeTe. We found that 2D t-FeTe presented the pressure-induced transition from antiferromagnetic to ferromagnetic states at ~ 3 GPa, corresponding to the tetragonal collapse of layered structure. Contrarily, ferromagnetic order of 2D h-FeTe was retained up to 15 GPa, evidently confirmed by electrical transport and Raman measurements. Furthermore, the detailed P-T phase diagrams of both 2D t-FeTe and h-FeTe were mapped out with the delicate critical conditions. We believe our results can provide a unique platform to elaborate the extraordinary physical properties of Fe-chalcogenides and further to develop their practical applications.


title: The two square root laws of market impact and the role of sophisticated market participants

abstract: The goal of this paper is to disentangle the roles of volume and of participation rate in the price response of the market to a sequence of transactions. To do so, we are inspired the methodology introduced in arXiv:1402.1288, arXiv:1805.07134 where price dynamics are derived from order flow dynamics using no arbitrage assumptions. We extend this approach by taking into account a sophisticated market participant having superior abilities to analyse market dynamics. Our results lead to the recovery of two square root laws: (i) For a given participation rate, during the execution of a metaorder, the market impact evolves in a square root manner with respect to the cumulated traded volume. (ii) For a given executed volume $Q$, the market impact is proportional to $\sqrt{\gamma}$, where $\gamma$ denotes the participation rate, for $\gamma$ large enough. Smaller participation rates induce a more linear dependence of the market impact in the participation rate.


title: The Complement of the Djokovic-Winkler Relation

abstract: The Djokovi\'{c}-Winkler relation $\Theta$ is a binary relation defined on the edge set of a given graph that is based on the distances of certain vertices and which plays a prominent role in graph theory. In this paper, we explore the relatively uncharted ``reflexive complement'' $\overline\Theta$ of $\Theta$, where $(e,f)\in \overline\Theta$ if and only if $e=f$ or $(e,f)\notin \Theta$ for edges $e$ and $f$. We establish the relationship between $\overline\Theta$ and the set $\Delta_{ef}$, comprising the distances between the vertices of $e$ and $f$ and shed some light on the intricacies of its transitive closure $\overline\Theta^*$. Notably, we demonstrate that $\overline\Theta^*$ exhibits multiple equivalence classes only within a restricted subclass of complete multipartite graphs. In addition, we characterize non-trivial relations $R$ that coincide with $\overline\Theta$ as those where the graph representation is disconnected, with each connected component being the (join of) Cartesian product of complete graphs. The latter results imply, somewhat surprisingly, that knowledge about the distances between vertices is not required to determine $\overline\Theta^*$. Moreover, $\overline\Theta^*$ has either exactly one or three equivalence classes.


title: Co-speech gestures for human-robot collaboration

abstract: Collaboration between human and robot requires effective modes of communication to assign robot tasks and coordinate activities. As communication can utilize different modalities, a multi-modal approach can be more expressive than single modal models alone. In this work we propose a co-speech gesture model that can assign robot tasks for human-robot collaboration. Human gestures and speech, detected by computer vision and speech recognition, can thus refer to objects in the scene and apply robot actions to them. We present an experimental evaluation of the multi-modal co-speech model with a real-world industrial use case. Results demonstrate that multi-modal communication is easy to achieve and can provide benefits for collaboration with respect to single modal tools.


title: SimulFlow: Simultaneously Extracting Feature and Identifying Target for Unsupervised Video Object Segmentation

abstract: Unsupervised video object segmentation (UVOS) aims at detecting the primary objects in a given video sequence without any human interposing. Most existing methods rely on two-stream architectures that separately encode the appearance and motion information before fusing them to identify the target and generate object masks. However, this pipeline is computationally expensive and can lead to suboptimal performance due to the difficulty of fusing the two modalities properly. In this paper, we propose a novel UVOS model called SimulFlow that simultaneously performs feature extraction and target identification, enabling efficient and effective unsupervised video object segmentation. Concretely, we design a novel SimulFlow Attention mechanism to bridege the image and motion by utilizing the flexibility of attention operation, where coarse masks predicted from fused feature at each stage are used to constrain the attention operation within the mask area and exclude the impact of noise. Because of the bidirectional information flow between visual and optical flow features in SimulFlow Attention, no extra hand-designed fusing module is required and we only adopt a light decoder to obtain the final prediction. We evaluate our method on several benchmark datasets and achieve state-of-the-art results. Our proposed approach not only outperforms existing methods but also addresses the computational complexity and fusion difficulties caused by two-stream architectures. Our models achieve 87.4% J & F on DAVIS-16 with the highest speed (63.7 FPS on a 3090) and the lowest parameters (13.7 M). Our SimulFlow also obtains competitive results on video salient object detection datasets.


title: Dispersed Structured Light for Hyperspectral 3D Imaging

abstract: Hyperspectral 3D imaging aims to acquire both depth and spectral information of a scene. However, existing methods are either prohibitively expensive and bulky or compromise on spectral and depth accuracy. In this work, we present Dispersed Structured Light (DSL), a cost-effective and compact method for accurate hyperspectral 3D imaging. DSL modifies a traditional projector-camera system by placing a sub-millimeter thick diffraction grating film front of the projector. The grating disperses structured light based on light wavelength. To utilize the dispersed structured light, we devise a model for dispersive projection image formation and a per-pixel hyperspectral 3D reconstruction method. We validate DSL by instantiating a compact experimental prototype. DSL achieves spectral accuracy of 18.8nm full-width half-maximum (FWHM) and depth error of 1mm. We demonstrate that DSL outperforms prior work on practical hyperspectral 3D imaging. DSL promises accurate and practical hyperspectral 3D imaging for diverse application domains, including computer vision and graphics, cultural heritage, geology, and biology.


title: CosAvatar: Consistent and Animatable Portrait Video Tuning with Text Prompt

abstract: Recently, text-guided digital portrait editing has attracted more and more attentions. However, existing methods still struggle to maintain consistency across time, expression, and view or require specific data prerequisites. To solve these challenging problems, we propose CosAvatar, a high-quality and user-friendly framework for portrait tuning. With only monocular video and text instructions as input, we can produce animatable portraits with both temporal and 3D consistency. Different from methods that directly edit in the 2D domain, we employ a dynamic NeRF-based 3D portrait representation to model both the head and torso. We alternate between editing the video frames' dataset and updating the underlying 3D portrait until the edited frames reach 3D consistency. Additionally, we integrate the semantic portrait priors to enhance the edited results, allowing precise modifications in specified semantic areas. Extensive results demonstrate that our proposed method can not only accurately edit portrait styles or local attributes based on text instructions but also support expressive animation driven by a source video.


title: Size of the largest sum-free subset of $[n]^3$, $[n]^4$, and $[n]^5$

abstract: We determine the density of the largest sum-free subset of the lattice cube $\{1, 2, \dots, n\}^d$ for $d \in \{3, 4, 5\}$. This solves a conjecture of Cameron and Aydinian in dimensions $3$, $4$, and $5$.


title: Constrained HRT Surfaces and their Entropic Interpretation

abstract: Consider two boundary subregions $A$ and $B$ that lie in a common boundary Cauchy surface, and consider also the associated HRT surface $\gamma_B$ for $B$. In that context, the constrained HRT surface $\gamma_{A:B}$ can be defined as the codimension-2 bulk surface anchored to $A$ that is obtained by a maximin construction restricted to Cauchy slices containing $\gamma_B$. As a result, $\gamma_{A:B}$ is the union of two pieces, $\gamma^B_{A:B}$ and $\gamma^{\bar B}_{A:B}$ lying respectively in the entanglement wedges of $B$ and its complement $\bar B$. Unlike the area $\mathcal{A}\left(\gamma_A\right)$ of the HRT surface $\gamma_A$, at least in the semiclassical limit, the area $\mathcal{A}\left(\gamma_{A:B}\right)$ of $\gamma_{A:B}$ commutes with the area $\mathcal{A}\left(\gamma_B\right)$ of $\gamma_B$. To study the entropic interpretation of $\mathcal{A}\left(\gamma_{A:B}\right)$, we analyze the R\'enyi entropies of subregion $A$ in a fixed-area state of subregion $B$. We use the gravitational path integral to show that the $n\approx1$ R\'enyi entropies are then computed by minimizing $\mathcal{A}\left(\gamma_A\right)$ over spacetimes defined by a boost angle conjugate to $\mathcal{A}\left(\gamma_B\right)$. In the case where the pieces $\gamma^B_{A:B}$ and $\gamma^{\bar B}_{A:B}$ intersect at a constant boost angle, a geometric argument shows that the $n\approx1$ R\'enyi entropy is then given by $\frac{\mathcal{A}(\gamma_{A:B})}{4G}$. We discuss how the $n\approx1$ R\'enyi entropy differs from the von Neumann entropy due to a lack of commutativity of the $n\to1$ and $G\to0$ limits. We also discuss how the behaviour changes as a function of the width of the fixed-area state. Our results are relevant to some of the issues associated with attempts to use standard random tensor networks to describe time dependent geometries.


title: TLDR: Text Based Last-layer Retraining for Debiasing Image Classifiers

abstract: A classifier may depend on incidental features stemming from a strong correlation between the feature and the classification target in the training dataset. Recently, Last Layer Retraining (LLR) with group-balanced datasets is known to be efficient in mitigating the spurious correlation of classifiers. However, the acquisition of group-balanced datasets is costly, which hinders the applicability of the LLR method. In this work, we propose to perform LLR based on text datasets built with large language models for a general image classifier. We demonstrate that text can be a proxy for its corresponding image beyond the image-text joint embedding space, such as CLIP. Based on this, we use generated texts to train the final layer in the embedding space of the arbitrary image classifier. In addition, we propose a method of filtering the generated words to get rid of noisy, imprecise words, which reduces the effort of inspecting each word. We dub these procedures as TLDR (\textbf{T}ext-based \textbf{L}ast layer retraining for \textbf{D}ebiasing image classifie\textbf{R}s) and show our method achieves the performance that is comparable to those of the LLR methods that also utilize group-balanced image dataset for retraining. Furthermore, TLDR outperforms other baselines that involve training the last linear layer without a group annotated dataset.


title: Linear-quadratic Mean Field Control with Non-convex Data

abstract: In this manuscript, we study a class of linear-quadratic (LQ) mean field control problems with a common noise and their corresponding $N$-particle systems. The mean field control problems considered are not standard LQ mean field control problems in the sense that their dependence on the mean field terms can be non-linear and non-convex. Therefore, all the existing methods to deal with LQ mean field control problems fail. The key idea to solve our LQ mean field control problem is to utilize the common noise. We first prove the global well-posedness of the corresponding Hamilton-Jacobi equations via the non-degeneracy of the common noise. In contrast to the LQ mean field games master equations, the Hamilton-Jacobi equations for the LQ mean field control problems can not be reduced to finite-dimensional PDEs. We then globally solve the Hamilton-Jacobi equations for $N$-particle systems. As byproducts, we derive the optimal quantitative convergence results from the $N$-particle systems to the mean field control problem and the propagation of chaos property for the related optimal trajectories. This paper extends the results in [{\sc M. Li, C. Mou, Z. Wu and C. Zhou}, \emph{Trans. Amer. Math. Soc.}, 376(06) (2023), pp.~4105--4143] to the LQ mean field control problems.


title: Dynamical relaxation of a long-range XY chain

abstract: We study the universal real-time relaxation behaviors of a long-range quantum XY chain following a quench. Our research includes both the noncritical and critical quench. In the case of noncritical quench, i.e., neither the initial state nor the postquench Hamiltonian is at a critical point of equilibrium phase transition, a quench to the commensurate phase or incommensurate phase gives a scaling of $t^{-3/2}$ or $t^{-1/2}$, respectively, which is the same as the counterpart of the short-range XY model. However, for a quench to the boundary line between the commensurate and incommensurate phases, the scaling law $t^{-\mu}$ may be different from the $t^{-3/4}$ law of the counterpart of the short-range model. More interestingly, the decaying exponent $\mu$ may depend on the choice of the parameters of the postquench Hamiltonian because of the different asymptotic behaviors of the energy spectrum. Furthermore, in certain cases, the scaling behavior may be outside the range of predictions made by the stationary phase approximation, because an inflection point emerges in the energy spectrum. For the critical quench, i.e., the initial state or the postquench Hamiltonian is at a critical point of equilibrium phase transition, the aforementioned scaling law $t^{-\mu}$ may be changed because of the gap-closing property of the energy spectrum of the critical point.


title: Multivariate Unified Skew-t Distributions And Their Properties

abstract: The unified skew-t (SUT) is a flexible parametric multivariate distribution that accounts for skewness and heavy tails in the data. A few of its properties can be found scattered in the literature or in a parameterization that does not follow the original one for unified skew-normal (SUN) distributions, yet a systematic study is lacking. In this work, explicit properties of the multivariate SUT distribution are presented, such as its stochastic representations, moments, SUN-scale mixture representation, linear transformation, additivity, marginal distribution, canonical form, quadratic form, conditional distribution, change of latent dimensions, Mardia measures of multivariate skewness and kurtosis, and non-identifiability issue. These results are given in a parametrization that reduces to the original SUN distribution as a sub-model, hence facilitating the use of the SUT for applications. Several models based on the SUT distribution are provided for illustration.


title: Almost-Linear Time Algorithms for Incremental Graphs: Cycle Detection, SCCs, $s$-$t$ Shortest Path, and Minimum-Cost Flow

abstract: We give the first almost-linear time algorithms for several problems in incremental graphs including cycle detection, strongly connected component maintenance, $s$-$t$ shortest path, maximum flow, and minimum-cost flow. To solve these problems, we give a deterministic data structure that returns a $m^{o(1)}$-approximate minimum-ratio cycle in fully dynamic graphs in amortized $m^{o(1)}$ time per update. Combining this with the interior point method framework of Brand-Liu-Sidford (STOC 2023) gives the first almost-linear time algorithm for deciding the first update in an incremental graph after which the cost of the minimum-cost flow attains value at most some given threshold $F$. By rather direct reductions to minimum-cost flow, we are then able to solve the problems in incremental graphs mentioned above. At a high level, our algorithm dynamizes the $\ell_1$ oblivious routing of Rozho\v{n}-Grunau-Haeupler-Zuzic-Li (STOC 2022), and develops a method to extract an approximate minimum ratio cycle from the structure of the oblivious routing. To maintain the oblivious routing, we use tools from concurrent work of Kyng-Meierhans-Probst Gutenberg which designed vertex sparsifiers for shortest paths, in order to maintain a sparse neighborhood cover in fully dynamic graphs. To find a cycle, we first show that an approximate minimum ratio cycle can be represented as a fundamental cycle on a small set of trees resulting from the oblivious routing. Then, we find a cycle whose quality is comparable to the best tree cycle. This final cycle query step involves vertex and edge sparsification procedures reminiscent of previous works, but crucially requires a more powerful dynamic spanner which can handle far more edge insertions. We build such a spanner via a construction that hearkens back to the classic greedy spanner algorithm.


title: Perceptual Group Tokenizer: Building Perception with Iterative Grouping

abstract: Human visual recognition system shows astonishing capability of compressing visual information into a set of tokens containing rich representations without label supervision. One critical driving principle behind it is perceptual grouping. Despite being widely used in computer vision in the early 2010s, it remains a mystery whether perceptual grouping can be leveraged to derive a neural visual recognition backbone that generates as powerful representations. In this paper, we propose the Perceptual Group Tokenizer, a model that entirely relies on grouping operations to extract visual features and perform self-supervised representation learning, where a series of grouping operations are used to iteratively hypothesize the context for pixels or superpixels to refine feature representations. We show that the proposed model can achieve competitive performance compared to state-of-the-art vision architectures, and inherits desirable properties including adaptive computation without re-training, and interpretability. Specifically, Perceptual Group Tokenizer achieves 80.3% on ImageNet-1K self-supervised learning benchmark with linear probe evaluation, marking a new progress under this paradigm.


title: TrustMark: Universal Watermarking for Arbitrary Resolution Images

abstract: Imperceptible digital watermarking is important in copyright protection, misinformation prevention, and responsible generative AI. We propose TrustMark - a GAN-based watermarking method with novel design in architecture and spatio-spectra losses to balance the trade-off between watermarked image quality with the watermark recovery accuracy. Our model is trained with robustness in mind, withstanding various in- and out-place perturbations on the encoded image. Additionally, we introduce TrustMark-RM - a watermark remover method useful for re-watermarking. Our methods achieve state-of-art performance on 3 benchmarks comprising arbitrary resolution images.


title: Search for light long-lived neutral particles from Higgs boson decays via vector-boson-fusion production from $pp$ collisions at $\sqrt{s}=13$ TeV with the ATLAS detector

abstract: A search is reported for long-lived dark photons with masses between 0.1 GeV and 15 GeV, from exotic decays of Higgs bosons produced via vector-boson-fusion. Events that contain displaced collimated Standard Model fermions reconstructed in the calorimeter or muon spectrometer are probed. This search uses the full LHC Run 2 (2015-2018) data sample collected in proton-proton collisions at $\sqrt{s}=13$ TeV, corresponding to an integrated luminosity of 139 $fb^{-1}$. Dominant backgrounds from Standard Model processes and non-collision sources are estimated by using data-driven techniques. The observed event yields in the signal regions are consistent with the expected background. Upper limits on the Higgs boson to dark photon branching fraction are reported as a function of the dark-photon mean proper decay length or of the dark-photon mass and the coupling between the Standard Model and the potential dark sector. This search is combined with previous ATLAS searches obtained in the gluon-gluon fusion and \textit{WH} production modes. A branching fraction above 10\% is excluded at 95\% CL for a 125 GeV Higgs boson decaying into two dark photons for dark-photon mean proper decay lengths between 173 and 1296 mm and mass of 10 GeV.


title: Reconstructing the normal and shape at specularities in endoscopy

abstract: Specularities are numerous in endoscopic images. They occur as many white small elliptic spots, which are generally ruled out as nuisance in image analysis and computer vision methods. Instead, we propose to use specularities as cues for 3D perception. Specifically, we propose a new method to reconstruct, at each specularity, the observed tissue's normal direction (i.e., its orientation) and shape (i.e., its curvature) from a single image. We show results on simulated and real interventional images.


title: Multi-label Annotation for Visual Multi-Task Learning Models

abstract: Deep learning requires large amounts of data, and a well-defined pipeline for labeling and augmentation. Current solutions support numerous computer vision tasks with dedicated annotation types and formats, such as bounding boxes, polygons, and key points. These annotations can be combined into a single data format to benefit approaches such as multi-task models. However, to our knowledge, no available labeling tool supports the export functionality for a combined benchmark format, and no augmentation library supports transformations for the combination of all. In this work, these functionalities are presented, with visual data annotation and augmentation to train a multi-task model (object detection, segmentation, and key point extraction). The tools are demonstrated in two robot perception use cases.


title: Rainbow common graphs must be forests

abstract: We study the rainbow version of the graph commonness property: a graph $H$ is $r$-rainbow common if the number of rainbow copies of $H$ (where all edges have distinct colors) in an $r$-coloring of edges of $K_n$ is maximized asymptotically by independently coloring each edge uniformly at random. $H$ is \emph{$r$-rainbow uncommon} otherwise. We show that if $H$ has a cycle, then it is $r$-rainbow uncommon for every $r$ at least the number of edges of $H$. This generalizes a result of Erd\H{o}s and Hajnal, and proves a conjecture of De Silva, Si, Tait, Tun\c{c}bilek, Yang, and Young.


title: Topological 5d $\mathcal {N} = 2$ Gauge Theory: Novel Floer Homologies, their Dualities, and an $A_\infty$-category of Three-Manifolds

abstract: We show how one can define novel gauge-theoretic Floer homologies of four, three and two-manifolds from the physics of a certain topologically-twisted 5d ${\cal N}=2$ gauge theory via its supersymmetric quantum mechanics interpretation. They are associated with Vafa-Witten, Hitchin and $G_{\mathbb{C}}$-BF configurations on the four, three and two-manifolds, respectively. We also show how one can define novel symplectic Floer homologies of Hitchin spaces, which in turn will allow us to derive novel Atiyah-Floer correspondences that relate our gauge-theoretic Floer homologies to symplectic intersection Floer homologies of Higgs bundles. Furthermore, topological invariance and 5d "S-duality" suggest a web of relations and a Langlands duality amongst these novel Floer homologies and their loop/toroidal group generalizations. Last but not least, via a 2d gauged Landau-Ginzburg model interpretation of the 5d theory, we derive, from the soliton string theory that it defines and the 5d partition function, a Fukaya-Seidel type $A_\infty$-category of Hitchin configurations on three-manifolds and its novel Atiyah-Floer correspondence. Our work therefore furnishes purely physical proofs and generalizations of the mathematical conjectures of Haydys [1], Abouzaid-Manolescu [2], and Bousseau [3], and more.


title: OmniMotionGPT: Animal Motion Generation with Limited Data

abstract: Our paper aims to generate diverse and realistic animal motion sequences from textual descriptions, without a large-scale animal text-motion dataset. While the task of text-driven human motion synthesis is already extensively studied and benchmarked, it remains challenging to transfer this success to other skeleton structures with limited data. In this work, we design a model architecture that imitates Generative Pretraining Transformer (GPT), utilizing prior knowledge learned from human data to the animal domain. We jointly train motion autoencoders for both animal and human motions and at the same time optimize through the similarity scores among human motion encoding, animal motion encoding, and text CLIP embedding. Presenting the first solution to this problem, we are able to generate animal motions with high diversity and fidelity, quantitatively and qualitatively outperforming the results of training human motion generation baselines on animal data. Additionally, we introduce AnimalML3D, the first text-animal motion dataset with 1240 animation sequences spanning 36 different animal identities. We hope this dataset would mediate the data scarcity problem in text-driven animal motion generation, providing a new playground for the research community.


title: AB-G$_0$W$_0$: A practical G$_0$W$_0$ method without frequency integration based on an auxiliary boson expansion

abstract: Common G$_0$W$_0$ implementations rely on numerical or analytical frequency integration to determine the G$_0$W$_0$ self-energy, which results in a variety of practical complications. Recently, we demonstrated an exact connection between the G$_0$W$_0$ approximation and equation-of-motion (EOM) quantum chemistry approaches [J. Chem. Phys., 158, 124123 (2023)]. Based on this connection, we propose a new method to determine G$_0$W$_0$ quasiparticle energies which completely avoids frequency integration and its associated problems. To achieve this, we make use of an auxiliary boson (AB) expansion. We name the new approach AB-G$_0$W$_0$ and demonstrate its practical applicability in a range of molecular problems.


title: Generalized Gearhart-Koshy acceleration is a Krylov space method of a new type

abstract: The Gearhart-Koshy acceleration for the Kaczmarz method for linear systems is a line-search with the unusual property that it does not minimize the residual, but the error. Recently one of the authors generalized the this acceleration from a line-search to a search in affine subspaces. In this paper, we demonstrate that the affine search is a Krylov space method that is neither a CG-type nor a MINRES-type method, and we prove that it is mathematically equivalent with a more canonical Gram-Schmidt-based method. We also investigate what abstract property of the Kaczmarz method enables this type of algorithm, and we conclude with a simple numerical example.


title: PAUNet: Precipitation Attention-based U-Net for rain prediction from satellite radiance data

abstract: This paper introduces Precipitation Attention-based U-Net (PAUNet), a deep learning architecture for predicting precipitation from satellite radiance data, addressing the challenges of the Weather4cast 2023 competition. PAUNet is a variant of U-Net and Res-Net, designed to effectively capture the large-scale contextual information of multi-band satellite images in visible, water vapor, and infrared bands through encoder convolutional layers with center cropping and attention mechanisms. We built upon the Focal Precipitation Loss including an exponential component (e-FPL), which further enhanced the importance across different precipitation categories, particularly medium and heavy rain. Trained on a substantial dataset from various European regions, PAUNet demonstrates notable accuracy with a higher Critical Success Index (CSI) score than the baseline model in predicting rainfall over multiple time slots. PAUNet's architecture and training methodology showcase improvements in precipitation forecasting, crucial for sectors like emergency services and retail and supply chain management.


title: Categorical Traffic Transformer: Interpretable and Diverse Behavior Prediction with Tokenized Latent

abstract: Adept traffic models are critical to both planning and closed-loop simulation for autonomous vehicles (AV), and key design objectives include accuracy, diverse multimodal behaviors, interpretability, and downstream compatibility. Recently, with the advent of large language models (LLMs), an additional desirable feature for traffic models is LLM compatibility. We present Categorical Traffic Transformer (CTT), a traffic model that outputs both continuous trajectory predictions and tokenized categorical predictions (lane modes, homotopies, etc.). The most outstanding feature of CTT is its fully interpretable latent space, which enables direct supervision of the latent variable from the ground truth during training and avoids mode collapse completely. As a result, CTT can generate diverse behaviors conditioned on different latent modes with semantic meanings while beating SOTA on prediction accuracy. In addition, CTT's ability to input and output tokens enables integration with LLMs for common-sense reasoning and zero-shot generalization.


title: Symplectic Representation and Turbulent Global Solutions of Incompressible Navier-Stokes Equations in $\R^3$

abstract: The incompressible Navier-Stokes equations are considered. We find that there exist infinite non-trivial solutions of static Euler equations. Moreover there exist random solutions of static Euler equations. Provided Reynolds number is large enough and time variable $t$ goes to infinity, these random solutions of static Euler equations are the path limits of corresponding Navier-Stokes flows. But the double limit of these Navier-Stokes flows do not exist. Therefore these solutions are called turbulent solutions.


title: A note on construction of the Leech lattice

abstract: In this paper, we present a method to construct the Leech lattice from other Niemeier lattices.


title: The jump of the Milnor number of quasihomogeneous singularities for linear deformations

abstract: The jump of the Milnor number of an isolated singularity $f_0$ is the minimal non-zero difference between the Milnor numbers of $f_0$ and one of its deformations $f_s$. We determinate the jump of quasihomogeneous singularities in the class of linear deformations.


title: Anisotropic Neural Representation Learning for High-Quality Neural Rendering

abstract: Neural radiance fields (NeRFs) have achieved impressive view synthesis results by learning an implicit volumetric representation from multi-view images. To project the implicit representation into an image, NeRF employs volume rendering that approximates the continuous integrals of rays as an accumulation of the colors and densities of the sampled points. Although this approximation enables efficient rendering, it ignores the direction information in point intervals, resulting in ambiguous features and limited reconstruction quality. In this paper, we propose an anisotropic neural representation learning method that utilizes learnable view-dependent features to improve scene representation and reconstruction. We model the volumetric function as spherical harmonic (SH)-guided anisotropic features, parameterized by multilayer perceptrons, facilitating ambiguity elimination while preserving the rendering efficiency. To achieve robust scene reconstruction without anisotropy overfitting, we regularize the energy of the anisotropic features during training. Our method is flexiable and can be plugged into NeRF-based frameworks. Extensive experiments show that the proposed representation can boost the rendering quality of various NeRFs and achieve state-of-the-art rendering performance on both synthetic and real-world scenes.


title: From Theory to Practice: Applying Neural Networks to Simulate Real Systems with Sign Problems

abstract: The numerical sign problem poses a seemingly insurmountable barrier to the simulation of many fascinating systems. We apply neural networks to deform the region of integration, mitigating the sign problem of systems with strongly correlated electrons. In this talk we present our latest architectural developments as applied to contour deformation. We also demonstrate its applicability to real systems, namely perylene.


title: Automatic Implementation of Neural Networks through Reaction Networks -- Part I: Circuit Design and Convergence Analysis

abstract: Information processing relying on biochemical interactions in the cellular environment is essential for biological organisms. The implementation of molecular computational systems holds significant interest and potential in the fields of synthetic biology and molecular computation. This two-part article aims to introduce a programmable biochemical reaction network (BCRN) system endowed with mass action kinetics that realizes the fully connected neural network (FCNN) and has the potential to act automatically in vivo. In part I, the feedforward propagation computation, the backpropagation component, and all bridging processes of FCNN are ingeniously designed as specific BCRN modules based on their dynamics. This approach addresses a design gap in the biochemical assignment module and judgment termination module and provides a novel precise and robust realization of bi-molecular reactions for the learning process. Through equilibrium approaching, we demonstrate that the designed BCRN system achieves FCNN functionality with exponential convergence to target computational results, thereby enhancing the theoretical support for such work. Finally, the performance of this construction is further evaluated on two typical logic classification problems.


title: A Collaborative Jamming Algorithm Based on Multi-UAV Scheduling

abstract: In this paper, we consider the problem of multi-unmanned aerial vehicles' scheduling for cooperative jamming, where UAVs equipped with directional antennas perform collaborative jamming tasks against several targets of interest. To ensure effective jamming towards the targets, we formulate it as an non-convex optimization problem, aiming to minimize the communication performance of the targets by jointly optimizing UAVs' deployment and directional antenna orientations. Due to the unique structure of the problem, we derive an equivalent transformation by introducing a set of auxiliary matrices. Subsequently, we propose an efficient iterative algorithm based on the alternating direction method of multipliers, which decomposes the problem into multiple tractable subproblems solved in closed-form or by gradient projection method. Extensive simulations validate the efficacy of the proposed algorithm.


title: Cylindrical Symplectic Representation and Global Regular Solution of Incompressible Navier-Stokes Equations in $\mathbb{R}^3$

abstract: The existence and uniqueness of global regular solution of incompressible Navier-Stokes equations in $\mathbb{R}^3$ are derived provided the initial velocity vector field holds a special structure.


title: Learning for Semantic Knowledge Base-Guided Online Feature Transmission in Dynamic Channels

abstract: With the proliferation of edge computing, efficient AI inference on edge devices has become essential for intelligent applications such as autonomous vehicles and VR/AR. In this context, we address the problem of efficient remote object recognition by optimizing feature transmission between mobile devices and edge servers. We propose an online optimization framework to address the challenge of dynamic channel conditions and device mobility in an end-to-end communication system. Our approach builds upon existing methods by leveraging a semantic knowledge base to drive multi-level feature transmission, accounting for temporal factors and dynamic elements throughout the transmission process. To solve the online optimization problem, we design a novel soft actor-critic-based deep reinforcement learning system with a carefully designed reward function for real-time decision-making, overcoming the optimization difficulty of the NP-hard problem and achieving the minimization of semantic loss while respecting latency constraints. Numerical results showcase the superiority of our approach compared to traditional greedy methods under various system setups.


title: Evolution of giant monopole resonance with triaxial deformation

abstract: Background: The isoscalar giant monopole resonance (ISGMR) splits into two peaks in prolately deformed nuclei. When a nucleus is triaxially deformed, a peak appears in the middle between the two peaks. Purpose: We investigate the mechanism of the appearance of the middle peak in the ISGMR in triaxial nuclei. Method: We perform the constrained Skyrme-Hartree-Fock-Bogoliubov (CHFB) calculation for arbitrary triaxial shapes in $^{100}$Mo. We calculate the strength functions of the isoscalar monopole (ISM) and IS quadrupole modes on the CHFB states. Furthermore, we investigate vibrations of matter distributions in $x$, $y$, and $z$ directions induced by the external ISM field, with the $z$ axis being the longest axis of the triaxial shape. Results: The middle peak in the ISM strength evolves from the triaxial degree $\gamma=0^\circ$ to $60^\circ$. This is because the difference between the vibration in $x$ direction and that in $y$ direction is evident with an increase in $\gamma$ and the quadrupole $K=2$ component of the induced density of the ISM at the middle peak increases as $\gamma$ increases, where $K$ denotes the $z$ component of the angular momentum. This property is also obtained in the unperturbed ISM strength without the residual fields. Conclusions: The mixing between the monopole and quadrupole modes is primarily determined by the ground-state deformation. Therefore, the ISM strength of the middle peak becomes strong as the triaxial degree in the ground state increases.


title: Unclonable Cryptography with Unbounded Collusions

abstract: Quantum no-cloning theorem gives rise to the intriguing possibility of quantum copy protection where we encode a program in a quantum state such that a user in possession of k such states cannot create k + 1 working copies. Introduced by Aaronson (CCC 09) over a decade ago, copy protection has proven to be notoriously hard to achieve. In this work, we construct public-key encryption and functional encryption schemes whose secret keys are copy-protected against unbounded collusions in the plain model (i.e. without any idealized oracles), assuming (post-quantum) subexponentially secure iO, one-way functions and LWE. This resolves a long-standing open question of constructing fully collusion-resistant copy-protected functionalities raised by multiple previous works. Prior to our work, copy-protected functionalities were known only in restricted collusion models where either an a-priori bound on the collusion size was needed, in the plain model with the same assumptions as ours (Liu, Liu, Qian, Zhandry [TCC 22]), or adversary was only prevented from doubling their number of working programs, in a structured quantum oracle model (Aaronson [CCC 09]). We obtain our results through a novel technique which uses identity-based encryption to construct unbounded collusion resistant copy-protection schemes from 1-to-2 secure schemes. This is analogous to the technique of using digital signatures to construct full-fledged quantum money from single banknote schemes1 (Lutomirski et al. [ICS 09], Farhi et al. [ITCS 12], Aaronson and Christiano [STOC 12]). We believe our technique is of independent interest. Along the way, we also construct a puncturable functional encryption scheme whose master secret key can be punctured at all functions f such that f (m0) != f (m1). This might also be of independent interest.


title: Modular Many-Body Quantum Sensors

abstract: Quantum many-body systems undergoing phase transitions have been proposed as probes enabling beyond-classical enhancement of sensing precision. However, this enhancement is usually limited to a very narrow region around the critical point. Here, we systematically develop a modular approach for introducing multiple phase transitions in a many-body system. This naturally allows us to enlarge the region of quantum-enhanced precision by encompassing the newly created phase boundaries. Our approach is general and can be applied to both symmetry-breaking and topological quantum sensors. In symmetry-breaking sensors, we show that the newly created critical points inherit the original universality class. In topological sensors, our modular construction creates multiple bands which leads to a rich phase diagram. In both cases, Heisenberg scaling for Hamiltonian parameter estimation is achieved at all the phase boundaries. This can be exploited to create a global sensor which significantly outperforms a uniform probe.


title: BN-embedded monolayer graphene with tunable electronic and topological properties

abstract: Finding an effective and controllable way to create a sizable energy gap in graphene-based systems has been a challenging topic of intensive research. We propose that the hybrid of boron nitride and graphene (h-BNC) at low BN doping serves as an ideal platform for band-gap engineering and valleytronic applications. We report a systematic first-principles study of the atomic configurations and band gap opening for energetically favorable BN patches embedded in graphene. Based on first-principles calculations, we construct a tight-binding model to simulate general doping configurations in large supercells. Unexpectedly, the calculations find a linear dependence of the band gap on the effective BN concentration at low doping, arising from an induced effective on-site energy difference at the two C sublattices as they are substituted by B and N dopants alternately. The significant and tunable band gap of a few hundred meVs, with preserved topological properties of graphene and feasible sample preparation in the laboratory, presents great opportunities to realize valley physics applications in graphene systems at room temperature.


title: 2D disc modelling of the JWST line spectrum of EX Lupi

abstract: We introduce a number of new theoretical approaches and improvements to the thermo-chemical disc modelling code ProDiMo to better predict and analyse the JWST line spectra of protoplanetary discs. We develop a new line escape probability method for disc geometries, a new scheme for dust settling, and discuss how to apply UV molecular shielding factors to photorates in 2D disc geometry. We show that these assumptions are crucial for the determination of the gas heating/cooling rates and discuss how they affect the predicted molecular concentrations and line emissions. We apply our revised 2D models to the protoplanetary disc around the T Tauri star EX Lupi in quiescent state. We calculate infrared line emission spectra between 5 and 20 mic by CO, H2O, OH, CO2, HCN, C2H2 and H2, including lines of atoms and ions, using our full 2D predictions of molecular abundances, dust opacities, gas and dust temperatures. We develop a disc model with a slowly increasing surface density structure around the inner rim that can simultaneously fit the spectral energy distribution, the overall shape of the JWST spectrum of EX Lupi, and the main observed molecular characteristics in terms of column densities, emitting areas and molecular emission temperatures, which all result from one consistent disc model. The spatial structure of the line emitting regions of the different molecules is discussed. High abundances of HCN and C2H2 are caused in the model by stellar X-ray irradiation of the gas around the inner rim.


title: Bayesian nonparametric inference in PDE models: asymptotic theory and implementation

abstract: Parameter identification problems in partial differential equations (PDEs) consist in determining one or more unknown functional parameters in a PDE. Here, the Bayesian nonparametric approach to such problems is considered. Focusing on the representative example of inferring the diffusivity function in an elliptic PDE from noisy observations of the PDE solution, the performance of Bayesian procedures based on Gaussian process priors is investigated. Recent asymptotic theoretical guarantees establishing posterior consistency and convergence rates are reviewed and expanded upon. An implementation of the associated posterior-based inference is provided, and illustrated via a numerical simulation study where two different discretisation strategies are devised. The reproducible code is available at: https://github.com/MattGiord.


title: Squashed quantum non-Markovianity: a measure of genuine quantum non-Markovianity in states

abstract: Quantum non-Markovianity in tripartite quantum states $\rho_{ABC}$ represents a correlation between systems $A$ and $C$ when conditioned on the system $B$ and is known to have both classical and quantum contributions. However, a systematic characterization of the latter is missing. To address this, we propose a faithful measure for non-Markovianity of genuine quantum origin called squashed quantum non-Markovianity (sQNM). It is based on the quantum conditional mutual information and is defined by the left-over non-Markovianity after squashing out all non-quantum contributions. It is lower bounded by the squashed entanglement between non-conditioning systems in the reduced state and is delimited by the extendibility of either of the non-conditioning systems. We show that the sQNM is monogamous, asymptotically continuous, convex, additive on tensor-product states, and generally super-additive. We characterize genuine quantum non-Markovianity as a resource via a convex resource theory after identifying free states with vanishing sQNM and free operations that do not increase sQNM in states. We use our resource-theoretic framework to bound the rate of state transformations under free operations and to study state transformation under non-free operations; in particular, we find the quantum communication cost from Bob ($B$) to Alice ($A$) or Charlie ($C$) is lower bounded by the change in sQNM in the states. The sQNM finds operational meaning; in particular, the optimal rate of private communication in a variant of conditional one-time pad protocol is twice the sQNM. Also, the minimum deconstruction cost for a variant of quantum deconstruction protocol is given by twice the sQNM of the state.

categories: quant-ph cond-mat.other hep-th math-ph math.MP


title: Low-rank optimization on Tucker tensor varieties

abstract: In the realm of tensor optimization, low-rank tensor decomposition, particularly Tucker decomposition, stands as a pivotal technique for reducing the number of parameters and for saving storage. We embark on an exploration of Tucker tensor varieties -- the set of tensors with bounded Tucker rank -- in which the geometry is notably more intricate than the well-explored geometry of matrix varieties. We give an explicit parametrization of the tangent cone of Tucker tensor varieties and leverage its geometry to develop provable gradient-related line-search methods for optimization on Tucker tensor varieties. The search directions are computed from approximate projections of antigradient onto the tangent cone, which circumvents the calculation of intractable metric projections. To the best of our knowledge, this is the first work concerning geometry and optimization on Tucker tensor varieties. In practice, low-rank tensor optimization suffers from the difficulty of choosing a reliable rank parameter. To this end, we incorporate the established geometry and propose a Tucker rank-adaptive method that is capable of identifying an appropriate rank during iterations while the convergence is also guaranteed. Numerical experiments on tensor completion with synthetic and real-world datasets reveal that the proposed methods are in favor of recovering performance over other state-of-the-art methods. Moreover, the rank-adaptive method performs the best across various rank parameter selections and is indeed able to find an appropriate rank.


title: Non-Hermitian second-order topological superconductors

abstract: The topology of non-Hermitian systems is fundamentally changed by the non-Hermitian skin effect, which leads to the generalized bulk-boundary correspondence. Based on the non-Bloch band theory, we get insight into the interplay between the non-Hermiticity and the second-order topological superconductors in two spatial dimensions. We investigate that the non-Hermiticity drives both the bulk states and topological edge modes to accumulate toward opposite corners of the system depending on the particle and hole degrees of freedom protected by the particle-hole symmetry. Furthermore, the degeneracy of the Majorana corner modes can be broken in terms of both the eigenenergies and the eigenstates. Through an edge theory analysis, we elucidate the impact of non-Hermiticity and enable the extension of higher-order topological superconductors to the realm of non-Hermitian systems. We show that $Z_2$ skin effect and $Z_2$ skin-topological modes reveal the universal characteristics of non-Hermitian second-order topological superconductors and the generalized bulk-boundary correspondence is further enriched by the particle-hole symmetry.


title: AESTRA: Deep Learning for Precise Radial Velocity Estimation in the Presence of Stellar Activity

abstract: Stellar activity interferes with precise radial velocity measurements and limits our ability to detect and characterize planets, particularly Earth-like planets. We introduce \aestra (Auto-Encoding STellar Radial-velocity and Activity), a deep learning method for precise radial velocity measurements. It combines a spectrum auto-encoder, which learns to create realistic models of the star's rest-frame spectrum, and a radial-velocity estimator, which learns to identify true Doppler shifts in the presence of spurious shifts due to line-profile variations. Being self-supervised, \aestra does not need "ground truth" radial velocities for training, making it applicable to exoplanet host stars for which the truth is unknown. In tests involving 1,000 simulated spectra, \aestra can detect planetary signals as low as 0.1 m/s even in the presence of 3 m/s of activity-induced noise and 0.3 m/s of photon noise per spectrum.


title: Deep Reinforcement Learning Based Optimal Energy Management of Multi-energy Microgrids with Uncertainties

abstract: Multi-energy microgrid (MEMG) offers an effective approach to deal with energy demand diversification and new energy consumption on the consumer side. In MEMG, it is critical to deploy an energy management system (EMS) for efficient utilization of energy and reliable operation of the system. To help EMS formulate optimal dispatching schemes, a deep reinforcement learning (DRL)-based MEMG energy management scheme with renewable energy source (RES) uncertainty is proposed in this paper. To accurately describe the operating state of the MEMG, the off-design performance model of energy conversion devices is considered in scheduling. The nonlinear optimal dispatching model is expressed as a Markov decision process (MDP) and is then addressed by the twin delayed deep deterministic policy gradient (TD3) algorithm. In addition, to accurately describe the uncertainty of RES, the conditional-least squares generative adversarial networks (C-LSGANs) method based on RES forecast power is proposed to construct the scenarios set of RES power generation. The generated data of RES is used for scheduling to obtain caps and floors for the purchase of electricity and natural gas. Based on this, the superior energy supply sector can formulate solutions in advance to tackle the uncertainty of RES. Finally, the simulation analysis demonstrates the validity and superiority of the method.


title: Advances in 3D Neural Stylization: A Survey

abstract: Modern artificial intelligence offers a novel and transformative approach to creating digital art across diverse styles and modalities like images, videos and 3D data, unleashing the power of creativity and revolutionizing the way that we perceive and interact with visual content. This paper reports on recent advances in stylized 3D asset creation and manipulation with the expressive power of neural networks. We establish a taxonomy for neural stylization, considering crucial design choices such as scene representation, guidance data, optimization strategies, and output styles. Building on such taxonomy, our survey first revisits the background of neural stylization on 2D images, and then presents in-depth discussions on recent neural stylization methods for 3D data, accompanied by a mini-benchmark evaluating selected neural field stylization methods. Based on the insights gained from the survey, we highlight the practical significance, open challenges, future research, and potential impacts of neural stylization, which facilitates researchers and practitioners to navigate the rapidly evolving landscape of 3D content creation using modern artificial intelligence.


title: Instructing Hierarchical Tasks to Robots by Verbal Commands

abstract: Natural language is an effective tool for communication, as information can be expressed in different ways and at different levels of complexity. Verbal commands, utilized for instructing robot tasks, can therefor replace traditional robot programming techniques, and provide a more expressive means to assign actions and enable collaboration. However, the challenge of utilizing speech for robot programming is how actions and targets can be grounded to physical entities in the world. In addition, to be time-efficient, a balance needs to be found between fine- and course-grained commands and natural language phrases. In this work we provide a framework for instructing tasks to robots by verbal commands. The framework includes functionalities for single commands to actions and targets, as well as longer-term sequences of actions, thereby providing a hierarchical structure to the robot tasks. Experimental evaluation demonstrates the functionalities of the framework by human collaboration with a robot in different tasks, with different levels of complexity. The tools are provided open-source at https://petim44.github.io/voice-jogger/


title: Attaining near-ideal Dicke superradiance in expanded spatial domains

abstract: Dicke superradiance is essentially a case of correlated dissipation leading to the macroscopic quantum coherence. Superradiance for arrays of inverted emitters in free space requires interactions far beyond the nearest-neighbor, limiting its occurrence to small emitter-emitter distances. Epsilon-near-zero (ENZ) materials, which exhibit infinite effective wavelengths, can mediate long-range interactions between emitters. We investigate the superradiance properties of two ENZ structures, namely plasmonic waveguides and dielectric photonic crystals, and demonstrate their potential to support near-ideal Dicke superradiance across expanded spatial domains. We employ a general method that we have developed to assess the occurrence of superradiance, which is applicable to various coupling scenarios and only relies on the decoherence matrix. Furthermore, by numerically examining the emission dynamics of the few-emitter systems, we distinct the roles of quantum coherence at different stages of emission for the case of all-to-all interaction, and demonstrate that the maximum quantum coherence in the system can be determined using the maximum photon burst rate. The findings of this work have prospective applications in quantum information processing and light-matter interaction.


title: MRFP: Learning Generalizable Semantic Segmentation from Sim-2-Real with Multi-Resolution Feature Perturbation

abstract: Deep neural networks have shown exemplary performance on semantic scene understanding tasks on source domains, but due to the absence of style diversity during training, enhancing performance on unseen target domains using only single source domain data remains a challenging task. Generation of simulated data is a feasible alternative to retrieving large style-diverse real-world datasets as it is a cumbersome and budget-intensive process. However, the large domain-specfic inconsistencies between simulated and real-world data pose a significant generalization challenge in semantic segmentation. In this work, to alleviate this problem, we propose a novel MultiResolution Feature Perturbation (MRFP) technique to randomize domain-specific fine-grained features and perturb style of coarse features. Our experimental results on various urban-scene segmentation datasets clearly indicate that, along with the perturbation of style-information, perturbation of fine-feature components is paramount to learn domain invariant robust feature maps for semantic segmentation models. MRFP is a simple and computationally efficient, transferable module with no additional learnable parameters or objective functions, that helps state-of-the-art deep neural networks to learn robust domain invariant features for simulation-to-real semantic segmentation.


title: Multilevel Saliency-Guided Self-Supervised Learning for Image Anomaly Detection

abstract: Anomaly detection (AD) is a fundamental task in computer vision. It aims to identify incorrect image data patterns which deviate from the normal ones. Conventional methods generally address AD by preparing augmented negative samples to enforce self-supervised learning. However, these techniques typically do not consider semantics during augmentation, leading to the generation of unrealistic or invalid negative samples. Consequently, the feature extraction network can be hindered from embedding critical features. In this study, inspired by visual attention learning approaches, we propose CutSwap, which leverages saliency guidance to incorporate semantic cues for augmentation. Specifically, we first employ LayerCAM to extract multilevel image features as saliency maps and then perform clustering to obtain multiple centroids. To fully exploit saliency guidance, on each map, we select a pixel pair from the cluster with the highest centroid saliency to form a patch pair. Such a patch pair includes highly similar context information with dense semantic correlations. The resulting negative sample is created by swapping the locations of the patch pair. Compared to prior augmentation methods, CutSwap generates more subtle yet realistic negative samples to facilitate quality feature learning. Extensive experimental and ablative evaluations demonstrate that our method achieves state-of-the-art AD performance on two mainstream AD benchmark datasets.


title: Spherical Designs for Function Approximation and Beyond

abstract: In this paper, we compare two optimization algorithms using full Hessian and approximation Hessian to obtain numerical spherical designs through their variational characterization. Based on the obtained spherical design point sets, we investigate the approximation of smooth and non-smooth functions by spherical harmonics with spherical designs. Finally, we use spherical framelets for denoising Wendland functions as an application, which shows the great potential of spherical designs in spherical data processing.