title: Vox-Fusion: Dense Tracking and Mapping with Voxel-based Neural Implicit Representation

abstract: In this work, we present a dense tracking and mapping system named Vox-Fusion, which seamlessly fuses neural implicit representations with traditional volumetric fusion methods. Our approach is inspired by the recently developed implicit mapping and positioning system and further extends the idea so that it can be freely applied to practical scenarios. Specifically, we leverage a voxel-based neural implicit surface representation to encode and optimize the scene inside each voxel. Furthermore, we adopt an octree-based structure to divide the scene and support dynamic expansion, enabling our system to track and map arbitrary scenes without knowing the environment like in previous works. Moreover, we proposed a high-performance multi-process framework to speed up the method, thus supporting some applications that require real-time performance. The evaluation results show that our methods can achieve better accuracy and completeness than previous methods. We also show that our Vox-Fusion can be used in augmented reality and virtual reality applications. Our source code is publicly available at https://github.com/zju3dv/Vox-Fusion.


title: You can't pick your neighbors, or can you? When and how to rely on retrieval in the $k$NN-LM

abstract: Retrieval-enhanced language models (LMs), which condition their predictions on text retrieved from large external datastores, have recently shown significant perplexity improvements compared to standard LMs. One such approach, the $k$NN-LM, interpolates any existing LM's predictions with the output of a $k$-nearest neighbors model and requires no additional training. In this paper, we explore the importance of lexical and semantic matching in the context of items retrieved by $k$NN-LM. We find two trends: (1) the presence of large overlapping $n$-grams between the datastore and evaluation set plays an important factor in strong performance, even when the datastore is derived from the training data; and (2) the $k$NN-LM is most beneficial when retrieved items have high semantic similarity with the query. Based on our analysis, we define a new formulation of the $k$NN-LM that uses retrieval quality to assign the interpolation coefficient. We empirically measure the effectiveness of our approach on two English language modeling datasets, Wikitext-103 and PG-19. Our re-formulation of the $k$NN-LM is beneficial in both cases, and leads to nearly 4% improvement in perplexity on the Wikitext-103 test set.


title: Chaos and operator growth in 2d CFT

abstract: We study the out-of-time-ordered correlator (OTOC) in a zero temperature two dimensional conformal field theory (CFT) under evolution by a Liouvillian composed of the Virasoro generators. A bound was conjectured in arXiv:1812.08657 on the growth of the OTOC set by the Krylov complexity which is a measure of operator growth. The latter grows as an exponential of time with exponent $2\alpha$, which sets an upper bound on the Lyapunov exponent, $\lambda_L \leq 2\alpha$. We find that for a two dimensional zero temperature CFT, the OTOC decays exponentially with a Lyapunov exponent which saturates this bound. We show that these Virasoro generators form the modular Hamiltonian of the CFT with half space traced out. Therefore, evolution by this modular Hamiltonian gives rise to thermal dynamics in a zero temperature CFT. Leveraging the thermal dynamics of the system, we derive this bound in a zero temperature CFT using the analyticity and boundedness properties of the OTOC.


title: Domain Adaptation of Machine Translation with Crowdworkers

abstract: Although a machine translation model trained with a large in-domain parallel corpus achieves remarkable results, it still works poorly when no in-domain data are available. This situation restricts the applicability of machine translation when the target domain's data are limited. However, there is great demand for high-quality domain-specific machine translation models for many domains. We propose a framework that efficiently and effectively collects parallel sentences in a target domain from the web with the help of crowdworkers. With the collected parallel data, we can quickly adapt a machine translation model to the target domain. Our experiments show that the proposed method can collect target-domain parallel data over a few days at a reasonable cost. We tested it with five domains, and the domain-adapted model improved the BLEU scores to +19.7 by an average of +7.8 points compared to a general-purpose translation model.


title: Sliding nanomechanical resonators

abstract: The motion of a vibrating object is determined by the way it is held. This simple observation has long inspired string instrument makers to create new sounds by devising elegant string clamping mechanisms, whereby the distance between the clamping points is modulated as the string vibrates. At the nanoscale, the simplest way to emulate this principle would be to controllably make nanoresonators slide across their clamping points, which would effectively modulate their vibrating length. Here, we report measurements of flexural vibrations in nanomechanical resonators that reveal such a sliding motion. Surprisingly, the resonant frequency of vibrations draws a loop as a tuning gate voltage is cycled. This behavior indicates that sliding is accompanied by a delayed frequency response of the resonators, making their dynamics richer than that of resonators with fixed clamping points. Our work elucidates the dynamics of nanomechanical resonators with unconventional boundary conditions, and offers opportunities for studying friction at the nanoscale from resonant frequency measurements.


title: Shape reconstructions by using plasmon resonances with enhanced sensitivity

abstract: This paper investigates the shape reconstructions of sub-wavelength objects from near-field measurements in transverse electromagnetic scattering. This geometric inverse problem is notoriously ill-posed and challenging. We develop a novel reconstruction scheme using plasmon resonances with significantly enhanced sensitivity and resolution. First, by spectral analysis, we establish a sharp quantitative relationship between the sensitivity of the reconstruction and the plasmon resonance. It shows that the sensitivity functional blows up when plasmon resonance occurs. Hence, the signal-to-noise ratio is significantly improved and the robustness and effectiveness of the reconstruction are ensured. Second, a variational regularization method is proposed to overcome the ill-posedness, and an alternating iteration method is introduced to automatically select the regularization parameters. Third, we use the Laplace approximation method to capture the statistical information of the target scattering object. Both rigorous theoretical analysis and extensive numerical experiments are conducted to validate the promising features of our method.


title: Theoretical analysis of anisotropic upper critical field of superconductivity in nodal-line semimetals

abstract: We study the properties of the upper critical field of superconductivity in nodal-line semimetals in a continuous model, which has a nodal-line on the $k_{z} = 0$ plane. Using the semiclassical Green's function method, we calculate the upper critical field for the two limiting cases: the dirty limit with many impurities and the clean limit with few impurities. The results show the large anisotropy of the magnitude of the upper critical field and the unusual temperature dependence. The obtained results are compared with recent experimental data of PbTaSe$_{2}$.


title: Completely Heterogeneous Federated Learning

abstract: Federated learning (FL) faces three major difficulties: cross-domain, heterogeneous models, and non-i.i.d. labels scenarios. Existing FL methods fail to handle the above three constraints at the same time, and the level of privacy protection needs to be lowered (e.g., the model architecture and data category distribution can be shared). In this work, we propose the challenging "completely heterogeneous" scenario in FL, which refers to that each client will not expose any private information including feature space, model architecture, and label distribution. We then devise an FL framework based on parameter decoupling and data-free knowledge distillation to solve the problem. Experiments show that our proposed method achieves high performance in completely heterogeneous scenarios where other approaches fail.


title: $\beta^{+}$ Gamow-Teller strengths from unstable $^{14}$O via the $(d,{}^2\text{He})$ reaction in inverse kinematics

abstract: For the first time, the $(d,{}^2\text{He})$ reaction was successfully used in inverse kinematics to extract the Gamow-Teller transition strength in the $\beta^{+}$ direction from an unstable nucleus. The nucleus studied was $^{14}$O, and the Gamow-Teller transition strength to $^{14}$N was extracted up to an excitation energy of 22 MeV. The measurement of the $(d,{}^2\text{He})$ reaction in inverse kinematics was made possible by the combination of an active target time projection chamber and a magnetic spectrometer. The data were used to test shell-model and state-of-the-art coupled cluster calculations. Shell-model calculations reproduce the measured Gamow-Teller strength distribution up to about 15 MeV reasonably well, after the application of a phenomenological quenching factor. Coupled-cluster calculation reproduces the full strength distribution well without such quenching, owing to the large model space, the inclusion of strong correlations, and the coupling of the weak interaction to two nucleons through two-body currents. This indicates that such calculations provide a very promising path for answering long-standing questions about the observed quenching of Gamow-Teller strengths in nuclei.


title: Stripe order and spin dynamics in triangular-lattice antiferromagnet KErSe$_{2}$: A single-crystal study with a theoretical description

abstract: The rare-earth triangular-lattice chalcogenide is a great platform for exploring both spin liquids and novel magnetic orders with anisotropic spin interactions and magnetic frustrations. Here, we report the thermodynamic and neutron scattering measurements of rare-earth triangular-lattice chalcogenide KErSe$_{2}$, using single-crystal samples. Our experiments revealed a long-range stripe order below 0.2 K. Although the magnetic order was three-dimensional, magnetic excitations exhibited negligible modulation along the z direction, indicating very weak interlayer coupling. Furthermore, magnetic excitation developed a well-defined spin-wave dispersion with a gap of $\sim$0.03 meV at M points. Both the stripe order and spin-wave excitations could be quantitatively understood from the anisotropic spin interactions of the Er$^{3+}$ Kramers doublets.


title: Residual Adapters for Few-Shot Text-to-Speech Speaker Adaptation

abstract: Adapting a neural text-to-speech (TTS) model to a target speaker typically involves fine-tuning most if not all of the parameters of a pretrained multi-speaker backbone model. However, serving hundreds of fine-tuned neural TTS models is expensive as each of them requires significant footprint and separate computational resources (e.g., accelerators, memory). To scale speaker adapted neural TTS voices to hundreds of speakers while preserving the naturalness and speaker similarity, this paper proposes a parameter-efficient few-shot speaker adaptation, where the backbone model is augmented with trainable lightweight modules called residual adapters. This architecture allows the backbone model to be shared across different target speakers. Experimental results show that the proposed approach can achieve competitive naturalness and speaker similarity compared to the full fine-tuning approaches, while requiring only $\sim$0.1% of the backbone model parameters for each speaker.


title: A Constrained Spatial Autoregressive Model for Interval-valued data

abstract: Interval-valued data receives much attention due to its wide applications in the fields of finance, econometrics, meteorology and medicine. However, most regression models developed for interval-valued data assume observations are mutually independent, not adapted to the scenario that individuals are spatially correlated. We propose a new linear model to accommodate to areal-type spatial dependency existed in interval-valued data. Specifically, spatial correlation among centers of responses are considered. To improve the new model's prediction accuracy, we add three inequality constrains. Parameters are obtained by an algorithm combining grid search technique and the constrained least squares method. Numerical experiments are designed to examine prediction performances of the proposed model. We also employ a weather dataset to demonstrate usefulness of our model.


title: "It's Not Just Hate'': A Multi-Dimensional Perspective on Detecting Harmful Speech Online

abstract: Well-annotated data is a prerequisite for good Natural Language Processing models. Too often, though, annotation decisions are governed by optimizing time or annotator agreement. We make a case for nuanced efforts in an interdisciplinary setting for annotating offensive online speech. Detecting offensive content is rapidly becoming one of the most important real-world NLP tasks. However, most datasets use a single binary label, e.g., for hate or incivility, even though each concept is multi-faceted. This modeling choice severely limits nuanced insights, but also performance. We show that a more fine-grained multi-label approach to predicting incivility and hateful or intolerant content addresses both conceptual and performance issues. We release a novel dataset of over 40,000 tweets about immigration from the US and UK, annotated with six labels for different aspects of incivility and intolerance. Our dataset not only allows for a more nuanced understanding of harmful speech online, models trained on it also outperform or match performance on benchmark datasets.


title: VLT: Vision-Language Transformer and Query Generation for Referring Segmentation

abstract: We propose a Vision-Language Transformer (VLT) framework for referring segmentation to facilitate deep interactions among multi-modal information and enhance the holistic understanding to vision-language features. There are different ways to understand the dynamic emphasis of a language expression, especially when interacting with the image. However, the learned queries in existing transformer works are fixed after training, which cannot cope with the randomness and huge diversity of the language expressions. To address this issue, we propose a Query Generation Module, which dynamically produces multiple sets of input-specific queries to represent the diverse comprehensions of language expression. To find the best among these diverse comprehensions, so as to generate a better mask, we propose a Query Balance Module to selectively fuse the corresponding responses of the set of queries. Furthermore, to enhance the model's ability in dealing with diverse language expressions, we consider inter-sample learning to explicitly endow the model with knowledge of understanding different language expressions to the same object. We introduce masked contrastive learning to narrow down the features of different expressions for the same target object while distinguishing the features of different objects. The proposed approach is lightweight and achieves new state-of-the-art referring segmentation results consistently on five datasets.


title: Exploring Spatial-Temporal Features for Deepfake Detection and Localization

abstract: With the continuous research on Deepfake forensics, recent studies have attempted to provide the fine-grained localization of forgeries, in addition to the coarse classification at the video-level. However, the detection and localization performance of existing Deepfake forensic methods still have plenty of room for further improvement. In this work, we propose a Spatial-Temporal Deepfake Detection and Localization (ST-DDL) network that simultaneously explores spatial and temporal features for detecting and localizing forged regions. Specifically, we design a new Anchor-Mesh Motion (AMM) algorithm to extract temporal (motion) features by modeling the precise geometric movements of the facial micro-expression. Compared with traditional motion extraction methods (e.g., optical flow) designed to simulate large-moving objects, our proposed AMM could better capture the small-displacement facial features. The temporal features and the spatial features are then fused in a Fusion Attention (FA) module based on a Transformer architecture for the eventual Deepfake forensic tasks. The superiority of our ST-DDL network is verified by experimental comparisons with several state-of-the-art competitors, in terms of both video- and pixel-level detection and localization performance. Furthermore, to impel the future development of Deepfake forensics, we build a public forgery dataset consisting of 6000 videos, with many new features such as using widely-used commercial software (e.g., After Effects) for the production, providing online social networks transmitted versions, and splicing multi-source videos. The source code and dataset are available at https://github.com/HighwayWu/ST-DDL.


title: Lattice dielectric properties of rutile $\mathrm{TiO}_2$: First-principles anharmonic self-consistent phonon study

abstract: We calculate the lattice dielectric function of strongly anharmonic rutile $\mathrm{TiO}_2$ from ab initio anharmonic lattice dynamics methods. Since an accurate calculation of the $\Gamma$ point phonons is essential for determining optical properties, we employ the modified self-consistent approach, including third-order anharmonicity as well as fourth-order anharmonicity. The resulting optical phonon frequencies and linewidths at the $\Gamma$ point much better agree with experimental measurements than those from a perturbative approach. We show that the four-phonon scattering process contributes as much as the third-order anharmonic term to phonon linewidths. Furthermore, incorporating the frequency dependence of phonon linewidth reveals that experimentally known but unidentified peaks of the dielectric function are due to two-phonon process. This work emphasizes the importance of a self-consistent approach in predicting the optical properties of highly anharmonic materials.


title: Stochastic Approach For Simulating Quantum Noise Using Tensor Networks

abstract: Noisy quantum simulation is challenging since one has to take into account the stochastic nature of the process. The dominating method for it is the density matrix approach. In this paper, we evaluate conditions for which this method is inferior to a substantially simpler way of simulation. Our approach uses stochastic ensembles of quantum circuits, where random Kraus operators are applied to original quantum gates to represent random errors for modeling quantum channels. We show that our stochastic simulation error is relatively low, even for large numbers of qubits. We implemented this approach as a part of the QTensor package. While usual density matrix simulations on average hardware are challenging at $n>15$, we show that for up to $n\lesssim 30$, it is possible to run embarrassingly parallel simulations with $<1\%$ error. By using the tensor slicing technique, we can simulate up to 100 qubit QAOA circuits with high depth using supercomputers.


title: Dynamic Event-Triggered Discrete-Time Linear Time-Varying System with Privacy-Preservation

abstract: This paper focuses on discrete-time wireless sensor networks with privacy-preservation. In practical applications, information exchange between sensors is subject to attacks. For the information leakage caused by the attack during the information transmission process, privacy-preservation is introduced for system states. To make communication resources more effectively utilized, a dynamic event-triggered set-membership estimator is designed. Moreover, the privacy of the system is analyzed to ensure the security of the real data. As a result, the set-membership estimator with differential privacy is analyzed using recursive convex optimization. Then the steady-state performance of the system is studied. Finally, one example is presented to demonstrate the feasibility of the proposed distributed filter containing privacy-preserving analysis.


title: Random Utterance Concatenation Based Data Augmentation for Improving Short-video Speech Recognition

abstract: One of limitations in end-to-end automatic speech recognition (ASR) framework is its performance would be compromised if train-test utterance lengths are mismatched. In this paper, we propose an on-the-fly random utterance concatenation (RUC) based data augmentation method to alleviate train-test utterance length mismatch issue for short-video ASR task. Specifically, we are motivated by observations that our human-transcribed training utterances tend to be much shorter for short-video spontaneous speech (~3 seconds on average), while our test utterance generated from voice activity detection front-end is much longer (~10 seconds on average). Such a mismatch can lead to suboptimal performance. Empirically, it's observed the proposed RUC method significantly improves long utterance recognition without performance drop on short one. Overall, it achieves 5.72% word error rate reduction on average for 15 languages and improved robustness to various utterance length.


title: Lagrangian acceleration in fully developed turbulence and its Eulerian decompositions

abstract: We study the properties of various Eulerian contributions to fluid particle acceleration by using well-resolved direct numerical simulations of isotropic turbulence, with the grid resolution as high as $12288^3$ and the Taylor-scale Reynolds number $R_\lambda$ in the range between 140 and 1300. The variance of convective acceleration, when normalized by Kolmogorov scales, increases linearly with $R_\lambda$, consistent with simple theoretical arguments, but very strongly differing from phenomenological predictions of Kolmogorov's hypothesis as well as Eulerian multifractal models. The scaling of the local acceleration is also linear $R_\lambda$ to the leading order, but more complex in detail. The strong cancellation between the local and convective acceleration -- faithful to the random sweeping hypothesis -- results in the variance of the Lagrangian acceleration increasing only as $R_\lambda^{0.25}$, as recently shown by Buaria \& Sreenivasan [Phys. Rev. Lett. 128, 234502 (2022)]. The acceleration variance is dominated by irrotational pressure gradient contributions, whose variance also follows an $R_\lambda^{0.25}$ scaling; the solenoidal viscous contributions are relatively small and follow a $R_\lambda^{0.13}$, consistent with Eulerian multifractal predictions.


title: Facial Action Unit Detection and Intensity Estimation from Self-supervised Representation

abstract: As a fine-grained and local expression behavior measurement, facial action unit (FAU) analysis (e.g., detection and intensity estimation) has been documented for its time-consuming, labor-intensive, and error-prone annotation. Thus a long-standing challenge of FAU analysis arises from the data scarcity of manual annotations, limiting the generalization ability of trained models to a large extent. Amounts of previous works have made efforts to alleviate this issue via semi/weakly supervised methods and extra auxiliary information. However, these methods still require domain knowledge and have not yet avoided the high dependency on data annotation. This paper introduces a robust facial representation model MAE-Face for AU analysis. Using masked autoencoding as the self-supervised pre-training approach, MAE-Face first learns a high-capacity model from a feasible collection of face images without additional data annotations. Then after being fine-tuned on AU datasets, MAE-Face exhibits convincing performance for both AU detection and AU intensity estimation, achieving a new state-of-the-art on nearly all the evaluation results. Further investigation shows that MAE-Face achieves decent performance even when fine-tuned on only 1\% of the AU training set, strongly proving its robustness and generalization performance.


title: Complex Handwriting Trajectory Recovery: Evaluation Metrics and Algorithm

abstract: Many important tasks such as forensic signature verification, calligraphy synthesis, etc, rely on handwriting trajectory recovery of which, however, even an appropriate evaluation metric is still missing. Indeed, existing metrics only focus on the writing orders but overlook the fidelity of glyphs. Taking both facets into account, we come up with two new metrics, the adaptive intersection on union (AIoU) which eliminates the influence of various stroke widths, and the length-independent dynamic time warping (LDTW) which solves the trajectory-point alignment problem. After that, we then propose a novel handwriting trajectory recovery model named Parsing-and-tracing ENcoder-decoder Network (PEN-Net), in particular for characters with both complex glyph and long trajectory, which was believed very challenging. In the PEN-Net, a carefully designed double-stream parsing encoder parses the glyph structure, and a global tracing decoder overcomes the memory difficulty of long trajectory prediction. Our experiments demonstrate that the two new metrics AIoU and LDTW together can truly assess the quality of handwriting trajectory recovery and the proposed PEN-Net exhibits satisfactory performance in various complex-glyph languages including Chinese, Japanese and Indic.


title: Experimental demonstration of non-adjacent band topology connecting multiple nodal links

abstract: Nodal links are special configurations of band degeneracies in the momentum space, where nodal line branches encircle each other. In PT symmetric systems, nodal lines can be topologically characterized using the eigenvector frame rotations along an encircling loop and the linking structure can be described with non-Abelian frame charges interacting among adjacent bands. In this paper, we present a photonic multiple nodal links system, where non-adjacent band topology is proposed to characterize the hidden relation between nodal lines from non-adjacent band pairs. Through an orthogonal nodal chain, the nodal line from the lower two bands predicts the existence of nodal lines formed between the higher bands. We designed and fabricated a metamaterial, with which the multiple nodal links and non-adjacent band topology are experimentally demonstrated.


title: 300 GHz wireless link based on an integrated Kerr soliton comb

abstract: A Kerr microresonator frequency comb has enabled the generation of low-phase-noise millimeter- and terahertz-waves in conjunction with an ultrafast photodiode. It is intriguing to employ the new light source in wireless communication at above 100 GHz band, where a carrier signal with a high signal-to-noise ratio is desired to achieve higher data rates. In this study, we demonstrate two simple and efficient architectures of wireless links based on a microresonator comb. We show experimentally that simultaneous modulation and detection of multiple comb lines result in >10 times stronger modulation signal strength than two-line detection at a receiver. Successful transmission of complex modulation format up to 64 quadrature amplitude modulation proves that a microresonator comb and the proposed modulation method are effective in modern wireless communication.


title: Can Current Explainability Help Provide References in Clinical Notes to Support Humans Annotate Medical Codes?

abstract: The medical codes prediction problem from clinical notes has received substantial interest in the NLP community, and several recent studies have shown the state-of-the-art (SOTA) code prediction results of full-fledged deep learning-based methods. However, most previous SOTA works based on deep learning are still in early stages in terms of providing textual references and explanations of the predicted codes, despite the fact that this level of explainability of the prediction outcomes is critical to gaining trust from professional medical coders. This raises the important question of how well current explainability methods apply to advanced neural network models such as transformers to predict correct codes and present references in clinical notes that support code prediction. First, we present an explainable Read, Attend, and Code (xRAC) framework and assess two approaches, attention score-based xRAC-ATTN and model-agnostic knowledge-distillation-based xRAC-KD, through simplified but thorough human-grounded evaluations with SOTA transformer-based model, RAC. We find that the supporting evidence text highlighted by xRAC-ATTN is of higher quality than xRAC-KD whereas xRAC-KD has potential advantages in production deployment scenarios. More importantly, we show for the first time that, given the current state of explainability methodologies, using the SOTA medical codes prediction system still requires the expertise and competencies of professional coders, even though its prediction accuracy is superior to that of human coders. This, we believe, is a very meaningful step toward developing explainable and accurate machine learning systems for fully autonomous medical code prediction from clinical notes.


title: LCCM-VC: Learned Conditional Coding Modes for Video Compression

abstract: End-to-end learning-based video compression has made steady progress over the last several years. However, unlike learning-based image coding, which has already surpassed its handcrafted counterparts, learning-based video coding still has some ways to go. In this paper we present learned conditional coding modes for video coding (LCCM-VC), a video coding model that achieves state-of-the-art results among learning-based video coding methods. Our model utilizes conditional coding engines from the recent conditional augmented normalizing flows (CANF) pipeline, and introduces additional coding modes to improve compression performance. The compression efficiency is especially good in the high-quality/high-bitrate range, which is important for broadcast and video-on-demand streaming applications. The implementation of LCCM-VC is available at https://github.com/hadihdz/lccm_vc


title: Long-term multiwavelength periodicity on the light curves of Mrk~501: the case for an eclipsing supermassive binary black hole

abstract: Using multifrequency observations, from radio to gamma-rays of the Blazar Mrk 501, we constructed their corresponding light curves, and built its periodograms using RobPer and Lomb-Scargle algorithms. Long-term variability was also studied using the Power Density Spectrum, the Detrended Function Analysis using the software VARTOOLS. The result of these techniques showed an achromatic periodicity <~ 229 d. This combined with the result of a pink colour noise in the spectra lead us to propose that the periodicity was produced by a secondary eclipsing supermassive binary black hole orbiting the primary one locked inside the central engine of Mrk 501. We built a relativistic eclipsing model of this phenomenon using Jacobi elliptical functions finding a periodic relativistic eclipse occurring every ~225 d in all the studied wavebands.


title: Treasure Maps for Detections of Extreme Energy Cosmic Rays

abstract: The origin of Ultra High Energy Cosmic Rays is a 60-year old mystery. We show that with more events at the highest energies (above 150~EeV) it may be possible to limit the character of the sources and learn about the intervening magnetic fields. Individual sources become more prominent, relative to the background, as the horizon diminishes. An event-by-event, composition-dependent observatory would allow a ``tomography'' of the sources as different mass and energy groups probe different GZK horizons. A major goal here is to provide a methodology to distinguish between steady and transient or highly variable sources. Using recent Galactic magnetic field models, we calculate ``treasure'' sky maps to identify the most promising directions for detecting Extreme Energy Cosmic Rays (EECR) doublets, events that are close in arrival time and direction. On this basis, we predict the incidence of doublets as a function of the nature of the source host galaxy. Based on the asymmetry in the distribution of time delays, we show that observation of doublets might distinguish source models. In particular the Telescope Array hotspot could exhibit temporal variability as it is in a ``magnetic window'' of small time delays. These considerations could improve the use of data with existing facilities and the planning of future ones such as Global Cosmic Ray Observatory - GCOS.


title: Wellposedness of nonlinear flows on manifolds of bounded geometry

abstract: We present simple conditions which ensure that a strongly elliptic operator $L$ generates an analytic semigroup on H\"older spaces on an arbitrary complete manifold of bounded geometry. This is done by establishing the equivalent property that $L$ is "sectorial", a condition that specifies the decay of the resolvent $(\lambda I - L)^{-1}$ as $\lambda$ diverges from the H\"older spectrum of $L$. As one step, we prove existence of this resolvent if $\lambda$ is sufficiently large, and on this general class of manifolds, use a geometric microlocal version of the semiclassical pseudodifferential calculus. The properties of $L$ and $e^{-tL}$ we obtain can then be used to prove wellposedness of a wide class of nonlinear flows. We illustrate this by proving wellposedness on H\"older spaces of the flow associated to the ambient obstruction tensor on complete manifolds of bounded geometry.


title: Nonparallel High-Quality Audio Super Resolution with Domain Adaptation and Resampling CycleGANs

abstract: Neural audio super-resolution models are typically trained on low- and high-resolution audio signal pairs. Although these methods achieve highly accurate super-resolution if the acoustic characteristics of the input data are similar to those of the training data, challenges remain: the models suffer from quality degradation for out-of-domain data, and paired data are required for training. To address these problems, we propose Dual-CycleGAN, a high-quality audio super-resolution method that can utilize unpaired data based on two connected cycle consistent generative adversarial networks (CycleGAN). Our method decomposes the super-resolution method into domain adaptation and resampling processes to handle acoustic mismatch in the unpaired low- and high-resolution signals. The two processes are then jointly optimized within the CycleGAN framework. Experimental results verify that the proposed method significantly outperforms conventional methods when paired data are not available. Code and audio samples are available from https://chomeyama.github.io/DualCycleGAN-Demo/.


title: Deep Learning Detection and Classification of Gravitational Waves from Neutron Star-Black Hole Mergers

abstract: The Laser Interferometer Gravitational-Wave Observatory (LIGO) and Virgo Interferometer Collaborations have now detected all three classes of compact binary mergers: binary black hole (BBH), binary neutron star (BNS), and neutron star-black hole (NSBH). For coalescences involving neutron stars, the simultaneous observation of gravitational and electromagnetic radiation produced by an event, has broader potential to enhance our understanding of these events, and also to probe the equation of state (EOS) of dense matter. However, electromagnetic follow-up to gravitational wave (GW) events requires rapid real-time detection and classification of GW signals, and conventional detection approaches are computationally prohibitive for the anticipated rate of detection of next-generation GW detectors. In this work, we present the first deep learning based results of classification of GW signals from NSBH mergers in \textit{real} LIGO data. We show for the first time that a deep neural network can successfully distinguish all three classes of compact binary mergers and separate them from detector noise. Specifically, we train a convolutional neural network (CNN) on $\sim 500,000$ data samples of real LIGO noise with injected BBH, BNS, and NSBH GW signals, and we show that our network has high sensitivity and accuracy. Most importantly, we successfully recover the two confirmed NSBH events to-date (GW200105 and GW200115) and the two confirmed BNS mergers to-date (GW170817 and GW190425), together with $\approx 90\%$ of all BBH candidate events from the third Gravitational Wave Transient Catalog, GWTC-3. These results are an important step towards low-latency real-time GW detection, enabling multi-messenger astronomy.


title: Towards Data-and Knowledge-Driven Artificial Intelligence: A Survey on Neuro-Symbolic Computing

abstract: Neural-symbolic computing (NeSy), which pursues the integration of the symbolic and statistical paradigms of cognition, has been an active research area of Artificial Intelligence (AI) for many years. As NeSy shows promise of reconciling the advantages of reasoning and interpretability of symbolic representation and robust learning in neural networks, it may serve as a catalyst for the next generation of AI. In the present paper, we provide a systematic overview of the recent developments and important contributions of NeSy research. Firstly, we introduce study history of this area, covering early work and foundations. We further discuss background concepts and identify key driving factors behind the development of NeSy. Afterward, we categorize recent landmark approaches along several main characteristics that underline this research paradigm, including neural-symbolic integration, knowledge representation, knowledge embedding, and functionality. Next, we briefly discuss the successful application of modern NeSy approaches in several domains. Then, we benchmark several NeSy methods on three representative application tasks. Finally, we identify the open problems together with potential future research directions. This survey is expected to help new researchers enter this rapidly evolving field and accelerate the progress towards data-and knowledge-driven AI.


title: Can magneto-transport properties provide insight into the functional groups in semiconducting MXenes?

abstract: The Hall scattering factor of Sc2CF2, Sc2CO2 and Sc2C(OH)2 is calculated using Rode's iterative approach by solving the Boltzmann transport equation. This is carried out in conjunction with calculations based on density functional theory. The electrical transport in Sc2CF2, Sc2CO2, and Sc2C(OH)2 is modelled by accounting for both elastic (acoustic and piezoelectric) and inelastic (polar optical phonon) scattering. Polar optical phonon (POP) scattering is the most significant mechanism in these MXenes. We observe that there is a window of carrier concentration where Hall factor acts dramatically; Sc2CF2 obtains an incredible high value of 2.49 while Sc2CO2 achieves a very small value of approximately 0.5, and Sc2C(OH)2 achieves the so called ideal value of 1. We propose in this paper that such Hall factor behaviour has significant promise in the field of surface group identification in MXenes, an issue that has long baffled researchers.


title: The lowest excited states of 14C and 14O nuclei within a five-cluster model

abstract: We study the ground and the first excited $0^{+}$ states of two mirror nuclei $^{14}$C and $^{14}$O within a five-cluster model (three alpha-particles and two extra nucleons) with the use of high accuracy variational approach with Gaussian bases. The first excited $0^{+}$ state of these nuclei is shown to be connected with a change of the structure of the two-nucleon subsystem moving in the field of the $^{12}$C cluster. The density distributions, electric form factors (both the elastic and transition ones), pair correlation functions, and the momentum distributions of the constituent particles are found. The most probable shapes of five-cluster systems are revealed.


title: Artificial Intelligence Assisted Inversion (AIAI): Quantifying the Spectral Features of $^{56}$Ni of Type Ia Supernovae

abstract: Following our previous study of Artificial Intelligence Assisted Inversion (AIAI) of supernova analyses (Chen et al. 2020), we train a set of deep neural networks based on the one-dimensional radiative transfer code TARDIS (Kerzendorf & Sim 2014) to simulate the optical spectra of Type Ia supernovae (SNe Ia) between 10 and 40 days after the explosion. The neural networks are applied to derive the mass of 56Ni in velocity ranges well above the photosphere for a sample of 153 well-observed SNe Ia. Many SNe have multi-epoch observations for which the decay of the radioactive 56Ni can be tested quantitatively. The 56Ni mass derived from AIAI using the observed spectra as input for the sample is found to agree with the theoretical 56Ni decay rate. The AIAI reveals a spectral signature near 3890 \AA which can be identified as being produced by multiple Ni II lines between 3950 and 4100 \AA. The mass deduced from AIAI is correlated to the light-curve shapes of SNe Ia, with the SNe Ia with broader light curves showing larger 56Ni mass in the envelope. AIAI enables spectral data of SNe to be quantitatively analyzed under theoretical frameworks based on well-defined physical assumptions.


title: When Life Gives You Lemons, Make Cherryade: Converting Feedback from Bad Responses into Good Labels

abstract: Deployed dialogue agents have the potential to integrate human feedback to continuously improve themselves. However, humans may not always provide explicit signals when the chatbot makes mistakes during interactions. In this work, we propose Juicer, a framework to make use of both binary and free-form textual human feedback. It works by: (i) extending sparse binary feedback by training a satisfaction classifier to label the unlabeled data; and (ii) training a reply corrector to map the bad replies to good ones. We find that augmenting training with model-corrected replies improves the final dialogue model, and we can further improve performance by using both positive and negative replies through the recently proposed Director model.


title: Sublacunary sequences that are strong sweeping out

abstract: An increasing sequence $(a_n)$ of positive integers which satisfies $\frac{a_{n+1}}{a_n}>1+\eta$ for some positive $\eta$ is called a lacunary sequence. It has been known for over twenty years that every lacunary sequence is strong sweeping out which means that in every aperiodic dynamical system we can find a set $E$ of arbitrary small measure so that $\limsup_N\frac{1}{N} \sum_{n\le N}\mathbb{1}_E(T^nx)=1$ and $\liminf_N\frac{1}{N} \sum_{n\le N}\mathbb{1}_E(T^nx)=0$ almost everywhere. In this paper we improve this result by showing that if $(a_n)$ satisfies only $\frac{a_{n+1}}{a_n}>1+\frac1{(\log\log n)^{1-\eta}}$ for some positive $\eta$ then it is already strong sweeping out.


title: Global Existence and Singularity Formation of Classical Solutions in Einstein-Skyrme System

abstract: In this paper, we elucidate the problem of gravitating Skyrmion governed by field equations of the Einstein-Skyrme system with no potential term in the Bondi coordinate. The spherical symmetry has to be assumed and both the metric functions and Skyrme ansatz depend on radial and retarded time coordinates which implies that the system is dynamic. We show that unique smooth solutions with arbitrary initial data exist for a certain time interval with the extra condition that the time interval must be finite in order to have a non-zero topological charge. Then, the strategy to show that global smooth solutions exist is to restrict the initial data and proceed to find suitable configurations for extending the time interval to infinity. We also discuss the possible configurations within The Einstein-Skyrme System which develop singularities in coordinate origin.


title: $C^r$-Chain closing lemma for certain partially hyperbolic diffeomorphisms

abstract: For every $r\in\mathbb{N}_{\geq 2}\cup\{\infty\}$, we prove a $C^r$-orbit connecting lemma for dynamically coherent and plaque expansive partially hyperbolic diffeomorphisms with 1-dimensional orientation preserving center bundle. To be precise, for such a diffeomorphism $f$, if a point $y$ is chain attainable from $x$ through pseudo-orbits, then for any neighborhood $U$ of $x$ and any neighborhood $V$ of $y$, there exist true orbits from $U$ to $V$ by arbitrarily $C^r$-small perturbations. As a consequence, we prove that for $C^r$-generic diffeomorphisms in this class, periodic points are dense in the chain recurrent set, and chain transitivity implies transitivity.


title: Single-Image HDR Reconstruction by Multi-Exposure Generation

abstract: High dynamic range (HDR) imaging is an indispensable technique in modern photography. Traditional methods focus on HDR reconstruction from multiple images, solving the core problems of image alignment, fusion, and tone mapping, yet having a perfect solution due to ghosting and other visual artifacts in the reconstruction. Recent attempts at single-image HDR reconstruction show a promising alternative: by learning to map pixel values to their irradiance using a neural network, one can bypass the align-and-merge pipeline completely yet still obtain a high-quality HDR image. In this work, we propose a weakly supervised learning method that inverts the physical image formation process for HDR reconstruction via learning to generate multiple exposures from a single image. Our neural network can invert the camera response to reconstruct pixel irradiance before synthesizing multiple exposures and hallucinating details in under- and over-exposed regions from a single input image. To train the network, we propose a representation loss, a reconstruction loss, and a perceptual loss applied on pairs of under- and over-exposure images and thus do not require HDR images for training. Our experiments show that our proposed model can effectively reconstruct HDR images. Our qualitative and quantitative results show that our method achieves state-of-the-art performance on the DrTMO dataset. Our code is available at https://github.com/VinAIResearch/single_image_hdr.


title: Toward Equation of Motion for Deep Neural Networks: Continuous-time Gradient Descent and Discretization Error Analysis

abstract: We derive and solve an ``Equation of Motion'' (EoM) for deep neural networks (DNNs), a differential equation that precisely describes the discrete learning dynamics of DNNs. Differential equations are continuous but have played a prominent role even in the study of discrete optimization (gradient descent (GD) algorithms). However, there still exist gaps between differential equations and the actual learning dynamics of DNNs due to discretization error. In this paper, we start from gradient flow (GF) and derive a counter term that cancels the discretization error between GF and GD. As a result, we obtain EoM, a continuous differential equation that precisely describes the discrete learning dynamics of GD. We also derive discretization error to show to what extent EoM is precise. In addition, we apply EoM to two specific cases: scale- and translation-invariant layers. EoM highlights differences between continuous-time and discrete-time GD, indicating the importance of the counter term for a better description of the discrete learning dynamics of GD. Our experimental results support our theoretical findings.


title: Self-similar collapse in a circular magnetic field and electron beam jets by hybrid transverse plasmon

abstract: Based on the set of nonlinear coupling equations describing the interaction of the high-frequency field, the self-generated magnetic field and the ion-acoustic field, the dispersion relation for the circular magnetic field is obtained. The numerical results indicate that the strength of the magnetic field have influence on the growth rate of modulation instability. The self-generated magnetic field has the tendency to self-similar collapse which makes the electron escapes along the axial region and form collimated jets. The velocity of jets is calculated and the results are consistent with experimental observations. The research may be applied to understand the dynamic process of electron beam jets in laboratory and space plasma.


title: An adaptive low-rank splitting approach for the extended Fisher--Kolmogorov equation

abstract: The extended Fisher--Kolmogorov (EFK) equation has been used to describe some phenomena in physical, material and biology systems. In this paper, we propose a full-rank splitting scheme and a rank-adaptive splitting approach for this equation. We first use a finite difference method to approximate the space derivatives. Then, the resulting semi-discrete system is split into two stiff linear parts and a nonstiff nonlinear part. This leads to our full-rank splitting scheme. The convergence and the maximum principle of the proposed scheme are proved rigorously. Based on the frame of the full-rank splitting scheme, a rank-adaptive splitting approach for obtaining a low-rank solution of the EFK equation. Numerical examples show that our methods are robust and accurate. They can also preserve energy dissipation and the discrete maximum principle.


title: Mitigating Health Disparities in EHR via Deconfounder

abstract: Health disparities, or inequalities between different patient demographics, are becoming crucial in medical decision-making, especially in Electronic Health Record (EHR) predictive modeling. To ensure the fairness of sensitive attributes, conventional studies mainly adopt calibration or re-weighting methods to balance the performance on among different demographic groups. However, we argue that these methods have some limitations. First, these methods usually mean a trade-off between the model's performance and fairness. Second, many methods completely attribute unfairness to the data collection process, which lacks substantial evidence. In this paper, we provide an empirical study to discover the possibility of using deconfounder to address the disparity issue in healthcare. Our study can be summarized in two parts. The first part is a pilot study demonstrating the exacerbation of disparity when unobserved confounders exist. The second part proposed a novel framework, Parity Medical Deconfounder (PriMeD), to deal with the disparity issue in healthcare datasets. Inspired by the deconfounder theory, PriMeD adopts a Conditional Variational Autoencoder (CVAE) to learn latent factors (substitute confounders) for observational data, and extensive experiments are provided to show its effectiveness.


title: Learning to Immunize Images for Tamper Localization and Self-Recovery

abstract: Digital images are vulnerable to nefarious tampering attacks such as content addition or removal that severely alter the original meaning. It is somehow like a person without protection that is open to various kinds of viruses. Image immunization (Imuge) is a technology of protecting the images by introducing trivial perturbation, so that the protected images are immune to the viruses in that the tampered contents can be auto-recovered. This paper presents Imuge+, an enhanced scheme for image immunization. By observing the invertible relationship between image immunization and the corresponding self-recovery, we employ an invertible neural network to jointly learn image immunization and recovery respectively in the forward and backward pass. We also introduce an efficient attack layer that involves both malicious tamper and benign image post-processing, where a novel distillation-based JPEG simulator is proposed for improved JPEG robustness. Our method achieves promising results in real-world tests where experiments show accurate tamper localization as well as high-fidelity content recovery. Additionally, we show superior performance on tamper localization compared to state-of-the-art schemes based on passive forensics.


title: Speaker recognition with two-step multi-modal deep cleansing

abstract: Neural network-based speaker recognition has achieved significant improvement in recent years. A robust speaker representation learns meaningful knowledge from both hard and easy samples in the training set to achieve good performance. However, noisy samples (i.e., with wrong labels) in the training set induce confusion and cause the network to learn the incorrect representation. In this paper, we propose a two-step audio-visual deep cleansing framework to eliminate the effect of noisy labels in speaker representation learning. This framework contains a coarse-grained cleansing step to search for the peculiar samples, followed by a fine-grained cleansing step to filter out the noisy labels. Our study starts from an efficient audio-visual speaker recognition system, which achieves a close to perfect equal-error-rate (EER) of 0.01\%, 0.07\% and 0.13\% on the Vox-O, E and H test sets. With the proposed multi-modal cleansing mechanism, four different speaker recognition networks achieve an average improvement of 5.9\%. Code has been made available at: \textcolor{magenta}{\url{https://github.com/TaoRuijie/AVCleanse}}.


title: Self-Supervised Learning with Multi-View Rendering for 3D Point Cloud Analysis

abstract: Recently, great progress has been made in 3D deep learning with the emergence of deep neural networks specifically designed for 3D point clouds. These networks are often trained from scratch or from pre-trained models learned purely from point cloud data. Inspired by the success of deep learning in the image domain, we devise a novel pre-training technique for better model initialization by utilizing the multi-view rendering of the 3D data. Our pre-training is self-supervised by a local pixel/point level correspondence loss computed from perspective projection and a global image/point cloud level loss based on knowledge distillation, thus effectively improving upon popular point cloud networks, including PointNet, DGCNN and SR-UNet. These improved models outperform existing state-of-the-art methods on various datasets and downstream tasks. We also analyze the benefits of synthetic and real data for pre-training, and observe that pre-training on synthetic data is also useful for high-level downstream tasks. Code and pre-trained models are available at https://github.com/VinAIResearch/selfsup_pcd.


title: Radius-Dependent Spin Transition of Dark Matter Halos

abstract: A numerical detection of the radius-dependent spin transition of dark matter halos is reported. Analyzing the data from the IllustrisTNG simulations, we measure the halo spin vectors at several inner radii within the virial boundaries and investigate their orientations in the principal frames of the tidal and velocity shear fields, called the Tweb and Vweb, respectively. The halo spin vectors in the high-mass section exhibit a transition from the Tweb intermediate to major principal axes as they are measured at more inner radii, which holds for both of the dark matter and baryonic components. The radius threshold at which the transition occurs depends on the smoothing scale, $R_{f}$, becoming larger as $R_{f}$ decreases. For the case of the Vweb, the occurrence of the radius-dependent spin transition is witnessed only when $R_{f}\ge 1\, h^{-1}$Mpc. Repeating the same analysis but with the vorticity vectors, we reveal a critical difference from the spins. The vorticity vectors are always perpendicular to the Tweb (Vweb) major principal axes, regardless of $R_{f}$, which indicates that the halo inner spins are not strongly affected by the generation of vorticity. It is also shown that the halo spins, as well as the Tweb (Vweb) principal axes, have more directional coherence over a wide range of radial distances in the regions where the vorticity vectors have higher magnitudes. The physical interpretations and implications of our results are discussed.


title: Relative Behavioral Attributes: Filling the Gap between Symbolic Goal Specification and Reward Learning from Human Preferences

abstract: Generating complex behaviors that satisfy the preferences of non-expert users is a crucial requirement for AI agents. Interactive reward learning from trajectory comparisons (a.k.a. RLHF) is one way to allow non-expert users to convey complex objectives by expressing preferences over short clips of agent behaviors. Even though this parametric method can encode complex tacit knowledge present in the underlying tasks, it implicitly assumes that the human is unable to provide richer feedback than binary preference labels, leading to intolerably high feedback complexity and poor user experience. While providing a detailed symbolic closed-form specification of the objectives might be tempting, it is not always feasible even for an expert user. However, in most cases, humans are aware of how the agent should change its behavior along meaningful axes to fulfill their underlying purpose, even if they are not able to fully specify task objectives symbolically. Using this as motivation, we introduce the notion of Relative Behavioral Attributes, which allows the users to tweak the agent behavior through symbolic concepts (e.g., increasing the softness or speed of agents' movement). We propose two practical methods that can learn to model any kind of behavioral attributes from ordered behavior clips. We demonstrate the effectiveness of our methods on four tasks with nine different behavioral attributes, showing that once the attributes are learned, end users can produce desirable agent behaviors relatively effortlessly, by providing feedback just around ten times. This is over an order of magnitude less than that required by the popular learning-from-human-preferences baselines. The supplementary video and source code are available at: https://guansuns.github.io/pages/rba.


title: Credit-Based Congestion Pricing: Equilibrium Properties and Optimal Scheme Design

abstract: Credit-based congestion pricing (CBCP) has emerged as a mechanism to alleviate the social inequity concerns of road congestion pricing - a promising strategy for traffic congestion mitigation - by providing low-income users with travel credits to offset some of their toll payments. While CBCP offers immense potential for addressing inequity issues that hamper the practical viability of congestion pricing, the deployment of CBCP in practice is nascent, and the potential efficacy and optimal design of CBCP schemes have yet to be formalized. In this work, we study the design of CBCP schemes to achieve particular societal objectives and investigate their influence on traffic patterns when routing heterogeneous users with different values of time (VoTs) in a multi-lane highway with an express lane. We introduce a new non-atomic congestion game model of a mixed-economy, wherein eligible users receive travel credits while the remaining ineligible users pay out-of-pocket to use the express lane. In this setting, we investigate the effect of CBCP schemes on traffic patterns by characterizing the properties (i.e., existence, comparative statics) of the corresponding Nash equilibria and, in the setting when eligible users have time-invariant VoTs, develop a convex program to compute these equilibria. We further present a bi-level optimization framework to design optimal CBCP schemes to achieve a central planner's societal objectives. Finally, we conduct numerical experiments based on a case study of the San Mateo 101 Express Lanes Project, one of the first North American CBCP pilots. Our results demonstrate the potential of CBCP to enable low-income travelers to avail of the travel time savings provided by congestion pricing on express lanes while having comparatively low impacts on the travel costs of other road users.


title: Long-HOT: A Modular Hierarchical Approach for Long-Horizon Object Transport

abstract: We address key challenges in long-horizon embodied exploration and navigation by proposing a new object transport task and a novel modular framework for temporally extended navigation. Our first contribution is the design of a novel Long-HOT environment focused on deep exploration and long-horizon planning where the agent is required to efficiently find and pick up target objects to be carried and dropped at a goal location, with load constraints and optional access to a container if it finds one. Further, we propose a modular hierarchical transport policy (HTP) that builds a topological graph of the scene to perform exploration with the help of weighted frontiers. Our hierarchical approach uses a combination of motion planning algorithms to reach point goals within explored locations and object navigation policies for moving towards semantic targets at unknown locations. Experiments on both our proposed Habitat transport task and on MultiOn benchmarks show that our method significantly outperforms baselines and prior works. Further, we validate the effectiveness of our modular approach for long-horizon transport by demonstrating meaningful generalization to much harder transport scenes with training only on simpler versions of the task.


title: Subsidiary Prototype Alignment for Universal Domain Adaptation

abstract: Universal Domain Adaptation (UniDA) deals with the problem of knowledge transfer between two datasets with domain-shift as well as category-shift. The goal is to categorize unlabeled target samples, either into one of the "known" categories or into a single "unknown" category. A major problem in UniDA is negative transfer, i.e. misalignment of "known" and "unknown" classes. To this end, we first uncover an intriguing tradeoff between negative-transfer-risk and domain-invariance exhibited at different layers of a deep network. It turns out we can strike a balance between these two metrics at a mid-level layer. Towards designing an effective framework based on this insight, we draw motivation from Bag-of-visual-Words (BoW). Word-prototypes in a BoW-like representation of a mid-level layer would represent lower-level visual primitives that are likely to be unaffected by the category-shift in the high-level features. We develop modifications that encourage learning of word-prototypes followed by word-histogram based classification. Following this, subsidiary prototype-space alignment (SPA) can be seen as a closed-set alignment problem, thereby avoiding negative transfer. We realize this with a novel word-histogram-related pretext task to enable closed-set SPA, operating in conjunction with goal task UniDA. We demonstrate the efficacy of our approach on top of existing UniDA techniques, yielding state-of-the-art performance across three standard UniDA and Open-Set DA object recognition benchmarks.


title: Broadband vortex fiber nulling: high-dispersion exoplanet science at the diffraction limit

abstract: As the number of confirmed exoplanets continues to grow, there is an increased push to spectrally characterize them to determine their atmospheric composition, formation paths, rotation rates, and habitability. However, there is a large population of known exoplanets that either do not transit their star or have been detected via the radial velocity (RV) method at very small angular separations such that they are inaccessible to traditional coronagraph systems. Vortex Fiber Nulling (VFN) is a new single-aperture interferometric technique that uses the entire telescope pupil to bridge the gap between traditional coronagraphy and RV or Transit methods by enabling the direct observation and spectral characterization of targets at and within the diffraction limit. By combining a vortex mask with a single mode fiber, the on-axis starlight is rejected while the off-axis planet light is coupled and efficiently routed to a radiometer or spectrograph for analysis. We have demonstrated VFN in the lab monochromatically in the past. In this paper we present a polychromatic validation of VFN with nulls of $<10^{-4}$ across 15% bandwidth light. We also provide an update on deployment plans and predicted yield estimates for the VFN mode of the Keck Planet Imager and Characterizer (KPIC) instrument. Using PSISIM, a simulation package developed in cooperation with several groups, we assess KPIC VFN's ability to detect and characterize different types of targets including planet candidates around promising young-moving-group stars as well as known exoplanets detected via the RV method. The KPIC VFN on-sky demonstration will pave the road to deployment on future instruments such as Keck-HISPEC and TMT-MODHIS where it could provide high-resolution spectra of sub-Jupiter mass planets down to 5 milliarcseconds from their star.


title: Joint Semantic Transfer Network for IoT Intrusion Detection

abstract: In this paper, we propose a Joint Semantic Transfer Network (JSTN) towards effective intrusion detection for large-scale scarcely labelled IoT domain. As a multi-source heterogeneous domain adaptation (MS-HDA) method, the JSTN integrates a knowledge rich network intrusion (NI) domain and another small-scale IoT intrusion (II) domain as source domains, and preserves intrinsic semantic properties to assist target II domain intrusion detection. The JSTN jointly transfers the following three semantics to learn a domain-invariant and discriminative feature representation. The scenario semantic endows source NI and II domain with characteristics from each other to ease the knowledge transfer process via a confused domain discriminator and categorical distribution knowledge preservation. It also reduces the source-target discrepancy to make the shared feature space domain-invariant. Meanwhile, the weighted implicit semantic transfer boosts discriminability via a fine-grained knowledge preservation, which transfers the source categorical distribution to the target domain. The source-target divergence guides the importance weighting during knowledge preservation to reflect the degree of knowledge learning. Additionally, the hierarchical explicit semantic alignment performs centroid-level and representative-level alignment with the help of a geometric similarity-aware pseudo-label refiner, which exploits the value of unlabelled target II domain and explicitly aligns feature representations from a global and local perspective in a concentrated manner. Comprehensive experiments on various tasks verify the superiority of the JSTN against state-of-the-art comparing methods, on average a 10.3% of accuracy boost is achieved. The statistical soundness of each constituting component and the computational efficiency are also verified.


title: Decontamination of the scientific literature

abstract: Research misconduct and frauds pollute the scientific literature. Honest errors and malevolent data fabrication, image manipulation, journal hijacking, and plagiarism passed peer review unnoticed. Problematic papers deceive readers, authors citing them, and AI-powered literature-based discovery. Flagship publishers accepted hundreds flawed papers despite claiming to enforce peer review. This application ambitions to decontaminate the scientific literature using curative and preventive actions.


title: GeoGCN: Geometric Dual-domain Graph Convolution Network for Point Cloud Denoising

abstract: We propose GeoGCN, a novel geometric dual-domain graph convolution network for point cloud denoising (PCD). Beyond the traditional wisdom of PCD, to fully exploit the geometric information of point clouds, we define two kinds of surface normals, one is called Real Normal (RN), and the other is Virtual Normal (VN). RN preserves the local details of noisy point clouds while VN avoids the global shape shrinkage during denoising. GeoGCN is a new PCD paradigm that, 1) first regresses point positions by spatialbased GCN with the help of VNs, 2) then estimates initial RNs by performing Principal Component Analysis on the regressed points, and 3) finally regresses fine RNs by normalbased GCN. Unlike existing PCD methods, GeoGCN not only exploits two kinds of geometry expertise (i.e., RN and VN) but also benefits from training data. Experiments validate that GeoGCN outperforms SOTAs in terms of both noise-robustness and local-and-global feature preservation.


title: The Role of Immigrants, Emigrants, and Locals in the Historical Formation of European Knowledge Agglomerations

abstract: Did migrants make Paris a Mecca for the arts and Vienna a beacon of classical music? Or was their rise a pure consequence of local actors? Here, we use data on more than 22,000 historical individuals born between the years 1000 and 2000 to estimate the contribution of famous immigrants, emigrants, and locals to the knowledge specializations of European regions. We find that the probability that a region develops or keeps specialization in an activity (based on the birth of famous physicists, painters, etc.) grows with both, the presence of immigrants with knowledge on that activity and immigrants with knowledge in related activities. In contrast, we do not find robust evidence that the presence of locals with related knowledge explains entries and/or exits. We address some endogeneity concerns using fixed-effects models considering any location-period-activity specific factors (e.g. the presence of a new university attracting scientists).


title: Phase II of the Keck Planet Imager and Characterizer: system-level laboratory characterization and preliminary on-sky commissioning

abstract: The Keck Planet Imager and Characterizer (KPIC) is a series of upgrades for the Keck II Adaptive Optics (AO) system and the NIRSPEC spectrograph to enable diffraction-limited, high-resolution ($R>30,000$) spectroscopy of exoplanets and low-mass companions in the K and L bands. Phase I consisted of single-mode fiber injection/extraction units (FIU/FEU) used in conjunction with an H-band pyramid wavefront sensor. Phase II, deployed and commissioned in 2022, adds a 1000-actuator deformable mirror, beam-shaping optics, a vortex coronagraph, and other upgrades to the FIU/FEU. The use of single-mode fibers provides a gain in stellar rejection, a substantial reduction in sky background, and an extremely stable line-spread function on the spectrograph. In this paper we present the results of extensive system-level laboratory testing and characterization showing the instrument's Phase II throughput, stability, repeatability, and other key performance metrics prior to delivery and during installation at Keck. We also demonstrate the capabilities of the various observing modes enabled by the new system modules using internal test light sources. Finally, we show preliminary results of on-sky tests performed in the first few months of Phase II commissioning along with the next steps for the instrument. Once commissioning of Phase II is complete, KPIC will continue to characterize exoplanets at an unprecedented spectral resolution, thereby growing its already successful track record of 23 detected exoplanets and brown dwarfs from Phase I. Using the new vortex fiber nulling (VFN) mode, Phase II will also be able to search for exoplanets at small angular separations less than 45 milliarcseconds which conventional coronagraphs cannot reach.


title: Actions of discrete amenable groups into the normalizers of full groups of ergodic transformations

abstract: We apply Evans-Kishimoto's intertwining argument to the classification of actions of discrete amenable groups into the normalizer of a full group of an ergodic transformation. Our proof does not depend on the types of ergodic transformations.


title: Low-Complexity Channel Estimation for Massive MIMO Systems with Decentralized Baseband Processing

abstract: The traditional centralized baseband processing architecture is faced with the bottlenecks of high computation complexity and excessive fronthaul communication, especially when the number of antennas at the base station (BS) is large. To cope with these two challenges, the decentralized baseband processing (DPB) architecture has been proposed, where the BS antennas are partitioned into multiple clusters, and each is connected to a local baseband unit (BBU). In this paper, we are interested in the low-complexity distributed channel estimation (CE) method under such DBP architecture, which is rarely studied in the literature. The aim is to devise distributed CE algorithms that can perform as well as the centralized scheme but with a small inter-BBU communication cost. Specifically, based on the low-complexity diagonal minimum mean square error channel estimator, we propose two distributed CE algorithms, namely the aggregate-then-estimate algorithm and the estimate-then-aggregate algorithm. In contrast to the existing distributed CE algorithm which requires iterative information exchanges among the nodes, our algorithms only require one roundtrip communication among BBUs. Extensive experiment results are presented to demonstrate the advantages of the proposed distributed CE algorithms in terms of estimation accuracy, inter-BBU communication cost, and computation complexity.


title: Empirical temperature- and extinction-dependent extinction coefficients for the GALEX, Pan-STARRS1, Gaia, SDSS, 2MASS, and WISE passbands

abstract: We have obtained accurate dust reddening from far-ultraviolet (UV) to the mid-infrared (IR) for up to 5 million stars by the star-pair algorithm based on LAMOST stellar parameters along with GALEX, Pan-STARRS 1, Gaia, SDSS, 2MASS, and WISE photometric data. The typical errors are between 0.01-0.03 mag for most colors. We derived the empirical reddening coefficients for 21 colors both in the traditional (single valued) way and as a function of Teff and E(B-V) by using the largest samples of accurate reddening measurements, together with the extinction values from Schlegel et al. The corresponding extinction coefficients have also been obtained. The results are compared with model predictions and generally in good agreement. Comparisons with measurements in the literature show that the Teff- and E(B-V)-dependent coefficients explain the discrepancies between different measurements naturally, i.e., using sample stars of different temperatures and reddening. Our coefficients are mostly valid in the extinction range of 0-0.5 mag and the temperature range of 4000-10000 K. We recommend that the new Teff and E(B-V) dependent reddening and extinction coefficients should be used in the future. A Python package is also provided for the usage of the coefficient


title: Chiral Spin Textures for Next-Generation Memory and Unconventional Computing

abstract: The realization of chiral spin textures - comprising myriad distinct, nanoscale arrangements of spins with topological properties - has established pathways for engineering robust, energy-efficient and scalable elements for non-volatile nanoelectronics. Particularly, current-induced manipulation of spin textures in nanowire racetracks and tunnel junction based devices are actively investigated for applications in memory, logic and unconventional computing. In this article, we paint a background on the progress of spin textures, as well as the relevant state-of-the-art techniques used for their development. In particular, we clarify the competing energy landscape of chiral spin textures, such as skyrmions and chiral domain walls, to tune their size, density and zero-field stability. Next, we discuss the spin texture phenomenology and their response to extrinsic factors arising from geometric constraints, inter-wire interactions and thermal-electrical effects. Finally, we reveal promising chiral spintronic memory and neuromorphic devices, and discuss emerging material and device engineering opportunities.


title: Locating the eigenshield of a network via perturbation theory

abstract: The functions of complex networks are usually determined by a small set of vital nodes. Finding the best set of vital nodes (eigenshield nodes) is critical to the network's robustness against rumor spreading and cascading failures, which makes it one of the fundamental problems in network science. The problem is challenging as it requires to maximize the influence of nodes in the set while simultaneously minimizing the redundancies between the set's nodes. However, the redundancy mechanism is rarely investigated by previous studies. Here we introduce the matrix perturbation framework to find a small ``eigenshield" set of nodes that, when removed, lead to the largest drop in the network's spectral radius. We show that finding the ``eigenshield" nodes can be translated into the optimization of an objective function that simultaneously accounts for the individual influence of each node and redundancy between different nodes. We analytically quantify the influence redundancy that explains why an important node might play an insignificant role in the ``eigenshield" node set. Extensive experiments under diverse influence maximization problems, ranging from network dismantling to spreading maximization, demonstrate that the eigenshield detection tends to significantly outperforms state-of-the-art methods across most problems. Our findings shed light on the mechanisms that may lie at the core of the function of vital nodes in complex network.


title: Multidimensionnel Borg-Levinson uniqueness and stability results for the Robin Laplacian with unbounded potential

abstract: This article deals with the uniqueness and stability issues in the inverse problem of determining the unbounded potential of the Schr\"odinger operator in a bounded domain of dimension 3 or greater, endowed with Robin boundary condition, from knowledge of its boundary spectral data. These data are defined by the pairs formed by the eigenvalues and either full or partial Dirichlet measurement of the eigenfunctions on the boundary of the domain.


title: Digital Quantum Simulation of the Spin-Boson Model under Open System Dynamics

abstract: Digital quantum computers have the potential to simulate complex quantum systems. The spin-boson model is one of such systems, used in disparate physical domains. Importantly, in a number of setups, the spin-boson model is open, i.e. the system is in contact with an external environment which can, for instance, cause the decay of the spin state. Here we study how to simulate such open quantum dynamics in a digital quantum computer, for which we use one of IBM's hardware. We consider in particular how accurate different implementations of the evolution result as a function of the level of noise in the hardware and of the parameters of the open dynamics. For the regimes studied, we show that the key aspect is to simulate the unitary portion of the dynamics, while the dissipative part can lead to a more noise-resistant simulation. We consider both a single spin coupled to a harmonic oscillator, and also two spins coupled to the oscillator. In the latter case, we show that it is possible to simulate the emergence of correlations between the spins via the oscillator.


title: DELFI: Deep Mixture Models for Long-term Air Quality Forecasting in the Delhi National Capital Region

abstract: The identification and control of human factors in climate change is a rapidly growing concern and robust, real-time air-quality monitoring and forecasting plays a critical role in allowing effective policy formulation and implementation. This paper presents DELFI, a novel deep learning-based mixture model to make effective long-term predictions of Particulate Matter (PM) 2.5 concentrations. A key novelty in DELFI is its multi-scale approach to the forecasting problem. The observation that point predictions are more suitable in the short-term and probabilistic predictions in the long-term allows accurate predictions to be made as much as 24 hours in advance. DELFI incorporates meteorological data as well as pollutant-based features to ensure a robust model that is divided into two parts: (i) a stack of three Long Short-Term Memory (LSTM) networks that perform differential modelling of the same window of past data, and (ii) a fully-connected layer enabling attention to each of the components. Experimental evaluation based on deployment of 13 stations in the Delhi National Capital Region (Delhi-NCR) in India establishes that DELFI offers far superior predictions especially in the long-term as compared to even non-parametric baselines. The Delhi-NCR recorded the 3rd highest PM levels amongst 39 mega-cities across the world during 2011-2015 and DELFI's performance establishes it as a potential tool for effective long-term forecasting of PM levels to enable public health management and environment protection.


title: Groups of type $\mathrm{E}_6$ and $\mathrm{E}_7$ over Rings via Brown Algebras and Related Torsors

abstract: We study structurable algebras and their associated Freudenthal triple systems over commutative rings. The automorphism groups of these triple systems are exceptional groups of type $\mathrm{E}_7$, and we realize groups of type $\mathrm{E}_6$ as centralizers. When 6 is invertible, we further give a geometric description of homogeneous spaces of type $\mathrm{E}_7/\mathrm{E}_6$, and show that they parametrize principal isotopes of Brown algebras. As opposed to the situation over fields, we show that such isotopes may be non-isomorphic.


title: Incorporating Interactive Facts for Stock Selection via Neural Recursive ODEs

abstract: Stock selection attempts to rank a list of stocks for optimizing investment decision making, aiming at minimizing investment risks while maximizing profit returns. Recently, researchers have developed various (recurrent) neural network-based methods to tackle this problem. Without exceptions, they primarily leverage historical market volatility to enhance the selection performance. However, these approaches greatly rely on discrete sampled market observations, which either fail to consider the uncertainty of stock fluctuations or predict continuous stock dynamics in the future. Besides, some studies have considered the explicit stock interdependence derived from multiple domains (e.g., industry and shareholder). Nevertheless, the implicit cross-dependencies among different domains are under-explored. To address such limitations, we present a novel stock selection solution -- StockODE, a latent variable model with Gaussian prior. Specifically, we devise a Movement Trend Correlation module to expose the time-varying relationships regarding stock movements. We design Neural Recursive Ordinary Differential Equation Networks (NRODEs) to capture the temporal evolution of stock volatility in a continuous dynamic manner. Moreover, we build a hierarchical hypergraph to incorporate the domain-aware dependencies among the stocks. Experiments conducted on two real-world stock market datasets demonstrate that StockODE significantly outperforms several baselines, such as up to 18.57% average improvement regarding Sharpe Ratio.


title: Comparison of Stereo Matching Algorithms for the Development of Disparity Map

abstract: Stereo Matching is one of the classical problems in computer vision for the extraction of 3D information but still controversial for accuracy and processing costs. The use of matching techniques and cost functions is crucial in the development of the disparity map. This paper presents a comparative study of six different stereo matching algorithms including Block Matching (BM), Block Matching with Dynamic Programming (BMDP), Belief Propagation (BP), Gradient Feature Matching (GF), Histogram of Oriented Gradient (HOG), and the proposed method. Also three cost functions namely Mean Squared Error (MSE), Sum of Absolute Differences (SAD), Normalized Cross-Correlation (NCC) were used and compared. The stereo images used in this study were from the Middlebury Stereo Datasets provided with perfect and imperfect calibrations. Results show that the selection of matching function is quite important and also depends on the images properties. Results showed that the BP algorithm in most cases provided better results getting accuracies over 95%.


title: The Functional Analytic Approach for quasi-periodic boundary value problems for the Helmholtz equation

abstract: We lay down the preliminary work to apply the Functional Analytic Approach to quasi-periodic boundary value problems for the Helmholtz equation. This consists in introducing a quasi-periodic fundamental solution and the related layer potentials, showing how they are used to construct the solutions of quasi-periodic boundary value problems, and how they behave when we perform a singular perturbation of the domain. To show an application, we study a nonlinear quasi-periodic Robin problem in a domain with a set of holes that shrink to points.


title: Coincidence analysis of Stackelberg and Nash equilibria in three-player leader-follower security games

abstract: There has been significant recent interest in leader-follower security games, where the leader dominates the decision process with the Stackelberg equilibrium (SE) strategy. However, such a leader-follower scheme may become invalid in practice due to subjective or objective factors, and then the Nash equilibrium (NE) strategy may be an alternative option. In this case, the leader may face a dilemma of choosing an SE strategy or an NE strategy. In this paper, we focus on a unified three-player leader-follower security game and study the coincidence between SE and NE. We first explore a necessary and sufficient condition for the case that each SE is an NE, which can be further presented concisely when the SE is unique. This condition not only provides access to seek a satisfactory SE strategy but also makes a criterion to verify an obtained SE strategy. Then we provide another appropriate condition for the case that at least one SE is an NE. Moreover, since the coincidence condition may not always be satisfied, we describe the closeness between SE and NE, and give an upper bound of their deviation. Finally, we show the applicability of the obtained theoretical results in several practical security cases, including the secure transmission problem and the cybersecurity defense.


title: Being Comes from Not-being: Open-vocabulary Text-to-Motion Generation with Wordless Training

abstract: Text-to-motion generation is an emerging and challenging problem, which aims to synthesize motion with the same semantics as the input text. However, due to the lack of diverse labeled training data, most approaches either limit to specific types of text annotations or require online optimizations to cater to the texts during inference at the cost of efficiency and stability. In this paper, we investigate offline open-vocabulary text-to-motion generation in a zero-shot learning manner that neither requires paired training data nor extra online optimization to adapt for unseen texts. Inspired by the prompt learning in NLP, we pretrain a motion generator that learns to reconstruct the full motion from the masked motion. During inference, instead of changing the motion generator, our method reformulates the input text into a masked motion as the prompt for the motion generator to ``reconstruct'' the motion. In constructing the prompt, the unmasked poses of the prompt are synthesized by a text-to-pose generator. To supervise the optimization of the text-to-pose generator, we propose the first text-pose alignment model for measuring the alignment between texts and 3D poses. And to prevent the pose generator from overfitting to limited training texts, we further propose a novel wordless training mechanism that optimizes the text-to-pose generator without any training texts. The comprehensive experimental results show that our method obtains a significant improvement against the baseline methods. The code is available at https://github.com/junfanlin/oohmg.


title: Lyapunov-based Nonlinear Model Predictive Control for Attitude Trajectory Tracking of Unmanned Aerial Vehicles

abstract: This paper presents a new Lyapunov-based nonlinear model predictive controller (LNMPC) for the attitude control problem of unmanned aerial vehicles (UAVs), which is essential for their functioning operation. The controller is designed based on a quadratic cost function integrating UAV dynamics and system constraints. An additional contraction constraint is then introduced to ensure closed-loop system stability. That constraint is fulfilled via a Lyapunov function derived from a sliding mode controller (SMC). The feasibility and stability of the LNMPC are finally proved. Simulation and comparison results show that the proposed controller guarantees the system stability and outperforms other state-of-the-art nonlinear controllers such as the backstepping controller (BSC) and SMC. In addition, the proposed controller can be integrated into an existing UAV model in the Gazebo simulator to perform software-in-the-loop tests. The results show that the LNMPC is better than the built-in PID controller of the UAV, which confirms the validity and applicability of our proposed approach.


title: Time-Domain Universal Linear-Optical Operations for Universal Quantum Information Processing

abstract: We demonstrate universal and programmable three-mode linear optical operations in the time domain by realizing a scalable dual-loop optical circuit suitable for universal quantum information processing (QIP). The programmability, validity, and deterministic operation of our circuit are demonstrated by performing nine different three-mode operations on squeezed-state pulses, fully characterizing the outputs with variable measurements, and confirming their entanglement. Our circuit can be scaled up just by making the outer loop longer and also extended to universal quantum computers by incorporating feedforward systems. Thus, our work paves the way to large-scale universal optical QIP.


title: Real Regulators for Products of Elliptic Curves

abstract: Assuming the Kunneth decomposition of the Chow groups of products of general Kummer surfaces, we prove that the Hodge-${\mathcal D}$-conjecture fails for the real regulator $r_{k,1}$ on a product of $n$ general elliptic curves for $2n\ge 3k-1\ge 8$.


title: PSFormer: Point Transformer for 3D Salient Object Detection

abstract: We propose PSFormer, an effective point transformer model for 3D salient object detection. PSFormer is an encoder-decoder network that takes full advantage of transformers to model the contextual information in both multi-scale point- and scene-wise manners. In the encoder, we develop a Point Context Transformer (PCT) module to capture region contextual features at the point level; PCT contains two different transformers to excavate the relationship among points. In the decoder, we develop a Scene Context Transformer (SCT) module to learn context representations at the scene level; SCT contains both Upsampling-and-Transformer blocks and Multi-context Aggregation units to integrate the global semantic and multi-level features from the encoder into the global scene context. Experiments show clear improvements of PSFormer over its competitors and validate that PSFormer is more robust to challenging cases such as small objects, multiple objects, and objects with complex structures.


title: Multiresolution Signal Processing of Financial Market Objects

abstract: Multiresolution analysis has applications across many disciplines in the study of complex systems and their dynamics. Financial markets are among the most complex entities in our environment, yet mainstream quantitative models operate at predetermined scale, rely on linear correlation measures, and struggle to recognize non-linear or causal structures. In this paper, we combine neural networks known to capture non-linear associations with a multiscale decomposition to facilitate a better understanding of financial market data substructures. Quantization keeps our decompositions calibrated to market at every scale. We illustrate our approach in the context of seven use cases.


title: Conserved currents for Kerr and orthogonality of quasinormal modes

abstract: We introduce a bilinear form for Weyl scalar perturbations of Kerr. The form is symmetric and conserved, and we show that, when combined with a suitable renormalization prescription involving complex r integration contours, quasinormal modes are orthogonal in the bilinear form for different (l, m, n). These properties are apparently not evident consequences of standard properties for the radial and angular solutions to the decoupled Teukolsky relations and rely on the Petrov type D character of Kerr and its t-$\phi$ reflection isometry. We show that quasinormal mode excitation coefficients are given precisely by the projection with respect to our bilinear form. These properties can make our bilinear form useful to set up a framework for nonlinear quasinormal mode coupling in Kerr. We also provide a general discussion on conserved local currents and their associated local symmetry operators for metric and Weyl perturbations, identifying a collection containing an increasing number of derivatives.


title: A comprehensive study on self-supervised distillation for speaker representation learning

abstract: In real application scenarios, it is often challenging to obtain a large amount of labeled data for speaker representation learning due to speaker privacy concerns. Self-supervised learning with no labels has become a more and more promising way to solve it. Compared with contrastive learning, self-distilled approaches use only positive samples in the loss function and thus are more attractive. In this paper, we present a comprehensive study on self-distilled self-supervised speaker representation learning, especially on critical data augmentation. Our proposed strategy of audio perturbation augmentation has pushed the performance of the speaker representation to a new limit. The experimental results show that our model can achieve a new SoTA on Voxceleb1 speaker verification evaluation benchmark ( i.e., equal error rate (EER) 2.505%, 2.473%, and 4.791% for trial Vox1-O, Vox1-E and Vox1-H , respectively), discarding any speaker labels in the training phase.


title: On the Use of Modality-Specific Large-Scale Pre-Trained Encoders for Multimodal Sentiment Analysis

abstract: This paper investigates the effectiveness and implementation of modality-specific large-scale pre-trained encoders for multimodal sentiment analysis~(MSA). Although the effectiveness of pre-trained encoders in various fields has been reported, conventional MSA methods employ them for only linguistic modality, and their application has not been investigated. This paper compares the features yielded by large-scale pre-trained encoders with conventional heuristic features. One each of the largest pre-trained encoders publicly available for each modality are used; CLIP-ViT, WavLM, and BERT for visual, acoustic, and linguistic modalities, respectively. Experiments on two datasets reveal that methods with domain-specific pre-trained encoders attain better performance than those with conventional features in both unimodal and multimodal scenarios. We also find it better to use the outputs of the intermediate layers of the encoders than those of the output layer. The codes are available at https://github.com/ando-hub/MSA_Pretrain.


title: Data-driven Output Regulation via Gaussian Processes and Luenberger Internal Models

abstract: This paper deals with the problem of adaptive output regulation for multivariable nonlinear systems by presenting a learning-based adaptive internal model-based design strategy. The approach builds on the recently proposed adaptive internal model design techniques based on the theory of nonlinear Luenberger observers, and the adaptation side is approached as a probabilistic regression problem. In particular, Gaussian process priors are employed to cope with the learning problem. Unlike the previous approaches in the field, here only coarse assumptions about the friend structure are required, making the proposed approach suitable for applications where the exosystem is highly uncertain. The paper presents performance bounds on the attained regulation error and numerical simulations showing how the proposed method outperforms previous approaches.


title: INTERNEURON: A Middleware with Multi-Network Communication Reliability for Infrastructure Vehicle Cooperative Autonomous Driving

abstract: Infrastructure-Vehicle Cooperative Autonomous Driving (IVCAD) is a new paradigm of autonomous driving, which relies on the cooperation between intelligent roads and autonomous vehicles. This paradigm has been shown to be safer and more efficient compared to the on-vehicle-only autonomous driving paradigm. Our real-world deployment data indicates that the effectiveness of IVCAD is constrained by reliability and performance of commercial communication networks. This paper targets this exact problem, and proposes INTERNEURON, a middleware to achieve high communication reliability between intelligent roads and autonomous vehicles, in the context of IVCAD. Specifically, INTERNEURON dynamically matches IVCAD applications and the underlying communication technologies based on varying communication performance and quality needs. Evaluation results confirm that INTERNEURON reduces deadline violations by more than 95\%, significantly improving the reliability of IVCAD systems.


title: Multilevel fista for image restoration

abstract: This paper presents a multilevel FISTA algorithm, based on the use of the Moreau envelope to build the correction brought by the coarse models, which is easy to compute when the explicit form of the proximal operator of the considered functions is known. This approach is supported by strong theoretical guarantees: we prove both the rate of convergence and the convergence of the iterates to a minimum in the convex case, an important result for ill-posed problems. We evaluate our approach on image restoration problems and we show that it outperforms classical FISTA for large-scale images.