title: Towards Understanding and Boosting Adversarial Transferability from a Distribution Perspective

abstract: Transferable adversarial attacks against Deep neural networks (DNNs) have received broad attention in recent years. An adversarial example can be crafted by a surrogate model and then attack the unknown target model successfully, which brings a severe threat to DNNs. The exact underlying reasons for the transferability are still not completely understood. Previous work mostly explores the causes from the model perspective, e.g., decision boundary, model architecture, and model capacity. adversarial attacks against Deep neural networks (DNNs) have received broad attention in recent years. An adversarial example can be crafted by a surrogate model and then attack the unknown target model successfully, which brings a severe threat to DNNs. The exact underlying reasons for the transferability are still not completely understood. Previous work mostly explores the causes from the model perspective. Here, we investigate the transferability from the data distribution perspective and hypothesize that pushing the image away from its original distribution can enhance the adversarial transferability. To be specific, moving the image out of its original distribution makes different models hardly classify the image correctly, which benefits the untargeted attack, and dragging the image into the target distribution misleads the models to classify the image as the target class, which benefits the targeted attack. Towards this end, we propose a novel method that crafts adversarial examples by manipulating the distribution of the image. We conduct comprehensive transferable attacks against multiple DNNs to demonstrate the effectiveness of the proposed method. Our method can significantly improve the transferability of the crafted attacks and achieves state-of-the-art performance in both untargeted and targeted scenarios, surpassing the previous best method by up to 40$\%$ in some cases.


title: VM-NeRF: Tackling Sparsity in NeRF with View Morphing

abstract: NeRF aims to learn a continuous neural scene representation by using a finite set of input images taken from various viewpoints. A well-known limitation of NeRF methods is their reliance on data: the fewer the viewpoints, the higher the likelihood of overfitting. This paper addresses this issue by introducing a novel method to generate geometrically consistent image transitions between viewpoints using View Morphing. Our VM-NeRF approach requires no prior knowledge about the scene structure, as View Morphing is based on the fundamental principles of projective geometry. VM-NeRF tightly integrates this geometric view generation process during the training procedure of standard NeRF approaches. Notably, our method significantly improves novel view synthesis, particularly when only a few views are available. Experimental evaluation reveals consistent improvement over current methods that handle sparse viewpoints in NeRF models. We report an increase in PSNR of up to 1.8dB and 1.0dB when training uses eight and four views, respectively. Source code: \url{https://github.com/mbortolon97/VM-NeRF}


title: The Discovery of Transitive Phenomenon in the Radio Emission of the mode-switcher PSR B0943+10

abstract: B0943+10 is known to switch between two distinct, hours-long modes of radio emission, Bright (B) and Quiet (Q). Up to now the switches in both directions were believed to occur instantly (on the scale of a spin period). We have found a transitive process around the Q-to-B-mode switch, which consists of two additional short-lived modes, each with distinct average profiles and subpulse drift rates. Based on observations at low radio frequencies, we examine the properties of these transitive modes and discuss their implications in the framework of the traditional carousel model of drifting subpulses.


title: AMPose: Alternately Mixed Global-Local Attention Model for 3D Human Pose Estimation

abstract: The graph convolutional networks (GCNs) have been applied to model the physically connected and non-local relations among human joints for 3D human pose estimation (HPE). In addition, the purely Transformer-based models recently show promising results in video-based 3D HPE. However, the single-frame method still needs to model the physically connected relations among joints because the feature representations transformed only by global relations via the Transformer neglect information on the human skeleton. To deal with this problem, we propose a novel method in which the Transformer encoder and GCN blocks are alternately stacked, namely AMPose, to combine the global and physically connected relations among joints towards HPE. In the AMPose, the Transformer encoder is applied to connect each joint with all the other joints, while GCNs are applied to capture information on physically connected relations. The effectiveness of our proposed method is evaluated on the Human3.6M dataset. Our model also shows better generalization ability by testing on the MPI-INF-3DHP dataset. Code can be retrieved at https://github.com/erikervalid/AMPose.


title: Estimating Neural Reflectance Field from Radiance Field using Tree Structures

abstract: We present a new method for estimating the Neural Reflectance Field (NReF) of an object from a set of posed multi-view images under unknown lighting. NReF represents 3D geometry and appearance of objects in a disentangled manner, and are hard to be estimated from images only. Our method solves this problem by exploiting the Neural Radiance Field (NeRF) as a proxy representation, from which we perform further decomposition. A high-quality NeRF decomposition relies on good geometry information extraction as well as good prior terms to properly resolve ambiguities between different components. To extract high-quality geometry information from radiance fields, we re-design a new ray-casting based method for surface point extraction. To efficiently compute and apply prior terms, we convert different prior terms into different type of filter operations on the surface extracted from radiance field. We then employ two type of auxiliary data structures, namely Gaussian KD-tree and octree, to support fast querying of surface points and efficient computation of surface filters during training. Based on this, we design a multi-stage decomposition optimization pipeline for estimating neural reflectance field from neural radiance fields. Extensive experiments show our method outperforms other state-of-the-art methods on different data, and enable high-quality free-view relighting as well as material editing tasks.


title: Transformer-based Flood Scene Segmentation for Developing Countries

abstract: Floods are large-scale natural disasters that often induce a massive number of deaths, extensive material damage, and economic turmoil. The effects are more extensive and longer-lasting in high-population and low-resource developing countries. Early Warning Systems (EWS) constantly assess water levels and other factors to forecast floods, to help minimize damage. Post-disaster, disaster response teams undertake a Post Disaster Needs Assessment (PDSA) to assess structural damage and determine optimal strategies to respond to highly affected neighbourhoods. However, even today in developing countries, EWS and PDSA analysis of large volumes of image and video data is largely a manual process undertaken by first responders and volunteers. We propose FloodTransformer, which to the best of our knowledge, is the first visual transformer-based model to detect and segment flooded areas from aerial images at disaster sites. We also propose a custom metric, Flood Capacity (FC) to measure the spatial extent of water coverage and quantify the segmented flooded area for EWS and PDSA analyses. We use the SWOC Flood segmentation dataset and achieve 0.93 mIoU, outperforming all other methods. We further show the robustness of this approach by validating across unseen flood images from other flood data sources.


title: Rational cross-sections, bounded generation and orders on groups

abstract: We provide new examples of groups without rational cross-sections (also called regular normal forms), using connections with bounded generation and rational orders on groups. Specifically, our examples are extensions of infinite torsion groups, groups of Grigorchuk type, wreath products similar to $C_2\wr(C_2\wr \mathbb Z)$ and $\mathbb Z\wr F_2$, a group of permutations of $\mathbb Z$, and a finitely presented HNN extension of the first Grigorchuk group. This last group is the first example of finitely presented group with solvable word problem and without rational cross-sections. It is also not autostackable, and has no left-regular complete rewriting system.


title: Label-Driven Denoising Framework for Multi-Label Few-Shot Aspect Category Detection

abstract: Multi-Label Few-Shot Aspect Category Detection (FS-ACD) is a new sub-task of aspect-based sentiment analysis, which aims to detect aspect categories accurately with limited training instances. Recently, dominant works use the prototypical network to accomplish this task, and employ the attention mechanism to extract keywords of aspect category from the sentences to produce the prototype for each aspect. However, they still suffer from serious noise problems: (1) due to lack of sufficient supervised data, the previous methods easily catch noisy words irrelevant to the current aspect category, which largely affects the quality of the generated prototype; (2) the semantically-close aspect categories usually generate similar prototypes, which are mutually noisy and confuse the classifier seriously. In this paper, we resort to the label information of each aspect to tackle the above problems, along with proposing a novel Label-Driven Denoising Framework (LDF). Extensive experimental results show that our framework achieves better performance than other state-of-the-art methods.


title: The Elliptical Quartic Exponential Distribution: An Annular Distribution Obtained via Maximum Entropy

abstract: This paper describes the Elliptical Quartic Exponential distribution in $\mathbb{R}^D$, obtained via a maximum entropy construction by imposing second and fourth moment constraints. I discuss relationships to related work, analytical expressions for the normalization constant and the entropy, and the conditional and marginal distributions.


title: Correlative Information Maximization Based Biologically Plausible Neural Networks for Correlated Source Separation

abstract: The brain effortlessly extracts latent causes of stimuli, but how it does this at the network level remains unknown. Most prior attempts at this problem proposed neural networks that implement independent component analysis which works under the limitation that latent causes are mutually independent. Here, we relax this limitation and propose a biologically plausible neural network that extracts correlated latent sources by exploiting information about their domains. To derive this network, we choose maximum correlative information transfer from inputs to outputs as the separation objective under the constraint that the outputs are restricted to their presumed sets. The online formulation of this optimization problem naturally leads to neural networks with local learning rules. Our framework incorporates infinitely many source domain choices and flexibly models complex latent structures. Choices of simplex or polytopic source domains result in networks with piecewise-linear activation functions. We provide numerical examples to demonstrate the superior correlated source separation capability for both synthetic and natural sources.


title: Market Directional Information Derived From (Time, Execution Price, Shares Traded) Sequence of Transactions. On The Impact From The Future

abstract: An attempt to obtain market directional information from non-stationary solution of the dynamic equation: "future price tends to the value maximizing the number of shares traded per unit time" is presented. A remarkable feature of the approach is an automatic time scale selection. It is determined from the state of maximal execution flow calculated on past transactions. Both lagging and advancing prices are calculated.


title: Determination of $|V_{ub}|$ from untagged $B^0\to\pi^- \ell^+ \nu_{\ell}$ decays using 2019-2021 Belle II data

abstract: We present an analysis of the charmless semileptonic decay $B^0\to\pi^- \ell^+ \nu_{\ell}$, where $\ell = e, \mu$, from 198.0 million pairs of $B\bar{B}$ mesons recorded by the Belle II detector at the SuperKEKB electron-positron collider. The decay is reconstructed without identifying the partner $B$ meson. The partial branching fractions are measured independently for $B^0\to\pi^- e^+ \nu_{e}$ and $B^0\to\pi^- \mu^+ \nu_{\mu}$ as functions of $q^{2}$ (momentum transfer squared), using 3896 $B^0\to\pi^- e^+ \nu_{e}$ and 5466 $B^0\to\pi^- \mu^+ \nu_{\mu}$ decays. The total branching fraction is found to be $(1.426 \pm 0.056 \pm 0.125) \times 10^{-4}$ for $B^0\to\pi^- \ell^+ \nu_{\ell}$ decays, where the uncertainties are statistical and systematic, respectively. By fitting the measured partial branching fractions as functions of $q^{2}$, together with constraints on the nonperturbative hadronic contribution from lattice QCD calculations, the magnitude of the Cabibbo-Kobayashi-Maskawa matrix element $V_{ub}$, $(3.55 \pm 0.12 \pm 0.13 \pm 0.17) \times 10^{-3}$, is extracted. Here, the first uncertainty is statistical, the second is systematic and the third is theoretical.


title: Hyperactive Learning (HAL) for Data-Driven Interatomic Potentials

abstract: Data-driven interatomic potentials have emerged as a powerful class of surrogate models for {\it ab initio} potential energy surfaces that are able to reliably predict macroscopic properties with experimental accuracy. In generating accurate and transferable potentials the most time-consuming and arguably most important task is generating the training set, which still requires significant expert user input. To accelerate this process, this work presents \text{\it hyperactive learning} (HAL), a framework for formulating an accelerated sampling algorithm specifically for the task of training database generation. The key idea is to start from a physically motivated sampler (e.g., molecular dynamics) and add a biasing term that drives the system towards high uncertainty and thus to unseen training configurations. Building on this framework, general protocols for building training databases for alloys and polymers leveraging the HAL framework will be presented. For alloys, ACE potentials for AlSi10 are created by fitting to a minimal HAL-generated database containing 88 configurations (32 atoms each) with fast evaluation times of <100 microsecond/atom/cpu-core. These potentials are demonstrated to predict the melting temperature with excellent accuracy. For polymers, a HAL database is built using ACE, able to determine the density of a long polyethylene glycol (PEG) polymer formed of 200 monomer units with experimental accuracy by only fitting to small isolated PEG polymers with sizes ranging from 2 to 32.


title: Laplace hyperfunctions via \v{C}ech-Dolbeault cohomology

abstract: The paper studies several properties of Laplace hyperfunctions introduced by H.~Komatsu in the one dimensional case and by the authors in the higher dimensional cases from the viewpoint of \v{C}ech-Dolbeault cohomology theory, which enables us, for example, to construct the Laplace transformation and its inverse in a simple way. We also give some applications to a system of PDEs with constant coefficients.


title: Dual-distribution discrepancy with self-supervised refinement for anomaly detection in medical images

abstract: Medical anomaly detection is a crucial yet challenging task aimed at recognizing abnormal images to assist in diagnosis. Due to the high-cost annotations of abnormal images, most methods utilize only known normal images during training and identify samples deviating from the normal profile as anomalies in the testing phase. Many readily available unlabeled images containing anomalies are thus ignored in the training phase, restricting the performance. To solve this problem, we introduce one-class semi-supervised learning (OC-SSL) to utilize known normal and unlabeled images for training, and propose Dual-distribution Discrepancy for Anomaly Detection (DDAD) based on this setting. Ensembles of reconstruction networks are designed to model the distribution of normal images and the distribution of both normal and unlabeled images, deriving the normative distribution module (NDM) and unknown distribution module (UDM). Subsequently, the intra-discrepancy of NDM and inter-discrepancy between the two modules are designed as anomaly scores. Furthermore, we propose a new perspective on self-supervised learning, which is designed to refine the anomaly scores rather than detect anomalies directly. Five medical datasets, including chest X-rays, brain MRIs and retinal fundus images, are organized as benchmarks for evaluation. Experiments on these benchmarks comprehensively compare a wide range of anomaly detection methods and demonstrate that our method achieves significant gains and outperforms the state-of-the-art. Code and organized benchmarks are available at https://github.com/caiyu6666/DDAD-ASR.


title: Deep learning method in testing the cosmic distance duality relation

abstract: The cosmic distance duality relation (DDR) is constrained from the combination of type-Ia supernovae (SNe Ia) and strong gravitational lensing (SGL) systems using deep learning method. To make use of the full SGL data, we reconstruct the luminosity distance from SNe Ia up to the highest redshift of SGL using deep learning, then it is compared with the angular diameter distance obtained from SGL. Considering the influence of lens mass profile, we constrain the possible violation of DDR in three lens mass models. Results show that in the SIS model and EPL model, DDR is violated at high confidence level, with the violation parameter $\eta_0=-0.193^{+0.021}_{-0.019}$ and $\eta_0=-0.247^{+0.014}_{-0.013}$, respectively. In the PL model, however, DDR is verified within 1$\sigma$ confidence level, with the violation parameter $\eta_0=-0.014^{+0.053}_{-0.045}$. Our results demonstrate that the constraints on DDR strongly depend on the lens mass models. Given a specific lens mass model, DDR can be constrained at a precision of $\textit{O}(10^{-2})$ using deep learning.


title: Learning on the Edge: Online Learning with Stochastic Feedback Graphs

abstract: The framework of feedback graphs is a generalization of sequential decision-making with bandit or full information feedback. In this work, we study an extension where the directed feedback graph is stochastic, following a distribution similar to the classical Erd\H{o}s-R\'enyi model. Specifically, in each round every edge in the graph is either realized or not with a distinct probability for each edge. We prove nearly optimal regret bounds of order $\min\bigl\{\min_{\varepsilon} \sqrt{(\alpha_\varepsilon/\varepsilon) T},\, \min_{\varepsilon} (\delta_\varepsilon/\varepsilon)^{1/3} T^{2/3}\bigr\}$ (ignoring logarithmic factors), where $\alpha_{\varepsilon}$ and $\delta_{\varepsilon}$ are graph-theoretic quantities measured on the support of the stochastic feedback graph $\mathcal{G}$ with edge probabilities thresholded at $\varepsilon$. Our result, which holds without any preliminary knowledge about $\mathcal{G}$, requires the learner to observe only the realized out-neighborhood of the chosen action. When the learner is allowed to observe the realization of the entire graph (but only the losses in the out-neighborhood of the chosen action), we derive a more efficient algorithm featuring a dependence on weighted versions of the independence and weak domination numbers that exhibits improved bounds for some special cases.


title: Random Access Protocol with Channel Oracle Enabled by a Reconfigurable Intelligent Surface

abstract: The widespread adoption of Reconfigurable Intelligent Surfaces (RISs) in future practical wireless systems is critically dependent on the integration of the RIS into higher-layer protocols beyond the physical (PHY) one, an issue that has received minimal attention in the research literature. In light of this, we consider a classical random access (RA) problem, where uncoordinated users' equipment (UEs) transmit sporadically to an access point (AP). Differently from previous works, we ponder how a RIS can be integrated into the design of new medium access control (MAC) layer protocols to solve such a problem. We consider that the AP is able to control a RIS to change how its reflective elements are configured, namely, the RIS configurations. Thus, the RIS can be opportunistically controlled to favor the transmission of some of the UEs without the need to explicitly perform channel estimation (CHEST). We embrace this observation and propose a RIS-assisted RA protocol comprised of two modules: Channel Oracle and Access. During channel oracle, the UEs learn how the RIS configurations affect their channel conditions. During the access, the UEs tailor their access policies using the channel oracle knowledge. Our proposed RIS-assisted protocol is able to increase the expected throughput by approximately 60% in comparison to the slotted ALOHA (S-ALOHA) protocol.


title: Multi-Robot Trajectory Planning with Feasibility Guarantee and Deadlock Resolution: An Obstacle-Dense Environment

abstract: This article presents a multi-robot trajectory planning method which not only guarantees optimization feasibility and but also resolves deadlocks in obstacle-dense environments. The method is proposed via formulating a recursive optimization problem, where a novel safe corridor is generated online to ensure obstacle avoidance in trajectory planning. A dynamic-priority mechanism is combined with the right-hand rule to handle potential deadlocks that are much harder to resolve due to static obstacles. Comparisons with other state-of-the-art results are conducted to validate the improved safety and success rate. Additional hardware experiments are carried out with up to eight nano-quadrotors in various cluttered scenarios.


title: Revealing Patient-Reported Experiences in Healthcare from Social Media using the DAPMAV Framework

abstract: Understanding patient experience in healthcare is increasingly important and desired by medical professionals in a patient-centered care approach. Healthcare discourse on social media presents an opportunity to gain a unique perspective on patient-reported experiences, complementing traditional survey data. These social media reports often appear as first-hand accounts of patients' journeys through the healthcare system, whose details extend beyond the confines of structured surveys and at a far larger scale than focus groups. However, in contrast with the vast presence of patient-experience data on social media and the potential benefits the data offers, it attracts comparatively little research attention due to the technical proficiency required for text analysis. In this paper, we introduce the Design-Acquire-Process-Model-Analyse-Visualise (DAPMAV) framework to provide an overview of techniques and an approach to capture patient-reported experiences from social media data. We apply this framework in a case study on prostate cancer data from /r/ProstateCancer, demonstrate the framework's value in capturing specific aspects of patient concern (such as sexual dysfunction), provide an overview of the discourse, and show narrative and emotional progression through these stories. We anticipate this framework to apply to a wide variety of areas in healthcare, including capturing and differentiating experiences across minority groups, geographic boundaries, and types of illnesses.


title: Robustifying the Multi-Scale Representation of Neural Radiance Fields

abstract: Neural Radiance Fields (NeRF) recently emerged as a new paradigm for object representation from multi-view (MV) images. Yet, it cannot handle multi-scale (MS) images and camera pose estimation errors, which generally is the case with multi-view images captured from a day-to-day commodity camera. Although recently proposed Mip-NeRF could handle multi-scale imaging problems with NeRF, it cannot handle camera pose estimation error. On the other hand, the newly proposed BARF can solve the camera pose problem with NeRF but fails if the images are multi-scale in nature. This paper presents a robust multi-scale neural radiance fields representation approach to simultaneously overcome both real-world imaging issues. Our method handles multi-scale imaging effects and camera-pose estimation problems with NeRF-inspired approaches by leveraging the fundamentals of scene rigidity. To reduce unpleasant aliasing artifacts due to multi-scale images in the ray space, we leverage Mip-NeRF multi-scale representation. For joint estimation of robust camera pose, we propose graph-neural network-based multiple motion averaging in the neural volume rendering framework. We demonstrate, with examples, that for an accurate neural representation of an object from day-to-day acquired multi-view images, it is crucial to have precise camera-pose estimates. Without considering robustness measures in the camera pose estimation, modeling for multi-scale aliasing artifacts via conical frustum can be counterproductive. We present extensive experiments on the benchmark datasets to demonstrate that our approach provides better results than the recent NeRF-inspired approaches for such realistic settings.


title: Understanding and Improving Zero-shot Multi-hop Reasoning in Generative Question Answering

abstract: Generative question answering (QA) models generate answers to questions either solely based on the parameters of the model (the closed-book setting) or additionally retrieving relevant evidence (the open-book setting). Generative QA models can answer some relatively complex questions, but the mechanism through which they do so is still poorly understood. We perform several studies aimed at better understanding the multi-hop reasoning capabilities of generative QA models. First, we decompose multi-hop questions into multiple corresponding single-hop questions, and find marked inconsistency in QA models' answers on these pairs of ostensibly identical question chains. Second, we find that models lack zero-shot multi-hop reasoning ability: when trained only on single-hop questions, models generalize poorly to multi-hop questions. Finally, we demonstrate that it is possible to improve models' zero-shot multi-hop reasoning capacity through two methods that approximate real multi-hop natural language (NL) questions by training on either concatenation of single-hop questions or logical forms (SPARQL). In sum, these results demonstrate that multi-hop reasoning does not emerge naturally in generative QA models, but can be encouraged by advances in training or modeling techniques.


title: Probing the microscopic structure and flexibility of oxidized DNA by molecular simulations

abstract: The oxidative damage of DNA is a compelling issue in molecular biophysics as it plays a vital role in the epigenetic control of gene expression and is believed to be associated with mutagenesis, carcinogenesis, and ageing. To understand the microscopic structural changes in physical properties of DNA and the resulting influence on its function due to oxidative damage of its nucleotide bases, we have conducted all-atom molecular dynamic simulations of double-stranded DNA (dsDNA) with its guanine bases being oxidized. The guanine bases are more prone to oxidative damage due to the lowest value of redox potential among all nucleobases. We have analyzed the local as well as global mechanical properties of native and oxidized dsDNA and explained those results by microscopic structural parameters and thermodynamic calculations. Our results show that the oxidative damage of dsDNA does not deform the Watson-Crick geometry; instead, the oxidized DNA structures are found to be better stabilized through electrostatic interactions. Moreover, oxidative damage changes the mechanical, helical, and groove parameters of dsDNA. The persistence length, stretch modulus, and torsional stiffness are found to be 48.87 nm, 1239.26 pN, and 477.30 pN.nm^2, respectively, for native dsDNA, and these values are 61.31 nm, 659.91 pN, and 407.79 pN.nm^2, respectively, when all the guanine bases of the dsDNA are oxidized. Compared to the global mechanical properties, the changes in helical and groove properties are found to be more prominent, concentrated locally at the oxidation sites, and causing the transition of the backbone conformations from BI to BII at the regions of oxidative damage.


title: Fusing Event-based Camera and Radar for SLAM Using Spiking Neural Networks with Continual STDP Learning

abstract: This work proposes a first-of-its-kind SLAM architecture fusing an event-based camera and a Frequency Modulated Continuous Wave (FMCW) radar for drone navigation. Each sensor is processed by a bio-inspired Spiking Neural Network (SNN) with continual Spike-Timing-Dependent Plasticity (STDP) learning, as observed in the brain. In contrast to most learning-based SLAM systems%, which a) require the acquisition of a representative dataset of the environment in which navigation must be performed and b) require an off-line training phase, our method does not require any offline training phase, but rather the SNN continuously learns features from the input data on the fly via STDP. At the same time, the SNN outputs are used as feature descriptors for loop closure detection and map correction. We conduct numerous experiments to benchmark our system against state-of-the-art RGB methods and we demonstrate the robustness of our DVS-Radar SLAM approach under strong lighting variations.


title: DMRG study of the higher-charge Schwinger model and its 't Hooft anomaly

abstract: The charge-$q$ Schwinger model is the $(1+1)$-dimensional quantum electrodynamics (QED) with a charge-$q$ Dirac fermion. It has the $\mathbb{Z}_q$ $1$-form symmetry and also enjoys the $\mathbb{Z}_q$ chiral symmetry in the chiral limit, and there is a mixed 't Hooft anomaly between those symmetries. We numerically study the charge-$q$ Schwinger model in the lattice Hamiltonian formulation using the density-matrix renormalization group (DMRG). When applying DMRG, we map the Schwinger model to a spin chain with nonlocal interaction via Jordan-Wigner transformation, and we take the open boundary condition instead of the periodic one to make the Hilbert space finite-dimensional. When computing the energy density or chiral condensate, we find that using local operators significantly reduces the boundary effect compared with the computation of corresponding extensive quantities divided by the volume. To discuss the consequence of the 't Hooft anomaly, we carefully treat the renormalization of the chiral condensates, and then we confirm that Wilson loops generate the discrete chiral transformations in the continuum limit.


title: On some features of the solar proton event on 2021 October 28 (GLE73)

abstract: In addition to several recent articles devoted to the rare event of ground-level enhancement of the solar relativistic proton flux observed on 2021 October 28 (GLE73), we study the 10-100 MeV solar energetic particle (SEP) component of this event. Based on the GOES satellite data for 26 GLEs recorded since 1986, we have formed a scatter plot displaying the ratio of the peak fluxes of the >10 MeV (J10) and >100 MeV (J100) protons and their energy spectra. Two extreme characteristics of the prompt component of the SEP-GLE73 event were revealed: (1) very small J10 and J100 proton fluxes and (2) a very hard energetic spectrum in the 10-100 MeV range. There are only two events with these characteristics similar to SEP-GLE73 namely, GLE40 (1989 July 25) and GLE46 (1989 November 15). A correspondence was demonstrated between the hard frequency spectrum of microwave radio bursts of initiating flares and the hard SEP energy spectrum of these two and other GLEs. These results suggest that the flare magnetic reconnection both in the impulsive and post-eruption phases plays an important role in the acceleration of the SEP-GLE protons.


title: Wong-Zakai type approximations of rough random dynamical systems by smooth noise

abstract: This paper is devoted to the smooth and stationary Wong-Zakai approximations for a class of rough differential equations driven by a geometric fractional Brownian rough path $\boldsymbol{\omega}$ with Hurst index $H\in(\frac{1}{3},\frac{1}{2}]$. We first construct the approximation $\boldsymbol{\omega}_{\delta}$ of $\boldsymbol{\omega}$ by probabilistic arguments, and then using the rough path theory to obtain the Wong-Zakai approximation for the solution on any finite interval. Finally, both the original system and approximative system generate a continuous random dynamical systems $\varphi$ and $\varphi^{\delta}$. As a consequence of the Wong-Zakai approximation of the solution, $\varphi^{\delta}$ converges to $\varphi$ as $\delta\rightarrow 0$.


title: Less is More: Facial Landmarks can Recognize a Spontaneous Smile

abstract: Smile veracity classification is a task of interpreting social interactions. Broadly, it distinguishes between spontaneous and posed smiles. Previous approaches used hand-engineered features from facial landmarks or considered raw smile videos in an end-to-end manner to perform smile classification tasks. Feature-based methods require intervention from human experts on feature engineering and heavy pre-processing steps. On the contrary, raw smile video inputs fed into end-to-end models bring more automation to the process with the cost of considering many redundant facial features (beyond landmark locations) that are mainly irrelevant to smile veracity classification. It remains unclear to establish discriminative features from landmarks in an end-to-end manner. We present a MeshSmileNet framework, a transformer architecture, to address the above limitations. To eliminate redundant facial features, our landmarks input is extracted from Attention Mesh, a pre-trained landmark detector. Again, to discover discriminative features, we consider the relativity and trajectory of the landmarks. For the relativity, we aggregate facial landmark that conceptually formats a curve at each frame to establish local spatial features. For the trajectory, we estimate the movements of landmark composed features across time by self-attention mechanism, which captures pairwise dependency on the trajectory of the same landmark. This idea allows us to achieve state-of-the-art performances on UVA-NEMO, BBC, MMI Facial Expression, and SPOS datasets.


title: The Galactic Underworld: The spatial distribution of compact remnants

abstract: We chart the expected Galactic distribution of neutron stars and black holes. These compact remnants of dead stars -- the Galactic underworld -- are found to exhibit a fundamentally different distribution and structure to the visible Galaxy. Compared to the visible Galaxy, concentration into a thin flattened disk structure is much less evident with the scale height more than tripling to 1260 +- 30 pc. This difference arises from two primary causes. Firstly, the distribution is in part inherited from the integration over the evolving structure of the Galaxy itself (and hence the changing distribution of the parent stars). Secondly, an even larger effect arises from the natal kick received by the remnant at the event of its supernova birth. Due to this kick we find 30% of remnants have sufficient kinetic energy to entirely escape the Galactic potential (40% of neutron stars and 2% of black holes) leading to a Galactic mass loss integrated to the present day of ~ 0.4% of the stellar mass of the Galaxy. The black hole -- neutron star fraction increases near the Galactic centre: a consequence of smaller kick velocities in the former (the assumption made is that kick velocity is inversely proportional to mass). Our simulated remnant distribution yields probable distances of 19 pc and 21 pc to the nearest neutron star and black hole respectively, while our nearest probable magnetar lies at 4.2 kpc. Although the underworld only contains of order ~ 1% of the Galaxy's mass, observational signatures and physical traces of its population, such as microlensing, will become increasingly present in data ranging from gravitational wave detectors to high precision surveys from space missions such as Gaia.


title: Improving Multi-turn Emotional Support Dialogue Generation with Lookahead Strategy Planning

abstract: Providing Emotional Support (ES) to soothe people in emotional distress is an essential capability in social interactions. Most existing researches on building ES conversation systems only considered single-turn interactions with users, which was over-simplified. In comparison, multi-turn ES conversation systems can provide ES more effectively, but face several new technical challenges, including: (1) how to adopt appropriate support strategies to achieve the long-term dialogue goal of comforting the user's emotion; (2) how to dynamically model the user's state. In this paper, we propose a novel system MultiESC to address these issues. For strategy planning, drawing inspiration from the A* search algorithm, we propose lookahead heuristics to estimate the future user feedback after using particular strategies, which helps to select strategies that can lead to the best long-term effects. For user state modeling, MultiESC focuses on capturing users' subtle emotional expressions and understanding their emotion causes. Extensive experiments show that MultiESC significantly outperforms competitive baselines in both dialogue generation and strategy planning. Our codes are available at https://github.com/lwgkzl/MultiESC.


title: Fine-Tuning Pre-trained Transformers into Decaying Fast Weights

abstract: Autoregressive Transformers are strong language models but incur O(T) complexity during per-token generation due to the self-attention mechanism. Recent work proposes kernel-based methods to approximate causal self-attention by replacing it with recurrent formulations with various update rules and feature maps to achieve O(1) time and memory complexity. We explore these approaches and find that they are unnecessarily complex, and propose a simple alternative - decaying fast weights - that runs fast on GPU, outperforms prior methods, and retains 99% of attention's performance for GPT-2. We also show competitive performance on WikiText-103 against more complex attention substitutes.


title: Text detection and recognition based on a lensless imaging system

abstract: Lensless cameras are characterized by several advantages (e.g., miniaturization, ease of manufacture, and low cost) as compared with conventional cameras. However, they have not been extensively employed due to their poor image clarity and low image resolution, especially for tasks that have high requirements on image quality and details such as text detection and text recognition. To address the problem, a framework of deep-learning-based pipeline structure was built to recognize text with three steps from raw data captured by employing lensless cameras. This pipeline structure consisted of the lensless imaging model U-Net, the text detection model connectionist text proposal network (CTPN), and the text recognition model convolutional recurrent neural network (CRNN). Compared with the method focusing only on image reconstruction, UNet in the pipeline was able to supplement the imaging details by enhancing factors related to character categories in the reconstruction process, so the textual information can be more effectively detected and recognized by CTPN and CRNN with fewer artifacts and high-clarity reconstructed lensless images. By performing experiments on datasets of different complexities, the applicability to text detection and recognition on lensless cameras was verified. This study reasonably demonstrates text detection and recognition tasks in the lensless camera system,and develops a basic method for novel applications.


title: The distribution of globular clusters in kinematic spaces does not trace the accretion history of the host galaxy

abstract: Reconstructing how all the stellar components of the Galaxy formed and assembled over time, by studying the properties of the stars which make it, is the aim of Galactic archeology. In these last years, thanks to the launch of the ESA Gaia astrometric mission, and the development of many spectroscopic surveys, we are for the first time in the position to delve into the layers of the past of our galaxy. Globular clusters (GCs) play a fundamental role in this research field since they are among the oldest stellar systems in the Milky Way (MW) and so bear witness of its entire past. In the recent years, there have been several attempts to constrain the nature of clusters (accreted or formed in the MW itself) through the analysis of kinematic spaces and to reconstruct from this the properties of the accretions events experienced by the MW through time. This work aims to test a widely-used assumption about the clustering of the accreted populations of GCs in the integrals of motions space. We analyze a set of dissipation-less N-body simulations that reproduce the accretion of one or two satellites with their GC population on a MW-type galaxy. Our results demonstrate that a significant overlap between accreted and "kinematically-heated" in-situ GCs is expected in kinematic spaces, for mergers with mass ratios of 1:10. In contrast with standard assumptions made in the literature so far, we find that accreted GCs do not show dynamical coherence, that is they do not cluster in kinematic spaces. In addition, GCs can also be found in regions dominated by stars which have a different origin (i.e. different progenitor). This casts doubt on the association between GCs and field stars that is generally made in the literature to assign them to a common origin. Our findings severely question the recovered accretion history of the MW based on the phase-space clustering of the GC population.


title: Better Pre-Training by Reducing Representation Confusion

abstract: In this work, we revisit the Transformer-based pre-trained language models and identify two different types of information confusion in position encoding and model representations, respectively. Firstly, we show that in the relative position encoding, the joint modeling about relative distances and directions brings confusion between two heterogeneous information. It may make the model unable to capture the associative semantics of the same distance and the opposite directions, which in turn affects the performance of downstream tasks. Secondly, we notice the BERT with Mask Language Modeling (MLM) pre-training objective outputs similar token representations (last hidden states of different tokens) and head representations (attention weights of different heads), which may make the diversity of information expressed by different tokens and heads limited. Motivated by the above investigation, we propose two novel techniques to improve pre-trained language models: Decoupled Directional Relative Position (DDRP) encoding and MTH pre-training objective. DDRP decouples the relative distance features and the directional features in classical relative position encoding. MTH applies two novel auxiliary regularizers besides MLM to enlarge the dissimilarities between (a) last hidden states of different tokens, and (b) attention weights of different heads. These designs allow the model to capture different categories of information more clearly, as a way to alleviate information confusion in representation learning for better optimization. Extensive experiments and ablation studies on GLUE benchmark demonstrate the effectiveness of our proposed methods.


title: Role of planar buckling on the electronic, thermal, and optical properties of Germagraphene nanosheets

abstract: We report the electronic, the thermal, and the optical properties of a Germagraphene (GeC) monolayer taking into account buckling effects. The relatively wide direct band gap of a flat GeC nanosheet can be changed by tuning the planar buckling. A GeC monolayer has an sp$^2$ hybridization in which the contribution of an $s$-orbital is half of the contribution of a $p$-orbital leading to stronger $\sigma\text{-}\sigma$ bonds compared to the $\sigma\text{-}\pi$ bonds. Increasing the planar buckling, the contribution of an $s$-orbital is decreased while the contribution of a $p$-orbital is increased resulting in a sp$^3$-hybridization in which the $\sigma\text{-}\pi$ bond becomes stronger than the $\sigma\text{-}\sigma$ bond. As a result, the band gap of a buckled GeC is reduced and thus the thermal and the optical properties are significantly modified. We find that the heat capacity of the buckled GeC is decreased at low values of planar buckling, which is caused by the anticrossing of the optical and the acoustic phonon modes affecting phonon scattering processes. The resulting optical properties, such as the dielectric function, the refractive index, the electron energy loss spectra, the absorption, and the optical conductivity show that a buckled GeC nanosheet has increased optical activities in the visible light region compared to a flat GeC. The optical conductivity is red shifted from the near ultraviolet to the visible light region, when the planar buckling is increased. We can thus confirm that the buckling can be seen as another parameter to improve GeC monolayers for optoelectronic devices.


title: Residual Neural Networks for the Prediction of Planetary Collision Outcomes

abstract: Fast and accurate treatment of collisions in the context of modern N-body planet formation simulations remains a challenging task due to inherently complex collision processes. We aim to tackle this problem with machine learning (ML), in particular via residual neural networks. Our model is motivated by the underlying physical processes of the data-generating process and allows for flexible prediction of post-collision states. We demonstrate that our model outperforms commonly used collision handling methods such as perfect inelastic merging and feed-forward neural networks in both prediction accuracy and out-of-distribution generalization. Our model outperforms the current state of the art in 20/24 experiments. We provide a dataset that consists of 10164 Smooth Particle Hydrodynamics (SPH) simulations of pairwise planetary collisions. The dataset is specifically suited for ML research to improve computational aspects for collision treatment and for studying planetary collisions in general. We formulate the ML task as a multi-task regression problem, allowing simple, yet efficient training of ML models for collision treatment in an end-to-end manner. Our models can be easily integrated into existing N-body frameworks and can be used within our chosen parameter space of initial conditions, i.e. where similar-sized collisions during late-stage terrestrial planet formation typically occur.


title: Coresets for Relational Data and The Applications

abstract: A coreset is a small set that can approximately preserve the structure of the original input data set. Therefore we can run our algorithm on a coreset so as to reduce the total computational complexity. Conventional coreset techniques assume that the input data set is available to process explicitly. However, this assumption may not hold in real-world scenarios. In this paper, we consider the problem of coresets construction over relational data. Namely, the data is decoupled into several relational tables, and it could be very expensive to directly materialize the data matrix by joining the tables. We propose a novel approach called ``aggregation tree with pseudo-cube'' that can build a coreset from bottom to up. Moreover, our approach can neatly circumvent several troublesome issues of relational learning problems [Khamis et al., PODS 2019]. Under some mild assumptions, we show that our coreset approach can be applied for the machine learning tasks, such as clustering, logistic regression and SVM.


title: Interplay of magnetism and band topology in Eu$_{1-x}$Ca$_x$Mg$_2$Bi$_2$ (x=0, 0.5) from first principles study

abstract: Recent discovery of the time reversal symmetry breaking magnetic Weyl semimetals has created a huge surge of activities in the field of quantum topological materials. In this work, we have studied systematically the ground state magnetic order, electronic structure and the interplay between the magnetic order and band topology in one such materials, EuMg$_2$Bi$_2$ (EMB) and its Ca doped variant using first principles method within the framework of density functional theory (DFT). The detailed investigation unravels the existence of different topological phases in this single material which can be tuned by an external probe such as magnetic field or chemical substitution. Our DFT calculations including Coulomb correlation (U) and spin-orbit (SO) interaction within GGA+U+SO approximation confirms that the magnetic ground state of EMB is A-type Antiferromagnetic (A-AFM) with Eu magnetic moments aligned along the crystallographic $a$ or $b$ direction. Although the ground state of EMB is A-AFM, the Ferromagnetic (FM) state lies very close in energy. We observe a single pair of Weyl points connecting valence and conduction band very close to the Fermi level (FL) along $\Gamma$-A direction in the FM state of EuMg$_2$Bi$_2$ with Eu moments aligned along crystallographic $c$ direction. On doping 50\% Ca at Eu sites, we observe single pair of Weyl points moving closer to the FL which is highly desirable for application purposes. Further we observe that the separation between the Weyl points in the pair decreases in doped compound compared to that in the parent compound which has direct consequence on anomalous Hall conductivity (AHC). Our first principles calculation of AHC shows high peak values exactly at these Weyl points and the peak height decreases when we dope the system with Ca. Therefore, Ca doping can be a good external handle to tune AHC in this system.


title: State Advantage Weighting for Offline RL

abstract: We present state advantage weighting for offline reinforcement learning (RL). In contrast to action advantage $A(s,a)$ that we commonly adopt in QSA learning, we leverage state advantage $A(s,s^\prime)$ and QSS learning for offline RL, hence decoupling the action from values. We expect the agent can get to the high-reward state and the action is determined by how the agent can get to that corresponding state. Experiments on D4RL datasets show that our proposed method can achieve remarkable performance against the common baselines. Furthermore, our method shows good generalization capability when transferring from offline to online.


title: Precise Single-stage Detector

abstract: There are still two problems in SDD causing some inaccurate results: (1) In the process of feature extraction, with the layer-by-layer acquisition of semantic information, local information is gradually lost, resulting into less representative feature maps; (2) During the Non-Maximum Suppression (NMS) algorithm due to inconsistency in classification and regression tasks, the classification confidence and predicted detection position cannot accurately indicate the position of the prediction boxes. Methods: In order to address these aforementioned issues, we propose a new architecture, a modified version of Single Shot Multibox Detector (SSD), named Precise Single Stage Detector (PSSD). Firstly, we improve the features by adding extra layers to SSD. Secondly, we construct a simple and effective feature enhancement module to expand the receptive field step by step for each layer and enhance its local and semantic information. Finally, we design a more efficient loss function to predict the IOU between the prediction boxes and ground truth boxes, and the threshold IOU guides classification training and attenuates the scores, which are used by the NMS algorithm. Main Results: Benefiting from the above optimization, the proposed model PSSD achieves exciting performance in real-time. Specifically, with the hardware of Titan Xp and the input size of 320 pix, PSSD achieves 33.8 mAP at 45 FPS speed on MS COCO benchmark and 81.28 mAP at 66 FPS speed on Pascal VOC 2007 outperforming state-of-the-art object detection models. Besides, the proposed model performs significantly well with larger input size. Under 512 pix, PSSD can obtain 37.2 mAP with 27 FPS on MS COCO and 82.82 mAP with 40 FPS on Pascal VOC 2007. The experiment results prove that the proposed model has a better trade-off between speed and accuracy.


title: A Concentration Bound for Distributed Stochastic Approximation

abstract: We revisit the classical model of Tsitsiklis, Bertsekas and Athans for distributed stochastic approximation with consensus. The main result is an analysis of this scheme using the ODE approach to stochastic approximation, leading to a high probability bound for the tracking error between suitably interpolated iterates and the limiting differential equation. Several future directions will also be highlighted.


title: Notes on a 1-dimensional electrostatic plasma model

abstract: A starting point for deriving the Vlasov equation is the BBGKY hierarchy that describes the dynamics of coupled marginal distribution functions. With a large value of the plasma parameter one can justify eliminating 2-point correlations in terms of the 1-point function in order to derive the Vlasov Landau Lenard Balescu (VLLB) theory. Because of the high dimensionality of the problem, numerically testing the assumptions of the VLLB theory is prohibitive. In these notes we propose a physically reasonable interaction model that lowers the dimensionality of the problem and may bring such computations within reach. We introduce a 1-dimensional (1-D) electrostatic plasma model formulated in terms of the interaction of parallelly-aligned charged disks. This model combines 1-dimensional features at short distances and 3-dimensional features at large distances.


title: Unsupervised Cross-Modality Domain Adaptation for Vestibular Schwannoma Segmentation and Koos Grade Prediction based on Semi-Supervised Contrastive Learning

abstract: Domain adaptation has been widely adopted to transfer styles across multi-vendors and multi-centers, as well as to complement the missing modalities. In this challenge, we proposed an unsupervised domain adaptation framework for cross-modality vestibular schwannoma (VS) and cochlea segmentation and Koos grade prediction. We learn the shared representation from both ceT1 and hrT2 images and recover another modality from the latent representation, and we also utilize proxy tasks of VS segmentation and brain parcellation to restrict the consistency of image structures in domain adaptation. After generating missing modalities, the nnU-Net model is utilized for VS and cochlea segmentation, while a semi-supervised contrastive learning pre-train approach is employed to improve the model performance for Koos grade prediction. On CrossMoDA validation phase Leaderboard, our method received rank 4 in task1 with a mean Dice score of 0.8394 and rank 2 in task2 with Macro-Average Mean Square Error of 0.3941. Our code is available at https://github.com/fiy2W/cmda2022.superpolymerization.


title: Temperature Dependence of the Electron-Drift Anisotropy and Implications for the Electron-Drift Model

abstract: The electron drift in germanium detectors is modeled making many assumptions. Confronted with data, these assumptions have to be revisited. The temperature dependence of the drift of electrons was studied in detail for an n-type segmented point-contact germanium detector. The detector was mounted in a temperature controlled, electrically cooled cryostat. Surface events were induced with collimated 81 keV photons from a $^{133}$Ba source. A detailed analysis of the rise time of pulses collected in surface scans, performed at different temperatures, is presented. The longitudinal anisotropy of the electron drift decreases with rising temperature. A new approach, making use of designated rise-time windows determined by simulations using SolidStateDetectors.jl, was used to isolate the longitudinal drift of electrons along different axes to quantify this observation. The measured temperature dependence of the longitudinal drift velocities combined with the standard electron drift model as widely used in relevant simulation packages results in unphysical predictions. A first suggestion to modify the electron-drift model is motivated and described. The results of a first implementation of the modified model in SolidStateDetectors.jl are shown. They describe the data reasonably well. A general review of the model and the standard input values for mobilities is suggested.


title: Memristive Ising Circuits

abstract: The Ising model is of prime importance in the field of statistical mechanics. Here we show that Ising-type interactions can be realized in periodically-driven circuits of stochastic binary resistors with memory. A key feature of our realization is the simultaneous co-existence of ferromagnetic and antiferromagnetic interactions between two neighboring spins -- an extraordinary property not available in nature. We demonstrate that the statistics of circuit states may perfectly match the ones found in the Ising model with ferromagnetic or antiferromagnetic interactions, and, importantly, the corresponding Ising model parameters can be extracted from the probabilities of circuit states. Using this finding, the Ising Hamiltonian is re-constructed in several model cases, and it is shown that different types of interaction can be realized in circuits of stochastic memristors.


title: A unit-based symbolic execution method for detecting memory corruption vulnerabilities in executable codes

abstract: Memory corruption is a serious class of software vulnerabilities, which requires careful attention to be detected and removed from applications before getting exploited and harming the system users. Symbolic execution is a well-known method for analyzing programs and detecting various vulnerabilities, e.g., memory corruption. Although this method is sound and complete in theory, it faces some challenges, such as path explosion, when applied to real-world complex programs. In this paper, we present a method for improving the efficiency of symbolic execution and detecting four classes of memory corruption vulnerabilities in executable codes, i.e., heap-based buffer overflow, stack-based buffer overflow, use-after-free, and double-free. We perform symbolic execution only on test units rather than the whole program to avoid path explosion. In our method, test units are considered parts of the program's code, which might contain vulnerable statements and are statically identified based on the specifications of memory corruption vulnerabilities. Then, each test unit is symbolically executed to calculate path and vulnerability constraints of each statement of the unit, which determine the conditions on unit input data for executing that statement or activating vulnerabilities in it, respectively. Solving these constraints gives us input values for the test unit, which execute the desired statements and reveal vulnerabilities in them. Finally, we use machine learning to approximate the correlation between system and unit input data. Thereby, we generate system inputs that enter the program, reach vulnerable instructions in the desired test unit, and reveal vulnerabilities in them. This method is implemented as a plugin for angr framework and evaluated using a group of benchmark programs. The experiments show its superiority over similar tools in accuracy and performance.


title: Linear attention coupled Fourier neural operator for simulation of three-dimensional turbulence

abstract: Modeling three-dimensional (3D) turbulence by neural networks is difficult because 3D turbulence is highly-nonlinear with high degrees of freedom and the corresponding simulation is memory-intensive. Recently, the attention mechanism has been shown as a promising approach to boost the performance of neural networks on turbulence simulation. However, the standard self-attention mechanism uses $O(n^2)$ time and space with respect to input dimension $n$, and such quadratic complexity has become the main bottleneck for attention to be applied on 3D turbulence simulation. In this work, we resolve this issue with the concept of linear attention network. The linear attention approximates the standard attention by adding two linear projections, reducing the overall self-attention complexity from $O(n^2)$ to $O(n)$ in both time and space. The linear attention coupled Fourier neural operator (LAFNO) is developed for the simulation of 3D turbulence. Numerical simulations show that the linear attention mechanism provides 40\% error reduction at the same level of computational cost, and LAFNO can accurately reconstruct a variety of statistics and instantaneous spatial structures of 3D turbulence. The linear attention method would be helpful for the improvement of neural network models of 3D nonlinear problems involving high-dimensional data in other scientific domains.


title: Coresets for Wasserstein Distributionally Robust Optimization Problems

abstract: Wasserstein distributionally robust optimization (\textsf{WDRO}) is a popular model to enhance the robustness of machine learning with ambiguous data. However, the complexity of \textsf{WDRO} can be prohibitive in practice since solving its ``minimax'' formulation requires a great amount of computation. Recently, several fast \textsf{WDRO} training algorithms for some specific machine learning tasks (e.g., logistic regression) have been developed. However, the research on designing efficient algorithms for general large-scale \textsf{WDRO}s is still quite limited, to the best of our knowledge. \textit{Coreset} is an important tool for compressing large dataset, and thus it has been widely applied to reduce the computational complexities for many optimization problems. In this paper, we introduce a unified framework to construct the $\epsilon$-coreset for the general \textsf{WDRO} problems. Though it is challenging to obtain a conventional coreset for \textsf{WDRO} due to the uncertainty issue of ambiguous data, we show that we can compute a ``dual coreset'' by using the strong duality property of \textsf{WDRO}. Also, the error introduced by the dual coreset can be theoretically guaranteed for the original \textsf{WDRO} objective. To construct the dual coreset, we propose a novel grid sampling approach that is particularly suitable for the dual formulation of \textsf{WDRO}. Finally, we implement our coreset approach and illustrate its effectiveness for several \textsf{WDRO} problems in the experiments.


title: Noise-Robust De-Duplication at Scale

abstract: Identifying near duplicates within large, noisy text corpora has a myriad of applications that range from de-duplicating training datasets, reducing privacy risk, and evaluating test set leakage, to identifying reproduced news articles and literature within large corpora. Across these diverse applications, the overwhelming majority of work relies on N-grams. Limited efforts have been made to evaluate how well N-gram methods perform, in part because it is unclear how one could create an unbiased evaluation dataset for a massive corpus. This study uses the unique timeliness of historical news wires to create a 27,210 document dataset, with 122,876 positive duplicate pairs, for studying noise-robust de-duplication. The time-sensitivity of news makes comprehensive hand labelling feasible - despite the massive overall size of the corpus - as duplicates occur within a narrow date range. The study then develops and evaluates a range of de-duplication methods: hashing and N-gram overlap (which predominate in the literature), a contrastively trained bi-encoder, and a re-rank style approach combining a bi- and cross-encoder. The neural approaches significantly outperform hashing and N-gram overlap. We show that the bi-encoder scales well, de-duplicating a 10 million article corpus on a single GPU card in a matter of hours. We also apply our pre-trained model to the RealNews and patent portions of C4 (Colossal Clean Crawled Corpus), illustrating that a neural approach can identify many near duplicates missed by hashing, in the presence of various types of noise. The public release of our NEWS-COPY de-duplication dataset, codebase, and the pre-trained models will facilitate further research and applications.


title: Method of dynamic resonance tuning in spintronics of nanosystems

abstract: A method is advanced allowing for fast regulation of magnetization direction in magnetic nanosystems. The examples of such systems are polarized nanostructures, magnetic nanomolecules, magnetic nanoclusters, magnetic graphene, dipolar and spinor trapped atoms, and quantum dots. The emphasis in the paper is on magnetic nanomolecules and nanoclusters. The method is based on two principal contrivances: First, the magnetic sample is placed inside a coil of a resonant electric circuit creating a feedback field, and second, there is an external magnetic field that can be varied so that to dynamically support the resonance between the Zeeman frequency of the sample and the natural frequency of the circuit during the motion of the sample magnetization. This method can find applications in the production of memory devices and other spintronic appliances.


title: Complete set of unitary irreps of Discrete Heisenberg Group $HW_{2^s}$

abstract: Following the method of induced group representations of Wigner-Mackay, the explicit construction of all the unitary irreducible representations of the discrete finite Heisenberg-Weyl group $HW_{2^s}$ over the discrete phase space lattice $Z_{2^s}$ $\otimes$ $Z_{2^s}$ is presented. We explicitly determine their characters and their fusion rules. We discuss possible physical applications for finite quantum mechanics and quantum computation.


title: CAGroup3D: Class-Aware Grouping for 3D Object Detection on Point Clouds

abstract: We present a novel two-stage fully sparse convolutional 3D object detection framework, named CAGroup3D. Our proposed method first generates some high-quality 3D proposals by leveraging the class-aware local group strategy on the object surface voxels with the same semantic predictions, which considers semantic consistency and diverse locality abandoned in previous bottom-up approaches. Then, to recover the features of missed voxels due to incorrect voxel-wise segmentation, we build a fully sparse convolutional RoI pooling module to directly aggregate fine-grained spatial information from backbone for further proposal refinement. It is memory-and-computation efficient and can better encode the geometry-specific features of each 3D proposal. Our model achieves state-of-the-art 3D detection performance with remarkable gains of +\textit{3.6\%} on ScanNet V2 and +\textit{2.6}\% on SUN RGB-D in term of mAP@0.25. Code will be available at https://github.com/Haiyang-W/CAGroup3D.


title: 3D Reconstruction of Sculptures from Single Images via Unsupervised Domain Adaptation on Implicit Models

abstract: Acquiring the virtual equivalent of exhibits, such as sculptures, in virtual reality (VR) museums, can be labour-intensive and sometimes infeasible. Deep learning based 3D reconstruction approaches allow us to recover 3D shapes from 2D observations, among which single-view-based approaches can reduce the need for human intervention and specialised equipment in acquiring 3D sculptures for VR museums. However, there exist two challenges when attempting to use the well-researched human reconstruction methods: limited data availability and domain shift. Considering sculptures are usually related to humans, we propose our unsupervised 3D domain adaptation method for adapting a single-view 3D implicit reconstruction model from the source (real-world humans) to the target (sculptures) domain. We have compared the generated shapes with other methods and conducted ablation studies as well as a user study to demonstrate the effectiveness of our adaptation method. We also deploy our results in a VR application.


title: Does Thermal Really Always Matter for RGB-T Salient Object Detection?

abstract: In recent years, RGB-T salient object detection (SOD) has attracted continuous attention, which makes it possible to identify salient objects in environments such as low light by introducing thermal image. However, most of the existing RGB-T SOD models focus on how to perform cross-modality feature fusion, ignoring whether thermal image is really always matter in SOD task. Starting from the definition and nature of this task, this paper rethinks the connotation of thermal modality, and proposes a network named TNet to solve the RGB-T SOD task. In this paper, we introduce a global illumination estimation module to predict the global illuminance score of the image, so as to regulate the role played by the two modalities. In addition, considering the role of thermal modality, we set up different cross-modality interaction mechanisms in the encoding phase and the decoding phase. On the one hand, we introduce a semantic constraint provider to enrich the semantics of thermal images in the encoding phase, which makes thermal modality more suitable for the SOD task. On the other hand, we introduce a two-stage localization and complementation module in the decoding phase to transfer object localization cue and internal integrity cue in thermal features to the RGB modality. Extensive experiments on three datasets show that the proposed TNet achieves competitive performance compared with 20 state-of-the-art methods.


title: Spread Love Not Hate: Undermining the Importance of Hateful Pre-training for Hate Speech Detection

abstract: Pre-training large neural language models, such as BERT, has led to impressive gains on many natural language processing (NLP) tasks. Although this method has proven to be effective for many domains, it might not always provide desirable benefits. In this paper, we study the effects of hateful pre-training on low-resource hate speech classification tasks. While previous studies on the English language have emphasized its importance, we aim to augment their observations with some non-obvious insights. We evaluate different variations of tweet-based BERT models pre-trained on hateful, non-hateful, and mixed subsets of a 40M tweet dataset. This evaluation is carried out for the Indian languages Hindi and Marathi. This paper is empirical evidence that hateful pre-training is not the best pre-training option for hate speech detection. We show that pre-training on non-hateful text from the target domain provides similar or better results. Further, we introduce HindTweetBERT and MahaTweetBERT, the first publicly available BERT models pre-trained on Hindi and Marathi tweets, respectively. We show that they provide state-of-the-art performance on hate speech classification tasks. We also release hateful BERT for the two languages and a gold hate speech evaluation benchmark HateEval-Hi and HateEval-Mr consisting of manually labeled 2000 tweets each. The models and data are available at https://github.com/l3cube-pune/MarathiNLP .


title: A Locally Adaptive Shrinkage Approach to False Selection Rate Control in High-Dimensional Classification

abstract: The uncertainty quantification and error control of classifiers are crucial in many high-consequence decision-making scenarios. We propose a selective classification framework that provides an indecision option for any observations that cannot be classified with confidence. The false selection rate (FSR), defined as the expected fraction of erroneous classifications among all definitive classifications, provides a useful error rate notion that trades off a fraction of indecisions for fewer classification errors. We develop a new class of locally adaptive shrinkage and selection (LASS) rules for FSR control in the context of high-dimensional linear discriminant analysis (LDA). LASS is easy-to-analyze and has robust performance across sparse and dense regimes. Theoretical guarantees on FSR control are established without strong assumptions on sparsity as required by existing theories in high-dimensional LDA. The empirical performances of LASS are investigated using both simulated and real data.


title: Data-driven framework for input/output lookup tables reduction: Application to hypersonic flows in chemical non-equilibrium

abstract: In this paper, we present a novel model-agnostic machine learning technique to extract a reduced thermochemical model for reacting hypersonic flows simulation. A first simulation gathers all relevant thermodynamic states and the corresponding gas properties via a given model. The states are embedded in a low-dimensional space and clustered to identify regions with different levels of thermochemical (non)-equilibrium. Then, a surrogate surface from the reduced cluster-space to the output space is generated using radial-basis-function networks. The method is validated and benchmarked on a simulation of a hypersonic flat-plate boundary layer with finite-rate chemistry. The gas properties of the reactive air mixture are initially modeled using the open-source Mutation++ library. Substituting Mutation++ with the light-weight, machine-learned alternative improves the performance of the solver by 50% while maintaining overall accuracy.


title: One-loop Matching of Scotogenic Model onto Standard Model Effective Field Theory up to Dimension 7

abstract: The scotogenic neutrino seesaw model is a minimal extension of the standard model with three $\mathbb{Z}_2$-odd right-handed singlet fermions $N$ and one $\mathbb{Z}_2$-odd Higgs doublet $\eta$ that can accommodate the tiny neutrino mass and provide a dark matter candidate in a unified picture. Due to lack of experimental signatures for electroweak scale new physics, it is appealing to assume these new particles are well above the electroweak scale and take the effective field theory approach to study their effects on low energy observables. In this work we apply the recently developed functional matching formalism to the one-loop matching of the model onto the standard model effective field theory up to dimension seven for the case when all new states $N$ and $\eta$ are heavy to be integrated out. This is a realistic example which has no tree-level matching due to the $\mathbb{Z}_2$ symmetry. Using the matching results, we analyze their phenomenological implications for several physical processes, including the lepton number violating effect, the CDF $W$ mass excess, and the lepton flavor violating decays like $\mu\to e\gamma$ and $\mu\to 3e$.


title: Sketched Multi-view Subspace Learning for Hyperspectral Anomalous Change Detection

abstract: In recent years, multi-view subspace learning has been garnering increasing attention. It aims to capture the inner relationships of the data that are collected from multiple sources by learning a unified representation. In this way, comprehensive information from multiple views is shared and preserved for the generalization processes. As a special branch of temporal series hyperspectral image (HSI) processing, the anomalous change detection task focuses on detecting very small changes among different temporal images. However, when the volume of datasets is very large or the classes are relatively comprehensive, existing methods may fail to find those changes between the scenes, and end up with terrible detection results. In this paper, inspired by the sketched representation and multi-view subspace learning, a sketched multi-view subspace learning (SMSL) model is proposed for HSI anomalous change detection. The proposed model preserves major information from the image pairs and improves computational complexity by using a sketched representation matrix. Furthermore, the differences between scenes are extracted by utilizing the specific regularizer of the self-representation matrices. To evaluate the detection effectiveness of the proposed SMSL model, experiments are conducted on a benchmark hyperspectral remote sensing dataset and a natural hyperspectral dataset, and compared with other state-of-the art approaches.


title: Caution on Gross-Neveu criticality with a single Dirac cone: Violation of locality and its consequence of unexpected finite-temperature transition

abstract: Lately there are many SLAC fermion investigations on the (2+1)D Gross-Neveu criticality of a single Dirac cone [1,2]. While the SLAC fermion construction indeed gives rise to the linear energy-momentum relation for all lattice momenta at the non-interacting limit, the long-range hopping and its consequent violation of locality on the Gross-Neveu quantum critical point (GN-QCP) -- which a priori requires short-range interaction -- has not been verified. Here we show, by means of large-scale quantum Monte Carlo simulations, that the interaction-driven antiferromagnetic insulator in this case is fundamentally different from that on a purely local $\pi$-flux Hubbard model on the square lattice. In particular, we find the antiferromagnetic long-range order in the SLAC fermion model has a finite temperature continuous phase transition, which violates the Mermin-Wagner theorem, and smoothly connects to the previously determined GN-QCP. The magnetic excitations inside the antiferromagnetic insulator are gapped without Goldstone mode, even though the state spontaneously breaks continuous $SU(2)$ symmetry. These unusual results proclaim caution on the interpretation of the quantum phase transition in SLAC fermion model as that of GN-QCP with short-range interaction.


title: Stochastic Zeroth-order Functional Constrained Optimization: Oracle Complexity and Applications

abstract: Functionally constrained stochastic optimization problems, where neither the objective function nor the constraint functions are analytically available, arise frequently in machine learning applications. In this work, assuming we only have access to the noisy evaluations of the objective and constraint functions, we propose and analyze stochastic zeroth-order algorithms for solving the above class of stochastic optimization problem. When the domain of the functions is $\mathbb{R}^n$, assuming there are $m$ constraint functions, we establish oracle complexities of order $\mathcal{O}((m+1)n/\epsilon^2)$ and $\mathcal{O}((m+1)n/\epsilon^3)$ respectively in the convex and nonconvex setting, where $\epsilon$ represents the accuracy of the solutions required in appropriately defined metrics. The established oracle complexities are, to our knowledge, the first such results in the literature for functionally constrained stochastic zeroth-order optimization problems. We demonstrate the applicability of our algorithms by illustrating its superior performance on the problem of hyperparameter tuning for sampling algorithms and neural network training.


title: On Schreier varieties of racks

abstract: We prove that a subrack of a free rack is free and suggest a method to prove a similar statement about involutory racks.


title: Research Software Engineers: Career Entry Points and Training Gaps

abstract: As software has become more essential to research across disciplines, and as the recognition of this fact has grown, the importance of professionalizing the development and maintenance of this software has also increased. The community of software professionals who work on this software have come together under the title Research Software Engineer (RSE) over the last decade. This has led to the formalization of RSE roles and organized RSE groups in universities, national labs, and industry. This, in turn, has created the need to understand how RSEs come into this profession and into these groups, how to further promote this career path to potential members, as well as the need to understand what training gaps need to be filled for RSEs coming from different entry points. We have categorized three main classifications of entry paths into the RSE profession and identified key elements, both advantages and disadvantages, that should be acknowledged and addressed by the broader research community in order to attract and retain a talented and diverse pool of future RSEs.


title: On the complements of union of open balls of fixed radius in the Euclidean space

abstract: Let an $R$-body be the complement of the union of open balls of radius $R$ in $\mathbb{E}^d$. The $R$-hulloid of a closed not empty set $A$, the minimal $R$-body containing $A$, is investigated; if $A$ is the set of the vertices of a simplex, the $R$-hulloid of $A$ is completely described (if $d=2$) and if $d> 2$ special examples are studied. The class of $R$-bodies is compact in the Hausdorff metric if $d =2$, but not compact if $d>2$.


title: Boost Event-Driven Tactile Learning with Location Spiking Neurons

abstract: Tactile sensing is essential for a variety of daily tasks. And recent advances in event-driven tactile sensors and Spiking Neural Networks (SNNs) spur the research in related fields. However, SNN-enabled event-driven tactile learning is still in its infancy due to the limited representation abilities of existing spiking neurons and high spatio-temporal complexity in the event-driven tactile data. In this paper, to improve the representation capability of existing spiking neurons, we propose a novel neuron model called "location spiking neuron", which enables us to extract features of event-based data in a novel way. Specifically, based on the classical Time Spike Response Model (TSRM), we develop the Location Spike Response Model (LSRM). In addition, based on the most commonly-used Time Leaky Integrate-and-Fire (TLIF) model, we develop the Location Leaky Integrate-and-Fire (LLIF) model. Moreover, to demonstrate the representation effectiveness of our proposed neurons and capture the complex spatio-temporal dependencies in the event-driven tactile data, we exploit the location spiking neurons to propose two hybrid models for event-driven tactile learning. Specifically, the first hybrid model combines a fully-connected SNN with TSRM neurons and a fully-connected SNN with LSRM neurons. And the second hybrid model fuses the spatial spiking graph neural network with TLIF neurons and the temporal spiking graph neural network with LLIF neurons. Extensive experiments demonstrate the significant improvements of our models over the state-of-the-art methods on event-driven tactile learning. Moreover, compared to the counterpart artificial neural networks (ANNs), our SNN models are 10x to 100x energy-efficient, which shows the superior energy efficiency of our models and may bring new opportunities to the spike-based learning community and neuromorphic engineering.


title: Mixed moments and the joint distribution of random groups

abstract: We study the joint distribution of random abelian and non-abelian groups. In the abelian case, we prove several universality results for the joint distribution of the multiple cokernels for random $p$-adic matrices. In the non-abelian case, we compute the joint distribution of random groups given by the quotients of the free profinite group by random relations. In both cases, we generalize the known results on the distribution of the cokernels of random $p$-adic matrices and random groups. Our proofs are based on the observation that mixed moments determine the joint distribution of random groups, which extends the works of Wood for abelian groups and Sawin for non-abelian groups.


title: Observation of edge magnetoplasmon squeezing in a quantum Hall conductor

abstract: Squeezing of the quadratures of the electromagnetic field has been extensively studied in optics and microwaves. However, previous works focused on the generation of squeezed states in a low impedance ($Z_0 \approx 50 \Omega$) environment. We report here on the demonstration of the squeezing of bosonic edge magnetoplasmon modes in a quantum Hall conductor whose characteristic impedance is set by the quantum of resistance ($R_K \approx 25 k \Omega$), offering the possibility of an enhanced coupling to low-dimensional quantum conductors. By applying a combination of dc and ac drives to a quantum point contact, we demonstrate squeezing and observe a noise reduction 18\% below the vacuum fluctuations. This level of squeezing can be improved by using more complex conductors, such as ac driven quantum dots or mesoscopic capacitors.


title: Cost-effective photonic super-resolution millimeter-wave joint radar-communication system using self-coherent detection

abstract: A cost-effective millimeter-wave (MMW) joint radar-communication (JRC) system with super resolution is proposed and experimentally demonstrated, using optical heterodyne up-conversion and self-coherent detection down-conversion techniques. The point lies in the designed coherent dual-band constant envelope linear frequency modulation-orthogonal frequency division multiplexing (LFM-OFDM) signal with opposite phase modulation indexes for the JRC system. Then the self-coherent detection, as a simple and low-cost means, is accordingly facilitated for both de-chirping of MMW radar and frequency down-conversion reception of MMW communication, which circumvents the costly high-speed mixers along with MMW local oscillators and more significantly achieves the real-time decomposition of radar and communication information. Furthermore, a super resolution radar range profile is realized through the coherent fusion processing of dual-band JRC signal. In experiments, a dual-band LFM-OFDM JRC signal centered at 54-GHz and 61-GHz is generated. The dual bands are featured with an identical instantaneous bandwidth of 2 GHz and carry an OFDM signal of 1 GBaud, which help to achieve a 6-Gbit/s data rate for communication and a 1.76-cm range resolution for radar.


title: Component graphs of vector spaces and zero-divisor graphs of ordered sets

abstract: In this paper, nonzero component graphs and nonzero component union graphs of finite dimensional vector space are studied using the zero-divisor graph of specially constructed 0-1-distributive lattice and the zero-divisor graph of rings. Further, we define an equivalence relation on nonzero component graphs and nonzero component union graphs to deduce that these graphs are the graph join of zero-divisor graphs of Boolean algebras and complete graphs. In the last section, we characterize the perfect and chordal nonzero component graphs and nonzero component union graphs.


title: Relativistic thermodynamics of perfect fluids

abstract: The relativistic continuity equations for the extensive thermodynamic quantities are derived based on the divergence theorem in Minkowski space outlined by St\"uckelberg. This covariant approach leads to a relativistic formulation of the first and second laws of thermodynamics. The internal energy density and the pressure of a relativistic perfect fluid carry inertia, which leads to a relativistic coupling between heat and work. The relativistic continuity equation for the relativistic inertia is derived. The relativistic corrections in the Euler equation and in the continuity equations for the energy and momentum are identified. This relativistic theoretical framework allows a rigorous derivation of the relativistic transformation laws for the temperature, the pressure and the chemical potential based on the relativistic transformation laws for the energy density, the entropy density, the mass density and the number density.


title: Cutting sequence and Sturmian sequence in billiard

abstract: The winning rule of billiards is to drive the billiard ball on the table into the designated holes. We try to study the trajectory of the billiard ball, so that we can predict the direction of the ball. For rational slopes, we got cutting sequence by setting up the square torus. We simplified cutting sequence using shearing and flipping and we obtain the transformation between trajectory slope and cutting sequence. For irrational slopes, we look at some properties of Sturmian sequence, which help us distinguish between cutting sequence and Sturmian sequence. In conclusion, in the case of different slopes, we use different sequences to do research.


title: SparseAdapter: An Easy Approach for Improving the Parameter-Efficiency of Adapters

abstract: Adapter Tuning, which freezes the pretrained language models (PLMs) and only fine-tunes a few extra modules, becomes an appealing efficient alternative to the full model fine-tuning. Although computationally efficient, the recent Adapters often increase parameters (e.g. bottleneck dimension) for matching the performance of full model fine-tuning, which we argue goes against their original intention. In this work, we re-examine the parameter-efficiency of Adapters through the lens of network pruning (we name such plug-in concept as \texttt{SparseAdapter}) and find that SparseAdapter can achieve comparable or better performance than standard Adapters when the sparse ratio reaches up to 80\%. Based on our findings, we introduce an easy but effective setting ``\textit{Large-Sparse}'' to improve the model capacity of Adapters under the same parameter budget. Experiments on five competitive Adapters upon three advanced PLMs show that with proper sparse method (e.g. SNIP) and ratio (e.g. 40\%) SparseAdapter can consistently outperform their corresponding counterpart. Encouragingly, with the \textit{Large-Sparse} setting, we can obtain further appealing gains, even outperforming the full fine-tuning by a large margin. Our code will be released at: https://github.com/Shwai-He/SparseAdapter.


title: Improved Abdominal Multi-Organ Segmentation via 3D Boundary-Constrained Deep Neural Networks

abstract: Quantitative assessment of the abdominal region from clinically acquired CT scans requires the simultaneous segmentation of abdominal organs. Thanks to the availability of high-performance computational resources, deep learning-based methods have resulted in state-of-the-art performance for the segmentation of 3D abdominal CT scans. However, the complex characterization of organs with fuzzy boundaries prevents the deep learning methods from accurately segmenting these anatomical organs. Specifically, the voxels on the boundary of organs are more vulnerable to misprediction due to the highly-varying intensity of inter-organ boundaries. This paper investigates the possibility of improving the abdominal image segmentation performance of the existing 3D encoder-decoder networks by leveraging organ-boundary prediction as a complementary task. To address the problem of abdominal multi-organ segmentation, we train the 3D encoder-decoder network to simultaneously segment the abdominal organs and their corresponding boundaries in CT scans via multi-task learning. The network is trained end-to-end using a loss function that combines two task-specific losses, i.e., complete organ segmentation loss and boundary prediction loss. We explore two different network topologies based on the extent of weights shared between the two tasks within a unified multi-task framework. To evaluate the utilization of complementary boundary prediction task in improving the abdominal multi-organ segmentation, we use three state-of-the-art encoder-decoder networks: 3D UNet, 3D UNet++, and 3D Attention-UNet. The effectiveness of utilizing the organs' boundary information for abdominal multi-organ segmentation is evaluated on two publically available abdominal CT datasets. A maximum relative improvement of 3.5% and 3.6% is observed in Mean Dice Score for Pancreas-CT and BTCV datasets, respectively.


title: Three dimensional topological quantum field theory from $U_q(\mathfrak{gl}(1 \vert 1))$ and $U(1 \vert 1)$ Chern--Simons theory

abstract: We introduce an unrolled quantization $U_q^E(\mathfrak{gl}(1 \vert 1))$ of the complex Lie superalgebra $\mathfrak{gl}(1 \vert 1)$ and use its categories of weight modules to construct and study new three dimensional non-semisimple topological quantum field theories. These theories are defined on categories of cobordisms which are decorated by ribbon graphs and cohomology classes and take values in categories of graded super vector spaces. Computations in these theories are enabled by a detailed study of the representation theory of $U_q^E(\mathfrak{gl}(1 \vert 1))$, both for generic and root of unity $q$. We argue that by restricting to subcategories of integral weight modules we obtain topological quantum field theories which are mathematical models of Chern--Simons theories with gauge supergroups $\mathfrak{psl}(1 \vert 1)$ and $\mathfrak{gl}(1 \vert 1)$ coupled to background flat $\mathbb{C}^{\times}$-connections, as studied in the physics literature by Rozansky--Saleur and Mikhaylov. In particular, we match Verlinde formulae and mapping class group actions on state spaces of non-generic tori with results in the physics literature. We also obtain explicit descriptions of state spaces of generic surfaces, including their graded dimensions, which go beyond results in the physics literature.


title: Learning to Decompose Visual Features with Latent Textual Prompts

abstract: Recent advances in pre-training vision-language models like CLIP have shown great potential in learning transferable visual representations. Nonetheless, for downstream inference, CLIP-like models suffer from either 1) degraded accuracy and robustness in the case of inaccurate text descriptions during retrieval-based inference (the challenge for zero-shot protocol); or 2) breaking the well-established vision-language alignment (the challenge for linear probing). To address them, we propose Decomposed Feature Prompting (DeFo). DeFo leverages a flexible number of learnable embeddings as textual input while maintaining the vision-language dual-model architecture, which enables the model to learn decomposed visual features with the help of feature-level textual prompts. We further use an additional linear layer to perform classification, allowing a scalable size of language inputs. Our empirical study shows DeFo's significance in improving the vision-language models. For example, DeFo obtains 73.2% test accuracy on ImageNet with a ResNet-50 backbone without tuning any pretrained weights of both the vision and language encoder, outperforming zero-shot CLIP by a large margin of 15.0%, and outperforming state-of-the-art vision-language prompt tuning method by 7.6%.


title: CoopHash: Cooperative Learning of Multipurpose Descriptor and Contrastive Pair Generator via Variational MCMC Teaching for Supervised Image Hashing

abstract: Leveraging supervised information can lead to superior retrieval performance in the image hashing domain but the performance degrades significantly without enough labeled data. One effective solution to boost performance is to employ generative models, such as Generative Adversarial Networks (GANs), to generate synthetic data in an image hashing model. However, GAN-based methods are difficult to train, which prevents the hashing approaches from jointly training the generative models and the hash functions. This limitation results in sub-optimal retrieval performance. To overcome this limitation, we propose a novel framework, the generative cooperative hashing network, which is based on energy-based cooperative learning. This framework jointly learns a powerful generative representation of the data and a robust hash function via two components: a top-down contrastive pair generator that synthesizes contrastive images and a bottom-up multipurpose descriptor that simultaneously represents the images from multiple perspectives, including probability density, hash code, latent code, and category. The two components are jointly learned via a novel likelihood-based cooperative learning scheme. We conduct experiments on several real-world datasets and show that the proposed method outperforms the competing hashing supervised methods, achieving up to 10\% relative improvement over the current state-of-the-art supervised hashing methods, and exhibits a significantly better performance in out-of-distribution retrieval.


title: Onsager-Casimir reciprocal relations

abstract: The Onsager reciprocal relations are established within the phenomenological framework of the thermodynamics of irreversible processes. In order to do so, the dissipated power densities associated to scalar and vectorial processes are written as positive semi-definite quadratic forms of the corresponding generalised forces, as required by the local expression of the second law in the neighbourhood of the equilibrium. The antisymmetric part of the scalar and vectorial Onsager matrices do not contribute to the dissipation, which yields the scalar and vectorial Onsager reciprocal relations. Furthermore, the positive semi-definite quadratic forms of the generalised scalar and vectorial forces are invariant under time reversal, which yields the scalar and vectorial Casimir-Onsager reciprocal relations, that are a generalisation of the Onsager reciprocal relations.


title: Low Light Video Enhancement by Learning on Static Videos with Cross-Frame Attention

abstract: The design of deep learning methods for low light video enhancement remains a challenging problem owing to the difficulty in capturing low light and ground truth video pairs. This is particularly hard in the context of dynamic scenes or moving cameras where a long exposure ground truth cannot be captured. We approach this problem by training a model on static videos such that the model can generalize to dynamic videos. Existing methods adopting this approach operate frame by frame and do not exploit the relationships among neighbouring frames. We overcome this limitation through a selfcross dilated attention module that can effectively learn to use information from neighbouring frames even when dynamics between the frames are different during training and test times. We validate our approach through experiments on multiple datasets and show that our method outperforms other state-of-the-art video enhancement algorithms when trained only on static videos.