title: Estimating psychometric functions from adaptive designs

abstract: An adaptive design adjusts dynamically as information is accrued and a consequence of applying an adaptive design is the potential for inducing small-sample bias in estimates. In psychometrics and psychophysics, a common class of studies investigate a subject's ability to perform a task as a function of the stimulus intensity, meaning the amount or clarity of the information supplied for the task. The relationship between the performance and intensity is represented by a psychometric function. Such experiments routinely apply adaptive designs, which use both previous intensities and performance to assign stimulus intensities, the strategy being to sample intensities where the information about the psychometric function is maximised. Similar schemes are often applied in drug trials to assign doses dynamically using doses and responses from earlier observations. The present paper investigates the influence of adaptation on statistical inference about the psychometric function focusing on estimation, considering both parametric and non-parametric estimation under both fixed and adaptive designs in schemes encompassing within subject independence as well as dependence through random effects. We study the scenarios analytically, focussing on a latent class model to derive results under random effects, and numerically through a simulation study. We show that while the asymptotic properties of estimators are preserved under adaptation, the adaptive nature of the design introduces small-sample bias, in particular in the slope parameter of the psychometric function. We argue that this poses a dilemma for a study applying an adaptive design in the form of a trade-off between more efficient sampling and the need to increase the number of samples to ameliorate small-sample bias.


title: CTC Alignments Improve Autoregressive Translation

abstract: Connectionist Temporal Classification (CTC) is a widely used approach for automatic speech recognition (ASR) that performs conditionally independent monotonic alignment. However for translation, CTC exhibits clear limitations due to the contextual and non-monotonic nature of the task and thus lags behind attentional decoder approaches in terms of translation quality. In this work, we argue that CTC does in fact make sense for translation if applied in a joint CTC/attention framework wherein CTC's core properties can counteract several key weaknesses of pure-attention models during training and decoding. To validate this conjecture, we modify the Hybrid CTC/Attention model originally proposed for ASR to support text-to-text translation (MT) and speech-to-text translation (ST). Our proposed joint CTC/attention models outperform pure-attention baselines across six benchmark translation tasks.


title: Primordial non-Guassianity in inflation with gravitationally enhanced friction

abstract: The gravitationally enhanced friction can reduce the speed of the inflaton to realize an ultra-slow-roll inflation, which will amplify the curvature perturbations. The amplified perturbations can generate a sizable amount of primordial black holes (PBHs) and induce simultaneously a significant background gravitational waves (SIGWs). In this paper, we investigate the primordial non-Gaussianity of the curvature perturbations in the inflation with gravitationally enhanced friction. We find that when the gravitationally enhanced friction plays a role in the inflationary dynamics, the non-Gaussianity is noticeably larger than that from the standard slow-roll inflation. During the regime in which the power spectrum of the curvature perturbations is around its peak, the non-Gaussianity parameter changes from negative to positive. When the power spectrum is at its maximum, the non-Gaussianity parameter is near zero ($\sim \mathcal{O}(0.01)$). Furthermore, the primordial non-Gaussianity promotes the formation of PBHs, while its effect on SIGWs is negligible.


title: Cosmological-model-independent determination of Hubble constant from fast radio bursts and Hubble parameter measurements

abstract: We establish a cosmological-model-independent method to determine the Hubble constant $H_0$ from the localized fast radio bursts (FRBs) and the Hubble parameter measurements from cosmic chronometers and obtain a first such determination $H_0=71\pm 3~\mathrm{km/s/Mpc}$, with an uncertainty of 4\%, from the eighteen localized FRBs and nineteen Hubble parameter measurements in the redshift range $0<z\leq0.66$. This value, which is independent of the cosmological model, is consistent with the results from the nearby type Ia supernovae (SN Ia) data calibrated by Cepheids and the Planck cosmic microwave background radiation observations at the $1\sigma$ and 2$\sigma$ confidence level, respectively. Simulations show that the uncertainty of $H_0$ can be decreased to the level of that from the nearby SN Ia when mock data from 500 localized FRBs with 50 Hubble parameter measurements in the redshift range of $0<z\leq1$ are used. Since localized FRBs are expected to be detected in large quantities, our method will be able to give a reliable and more precise determination of $H_0$ in the very near future, which will help us to figure out the possible origin of the Hubble constant disagreement.


title: Holographic Anomalous Chiral Current Near a Boundary

abstract: Due to the Weyl anomaly, an axial vector field produces novel anomalous chiral currents in spacetime with boundaries. Remarkably, the chiral current is not invariant under the gauge transformation of axial vector fields. As a result, more potential terms appear, and the chiral current becomes larger than the electric current near the boundary. This paper investigates the anomalous chiral current in AdS/BCFT. We find that the minimal holographic model of the axial vector field cannot produce the expected chiral current. To resolve this problem, we propose adding a suitable boundary action. Furthermore, we notice a similar situation for holographic condensation. Finally, we obtain the shape dependence of holographic chiral current and verify that it agrees with the field-theoretical result.


title: A review of cuspidal serial and parallel manipulators

abstract: Cuspidal robots can move from one inverse or direct kinematic solution to another without ever passing through a singularity. These robots have remained unknown because almost all industrial robots do not have this feature. However, in fact, industrial robots are the exceptions. Some robots appeared recently in the industrial market can be shown to be cuspidal but, surprisingly, almost nobody knows it and robot users meet difficulties in planning trajectories with these robots. This paper proposes a review on the fundamental and application aspects of cuspidal robots. It addresses the important issues raised by these robots for the design and planning of trajectories. The identification of all cuspidal robots is still an open issue. This paper recalls in details the case of serial robots with three joints but it also addresses robots with more complex architectures such as 6-revolute-jointed robot and parallel robots. We hope that this paper will help disseminate more widely knowledge on cuspidal robots.


title: Stackelberg-Nash null controllability for a non linear coupled degenerate parabolic equations

abstract: The main purpose of this paper is to apply the notion of hierarchical control to a coupled degenerate non linear parabolic equations. We use the Stackelberg-Nash strategy with one leader and two followers. The followers solve a Nash equilibrium corresponding to a bi-objective optimal control problem and the leader a null controllability problem. Since the considered problem is non linear, the associated cost is non-convex. We first prove the existence, uniqueness and the characterization of the Nash quasiequilibrium, which is a weak formulation of the Nash equilibrium because the cost associated to the non linear problem is non-convex. Next, we show that under suitable conditions, the Nash quasi-equilibrium is equivalent to the Nash equilibrium. Finally using some Carleman inequalities that we established, and the Kakutani's fixed point Theorem, we brough the states of our system to the rest at final time T .


title: Kernelized multi-graph matching

abstract: Multigraph matching is a recent variant of the graph matching problem. In this framework, the optimization procedure considers several graphs and enforces the consistency of the matches along the graphs. This constraint can be formalized as a cycle consistency across the pairwise permutation matrices, which implies the definition of a universe of vertex~\citep{pachauri2013solving}. The label of each vertex is encoded by a sparse vector and the dimension of this space corresponds to the rank of the bulk permutation matrix, the matrix built from the aggregation of all the pairwise permutation matrices. The matching problem can then be formulated as a non-convex quadratic optimization problem (QAP) under constraints imposed on the rank and the permutations. In this paper, we introduce a novel kernelized multigraph matching technique that handles vectors of attributes on both the vertices and edges of the graphs, while maintaining a low memory usage. We solve the QAP problem using a projected power optimization approach and propose several projectors leading to improved stability of the results. We provide several experiments showing that our method is competitive against other unsupervised methods.


title: Radio Variability and Broad-Band Spectra of Infrared Galaxies with and without OH Megamaser Emission

abstract: We study the radio variability of galaxies with and without sources of hydroxyl (OH) megamaser radiation based on the continuum radio measurements conducted in 2019-2022 with the radio telescope RATAN-600 at frequencies of 2.3, 4.7, 8.2, and 11.2 GHz. Presumably, radio continuum emission significantly affects the megamaser radiation brightness, therefore, such a characteristic as the variability of radio emission is important for determining the OHM galaxies parameters. With additional data from the literature, the parameters of radio variability on a time scale up to 30 years were estimated. The median values of the variability index for 48 OHM galaxies are in the range $V_{S}=0.08$-$0.17$, and for 30 galaxies without OH emission they are $V_{S}=0.08$-$0.28$. For some individual galaxies in both samples, flux density variations reach 30-50%. These sources either are commonly associated with AGNs or reveal active star formation. Generally, the variability of luminous infrared galaxies with and without OH megamaser emission is moderate and of the same order of magnitude on long time scales. From estimating the spectral energy distribution parameters in a broad frequency range (from MHz to THz), we determined the spectral index below 50 GHz and the color temperatures of dust components for megamaser and control sample galaxies. At a level of $\rho<0.05$, there are no statistically significant differences in the distribution of these parameters for the two samples, as well there are no statistically significant correlations between the dust color temperatures and the variability index or luminosity in the OH line.


title: How Well Do Multi-hop Reading Comprehension Models Understand Date Information?

abstract: Several multi-hop reading comprehension datasets have been proposed to resolve the issue of reasoning shortcuts by which questions can be answered without performing multi-hop reasoning. However, the ability of multi-hop models to perform step-by-step reasoning when finding an answer to a comparison question remains unclear. It is also unclear how questions about the internal reasoning process are useful for training and evaluating question-answering (QA) systems. To evaluate the model precisely in a hierarchical manner, we first propose a dataset, \textit{HieraDate}, with three probing tasks in addition to the main question: extraction, reasoning, and robustness. Our dataset is created by enhancing two previous multi-hop datasets, HotpotQA and 2WikiMultiHopQA, focusing on multi-hop questions on date information that involve both comparison and numerical reasoning. We then evaluate the ability of existing models to understand date information. Our experimental results reveal that the multi-hop models do not have the ability to subtract two dates even when they perform well in date comparison and number subtraction tasks. Other results reveal that our probing questions can help to improve the performance of the models (e.g., by +10.3 F1) on the main QA task and our dataset can be used for data augmentation to improve the robustness of the models.


title: Discrete scale invariance of the quasi-bound states at atomic vacancies in a topological material

abstract: Recently, log-periodic quantum oscillations have been detected in topological materials zirconium pentatelluride (ZrTe5) and hafnium pentatelluride (HfTe5), displaying intriguing discrete scale invariance (DSI) characteristic. In condensed materials, the DSI is considered to be related to the quasi-bound states formed by massless Dirac fermions with strong Coulomb attraction, offering a feasible platform to study the long-pursued atomic-collapse phenomenon. Here, we demonstrate that a variety of atomic vacancies in the topological material HfTe5 can host the geometric quasi-bound states with DSI feature, resembling the artificial supercritical atom collapse. The density of states of these quasi-bound states are enhanced and the quasi-bound states are spatially distributed in the "orbitals" surrounding the vacancy sites, which are detected and visualized by low-temperature scanning tunneling microscope/spectroscopy (STM/S). By applying the perpendicular magnetic fields, the quasi-bound states at lower energies become wider and eventually invisible, meanwhile the energies of quasi-bound states move gradually towards the Fermi energy (EF). These features are consistent with the theoretical prediction of a magnetic-field-induced transition from supercritical to subcritical states. The direct observation of geometric quasi-bound states sheds light on the deep understanding of the DSI in quantum materials.


title: Robust Human Matting via Semantic Guidance

abstract: Automatic human matting is highly desired for many real applications. We investigate recent human matting methods and show that common bad cases happen when semantic human segmentation fails. This indicates that semantic understanding is crucial for robust human matting. From this, we develop a fast yet accurate human matting framework, named Semantic Guided Human Matting (SGHM). It builds on a semantic human segmentation network and introduces a light-weight matting module with only marginal computational cost. Unlike previous works, our framework is data efficient, which requires a small amount of matting ground-truth to learn to estimate high quality object mattes. Our experiments show that trained with merely 200 matting images, our method can generalize well to real-world datasets, and outperform recent methods on multiple benchmarks, while remaining efficient. Considering the unbearable labeling cost of matting data and widely available segmentation data, our method becomes a practical and effective solution for the task of human matting. Source code is available at https://github.com/cxgincsu/SemanticGuidedHumanMatting.


title: A Win-win Deal: Towards Sparse and Robust Pre-trained Language Models

abstract: Despite the remarkable success of pre-trained language models (PLMs), they still face two challenges: First, large-scale PLMs are inefficient in terms of memory footprint and computation. Second, on the downstream tasks, PLMs tend to rely on the dataset bias and struggle to generalize to out-of-distribution (OOD) data. In response to the efficiency problem, recent studies show that dense PLMs can be replaced with sparse subnetworks without hurting the performance. Such subnetworks can be found in three scenarios: 1) the fine-tuned PLMs, 2) the raw PLMs and then fine-tuned in isolation, and even inside 3) PLMs without any parameter fine-tuning. However, these results are only obtained in the in-distribution (ID) setting. In this paper, we extend the study on PLMs subnetworks to the OOD setting, investigating whether sparsity and robustness to dataset bias can be achieved simultaneously. To this end, we conduct extensive experiments with the pre-trained BERT model on three natural language understanding (NLU) tasks. Our results demonstrate that \textbf{sparse and robust subnetworks (SRNets) can consistently be found in BERT}, across the aforementioned three scenarios, using different training and compression methods. Furthermore, we explore the upper bound of SRNets using the OOD information and show that \textbf{there exist sparse and almost unbiased BERT subnetworks}. Finally, we present 1) an analytical study that provides insights on how to promote the efficiency of SRNets searching process and 2) a solution to improve subnetworks' performance at high sparsity. The code is available at https://github.com/llyx97/sparse-and-robust-PLM.


title: On Scrambling Phenomena for Randomly Initialized Recurrent Networks

abstract: Recurrent Neural Networks (RNNs) frequently exhibit complicated dynamics, and their sensitivity to the initialization process often renders them notoriously hard to train. Recent works have shed light on such phenomena analyzing when exploding or vanishing gradients may occur, either of which is detrimental for training dynamics. In this paper, we point to a formal connection between RNNs and chaotic dynamical systems and prove a qualitatively stronger phenomenon about RNNs than what exploding gradients seem to suggest. Our main result proves that under standard initialization (e.g., He, Xavier etc.), RNNs will exhibit \textit{Li-Yorke chaos} with \textit{constant} probability \textit{independent} of the network's width. This explains the experimentally observed phenomenon of \textit{scrambling}, under which trajectories of nearby points may appear to be arbitrarily close during some timesteps, yet will be far away in future timesteps. In stark contrast to their feedforward counterparts, we show that chaotic behavior in RNNs is preserved under small perturbations and that their expressive power remains exponential in the number of feedback iterations. Our technical arguments rely on viewing RNNs as random walks under non-linear activations, and studying the existence of certain types of higher-order fixed points called \textit{periodic points} that lead to phase transitions from order to chaos.


title: Relationship between MP and DPP for stochastic recursive optimal control problem under volatility uncertainty

abstract: In this paper, we study the relationship between maximum principle (MP) and dynamic programming principle (DPP) for stochastic recursive optimal control problem driven by $G$-Brownian motion. Under the smooth assumption for the value function, we obtain the connection between MP and DPP under a reference probability $P_{t,x}^{\ast}$. Within the framework of viscosity solution, we establish the relation between the first-order super-jet, sub-jet of the value function and the solution to the adjoint equation respectively.


title: Generation of neutrino dark matter, baryon asymmetry, and radiation after quintessential inflation

abstract: We construct a model explaining dark matter, baryon asymmetry and reheating in quintessential inflation model. Three generations of right-handed neutrinos having hierarchical masses, and the light scalar field leading to self-interaction of active neutrinos are introduced. The lightest sterile neutrino is a dark matter candidate produced by a Dodelson-Widrow mechanism in the presence of a new light scalar field, while the heaviest and the next heaviest sterile neutrinos produced by gravitational particle production are responsible for the generation of the baryon asymmetry. Reheating is realized by spinodal instabilities of the Standard Model Higgs field induced by the non-minimal coupling to the scalar curvature, which can solve overproduction of gravitons and curvature perturbation created by the Higgs condensation.


title: Galaxy-halo size relation from Sloan Digital Sky Survey Data Release 7 and the ELUCID simulation

abstract: Based on galaxies in the Sloan Digital Sky Survey Data Release 7 (SDSS DR7) and dark matter haloes in the dark matter only, cosmological and constrained ELUCID simulation, we investigate the relation between the observed radii of central galaxies with stellar mass $\gtrsim 10^{8} h^{-2}{\rm M}_\odot$ and the virial radii of their host dark matter haloes with virial mass $\gtrsim 10^{10.5} h^{-1}{\rm M}_\odot$, and the dependence of galaxy-halo size relation on the halo spin and concentration. Galaxies in observation are matched to dark matter (sub-)haloes in the ELUCID simulation using a novel neighborhood subhalo abundance matching method. For galaxy 2D half-light radii $R_{50}$, we find that early- and late-type galaxies have the same power-law index 0.55 with $R_{50} \propto R_{\rm vir}^{0.55}$, although early-type galaxies have smaller 2D half-light radii than late-type galaxies at fixed halo virial radii. When converting the 2D half-light radii $R_{50}$ to 3D half-mass radii $r_{1/2}$, both early- and late-type galaxies display similar galaxy-halo size relations with $\log r_{1/2} = 0.55 \log (R_{\rm vir}/210 h^{-1}{\rm kpc}) + 0.39$. We find that the galaxy-halo size ratio $r_{1/2}/ R_{\rm vir}$ decreases with increasing halo mass. At fixed halo mass, there is no significant dependence of galaxy-halo size ratio on the halo spin or concentration.


title: Second order symmetry operators for the massive Dirac equation

abstract: Employing the covariant language of two-spinors, we find what conditions a curved Lorentzian spacetime must satisfy for existence of a second order symmetry operator for the massive Dirac equation. The conditions are formulated as existence of a set of Killing spinors satisfying a set of covariant linear differential equations. Using these Killing spinors, we then state the most general form of such an operator. Partial results for the zeroth and first order are presented and interpreted as well. Computer algebra tools from the Mathematica package suite xAct were used for the calculations.


title: Abstract interpretation of Michelson smart-contracts

abstract: Static analysis of smart-contracts is becoming more widespread on blockchain platforms. Analyzers rely on techniques like symbolic execution or model checking, but few of them can provide strong soundness properties and guarantee the analysis termination at the same time. As smart-contracts often manipulate economic assets, proving numerical properties beyond the absence of runtime errors is also desirable. Smart-contract execution models differ considerably from mainstream programming languages and vary from one blockchain to another, making state-of-the-art analyses hard to adapt. For instance, smart-contract calls may modify a persistent storage impacting subsequent calls. This makes it difficult for tools to infer invariants required to formally ensure the absence of exploitable vulnerabilities. The Michelson smart-contract language, used in the Tezos blockchain, is strongly typed, stack-based, and has a strict execution model leaving few opportunities for implicit runtime errors. We present a work in progress static analyzer for Michelson based on Abstract Interpretation and implemented within MOPSA, a modular static analyzer. Our tool supports the Michelson semantic features, including inner calls to external contracts. It can prove the absence of runtime errors and infer invariants on the persistent storage over an unbounded number of calls. It is also being extended to prove high-level numerical and security properties. CCS Concepts: $\bullet$ Security and privacy $\rightarrow$ Logic and verification; $\bullet$ Software and its engineering $\rightarrow$ Automated static analysis.


title: A Latent Logistic Regression Model with Graph Data

abstract: Recently, graph (network) data is an emerging research area in artificial intelligence, machine learning and statistics. In this work, we are interested in whether node's labels (people's responses) are affected by their neighbor's features (friends' characteristics). We propose a novel latent logistic regression model to describe the network dependence with binary responses. The key advantage of our proposed model is that a latent binary indicator is introduced to indicate whether a node is susceptible to the influence of its neighbour. A score-type test is proposed to diagnose the existence of network dependence. In addition, an EM-type algorithm is used to estimate the model parameters under network dependence. Extensive simulations are conducted to evaluate the performance of our method. Two public datasets are used to illustrate the effectiveness of the proposed latent logistic regression model.


title: Can we measure the Wigner time delay in a photoionization experiment?

abstract: No, we cannot! The concept of Wigner time delay was introduced in scattering theory to quantify the delay or advance of an incoming particle in its interaction with the scattering potential. It was assumed that this concept can be transferred to ionization considering it as a half scattering process. In the present work we show, by analyzing the corresponding wave packets, that this assumption is incorrect since the wave function of the liberated particle has to satisfy the incoming-wave boundary condition. We show that the electron released in photoionization carries no imprint of the scattering phase and thus cannot be used to determine the Wigner time delay. We illustrate our conclusions by comparing the numerical results obtained using two different methods of extracting the photoelectron spectra in an attoclock experiment.


title: Solving forward and inverse problems in a non-linear 3D PDE via an asymptotic expansion based approach

abstract: This paper concerns the use of asymptotic expansions for the efficient solving of forward and inverse problems involving a nonlinear singularly perturbed time-dependent reaction--diffusion--advection equation. By using an asymptotic expansion with the local coordinates in the transition-layer region, we prove the existence and uniqueness of a smooth solution with a sharp transition layer for a three-dimensional partial differential equation. Moreover, with the help of asymptotic expansion, a simplified model is derived for the corresponding inverse source problem, which is close to the original inverse problem over the entire region except for a narrow transition layer. We show that such simplification does not reduce the accuracy of the inversion results when the measurement data contain noise. Based on this simpler inversion model, an asymptotic-expansion regularization algorithm is proposed for efficiently solving the inverse source problem in the three-dimensional case. A model problem shows the feasibility of the proposed numerical approach.


title: CHAE: Fine-Grained Controllable Story Generation with Characters, Actions and Emotions

abstract: Story generation has emerged as an interesting yet challenging NLP task in recent years. Some existing studies aim at generating fluent and coherent stories from keywords and outlines; while others attempt to control the global features of the story, such as emotion, style and topic. However, these works focus on coarse-grained control on the story, neglecting control on the details of the story, which is also crucial for the task. To fill the gap, this paper proposes a model for fine-grained control on the story, which allows the generation of customized stories with characters, corresponding actions and emotions arbitrarily assigned. Extensive experimental results on both automatic and human manual evaluations show the superiority of our method. It has strong controllability to generate stories according to the fine-grained personalized guidance, unveiling the effectiveness of our methodology. Our code is available at https://github.com/victorup/CHAE.


title: Regret Analysis of the Stochastic Direct Search Method for Blind Resource Allocation

abstract: Motivated by programmatic advertising optimization, we consider the task of sequentially allocating budget across a set of resources. At every time step, a feasible allocation is chosen and only a corresponding random return is observed. The goal is to maximize the cumulative expected sum of returns. This is a realistic model for budget allocation across subdivisions of marketing campaigns, when the objective is to maximize the number of conversions. We study direct search (aka pattern search) methods for linearly constrained and derivative-free optimization in the presence of noise. Those algorithms are easy to implement and particularly suited to constrained optimization. They have not yet been analyzed from the perspective of cumulative regret. We provide a regret upper-bound of the order of T 2/3 in the general case. Our mathematical analysis also establishes, as a by-product, time-independent regret bounds in the deterministic, unconstrained case. We also propose an improved version of the method relying on sequential tests to accelerate the identification of descent directions.


title: An innovative and automated method for vortex identification. I. Description of the SWIRL algorithm

abstract: Context. A universally accepted definition of what a vortex is has not yet been reached. Therefore, we lack an unambiguous and rigorous method for the identification of vortices in fluid flows. Such a method would be necessary to conduct robust statistical studies on vortices in highly dynamical and turbulent systems, such as the solar atmosphere. Aims. We aim to develop an innovative and robust automated methodology for the identification of vortices based on local and global characteristics of the flow. Moreover, the use of a threshold that could potentially prevent the detection of weak vortices in the identification process should be avoided. Methods. We present a new method that combines the rigor of mathematical criteria with the global perspective of morphological techniques. The core of the method consists in the estimation of the center of rotation for every point of the flow that presents some degree of curvature in its neighborhood. For that, we employ the Rortex criterion and combine it with morphological considerations of the velocity field. We then identify coherent vortical structures by clusters of estimated centers of rotation. Results. We demonstrate that the Rortex is a more reliable criterion than are the swirling strength and the vorticity for the extraction of physical information from vortical flows, because it measures the rigid-body rotational part of the flow alone and is not biased by the presence of pure or intrinsic shears. We show that the method performs well on a simplistic test case composed of two Lamb-Oseen vortices. We combine the proposed method with a state of the art clustering algorithm to build an automated vortex identification algorithm. (Abridged)


title: Reparameterization of extreme value framework for improved Bayesian workflow

abstract: Using Bayesian methods for extreme value analysis offers an alternative to frequentist ones, with several advantages such as easily dealing with parametric uncertainty or studying irregular models. However, computations can be challenging and the efficiency of algorithms can be altered by poor parametrization choices. The focus is on the Poisson process characterization of univariate extremes and outline two key benefits of an orthogonal parameterization. First, Markov chain Monte Carlo convergence is improved when applied on orthogonal parameters. This analysis relies on convergence diagnostics computed on several simulations. Second, orthogonalization also helps deriving Jeffreys and penalized complexity priors, and establishing posterior propriety thereof. The proposed framework is applied to return level estimation of Garonne flow data (France).


title: A Formalisation of a Fast Fourier Transform

abstract: This notes explains how a standard algorithm that constructs the discrete Fourier transform has been formalised and proved correct in the Coq proof assistant using the SSReflect extension.


title: Detecting Hidden Attackers in Photovoltaic Systems Using Machine Learning

abstract: In modern smart grids, the proliferation of communication-enabled distributed energy resource (DER) systems has increased the surface of possible cyber-physical attacks. Attacks originating from the distributed edge devices of DER system, such as photovoltaic (PV) system, is often difficult to detect. An attacker may change the control configurations or various setpoints of the PV inverters to destabilize the power grid, damage devices, or for the purpose of economic gain. A more powerful attacker may even manipulate the PV system metering data transmitted for remote monitoring, so that (s)he can remain hidden. In this paper, we consider a case where PV systems operating in different control modes can be simultaneously attacked and the attacker has the ability to manipulate individual PV bus measurements to avoid detection. We show that even in such a scenario, with just the aggregated measurements (that the attacker cannot manipulate), machine learning (ML) techniques are able to detect the attack in a fast and accurate manner. We use a standard radial distribution network, together with real smart home electricity consumption data and solar power data in our experimental setup. We test the performance of several ML algorithms to detect attacks on the PV system. Our detailed evaluations show that the proposed intrusion detection system (IDS) is highly effective and efficient in detecting attacks on PV inverter control modes.


title: Provenance of Lyfe: Chemical Autonomous Agents Surviving through Associative Learning

abstract: We present a benchmark study of autonomous, chemical agents exhibiting associative learning of an environmental feature. Associative learning has been widely studied in cognitive science and artificial intelligence, but are most commonly implemented in highly complex or carefully engineered systems such as animal brains, artificial neural networks, DNA computing systems and gene regulatory networks. The ability to encode environmental correlations and use them to make predictions is a benchmark of biological resilience, and underpins a plethora of adaptive responses in the living hierarchy, spanning prey animal species anticipating the arrival of predators, to epigenetic systems in microorganisms learning environmental correlations. Given the ubiquitous and essential presence of learning behaviours in the biosphere, we aimed to explore whether simple, non-living dissipative structures could also exhibit associative learning. Inspired by previous modeling of associative learning in chemical networks, we simulated simple systems composed of long and short term memory chemical species that could encode the presence or absence of temporal correlations between two external species. The ability to learn this association was implemented in Gray-Scott reaction-diffusion spots, emergent chemical patterns that exhibit self-replication and homeostasis. With the novel ability of associative learning, we demonstrate that simple chemical patterns can exhibit a broad repertoire of life-like behaviour, paving the way for in vitro studies of autonomous chemical learning systems, with potential relevance to artificial life, origins of life, and systems chemistry. The experimental realisation of these learning behaviours in protocell systems could advance a novel research direction in astrobiology, since our system significantly reduces the lower bound on the required complexity for emergent learning.


title: New and simplified manual controls for projection and slice tours, with application to exploring classification boundaries in high dimensions

abstract: This paper describes new user controls for examining high-dimensional data using low-dimensional linear projections and slices. A user can interactively change the contribution of a given variable to a low-dimensional projection, which is useful for exploring the sensitivity of structure to particular variables. The user can also interactively shift the center of a slice, for example, to explore how structure changes in local subspaces. The Mathematica package as well as example notebooks are provided, which contain functions enabling the user to experiment with these new manual controls, with one specifically for exploring regions and boundaries produced by classification models. The advantage of Mathematica is its linear algebra capabilities, and interactive cursor location controls. Some limited implementation has also been made available in the R package tourr.


title: Deep Learning-Aided Delay-Tolerant Zero-Forcing Precoding in Cell-Free Massive MIMO

abstract: In the context of cell-free massive multi-input multi-output (CFmMIMO), zero-forcing precoding (ZFP) is superior in terms of spectral efficiency. However, it suffers from channel aging owing to fronthaul and processing delays. In this paper, we propose a robust scheme coined delay-tolerant zero-forcing precoding (DT-ZFP), which exploits deep learning-aided channel prediction to alleviate the effect of outdated channel state information (CSI). A predictor consisting of a bank of user-specific predictive modules is specifically designed for such a multi-user scenario. Leveraging the degree of freedom brought by the prediction horizon, the delivery of CSI and precoded data through a fronthaul network and the transmission of user data and pilots over an air interface can be parallelized. Therefore, DT-ZFP not only effectively combats channel aging but also avoids the inefficient Stop-and-Wait mechanism of the canonical ZFP in CFmMIMO.


title: From Mimicking to Integrating: Knowledge Integration for Pre-Trained Language Models

abstract: Investigating better ways to reuse the released pre-trained language models (PLMs) can significantly reduce the computational cost and the potential environmental side-effects. This paper explores a novel PLM reuse paradigm, Knowledge Integration (KI). Without human annotations available, KI aims to merge the knowledge from different teacher-PLMs, each of which specializes in a different classification problem, into a versatile student model. To achieve this, we first derive the correlation between virtual golden supervision and teacher predictions. We then design a Model Uncertainty--aware Knowledge Integration (MUKI) framework to recover the golden supervision for the student. Specifically, MUKI adopts Monte-Carlo Dropout to estimate model uncertainty for the supervision integration. An instance-wise re-weighting mechanism based on the margin of uncertainty scores is further incorporated, to deal with the potential conflicting supervision from teachers. Experimental results demonstrate that MUKI achieves substantial improvements over baselines on benchmark datasets. Further analysis shows that MUKI can generalize well for merging teacher models with heterogeneous architectures, and even teachers major in cross-lingual datasets.


title: Second root of dilute Bose-Fermi mixtures

abstract: We discuss an equilibrium mean-field properties of mixtures consisting of bosons and spin-polarized fermionic atoms with a point-like interaction in an arbitrary dimension $2<d<4$. Particularly, we discuss except the standard weak-coupling limit of the system with slightly depleted Bose condensate and almost ideal Fermi gas, the (meta)stable phase with dimers composed exactly of one boson and one fermion. The peculiarities of the fermion-dimer and the boson-dimer three-body effective interactions and their impact on the thermodynamic stability of the dilute Bose-Fermi mixtures are elucidated.


title: DCL-Net: Deep Correspondence Learning Network for 6D Pose Estimation

abstract: Establishment of point correspondence between camera and object coordinate systems is a promising way to solve 6D object poses. However, surrogate objectives of correspondence learning in 3D space are a step away from the true ones of object pose estimation, making the learning suboptimal for the end task. In this paper, we address this shortcoming by introducing a new method of Deep Correspondence Learning Network for direct 6D object pose estimation, shortened as DCL-Net. Specifically, DCL-Net employs dual newly proposed Feature Disengagement and Alignment (FDA) modules to establish, in the feature space, partial-to-partial correspondence and complete-to-complete one for partial object observation and its complete CAD model, respectively, which result in aggregated pose and match feature pairs from two coordinate systems; these two FDA modules thus bring complementary advantages. The match feature pairs are used to learn confidence scores for measuring the qualities of deep correspondence, while the pose feature pairs are weighted by confidence scores for direct object pose regression. A confidence-based pose refinement network is also proposed to further improve pose precision in an iterative manner. Extensive experiments show that DCL-Net outperforms existing methods on three benchmarking datasets, including YCB-Video, LineMOD, and Oclussion-LineMOD; ablation studies also confirm the efficacy of our novel designs.


title: Estimation of Doubly-Dispersive Channels in Linearly Precoded Multicarrier Systems Using Smoothness Regularization

abstract: In this paper, we propose a novel channel estimation scheme for pulse-shaped multicarrier systems using smoothness regularization for ultra-reliable low-latency communication (URLLC). It can be applied to any multicarrier system with or without linear precoding to estimate challenging doubly-dispersive channels. A recently proposed modulation scheme using orthogonal precoding is orthogonal time-frequency and space modulation (OTFS). In OTFS, pilot and data symbols are placed in delay-Doppler (DD) domain and are jointly precoded to the time-frequency (TF) domain. On the one hand, such orthogonal precoding increases the achievable channel estimation accuracy and enables high TF diversity at the receiver. On the other hand, it introduces leakage effects which requires extensive leakage suppression when the piloting is jointly precoded with the data. To avoid this, we propose to precode the data symbols only, place pilot symbols without precoding into the TF domain, and estimate the channel coefficients by interpolating smooth functions from the pilot samples. Furthermore, we present a piloting scheme enabling a smooth control of the number and position of the pilot symbols. Our numerical results suggest that the proposed scheme provides accurate channel estimation with reduced signaling overhead compared to standard estimators using Wiener filtering in the discrete DD domain.


title: It Takes Two: Masked Appearance-Motion Modeling for Self-supervised Video Transformer Pre-training

abstract: Self-supervised video transformer pre-training has recently benefited from the mask-and-predict pipeline. They have demonstrated outstanding effectiveness on downstream video tasks and superior data efficiency on small datasets. However, temporal relation is not fully exploited by these methods. In this work, we explicitly investigate motion cues in videos as extra prediction target and propose our Masked Appearance-Motion Modeling (MAM2) framework. Specifically, we design an encoder-regressor-decoder pipeline for this task. The regressor separates feature encoding and pretext tasks completion, such that the feature extraction process is completed adequately by the encoder. In order to guide the encoder to fully excavate spatial-temporal features, two separate decoders are used for two pretext tasks of disentangled appearance and motion prediction. We explore various motion prediction targets and figure out RGB-difference is simple yet effective. As for appearance prediction, VQGAN codes are leveraged as prediction target. With our pre-training pipeline, convergence can be remarkably speed up, e.g., we only require half of epochs than state-of-the-art VideoMAE (400 v.s. 800) to achieve the competitive performance. Extensive experimental results prove that our method learns generalized video representations. Notably, our MAM2 with ViT-B achieves 82.3% on Kinects-400, 71.3% on Something-Something V2, 91.5% on UCF101, and 62.5% on HMDB51.


title: Online Ramsey numbers of ordered paths and cycles

abstract: An ordered graph is a graph with a linear ordering on its vertices. The online Ramsey game for ordered graphs $G$ and $H$ is played on an infinite sequence of vertices; on each turn, Builder draws an edge between two vertices, and Painter colors it red or blue. Builder tries to create a red $G$ or a blue $H$ as quickly as possible, while Painter wants the opposite. The online ordered Ramsey number $r_o(G,H)$ is the number of turns the game lasts with optimal play. In this paper, we consider the behavior of $r_o(G,P_n)$ for fixed $G$, where $P_n$ is the monotone ordered path. We prove an $O(n \log_2n)$ bound on $r_o(G,P_n)$ for all $G$ and an $O(n)$ bound when $G$ is $3$-ichromatic; we partially classify graphs $G$ with $r_o(G,P_n) = n + O(1)$. Many of these results extend to $r_o(G,C_n)$, where $C_n$ is an ordered cycle obtained from $P_n$ by adding one edge.


title: Planning Assembly Sequence with Graph Transformer

abstract: Assembly sequence planning (ASP) is the essential process for modern manufacturing, proven to be NP-complete thus its effective and efficient solution has been a challenge for researchers in the field. In this paper, we present a graph-transformer based framework for the ASP problem which is trained and demonstrated on a self-collected ASP database. The ASP database contains a self-collected set of LEGO models. The LEGO model is abstracted to a heterogeneous graph structure after a thorough analysis of the original structure and feature extraction. The ground truth assembly sequence is first generated by brute-force search and then adjusted manually to in line with human rational habits. Based on this self-collected ASP dataset, we propose a heterogeneous graph-transformer framework to learn the latent rules for assembly planning. We evaluated the proposed framework in a series of experiment. The results show that the similarity of the predicted and ground truth sequences can reach 0.44, a medium correlation measured by Kendall's $\tau$. Meanwhile, we compared the different effects of node features and edge features and generated a feasible and reasonable assembly sequence as a benchmark for further research. Our data set and code is available on https://github.com/AIR-DISCOVER/ICRA\_ASP.


title: Fair and Efficient Multi-Resource Allocation for Cloud Computing

abstract: We study the problem of allocating multiple types of resources to agents with Leontief preferences. The classic Dominant Resource Fairness (DRF) mechanism satisfies several desired fairness and incentive properties, but is known to have poor performance in terms of social welfare approximation ratio. In this work, we propose a new approximation ratio measure, called \emph{\fratio}, which is defined as the worst-case ratio between the optimal social welfare (resp. utilization) among all \emph{fair} allocations and that by the mechanism, allowing us to break the lower bound barrier under the classic approximation ratio. We then generalize DRF and present several new mechanisms with two and multiple types of resources that satisfy the same set of properties as DRF but with better social welfare and utilization guarantees under the new benchmark. We also demonstrate the effectiveness of these mechanisms through experiments on both synthetic and real-world datasets.


title: Minimum distances of binary optimal LCD codes of dimension five are completely determined

abstract: Let $t \in \{2,8,10,12,14,16,18\}$ and $n=31s+t\geq 14$, $d_{a}(n,5)$ and $d_{l}(n,5)$ be distances of binary $[n,5]$ optimal linear codes and optimal linear complementary dual (LCD) codes, respectively. We show that an $[n,5,d_{a}(n,5)]$ optimal linear code is not an LCD code, there is an $[n,5,d_{l}(n,5)]=[n,5,d_{a}(n,5)-1]$ optimal LCD code if $t\neq 16$, and an optimal $[n,5,d_{l}(n,5)]$ optimal LCD code has $d_{l}(n,5)=16s+6=d_{a}(n,5)-2$ for $t=16$. Combined with known results on optimal LCD code, $d_{l}(n,5)$ of all $[n,5]$ LCD codes are completely determined.


title: Matrix models at low temperature

abstract: In this article we investigate the behavior of multi-matrix unitary invariant models under a potential $V_\beta=\beta U+W$ when the inverse temperature $\beta$ becomes very large. We first prove, under mild hypothesis on the functionals $U,W$ that as soon at these potentials are "confining" at infinity, the sequence of spectral distribution of the matrices are tight when the dimension goes to infinity. Their limit points are solutions of Dyson-Schwinger's equations. Next we investigate a few specific models, most importantly the "strong single variable model" where $U$ is a sum of potentials in a single matrix and the "strong commutator model" where $U = -[X,Y]^2$.


title: Multi-site Diagnostic Classification Of Schizophrenia Using 3D CNN On Aggregated Task-based fMRI Data

abstract: In spite of years of research, the mechanisms that underlie the development of schizophrenia, as well as its relapse, symptomatology, and treatment, continue to be a mystery. The absence of appropriate analytic tools to deal with the variable and complicated nature of schizophrenia may be one of the factors that contribute to the development of this disorder. Deep learning is a subfield of artificial intelligence that was inspired by the nervous system. In recent years, deep learning has made it easier to model and analyse complicated, high-dimensional, and nonlinear systems. Research on schizophrenia is one of the many areas of study that has been revolutionised as a result of the outstanding accuracy that deep learning algorithms have demonstrated in classification and prediction tasks. Deep learning has the potential to become a powerful tool for understanding the mechanisms that are at the root of schizophrenia. In addition, a growing variety of techniques aimed at improving model interpretability and causal reasoning are contributing to this trend. Using multi-site fMRI data and a variety of deep learning approaches, this study seeks to identify different types of schizophrenia. Our proposed method of temporal aggregation of the 4D fMRI data outperforms existing work. In addition, this study aims to shed light on the strength of connections between various brain areas in schizophrenia individuals.


title: STSC-SNN: Spatio-Temporal Synaptic Connection with Temporal Convolution and Attention for Spiking Neural Networks

abstract: Spiking Neural Networks (SNNs), as one of the algorithmic models in neuromorphic computing, have gained a great deal of research attention owing to temporal information processing capability, low power consumption, and high biological plausibility. The potential to efficiently extract spatio-temporal features makes it suitable for processing the event streams. However, existing synaptic structures in SNNs are almost full-connections or spatial 2D convolution, neither of which can extract temporal dependencies adequately. In this work, we take inspiration from biological synapses and propose a spatio-temporal synaptic connection SNN (STSC-SNN) model, to enhance the spatio-temporal receptive fields of synaptic connections, thereby establishing temporal dependencies across layers. Concretely, we incorporate temporal convolution and attention mechanisms to implement synaptic filtering and gating functions. We show that endowing synaptic models with temporal dependencies can improve the performance of SNNs on classification tasks. In addition, we investigate the impact of performance vias varied spatial-temporal receptive fields and reevaluate the temporal modules in SNNs. Our approach is tested on neuromorphic datasets, including DVS128 Gesture (gesture recognition), N-MNIST, CIFAR10-DVS (image classification), and SHD (speech digit recognition). The results show that the proposed model outperforms the state-of-the-art accuracy on nearly all datasets.


title: Leveraging the Video-level Semantic Consistency of Event for Audio-visual Event Localization

abstract: Audio-visual event (AVE) localization has attracted much attention in recent years. Most existing methods are often limited to independently encoding and classifying each video segment separated from the full video (which can be regarded as the segment-level representations of events). However, they ignore the semantic consistency of the event within the same full video (which can be considered as the video-level representations of events). In contrast to existing methods, we propose a novel video-level semantic consistency guidance network for the AVE localization task. Specifically, we propose an event semantic consistency modeling (ESCM) module to explore video-level semantic information for semantic consistency modeling. It consists of two components: a cross-modal event representation extractor (CERE) and an intra-modal semantic consistency enhancer (ISCE). CERE is proposed to obtain the event semantic information at the video level. Furthermore, ISCE takes video-level event semantics as prior knowledge to guide the model to focus on the semantic continuity of an event within each modality. Moreover, we propose a new negative pair filter loss to encourage the network to filter out the irrelevant segment pairs and a new smooth loss to further increase the gap between different categories of events in the weakly-supervised setting. We perform extensive experiments on the public AVE dataset and outperform the state-of-the-art methods in both fully- and weakly-supervised settings, thus verifying the effectiveness of our method.The code is available at https://github.com/Bravo5542/VSCG.


title: Cross-modal Search Method of Technology Video based on Adversarial Learning and Feature Fusion

abstract: Technology videos contain rich multi-modal information. In cross-modal information search, the data features of different modalities cannot be compared directly, so the semantic gap between different modalities is a key problem that needs to be solved. To address the above problems, this paper proposes a novel Feature Fusion based Adversarial Cross-modal Retrieval method (FFACR) to achieve text-to-video matching, ranking and searching. The proposed method uses the framework of adversarial learning to construct a video multimodal feature fusion network and a feature mapping network as generator, a modality discrimination network as discriminator. Multi-modal features of videos are obtained by the feature fusion network. The feature mapping network projects multi-modal features into the same semantic space based on semantics and similarity. The modality discrimination network is responsible for determining the original modality of features. Generator and discriminator are trained alternately based on adversarial learning, so that the data obtained by the feature mapping network is semantically consistent with the original data and the modal features are eliminated, and finally the similarity is used to rank and obtain the search results in the semantic space. Experimental results demonstrate that the proposed method performs better in text-to-video search than other existing methods, and validate the effectiveness of the method on the self-built datasets of technology videos.


title: Dataloader Parameter Tuner: An Automated Dataloader Parameter Tuner for Deep Learning Models

abstract: Deep learning has recently become one of the most compute/data-intensive methods and is widely used in many research areas and businesses. One of the critical challenges of deep learning is that it has many parameters that can be adjusted, and the optimal value may need to be determined for faster operation and high accuracy. The focus of this paper is the adjustable parameters of the dataloader. The dataloader in a system mainly groups the data appropriately and loads it to the main memory for the deep learning model to use. We introduce an automated framework called Dataloader Parameter Tuner (DPT) that determines the optimal value for the parameters required for the dataloader. This framework discovers the optimal values for the number of dataloader's subprocesses (i.e., worker) and prefetch factor through grid search to accelerate the data transfer for machine learning systems.


title: PatternRank: Leveraging Pretrained Language Models and Part of Speech for Unsupervised Keyphrase Extraction

abstract: Keyphrase extraction is the process of automatically selecting a small set of most relevant phrases from a given text. Supervised keyphrase extraction approaches need large amounts of labeled training data and perform poorly outside the domain of the training data. In this paper, we present PatternRank, which leverages pretrained language models and part-of-speech for unsupervised keyphrase extraction from single documents. Our experiments show PatternRank achieves higher precision, recall and F1-scores than previous state-of-the-art approaches. In addition, we present the KeyphraseVectorizers package, which allows easy modification of part-of-speech patterns for candidate keyphrase selection, and hence adaptation of our approach to any domain.


title: Cluster-level pseudo-labelling for source-free cross-domain facial expression recognition

abstract: Automatically understanding emotions from visual data is a fundamental task for human behaviour understanding. While models devised for Facial Expression Recognition (FER) have demonstrated excellent performances on many datasets, they often suffer from severe performance degradation when trained and tested on different datasets due to domain shift. In addition, as face images are considered highly sensitive data, the accessibility to large-scale datasets for model training is often denied. In this work, we tackle the above-mentioned problems by proposing the first Source-Free Unsupervised Domain Adaptation (SFUDA) method for FER. Our method exploits self-supervised pretraining to learn good feature representations from the target data and proposes a novel and robust cluster-level pseudo-labelling strategy that accounts for in-cluster statistics. We validate the effectiveness of our method in four adaptation setups, proving that it consistently outperforms existing SFUDA methods when applied to FER, and is on par with methods addressing FER in the UDA setting.


title: Training Debiased Subnetworks with Contrastive Weight Pruning

abstract: Neural networks are often biased to spuriously correlated features that provide misleading statistical evidence that does not generalize. This raises an interesting question: ``Does an optimal unbiased functional subnetwork exist in a severely biased network? If so, how to extract such subnetwork?" While empirical evidence has been accumulated about the existence of such unbiased subnetworks, these observations are mainly based on the guidance of ground-truth unbiased samples. Thus, it is unexplored how to discover the optimal subnetworks with biased training datasets in practice. To address this, here we first present our theoretical insight that alerts potential limitations of existing algorithms in exploring unbiased subnetworks in the presence of strong spurious correlations. We then further elucidate the importance of bias-conflicting samples on structure learning. Motivated by these observations, we propose a Debiased Contrastive Weight Pruning (DCWP) algorithm, which probes unbiased subnetworks without expensive group annotations. Experimental results demonstrate that our approach significantly outperforms state-of-the-art debiasing methods despite its considerable reduction in the number of parameters.


title: Self-supervised debiasing using low rank regularization

abstract: Spurious correlations can cause strong biases in deep neural networks, impairing generalization ability. While most existing debiasing methods require full supervision on either spurious attributes or target labels, training a debiased model from a limited amount of both annotations is still an open question. To address this issue, we investigate an interesting phenomenon using the spectral analysis of latent representations: spuriously correlated attributes make neural networks inductively biased towards encoding lower effective rank representations. We also show that a rank regularization can amplify this bias in a way that encourages highly correlated features. Leveraging these findings, we propose a self-supervised debiasing framework potentially compatible with unlabeled samples. Specifically, we first pretrain a biased encoder in a self-supervised manner with the rank regularization, serving as a semantic bottleneck to enforce the encoder to learn the spuriously correlated attributes. This biased encoder is then used to discover and upweight bias-conflicting samples in a downstream task, serving as a boosting to effectively debias the main model. Remarkably, the proposed debiasing framework significantly improves the generalization performance of self-supervised learning baselines and, in some cases, even outperforms state-of-the-art supervised debiasing approaches.


title: Nonequilibrium thermodynamics of uncertain stochastic processes

abstract: Stochastic thermodynamics is formulated under the assumption of perfect knowledge of all thermodynamic parameters. However, in any real-world experiment, there is non-zero uncertainty about the precise value of temperatures, chemical potentials, energy spectrum, etc. Here we investigate how this uncertainty modifies the theorems of stochastic thermodynamics. We consider two scenarios: in the (called \emph{effective}) scenario we fix the (unknown, randomly generated) experimental apparatus and then repeatedly observe (stochastic) trajectories of the system for that fixed apparatus. In contrast, in a (called \emph{phenomenological}) scenario the (unknown) apparatus is re-generated for each trajectory. We derive expressions for thermodynamic quantities in both scenarios. We also discuss the physical interpretation of effective (scenario) entropy production (EP), derive the effective mismatch cost, and provide a numerical analysis of the effective thermodynamics of a quantum dot implementing bit erasure with uncertain temperature. We then analyze the protocol for moving between two state distributions that maximize effective work extraction. Next, we investigate the effective thermodynamic value of information, focusing on the case where there is a delay between the initialization of the system and the start of the protocol. Finally, we derive the detailed and integrated fluctuation theorems (FTs) for the phenomenological EP. In particular, we show how the phenomenological FTs account for the fact that the longer a trajectory runs, the more information it provides concerning the precise experimental apparatus, and therefore the less EP it generates.


title: Digital twins for city simulation: Automatic, efficient, and robust mesh generation for large-scale city modeling and simulation

abstract: The concept of creating digital twins, connected digital models of physical systems, is gaining increasing attention for modeling and simulation of whole cities. The basis for building a digital twin of a city is the generation of a 3D city model, often represented as a mesh. Creating and updating such models is a tedious process that requires manual work and considerable effort, especially in the modeling of building geometries. In the current paper, we present a novel algorithm and implementation for automatic, efficient, and robust mesh generation for large-scale city modeling and simulation. The algorithm relies on standard, publicly available data, in particular 2D cadastral maps (building footprints) and 3D point clouds obtained from aerial scanning. The algorithm generates LoD1.2 city models in the form of both triangular surface meshes, suitable for visualisation, and high-quality tetrahedral volume meshes, suitable for simulation. Our tests demonstrate good performance and scaling and indicate good avenues for further optimization based on parallelisation. The long-term goal is a generic digital twin of cities volume mesh generator that provides (nearly) real-time mesh manipulation in LoD2.x.


title: On the computational properties of the Baire Category Theorem

abstract: Computability theory is a discipline in the intersection of computer science and mathematical logic where the fundamental question is: given two mathematical objects X and Y, does X compute Y in principle? In case X and Y are real numbers, Turing's famous 'machine' model provides the standard interpretation of 'computation' for this question. To formalise computation involving (total) abstract objects, Kleene introduced his S1-S9 computation schemes. In turn, Dag Normann and the author have introduced a version of the lambda calculus involving fixed point operators that exactly captures S1-S9 and accommodates partial objects. In this paper, we use this new model to develop the computability theory of various well-known theorems due to Baire and Volterra and related results; these theorems only require basic mathematical notions like continuity, open sets, and density. We show that these theorems due to Baire and Volterra are computationally equivalent from the point of view of our new model, sometimes working in rather tame fragments of Goedel's T.


title: Graph Neural Network Policies and Imitation Learning for Multi-Domain Task-Oriented Dialogues

abstract: Task-oriented dialogue systems are designed to achieve specific goals while conversing with humans. In practice, they may have to handle simultaneously several domains and tasks. The dialogue manager must therefore be able to take into account domain changes and plan over different domains/tasks in order to deal with multidomain dialogues. However, learning with reinforcement in such context becomes difficult because the state-action dimension is larger while the reward signal remains scarce. Our experimental results suggest that structured policies based on graph neural networks combined with different degrees of imitation learning can effectively handle multi-domain dialogues. The reported experiments underline the benefit of structured policies over standard policies.


title: Constrained Deployment Optimization in Integrated Access and Backhaul Networks

abstract: Integrated access and backhaul (IAB) is one of the promising techniques for 5G networks and beyond (6G), in which the same node/hardware is used to provide both backhaul and cellular services in a multi-hop fashion. Due to the sensitivity of the backhaul links with high rate/reliability demands, proper network planning is needed to make the IAB network performing appropriately and as good as possible. In this paper, we study the effect of deployment optimization on the coverage of IAB networks. We concentrate on the cases where, due to either geographical or interference management limitations, unconstrained IAB node placement is not feasible in some areas. To that end, we propose various millimeter wave (mmWave) blocking-aware constrained deployment optimization approaches. Our results indicate that, even with limitations on deployment optimization, network planning boosts the coverage of IAB networks considerably.


title: Deep Spectro-temporal Artifacts for Detecting Synthesized Speech

abstract: The Audio Deep Synthesis Detection (ADD) Challenge has been held to detect generated human-like speech. With our submitted system, this paper provides an overall assessment of track 1 (Low-quality Fake Audio Detection) and track 2 (Partially Fake Audio Detection). In this paper, spectro-temporal artifacts were detected using raw temporal signals, spectral features, as well as deep embedding features. To address track 1, low-quality data augmentation, domain adaptation via finetuning, and various complementary feature information fusion were aggregated in our system. Furthermore, we analyzed the clustering characteristics of subsystems with different features by visualization method and explained the effectiveness of our proposed greedy fusion strategy. As for track 2, frame transition and smoothing were detected using self-supervised learning structure to capture the manipulation of PF attacks in the time domain. We ranked 4th and 5th in track 1 and track 2, respectively.


title: Liouville heat kernel upper bounds at large distances

abstract: We show that the Liouville heat kernel decays fast at large distances. In particular, the Liouville semigroup $T_t$ is $C_0$-Feller, where $C_0$ is the space of real-valued continuous functions on $\mathbb C$ vanishing at infinity.


title: Parametric linearization of skew products

abstract: We establish a linearization criterion for skew products of contractions in any dimension. We prove their smooth or holomorphic parameter dependence. In the smooth setting, we use the language of tame Fr\'echet spaces. We apply our result to the linearization of totally projectively expanding Cantor sets.


title: Rethinking the Event Coding Pipeline with Prompt Entailment

abstract: For monitoring crises, political events are extracted from the news. The large amount of unstructured full-text event descriptions makes a case-by-case analysis unmanageable, particularly for low-resource humanitarian aid organizations. This creates a demand to classify events into event types, a task referred to as event coding. Typically, domain experts craft an event type ontology, annotators label a large dataset and technical experts develop a supervised coding system. In this work, we propose PR-ENT, a new event coding approach that is more flexible and resource-efficient, while maintaining competitive accuracy: first, we extend an event description such as "Military injured two civilians'' by a template, e.g. "People were [Z]" and prompt a pre-trained (cloze) language model to fill the slot Z. Second, we select answer candidates Z* = {"injured'', "hurt"...} by treating the event description as premise and the filled templates as hypothesis in a textual entailment task. This allows domain experts to draft the codebook directly as labeled prompts and interpretable answer candidates. This human-in-the-loop process is guided by our interactive codebook design tool. We evaluate PR-ENT in several robustness checks: perturbing the event description and prompt template, restricting the vocabulary and removing contextual information.


title: EOCSA: Predicting Prognosis of Epithelial Ovarian Cancer with Whole Slide Histopathological Images

abstract: Ovarian cancer is one of the most serious cancers that threaten women around the world. Epithelial ovarian cancer (EOC), as the most commonly seen subtype of ovarian cancer, has rather high mortality rate and poor prognosis among various gynecological cancers. Survival analysis outcome is able to provide treatment advices to doctors. In recent years, with the development of medical imaging technology, survival prediction approaches based on pathological images have been proposed. In this study, we designed a deep framework named EOCSA which analyzes the prognosis of EOC patients based on pathological whole slide images (WSIs). Specifically, we first randomly extracted patches from WSIs and grouped them into multiple clusters. Next, we developed a survival prediction model, named DeepConvAttentionSurv (DCAS), which was able to extract patch-level features, removed less discriminative clusters and predicted the EOC survival precisely. Particularly, channel attention, spatial attention, and neuron attention mechanisms were used to improve the performance of feature extraction. Then patient-level features were generated from our weight calculation method and the survival time was finally estimated using LASSO-Cox model. The proposed EOCSA is efficient and effective in predicting prognosis of EOC and the DCAS ensures more informative and discriminative features can be extracted. As far as we know, our work is the first to analyze the survival of EOC based on WSIs and deep neural network technologies. The experimental results demonstrate that our proposed framework has achieved state-of-the-art performance of 0.980 C-index. The implementation of the approach can be found at https://github.com/RanSuLab/EOCprognosis.


title: Polarized primordial gravitational waves in spatial covariant gravities

abstract: The spatial covariant gravities provide a natural way to including odd-order spatial derivative terms into the gravitational action, which breaks the parity symmetry at gravitational sector. A lot of parity-violating scalar-tensor theories can be mapped to the spatial covariant framework by imposing the unitary gauge. This provides us with a general framework for exploring the parity-violating effects in primordial gravitational waves (PGWs). The main purpose of this paper is to investigate the polarization of PGWs in the spatial covariant gravities and their possible observational effects. To this end, we first construct the approximate analytical solution to the mode function of the PGWs during the slow-roll inflation by using the uniform asymptotic approximation. With the approximate solution, we calculate explicitly the power spectrum and the corresponding circular polarization of the PGWs analytically. It is shown that the new contributions to power spectrum from spatial covariant gravities contain two parts, one from the parity-preserving terms and the other from the parity-violating terms. While the parity-preserving terms can only affect the overall amplitudes of PGWs, the parity-violating terms induce nonzero circular polarization of PGWs, i.e., the left-hand and right-hand polarization modes of GWs have different amplitudes. The observational implications of this nonzero circular polarization is also briefly discussed.


title: Radiative corrections to stop-antistop annihilation into gluons and light quarks

abstract: We present the full one-loop SUSY-QCD corrections to stop-antistop annihilation into gluons and light quarks within the Minimal Supersymmetric Standard Model including Sommerfeld enhancement effects from the exchange of multiple gluons between the incoming particles. These corrections are important as stop (co)annihilation becomes the dominant contribution to the relic density for scenarios with a small mass difference between the neutralino and the stop which are less constrained by current LHC searches and consistent with the observation of a 125 GeV SM-like Higgs boson. We discuss important technical details of our one-loop, real emission, and resummation calculations where we pay particular attention to the cancellation of infrared divergences and the associated application of the dipole formalism for massive initial scalars. The corrections have been implemented in the dark matter precision tool DM@NLO which allows us to study numerically the impact of these corrections on the annihilation cross section. We find that for the chosen reference scenario the dominant correction comes from the Sommerfeld effect and that the pure NLO correction is below 3%. The inclusion of these radiative corrections is still large enough to decrease the relic density by more than 10% and shift the cosmologically preferred parameter region by a few GeV relative to the standard MicrOMEGAs result. Therefore, the inclusion of these corrections is mandatory if the experimental errors are taken as upper and lower bounds of the theory value.


title: Once is Enough: A Light-Weight Cross-Attention for Fast Sentence Pair Modeling

abstract: Transformer-based models have achieved great success on sentence pair modeling tasks, such as answer selection and natural language inference (NLI). These models generally perform cross-attention over input pairs, leading to prohibitive computational costs. Recent studies propose dual-encoder and late interaction architectures for faster computation. However, the balance between the expressive of cross-attention and computation speedup still needs better coordinated. To this end, this paper introduces a novel paradigm MixEncoder for efficient sentence pair modeling. MixEncoder involves a light-weight cross-attention mechanism. It conducts query encoding only once while modeling the query-candidate interaction in parallel. Extensive experiments conducted on four tasks demonstrate that our MixEncoder can speed up sentence pairing by over 113x while achieving comparable performance as the more expensive cross-attention models.


title: Factors of Influence of the Overestimation Bias of Q-Learning

abstract: We study whether the learning rate $\alpha$, the discount factor $\gamma$ and the reward signal $r$ have an influence on the overestimation bias of the Q-Learning algorithm. Our preliminary results in environments which are stochastic and that require the use of neural networks as function approximators, show that all three parameters influence overestimation significantly. By carefully tuning $\alpha$ and $\gamma$, and by using an exponential moving average of $r$ in Q-Learning's temporal difference target, we show that the algorithm can learn value estimates that are more accurate than the ones of several other popular model-free methods that have addressed its overestimation bias in the past.


title: Classical Nucleation Theory for Active Fluid Phase Separation

abstract: Classical nucleation theory (CNT), linking rare nucleation events to the free energy landscape of a growing nucleus, is central to understanding phase-change kinetics in passive fluids. Nucleation in non-equilibrium systems is much harder to describe because there is no free energy, but instead a dynamics-dependent quasi-potential that typically must be found numerically. Here we extend CNT to a class of active phase separating systems governed by a minimal field-theoretic model (Active Model B+). In the small noise and supersaturation limits that CNT assumes, we compute analytically the quasi-potential, and hence nucleation barrier, for liquid-vapor phase separation. Crucially to our results, detailed balance, although broken microscopically by activity, is restored along the instanton trajectory, which in CNT involves the nuclear radius as the sole reaction coordinate.


title: Integrated Graphene Patch Antenna for Communications at THz Frequencies

abstract: Graphene is an attractive material for communications in the THz range due to its ability to support surface plasmon polaritons. This enables a graphene antenna to be smaller in size than its metallic counterpart. In addition, the possibility to control the graphene conductivity during operation by an applied bias leads to the tunability of the resonant frequency of graphene antennas. Graphene-based antennas integrated into transceivers working at THz frequencies may lead to faster and more efficient devices. In this work, we design and simulate a graphene patch antenna that can be integrated into transceivers by through-substrate vias. The tuning of the resonant frequency is also studied by simulations.


title: MFCCA:Multi-Frame Cross-Channel attention for multi-speaker ASR in Multi-party meeting scenario

abstract: Recently cross-channel attention, which better leverages multi-channel signals from microphone array, has shown promising results in the multi-party meeting scenario. Cross-channel attention focuses on either learning global correlations between sequences of different channels or exploiting fine-grained channel-wise information effectively at each time step. Considering the delay of microphone array receiving sound, we propose a multi-frame cross-channel attention, which models cross-channel information between adjacent frames to exploit the complementarity of both frame-wise and channel-wise knowledge. Besides, we also propose a multi-layer convolutional mechanism to fuse the multi-channel output and a channel masking strategy to combat the channel number mismatch problem between training and inference. Experiments on the AliMeeting, a real-world corpus, reveal that our proposed model outperforms single-channel model by 31.7\% and 37.0\% CER reduction on Eval and Test sets. Moreover, with comparable model parameters and training data, our proposed model achieves a new SOTA performance on the AliMeeting corpus, as compared with the top ranking systems in the ICASSP2022 M2MeT challenge, a recently held multi-channel multi-speaker ASR challenge.


title: Virasoro constraints on moduli of sheaves and vertex algebras

abstract: In enumerative geometry, Virasoro constraints were first conjectured in Gromov-Witten theory with many new recent developments in the sheaf theoretic context. In this paper, we rephrase the sheaf-theoretic Virasoro constraints in terms of primary states coming from a natural conformal vector in Joyce's vertex algebra. This shows that Virasoro constraints are preserved under wall-crossing. As an application, we prove the conjectural Virasoro constraints for moduli spaces of torsion-free sheaves on any curve and on surfaces with only $(p,p)$ cohomology classes by reducing the statements to the rank 1 case.

categories: math.AG math-ph math.CO math.KT math.MP math.RT


title: Simulating Structural Plasticity of the Brain more Scalable than Expected

abstract: Structural plasticity of the brain describes the creation of new and the deletion of old synapses over time. Rinke et al. (JPDC 2018) introduced a scalable algorithm that simulates structural plasticity for up to one billion neurons on current hardware using a variant of the Barnes-Hut algorithm. They demonstrate good scalability and prove a runtime complexity of $O(n \log^2 n)$. In this comment paper, we show that with careful consideration of the algorithm and a rigorous proof, the theoretical runtime can even be classified as $O(n \log n)$.


title: Component-Wise Natural Gradient Descent -- An Efficient Neural Network Optimization

abstract: Natural Gradient Descent (NGD) is a second-order neural network training that preconditions the gradient descent with the inverse of the Fisher Information Matrix (FIM). Although NGD provides an efficient preconditioner, it is not practicable due to the expensive computation required when inverting the FIM. This paper proposes a new NGD variant algorithm named Component-Wise Natural Gradient Descent (CW-NGD). CW-NGD is composed of 2 steps. Similar to several existing works, the first step is to consider the FIM matrix as a block-diagonal matrix whose diagonal blocks correspond to the FIM of each layer's weights. In the second step, unique to CW-NGD, we analyze the layer's structure and further decompose the layer's FIM into smaller segments whose derivatives are approximately independent. As a result, individual layers' FIMs are approximated in a block-diagonal form that trivially supports the inversion. The segment decomposition strategy is varied by layer structure. Specifically, we analyze the dense and convolutional layers and design their decomposition strategies appropriately. In an experiment of training a network containing these 2 types of layers, we empirically prove that CW-NGD requires fewer iterations to converge compared to the state-of-the-art first-order and second-order methods.


title: Autopolyploidy, allopolyploidy, and phylogenetic networks with horizontal arcs

abstract: Polyploidization is an evolutionary process by which a species acquires multiple copies of its complete set of chromosomes. The reticulate nature of the signal left behind by it means that phylogenetic networks offer themselves as a framework to reconstruct the evolutionary past of species affected by it. The main strategy for doing this is to first construct a so called multiple-labelled tree and to then somehow derive such a network from it. The following question therefore arises: How much can be said about that past if such a tree is not readily available? By viewing a polyploid dataset as a certain vector which we call a ploidy (level) profile we show that, among other results, there always exists a phylogenetic network in the form of a beaded phylogenetic tree with additional arcs that realizes a given ploidy profile. Intriguingly, the two end vertices of almost all of these additional arcs can be interpreted as having co-existed in time thereby adding biological realism to our network, a feature that is, in general, not enjoyed by phylogenetic networks. In addition, we show that our network may be viewed as a generator of ploidy profile space, a novel concept similar to phylogenetic tree space that we introduce to be able to compare phylogenetic networks that realize one and the same ploidy profile. We illustrate our findings in terms of a publicly available Viola dataset.


title: Effective electric field associated with the electric dipole moment of the electron for TlF^+

abstract: In this article, we have employed relativistic many-body theory to theoretically assess the suitability of TlF+ molecular ion in its ground state for electron electric dipole moment searches. To that end, we have computed values of the effective electric field as well as the molecular permanent electric dipole moment using both configuration interaction and coupled cluster methods with high quality basis sets, followed by an analysis on the role of electron correlation in the considered properties. We find that TlF+ has a large value of effective electric field of about 163 GV/cm, which is about one and a half times larger than the HgF and HgH molecules, which are known to have the largest effective electric fields among non-superheavy systems.


title: GAN You Hear Me? Reclaiming Unconditional Speech Synthesis from Diffusion Models

abstract: We propose AudioStyleGAN (ASGAN), a new generative adversarial network (GAN) for unconditional speech synthesis. As in the StyleGAN family of image synthesis models, ASGAN maps sampled noise to a disentangled latent vector which is then mapped to a sequence of audio features so that signal aliasing is suppressed at every layer. To successfully train ASGAN, we introduce a number of new techniques, including a modification to adaptive discriminator augmentation to probabilistically skip discriminator updates. ASGAN achieves state-of-the-art results in unconditional speech synthesis on the Google Speech Commands dataset. It is also substantially faster than the top-performing diffusion models. Through a design that encourages disentanglement, ASGAN is able to perform voice conversion and speech editing without being explicitly trained to do so. ASGAN demonstrates that GANs are still highly competitive with diffusion models. Code, models, samples: https://github.com/RF5/simple-asgan/.


title: Construction of efficient Schmidt number witnesses for high-dimensional quantum states

abstract: Recent progress in quantum optics has led to setups that are able to prepare high-dimensional quantum states for quantum information processing tasks. As such, it is of importance to benchmark the states generated by these setups in terms of their quantum mechanical properties, such as their Schmidt numbers, i.e., the number of entangled degrees of freedom. In this paper, we develop an iterative algorithm that finds Schmidt number witnesses tailored to the measurements available in specific experimental setups. We then apply the algorithm to find a witness that requires the measurement of a number of density matrix elements that scales linearly with the local dimension of the system. As a concrete example, we apply our construction method to an implementation with photonic temporal modes.


title: Two-dimensional rare-earth Janus 2$\textit{H}$-Gd$\textit{XY}$ ($\textit{X}$,$\textit{Y}$=Cl, Br, I, $\textit{X}$$\neq$$\textit{Y}$) monolayers: Bipolar ferro-magnetic semiconductors with high Curie temperature and large valley polarization

abstract: Two-dimensional (2D) ferromagnetic semiconductors show great interest due to their potential applications for the nanoscale electronic devices. In this work, the Janus 2$H$-Gd$XY$ ($X$, $Y$=Cl, Br, I, $X$$\neq$$Y$) monolayers with rare-earth element Gd (4$f^{7}$+5$d^{1}$) are predicted by the first-principles calculations. Small exfoliation energy of less than 0.25 J/m$^{2}$ and excellent dynamical/thermal stabilities can be confirmed for the Janus 2$H$-Gd$XY$ monolayers, which exhibit the bipolar magnetic semiconductor character with high Curie temperatures above 260 K and large spin-orbit coupling effect, and can be further transformed into the half-semiconductor phase under proper tensile strains (5-6\%). In addition, the in-plane magnetic anisotropy can be observed in the 2$H$-GdICl and 2$H$-GdIBr monolayers. On the contrary, the 2$H$-GdBrCl monolayer exhibits perpendicular magnetic anisotropy character, which originates from the competition between Gd-$p$/$d$ and halogen atom-$p$ orbitals. Calculated valley optical actions of the Janus 2$H$-Gd$XY$ monolayers exhibit distinguished valley-selective circular dichroisms, which is expected to realize the special valley excitation by polarized light. Spontaneously valley-Zeeman effect in the valance band for the Janus 2$H$-Gd$XY$ monolayers induces a giant valley splitting of 60-120 meV, which is also robust against various external biaxial strains. Tunable valley degree of freedom in the Janus 2$H$-Gd$XY$ systems is very necessary for encoding and processing information.


title: Equivariant 3D-Conditional Diffusion Models for Molecular Linker Design

abstract: Fragment-based drug discovery has been an effective paradigm in early-stage drug development. An open challenge in this area is designing linkers between disconnected molecular fragments of interest to obtain chemically-relevant candidate drug molecules. In this work, we propose DiffLinker, an E(3)-equivariant 3D-conditional diffusion model for molecular linker design. Given a set of disconnected fragments, our model places missing atoms in between and designs a molecule incorporating all the initial fragments. Unlike previous approaches that are only able to connect pairs of molecular fragments, our method can link an arbitrary number of fragments. Additionally, the model automatically determines the number of atoms in the linker and its attachment points to the input fragments. We demonstrate that DiffLinker outperforms other methods on the standard datasets generating more diverse and synthetically-accessible molecules. Besides, we experimentally test our method in real-world applications, showing that it can successfully generate valid linkers conditioned on target protein pockets.


title: Topological superconductivity from doping a triplet quantum spin liquid in a flat band system

abstract: We explore superconductivity in strongly interacting electrons on a decorated honeycomb lattice (DHL). An easy-plane ferromagnetic interaction arises from spin-orbit coupling in the Mott insulating phase, which favors a triplet resonance valence bond spin liquid state. Hole doping leads to partial occupation of a flat band and to triplet superconductivity. The order parameter is highly sensitive to the doping level and the interaction parameters, with $p+ip$, $f$ and $p+f$ superconductivity found, as the flat band leads to instabilities in multiple channels. Typically, first order transitions separate different superconducting phases, but a second order transition separates two time reversal symmetry breaking $p+ip$ phases with different Chern numbers ($\nu=0$ and 1). The Majorana edge modes in the topological ($\nu=1$) superconductor are almost localized due to the strong electronic correlations in a system with a flat band at the Fermi level. This suggests that these modes could be useful for topological quantum computing. The `hybrid' $p+f$ state does not require two phase transitions as temperature is lowered. This is because the symmetry of the model is lowered in the $p$-wave phase, allowing arbitrary admixtures of $f$-wave basis functions as overtones. We show that the multiple sites per unit cell of the DHL, and hence multiple bands near the Fermi energy, lead to very different nodal structures in real and reciprocal space. We emphasize that this should be a generic feature of multi-site/multi-band superconductors.


title: RoHNAS: A Neural Architecture Search Framework with Conjoint Optimization for Adversarial Robustness and Hardware Efficiency of Convolutional and Capsule Networks

abstract: Neural Architecture Search (NAS) algorithms aim at finding efficient Deep Neural Network (DNN) architectures for a given application under given system constraints. DNNs are computationally-complex as well as vulnerable to adversarial attacks. In order to address multiple design objectives, we propose RoHNAS, a novel NAS framework that jointly optimizes for adversarial-robustness and hardware-efficiency of DNNs executed on specialized hardware accelerators. Besides the traditional convolutional DNNs, RoHNAS additionally accounts for complex types of DNNs such as Capsule Networks. For reducing the exploration time, RoHNAS analyzes and selects appropriate values of adversarial perturbation for each dataset to employ in the NAS flow. Extensive evaluations on multi - Graphics Processing Unit (GPU) - High Performance Computing (HPC) nodes provide a set of Pareto-optimal solutions, leveraging the tradeoff between the above-discussed design objectives. For example, a Pareto-optimal DNN for the CIFAR-10 dataset exhibits 86.07% accuracy, while having an energy of 38.63 mJ, a memory footprint of 11.85 MiB, and a latency of 4.47 ms.


title: On Furusho's analytic continuation of Drinfeld logarithms

abstract: In the present paper, we establish an analytic continuation of Drinfeld logarithms by using the techniques introduced in [Fur20]. This result can be seen as an analogue of the analytic continuation of the elliptic integrals of the first kind for Drinfeld modules.


title: EnsembleMOT: A Step towards Ensemble Learning of Multiple Object Tracking

abstract: Multiple Object Tracking (MOT) has rapidly progressed in recent years. Existing works tend to design a single tracking algorithm to perform both detection and association. Though ensemble learning has been exploited in many tasks, i.e, classification and object detection, it hasn't been studied in the MOT task, which is mainly caused by its complexity and evaluation metrics. In this paper, we propose a simple but effective ensemble method for MOT, called EnsembleMOT, which merges multiple tracking results from various trackers with spatio-temporal constraints. Meanwhile, several post-processing procedures are applied to filter out abnormal results. Our method is model-independent and doesn't need the learning procedure. What's more, it can easily work in conjunction with other algorithms, e.g., tracklets interpolation. Experiments on the MOT17 dataset demonstrate the effectiveness of the proposed method. Codes are available at https://github.com/dyhBUPT/EnsembleMOT.


title: Zeroth-Order Hard-Thresholding: Gradient Error vs. Expansivity

abstract: $\ell_0$ constrained optimization is prevalent in machine learning, particularly for high-dimensional problems, because it is a fundamental approach to achieve sparse learning. Hard-thresholding gradient descent is a dominant technique to solve this problem. However, first-order gradients of the objective function may be either unavailable or expensive to calculate in a lot of real-world problems, where zeroth-order (ZO) gradients could be a good surrogate. Unfortunately, whether ZO gradients can work with the hard-thresholding operator is still an unsolved problem. To solve this puzzle, in this paper, we focus on the $\ell_0$ constrained black-box stochastic optimization problems, and propose a new stochastic zeroth-order gradient hard-thresholding (SZOHT) algorithm with a general ZO gradient estimator powered by a novel random support sampling. We provide the convergence analysis of SZOHT under standard assumptions. Importantly, we reveal a conflict between the deviation of ZO estimators and the expansivity of the hard-thresholding operator, and provide a theoretical minimal value of the number of random directions in ZO gradients. In addition, we find that the query complexity of SZOHT is independent or weakly dependent on the dimensionality under different settings. Finally, we illustrate the utility of our method on a portfolio optimization problem as well as black-box adversarial attacks.


title: ME-D2N: Multi-Expert Domain Decompositional Network for Cross-Domain Few-Shot Learning

abstract: Recently, Cross-Domain Few-Shot Learning (CD-FSL) which aims at addressing the Few-Shot Learning (FSL) problem across different domains has attracted rising attention. The core challenge of CD-FSL lies in the domain gap between the source and novel target datasets. Though many attempts have been made for CD-FSL without any target data during model training, the huge domain gap makes it still hard for existing CD-FSL methods to achieve very satisfactory results. Alternatively, learning CD-FSL models with few labeled target domain data which is more realistic and promising is advocated in previous work~\cite{fu2021meta}. Thus, in this paper, we stick to this setting and technically contribute a novel Multi-Expert Domain Decompositional Network (ME-D2N). Concretely, to solve the data imbalance problem between the source data with sufficient examples and the auxiliary target data with limited examples, we build our model under the umbrella of multi-expert learning. Two teacher models which can be considered to be experts in their corresponding domain are first trained on the source and the auxiliary target sets, respectively. Then, the knowledge distillation technique is introduced to transfer the knowledge from two teachers to a unified student model. Taking a step further, to help our student model learn knowledge from different domain teachers simultaneously, we further present a novel domain decomposition module that learns to decompose the student model into two domain-related sub parts. This is achieved by a novel domain-specific gate that learns to assign each filter to only one specific domain in a learnable way. Extensive experiments demonstrate the effectiveness of our method. Codes and models are available at https://github.com/lovelyqian/ME-D2N_for_CDFSL.