title: Variations of the SIR model for COVID-19 evolution

abstract: In this work, we discuss the SIR epidemiological model and different variations of it applied to the propagation of the COVID-19 pandemia; we employ the data of the state of Guanajuato and of Mexico. We present some considerations that can improve the predictions made by those models. We consider a time-dependent infection rate, which we adjust to the data. Starting from a linear regime where the populations are much smaller that the country or state population and the population of susceptible (S) can be approximated in convenient units to S approximately 1, we make fits of the parameters. We also consider the case when the susceptible starts departing from 1, for this case we adjust an effective contagion rate. We also explore the ratio of detected populations and the real ones, obtaining that -for the analyzed case it is of approximately 10%. We estimate the number of deaths by making a fit versus the recovered cases, this fit is in first approximation linear, but other powers can give a good agreement. By predictions to past data, we conclude that adaptations of the SIR model can be of great use in describing pandemia's propagation, specially in limited time periods.


title: On counterfactual inference with unobserved confounding

abstract: Given an observational study with $n$ independent but heterogeneous units, our goal is to learn the counterfactual distribution for each unit using only one $p$-dimensional sample per unit containing covariates, interventions, and outcomes. Specifically, we allow for unobserved confounding that introduces statistical biases between interventions and outcomes as well as exacerbates the heterogeneity across units. Modeling the conditional distribution of the outcomes as an exponential family, we reduce learning the unit-level counterfactual distributions to learning $n$ exponential family distributions with heterogeneous parameters and only one sample per distribution. We introduce a convex objective that pools all $n$ samples to jointly learn all $n$ parameter vectors, and provide a unit-wise mean squared error bound that scales linearly with the metric entropy of the parameter space. For example, when the parameters are $s$-sparse linear combination of $k$ known vectors, the error is $O(s\log k/p)$. En route, we derive sufficient conditions for compactly supported distributions to satisfy the logarithmic Sobolev inequality. As an application of the framework, our results enable consistent imputation of sparsely missing covariates.


title: Reconfigurable Intelligent Surface Aided Wireless Sensing for Scene Depth Estimation

abstract: Current scene depth estimation approaches mainly rely on optical sensing, which carries privacy concerns and suffers from estimation ambiguity for distant, shiny, and transparent surfaces/objects. Reconfigurable intelligent surfaces (RISs) provide a path for employing a massive number of antennas using low-cost and energy-efficient architectures. This has the potential for realizing RIS-aided wireless sensing with high spatial resolution. In this paper, we propose to employ RIS-aided wireless sensing systems for scene depth estimation. We develop a comprehensive framework for building accurate depth maps using RIS-aided mmWave sensing systems. In this framework, we propose a new RIS interaction codebook capable of creating a sensing grid of reflected beams that meets the desirable characteristics of efficient scene depth map construction. Using the designed codebook, the received signals are processed to build high-resolution depth maps. Simulation results compare the proposed solution against RGB-based approaches and highlight the promise of adopting RIS-aided mmWave sensing in scene depth perception.


title: Molecular $P_{\psi}$ pentaquarks from light-meson exchange saturation

abstract: Theoretical predictions for the spectrum of heavy meson-baryon bound states are a fundamental tool for disentangling the nature of the different pentaquark states that have been observed in experimental facilities. Here we explore this spectrum in a phenomenological model that describes the heavy meson-baryon interaction in terms of a contact-range interaction, where the coupling strength is saturated by the exchange of light scalar and vector mesons, i.e. $\sigma$, $\rho$ and $\omega$ exchanges. Saturation determines the couplings modulo an unknown proportionality constant that can be calibrated from a molecular candidate. If we use the $P_{\psi}^N(4312)$ as input, we predict a series of molecular pentaquarks including the $P_{\psi}^N(4440)$ and $P_{\psi}^N(4457)$, the recent $P_{\psi s}^{\Lambda}(4338)$ and the $P_{\psi s}^{\Lambda}(4459)$.


title: A Homogeneous Second-Order Descent Method for Nonconvex Optimization

abstract: In this paper, we introduce a Homogeneous Second-Order Descent Method (HSODM) using the homogenized quadratic approximation to the original function. The merit of homogenization is that only the leftmost eigenvector of a gradient-Hessian integrated matrix is computed at each iteration. Therefore, the algorithm is a single-loop method that does not need to switch to other sophisticated algorithms and is easy to implement. We show that HSODM has a global convergence rate of $O(\epsilon^{-3/2})$ to find an $\epsilon$-approximate second-order stationary point, and has a local quadratic convergence rate under the standard assumptions. The numerical results demonstrate the advantage of the proposed method over other second-order methods.


title: Is Style All You Need? Dependencies Between Emotion and GST-based Speaker Recognition

abstract: In this work, we study the hypothesis that speaker identity embeddings extracted from speech samples may be used for detection and classification of emotion. In particular, we show that emotions can be effectively identified by learning speaker identities by use of a 1-D Triplet Convolutional Neural Network (CNN) & Global Style Token (GST) scheme (e.g., DeepTalk Network) and reusing the trained speaker recognition model weights to generate features in the emotion classification domain. The automatic speaker recognition (ASR) network is trained with VoxCeleb1, VoxCeleb2, and Librispeech datasets with a triplet training loss function using speaker identity labels. Using an Support Vector Machine (SVM) classifier, we map speaker identity embeddings into discrete emotion categories from the CREMA-D, IEMOCAP, and MSP-Podcast datasets. On the task of speech emotion detection, we obtain 80.8% ACC with acted emotion samples from CREMA-D, 81.2% ACC with semi-natural emotion samples in IEMOCAP, and 66.9% ACC with natural emotion samples in MSP-Podcast. We also propose a novel two-stage hierarchical classifier (HC) approach which demonstrates +2% ACC improvement on CREMA-D emotion samples. Through this work, we seek to convey the importance of holistically modeling intra-user variation within audio samples


title: Laser and Diffusion Driven Optimal Discrimination of Similar Quantum Systems in Resonator

abstract: A method for solving the problem of efficient population transfer from the ground to some excited state by available technical means (varying resonator length) is proposed. We consider a mixture of similar quantum systems distributed in a stationary gas flow in the resonator with variable resonator length, which implements tailored laser field close to the optimal one. In difference from previous works, in this work piezoelectric transducer (PZT; or actuator) is used as mean of control to manipulate variable resonator length. The external actions are optimized to selectively prepare different stationary states of different species which are then separated using their diffusion with rates which differ due to different masses. This system provides an example of the general problem of optimizing states of distributed systems with stationary gas flow with diffusion.


title: Superlinear Convergence of an Interior Point Algorithm on Linear Semi-definite Feasibility Problems with Application to Linear Matrix Inequalities

abstract: In the literature, besides the assumption of strict complementarity, superlinear convergence of implementable polynomial-time interior point algorithms using known search directions, namely, the HKM direction, its dual or the NT direction, to solve semi-definite programs (SDPs) is shown by (i) assuming that the given SDP is nondegenerate and making modifications to these algorithms [10], or (ii) considering special classes of SDPs, such as the class of linear semi-definite feasibility problems (LSDFPs) and requiring the initial iterate to the algorithm to satisfy certain conditions [26, 27]. Otherwise, these algorithms are not easy to implement even though they are shown to have polynomial iteration complexities and superlinear convergence [14]. The conditions in [26, 27] that the initial iterate to the algorithm is required to satisfy to have superlinear convergence when solving LSDFPs however are not practical. In this paper, we propose a practical initial iterate to an implementable infeasible interior point algorithm that guarantees superlinear convergence when the algorithm is used to solve the homogeneous feasibility model of an LSDFP.


title: Maximal disjoint Schubert cycles in rational homogeneous varieties

abstract: In this paper we study properties of the Chow ring of rational homogeneous varieties of classical type, more concretely, effective zero divisors of low codimension, and a related invariant called effective good divisibility. This information is then used to study the question of (non)existence of nonconstant maps among these varieties, generalizing previous results for projective spaces and Grassmannians.


title: A Low-Shot Object Counting Network With Iterative Prototype Adaptation

abstract: We consider low-shot counting of arbitrary semantic categories in the image using only few annotated exemplars (few-shot) or no exemplars (no-shot). The standard few-shot pipeline follows extraction of appearance queries from exemplars and matching them with image features to infer the object counts. Existing methods extract queries by feature pooling which neglects the shape information (e.g., size and aspect) and leads to a reduced object localization accuracy and count estimates. We propose a Low-shot Object Counting network with iterative prototype Adaptation (LOCA). Our main contribution is the new object prototype extraction module, which iteratively fuses the exemplar shape and appearance information with image features. The module is easily adapted to zero-shot scenarios, enabling LOCA to cover the entire spectrum of low-shot counting problems. LOCA outperforms all recent state-of-the-art methods on FSC147 benchmark by 20-30% in RMSE on one-shot and few-shot and achieves state-of-the-art on zero-shot scenarios, while demonstrating better generalization capabilities.


title: Gravitational waves and tadpole resummation: Efficient and easy convergence of finite temperature QFT

abstract: We demonstrate analytically and numerically that "optimized partial dressing" (OPD) thermal mass resummation, which uses gap equation solutions inserted into the tadpole, efficiently tames finite-temperature perturbation theory calculations of the effective thermal potential, without necessitating use of the high-temperature approximation. An analytical estimate of the scale dependence for OPD resummation, standard Parwani resummation (Daisy resummation), and dimensional reduction shows that OPD has similar scale dependence to dimensional reduction, greatly improving Parwani resummation. We also elucidate how to construct and solve the gap equation for realistic numerical calculations, and demonstrate OPD's improved accuracy for a toy scalar model. OPD's improved accuracy is most physically significant when the high-temperature approximation breaks down, rendering dimensional reduction unusable and Parwani resummation highly inaccurate, with the latter underestimating the maximal gravitational wave amplitude for the model by 2 orders of magnitude compared to OPD. Our work highlights the need to bring theoretical uncertainties under control even when analyzing broad features of a model. Given the simplicity of the OPD compared to two-loop dimensional reduction, as well as the ease with which this scheme handles departures from the high-temperature expansion, we argue this scheme has great potential in analyzing the parameter space of realistic beyond the Standard Model models.


title: Clustering phenomena in low dimensions for a boundary Yamabe problem

abstract: We consider the classical geometric problem of prescribing the scalar and boundary mean curvatures via conformal deformation of the metric on a $n-$dimensional compact Riemannian manifold. We deal with the case of negative scalar curvature and positive boundary mean curvature. It is known that if $n=3$ all the blow-up points are isolated and simple. In this work we prove that, for a linear perturbation, this is not true anymore in low dimensions $4\leq n\leq 7$. In particular, we construct a solution with a clustering blow-up boundary point (i.e. non-isolated), which is non-umbilic and is a local minimizer of the norm of the trace-free second fundamental form of the boundary.


title: Lozenge Tilings of Hexagons with Intrusions I: Generalized Intrusion

abstract: MacMahon's classical theorem on the number of boxed plane partitions has been generalized in several directions. One way to generalize the theorem is to view boxed plane partitions as lozenge tilings of a hexagonal region and then generalize it by making some holes in the region and counting its tilings. In this paper, we provide new regions whose numbers of lozenges tilings are given by simple product formulas. The regions we consider can be obtained from hexagons by removing structures called intrusions. In fact, we show that the tiling generating functions of those regions under certain weights are given by similar formulas. These give the $q$-analogue of the enumeration results.


title: A Synchronous, Reservation Based Medium Access Control Protocol for Multihop Wireless Networks

abstract: We describe a new synchronous and distributed medium access control (MAC) protocol for multihop wireless networks that provides bandwidth guarantees to unicast connections. Our MAC protocol is based on a slotted time division multiple access (TDMA) architecture, with a multi-mini-slotted signaling phase scheduling data transmissions over slots in the following data phase. Resolving contentions at the beginning of a frame allows for effective utilization of bandwidth. Our protocol essentially combines the benefits of TDMA architecture with the distributed reservation mechanism of IEEE 802.11 MAC protocol, thereby performing well even at high loads. We implement a two-way handshake before each data slot to avoid deadlocks, a phenomena that plagues 802.11. Through theoretical analysis, we derive the system throughput achieved by our MAC protocol. We implemented our MAC protocol into ns-2 simulator, and demonstrate its vast superiority to IEEE 802.11 and a synchronous MAC protocol CATA through extensive simulations.


title: Impact of combining human and analytics feedback on students' engagement with, and performance in, reflective writing tasks

abstract: Reflective writing is part of many higher education courses across the globe. It is often considered a challenging task for students as it requires self-regulated learning skills to appropriately plan, timely engage and deeply reflect on learning experiences. Despite an advance in writing analytics and the pervasiveness of human feedback aimed to support student reflections, little is known about how to integrate feedback from humans and analytics to improve students' learning engagement and performance in reflective writing tasks. This study proposes a personalised behavioural feedback intervention based on students' writing engagement analytics utilising time-series analysis of digital traces from a ubiquitous online word processing platform. In a semester-long experimental study involving 81 postgraduate students, its impact on learning engagement and performance was studied. The results showed that the intervention cohort engaged statistically significantly more in their reflective writing task after receiving the combined feedback compared to the control cohort which only received human feedback on their reflective writing content. Further analyses revealed that the intervention cohort reflected more regularly at the weekly level, the regularity of weekly reflection led to better performance grades, and the impact on students with low self-regulated learning skills was higher. This study emphasizes the powerful benefits of implementing combined feedback approaches in which the strengths of analytics and human feedback are synthesized to improve student engagement and performance. Further research should explore the long-term sustainability of the observed effects and their validity in other contexts.


title: Jump-preserving polynomial interpolation in non-manifold polyhedra

abstract: We construct a piecewise-polynomial interpolant $u \mapsto \Pi u$ for functions $u:\Omega \setminus \Gamma \to \mathbb{R}$, where $\Omega \subset \mathbb{R}^d$ is a Lipschitz polyhedron and $\Gamma \subset \Omega$ is a possibly non-manifold $(d-1)$-dimensional hypersurface. This interpolant enjoys approximation properties in relevant Sobolev norms, as well as a set of additional algebraic properties, namely, $\Pi^2 = \Pi$, and $\Pi$ preserves homogeneous boundary values and jumps of its argument on $\Gamma$. As an application, we obtain a bounded discrete right-inverse of the "jump" operator across $\Gamma$, and an error estimate for a Galerkin scheme to solve a second-order elliptic PDE in $\Omega$ with a prescribed jump across $\Gamma$.


title: On Energy Efficiency and Fairness Maximization in RIS-Assisted MU-MISO mmWave Communications

abstract: Reconfigurable intelligent surfaces (RISs) are considered to be a promising solution to overcome the blockage issue in the millimeter-wave (mmWave) band. Energy efficiency is an important performance metric in mmWave systems with a large number of antennas. However, due to the severe path loss in mmWave systems, resource allocation algorithms tend to allocate most of the resources for the benefit of the users with higher channel gains. In this paper, we propose a lexicographic-based approach to find the optimal power allocation, RIS phase shift matrix, and analog precoders that maximize both energy efficiency and user fairness. We solve the corresponding multi-objective optimization problem in two stages. In the first stage, we maximize the energy efficiency, and in the second stage we maximize the fairness subject to a minimum energy efficiency constraint. We propose an alternating optimization procedure to solve the optimization problem in each stage. The optimal power allocation is found using Dinkelbach's method in the first stage and using convex optimization techniques in the second stage, the RIS phase shift matrix is found using a gradient ascent algorithm, and the analog precoder is determined using beam alignment. Numerical results show that the proposed algorithm can achieve an excellent trade-off between the energy efficiency and fairness by boosting the minimum weighted rate with a minor and controllable reduction in the energy efficiency.


title: Ultrafast crystallization and sintering of Li1.5Al0.5Ge1.5(PO4)3 glass and its impact on ion conduction

abstract: Li1.5Al0.5Ge1.5(PO4)3 (LAGP) is among the most promising solid electrolytes for the next generation all-solid-state lithium batteries. However, preparing LAGP electrolytes is timeand energy-intensive. In this work, LAGP glassy powders were sintered and crystallized in 180 seconds by ultrafast high-temperature sintering (UHS) under conditions attractive for continuous industrial processes (i.e., ambient pressure and atmosphere). The fast heating rates characteristic of UHS significantly delay crystallization, potentially decoupling crystallization and sintering. Furthermore, EIS characterizations reveal that LAGP sintered and crystallized by UHS has an ionic conductivity of 1.15 10-4 S/cm, slightly lower than conventionally annealed samples (1.75 10-4 S/cm). The lower conductivity can be attributed to poorer intergrain contact. To overcome this issue, additives such as B2O3 and Li3BO3 are used, resulting in 2 and 5 times higher grain boundary conductivity for LAGP+1 wt B2O3 and LAGP+1 wt Li3BO3, respectively, compared to LAGP. Overall, this work provides insights into unraveling the impact of UHS sintering on the LAGP Li+ conduction mechanism.


title: Modification of three-magnon splitting in a flexed magnetic vortex

abstract: We present an experimental and numerical study of three-magnon splitting in a micrometer-sized magnetic disk with the vortex state strongly deformed by static in-plane magnetic fields. Excited with a large enough power at frequency $f_\mathrm{RF}$, the primary radial magnon modes of a cylindrical magnetic vortex can decay into secondary azimuthal modes via spontaneous three-magnon splitting. This nonlinear process exhibits selection rules leading to well-defined and distinct frequencies $f_\mathrm{RF}/2\pm \Delta f$ of the secondary modes. Here, we demonstrate that three-magnon splitting in vortices can be significantly modified by deforming the magnetic vortex with in-plane magnetic fields, leading to a much richer three-magnon response. We find that, with increasing field, an additional class of secondary modes is excited which are localized to the highly-flexed regions adjacent to the displaced vortex core. While these modes satisfy the same selection rules of three-magnon splitting, they exhibit a much lower three-magnon threshold power compared to regular secondary modes of a centered vortex. The applied static magnetic fields are small ($\simeq$ 10 mT), providing an effective parameter to control the nonlinear spectral response of confined vortices. Our work expands the understanding of nonlinear magnon dynamics in vortices and advertises these for potential neuromorphic applications based on magnons.


title: Perona: Robust Infrastructure Fingerprinting for Resource-Efficient Big Data Analytics

abstract: Choosing a good resource configuration for big data analytics applications can be challenging, especially in cloud environments. Automated approaches are desirable as poor decisions can reduce performance and raise costs. The majority of existing automated approaches either build performance models from previous workload executions or conduct iterative resource configuration profiling until a near-optimal solution has been found. In doing so, they only obtain an implicit understanding of the underlying infrastructure, which is difficult to transfer to alternative infrastructures and, thus, profiling and modeling insights are not sustained beyond very specific situations. We present Perona, a novel approach to robust infrastructure fingerprinting for usage in the context of big data analytics. Perona employs common sets and configurations of benchmarking tools for target resources, so that resulting benchmark metrics are directly comparable and ranking is enabled. Insignificant benchmark metrics are discarded by learning a low-dimensional representation of the input metric vector, and previous benchmark executions are taken into consideration for context-awareness as well, allowing to detect resource degradation. We evaluate our approach both on data gathered from our own experiments as well as within related works for resource configuration optimization, demonstrating that Perona captures the characteristics from benchmark runs in a compact manner and produces representations that can be used directly.


title: When to Use What: An In-Depth Comparative Empirical Analysis of OpenIE Systems for Downstream Applications

abstract: Open Information Extraction (OpenIE) has been used in the pipelines of various NLP tasks. Unfortunately, there is no clear consensus on which models to use in which tasks. Muddying things further is the lack of comparisons that take differing training sets into account. In this paper, we present an application-focused empirical survey of neural OpenIE models, training sets, and benchmarks in an effort to help users choose the most suitable OpenIE systems for their applications. We find that the different assumptions made by different models and datasets have a statistically significant effect on performance, making it important to choose the most appropriate model for one's applications. We demonstrate the applicability of our recommendations on a downstream Complex QA application.


title: CorruptEncoder: Data Poisoning based Backdoor Attacks to Contrastive Learning

abstract: Contrastive learning (CL) pre-trains general-purpose encoders using an unlabeled pre-training dataset, which consists of images or image-text pairs. CL is vulnerable to data poisoning based backdoor attacks (DPBAs), in which an attacker injects poisoned inputs into the pre-training dataset so the encoder is backdoored. However, existing DPBAs achieve limited effectiveness. In this work, we take the first step to analyze the limitations of existing backdoor attacks and propose new DPBAs called CorruptEncoder to CL. CorruptEncoder introduces a new attack strategy to create poisoned inputs and uses a theory-guided method to maximize attack effectiveness. Our experiments show that CorruptEncoder substantially outperforms existing DPBAs. In particular, CorruptEncoder is the first DPBA that achieves more than 90% attack success rates with only a few (3) reference images and a small poisoning ratio 0.5%. Moreover, we also propose a defense, called localized cropping, to defend against DPBAs. Our results show that our defense can reduce the effectiveness of DPBAs, but it sacrifices the utility of the encoder, highlighting the need for new defenses.


title: Viscosity of pure-glue QCD from the lattice

abstract: We calculate shear viscosity and bulk viscosity in SU(3) gauge theory on the lattice at $1.5 \,T_c$. The viscosities are extracted via a Kubo formula from the reconstructed spectral function which we determine from the Euclidean-time dependence of the corresponding channel of the energy-momentum tensor correlators. We obtain unprecedented precision for the correlators by applying gradient flow and blocking methods. The correlators are extrapolated to the continuum and then to zero flow time. To extract the viscosities we fit theoretically inspired models to the lattice data and crosscheck the fit results using the Backus Gilbert method. The final estimates for shear and bulk viscosity are $\eta/s = 0.15-0.48$ and $\zeta/s = 0.017-0.059$.


title: Loop Current influence on the connectivity of the West Florida Shelf and impacts on red tide events

abstract: We investigate the influence of the Loop Current (LC) on the connectivity of the Gulf of Mexico, with a focus on the West Florida Shelf (WFS), using in situ trajectories from satellite-tracked drifting buoys in the Gulf of Mexico (GoM). We subset the dataset into two groups, Loop Current extended and retracted phases, that are used to construct two Markov Chains representing the distinct underlying dynamics during those two periods. The LC phases were found to impact and modify substantively the general connectivity of the GoM. Additionally, we highlight the presence of almost-invariant regions, where particles tend to remain for an extended period, on the WFS when the LC is extended. Those regions are bounded by a previously identified Cross-Shelf Transport Barrier and correspond to records of high-density areas of Karenia Brevis, a dinoflagellate responsible for red tides. Finally, we show that Markov Chain modeling could help forecast harmful algae blooms by using the devastating 2017 red tide event as a test case. The development phase on the WFS and its further propagation to Florida's east coast ecosystems is presented.


title: Response functions as a new concept to study local dynamics in traffic networks

abstract: Vehicle velocities in neighbouring road sections are correlated with memory effects. We explore the response of the velocities in the sequence of sections to a congestion in a given section and its dynamic characteristics. To this end, we transfer the concept of response functions from previous applications in finance to traffic systems. The dynamical characteristics are of particular interest. We identify two phases, a phase of transient response and a phase of long-term response. The transient response is pronounced when considering the backward propagation of heavy congestions but almost vanishes for forward propagation. For each response phase, we find a linear relation between the velocity response and the congestion correlator, implying that the correlation of congestion is most likely the cause for the velocity response. We also construct a susceptible-decelerated-withdrawing model mathematically inspired by the susceptible-infectious-recovered (SIR) model in epidemiology to describe the transient response. We find that the heavy congestion on a section propagates forward and backward at a similar rate, but the forward sections are more likely to recover from the effect of heavy congestion than the backward sections.


title: Temporal Modeling Matters: A Novel Temporal Emotional Modeling Approach for Speech Emotion Recognition

abstract: Speech emotion recognition (SER) plays a vital role in improving the interactions between humans and machines by inferring human emotion and affective states from speech signals. Whereas recent works primarily focus on mining spatiotemporal information from hand-crafted features, we explore how to model the temporal patterns of speech emotions from dynamic temporal scales. Towards that goal, we introduce a novel temporal emotional modeling approach for SER, termed Temporal-aware bI-direction Multi-scale Network (TIM-Net), which learns multi-scale contextual affective representations from various time scales. Specifically, TIM-Net first employs temporal-aware blocks to learn temporal affective representation, then integrates complementary information from the past and the future to enrich contextual representations, and finally, fuses multiple time scale features for better adaptation to the emotional variation. Extensive experimental results on six benchmark SER datasets demonstrate the superior performance of TIM-Net, gaining 2.34% and 2.61% improvements of the average UAR and WAR over the second-best on each corpus. The source code is available at https://github.com/Jiaxin-Ye/TIM-Net_SER.


title: Build generally reusable agent-environment interaction models

abstract: This paper tackles the problem of how to pre-train a model and make it generally reusable backbones for downstream task learning. In pre-training, we propose a method that builds an agent-environment interaction model by learning domain invariant successor features from the agent's vast experiences covering various tasks, then discretize them into behavior prototypes which result in an embodied set structure. To make the model generally reusable for downstream task learning, we propose (1) embodied feature projection that retains previous knowledge by projecting the new task's observation-action pair to the embodied set structure and (2) projected Bellman updates which add learning plasticity for the new task setting. We provide preliminary results that show downstream task learning based on a pre-trained embodied set structure can handle unseen changes in task objectives, environmental dynamics and sensor modalities.


title: Levitated Optomechanics with Meta-Atoms

abstract: We propose to introduce additional control in levitated optomechanics by trapping a meta-atom, i.e. a subwavelength and high-permittivity dielectric particle supporting Mie resonances. In particular, we theoretically demonstrate that optical levitation and center-of-mass ground-state cooling of silicon nanoparticles in vacuum is not only experimentally feasible but it offers enhanced performance over widely used silica particles, in terms of both trap frequency and trap depth. Moreover, we show that, by adjusting the detuning of the trapping laser with respect to the particle's resonance, the sign of the polarizability becomes negative, enabling levitation in the minimum of laser intensity e.g. at the nodes of a standing wave. The latter opens the door to trapping nanoparticles in the optical near-field combining red and blue-detuned frequencies, in analogy to two-level atoms, which is of interest for generating strong coupling to photonic nanostructures and short-distance force sensing.


title: Newtonian Gravity on an N-Sphere

abstract: We consider some elementary features of Newtonian gravity, or electrostatics, as defined on an N-sphere. In particular, we present and discuss "the shell theorem" for this system.


title: Multilingual Speech Emotion Recognition With Multi-Gating Mechanism and Neural Architecture Search

abstract: Speech emotion recognition (SER) classifies audio into emotion categories such as Happy, Angry, Fear, Disgust and Neutral. While Speech Emotion Recognition (SER) is a common application for popular languages, it continues to be a problem for low-resourced languages, i.e., languages with no pretrained speech-to-text recognition models. This paper firstly proposes a language-specific model that extract emotional information from multiple pre-trained speech models, and then designs a multi-domain model that simultaneously performs SER for various languages. Our multidomain model employs a multi-gating mechanism to generate unique weighted feature combination for each language, and also searches for specific neural network structure for each language through a neural architecture search module. In addition, we introduce a contrastive auxiliary loss to build more separable representations for audio data. Our experiments show that our model raises the state-of-the-art accuracy by 3% for German and 14.3% for French.


title: Exploiting Contrastive Learning and Numerical Evidence for Confusing Legal Judgment Prediction

abstract: Given the fact description text of a legal case, legal judgment prediction (LJP) aims to predict the case's charge, law article and penalty term. A core problem of LJP is how to distinguish confusing legal cases, where only subtle text differences exist. Previous studies fail to distinguish different classification errors with a standard cross-entropy classification loss, and ignore the numbers in the fact description for predicting the term of penalty. To tackle these issues, in this work, first, we propose a moco-based supervised contrastive learning to learn distinguishable representations, and explore the best strategy to construct positive example pairs to benefit all three subtasks of LJP simultaneously. Second, in order to exploit the numbers in legal cases for predicting the penalty terms of certain cases, we further enhance the representation of the fact description with extracted crime amounts which are encoded by a pre-trained numeracy model. Extensive experiments on public benchmarks show that the proposed method achieves new state-of-the-art results, especially on confusing legal cases. Ablation studies also demonstrate the effectiveness of each component.


title: Geometrical Penrose Tilings are characterized by their 1-atlas

abstract: Rhombus Penrose tilings are tilings of the plane by two decorated rhombi such that the decoration match at the junction between two tiles (like in a jigsaw puzzle). In dynamical terms, they form a tiling space of finite type. If we remove the decorations, we get, by definition, a sofic tiling space that we here call geometrical Penrose tilings. Here, we show how to compute the patterns of a given size which appear in these tilings by two different method: one based on the substitutive structure of the Penrose tilings and the other on their definition by the cut and projection method. We use this to prove that the geometrical Penrose tilings are characterized by a small set of patterns called vertex-atlas, i.e., they form a tiling space of finite type. Though considered as folk, no complete proof of this result has been published, to our knowledge.


title: Kinks in higher-order polynomial models

abstract: We consider a family of field-theoretic models with a real scalar field in (1+1)-dimensional space-time. The field dynamics in each model is determined by a polynomial potential with two degenerate minima. We obtain exact general formulas for kink solutions with power-law asymptotic behavior. We also write out formulas for the asymptotics of all found kinks. In addition, we analyze some other properties of the obtained kinks: stability potentials, zero modes, positions of the centers of mass.


title: Advances in ultrafast plasmonics

abstract: In the past twenty years, we have reached a broad understanding of many light-driven phenomena in nanoscale systems. The temporal dynamics of the excited states are instead quite challenging to explore, and, at the same time, crucial to study for understanding the origin of fundamental physical and chemical processes. In this review we examine the current state and prospects of ultrafast phenomena driven by plasmons both from a fundamental and applied point of view. This research area is referred to as ultrafast plasmonics and represents an outstanding playground to tailor and control fast optical and electronic processes at the nanoscale, such as ultrafast optical switching, single photon emission and strong coupling interactions to tailor photochemical reactions. Here, we provide an overview of the field, and describe the methodologies to monitor and control nanoscale phenomena with plasmons at ultrafast timescales in terms of both modeling and experimental characterization. Various directions are showcased, among others recent advances in ultrafast plasmon-driven chemistry and multi-functional plasmonics, in which charge, spin, and lattice degrees of freedom are exploited to provide active control of the optical and electronic properties of nanoscale materials. As the focus shifts to the development of practical devices, such as all-optical transistors, we also emphasize new materials and applications in ultrafast plasmonics and highlight recent development in the relativistic realm. The latter is a promising research field with potential applications in fusion research or particle and light sources providing properties such as attosecond duration.

categories: physics.optics cond-mat.mes-hall cond-mat.mtrl-sci physics.app-ph quant-ph


title: Exponential ergodicity of stochastic heat equations with H\"older coefficients

abstract: We investigate the stochastic heat equation driven by space-time white noise defined on an abstract Hilbert space, assuming that the drift and diffusion coefficients are both merely H\"older continuous. Random field SPDEs are covered as special examples. We give the first proof that there exists a unique in law mild solution when the diffusion coefficient is $\beta$ - H\"older continuous for $\beta>\frac{3}{4}$ and uniformly non-degenerate, and that the drift is locally H\"older continuous. Meanwhile, assuming the existence of a suitable Lyapunov function for the SPDE, we prove that the solution converges exponentially fast to the unique invariant measure with respect to a typical Wasserstein distance. Our technique generalizes when the SPDE has a Burgers type non-linearity $(-A)^{\vartheta}F(X_t)$ for any $\vartheta\in(0,1)$, where $F$ is $\vartheta+\epsilon$- H\"older continuous and has linear growth. For $\vartheta\in(\frac{1}{2},1)$ this result is new even in the case of additive noise.


title: Neural Bayesian Network Understudy

abstract: Bayesian Networks may be appealing for clinical decision-making due to their inclusion of causal knowledge, but their practical adoption remains limited as a result of their inability to deal with unstructured data. While neural networks do not have this limitation, they are not interpretable and are inherently unable to deal with causal structure in the input space. Our goal is to build neural networks that combine the advantages of both approaches. Motivated by the perspective to inject causal knowledge while training such neural networks, this work presents initial steps in that direction. We demonstrate how a neural network can be trained to output conditional probabilities, providing approximately the same functionality as a Bayesian Network. Additionally, we propose two training strategies that allow encoding the independence relations inferred from a given causal structure into the neural network. We present initial results in a proof-of-concept setting, showing that the neural model acts as an understudy to its Bayesian Network counterpart, approximating its probabilistic and causal properties.


title: Artificial Intelligence for Automatic Detection and Classification Disease on the X-Ray Images

abstract: Detecting and classifying diseases using X-ray images is one of the more challenging core tasks in the medical and research world. Due to the recent high interest in radiological images and AI, early detection of diseases in X-ray images has become notably more essential to prevent further spreading and flatten the curve. Innovations and revolutions of Computer Vision with Deep learning methods offer great promise for fast and accurate diagnosis of screening and detection from chest X-ray images (CXR). This work presents rapid detection of diseases in the lung using the efficient Deep learning pre-trained RepVGG algorithm for deep feature extraction and classification. We used X-ray images as an example to show the model's efficiency. To perform this task, we classify X-Ray images into Covid-19, Pneumonia, and Normal X-Ray images. Employ ROI object to improve the detection accuracy for lung extraction, followed by data pre-processing and augmentation. We are applying Artificial Intelligence technology for automatic highlighted detection of affected areas of people's lungs. Based on the X-Ray images, an algorithm was developed that classifies X-Ray images with height accuracy and power faster thanks to the architecture transformation of the model. We compared deep learning frameworks' accuracy and detection of disease. The study shows the high power of deep learning methods for X-ray images based on COVID-19 detection utilizing chest X-rays. The proposed framework offers better diagnostic accuracy by comparing popular deep learning models, i.e., VGG, ResNet50, inceptionV3, DenseNet, and InceptionResnetV2.


title: PhysiQ: Off-site Quality Assessment of Exercise in Physical Therapy

abstract: Physical therapy (PT) is crucial for patients to restore and maintain mobility, function, and well-being. Many on-site activities and body exercises are performed under the supervision of therapists or clinicians. However, the postures of some exercises at home cannot be performed accurately due to the lack of supervision, quality assessment, and self-correction. Therefore, in this paper, we design a new framework, PhysiQ, that continuously tracks and quantitatively measures people's off-site exercise activity through passive sensory detection. In the framework, we create a novel multi-task spatio-temporal Siamese Neural Network that measures the absolute quality through classification and relative quality based on an individual's PT progress through similarity comparison. PhysiQ digitizes and evaluates exercises in three different metrics: range of motions, stability, and repetition.


title: Online Phase Reconstruction via DNN-based Phase Differences Estimation

abstract: This paper presents a two-stage online phase reconstruction framework using causal deep neural networks (DNNs). Phase reconstruction is a task of recovering phase of the short-time Fourier transform (STFT) coefficients only from the corresponding magnitude. However, phase is sensitive to waveform shifts and not easy to estimate from the magnitude even with a DNN. To overcome this problem, we propose to use DNNs for estimating differences of phase between adjacent time-frequency bins. We show that convolutional neural networks are suitable for phase difference estimation, according to the theoretical relation between partial derivatives of STFT phase and magnitude. The estimated phase differences are used for reconstructing phase by solving a weighted least squares problem in a frame-by-frame manner. In contrast to existing DNN-based phase reconstruction methods, the proposed framework is causal and does not require any iterative procedure. The experiments showed that the proposed method outperforms existing online methods and a DNN-based method for phase reconstruction.


title: Scene-to-Patch Earth Observation: Multiple Instance Learning for Land Cover Classification

abstract: Land cover classification (LCC), and monitoring how land use changes over time, is an important process in climate change mitigation and adaptation. Existing approaches that use machine learning with Earth observation data for LCC rely on fully-annotated and segmented datasets. Creating these datasets requires a large amount of effort, and a lack of suitable datasets has become an obstacle in scaling the use of LCC. In this study, we propose Scene-to-Patch models: an alternative LCC approach utilising Multiple Instance Learning (MIL) that requires only high-level scene labels. This enables much faster development of new datasets whilst still providing segmentation through patch-level predictions, ultimately increasing the accessibility of using LCC for different scenarios. On the DeepGlobe-LCC dataset, our approach outperforms non-MIL baselines on both scene- and patch-level prediction. This work provides the foundation for expanding the use of LCC in climate change mitigation methods for technology, government, and academia.


title: 3D Cascade RCNN: High Quality Object Detection in Point Clouds

abstract: Recent progress on 2D object detection has featured Cascade RCNN, which capitalizes on a sequence of cascade detectors to progressively improve proposal quality, towards high-quality object detection. However, there has not been evidence in support of building such cascade structures for 3D object detection, a challenging detection scenario with highly sparse LiDAR point clouds. In this work, we present a simple yet effective cascade architecture, named 3D Cascade RCNN, that allocates multiple detectors based on the voxelized point clouds in a cascade paradigm, pursuing higher quality 3D object detector progressively. Furthermore, we quantitatively define the sparsity level of the points within 3D bounding box of each object as the point completeness score, which is exploited as the task weight for each proposal to guide the learning of each stage detector. The spirit behind is to assign higher weights for high-quality proposals with relatively complete point distribution, while down-weight the proposals with extremely sparse points that often incur noise during training. This design of completeness-aware re-weighting elegantly upgrades the cascade paradigm to be better applicable for the sparse input data, without increasing any FLOP budgets. Through extensive experiments on both the KITTI dataset and Waymo Open Dataset, we validate the superiority of our proposed 3D Cascade RCNN, when comparing to state-of-the-art 3D object detection techniques. The source code is publicly available at \url{https://github.com/caiqi/Cascasde-3D}.


title: Explaining Cross-Domain Recognition with Interpretable Deep Classifier

abstract: The recent advances in deep learning predominantly construct models in their internal representations, and it is opaque to explain the rationale behind and decisions to human users. Such explainability is especially essential for domain adaptation, whose challenges require developing more adaptive models across different domains. In this paper, we ask the question: how much each sample in source domain contributes to the network's prediction on the samples from target domain. To address this, we devise a novel Interpretable Deep Classifier (IDC) that learns the nearest source samples of a target sample as evidence upon which the classifier makes the decision. Technically, IDC maintains a differentiable memory bank for each category and the memory slot derives a form of key-value pair. The key records the features of discriminative source samples and the value stores the corresponding properties, e.g., representative scores of the features for describing the category. IDC computes the loss between the output of IDC and the labels of source samples to back-propagate to adjust the representative scores and update the memory banks. Extensive experiments on Office-Home and VisDA-2017 datasets demonstrate that our IDC leads to a more explainable model with almost no accuracy degradation and effectively calibrates classification for optimum reject options. More remarkably, when taking IDC as a prior interpreter, capitalizing on 0.1% source training data selected by IDC still yields superior results than that uses full training set on VisDA-2017 for unsupervised domain adaptation.


title: SPE-Net: Boosting Point Cloud Analysis via Rotation Robustness Enhancement

abstract: In this paper, we propose a novel deep architecture tailored for 3D point cloud applications, named as SPE-Net. The embedded ``Selective Position Encoding (SPE)'' procedure relies on an attention mechanism that can effectively attend to the underlying rotation condition of the input. Such encoded rotation condition then determines which part of the network parameters to be focused on, and is shown to efficiently help reduce the degree of freedom of the optimization during training. This mechanism henceforth can better leverage the rotation augmentations through reduced training difficulties, making SPE-Net robust against rotated data both during training and testing. The new findings in our paper also urge us to rethink the relationship between the extracted rotation information and the actual test accuracy. Intriguingly, we reveal evidences that by locally encoding the rotation information through SPE-Net, the rotation-invariant features are still of critical importance in benefiting the test samples without any actual global rotation. We empirically demonstrate the merits of the SPE-Net and the associated hypothesis on four benchmarks, showing evident improvements on both rotated and unrotated test data over SOTA methods. Source code is available at https://github.com/ZhaofanQiu/SPE-Net.


title: Offline Reinforcement Learning with Adaptive Behavior Regularization

abstract: Offline reinforcement learning (RL) defines a sample-efficient learning paradigm, where a policy is learned from static and previously collected datasets without additional interaction with the environment. The major obstacle to offline RL is the estimation error arising from evaluating the value of out-of-distribution actions. To tackle this problem, most existing offline RL methods attempt to acquire a policy both ``close" to the behaviors contained in the dataset and sufficiently improved over them, which requires a trade-off between two possibly conflicting targets. In this paper, we propose a novel approach, which we refer to as adaptive behavior regularization (ABR), to balance this critical trade-off. By simply utilizing a sample-based regularization, ABR enables the policy to adaptively adjust its optimization objective between cloning and improving over the policy used to generate the dataset. In the evaluation on D4RL datasets, a widely adopted benchmark for offline reinforcement learning, ABR can achieve improved or competitive performance compared to existing state-of-the-art algorithms.


title: Dynamic Temporal Filtering in Video Models

abstract: Video temporal dynamics is conventionally modeled with 3D spatial-temporal kernel or its factorized version comprised of 2D spatial kernel and 1D temporal kernel. The modeling power, nevertheless, is limited by the fixed window size and static weights of a kernel along the temporal dimension. The pre-determined kernel size severely limits the temporal receptive fields and the fixed weights treat each spatial location across frames equally, resulting in sub-optimal solution for long-range temporal modeling in natural scenes. In this paper, we present a new recipe of temporal feature learning, namely Dynamic Temporal Filter (DTF), that novelly performs spatial-aware temporal modeling in frequency domain with large temporal receptive field. Specifically, DTF dynamically learns a specialized frequency filter for every spatial location to model its long-range temporal dynamics. Meanwhile, the temporal feature of each spatial location is also transformed into frequency feature spectrum via 1D Fast Fourier Transform (FFT). The spectrum is modulated by the learnt frequency filter, and then transformed back to temporal domain with inverse FFT. In addition, to facilitate the learning of frequency filter in DTF, we perform frame-wise aggregation to enhance the primary temporal feature with its temporal neighbors by inter-frame correlation. It is feasible to plug DTF block into ConvNets and Transformer, yielding DTF-Net and DTF-Transformer. Extensive experiments conducted on three datasets demonstrate the superiority of our proposals. More remarkably, DTF-Transformer achieves an accuracy of 83.5% on Kinetics-400 dataset. Source code is available at \url{https://github.com/FuchenUSTC/DTF}.


title: HMOE: Hypernetwork-based Mixture of Experts for Domain Generalization

abstract: Due to domain shifts, machine learning systems typically struggle to generalize well to new domains that differ from those of training data, which is what domain generalization (DG) aims to address. Although a variety of DG methods have been proposed, most of them fall short in interpretability and require domain labels, which are not available in many real-world scenarios. This paper presents a novel DG method, called HMOE: Hypernetwork-based Mixture of Experts (MoE), which does not rely on domain labels and is more interpretable. MoE proves effective in identifying heterogeneous patterns in data. For the DG problem, heterogeneity arises exactly from domain shifts. HMOE employs hypernetworks taking vectors as input to generate the weights of experts, which promotes knowledge sharing among experts and enables the exploration of their similarities in a low-dimensional vector space. We benchmark HMOE against other DG methods under a fair evaluation framework -- DomainBed. Our extensive experiments show that HMOE can effectively separate mixed-domain data into distinct clusters that are surprisingly more consistent with human intuition than original domain labels. Using self-learned domain information, HMOE achieves state-of-the-art results on most datasets and significantly surpasses other DG methods in average accuracy across all datasets.


title: EIGER I. a large sample of [OIII]-emitting galaxies at $5.3 < z < 6.9$ and direct evidence for local reionization by galaxies

abstract: We present a first sample of 117 [OIII]$\lambda\lambda$4960,5008-selected star-forming galaxies at $5.33 < z < 6.93$ detected in JWST/NIRCam 3.5$\mu$m slitless spectroscopy of a $6.5 \times 3.4$ arcmin$^2$ field centered on the hyperluminous quasar SDSS J0100+2802, obtained as part of the EIGER (Emission-line galaxies and Intergalactic Gas in the Epoch of Reionization) survey. Three prominent galaxy overdensities are observed, one of them at the redshift of the quasar. Galaxies are found within 200 pkpc and 105 km s$^{-1}$ of four known metal absorption-line systems in this redshift range. We focus on the role of the galaxies in ionizing the surrounding intergalactic medium (IGM) during the later stages of cosmic reionization and construct the mean Ly$\alpha$ and Ly$\beta$ transmission as a function of distance from the galaxies. At the lowest redshifts in our study, $5.3 < z < 5.7$, the IGM transmission rises monotonically with distance from the galaxies. This is as expected when galaxies reside at peaks in the overdensity field of an IGM that is ionized by more or less uniform ionizing background, and has been seen at lower redshifts. In contrast, at $5.7 < z < 6.14$, the transmission of both Ly$\alpha$ and Ly$\beta$ first increases with distance, but then peaks at a distance of 5 cMpc before declining. This peak in transmission is qualitatively similar to that seen (albeit at smaller distances and higher redshifts) in the THESAN simulations. Finally, in the region $6.15 < z < 6.26$ where the additional ionizing radiation from the quasar dominates, the monotonic increase in transmission with distance is re-established. This result is interpreted to represent evidence that the transmission of the IGM at $z \sim 5.9$ towards J0100+2802 results from the ``local'' ionizing radiation of galaxies that dominates over the much reduced cosmic background.


title: EIGER II. first spectroscopic characterisation of the young stars and ionised gas associated with strong H$\beta$ and [OIII] line-emission in galaxies at z=5-7 with JWST

abstract: We present emission-line measurements and physical interpretations for a sample of 117 [OIII] emitting galaxies at $z=5.33-6.93$, using the first deep JWST/NIRCam wide field slitless spectroscopic observations. Our 9.7-hour integration is centered upon the $z=6.3$ quasar J0100+2802 -- the first of six fields targeted by the EIGER survey -- and covers $\lambda=3-4$ microns. We detect 133 [OIII] doublets, but merge pairs within $\approx$10 kpc and 600 km s$^{-1}$, motivated by their small scale clustering excess. We detect H$\beta$ in 68 and H$\gamma$ emission in two galaxies. The galaxies are characterised by a UV luminosity M$_{\rm UV}\sim-19.6$ ($-17.7$ to $-22.3$), stellar mass ~$10^8$ $(10^{6.8-10.1})$ M$_{\odot}$, H$\beta$ and [OIII] EWs $\approx$ 850 Angstrom (up to 3000 Angstrom), young ages (~100 Myr), a highly excited interstellar medium ([OIII]/H$\beta\approx6$) and low dust attenuations. These high EWs are very rare in the local Universe, but we show they are ubiquitous at $z\sim6$ based on the measured number densities. The stacked spectrum reveals H$\gamma$ and [OIII]$_{4364}$ which shows that the galaxies are typically dust and metal poor (E(B-V)=0.1, 12+log(O/H)=7.4) with a high electron temperature ($2\times10^4$ K) and a production efficiency of ionising photons ($\xi_{\rm ion}=10^{25.3}$ Hz erg$^{-1}$). We further show the existence of a strong mass-metallicity relation. The young highly ionising stellar populations, moderately low metallicities, low dust attenuations and high ionisation state in z~6 galaxies conspire to maximise the [OIII] output from galaxies, yielding an [OIII] luminosity density at z~6 that is significantly higher than at z~2, despite the order of magnitude decline in cosmic star formation. Thus, [OIII] emission-line surveys with JWST prove a highly efficient method to trace the galaxy density in the epoch of reionization.


title: The q-Binomial Coefficient for Negative Arguments and Some q-Binomial Summation Identities

abstract: Using a property of the q-shifted factorial, an identity for q-binomial coefficients is proved, which is used to derive the formulas for the q-binomial coefficient for negative arguments. The result is in agreement with an earlier paper about the normal binomial coefficient for negative arguments. Some new q-binomial summation identities are derived, and the formulas for negative arguments transform some of these summation identities into each other. One q-binomial summation identity is transformed into a new q-binomial summation identity.


title: AutoTherm: A Dataset and Benchmark for Thermal Comfort Estimation Indoors and in Vehicles

abstract: Thermal comfort inside buildings is a well-studied field where human judgment for thermal comfort is collected and may be used for automatic thermal comfort estimation. However, indoor scenarios are rather static in terms of thermal state changes and, thus, cannot be applied to dynamic conditions, e.g., inside a vehicle. In this work, we present our findings of a gap between building and in-vehicle scenarios regarding thermal comfort estimation. We provide evidence by comparing deep neural classifiers for thermal comfort estimation for indoor and in-vehicle conditions. Further, we introduce a temporal dataset for indoor predictions incorporating 31 input signals and self-labeled user ratings by 18 subjects in a self-built climatic chamber. For in-vehicle scenarios, we acquired a second dataset featuring human judgments from 20 subjects in a BMW 3 Series. Our experimental results indicate superior performance for estimations from time series data over single vector input. Leveraging modern machine learning architectures enables us to recognize human thermal comfort states and estimate future states automatically. We provide details on training a recurrent network-based classifier and perform an initial performance benchmark of the proposed dataset. Ultimately, we compare our collected dataset to publicly available thermal comfort datasets.


title: Complex Symplectic Lie Algebras with Large Abelian Subalgebras

abstract: We present two constructions of complex symplectic structures on Lie algebras with large abelian ideals. In particular, we completely classify complex symplectic structures on almost abelian Lie algebras. By considering compact quotients of their corresponding connected, simply connected Lie groups we obtain many examples of complex symplectic manifolds which do not carry (hyper)k\"ahler metrics. We also produce examples of compact complex symplectic manifolds endowed with a fibration whose fibers are Lagrangian tori.


title: A few words about maps

abstract: In this paper, we survey some properties, encoding, and bijections involving combinatorial maps, double occurrence words, and chord diagrams. We particularly study quasi-trees from a purely combinatorial point of view and derive a topological representation of maps with a given spanning quasi-tree using two fundamental polygons, which extends the representation of planar maps based on the equivalence with bipartite circle graphs. Then, we focus on Depth-First Search trees and their connection with a poset we define on the spanning quasi-trees of a map. We apply the bijections obtained in the first section to the problem of enumerating loopless rooted maps. Finally, we return to the planar case and discuss a decomposition of planar rooted loopless maps and its consequences on planar rooted loopless map enumeration.


title: A functorial approach to the stability of vector bundles

abstract: On a normal projective variety the locus of $\mu$-stable bundles that remain $\mu$-stable on all Galois covers prime to the characteristic is open in the moduli space of Gieseker semi-stable sheaves. On a smooth projective curve of genus at least 2 this locus is big in the moduli space of stable bundles, i.e., its complement has codimension at least 2.


title: Atomic motifs govern the decoration of grain boundaries by interstitial solutes

abstract: Grain boundaries, the two-dimensional (2D) defects between differently oriented crystals, control mechanical and transport properties of materials. Our fundamental understanding of grain boundaries is still incomplete even after nearly a century and a half of research since Sorby first imaged grains. Here, we present a systematic study, over 9 orders of magnitude of size scales, in which we analyze 2D defects between two neighboring crystals across five hierarchy levels and investigate their crystallographic, compositional, and electronic features. The levels are (a) the macroscale interface alignment and grain misorientation (held constant here); (b) the systematic mesoscopic change in the inclination of the grain boundary plane for the same orientation difference; (c) the facets, atomic motifs (structural units), and internal nanoscopic defects within the boundary plane; (d) the grain boundary chemistry; and (e) the electronic structure of the atomic motifs. As a model material, we use Fe alloyed with B and C, exploiting the strong interdependence of interface structure and chemistry in this system. This model system is the basis of the 1.9 billion tons of steel produced annually and has an eminent role as a catalyst. Surprisingly, we find that even a change in the inclination of the GB plane with identical misorientation impacts GB composition and atomic arrangement. Thus, it is the smallest structural hierarchical level, the atomic motifs, which control the most important chemical properties of the grain boundaries. This finding not only closes a missing link between the structure and chemical composition of such defects but also enables the targeted design and passivation of the chemical state of grain boundaries to free them from their role as entry gates for corrosion, hydrogen embrittlement, or mechanical failure.


title: A mixed-categorical correlation kernel for Gaussian process

abstract: Recently, there has been a growing interest for mixed-categorical meta-models based on Gaussian process (GP) surrogates. In this setting, several existing approaches use different strategies either by using continuous kernels (e.g., continuous relaxation and Gower distance based GP) or by using a direct estimation of the correlation matrix. In this paper, we present a kernel-based approach that extends continuous exponential kernels to handle mixed-categorical variables. The proposed kernel leads to a new GP surrogate that generalizes both the continuous relaxation and the Gower distance based GP models. We demonstrate, on both analytical and engineering problems, that our proposed GP model gives a higher likelihood and a smaller residual error than the other kernel-based state-of-the-art models. Our method is available in the open-source software SMT.


title: An implicit FFT-based method for wave propagation in elastic heterogeneous media

abstract: An FFT-based algorithm is developed to simulate the propagation of elastic waves in heterogeneous $d$-dimensional rectangular shape domains. The method allows one to prescribe the displacement as a function of time in a subregion of the domain, emulating the application of Dirichlet boundary conditions on an outer face. Time discretization is performed using an unconditionally stable beta-Newmark approach. The implicit problem for obtaining the displacement at each time step is solved by transforming the equilibrium equations into Fourier space and solving the corresponding linear system with a preconditioned Krylov solver. The resulting method is validated against analytical solutions and compared with implicit and explicit finite element simulations and with an explicit FFT approach. The accuracy of the method is similar to or better than that of finite elements, and the numerical performance is clearly superior, allowing the use of much larger models. To illustrate the capabilities of the method, some numerical examples are presented, including the propagation of planar, circular, and spherical waves and the simulation of the propagation of a pulse in a polycrystalline medium.


title: QAmeleon: Multilingual QA with Only 5 Examples

abstract: The availability of large, high-quality datasets has been one of the main drivers of recent progress in question answering (QA). Such annotated datasets however are difficult and costly to collect, and rarely exist in languages other than English, rendering QA technology inaccessible to underrepresented languages. An alternative to building large monolingual training datasets is to leverage pre-trained language models (PLMs) under a few-shot learning setting. Our approach, QAmeleon, uses a PLM to automatically generate multilingual data upon which QA models are trained, thus avoiding costly annotation. Prompt tuning the PLM for data synthesis with only five examples per language delivers accuracy superior to translation-based baselines, bridges nearly 60% of the gap between an English-only baseline and a fully supervised upper bound trained on almost 50,000 hand labeled examples, and always leads to substantial improvements compared to fine-tuning a QA model directly on labeled examples in low resource settings. Experiments on the TyDiQA-GoldP and MLQA benchmarks show that few-shot prompt tuning for data synthesis scales across languages and is a viable alternative to large-scale annotation.


title: Spread of parasites affecting death and division rates in a cell population

abstract: We introduce a general class of branching Markov processes for the modelling of a parasite infection in a cell population. Each cell contains a quantity of parasites which evolves as a diffusion with positive jumps. The drift, diffusive function and positive jump rate of this quantity of parasites depend on its current value. The division rate of the cells also depends on the quantity of parasites they contain. At division, a cell gives birth to two daughter cells and shares its parasites between them. Cells may also die, at a rate which may depend on the quantity of parasites they contain. We study the long-time behaviour of the parasite infection.


title: Picosecond Spin-Orbit Torque Induced Coherent Magnetization Switching in a Ferromagnet

abstract: Electrically controllable non-volatile magnetic memories show great potential for the replacement of semiconductor-based technologies. Recently there has been strong interest in spin-orbit torque (SOT) induced magnetization reversal due to the device's increased lifetime and speed of operation. However, recent SOT switching studies reveal an incubation delay in the ~ns range due to stochasticity in the nucleation of a magnetic domain during reversal. Here, we experimentally demonstrate ultrafast SOT-induced magnetization switching dynamics of a ferromagnet with no incubation delay by avoiding the nucleation process and driving the magnetization coherently. We employ an ultrafast photo-conducting switch and a co-planar strip line to generate and guide ~ps current pulses into the heavy metal/ferromagnet layer stack and induce ultrafast SOT. We use magneto-optical probing to investigate the magnetization switching dynamics with sub-picosecond time resolution. Depending on the relative current pulse and in-plane magnetic field polarities, we observe either an ultrafast demagnetization and subsequent recovery along with a SOT-induced precessional oscillation, or ultrafast SOT switching. The magnetization zero-crossing occurs in ~70 ps, which is approximately an order of magnitude faster than previous studies. Complete switching needs ~250 ps and is limited by the heat diffusion to the substrate. We use a macro-magnetic simulation coupled with an ultrafast heating model to analyze the effect of ultrafast thermal anisotropy torque and current-induced torque in the observed dynamics. Good agreement between our experimental results and the macro-spin model shows that the switching dynamics are coherent and present no noticeable incubation delay. Our work suggests a potential pathway toward dramatically increasing the writing speed of SOT magnetic random-access memory devices.


title: Reads2Vec: Efficient Embedding of Raw High-Throughput Sequencing Reads Data

abstract: The massive amount of genomic data appearing for SARS-CoV-2 since the beginning of the COVID-19 pandemic has challenged traditional methods for studying its dynamics. As a result, new methods such as Pangolin, which can scale to the millions of samples of SARS-CoV-2 currently available, have appeared. Such a tool is tailored to take as input assembled, aligned and curated full-length sequences, such as those found in the GISAID database. As high-throughput sequencing technologies continue to advance, such assembly, alignment and curation may become a bottleneck, creating a need for methods which can process raw sequencing reads directly. In this paper, we propose Reads2Vec, an alignment-free embedding approach that can generate a fixed-length feature vector representation directly from the raw sequencing reads without requiring assembly. Furthermore, since such an embedding is a numerical representation, it may be applied to highly optimized classification and clustering algorithms. Experiments on simulated data show that our proposed embedding obtains better classification results and better clustering properties contrary to existing alignment-free baselines. In a study on real data, we show that alignment-free embeddings have better clustering properties than the Pangolin tool and that the spike region of the SARS-CoV-2 genome heavily informs the alignment-free clusterings, which is consistent with current biological knowledge of SARS-CoV-2.


title: A Comparative Study of Machine Learning and Deep Learning Techniques for Prediction of Co2 Emission in Cars

abstract: The most recent concern of all people on Earth is the increase in the concentration of greenhouse gas in the atmosphere. The concentration of these gases has risen rapidly over the last century and if the trend continues it can cause many adverse climatic changes. There have been ways implemented to curb this by the government by limiting processes that emit a higher amount of CO2, one such greenhouse gas. However, there is mounting evidence that the CO2 numbers supplied by the government do not accurately reflect the performance of automobiles on the road. Our proposal of using artificial intelligence techniques to improve a previously rudimentary process takes a radical tack, but it fits the bill given the situation. To determine which algorithms and models produce the greatest outcomes, we compared them all and explored a novel method of ensembling them. Further, this can be used to foretell the rise in global temperature and to ground crucial policy decisions like the adoption of electric vehicles. To estimate emissions from vehicles, we used machine learning, deep learning, and ensemble learning on a massive dataset.


title: The grand picture behind Jensen's inequality

abstract: Let $I$ and $J$ be two intervals, and let $f, g: I \rightarrow \mathbb{R}$. If for any points $a$ and $b$ in $I$ and any positive numbers $p$ and $q$ such that $p + q = 1$, we have \begin{align} \nonumber p f(a) + q f(b) + g(pa + qb) \in J, \end{align} then for any points $x_{1}, \ldots, x_{n}$ in $I$ and any positive numbers $\lambda_{1}, \ldots, \lambda_{n}$ such that $\sum_{i=1}^{n}\lambda_{i} = 1$, we have \begin{align} \nonumber \sum_{i=1}^{n}\lambda_{i} f(x_{i}) + g\left( \sum_{i=1}^{n}\lambda_{i}x_{i} \right) \in J. \end{align} If we take $g = -f$ and $J = [0, +\infty)$, then the Jensen's inequality. The conclusion is only a short glimpse of the grand picture behind Jensen's inequality shows in this paper.


title: Local Irregularity Conjecture for 2-multigraphs versus cacti

abstract: A multigraph is locally irregular if the degrees of the end-vertices of every multiedge are distinct. The locally irregular coloring is an edge coloring of a multigraph $G$ such that every color induces a locally irregular submultigraph of $G$. A locally irregular colorable multigraph $G$ is any multigraph which admits a locally irregular coloring. We denote by ${\rm lir}(G)$ the locally irregular chromatic index of a multigraph $G$, which is the smallest number of colors required in the locally irregular coloring of the locally irregular colorable multigraph $G$. In case of graphs the definitions are similar. The Local Irregularity Conjecture for 2-multigraphs claims that for every connected graph $G$, which is not isomorphic to $K_2$, multigraph $^2G$ obtained from $G$ by doubling each edge satisfies ${\rm lir}(^2G)\leq 2$. We show this conjecture for cacti. This class of graphs is important for the Local Irregularity Conjecture for 2-multigraphs and the Local Irregularity Conjecture which claims that every locally irregular colorable graph $G$ satisfies ${\rm lir}(G)\leq 3$. At the beginning it has been observed that all not locally irregular colorable graphs are cacti. Recently it has been proved that there is only one cactus which requires 4 colors for a locally irregular coloring and therefore the Local Irregularity Conjecture was disproved.


title: Identification of multiple-flux-quanta vortices by core states in the two-band superconductor Pb

abstract: Superconductors are of type I or II depending on whether they form an Abrikosov vortex lattice. Although bulk lead (Pb) is classified as a prototypical type-I superconductor, we observe single-flux-quantum and multiple-flux-quanta vortices in the intermediate state using mK scanning tunneling microscopy. We show that the winding number of individual vortices can be determined from the real space wave function of its Caroli-de Gennes-Matricon bound states. This generalizes the index theorem put forward by Volovik for isotropic electronic states to realistic electronic structures. In addition, the bound states due to the two superconducting bands of Pb can be separately detected. This yields strong evidence for low inter-band coupling and an independent closure of the gaps inside vortices.


title: Low-Thrust Orbital Transfer using Dynamics-Agnostic Reinforcement Learning

abstract: Low-thrust trajectory design and in-flight control remain two of the most challenging topics for new-generation satellite operations. Most of the solutions currently implemented are based on reference trajectories and lead to sub-optimal fuel usage. Other solutions are based on simple guidance laws that need to be updated periodically, increasing the cost of operations. Whereas some optimization strategies leverage Artificial Intelligence methods, all of the approaches studied so far need either previously generated data or a strong a priori knowledge of the satellite dynamics. This study uses model-free Reinforcement Learning to train an agent on a constrained pericenter raising scenario for a low-thrust medium-Earth-orbit satellite. The agent does not have any prior knowledge of the environment dynamics, which makes it unbiased from classical trajectory optimization patterns. The trained agent is then used to design a trajectory and to autonomously control the satellite during the cruise. Simulations show that a dynamics-agnostic agent is able to learn a quasi-optimal guidance law and responds well to uncertainties in the environment dynamics. The results obtained open the door to the usage of Reinforcement Learning on more complex scenarios, multi-satellite problems, or to explore trajectories in environments where a reference solution is not known


title: Matrix Factorization for Cache Optimization in Content Delivery Networks (CDN)

abstract: Content delivery networks (CDNs) are key components of high throughput, low latency services on the internet. CDN cache servers have limited storage and bandwidth and implement state-of-the-art cache admission and eviction algorithms to select the most popular and relevant content for the customers served. The aim of this study was to utilize state-of-the-art recommender system techniques for predicting ratings for cache content in CDN. Matrix factorization was used in predicting content popularity which is valuable information in content eviction and content admission algorithms run on CDN edge servers. A custom implemented matrix factorization class and MyMediaLite were utilized. The input CDN logs were received from a European telecommunication service provider. We built a matrix factorization model with that data and utilized grid search to tune its hyper-parameters. Experimental results indicate that there is promise about the proposed approaches and we showed that a low root mean square error value can be achieved on the real-life CDN log data.


title: A stochastic quantum Krylov protocol with double factorized Hamiltonians

abstract: We propose a class of randomized quantum Krylov diagonalization (rQKD) algorithms capable of solving the eigenstate estimation problem with modest quantum resource requirements. Compared to previous real-time evolution quantum Krylov subspace methods, our approach expresses the time evolution operator, $e^{-i\hat{H} \tau}$, as a linear combination of unitaries and subsequently uses a stochastic sampling procedure to reduce circuit depth requirements. While our methodology applies to any Hamiltonian with fast-forwardable subcomponents, we focus on its application to the explicitly double-factorized electronic-structure Hamiltonian. To demonstrate the potential of the proposed rQKD algorithm, we provide numerical benchmarks for a variety of molecular systems with circuit-based statevector simulators, achieving ground state energy errors of less than 1~kcal~mol$^{-1}$ with circuit depths orders of magnitude shallower than those required for low-rank deterministic Trotter-Suzuki decompositions.


title: Precise Derivations of Radiative Properties of Porous Media Using Renewal Theory

abstract: This work uses the mathematical machinery of Renewal/Ruin (surplus risk) theory to derive preliminary explicit estimations for the radiative properties of dilute and disperse porous media otherwise only computable accurately with Monte Carlo Ray Tracing (MCRT) simulations. Although random walk and Levy processes have been extensively used for modeling diffuse processes in various transport problems and porous media modeling, relevance to radiation heat transfer is scarce, as opposed to other problems such as probe diffusion and permeability modeling. Furthermore, closed form derivations that lead to tangible variance reduction in MCRT are widely missing. The particular angle of surplus risk theory provides a richer apparatus to derive directly related quantities. To the best of the authors' knowledge, the current work is the only work relating the surplus risk theory derivations to explicit computations of ray tracing results in porous media. The paper contains mathematical derivations of the radiation heat transfer estimates using the extracted machinery along with proofs and numerical validation using MCRT.


title: Intergranular corrosion in evolving media: experiment and modeling by cellular automata

abstract: We investigate the impact of the oxidizing character of the nitric medium on the evolution of the intergranular corrosion of a stainless steel. In two different oxidizing conditions ("severe" and "soft"), the corroded surface of the steel reaches a different steady state: the oxide is thicker, the intergranular grooves are thinner and the surface area is larger in the "severe" conditions than in the "soft" ones. Then we investigate the effect of an alternative "severe then soft" corrosion sequence. We show that the system re-adapts to the "soft" conditions without memory effect from the previous "severe" ones. bstra


title: SPADE4: Sparsity and Delay Embedding based Forecasting of Epidemics

abstract: Predicting the evolution of diseases is challenging, especially when the data availability is scarce and incomplete. The most popular tools for modelling and predicting infectious disease epidemics are compartmental models. They stratify the population into compartments according to health status and model the dynamics of these compartments using dynamical systems. However, these predefined systems may not capture the true dynamics of the epidemic due to the complexity of the disease transmission and human interactions. In order to overcome this drawback, we propose Sparsity and Delay Embedding based Forecasting (SPADE4) for predicting epidemics. SPADE4 predicts the future trajectory of an observable variable without the knowledge of the other variables or the underlying system. We use random features model with sparse regression to handle the data scarcity issue and employ Takens' delay embedding theorem to capture the nature of the underlying system from the observed variable. We show that our approach outperforms compartmental models when applied to both simulated and real data.


title: Data-Driven Occupancy Grid Mapping using Synthetic and Real-World Data

abstract: In perception tasks of automated vehicles (AVs) data-driven have often outperformed conventional approaches. This motivated us to develop a data-driven methodology to compute occupancy grid maps (OGMs) from lidar measurements. Our approach extends previous work such that the estimated environment representation now contains an additional layer for cells occupied by dynamic objects. Earlier solutions could only distinguish between free and occupied cells. The information whether an obstacle could move plays an important role for planning the behavior of an AV. We present two approaches to generating training data. One approach extends our previous work on using synthetic training data so that OGMs with the three aforementioned cell states are generated. The other approach uses manual annotations from the nuScenes dataset to create training data. We compare the performance of both models in a quantitative analysis on unseen data from the real-world dataset. Next, we analyze the ability of both approaches to cope with a domain shift, i.e. when presented with lidar measurements from a different sensor on a different vehicle. We propose using information gained from evaluation on real-world data to further close the reality gap and create better synthetic data that can be used to train occupancy grid mapping models for arbitrary sensor configurations. Code is available at https://github.com/ika-rwth-aachen/DEviLOG.


title: Towards an objective characterization of an individual's facial movements using Self-Supervised Person-Specific-Models

abstract: Disentangling facial movements from other facial characteristics, particularly from facial identity, remains a challenging task, as facial movements display great variation between individuals. In this paper, we aim to characterize individual-specific facial movements. We present a novel training approach to learn facial movements independently of other facial characteristics, focusing on each individual separately. We propose self-supervised Person-Specific Models (PSMs), in which one model per individual can learn to extract an embedding of the facial movements independently of the person's identity and other structural facial characteristics from unlabeled facial video. These models are trained using encoder-decoder-like architectures. We provide quantitative and qualitative evidence that a PSM learns a meaningful facial embedding that discovers fine-grained movements otherwise not characterized by a General Model (GM), which is trained across individuals and characterizes general patterns of facial movements. We present quantitative and qualitative evidence that this approach is easily scalable and generalizable for new individuals: facial movements knowledge learned on a person can quickly and effectively be transferred to a new person. Lastly, we propose a novel PSM using curriculum temporal learning to leverage the temporal contiguity between video frames. Our code, analysis details, and all pretrained models are available in Github and Supplementary Materials.


title: From deterministic to distributed chaos/turbulence in Rayleigh-B\'{e}nard convection: generalized Birkhoff-Saffman invariant

abstract: The transition from deterministic to distributed chaos/turbulence at the increase of Rayleigh number (from $10^4$ to $10^8$) in Rayleigh-B\'{e}nard convection, controlled by generalized Birkhoff-Saffman invariant, has been studied using the results of direct numerical simulations. The applications of this approach to rotating Rayleigh-B\'{e}nard convection, to stably stratified flows, and to observations in the atmosphere and in the solar photosphere have been briefly discussed.


title: Forecasting Bitcoin volatility spikes from whale transactions and CryptoQuant data using Synthesizer Transformer models

abstract: The cryptocurrency market is highly volatile compared to traditional financial markets. Hence, forecasting its volatility is crucial for risk management. In this paper, we investigate CryptoQuant data (e.g. on-chain analytics, exchange and miner data) and whale-alert tweets, and explore their relationship to Bitcoin's next-day volatility, with a focus on extreme volatility spikes. We propose a deep learning Synthesizer Transformer model for forecasting volatility. Our results show that the model outperforms existing state-of-the-art models when forecasting extreme volatility spikes for Bitcoin using CryptoQuant data as well as whale-alert tweets. We analysed our model with the Captum XAI library to investigate which features are most important. We also backtested our prediction results with different baseline trading strategies and the results show that we are able to minimize drawdown while keeping steady profits. Our findings underscore that the proposed method is a useful tool for forecasting extreme volatility movements in the Bitcoin market.


title: Homomorphic Self-Supervised Learning

abstract: In this work, we observe that many existing self-supervised learning algorithms can be both unified and generalized when seen through the lens of equivariant representations. Specifically, we introduce a general framework we call Homomorphic Self-Supervised Learning, and theoretically show how it may subsume the use of input-augmentations provided an augmentation-homomorphic feature extractor. We validate this theory experimentally for simple augmentations, demonstrate how the framework fails when representational structure is removed, and further empirically explore how the parameters of this framework relate to those of traditional augmentation-based self-supervised learning. We conclude with a discussion of the potential benefits afforded by this new perspective on self-supervised learning.


title: The RED-BLUE SEPARATION problem on graphs

abstract: We introduce the Red-Blue Separation problem on graphs, where we are given a graph $G=(V,E)$ whose vertices are colored either red or blue, and we want to select a (small) subset $S \subseteq V$, called red-blue separating set, such that for every red-blue pair of vertices, there is a vertex $s \in S$ whose closed neighborhood contains exactly one of the two vertices of the pair. We study the computational complexity of Red-Blue Separation, in which one asks whether a given red-blue colored graph has a red-blue separating set of size at most a given integer. We prove that the problem is NP-complete even for restricted graph classes. We also show that it is always approximable in polynomial time within a factor of $2\ln n$, where $n$ is the input graph's order. In contrast, for triangle-free graphs and for graphs of bounded maximum degree, we show that Red-Blue Separation is solvable in polynomial time when the size of the smaller color class is bounded by a constant. However, on general graphs, we show that the problem is $W[2]$-hard even when parameterized by the solution size plus the size of the smaller color class. We also consider the problem Max Red-Blue Separation where the coloring is not part of the input. Here, given an input graph $G$, we want to determine the smallest integer $k$ such that, for every possible red-blue coloring of $G$, there is a red-blue separating set of size at most $k$. We derive tight bounds on the cardinality of an optimal solution of Max Red-Blue Separation, showing that it can range from logarithmic in the graph order, up to the order minus one. We also give bounds with respect to related parameters. For trees however we prove an upper bound of two-thirds the order. We then show that Max Red-Blue Separation is NP-hard, even for graphs of bounded maximum degree, but can be approximated in polynomial time within a factor of $O(\ln^2 n)$.


title: Spatially Exclusive Pasting: A General Data Augmentation for the Polyp Segmentation

abstract: Automated polyp segmentation technology plays an important role in diagnosing intestinal diseases, such as tumors and precancerous lesions. Previous works have typically trained convolution-based U-Net or Transformer-based neural network architectures with labeled data. However, the available public polyp segmentation datasets are too small to train the network sufficiently, suppressing each network's potential performance. To alleviate this issue, we propose a universal data augmentation technology to synthesize more data from the existing datasets. Specifically, we paste the polyp area into the same image's background in a spatial-exclusive manner to obtain a combinatorial number of new images. Extensive experiments on various networks and datasets show that the proposed method enhances the data efficiency and achieves consistent improvements over baselines. Finally, we hit a new state of the art in this task. We will release the code soon.


title: Identifying Spurious Correlations and Correcting them with an Explanation-based Learning

abstract: Identifying spurious correlations learned by a trained model is at the core of refining a trained model and building a trustworthy model. We present a simple method to identify spurious correlations that have been learned by a model trained for image classification problems. We apply image-level perturbations and monitor changes in certainties of predictions made using the trained model. We demonstrate this approach using an image classification dataset that contains images with synthetically generated spurious regions and show that the trained model was overdependent on spurious regions. Moreover, we remove the learned spurious correlations with an explanation based learning approach.


title: U-duality and Courant Algebroid in Exceptional Field Theory

abstract: In this paper, we study the field transformation under U-duality in exceptional field theories. Take $SL(5)$ and $SO(5,5)$ exceptional field theories as examples, we explicitly show that the U-duality transformation is governed by the differential geometry of a corresponding Courant algebroid structure. The field redefinition specified by $SL(5)$ and $SO(5,5)$ transformations can be realized by Courant algebroid anchor mapping. Based on the existence of Courant algebroid in $E_d$ exceptional field theory, we expect that the Courant algebroid anchor mapping also exist in exceptional field theories with higher dimensional exceptional groups, such as $E_6$ and $E_7$. Intriguingly, the U-dual M2-brane and M5-brane can be realized with the same structure of Courant algebroid in exceptional field theory. Since in each exceptional field theory, all the involved fields can be mapped with the same anchor, the full Lagrangian is governed by the Courant algebroid anchor mapping. In particular, this is realized by the U-duality mapping in extended generalised geometry, from the extended bundle $E=TM \oplus \Lambda^2 T^*M \oplus \Lambda^5 T^*M\oplus \Lambda^6 TM$ to the U-dual bundle $E^*=T^*M \oplus \Lambda^2 TM \oplus \Lambda^5 TM \oplus \Lambda^6 T^*M$ under the global $E_d$ symmetry. From M-theory point of view, a U-dual effective theory of M-theory is expected from Courant algebroid anchor mapping in such a global manner via U-duality.


title: Towards 3D Object Detection with 2D Supervision

abstract: The great progress of 3D object detectors relies on large-scale data and 3D annotations. The annotation cost for 3D bounding boxes is extremely expensive while the 2D ones are easier and cheaper to collect. In this paper, we introduce a hybrid training framework, enabling us to learn a visual 3D object detector with massive 2D (pseudo) labels, even without 3D annotations. To break through the information bottleneck of 2D clues, we explore a new perspective: Temporal 2D Supervision. We propose a temporal 2D transformation to bridge the 3D predictions with temporal 2D labels. Two steps, including homography wraping and 2D box deduction, are taken to transform the 3D predictions into 2D ones for supervision. Experiments conducted on the nuScenes dataset show strong results (nearly 90% of its fully-supervised performance) with only 25% 3D annotations. We hope our findings can provide new insights for using a large number of 2D annotations for 3D perception.


title: Time-domain Classification of the Brain Reward System: Analysis of Natural- and Drug-Reward Driven Local Field Potential Signals in Hippocampus and Nucleus Accumbens

abstract: Addiction is a major public health concern characterized by compulsive reward-seeking behavior. The excitatory glutamatergic signals from the hippocampus (HIP) to the Nucleus accumbens (NAc) mediate learned behavior in addiction. Limited comparative studies have investigated the neural pathways activated by natural and unnatural reward sources. This study has evaluated neural activities in HIP and NAc associated with food (natural) and morphine (drug) reward sources using local field potential (LFP). We developed novel approaches to classify LFP signals into the source of reward and recorded regions by considering the time-domain feature of these signals. Proposed methods included a validation step of the LFP signals using autocorrelation, Lyapunov exponent and Hurst exponent to assess the meaningful stability of these signals (lack of chaos). By utilizing the probability density function (PDF) of LFP signals and applying Kullback-Leibler divergence (KLD), data were classified to the source of the reward. Also, HIP and NAc regions were visually separated and classified using the symmetrized dot pattern technique, which can be applied in real-time to ensure the deep brain region of interest is being targeted accurately during LFP recording. We believe our method provides a computationally light and fast, real-time signal analysis approach with real-world implementation.


title: More axions from diluted domain walls

abstract: We consider the scenario in which the Peccei-Quinn symmetry breaking is followed by a period of inflation. A particularly interesting case is that the string-domain wall network produced by the symmetry breaking enters the horizon after the QCD phase transition. We show that the abundance of axions produced by such a string-domain wall network is counterintuitively much larger than the conventional post-inflationary Peccei-Quinn symmetry breaking scenario. As a result, a scenario with the axion decay constant even as low as the astrophysical bound of about $10^8$ GeV can explain the observed abundance of dark matter. The axion mini-halos produced from the string-domain wall network is much more massive than the conventional scenario. We also briefly discuss models which can realize this scenario such as a Peccei-Quinn phase transition during inflation or a second inflation after a Peccei-Quinn phase transition.