title: Relativistic effects and three-body interactions in atomic nuclei

abstract: Based on the leading-order covariant pionless effective field theory, a relativistic nuclear Hamiltonian is derived and solved using the variational Monte Carlo approach for $A\le 4$ nuclei by representing the nuclear many-body wave functions with a symmetry-based artificial neural network. It is found that the relativistic effects rescue the renormalizability of the theory, and overcome the energy collapse problem for $^3$H and $^4$He without promoting a repulsive three-nucleon interaction to leading order as in nonrelativistic calculations. Nevertheless, to exactly reproduce the experimental ground-state energies, a three-nucleon interaction is needed and its interplay with the relativistic effects plays a crucial role. The strongly repulsive relativistic effects suppress the energy contribution given by the three-nucleon interactions, so a strong strength for the three-nucleon interaction could be required to reproduce the experimental energies. These results shed light on a consistent understanding of relativistic effects and three-body interactions in atomic nuclei.


title: Big Bang Nucleosynthesis constraints on varying electron mass solution to the Hubble tension

abstract: A cosmological model with a time-varying mass of electrons seems a promising solution for the so-called Hubble tension. We examine the big bang nucleosynthesis (BBN) constraints on the time-varying electron mass model, because a larger electron mass gives rise to the smaller neutron decay rate which could affect the light element abundance. Additionally, different inferred cosmological parameters, primarily baryon asymmetry, to keep the cosmic background power spectrum unchanged could affect the abundance of light element. We find that the predicted helium fraction becomes larger and the deuterium abundance becomes smaller as the electron mass at the BBN time becomes larger. Thus, we conclude that an acceptable electron mass at the BBN time would be only approximately 1% greater than the current electron mass.


title: Toward Quantization of Inhomogeneous Field Theory

abstract: We explore the quantization of a $(1+1)$-dimensional inhomogeneous scalar field theory in which Poincar\'{e} symmetry is explicitly broken. We show the `classical equivalence' between a scalar field theory on curved spacetime background and its corresponding inhomogeneous scalar field theory. This implies that a hidden connection may exist among some inhomogeneous field theories, which corresponds to general covariance in field theory on curved spacetime. Based on the classical equivalence, we propose how to quantize a specific field theory with broken Poincar\'{e} symmetry inspired by standard field theoretic approaches, canonical and algebraic methods, on curved spacetime. Consequently, we show that the Unruh effect can be realized in inhomogeneous field theory and propose that it may be tested by a condensed matter experiment. We suggest that an algebraic approach is appropriate for the quantization of a generic inhomogeneous field theory.


title: Modern graph neural networks do worse than classical greedy algorithms in solving combinatorial optimization problems like maximum independent set

abstract: The recent work ``Combinatorial Optimization with Physics-Inspired Graph Neural Networks'' [Nat Mach Intell 4 (2022) 367] introduces a physics-inspired unsupervised Graph Neural Network (GNN) to solve combinatorial optimization problems on sparse graphs. To test the performances of these GNNs, the authors of the work show numerical results for two fundamental problems: maximum cut and maximum independent set (MIS). They conclude that "the graph neural network optimizer performs on par or outperforms existing solvers, with the ability to scale beyond the state of the art to problems with millions of variables." In this comment, we show that a simple greedy algorithm, running in almost linear time, can find solutions for the MIS problem of much better quality than the GNN. The greedy algorithm is faster by a factor of $10^4$ with respect to the GNN for problems with a million variables. We do not see any good reason for solving the MIS with these GNN, as well as for using a sledgehammer to crack nuts. In general, many claims of superiority of neural networks in solving combinatorial problems are at risk of being not solid enough, since we lack standard benchmarks based on really hard problems. We propose one of such hard benchmarks, and we hope to see future neural network optimizers tested on these problems before any claim of superiority is made.


title: $tt^*$ Toda equations for surface defects in ${\mathcal N}=2$ SYM and instanton counting for classical Lie groups

abstract: The partition function of $\mathcal{N}=2$ super Yang-Mills theories with arbitrary simple gauge group coupled to a self-dual $\Omega$-background is shown to be fully determined by studying the renormalization group equations relevant to the surface operators generating its one-form symmetries. The corresponding system of equations results in a ${\it non-autonomous}$ Toda chain on the root system of the Langlands dual, the evolution parameter being the RG scale. A systematic algorithm computing the full multi-instanton corrections is derived in terms of recursion relations whose gauge theoretical solution is obtained just by fixing the perturbative part of the IR prepotential as its asymptotic boundary condition for the RGE. We analyse the explicit solutions of the $\tau$-system for all the classical groups at the diverse levels, extend our analysis to affine twisted Lie algebras and provide conjectural bilinear relations for the $\tau$-functions of linear quiver gauge theory.


title: Immersive and Interactive Visualization of 3D Spatio-Temporal Data using a Space Time Hypercube

abstract: We propose an extension of the well-known Space-Time Cube (STC) visualization technique in order to visualize time-varying 3D spatial data, taking advantage of the interaction capabilities of Virtual Reality (VR). The analysis of multidimensional time-varying datasets, which size grows as recording and simulating techniques advance, faces challenges on the representation and visualization of dense data, as well as on the study of temporal variations. First, we propose the Space-Time Hypercube (STH) as an abstraction for 3D temporal data, extended from the STC concept. Second, through the example of embryo development imaging dataset, we detail the construction and visualization of a STC based on a user-driven projection of the spatial and temporal information. This projection yields a 3D STC visualization, which can also encode additional numerical and categorical data. Additionally, we propose a set of tools allowing the user to filter and manipulate the 3D STC which benefits from the visualization, exploration and interaction possibilities offered by VR. Finally, we evaluated the proposed visualization method in the context of the visualization of spatio-temporal biological data. Several biology experts accompanied the application design to provide insight on how the STC visualization could be used to explore such data. We report a user study (n=12) using non-expert users performing a set of exploration and query tasks to evaluate the system.


title: Few-Shot Stance Detection via Target-Aware Prompt Distillation

abstract: Stance detection aims to identify whether the author of a text is in favor of, against, or neutral to a given target. The main challenge of this task comes two-fold: few-shot learning resulting from the varying targets and the lack of contextual information of the targets. Existing works mainly focus on solving the second issue by designing attention-based models or introducing noisy external knowledge, while the first issue remains under-explored. In this paper, inspired by the potential capability of pre-trained language models (PLMs) serving as knowledge bases and few-shot learners, we propose to introduce prompt-based fine-tuning for stance detection. PLMs can provide essential contextual information for the targets and enable few-shot learning via prompts. Considering the crucial role of the target in stance detection task, we design target-aware prompts and propose a novel verbalizer. Instead of mapping each label to a concrete word, our verbalizer maps each label to a vector and picks the label that best captures the correlation between the stance and the target. Moreover, to alleviate the possible defect of dealing with varying targets with a single hand-crafted prompt, we propose to distill the information learned from multiple prompts. Experimental results show the superior performance of our proposed model in both full-data and few-shot scenarios.


title: Merger histories of brightest group galaxies from MUSE stellar kinematics

abstract: Using Multi-Unit Spectroscopic Explorer (MUSE) spectroscopy, we analyse the stellar kinematics of 18 brightest group early-type (BGEs) galaxies, selected from the Complete Local-Volume Groups Sample (CLoGS). We analyse the kinematic maps for distinct features, and measure specific stellar angular momentum within one effective radius ($\lambda_{e}$). We classify the BGEs as fast (10/18) or slow (8/18) rotators, suggesting at least two different evolution paths. We quantify the anti-correlation between higher-order kinematic moment $h_{3}$ and V/$\sigma$ (using the $\xi_{3}$ parameter), and the kinematic misalignment angle between the photometric and kinematic position angles (using the $\Psi$ parameter), and note clear differences between these parameter distributions of the fast and slow rotating BGEs. We find that all 10 of our fast rotators are aligned between the morphological and kinematical axis, consistent with an oblate galaxy shape, whereas the slow rotators are spread over all three classes: oblate (1/8), triaxial (4/8), and prolate (3/8). We place the results into context using known radio properties, X-ray properties, and observations of molecular gas. We find consistent merger histories inferred from observations for the fast-rotating BGEs, indicating that they experienced gas-rich mergers or interactions, and these are very likely the origin of the cold gas. Observational evidence for the slow rotators are consistent with gas-poor mergers. For the slow rotators with cold gas, all evidence point to cold gas cooling from the intragroup medium.


title: Clipping and Intersection Algorithms: Short Survey and References

abstract: This contribution presents a brief survey of clipping and intersection algorithms in E2 and E3 with a nearly complete list of relevant references. Some algorithms use the projective extension of the Euclidean space and vector-vector operations, which supports GPU and SSE use.


title: Center-Embedding and Constituency in the Brain and a New Characterization of Context-Free Languages

abstract: A computational system implemented exclusively through the spiking of neurons was recently shown capable of syntax, that is, of carrying out the dependency parsing of simple English sentences. We address two of the most important questions left open by that work: constituency (the identification of key parts of the sentence such as the verb phrase) and the processing of dependent sentences, especially center-embedded ones. We show that these two aspects of language can also be implemented by neurons and synapses in a way that is compatible with what is known, or widely believed, about the structure and function of the language organ. Surprisingly, the way we implement center embedding points to a new characterization of context-free languages.


title: Nonlocality and entropic uncertainty relations in neutrino oscillations

abstract: Using the wave-packet approach to neutrino oscillations, we analyze Quantum-Memory-Assisted Entropic Uncertainty Relations and show that uncertainty and the Non-local Advantage of Quantum Coherence are anti-correlated. Furthermore, we explore the hierarchy among three different definitions of NAQC, those based on the l1-norm, relative entropy and skew information coherence measures, and we find that the coherence content detected by the l1-norm based NAQC overcomes the other two. The connection between QMA-EUR and NAQC could provide a better understanding of the physical meaning of the results so far obtained, and suggest a their extension to quantum field theory.


title: A Dynamical Model of the M101 / NGC 5474 Encounter

abstract: We present the first dynamical simulation that recreates the major properties of the archetypal nearby spiral galaxy M101. Our model describes a grazing but relatively close (14 kpc) passage of the companion galaxy NGC 5474 through M101's outer disk approximately 200 Myr ago. The passage is retrograde for both disks, which yields a relatively strong gravitational response while suppressing the formation of long tidal tails. The simulation reproduces M101's overall lopsidedness, as well as the extended NE Plume and sharp western edge of the galaxy's disk. The post-starburst populations observed in M101's NE Plume are likely a result of star formation triggered at the point of contact where the galaxies collided. Over time, this material will mix azimuthally, leaving behind diffuse, kinematically coherent stellar streams in M101's outer disk. At late times after the encounter, the density profile of M101's disk shows a broken "upbending" profile similar to those seen in spiral galaxies in denser environments, further demonstrating the connection between interactions and long-term structural changes in galaxy disks.


title: Bilevel Optimization of the Kantorovich Problem and its Quadratic Regularization Part I: Existence Results

abstract: This paper is concerned with an optimization problem governed by the Kantorovich optimal transportation problem. This gives rise to a bilevel optimization problem, which can be reformulated as a mathematical problem with complementarity constraints in the space of regular Borel measures. Because of the non-smoothness induced by the complementarity relations, problems of this type are frequently regularized. Here we apply a quadratic regularization of the Kantorovich problem. As the title indicates, this is the first part in a series of three papers. It addresses the existence of optimal solutions to the bilevel Kantorovich problem and its quadratic regularization, whereas part II and III are dedicated to the convergence analysis for vanishing regularization.


title: Three principles of quantum computing

abstract: The point of building a quantum computer is that it allows to model living things with predictive power and gives the opportunity to control life. Its scaling means not just the improvement of the instrument part, but also, mainly, mathematical and software tools, and our understanding of the QC problem. The first principle of quantum modeling is the reduction of reality to finite-dimensional models similar to QED in optical cavities. The second principle is a strict limitation of the so-called Feynman principle, the number of qubits in the standard formulation of the QC. This means treating decoherence exclusively as a limitation of the memory of a classical modeling computer, and introducing corresponding progressive restrictions on the working area of the Hilbert space of quantum states as the model expands. The third principle is similarity in processes of different nature. The quantum nature of reality is manifested in this principle; its nature is quantum nonlocality, which is the main property that ensures the prospects of quantum physical devices and their radical advantage over classical ones.


title: ML-Based Approach for NFL Defensive Pass Interference Prediction Using GPS Tracking Data

abstract: Defensive Pass Interference (DPI) is one of the most impactful penalties in the NFL. DPI is a spot foul, yielding an automatic first down to the team in possession. With such an influence on the game, referees have no room for a mistake. It is also a very rare event, which happens 1-2 times per 100 pass attempts. With technology improving and many IoT wearables being put on the athletes to collect valuable data, there is a solid ground for applying machine learning (ML) techniques to improve every aspect of the game. The work presented here is the first attempt in predicting DPI using player tracking GPS data. The data we used was collected by NFL's Next Gen Stats throughout the 2018 regular season. We present ML models for highly imbalanced time-series binary classification: LSTM, GRU, ANN, and Multivariate LSTM-FCN. Results showed that using GPS tracking data to predict DPI has limited success. The best performing models had high recall with low precision which resulted in the classification of many false positive examples. Looking closely at the data confirmed that there is just not enough information to determine whether a foul was committed. This study might serve as a filter for multi-step pipeline for video sequence classification which could be able to solve this problem.


title: MultiSAGE: a multiplex embedding algorithm for inter-layer link prediction

abstract: Research on graph representation learning has received great attention in recent years. However, most of the studies so far have focused on the embedding of single-layer graphs. The few studies dealing with the problem of representation learning of multilayer structures rely on the strong hypothesis that the inter-layer links are known, and this limits the range of possible applications. Here we propose MultiSAGE, a generalization of the GraphSAGE algorithm that allows to embed multiplex networks. We show that MultiSAGE is capable to reconstruct both the intra-layer and the inter-layer connectivity, outperforming GraphSAGE, which has been designed for simple graphs. Next, through a comprehensive experimental analysis, we shed light also on the performance of the embedding, both in simple and in multiplex networks, showing that either the density of the graph or the randomness of the links strongly influences the quality of the embedding.


title: Boosting the sensitivity of high frequency gravitational wave detectors by PT-symmetry

abstract: The kilo-Hertz gravitational waves radiated by the neutron star merger remnants carry rich information about the physics of high-density nuclear matter states, and many important astrophysical phenomena such as gamma-ray bursts and black hole formation. Current laser interferometer gravitational wave detectors, such as LIGO, VIRGO, and KAGRA have limited signal response at the kilo-Hertz band, thereby unable to capture these important physical phenomena. This work proposes an alternative protocol for boosting the sensitivity of the gravitational wave detectors at high frequency by implementing an optomechanical quantum amplifier. With the auxiliary quantum amplifier, this design has the feature of Parity-Time (PT) symmetry so that the detection band will be significantly broadened within the kilo-Hertz range. In this work, we carefully analyze the quantum-noise-limited sensitivity and the dynamical stability of this design. Based on our protocol, our result shows that the quantum-noise-limited sensitivity will be improved by one order of magnitude around 3kHz, which indicates the potential of our design for a future search of neutron star merger signals.


title: Exploring domain adaptation for deep neural network trained QSM

abstract: Quantitative susceptibility mapping (QSM) is a MRI technique that estimates tissue magnetic susceptibility. The generation of QSM requires solving a challenging ill-posed field-to-source inversion problem. Recently, several deep learning (DL) QSM techniques have been proposed and demonstrated impressive performance. Due to the inherent non-existent ground-truth QSM references, these techniques used either COSMOS maps or synthetic data for network training. Synthetic data is easy to generate but often adapt poorly to in-vivo data due to domain shifts. Here, we introduce an easy domain adaptation technique using domain-specific batch normalization to address this problem.


title: Some applications of modular convergence in vector lattice setting

abstract: The main purpose of this paper is to apply the theory of vector lattices and the related abstract modular convergence to the context of Mellin-type kernels and (non)linear vector lattice-valued operators, following the construction of an integral given in earlier papers.


title: A variational derivation of the field equations of an action-dependent Einstein-Hilbert Lagrangian

abstract: We derive the equations of motion of an action-dependent version of the Einstein-Hilbert Lagrangian, as a specific instance of the Herglotz variational problem. Action-dependent Lagrangians lead to dissipative dynamics, which cannot be obtained with the standard method of Lagrangian field theory. First-order theories of this kind are relatively well understood, but examples of singular or higher-order action-dependent field theories are scarce. This work constitutes an example of such a theory. By casting the problem in clear geometric terms we are able to obtain a Lorentz invariant set of equations, which contrasts with previous attempts.


title: NLTS Hamiltonians from good quantum codes

abstract: The NLTS (No Low-Energy Trivial State) conjecture of Freedman and Hastings [2014] posits that there exist families of Hamiltonians with all low energy states of non-trivial complexity (with complexity measured by the quantum circuit depth preparing the state). We prove this conjecture by showing that the recently discovered families of constant-rate and linear-distance QLDPC codes correspond to NLTS local Hamiltonians.


title: Harnack inequality for nonlinear parabolic equations under integral Ricci curvature bounds

abstract: Let $(M^{n},g)$ be a complete Riemannian manifold. In this paper, we establish a space-time gradient estimates for positive solutions of nonlinear parabolic equations $$\partial_{t}u(x,t)=\Delta u(x,t)+a u(x,t)(\log u(x,t))^b + q(x,t)A(u(x,t)),$$ on geodesic balls $B(O,r)$ in $M$ with $0<r\leq r$ for $p>\frac{n}{2}$ when integral Ricci curvature $k(p,1)$ is small enough. By integrating the gradient estimates, we find the corresponding Harnack inequalities.


title: Active TLS Stack Fingerprinting: Characterizing TLS Server Deployments at Scale

abstract: Active measurements can be used to collect server characteristics on a large scale. This kind of metadata can help discovering hidden relations and commonalities among server deployments offering new possibilities to cluster and classify them. As an example, identifying a previously-unknown cybercriminal infrastructures can be a valuable source for cyber-threat intelligence. We propose herein an active measurement-based methodology for acquiring Transport Layer Security (TLS) metadata from servers and leverage it for their fingerprinting. Our fingerprints capture the characteristic behavior of the TLS stack primarily caused by the implementation, configuration, and hardware support of the underlying server. Using an empirical optimization strategy that maximizes information gain from every handshake to minimize measurement costs, we generated 10 general-purpose Client Hellos used as scanning probes to create a large database of TLS configurations used for classifying servers. We fingerprinted 28 million servers from the Alexa and Majestic toplists and two Command and Control (C2) blocklists over a period of 30 weeks with weekly snapshots as foundation for two long-term case studies: classification of Content Delivery Network and C2 servers. The proposed methodology shows a precision of more than 99 % and enables a stable identification of new servers over time. This study describes a new opportunity for active measurements to provide valuable insights into the Internet that can be used in security-relevant use cases.


title: QbyE-MLPMixer: Query-by-Example Open-Vocabulary Keyword Spotting using MLPMixer

abstract: Current keyword spotting systems are typically trained with a large amount of pre-defined keywords. Recognizing keywords in an open-vocabulary setting is essential for personalizing smart device interaction. Towards this goal, we propose a pure MLP-based neural network that is based on MLPMixer - an MLP model architecture that effectively replaces the attention mechanism in Vision Transformers. We investigate different ways of adapting the MLPMixer architecture to the QbyE open-vocabulary keyword spotting task. Comparisons with the state-of-the-art RNN and CNN models show that our method achieves better performance in challenging situations (10dB and 6dB environments) on both the publicly available Hey-Snips dataset and a larger scale internal dataset with 400 speakers. Our proposed model also has a smaller number of parameters and MACs compared to the baseline models.


title: Conformer Based Elderly Speech Recognition System for Alzheimer's Disease Detection

abstract: Early diagnosis of Alzheimer's disease (AD) is crucial in facilitating preventive care to delay further progression. This paper presents the development of a state-of-the-art Conformer based speech recognition system built on the DementiaBank Pitt corpus for automatic AD detection. The baseline Conformer system trained with speed perturbation and SpecAugment based data augmentation is significantly improved by incorporating a set of purposefully designed modeling features, including neural architecture search based auto-configuration of domain-specific Conformer hyper-parameters in addition to parameter fine-tuning; fine-grained elderly speaker adaptation using learning hidden unit contributions (LHUC); and two-pass cross-system rescoring based combination with hybrid TDNN systems. An overall word error rate (WER) reduction of 13.6% absolute (34.8% relative) was obtained on the evaluation data of 48 elderly speakers. Using the final systems' recognition outputs to extract textual features, the best-published speech recognition based AD detection accuracy of 91.7% was obtained.


title: Effective-action model for dynamical scalarization beyond the adiabatic approximation

abstract: In certain scalar-field extensions to general relativity, scalar charges can develop on compact objects in an inspiraling binary -- an effect known as dynamical scalarization. This effect can be modeled using effective-field-theory methods applied to the binary within the post-Newtonian approximation. Past analytic investigations focused on the adiabatic (or quasi-stationary) case for quasi-circular orbits. In this work, we explore the full dynamical evolution around the phase transition to the scalarized regime. This allows for generic (eccentric) orbits and to quantify nonadiabatic (e.g., oscillatory) behavior during the phase transition. We also find that even in the circular-orbit case, the onset of scalarization can only be predicted reliably when taking the full dynamics into account, i.e., the adiabatic approximation is not appropriate. Our results pave the way for accurate post-Newtonian predictions for dynamical scalarization effects in gravitational waves from compact binaries.


title: A physical perturbation based study on the prediction of free-fall disks with chaotic modes in the water

abstract: We report a phenomenon that physical perturbations sometimes can benefit the certainty of a free-fall motion with chaotic modes, albeit, as commonly believed, they can ruin it. We statistically compare those factors that may lead to uncertainty, by which we find that the growth of the standard deviation of the landing locations is directly determined by the physical perturbations. A significant yardstick is defined in the meantime. This temporal criterion is of big relevance to the replicability of such problems experimentally, although they are inherently chaotic. Our hypothesis is verified by experiments from other literature. This outcome also provides a practical strategy to evaluate the credible prediction time by estimating the disturbances from physical parameters as a priori.


title: Bayesian Neural Network Detector for an Orthogonal Time Frequency Space Modulation

abstract: The orthogonal time-frequency space (OTFS) modulation is proposed for beyond 5G wireless systems to deal with high mobility communications. The existing low complexity OTFS detectors exhibit poor performance in rich scattering environments where there are a large number of moving reflectors that reflect the transmitted signal towards the receiver. In this paper, we propose an OTFS detector, referred to as the BPICNet OTFS detector that integrates NN, Bayesian inference, and parallel interference cancellation concepts. Simulation results show that the proposed OTFS detector significantly outperforms the state-of-the-art.


title: Pruned RNN-T for fast, memory-efficient ASR training

abstract: The RNN-Transducer (RNN-T) framework for speech recognition has been growing in popularity, particularly for deployed real-time ASR systems, because it combines high accuracy with naturally streaming recognition. One of the drawbacks of RNN-T is that its loss function is relatively slow to compute, and can use a lot of memory. Excessive GPU memory usage can make it impractical to use RNN-T loss in cases where the vocabulary size is large: for example, for Chinese character-based ASR. We introduce a method for faster and more memory-efficient RNN-T loss computation. We first obtain pruning bounds for the RNN-T recursion using a simple joiner network that is linear in the encoder and decoder embeddings; we can evaluate this without using much memory. We then use those pruning bounds to evaluate the full, non-linear joiner network.


title: The DEBS 2022 Grand Challenge: Detecting Trading Trends in Financial Tick Data

abstract: The DEBS Grand Challenge (GC) is an annual programming competition open to practitioners from both academia and industry. The GC 2022 edition focuses on real-time complex event processing of high-volume tick data provided by Infront Financial Technology GmbH. The goal of the challenge is to efficiently compute specific trend indicators and detect patterns in these indicators like those used by real-life traders to decide on buying or selling in financial markets. The data set Trading Data used for benchmarking contains 289 million tick events from approximately 5500+ financial instruments that had been traded on the three major exchanges Amsterdam (NL), Paris (FR), and Frankfurt am Main (GER) over the course of a full week in 2021. The data set is made publicly available. In addition to correctness and performance, submissions must explicitly focus on reusability and practicability. Hence, participants must address specific nonfunctional requirements and are asked to build upon open-source platforms. This paper describes the required scenario and the data set Trading Data, defines the queries of the problem statement, and explains the enhancements made to the evaluation platform Challenger that handles data distribution, dynamic subscriptions, and remote evaluation of the submissions.


title: SR-DEM: an efficient discrete element method for particles with surface of revolution

abstract: In this paper, the surface of revolution discrete element method (SR-DEM) is introduced to simulate systems of particles with closed surfaces of revolution. Due to the cylindrical symmetry of a surface of revolution, the geometry of any cross-section about the axis of rotation remains the same. Taking advantage of this geometric feature, a node-to-cross-section contact algorithm is proposed for efficient contact detection between particles with a surface of revolution. In our SR-DEM framework, the contact algorithm is realized in a master-slave fashion: the master particle is approximated by its surface nodes, while the slave particle is represented by a signed distance field (SDF) of the cross-section about the axis of rotation. This hybrid formulation in both 2D and 3D space allows a very efficient contact calculation yet relatively simple code implementation. We then apply SR-DEM to simulate particle-particle, particle-wall impact, granular packing in a cylindrical container, and tablets in a rotating drum, to demonstrate SR-DEM's ability to predict the post-impact velocities, packing porosity, and dynamic angle of repose, respectively. Finally, we suggest a simple approach to find an optimal surface resolution, by increasing the number of surface nodes until some of the bulk properties that could characterize the system converge.


title: GFET Lab: A Graphene Field-Effect Transistor TCAD Tool

abstract: Graphene field-effect transistors (GFETs) are experimental devices which are increasingly seeing commercial and research applications. Simulation and modelling forms an important stage in facilitating this transition, however the majority of GFET modelling relies on user implementation. To this end, we present GFET Lab, a user-friendly, open-source software tool for simulating GFETs. We first provide an overview of approaches to device modelling and a brief survey of GFET compact models and limitations. From this survey, we identify three key criteria for a suitable predictive model for circuit design: it must be a compact model; it must be SPICE-compatible; it must have a minimal number of fitting parameters. We selected Jimenez's drain-current model as it best matched these criteria, and we introduce some modifications to improve the predictive properties, namely accounting for saturation velocity and the asymmetry in n- and p-type carrier mobilities. We then validate the model by comparing GFETs simulated in our tool against experimentally-obtained GFET characteristics with the same materials and geometries and find good agreement between GFET Lab and experiment. We demonstrate the ability to export SPICE models for use in higher level circuit simulations and compare SPICE simulations of GFETs against GFETs simulated in GFET Lab, again showing good agreement. Lastly, we provide a brief tutorial of GFET Lab to demonstrate and encourage its use as a community-developed piece of software with both research and educational applications.


title: A Simple Baseline for Domain Adaptation in End to End ASR Systems Using Synthetic Data

abstract: Automatic Speech Recognition(ASR) has been dominated by deep learning-based end-to-end speech recognition models. These approaches require large amounts of labeled data in the form of audio-text pairs. Moreover, these models are more susceptible to domain shift as compared to traditional models. It is common practice to train generic ASR models and then adapt them to target domains using comparatively smaller data sets. We consider a more extreme case of domain adaptation where text-only corpus is available. In this work, we propose a simple baseline technique for domain adaptation in end-to-end speech recognition models. We convert the text-only corpus to audio data using single speaker Text to Speech (TTS) engine. The parallel data in the target domain is then used to fine-tune the final dense layer of generic ASR models. We show that single speaker synthetic TTS data coupled with final dense layer only fine-tuning provides reasonable improvements in word error rates. We use text data from address and e-commerce search domains to show the effectiveness of our low-cost baseline approach on CTC and attention-based models.


title: Kramers-Kronig relations and the analogy between electromagnetic and mechanical waves

abstract: The important consequence of the Kramers-Kronig relations (KKrs) is that dissipative behavior in material media inevitably implies the existence of dispersion, i.e., a frequency dependence in the constitutive equations. Basically, the relations are the frequency-domain expression of causality and correspond mathematically to pairs of Hilbert transforms. The relations have many forms and can be obtained with diverse mathematical tools. Here, two different demonstrations are given in the electromagnetic case, illustrating the eclectic mathematical apparatus available for this purpose. Then, we apply the acoustic (mechanical)-electromagnetic analogy to obtain the elastic versions. Finally, we discuss the concepts of stability and passivity and provide a novel algorithm to compute the relations numerically by using the fast Fourier transform.


title: Some Characterizations of Quasi Yamabe solitons

abstract: In this article, we have proved some results in connection with the potential vector field having finite global norm in quasi Yamabe soliton. We have derived some criteria in particular for the potential vector field on the non-positive Ricci curvature of the quasi Yamabe soliton. Also, a necessary condition for a compact quasi Yamabe soliton has been formulated. We further showed that if the potential vector field has a finite global norm in a complete non-trivial, non-compact quasi Yamabe soliton with finite volume, then the scalar curvature becomes constant and the soliton reduces to a Yamabe soliton.


title: A modified Bragg's law of Class I Bragg resonances of linear long waves excited by an array of artificial bars

abstract: Based on the band theory of Bloch waves, a modified Bragg's law is established for Class I Bragg resonances when linear long waves are reflected by a finite periodic array of artificial bars, including rectangular, parabolic, rectified cosinoidal, isosceles trapezoidal, and isosceles triangular bars. The modified Bragg's law is described by a function of several parameters such as the bar shape, dimensionless bar height with respect to the global water depth, and dimensionless bar width with respect to the incident wavelength. It is found that Bragg's law is just a limiting case of the modified Bragg's law as the bar height or width approaches zero. This fact tells us that the Bragg's law that accurately describes Bragg resonances in X-ray crystallography cannot be simply applied to Bragg resonances of linear long water waves excited by any finite periodic array of artificial bars, because the height and width of any artificial bar cannot be zero. Based on the modified Bragg's law, the phenomenon of phase downshifting can be well explained and accurately predicted. It is revealed that the phase downshifting becomes more significant with increasing the cross-sectional area of artificial bars.


title: Using the Jacobi-Trudi formula to compute Stirling determinants

abstract: We use the Jacobi-Trudi formula to execute "explicit" evaluation of determinants of Stirling numbers of both kinds. We also offer a Maple package accompanying the paper on the personal websites at the end of the second page.


title: Performance Evaluation of Dynamic Metasurface Antennas: Impact of Insertion Losses and Coupling

abstract: This paper evaluates the performance of multi-user massive multiple-input multiple-output (MIMO) systems in which the base station is equipped with a dynamic metasurface antenna (DMA). Due to the physical implementation of DMAs, conventional models widely-used in MIMO are no longer valid, and electromagnetic phenomena such as mutual coupling, insertion losses and reflections inside the waveguides need to be considered. Hence, starting from a recently proposed electromagnetic model for DMAs, we formulate a zero-forcing optimization problem, yielding an unconstrained objective function with known gradient. The performance is compared with that of full-digital and hybrid massive MIMO, focusing on the impact of insertion losses and mutual coupling.


title: Prediction of Football Player Value using Bayesian Ensemble Approach

abstract: The transfer fees of sports players have become astronomical. This is because bringing players of great future value to the club is essential for their survival. We present a case study on the key factors affecting the world's top soccer players' transfer fees based on the FIFA data analysis. To predict each player's market value, we propose an improved LightGBM model by optimizing its hyperparameter using a Tree-structured Parzen Estimator (TPE) algorithm. We identify prominent features by the SHapley Additive exPlanations (SHAP) algorithm. The proposed method has been compared against the baseline regression models (e.g., linear regression, lasso, elastic net, kernel ridge regression) and gradient boosting model without hyperparameter optimization. The optimized LightGBM model showed an excellent accuracy of approximately 3.8, 1.4, and 1.8 times on average compared to the regression baseline models, GBDT, and LightGBM model in terms of RMSE. Our model offers interpretability in deciding what attributes football clubs should consider in recruiting players in the future.


title: Upgrade of the ALICE experiment beyond LHC Run 3

abstract: The ALICE Collaboration completed the upgrade of the detector and is now commissioning for the beginning of the data taking during LHC Run 3. In parallel, R&D activities and simulation studies are being performed to define the future of the experiment beyond LHC Run 3. Two detector upgrades are foreseen for the next long shutdown (LS3). The first is the replacement of the three layers of the inner tracking system closest to the beam with a novel vertex detector consisting of curved wafer-scale ultra-thin silicon sensors arranged in perfectly cylindrical layers to improve impact parameter resolution and significantly extend the physics capability for the study of the heavy-flavor production and the low-mass dielectrons. The second upgrade for the LS3 is the addition of a Forward Calorimeter detector at large rapidity consisting of a Si-W electromagnetic calorimeter with pad and pixel readout, that will equip the experiment with unique capabilities to measure small-x gluon distributions via prompt photon production. A proposal of a next-generation heavy-ion experiment for LHC Run 5 is also in preparation and will be discussed. The aim is to perform novel measurements of the electromagnetic and hadronic probes of the QGP, such as the production of multiply-charmed baryons, which have so far been inaccessible, both because of detector performance and luminosity. The concept of the new apparatus foresees an extensive usage of thin silicon sensors for tracking and a modern particle identification system, combining a silicon-based time of flight detector, a RICH detector, an electromagnetic calorimeter and a muon system.


title: Adaptation to a changing environment: what me Normal?

abstract: Predicting the adaptation of populations to a changing environment is crucial to assess the impact of human activities on biodiversity. Many theoretical studies have tackled this issue by modeling the evolution of quantitative traits subject to stabilizing selection around an optimum phenotype, whose value is shifted continuously through time. In this context, the population fate results from the equilibrium distribution of the trait, relative to the moving optimum. Such a distribution may vary with the shape of selection, the system of reproduction, the number of loci, the mutation kernel or their interactions. Here, we develop a methodology that provides quantitative measures of population maladaptation and potential of survival directly from the entire profile of the phenotypic distribution, without any a priori on its shape.We investigate two different models of reproduction (asexual and infinitesimal sexual models of inheritance), with general forms of selection.In particular, we recover that fitness functions such that selection weakens away from the optimum lead to evolutionary tipping points, with an abrupt collapse of the population when the speed of environmental change is too high. Our unified framework furthermore allows highlighting the underlying mechanisms that lead to this phenomenon. More generally, it allows discussing similarities and discrepancies between the two reproduction models, the latter being ultimately explained by different constraints on the evolution of the phenotypic variance. We demonstrate that the mean fitness in the population crucially depends on the shape of the selection function in the sexual infinitesimal model, in contrast with the asexual model.In the asexual model, we also investigate the effect of the mutation kernel and we show that kernels with higher kurtosis tend to reduce maladaptation and improve fitness, especially in fast changing environments.


title: Resonant tunneling in graphene-ferroelectric-graphene junctions

abstract: We study tunnel junctions consisting of a two-dimensional ferroelectric (FE) material sandwiched between graphene electrodes. We formulate a theory for the interplay of the FE polarization and induced free charges in such devices, taking into account quantum capacitance effects. We predict a gate-sensitive FE voltage difference across the device, which can be measured using electrostatic force microscopy. Incorporating this electrostatic theory in the tunneling current-voltage characteristics, we identify a resonance peak associated with aligned Dirac cones as a highly sensitive probe of the FE polarization of the junction. This opens the way for device applications with few atom-thick FE layers acting as readable ultra-high-density memory.


title: Pragmatic distributionally robust optimization for simple integer recourse models

abstract: Inspired by its success for their continuous counterparts, the standard approach to deal with mixed-integer recourse (MIR) models under distributional uncertainty is to use distributionally robust optimization (DRO). We argue, however, that this modeling choice is not always justified, since DRO techniques are generally computationally extremely challenging when integer decision variables are involved. That is why we propose a fundamentally different approach for MIR models under distributional uncertainty aimed at obtaining models with improved computational tractability. For the special case of simple integer recourse (SIR) models, we show that tractable models can be obtained by pragmatically selecting the uncertainty set. Here, we consider uncertainty sets based on the Wasserstein distance and also on generalized moment conditions. We compare our approach with standard DRO and discuss potential generalizations of our ideas to more general MIR models. An important side-result of our analysis is the derivation of performance guarantees for convex approximations of SIR models. In contrast with the literature, these error bounds are not only valid for continuous distribution, but hold for any distribution.


title: The longest perimeter small triacontadigon

abstract: We showcase a small triacontadigon, i.e. a convex $32$-gon of unit diameter, with perimeter $3.1403311569546$, which improves on all examples available so far.


title: Lower Bound on Translative Covering Density of Tetrahedra

abstract: In this paper, we present the first nontrivial lower bound on the translative covering density of tetrahedra. To this end, we show the lower bound, in any translative covering of tetrahedra, on the density relative to a given cube. The resulting lower bound on the translative covering density of tetrahedra is $1+1.227\times10^{-3}$.


title: The relation between symmetries and coincidence and collinearity of polygon centers and centers of multisets of points in the plane

abstract: There are several remarkable points, defined for polygons and multisets of points in the plane, called centers (such as the centroid). To make possible their study, there exists a formal definition for the concept of center in both cases. In this paper, the relation between symmetries of polygons and multisets of points in the plane and the coincidence and collinearity of their centers is studied. First, a precise statement for the problem is given. Then, it is proved that, given a polygon or a multiset of points in the plane, a given point in the plane is a center for this object if and only if it belongs to the set of points fixed by its group of symmetries.


title: Sample compression schemes for balls in graphs

abstract: One of the open problems in machine learning is whether any set-family of VC-dimension $d$ admits a sample compression scheme of size $O(d)$. In this paper, we study this problem for balls in graphs. For a ball $B=B_r(x)$ of a graph $G=(V,E)$, a realizable sample for $B$ is a signed subset $X=(X^+,X^-)$ of $V$ such that $B$ contains $X^+$ and is disjoint from $X^-$. A proper sample compression scheme of size $k$ consists of a compressor and a reconstructor. The compressor maps any realizable sample $X$ to a subsample $X'$ of size at most $k$. The reconstructor maps each such subsample $X'$ to a ball $B'$ of $G$ such that $B'$ includes $X^+$ and is disjoint from $X^-$. For balls of arbitrary radius $r$, we design proper labeled sample compression schemes of size $2$ for trees, of size $3$ for cycles, of size $4$ for interval graphs, of size $6$ for trees of cycles, and of size $22$ for cube-free median graphs. For balls of a given radius, we design proper labeled sample compression schemes of size $2$ for trees and of size $4$ for interval graphs. We also design approximate sample compression schemes of size 2 for balls of $\delta$-hyperbolic graphs.


title: Knowledge-aware Neural Collective Matrix Factorization for Cross-domain Recommendation

abstract: Cross-domain recommendation (CDR) can help customers find more satisfying items in different domains. Existing CDR models mainly use common users or mapping functions as bridges between domains but have very limited exploration in fully utilizing extra knowledge across domains. In this paper, we propose to incorporate the knowledge graph (KG) for CDR, which enables items in different domains to share knowledge. To this end, we first construct a new dataset AmazonKG4CDR from the Freebase KG and a subset (two domain pairs: movies-music, movie-book) of Amazon Review Data. This new dataset facilitates linking knowledge to bridge within- and cross-domain items for CDR. Then we propose a new framework, KG-aware Neural Collective Matrix Factorization (KG-NeuCMF), leveraging KG to enrich item representations. It first learns item embeddings by graph convolutional autoencoder to capture both domain-specific and domain-general knowledge from adjacent and higher-order neighbours in the KG. Then, we maximize the mutual information between item embeddings learned from the KG and user-item matrix to establish cross-domain relationships for better CDR. Finally, we conduct extensive experiments on the newly constructed dataset and demonstrate that our model significantly outperforms the best-performing baselines.


title: A Topic-Attentive Transformer-based Model For Multimodal Depression Detection

abstract: Depression is one of the most common mental disorders, which imposes heavy negative impacts on one's daily life. Diagnosing depression based on the interview is usually in the form of questions and answers. In this process, the audio signals and their text transcripts of a subject are correlated to depression cues and easily recorded. Therefore, it is feasible to build an Automatic Depression Detection (ADD) model based on the data of these modalities in practice. However, there are two major challenges that should be addressed for constructing an effective ADD model. The first challenge is the organization of the textual and audio data, which can be of various contents and lengths for different subjects. The second challenge is the lack of training samples due to the privacy concern. Targeting to these two challenges, we propose the TOpic ATtentive transformer-based ADD model, abbreviated as TOAT. To address the first challenge, in the TOAT model, topic is taken as the basic unit of the textual and audio data according to the question-answer form in a typical interviewing process. Based on that, a topic attention module is designed to learn the importance of of each topic, which helps the model better retrieve the depressed samples. To solve the issue of data scarcity, we introduce large pre-trained models, and the fine-tuning strategy is adopted based on the small-scale ADD training data. We also design a two-branch architecture with a late-fusion strategy for building the TOAT model, in which the textual and audio data are encoded independently. We evaluate our model on the multimodal DAIC-WOZ dataset specifically designed for the ADD task. Experimental results show the superiority of our method. More importantly, the ablation studies demonstrate the effectiveness of the key elements in the TOAT model.


title: Finite Littlestone Dimension Implies Finite Information Complexity

abstract: We prove that every online learnable class of functions of Littlestone dimension $d$ admits a learning algorithm with finite information complexity. Towards this end, we use the notion of a globally stable algorithm. Generally, the information complexity of such a globally stable algorithm is large yet finite, roughly exponential in $d$. We also show there is room for improvement; for a canonical online learnable class, indicator functions of affine subspaces of dimension $d$, the information complexity can be upper bounded logarithmically in $d$.


title: Bulk-like magnetic properties in MBE-grown unstrained, antiferromagnetic CuMnSb

abstract: A detailed study of the influence of molecular beam epitaxial growth conditions on the structural and magnetic characteristics of CuMnSb films on lattice matched GaSb is presented. For a set of nine 40~nm thick layers, the Mn and Sb fluxes are varied to produce material with different elemental compositions. It is found that the layers grown under a relative Mn to Sb flux ratio of $\Phi_{\text{Mn}}$/$\Phi_{\text{Sb}}=1.24\pm0.02$ are closest to the stoichiometric composition, for which the N\'{e}el temperature ($T_\text{N}$) attains its maximum values. Mn-related structural defects are believed to be the driving contribution to changes in the vertical lattice parameter. Having established the optimum growth conditions, a second set of samples with CuMnSb layer thickness varied from 5 to 510 nm is fabricated. We show that for sufficiently large thicknesses, the magnetic characteristics ($T_\text{N}\simeq62$ K, Curie-Weiss temperature $\Theta_\text{CW} = -100$ K) of the stoichiometric layers do correspond to the parameters reported for bulk samples. On the other hand, we observe a reduction of $T_\text{N}$ as a function of the CuMnSb thickness for our thinnest layers. All findings reported here are of particular relevance for studies aiming at the demonstration of N\'{e}el vector switching and detection in this noncentrosymmetric antiferromagnet, which have been recently proposed.


title: User's Guide Project: Looking Back and Looking Forward

abstract: In 2014 Luke Wolcott created the User's Guide Project in which a group of algebraic topologists came together to write user's guides to coincide with their research papers in hopes of making their research more accessible. We examine the role of this innovative project within the greater mathematics community. We discuss the structure and history of the project, its impact on the community, and its value to the participants of the project. We end by encouraging the math community to recognize the value of the project and expand the User's Guide Project to other subfields.


title: From Si Nanowires to Ge Nanocrystals for VIS-NIR-SWIR Sensors and Non-volatile Memories: A Review

abstract: Nanocrystalline Si and Ge are of high interest for integrated Si photonics related to light emission, optical sensors, photodetectors, solar energy harvesting and conversion devices, and also for floating gate non-volatile memories (NVMs). In this review, we have focused on nanocrystalline porous Si (nc-PS) with extension to Si nanodots, and Ge nanocrystals (NCs)/quantum dots (QDs)/nanoparticles (NPs) embedded in oxides (SiO$_2$, TiO$_2$, HfO$_2$, Al$_2$O$_3$). The great asset of nc-PS is its intense photoluminescence in VIS at room temperature (RT), while Ge NCs/NPs embedded in oxides show high photosensitivity in VIS-NIR-SWIR in the spectral photocurrent up to 1325 nm at RT. Ge NCs/NPs/QDs floating gate NVMs present high memory performance, the retention characteristics corresponding to the state of the art for NCs floating gate NVMs. We prove the relevance of controlling the preparation parameters for obtaining films with targeted photoluminescence, photosensitivity and charge storage properties for applications, e.g. VIS-NIR-SWIR optical sensors and photodetectors, and electronic and photoelectric NVMs. We evidence the correlation of preparation conditions, morphology, composition and crystalline structure with optical, electrical, photoelectrical and charge storage properties and also evidence the contribution of quantum confinement effect, localized states and trapping centers.


title: On single distribution lattice Boltzmann schemes for the approximation of Navier Stokes equations

abstract: In this contribution we study the formal ability of a multi-resolution-times lattice Boltzmann scheme to approximate isothermal and thermal compressible Navier Stokes equations with a single particle distribution. More precisely, we consider a total of 12 classical square lattice Boltzmann schemes with prescribed sets of conserved and nonconserved moments. The question is to determine the algebraic expressions of the equilibrium functions for the nonconserved moments and the relaxation parameters associated to each scheme. We compare the fluid equations and the result of the Taylor expansion method at second order accuracy for bidimensional examples with a maximum of 17 velocities and three-dimensional schemes with at most 33 velocities. In some cases, it is not possible to fit exactly the physicalmodel. For several examples, we adjust the Navier Stokes equations and propose nontrivial expressions for the equilibria.


title: Three-dimensional TQFTs via string-nets and two-dimensional surgery

abstract: If $C$ is a spherical fusion category, the string-net construction associates to each closed oriented surface $\Sigma$ the vector space $Z_\text{SN}(\Sigma)$ of linear combinations of $C$-labelled graphs on $\Sigma$ modulo local relations, in a way which is functorial with respect to orientation-preserving diffeomorphisms of surfaces. We show how to extend this assignment to a 3-dimensional topological quantum field theory (TQFT), by defining how the surgery generators in Juh\'{a}sz' presentation of the oriented 3-dimensional bordism category act on the string-net vector spaces. We show that the resulting TQFT, which is formulated completely in the two-dimensional graphical language of string-nets, is an alternative description of the Turaev-Viro state sum model.


title: Learning with Weak Annotations for Robust Maritime Obstacle Detection

abstract: Robust maritime obstacle detection is critical for safe navigation of autonomous boats and timely collision avoidance. The current state-of-the-art is based on deep segmentation networks trained on large datasets. However, per-pixel ground truth labeling of such datasets is labor-intensive and expensive. We propose a new scaffolding learning regime (SLR) that leverages weak annotations consisting of water edges, the horizon location, and obstacle bounding boxes to train segmentation-based obstacle detection networks, thereby reducing the required ground truth labeling effort by a factor of twenty. SLR trains an initial model from weak annotations and then alternates between re-estimating the segmentation pseudo-labels and improving the network parameters. Experiments show that maritime obstacle segmentation networks trained using SLR on weak annotations not only match but outperform the same networks trained with dense ground truth labels, which is a remarkable result. In addition to the increased accuracy, SLR also increases domain generalization and can be used for domain adaptation with a low manual annotation load. The SLR code and pre-trained models are available at https://github.com/lojzezust/SLR .


title: Estimation of statistics of transitions and Hill relation for Langevin dynamics

abstract: In molecular dynamics, statistics of transitions, such as the mean transition time, are macroscopic observables which provide important dynamical information on the underlying microscopic stochastic process. A direct estimation using simulations of microscopic trajectories over long time scales is typically computationally intractable in metastable situations. To overcome this issue, several numerical methods rely on a potential-theoretic identity, sometimes attributed to Hill in the computational statistical physics litterature, which expresses statistics of transitions in terms of the invariant measure of the sequence of configurations by which the underlying process enters metastable sets. The use of this identity then allows to replace the long time simulation problem with a rare event sampling problem, for which efficient algorithms are available. In this article, we rigorously analyse such a method for molecular systems modelled by the Langevin dynamics. Our main contributions are twofold. First, we prove the Hill relation in the fairly general context of positive Harris recurrent chains, and show that this formula applies to the Langevin dynamics. Second, we provide an explicit expression of the invariant measure involved in the Hill relation, and describe an elementary exact simulation procedure. Overall, this yields a simple and complete numerical method to estimate statistics of transitions.


title: Non-Hermitian Hamiltonians for Linear and Nonlinear Optical Response: a Model for Plexcitons

abstract: In polaritons, the properties of matter are modified by mixing the molecular transitions with light modes inside a cavity. Resultant hybrid light-matter states exhibit energy level shifts, are delocalized over many molecular units and have a different excited-state potential energy landscape which leads to modified exciton dynamics. Previously, non-Hermitian Hamiltonians have been derived to describe the excited states of molecules coupled to surface plasmons (i.e. plexcitons), and these operators have been successfully used in the description of linear and third order optical response. In this article, we rigorously derive non-Hermitian Hamiltonians in the response function formalism of nonlinear spectroscopy by means of Feshbach operators, and apply them to explore spectroscopic signatures of plexcitons. In particular we analyze the optical response below and above the exceptional point that arises for matching transition energies for plasmon and molecular components, and study their decomposition using double-sided Feynman diagrams. We find a clear distinction between interference and Rabi splitting in linear spectroscopy, and a qualitative change in the symmetry of the lineshape of the nonlinear signal when crossing the exceptional. This change corresponds to one in the symmetry of the eigenvalues of the Hamiltonian. Our work presents an approach for simulating the optical response of sublevels within an electronic system, and opens new applications of nonlinear spectroscopy to examine the different regimes of the spectrum of non-Hermitian Hamiltonians.


title: Ultra-fast synthesis and thermodynamic analysis of MoAlB by self-propagating high temperature combustion synthesis

abstract: MoAlB as a typical member of the MAB phases has attracted much growing attention due to its unique properties. However, the low production of MoAlB powders limits its further development and potential applications. To respond this challenge, the ultra-fast preparation of high-purity MoAlB powders is achieved in a few seconds by self-propagating high temperature combustion synthesis (SHS) using the raw powder mixture at the atomic ratio of 1Mo/1.3Al/1B. The reaction mechanism in SHS process was obtained by analyzing the corresponding composition changes of starting materials. Furthermore, the thermodynamic prediction for the SHS reaction of Mo + (1+y)Al + B = MoAlB + yAl is consistent with the present experiments, where the preparation of MoAlB also conforms to two common self-propagating conditions of SHS. Enthalpy vs temperature curve shows that the adiabatic temperature of the reaction decreases with increasing the amount of excuse Al, but increase when pre-heating the reactants. The thermodynamic calculation method also provides a new idea for the preparation of other MAB phases by SHS.


title: A Stochastic Target Problem for Branching Diffusions

abstract: We consider an optimal stochastic target problem for branching diffusion processes. This problem consists in finding the minimal condition for which a control allows the underlying branching process to reach a target set at a finite terminal time for each of its branches. This problem is motivated by an example from fintech where we look for the super-replication price of options on blockchain based cryptocurrencies. We first state a dynamic programming principle for the value function of the stochastic target problem. We then show that the value function can be reduced to a new function with a finite dimensional argument by a so called branching property. Under wide conditions, this last function is shown to be the unique viscosity solution to an HJB variational inequality.


title: Interacting massive and massless arbitrary spin fields in 4d flat space

abstract: Massive and massless arbitrary integer spin fields propagating in four-dimensional flat space are studied. The massive and massless fields are treated by using a light-cone gauge helicity basis formalism. Cubic cross-interactions between massive and massless fields and cubic interactions between massive fields are investigated. We introduce a classification of such cubic interactions and using our classification we build all cubic interaction vertices. Realization of generators of the Poincare algebra on space of interacting fields is found. As a by-product, some illustrative examples of light-cone form for 3-point invariant amplitudes of massive and massless fields are also discussed.


title: Wasserstein Distributionally Robust Estimation in High Dimensions: Performance Analysis and Optimal Hyperparameter Tuning

abstract: Wasserstein distributionally robust optimization has recently emerged as a powerful framework for robust estimation, enjoying good out-of-sample performance guarantees, well-understood regularization effects, and computationally tractable reformulations. In such framework, the estimator is obtained by minimizing the worst-case expected loss over all probability distributions which are close, in a Wasserstein sense, to the empirical distribution. In this paper, we propose a Wasserstein distributionally robust estimation framework to estimate an unknown parameter from noisy linear measurements, and we focus on the task of analyzing the squared error performance of such estimators. Our study is carried out in the modern high-dimensional proportional regime, where both the ambient dimension and the number of samples go to infinity at a proportional rate which encodes the under/over-parametrization of the problem. Under an isotropic Gaussian features assumption, we show that the squared error can be recovered as the solution of a convex-concave optimization problem which, surprinsingly, involves at most four scalar variables. Importantly, the precise quantification of the squared error allows to accurately and efficiently compare different ambiguity radii and to understand the effect of the under/over-parametrization on the estimation error. We conclude the paper with a list of exciting research directions enabled by our results.


title: Organic chemistry in the first phases of Solar-type protostars

abstract: Planetary systems such as our own are formed after a long process where matter condenses from diffuse clouds to stars, planets, asteroids, comets and residual dust, undergoing dramatic changes in physical and chemical state in less than a few million years. Several studies have shown that the chemical composition during the early formation of a Solar-type planetary system is a powerful diagnostic to track the history of the system itself. Among the approximately 270 molecules so far detected in the ISM, the so-called interstellar complex organic molecules (iCOMs) are of particular interest both because of their evolutionary diagnostic power and because they might be potential precursors of biomolecules, which are at the basis of terrestrial life. This Chapter focuses on the evolution of organic molecules during the early stages of a Solar-type planetary system, represented by the prestellar, Class 0/I and protoplanetary disk phases, and compares them with what is observed presently in Solar System comets. Our twofold goal is to review the processes at the base of organic chemistry during Solar-type star formation and, in addition, to possibly provide constraints on the early history of our own planetary system.


title: A compact setup for loading magneto-optical trap in ultrahigh vacuum environment

abstract: We have developed a compact setup which enables loading a magneto-optical trap (MOT) in ultra-high vacuum (UHV) environment. Nearly $1 \times 10^{8}$ atoms of $^{87}Rb$ are trapped in the MOT at $\sim 2 \times 10^{-10}$ Torr base pressure in the chamber. After the MOT loading, we have successfully demonstrated working of quadrupole magnetic trap in this chamber with a lifetime of $\sim 8 $ s


title: Wideband Audio Waveform Evaluation Networks: Efficient, Accurate Estimation of Speech Qualities

abstract: Wideband Audio Waveform Evaluation Networks (WAWEnets) are convolutional neural networks that operate directly on wideband audio waveforms in order to produce evaluations of those waveforms. In the present work these evaluations give qualities of telecommunications speech (e.g., noisiness, intelligibility, overall speech quality). WAWEnets are no-reference networks because they do not require ``reference'' (original or undistorted) versions of the waveforms they evaluate. Our initial WAWEnet publication introduced four WAWEnets and each emulated the output of an established full-reference speech quality or intelligibility estimation algorithm. We have updated the WAWEnet architecture to be more efficient and effective. Here we present a single WAWEnet that closely tracks seven different quality and intelligibility values. We create a second network that additionally tracks four subjective speech quality dimensions. We offer a third network that focuses on just subjective quality scores and achieves very high levels of agreement. This work has leveraged 334 hours of speech in 13 languages, over two million full-reference target values and over 93,000 subjective mean opinion scores. We also interpret the operation of WAWEnets and identify the key to their operation using the language of signal processing: ReLUs strategically move spectral information from non-DC components into the DC component. The DC values of 96 output signals define a vector in a 96-D latent space and this vector is then mapped to a quality or intelligibility value for the input waveform.


title: A weak version of the $\varepsilon$-Dvoretzky conjecture for normed spaces

abstract: We prove a weak version of the $\varepsilon$-Dvoretzky conjecture for normed spaces, showing the existence of a subspace of $\mathbb{R}^n$ of dimension at least $c \log n / |\log \varepsilon|$ in which the given norm is $\varepsilon$-close to a norm obeying a large discrete group of symmetries ("$1$-unconditional norm").


title: Deep-Learning vs Regression: Prediction of Tourism Flow with Limited Data

abstract: Modern tourism in the 21st century is facing numerous challenges. One of these challenges is the rapidly growing number of tourists in space limited regions such as historical city centers, museums or geographical bottlenecks like narrow valleys. In this context, a proper and accurate prediction of tourism volume and tourism flow within a certain area is important and critical for visitor management tasks such as visitor flow control and prevention of overcrowding. Static flow control methods like limiting access to hotspots or using conventional low level controllers could not solve the problem yet. In this paper, we empirically evaluate the performance of several state-of-the-art deep-learning methods in the field of visitor flow prediction with limited data by using available granular data supplied by a tourism region and comparing the results to ARIMA, a classical statistical method. Our results show that deep-learning models yield better predictions compared to the ARIMA method, while both featuring faster inference times and being able to incorporate additional input features.


title: Cuts, flows and gradient conditions on harmonic functions

abstract: Reduced cohomology motivates to look at harmonic functions which satisfy certain gradient conditions. If $G$ is a direct product of two infinite groups or a (FC-central)-by-cyclic group, then there are no harmonic functions with gradient in $c_0$ on its Cayley graphs. From this, it follows that a metabelian group $G$ has no harmonic functions with gradient in $\ell^p$. Furthermore, under a radial isoperimetric condition, groups whose isoperimetric profile is bounded by power of logarithms also have no harmonic functions with gradient in $\ell^p$.


title: Scaling limit of a kinetic inhomogeneous stochastic system in the quadratic potential

abstract: We consider a particle evolving in the quadratic potential and subject to a time-inhomogeneous frictional force and to a random force. The couple of its velocity and position is solution to a stochastic differential equation driven by an $\alpha$-stable L{\'e}vy process with $\alpha \in (1,2]$ and the frictional force is of the form $t^{-\beta}\text{sgn}(v)|v|^\gamma$. We identify three regimes for the behavior in long-time of the couple velocity-position with a suitable rescaling, depending on the balance between the frictional force and the index of stability $\alpha$ of the noise.


title: Fundamentals of Vehicular Communication Networks with Vehicle Platoons

abstract: Vehicular platooning is a promising way to facilitate efficient movement of vehicles with a shared route. Despite its relevance, the interplay of platooning and the communication performance in the resulting vehicular network (VN) is largely unexplored. Inspired by this, we develop a comprehensive approach to statistical modeling and system-level analysis of VNs with platooned traffic. Modeling the network of roads using the by-now well-accepted Poisson line process (PLP), we place vehicles on each road according to an independent Matern cluster process (MCP) that jointly captures randomness in the locations of platoons on the roads and vehicles within each platoon. The resulting triply-stochastic point process is a PLP-driven-Cox process, which we term the PLP-MCP. We first present this new point process's distribution and derive several fundamental properties essential for the resulting VN's analysis. Assuming that the cellular base-stations (BSs) are distributed as a Poisson point process (PPP), we derive the distribution of the loads served by the typical BS and the BS associated with the typical user. In deriving the latter, we also present a new approach to deriving the length distribution of a tagged chord in a Poisson Voronoi tessellation. Using the derived results, we present the rate coverage of the typical user while considering partial loading of the BSs. We also provide a comparative analysis of VNs with and without platooning of traffic.


title: Anomalous metallic phase in molybdenum disulphide induced via gate-driven organic ion intercalation

abstract: Transition metal dichalcogenides exhibit rich phase diagrams dominated by the interplay of superconductivity and charge density waves, which often result in anomalies in the electric transport properties. Here, we employ the ionic gating technique to realize a tunable, non-volatile organic ion intercalation in bulk single crystals of molybdenum disulphide (MoS$_{2}$). We demonstrate that this gate-driven organic ion intercalation induces a strong electron doping in the system without changing the pristine $2H$ crystal symmetry and triggers the emergence of a re-entrant insulator-to-metal transition. We show that the gate-induced metallic state exhibits clear anomalies in the temperature dependence of the resistivity with a natural explanation as signatures of the development of a charge-density wave phase which was previously observed in alkali-intercalated MoS$_{2}$. The relatively large temperature at which the anomalies are observed ($\sim$$150$ K), combined with the absence of any sign of doping-induced superconductivity down to $\sim$$3$ K, suggests that the two phases might be competing with each other to determine the electronic ground state of electron-doped MoS$_2$.


title: Differential invariants for SE(2)-equivariant networks

abstract: Symmetry is present in many tasks in computer vision, where the same class of objects can appear transformed, e.g. rotated due to different camera orientations, or scaled due to perspective. The knowledge of such symmetries in data coupled with equivariance of neural networks can improve their generalization to new samples. Differential invariants are equivariant operators computed from the partial derivatives of a function. In this paper we use differential invariants to define equivariant operators that form the layers of an equivariant neural network. Specifically, we derive invariants of the Special Euclidean Group SE(2), composed of rotations and translations, and apply them to construct a SE(2)-equivariant network, called SE(2) Differential Invariants Network (SE2DINNet). The network is subsequently tested in classification tasks which require a degree of equivariance or invariance to rotations. The results compare positively with the state-of-the-art, even though the proposed SE2DINNet has far less parameters than the compared models.


title: Expressive power of binary and ternary neural networks

abstract: We show that deep sparse ReLU networks with ternary weights and deep ReLU networks with binary weights can approximate $\beta$-H\"older functions on $[0,1]^d$. Also, for any interval $[a,b)\subset\mathbb{R}$, continuous functions on $[0,1]^d$ can be approximated by networks of depth $2$ with binary activation function $\mathds{1}_{[a,b)}$.


title: Extracting Large Scale Spatio-Temporal Descriptions from Social Media

abstract: The ability to track large-scale events as they happen is essential for understanding them and coordinating reactions in an appropriate and timely manner. This is true, for example, in emergency management and decision-making support, where the constraints on both quality and latency of the extracted information can be stringent. In some contexts, real-time and large-scale sensor data and forecasts may be available. We are exploring the hypothesis that this kind of data can be augmented with the ingestion of semi-structured data sources, like social media. Social media can diffuse valuable knowledge, such as direct witness or expert opinions, while their noisy nature makes them not trivial to manage. This knowledge can be used to complement and confirm other spatio-temporal descriptions of events, highlighting previously unseen or undervalued aspects. The critical aspects of this investigation, such as event sensing, multilingualism, selection of visual evidence, and geolocation, are currently being studied as a foundation for a unified spatio-temporal representation of multi-modal descriptions. The paper presents, together with an introduction on the topics, the work done so far on this line of research, also presenting case studies relevant to the posed challenges, focusing on emergencies caused by natural disasters.


title: Monocular Depth Decomposition of Semi-Transparent Volume Renderings

abstract: Neural networks have shown great success in extracting geometric information from color images. Especially, monocular depth estimation networks are increasingly reliable in real-world scenes. In this work we investigate the applicability of such monocular depth estimation networks to semi-transparent volume rendered images. As depth is notoriously difficult to define in a volumetric scene without clearly defined surfaces, we consider different depth computations that have emerged in practice, and compare state-of-the-art monocular depth estimation approaches for these different interpretations during an evaluation considering different degrees of opacity in the renderings. Additionally, we investigate how these networks can be extended to further obtain color and opacity information, in order to create a layered representation of the scene based on a single color image. This layered representation consists of spatially separated semi-transparent intervals that composite to the original input rendering. In our experiments we show that existing approaches to monocular depth estimation can be adapted to perform well on semi-transparent volume renderings, which has several applications in the area of scientific visualization, like re-composition with additional objects and labels or additional shading.


title: Taylor's Law for some infinitely divisible probabbility distributions from population models

abstract: In a family of random variables, Taylor's law or Taylor's power law offluctuation scaling is a variance function that gives the variance $\sigma^{2}>0$ of a random variable (rv) $X$ with expectation $\mu >0$ as a powerof $\mu$: $\sigma ^{2}=A\mu ^{b}$ for finite real $A>0,\ b$ that are thesame for all rvs in the family. Equivalently, TL holds when $\log \sigma^{2}=a+b\log \mu ,\ a=\log A$, for all rvs in some set. Here we analyze thepossible values of the TL exponent $b$ in five families of infinitelydivisible two-parameter distributions and show how the values of $b$ dependon the parameters of these distributions. The five families areTweedie-Bar-Lev-Enis, negative binomial, compound Poisson-geometric,compound geometric-Poisson (or P\'{o}lya-Aeppli), and gamma distributions.These families arise frequently in empirical data and population models, and they are limit laws of Markov processes that we exhibit in each case.


title: Which one is more toxic? Findings from Jigsaw Rate Severity of Toxic Comments

abstract: The proliferation of online hate speech has necessitated the creation of algorithms which can detect toxicity. Most of the past research focuses on this detection as a classification task, but assigning an absolute toxicity label is often tricky. Hence, few of the past works transform the same task into a regression. This paper shows the comparative evaluation of different transformers and traditional machine learning models on a recently released toxicity severity measurement dataset by Jigsaw. We further demonstrate the issues with the model predictions using explainability analysis.


title: Sum-of-Squares Relaxations for Information Theory and Variational Inference

abstract: We consider extensions of the Shannon relative entropy, referred to as $f$-divergences.Three classical related computational problems are typically associated with these divergences: (a) estimation from moments, (b) computing normalizing integrals, and (c) variational inference in probabilistic models. These problems are related to one another through convex duality, and for all them, there are many applications throughout data science, and we aim for computationally tractable approximation algorithms that preserve properties of the original problem such as potential convexity or monotonicity. In order to achieve this, we derive a sequence of convex relaxations for computing these divergences from non-centered covariance matrices associated with a given feature vector: starting from the typically non-tractable optimal lower-bound, we consider an additional relaxation based on ``sums-of-squares'', which is is now computable in polynomial time as a semidefinite program. We also provide computationally more efficient relaxations based on spectral information divergences from quantum information theory. For all of the tasks above, beyond proposing new relaxations, we derive tractable convex optimization algorithms, and we present illustrations on multivariate trigonometric polynomials and functions on the Boolean hypercube.


title: First boundary Dirac eigenvalue and boundary capacity potential

abstract: We derive new lower bounds for the first eigenvalue of the Dirac operator of an oriented hypersurface $\Sigma$ bounding a noncompact domain in a spin asymptotically flat manifold (M n , g) with nonnegative scalar curvature. These bounds involve the boundary capacity potential and, in some cases, the capacity of $\Sigma$ in (M n , g) yielding several new geometric inequalities. The proof of our main result relies on an estimate for the first eigenvalue of the Dirac operator of boundaries of compact Riemannian spin manifolds endowed with a singular metric which may have independent interest.


title: Gauge-invariant coefficients in perturbative quantum gravity

abstract: Heat kernel methods are useful for studying properties of quantum gravity. We recompute here the first three heat kernel coefficients in perturbative quantum gravity with cosmological constant to ascertain which ones are correctly reported in the literature. They correspond to the counterterms needed to renormalize the one-loop effective action in four dimensions. They may be evaluated at arbitrary dimensions $D$, in which case they identify only a subset of the divergences appearing in the effective action for $D\geq 6$. Generically, these coefficients depend on the gauge-fixing choice adopted in quantizing the Einstein-Hilbert action. However, they become gauge-invariant once evaluated on-shell, i.e. using Einstein's field equations with cosmological constant. We identify them and use them as a benchmark for checking alternative approaches to perturbative quantum gravity. One such approach describes the graviton in first-quantization through the use of the action of the ${\cal N}=4$ spinning particle, characterized by four supersymmetries on the worldline and a set of worldline gauge invariances. This description has been used for computing the gauge-invariant coefficients as well. We verify their correctness at $D=4$, but find a mismatch at arbitrary $D$ when comparing with the benchmark fixed earlier. We interpret this result as signaling that the path integral quantization of the ${\cal N}=4$ spinning particle should be amended. We perform this task by fixing the correct counterterm that must be used in the worldline path integral quantization of the ${\cal N}=4$ spinning particle to make it consistent in arbitrary dimensions.


title: Discovering Salient Neurons in Deep NLP Models

abstract: While a lot of work has been done in understanding representations learned within deep NLP models and what knowledge they capture, little attention has been paid towards individual neurons. We present a technique called as Linguistic Correlation Analysis to extract salient neurons in the model, with respect to any extrinsic property - with the goal of understanding how such a knowledge is preserved within neurons. We carry out a fine-grained analysis to answer the following questions: (i) can we identify subsets of neurons in the network that capture specific linguistic properties? (ii) how localized or distributed neurons are across the network? iii) how redundantly is the information preserved? iv) how fine-tuning pre-trained models towards downstream NLP tasks, impacts the learned linguistic knowledge? iv) how do architectures vary in learning different linguistic properties? Our data-driven, quantitative analysis illuminates interesting findings: (i) we found small subsets of neurons that can predict different linguistic tasks, ii) with neurons capturing basic lexical information (such as suffixation) localized in lower most layers, iii) while those learning complex concepts (such as syntactic role) predominantly in middle and higher layers, iii) that salient linguistic neurons are relocated from higher to lower layers during transfer learning, as the network preserve the higher layers for task specific information, iv) we found interesting differences across pre-trained models, with respect to how linguistic information is preserved within, and v) we found that concept exhibit similar neuron distribution across different languages in the multilingual transformer models. Our code is publicly available as part of the NeuroX toolkit.


title: Analyzing Encoded Concepts in Transformer Language Models

abstract: We propose a novel framework ConceptX, to analyze how latent concepts are encoded in representations learned within pre-trained language models. It uses clustering to discover the encoded concepts and explains them by aligning with a large set of human-defined concepts. Our analysis on seven transformer language models reveal interesting insights: i) the latent space within the learned representations overlap with different linguistic concepts to a varying degree, ii) the lower layers in the model are dominated by lexical concepts (e.g., affixation), whereas the core-linguistic concepts (e.g., morphological or syntactic relations) are better represented in the middle and higher layers, iii) some encoded concepts are multi-faceted and cannot be adequately explained using the existing human-defined concepts.


title: Theoretical analysis of Adam using hyperparameters close to one without Lipschitz smoothness

abstract: Convergence and convergence rate analyses of adaptive methods, such as Adaptive Moment Estimation (Adam) and its variants, have been widely studied for nonconvex optimization. The analyses are based on assumptions that the expected or empirical average loss function is Lipschitz smooth (i.e., its gradient is Lipschitz continuous) and the learning rates depend on the Lipschitz constant of the Lipschitz continuous gradient. Meanwhile, numerical evaluations of Adam and its variants have clarified that using small constant learning rates without depending on the Lipschitz constant and hyperparameters ($\beta_1$ and $\beta_2$) close to one is advantageous for training deep neural networks. Since computing the Lipschitz constant is NP-hard, the Lipschitz smoothness condition would be unrealistic. This paper provides theoretical analyses of Adam without assuming the Lipschitz smoothness condition in order to bridge the gap between theory and practice. The main contribution is to show theoretical evidence that Adam using small learning rates and hyperparameters close to one performs well, whereas the previous theoretical results were all for hyperparameters close to zero. Our analysis also leads to the finding that Adam performs well with large batch sizes. Moreover, we show that Adam performs well when it uses diminishing learning rates and hyperparameters close to one.


title: Propagation of chaos in mean field networks of FitzHugh-Nagumo neurons

abstract: In this article, we are interested in the behavior of a fully connected network of $N$ neurons, where $N$ tends to infinity. We assume that the neurons follow the stochastic FitzHugh-Nagumo model, whose specificity is the non-linearity with a cubic term. We prove a result of uniform in time propagation of chaos of this model in a mean-field framework. We also exhibit explicit bounds. We use a coupling method initially suggested by A. Eberle (arXiv:1305.1233), and recently extended in (1805.11387), known as the reflection coupling. We simultaneously construct a solution of the $N$-particle system and $N$ independent copies of the non-linear McKean-Vlasov limit in such a way that, considering an appropriate semi-metric that takes into account the various possible behaviors of the processes, the two solutions tend to get closer together as $N$ increases, uniformly in time. The reflection coupling allows us to deal with the non-convexity of the underlying potential in the dynamics of the quantities defining our network, and show independence at the limit for the system in mean field interaction with sufficiently small Lipschitz continuous interactions.


title: Relaxation in a Keller-Segel-consumption system involving signal-dependent motilities

abstract: Two relaxation features of the migration-consumption chemotaxis system involving signal-dependent motilities, $$ \left\{ \begin{array}{l} u_t = \Delta \big(u\phi(v)\big), \\[1mm] v_t = \Delta v-uv, \end{array} \right. \qquad \qquad (\star)$$ are studied in smoothly bounded domains $\Omega\subset\mathbb{R}^n$, $n\ge 1$: It is shown that if $\phi\in C^0([0,\infty))$ is positive on $[0,\infty)$, then for any initial data $(u_0,v_0)$ belonging to the space $(C^0(\overline{\Omega}))^\star\times L^\infty(\Omega)$ an associated no-flux type initial-boundary value problem admits a global very weak solution. Beyond this initial relaxation property, it is seen that under the additional hypotheses that $\phi\in C^1([0,\infty))$ and $n\le 3$, each of these solutions stabilizes toward a semi-trivial spatially homogeneous steady state in the large time limit. By thus applying to irregular and partially even measure-type initial data of arbitrary size, this firstly extends previous results on global solvability in ($\star$) which have been restricted to initial data not only considerably more regular but also suitably small. Secondly, this reveals a significant difference between the large time behavior in ($\star$) and that in related degenerate counterparts involving functions $\phi$ with $\phi(0)=0$, about which, namely, it is known that some solutions may asymptotically approach nonhomogeneous states.


title: On the sharp regularity of solutions to hyperbolic boundary value problems

abstract: We prove some sharp regularity results for solutions of classical first order hyperbolic initial boundary value problems. Our two main improvements on the existing litterature are weaker regularity assumptions for the boundary data and regularity in fractional Sobolev spaces. This last point is specially interesting when the regularity index belongs to 1/2 + N, as it involves nonlocal compatibility conditions.


title: LaRa: Latents and Rays for Multi-Camera Bird's-Eye-View Semantic Segmentation

abstract: Recent works in autonomous driving have widely adopted the bird's-eye-view (BEV) semantic map as an intermediate representation of the world. Online prediction of these BEV maps involves non-trivial operations such as multi-camera data extraction as well as fusion and projection into a common topview grid. This is usually done with error-prone geometric operations (e.g., homography or back-projection from monocular depth estimation) or expensive direct dense mapping between image pixels and pixels in BEV (e.g., with MLP or attention). In this work, we present 'LaRa', an efficient encoder-decoder, transformer-based model for vehicle semantic segmentation from multiple cameras. Our approach uses a system of cross-attention to aggregate information over multiple sensors into a compact, yet rich, collection of latent representations. These latent representations, after being processed by a series of self-attention blocks, are then reprojected with a second cross-attention in the BEV space. We demonstrate that our model outperforms the best previous works using transformers on nuScenes. The code and trained models are available at https://github.com/valeoai/LaRa


title: Diffusion Deformable Model for 4D Temporal Medical Image Generation

abstract: Temporal volume images with 3D+t (4D) information are often used in medical imaging to statistically analyze temporal dynamics or capture disease progression. Although deep-learning-based generative models for natural images have been extensively studied, approaches for temporal medical image generation such as 4D cardiac volume data are limited. In this work, we present a novel deep learning model that generates intermediate temporal volumes between source and target volumes. Specifically, we propose a diffusion deformable model (DDM) by adapting the denoising diffusion probabilistic model that has recently been widely investigated for realistic image generation. Our proposed DDM is composed of the diffusion and the deformation modules so that DDM can learn spatial deformation information between the source and target volumes and provide a latent code for generating intermediate frames along a geodesic path. Once our model is trained, the latent code estimated from the diffusion module is simply interpolated and fed into the deformation module, which enables DDM to generate temporal frames along the continuous trajectory while preserving the topology of the source image. We demonstrate the proposed method with the 4D cardiac MR image generation between the diastolic and systolic phases for each subject. Compared to the existing deformation methods, our DDM achieves high performance on temporal volume generation.


title: Consistency-preserving Visual Question Answering in Medical Imaging

abstract: Visual Question Answering (VQA) models take an image and a natural-language question as input and infer the answer to the question. Recently, VQA systems in medical imaging have gained popularity thanks to potential advantages such as patient engagement and second opinions for clinicians. While most research efforts have been focused on improving architectures and overcoming data-related limitations, answer consistency has been overlooked even though it plays a critical role in establishing trustworthy models. In this work, we propose a novel loss function and corresponding training procedure that allows the inclusion of relations between questions into the training process. Specifically, we consider the case where implications between perception and reasoning questions are known a-priori. To show the benefits of our approach, we evaluate it on the clinically relevant task of Diabetic Macular Edema (DME) staging from fundus imaging. Our experiments show that our method outperforms state-of-the-art baselines, not only by improving model consistency, but also in terms of overall model accuracy. Our code and data are available at https://github.com/sergiotasconmorales/consistency_vqa.