title: Compressing Visual-linguistic Model via Knowledge Distillation

abstract: Despite exciting progress in pre-training for visual-linguistic (VL) representations, very few aspire to a small VL model. In this paper, we study knowledge distillation (KD) to effectively compress a transformer-based large VL model into a small VL model. The major challenge arises from the inconsistent regional visual tokens extracted from different detectors of Teacher and Student, resulting in the misalignment of hidden representations and attention distributions. To address the problem, we retrain and adapt the Teacher by using the same region proposals from Student's detector while the features are from Teacher's own object detector. With aligned network inputs, the adapted Teacher is capable of transferring the knowledge through the intermediate representations. Specifically, we use the mean square error loss to mimic the attention distribution inside the transformer block and present a token-wise noise contrastive loss to align the hidden state by contrasting with negative representations stored in a sample queue. To this end, we show that our proposed distillation significantly improves the performance of small VL models on image captioning and visual question answering tasks. It reaches 120.8 in CIDEr score on COCO captioning, an improvement of 5.1 over its non-distilled counterpart; and an accuracy of 69.8 on VQA 2.0, a 0.8 gain from the baseline. Our extensive experiments and ablations confirm the effectiveness of VL distillation in both pre-training and fine-tuning stages.


title: Geodesic Fiber Tracking in White Matter using Activation Function

abstract: The geodesic ray-tracing method has shown its effectiveness for the reconstruction of fibers in white matter structure. Based on reasonable metrics on the spaces of the diffusion tensors, it can provide multiple solutions and get robust to noise and curvatures of fibers. The choice of the metric on the spaces of diffusion tensors has a significant impact on the outcome of this method. Our objective is to suggest metrics and modifications of the algorithms leading to more satisfactory results in the construction of white matter tracts as geodesics. Starting with the DTI modality, we propose to rescale the initially chosen metric on the space of diffusion tensors to increase the geodetic cost in the isotropic regions. This change should be conformal in order to preserve the angles between crossing fibers. We also suggest enhancing the methods to be more robust to noise and employing the fourth-order tensor data in order to handle the fiber crossings properly.


title: Comprehensive Gas Characterization of a $z= 2.5$ Protocluster: A Cluster Core Caught in the Beginning of Virialization?

abstract: In order to connect galaxy clusters to their progenitor protoclusters, we must constrain the star formation histories within their member galaxies and the timescale of virial collapse. In this paper we characterize the complex star-forming properties of a $z=2.5$ protocluster in the COSMOS field using ALMA dust continuum and new VLA CO(1-0) observations of two filaments associated with the structure, sometimes referred to as the "Hyperion" protocluster. We focus in particular on the protocluster "core" which has previously been suggested as the highest redshift bona fide galaxy cluster traced by extended X-ray emission in a stacked Chandra/XMM image. We re-analyze this data and refute these claims, finding that at least 40 $\pm$ 17% of extended X-ray sources of similar luminosity and size at this redshift arise instead from Inverse Compton scattering off recently extinguished radio galaxies rather than intracluster medium. Using ancillary COSMOS data, we also constrain the SEDs of the two filaments' eight constituent galaxies from the rest-frame UV to radio. We do not find evidence for enhanced star formation efficiency in the core and conclude that the constituent galaxies are already massive (M$_{\star} \approx 10^{11} M_{\odot}$), with molecular gas reservoirs $>10^{10} M_{\odot}$ that will be depleted within 200-400 Myr. Finally, we calculate the halo mass of the nested core at $z=2.5$ and conclude that it will collapse into a cluster of 2-9 $\times 10^{14} M_{\odot}$, comparable to the size of the Coma cluster at $z=0$ and accounting for at least 50% of the total estimated halo mass of the extended "Hyperion" structure.


title: Bohr phenomenon for certain classes of harmonic mappings

abstract: Bohr phenomenon for analytic functions $ f $ where $ f(z)=\sum_{n=0}^{\infty}a_nz^n $, first introduced by Harald Bohr in $ 1914 $, deals with finding the largest radius $ r_f $, $ 0<r_f<1 $, such that the inequality $ \sum_{n=0}^{\infty}|a_nz^n|<1 $ holds whenever $ |f(z)|<1 $ holds in the unit disk $ \mathbb{D}=\{z\in\mathbb{C} : |z|<1\} $. The Bohr phenomenon for the harmonic functions of the form $ f(z)=h+\overline{g} $, where $ h(z)=\sum_{n=0}^{\infty}a_nz^n $ and $ g(z)=\sum_{n=1}^{\infty}b_nz^n $ is to find the largest radius $ r_f $, $ 0<r_f<1 $ such that \begin{equation*} \sum_{n=1}^{\infty}\left(|a_n|+|b_n|\right)|z|^n\leq d(f(0),\partial f(\mathbb{D})) \end{equation*} holds for $ |z|\leq r_f $, where $ d(f(0),\partial f(\mathbb{D})) $ is the Euclidean distance between $ f(0) $ and the boundary of $ f(\mathbb{D}) $. In this paper, we prove several improved versions of the sharp Bohr radius for the classes of harmonic and univalent functions. Further, we prove several corollaries as a consequence of the main results.


title: VR Hackathon with Goethe Institute: Lessons Learned from Organizing a Transdisciplinary VR Hackathon

abstract: In this article we report a case study of a Language Learning Bauhaus VR hackathon with Goethe Institute. It was organized as an educational and research project to tap into the dynamics of transdisciplinary teams challenged with a specific requirement. In our case, it was to build a Bauhaus-themed German Language Learning VR App. We constructed this experiment to simulate how representatives of different disciplines may work together towards a very specific purpose under time pressure. So, each participating team consisted of members of various expert-fields: software development (Unity or Unreal), design, psychology and linguistics. The results of this study cast light on the recommended cycle of design thinking and customer-centered design in VR. Especially in interdisciplinary rapid prototyping conditions, where stakeholders initially do not share competences. They also showcase educational benefits of working in transdisciplinary environments. This study, combined with our previous work on human factors in rapid software development and co-design, including hackathon dynamics, allowed us to formulate recommendations for organizing content creation VR hackathons for specific purposes. We also provide guidelines on how to prepare the participants to work in rapid prototyping VR environments and benefit from such experiences in the long term.


title: A universal state sum

abstract: We define a universal state sum construction which specializes to most previously known state sums (Turaev-Viro, Dijkgraaf-Witten, Crane-Yetter, Douglas-Reutter, Witten-Reshetikhin-Turaev surgery formula, Brown-Arf). The input data for the state sum is an n-category satisfying various conditions, including finiteness, semisimplicity and n-pivotality. From this n-category one constructs an n+1-dimensional TQFT, and applying the TQFT gluing rules to a handle decomposition of an n+1-manifold produces the state sum.


title: Automated Performance Testing Based on Active Deep Learning

abstract: Generating tests that can reveal performance issues in large and complex software systems within a reasonable amount of time is a challenging task. On one hand, there are numerous combinations of input data values to explore. On the other hand, we have a limited test budget to execute tests. What makes this task even more difficult is the lack of access to source code and the internal details of these systems. In this paper, we present an automated test generation method called ACTA for black-box performance testing. ACTA is based on active learning, which means that it does not require a large set of historical test data to learn about the performance characteristics of the system under test. Instead, it dynamically chooses the tests to execute using uncertainty sampling. ACTA relies on a conditional variant of generative adversarial networks,and facilitates specifying performance requirements in terms of conditions and generating tests that address those conditions.We have evaluated ACTA on a benchmark web application, and the experimental results indicate that this method is comparable with random testing, and two other machine learning methods,i.e. PerfXRL and DN.


title: Exact Algorithms for No-Rainbow Coloring and Phylogenetic Decisiveness

abstract: The input to the no-rainbow hypergraph coloring problem is a hypergraph $H$ where every hyperedge has $r$ nodes. The question is whether there exists an $r$-coloring of the nodes of $H$ such that all $r$ colors are used and there is no rainbow hyperedge -- i.e., no hyperedge uses all $r$ colors. The no-rainbow hypergraph $r$-coloring problem is known to be NP-complete for $r \geq 3$. The special case of $r=4$ is the complement of the phylogenetic decisiveness problem. Here we present a deterministic algorithm that solves the no-rainbow $r$-coloring problem in $O^*((r-1)^{(r-1)n/r})$ time and a randomized algorithm that solves the problem in $O^*((\frac{r}{2})^n)$ time.


title: Invariant structure preserving functions and an Oka-Weil Kaplansky density type theorem

abstract: We develop the theory of invariant structure preserving and free functions on a general structured topological space. We show that an invariant structure preserving function is pointwise approximiable by the appropriate analog of polynomials in the strong topology and therefore a free function. Moreover, if a domain of operators on a Hilbert space is polynomially convex, the set of free functions satisfies a Oka-Weil Kaplansky density type theorem -- contractive functions can be approximated by contractive polynomials.


title: Objective Bayesian meta-analysis based on generalized multivariate random effects model

abstract: Objective Bayesian inference procedures are derived for the parameters of the multivariate random effects model generalized to elliptically contoured distributions. The posterior for the overall mean vector and the between-study covariance matrix is deduced by assigning two noninformative priors to the model parameter, namely the Berger and Bernardo reference prior and the Jeffreys prior, whose analytical expressions are obtained under weak distributional assumptions. It is shown that the only condition needed for the posterior to be proper is that the sample size is larger than the dimension of the data-generating model, independently of the class of elliptically contoured distributions used in the definition of the generalized multivariate random effects model. The theoretical findings of the paper are applied to real data consisting of ten studies about the effectiveness of hypertension treatment for reducing blood pressure where the treatment effects on both the systolic blood pressure and diastolic blood pressure are investigated.


title: Efficient determination of the true magnetic structure in a high-throughput ab initio screening: the MDMC method

abstract: Finding the true magnetic structure at given external conditions is crucial for describing magnetic materials and predicting their properties. This is especially important for high-throughput screening of potentially good magnets that without adequate description of the magnetic structure may result in an enormous waste of computational resources. I introduce a method, which accurately and efficiently treats magnetic ordering in the course of standard first-principles calculations. The method is suitable for all temperatures and is based on Monte Carlo (MC) technique. At high temperatures MC is coupled to ab initio molecular dynamics, therefore treating atomic vibrations and magnetic ordering simultaneously. The method takes care of the convergence to the true ground-state magnetic structure at 0 K, coupling between spins and atomic vibrations at high temperatures, and spin-spin interactions in non-Heisenberg systems, i.e. it naturally goes beyond the usual pair-like effective exchange interactions at all temperatures. I show that the method nicely reproduces the magnetic structures at low and high temperatures even on relatively small supercells and provides a ground for truly ab initio calculations of magnetic systems in high-throughput studies. In its general formulation the MDMC method deals with non-collinear magnetism, but its collinear version may be more suitable for fast high-throughput calculations. The examples of the application of the MDMC method addressed in this paper are $\alpha$-Mn; body-centered cubic Fe, which is ferromagnetic at low and paramagnetic at high temperatures; and MnB$_2$W$_2$, a new magnetic compound with non-trivial magnetism.


title: Jekyll: Attacking Medical Image Diagnostics using Deep Generative Models

abstract: Advances in deep neural networks (DNNs) have shown tremendous promise in the medical domain. However, the deep learning tools that are helping the domain, can also be used against it. Given the prevalence of fraud in the healthcare domain, it is important to consider the adversarial use of DNNs in manipulating sensitive data that is crucial to patient healthcare. In this work, we present the design and implementation of a DNN-based image translation attack on biomedical imagery. More specifically, we propose Jekyll, a neural style transfer framework that takes as input a biomedical image of a patient and translates it to a new image that indicates an attacker-chosen disease condition. The potential for fraudulent claims based on such generated 'fake' medical images is significant, and we demonstrate successful attacks on both X-rays and retinal fundus image modalities. We show that these attacks manage to mislead both medical professionals and algorithmic detection schemes. Lastly, we also investigate defensive measures based on machine learning to detect images generated by Jekyll.


title: Control of a Tail-Sitter VTOL UAV Based on Recurrent Neural Networks

abstract: Tail-sitter vertical takeoff and landing (VTOL) unmanned aerial vehicles (UAVs) have the capability of hovering and performing efficient level flight with compact mechanical structures. We present a unified controller design for such UAVs, based on recurrent neural networks. An advantage of this design method is that the various flight modes (i.e., hovering, transition and level flight) of a VTOL UAV are controlled in a unified manner, as opposed to treating them separately and in the runtime switching one from another. The proposed controller consists of an outer-loop position controller and an inner-loop attitude controller. The inner-loop controller is composed of a proportional attitude controller and a loop-shaping linear angular rate controller. For the outer-loop controller, we propose a nonlinear solver to compute the desired attitude and thrust, based on the UAV dynamics and an aerodynamic model, in addition to a cascaded PID controller for the position and velocity tracking. We employ a recurrent neural network (RNN) to approximate the behavior of the nonlinear solver, which suffers from high computational complexity. The proposed RNN has negligible approximation errors, and can be implemented in real-time (e.g., 50 Hz). Moreover, the RNN generates much smoother outputs than the nonlinear solver. We provide an analysis of the stability and robustness of the overall closed-loop system. Simulation and experiments are also presented to demonstrate the effectiveness of the proposed method.


title: Streaming Multi-talker Speech Recognition with Joint Speaker Identification

abstract: In multi-talker scenarios such as meetings and conversations, speech processing systems are usually required to transcribe the audio as well as identify the speakers for downstream applications. Since overlapped speech is common in this case, conventional approaches usually address this problem in a cascaded fashion that involves speech separation, speech recognition and speaker identification that are trained independently. In this paper, we propose Streaming Unmixing, Recognition and Identification Transducer (SURIT) -- a new framework that deals with this problem in an end-to-end streaming fashion. SURIT employs the recurrent neural network transducer (RNN-T) as the backbone for both speech recognition and speaker identification. We validate our idea on the LibrispeechMix dataset -- a multi-talker dataset derived from Librispeech, and present encouraging results.


title: Challenges in Solving Chiral Hydrodynamics

abstract: We prove that ideal chiral hydrodynamics, as derived from chiral kinetic theory, is acausal and its initial-value problem is ill-posed both in the linearized case around a local equilibrium solution and also in the full nonlinear regime. Therefore, such theory cannot be used to determine how the chiral anomaly affects the hydrodynamic evolution. We show that these fundamental issues can be fixed by using different definitions (frames) for the hydrodynamic fields. This leads to a causal theory of ideal chiral hydrodynamics where the vorticity strength is constrained by the coefficient that encodes the anomaly.


title: Linear port-Hamiltonian systems are generically controllable

abstract: The new concept of relative generic subsets is introduced. It is shown that the set of controllable linear finite-dimensional port-Hamiltonian systems is a relative generic subset of the set of all linear finite-dimensional port-Hamiltonian systems. This implies that a random, continuously distributed port-Hamiltonian system is almost surely controllable.


title: Efficient Attentions for Long Document Summarization

abstract: The quadratic computational and memory complexities of large Transformers have limited their scalability for long document summarization. In this paper, we propose Hepos, a novel efficient encoder-decoder attention with head-wise positional strides to effectively pinpoint salient information from the source. We further conduct a systematic study of existing efficient self-attentions. Combined with Hepos, we are able to process ten times more tokens than existing models that use full attentions. For evaluation, we present a new dataset, GovReport, with significantly longer documents and summaries. Results show that our models produce significantly higher ROUGE scores than competitive comparisons, including new state-of-the-art results on PubMed. Human evaluation also shows that our models generate more informative summaries with fewer unfaithful errors.


title: Anchor-Constrained Viterbi for Set-Supervised Action Segmentation

abstract: This paper is about action segmentation under weak supervision in training, where the ground truth provides only a set of actions present, but neither their temporal ordering nor when they occur in a training video. We use a Hidden Markov Model (HMM) grounded on a multilayer perceptron (MLP) to label video frames, and thus generate a pseudo-ground truth for the subsequent pseudo-supervised training. In testing, a Monte Carlo sampling of action sets seen in training is used to generate candidate temporal sequences of actions, and select the maximum posterior sequence. Our key contribution is a new anchor-constrained Viterbi algorithm (ACV) for generating the pseudo-ground truth, where anchors are salient action parts estimated for each action from a given ground-truth set. Our evaluation on the tasks of action segmentation and alignment on the benchmark Breakfast, MPII Cooking2, Hollywood Extended datasets demonstrates our superior performance relative to that of prior work.


title: Temperature and intensity dependence of the open-circuit voltage of InGaN/GaN multi-quantum well solar cells

abstract: We have analyzed the temperature and intensity dependence of the open-circuit voltage of InGaN/GaN multi-quantum well solar cells up to 725 K and more than 1000 suns. We show that the simple ABC model routinely used to analyze the measured quantum efficiency data of InGaN/GaN LEDs can accurately reproduce the temperature and intensity dependence of the measured open-circuit voltage if a temperature-dependent Shockley-Read-Hall lifetime is used and device heating is taken into account.


title: Discrete Reasoning Templates for Natural Language Understanding

abstract: Reasoning about information from multiple parts of a passage to derive an answer is an open challenge for reading-comprehension models. In this paper, we present an approach that reasons about complex questions by decomposing them to simpler subquestions that can take advantage of single-span extraction reading-comprehension models, and derives the final answer according to instructions in a predefined reasoning template. We focus on subtraction-based arithmetic questions and evaluate our approach on a subset of the DROP dataset. We show that our approach is competitive with the state-of-the-art while being interpretable and requires little supervision


title: Action Shuffle Alternating Learning for Unsupervised Action Segmentation

abstract: This paper addresses unsupervised action segmentation. Prior work captures the frame-level temporal structure of videos by a feature embedding that encodes time locations of frames in the video. We advance prior work with a new self-supervised learning (SSL) of a feature embedding that accounts for both frame- and action-level structure of videos. Our SSL trains an RNN to recognize positive and negative action sequences, and the RNN's hidden layer is taken as our new action-level feature embedding. The positive and negative sequences consist of action segments sampled from videos, where in the former the sampled action segments respect their time ordering in the video, and in the latter they are shuffled. As supervision of actions is not available and our SSL requires access to action segments, we specify an HMM that explicitly models action lengths, and infer a MAP action segmentation with the Viterbi algorithm. The resulting action segmentation is used as pseudo-ground truth for estimating our action-level feature embedding and updating the HMM. We alternate the above steps within the Generalized EM framework, which ensures convergence. Our evaluation on the Breakfast, YouTube Instructions, and 50Salads datasets gives superior results to those of the state of the art.


title: Solutions of the 2D Schrodinger equation and its thermal properties for Improved Ultra Generalized Exponential Hyperbolic potential (IUGE-HP)

abstract: In this research work, we investigate the 2D Schrodinger equation with improved ultra-generalized exponential-hyperbolic potential (IUGE-HP) is scrutinized taking into consideration the effects external magnetic and Aharanov-Bohm (AB) fields within the non-relativistic quantum mechanics regime. The Schrodinger equation in 2D for this consideration is solved using the asymptotic iteration method (AIM) and the energy equation and eigenfunction for the IUGE-HP in the presence of magnetic and AB fields are obtained in a compact form. The numerical energy spectra is analyzed and it is observed that the presence of the external fields eliminates degeneracy from the spectra and the different values of the control parameter causes shifts in the energy spectra. The thermal and magnetic properties of the IUGE-HP in the presence of this external fields are duly investigated. The variations of the thermal and magnetic properties with control parameter are analyzed for negative and positive. The present research finds applications in condensed matter, molecular and atomic physics respectively.


title: A Generalized LinDistFlow Model for Power Flow Analysis

abstract: This paper proposes a new linear power flow model for distribution system with accurate voltage magnitude estimates. The new model can be seen as a generalization of LinDistFlow model to multiphase distribution system with generic network topology (radial or meshed) around arbitrary linearization point. We have shown that the approximation quality of the proposed model strictly dominates that of the fixed-point linearization (FPL) method, a popular linear power flow model for distribution system analysis, when both are linearized around zero injection point. Numerical examples using standard IEEE test feeders are provided to illustrate the effectiveness of the proposed model as well as the improvement in accuracy over existing methods when linearized around non-zero injection points.


title: Pancyclism in the Generalized Sum of Digraphs

abstract: A digraph $D=(V,A)$ of order $n\geq 3$ is pancyclic, whenever $D$ contains a directed cycle of length $k$ for each $k\in\{3,...,n\}$; and D is vertex-pancyclic iff, for each vertex $v\in V$ and each $k\in \{3,...,n\}$, $D$ contains a directed cycle of length $k$ passing through $v$. Let $D_1$, $D_2$,..., $D_k$ be a collection of pairwise vertex disjoint digraphs. The generalized sum (g.s.) of $D_1$, $D_2$,..., $D_k$, denoted by $\oplus_{i=1}^k D_i$ or $D_1\oplus D_2 \oplus \cdots \oplus D_k$, is the set of all digraphs D satisfying: (i) $V(D)=\bigcup_{i=1}^k V(D_i)$, (ii) $D\langle V(D_i) \rangle \cong D_i$ for $i=1, 2,..., k$; and (iii) for each pair of vertices belonging to different summands of D, there is exactly one arc between them, with an arbitrary but fixed direction. A digraph $D\in \oplus_{i=1}^k D_i$ will be called a generalized sum (g.s.) of $D_1$, $D_2$,..., $D_k$. In this paper we prove that if $D_1$ and $D_2$ are two vertex disjoint Hamiltonian digraphs and $D\in D_1 \oplus D_2$ is strong, then at least one of the following assertions holds: $D$ is vertex-pancyclic, it is pancyclic or it is Hamiltonian and contains a directed cycle of length $l$ for each $l\in\{3,..., \max\{|V(D_i)|+1 \colon i\in\{1,2\}\}\}$. Moreover, we prove that if $D_1$, $D_2$,..., $D_k$ is a collection of pairwise vertex disjoint Hamiltonian digraphs, $n_i=|V(D_i)|$ for each $i\in \{1,...,k\}$ and $D \in \oplus_{i=1}^k D_i$ is strong, then at least one of the following assertions holds: $D$ is vertex-pancyclic, it is pancyclic or it is Hamiltonian and contains a directed cycle of length $l$ for each $l\in \{3,..., \max\{\left(\sum_{i\in S} n_i\right) + 1 \colon S\subset\{1,..., k\}\text{ with }|S|=k-1\}\}$.


title: Nonlinear model reduction for slow-fast stochastic systems near unknown invariant manifolds

abstract: We introduce a nonlinear stochastic model reduction technique for high-dimensional stochastic dynamical systems that have a low-dimensional invariant effective manifold with slow dynamics, and high-dimensional, large fast modes. Given only access to a black box simulator from which short bursts of simulation can be obtained, we design an algorithm that outputs an estimate of the invariant manifold, a process of the effective stochastic dynamics on it, which has averaged out the fast modes, and a simulator thereof. This simulator is efficient in that it exploits of the low dimension of the invariant manifold, and takes time steps of size dependent on the regularity of the effective process, and therefore typically much larger than that of the original simulator, which had to resolve the fast modes. The algorithm and the estimation can be performed on-the-fly, leading to efficient exploration of the effective state space, without losing consistency with the underlying dynamics. This construction enables fast and efficient simulation of paths of the effective dynamics, together with estimation of crucial features and observables of such dynamics, including the stationary distribution, identification of metastable states, and residence times and transition rates between them.


title: Obliquely propagating ion-acoustic shock waves in degenerate quantum plasma

abstract: A theoretical investigation has been carried out on the propagation of nonlinear ion-acoustic shock waves (IASHWs) in a collsionless magnetized degenerate quantum plasma system composed of inertial non-relativistic positively charged light and heavy ions, inertialess ultra-relativistically degenerate electrons and positrons. The reductive perturbation method has been employed to drive the Burgers' equation. It has been observed that under consideration, our plasma model supports only positive potential shock structure. It is also found that the amplitude and steepness of the IASHWs have been significantly modified by the variation of ion kinematic viscosity, oblique angle, number density, and charge state of the plasma species. The results of our present investigation will be helpful for understanding the propagation of IASHWs in white dwarfs and neutron stars.


title: Active Turbulence

abstract: Active fluids exhibit spontaneous flows with complex spatiotemporal structure, which have been observed in bacterial suspensions, sperm cells, cytoskeletal suspensions, self-propelled colloids, and cell tissues. Despite occurring in the absence of inertia, chaotic active flows are reminiscent of inertial turbulence, and hence they are known as active turbulence. Here, we survey the field, providing a unified perspective over different classes of active turbulence. To this end, we divide our review in sections for systems with either polar or nematic order, and with or without momentum conservation (wet/dry). Comparing to inertial turbulence, we highlight the emergence of power-law scaling with either universal or non-universal exponents. We also contrast scenarios for the transition from steady to chaotic flows, and we discuss the absence of energy cascades. We link this feature to both the existence of intrinsic length scales and the self-organized nature of energy injection in active turbulence, which are fundamental differences with inertial turbulence. We close by outlining the emerging picture, remaining challenges, and future directions.

categories: cond-mat.soft nlin.CD nlin.PS physics.bio-ph physics.flu-dyn


title: Cosmological magnetic field---the boost-symmetric case

abstract: We find a class of cylindrically symmetric, static electrovacuum spacetimes generated by a non-homogeneous magnetic field and involving the cosmological constant and one additional parameter, which determine uniquely the strength of the magnetic field. We provide a simple model of a source producing the field.


title: Optimization of vertically mounted agrivoltaic systems

abstract: Agrivoltaic systems represent a key technology for reaching sustainable development goals reducing the completion of land for food versus land for energy. Moreover, agrivoltaic systems are at the centre of the nexus between electricity production, crop production, and irrigation water saving. In this study, an optimization model for vertically mounted agrivoltaic systems with bifacial photovoltaic models is developed. The model combines three main submodels: solar radiation and shadings, photovoltaic, and crop yield. Validation of the submodels is performed showing good agreement with measured data and commercial software. The optimization model is set as multi objective to explore the trade-offs between competing agrivoltaic key performance indicators. The results shows that the row distance between bifacial photovoltaic modules structure affects significantly the photosyntetically active radiation distribution by reducing the crop yield of potato and oat of about 50% by passing from 20 m to 5 m. The implementation of agrivoltaic system for the investigated crops at the chosen location shows a land equivalent ratio above 1.2 that justify the technology for reaching the country sustainability goals.


title: SpeakerStew: Scaling to Many Languages with a Triaged Multilingual Text-Dependent and Text-Independent Speaker Verification System

abstract: In this paper, we describe SpeakerStew - a hybrid system to perform speaker verification on 46 languages. Two core ideas were explored in this system: (1) Pooling training data of different languages together for multilingual generalization and reducing development cycles; (2) A novel triage mechanism between text-dependent and text-independent models to reduce runtime cost and expected latency. To the best of our knowledge, this is the first study of speaker verification systems at the scale of 46 languages. The problem is framed from the perspective of using a smart speaker device with interactions consisting of a wake-up keyword (text-dependent) followed by a speech query (text-independent). Experimental evidence suggests that training on multiple languages can generalize to unseen varieties while maintaining performance on seen varieties. We also found that it can reduce computational requirements for training models by an order of magnitude. Furthermore, during model inference on English data, we observe that leveraging a triage framework can reduce the number of calls to the more computationally expensive text-independent system by 73% (and reduce latency by 59%) while maintaining an EER no worse than the text-independent setup.


title: The survival-incorporated median versus the median in the survivors or in the always-survivors: What are we measuring? And why?

abstract: Many clinical studies evaluate the benefit of a treatment based on both survival and other continuous/ordinal clinical outcomes, such as Quality of Life scores. In these studies, when subjects die before the follow-up assessment, the clinical outcomes become undefined and are truncated by death. Treating outcomes as "missing" or "censored" due to death can be misleading for treatment effect evaluation. We show that if we use the median in the survivors or in the always-survivors as estimands to summarize clinical outcomes, we may conclude that a trade-off exists between the probability of survival and good clinical outcomes, even in settings where both the probability of survival and the probability of any good clinical outcome are better for one treatment. Therefore, we advocate not always treating death as a mechanism through which clinical outcomes are missing, but rather as part of the outcome measure. To account for the survival status, we describe the survival-incorporated median as an alternative summary measure for outcomes in the presence of death. The survival-incorporated median is the threshold such that 50% of the population is alive with an outcome above that threshold. Through conceptual examples and an application to a prostate cancer treatment study, we show that the survival-incorporated median provides a simple and useful summary measure to inform clinical practice.


title: On the factorization invariants of the additive structure of exponential Puiseux semirings

abstract: Exponential Puiseux semirings are additive submonoids of $\qq_{\geq 0}$ generated by almost all of the nonnegative powers of a positive rational number, and they are natural generalizations of rational cyclic semirings. In this paper, we investigate some of the factorization invariants of exponential Puiseux semirings and briefly explore the connections of these properties with semigroup-theoretical invariants. Specifically, we prove that sets of lengths of atomic exponential Puiseux semirings are almost arithmetic progressions with a common bound, while unions of sets of lengths are arithmetic progressions. Additionally, we provide exact formulas to compute the catenary degrees of these monoids and show that minima and maxima of their sets of distances are always attained at Betti elements. We conclude by providing various characterizations of the atomic exponential Puiseux semirings with finite omega functions; in particular, we completely describe them in terms of their presentations.


title: End-to-End Speaker-Attributed ASR with Transformer

abstract: This paper presents our recent effort on end-to-end speaker-attributed automatic speech recognition, which jointly performs speaker counting, speech recognition and speaker identification for monaural multi-talker audio. Firstly, we thoroughly update the model architecture that was previously designed based on a long short-term memory (LSTM)-based attention encoder decoder by applying transformer architectures. Secondly, we propose a speaker deduplication mechanism to reduce speaker identification errors in highly overlapped regions. Experimental results on the LibriSpeechMix dataset shows that the transformer-based architecture is especially good at counting the speakers and that the proposed model reduces the speaker-attributed word error rate by 47% over the LSTM-based baseline. Furthermore, for the LibriCSS dataset, which consists of real recordings of overlapped speech, the proposed model achieves concatenated minimum-permutation word error rates of 11.9% and 16.3% with and without target speaker profiles, respectively, both of which are the state-of-the-art results for LibriCSS with the monaural setting.


title: A simple way of simulating transmission lines using free software. Application to a quarter wave transformer

abstract: A simple way of simulating transmission lines using a free software is presented. In order to validate the results, the effective value of reflection coefficient for voltage wave in a quarter wavelength line was determined trough a transient analysis, for an incident voltage sin-type continuous wave front. The simulations presented reproduced the results previously found analytically.


title: Analytic functionals for the non-commutative disc algebra

abstract: The main objects of study in this paper are those functionals that are analytic in the sense that they annihilate the non-commutative disc algebra. In the classical univariate case, a theorem of F. and M. Riesz implies that such functionals must be given as integration against an absolutely continuous measure on the circle. We develop generalizations of this result to the multivariate non-commutative setting, upon reinterpreting the classical result. In one direction, we show that the GNS representation naturally associated to an analytic functional on the Cuntz algebra cannot have any singular summand. Following a different interpretation, we seek weak-$*$ continuous extensions of analytic functionals on the free disc operator system. In contrast with the classical setting, such extensions do not always exist, and we identify the obstruction precisely in terms of the so-called universal structure projection. We also apply our ideas to commutative algebras of multipliers on some complete Nevanlinna--Pick function spaces.


title: Political structures and the topology of simplicial complexes

abstract: We use the topology of simplicial complexes to model political structures following [1]. Simplicial complexes are a natural tool to encode interactions in the structures since a simplex can be used to represent a subset of compatible agents. We translate the wedge, cone, and suspension operations into the language of political structures and show how these constructions correspond to merging structures and introducing mediators. We introduce the notions of the viability of an agent and the stability of a political system and examine their interplay with the simplicial complex topology, casting their interactions in category-theoretic language whenever possible. We introduce a refinement of the model by assigning weights to simplices corresponding to the number of issues the agents agree on. In addition, homology of simplicial complexes is used to detect non-viabilities, certain cycles of incompatible agents, and the (non)presence of mediators. Finally, we extend some results from [1], bringing viability and stability into the language of friendly delegations and using homology to examine the existence of R-compromises and D-compromises.


title: Observation of the Modification of Quantum Statistics of Plasmonic Systems

abstract: For almost two decades, it has been believed that the quantum statistical properties of bosons are preserved in plasmonic systems. This idea has been stimulated by experimental work reporting the possibility of preserving nonclassical correlations in light-matter interactions mediated by scattering among photons and plasmons. Furthermore, it has been assumed that similar dynamics underlies the conservation of the quantum fluctuations that define the nature of light sources. Here, we demonstrate that quantum statistics are not always preserved in plasmonic systems and report the first observation of their modification. Moreover, we show that multiparticle scattering effects induced by confined optical near fields can lead to the modification of the excitation mode of plasmonic systems. These observations are validated through the quantum theory of optical coherence for single- and multi-mode plasmonic systems. Our findings constitute a new paradigm in the understanding of the quantum properties of plasmonic systems and unveil new paths to perform exquisite control of quantum multiparticle systems.


title: SpeechStew: Simply Mix All Available Speech Recognition Data to Train One Large Neural Network

abstract: We present SpeechStew, a speech recognition model that is trained on a combination of various publicly available speech recognition datasets: AMI, Broadcast News, Common Voice, LibriSpeech, Switchboard/Fisher, Tedlium, and Wall Street Journal. SpeechStew simply mixes all of these datasets together, without any special re-weighting or re-balancing of the datasets. SpeechStew achieves SoTA or near SoTA results across a variety of tasks, without the use of an external language model. Our results include 9.0\% WER on AMI-IHM, 4.7\% WER on Switchboard, 8.3\% WER on CallHome, and 1.3\% on WSJ, which significantly outperforms prior work with strong external language models. We also demonstrate that SpeechStew learns powerful transfer learning representations. We fine-tune SpeechStew on a noisy low resource speech dataset, CHiME-6. We achieve 38.9\% WER without a language model, which compares to 38.6\% WER to a strong HMM baseline with a language model.


title: Spectral Subsampling MCMC for Stationary Multivariate Time Series with Applications to Vector ARTFIMA Processes

abstract: Spectral subsampling MCMC was recently proposed to speed up Markov chain Monte Carlo (MCMC) for long stationary univariate time series by subsampling periodogram observations in the frequency domain. This article extends the approach to multivariate time series using a multivariate generalisation of the Whittle likelihood. To assess the computational gains from spectral subsampling in challenging problems, a multivariate generalisation of the autoregressive tempered fractionally integrated moving average model (ARTFIMA) is introduced and some of its properties derived. Bayesian inference based on the Whittle likelihood is demonstrated to be a fast and accurate alternative to the exact time domain likelihood. Spectral subsampling is shown to provide up to two orders of magnitude additional speed-up, while retaining MCMC sampling efficiency and accuracy, compared to spectral methods using the full dataset. Keywords: Bayesian, Markov chain Monte Carlo, Semi-long memory, Spectral analysis, Whittle likelihood.


title: State Constrained Stochastic Optimal Control Using LSTMs

abstract: In this paper, we propose a new methodology for state constrained stochastic optimal control (SOC) problems. The solution is based on past work in solving SOC problems using forward-backward stochastic differential equations (FBSDE). Our approach in solving the FBSDE utilizes a deep neural network (DNN), specifically Long Short-Term Memory (LSTM) networks. LSTMs are chosen to solve the FBSDE to address the curse of dimensionality, non-linearities, and long time horizons. In addition, the state constraints are incorporated using a hard penalty function, resulting in a controller that respects the constraint boundaries. Numerical instability that would be introduced by the penalty function is dealt with through an adaptive update scheme. The control design methodology is applicable to a large class of control problems. The performance and scalability of our proposed algorithm are demonstrated by numerical simulations.


title: Remarks on the existence of CMC Cauchy surfaces

abstract: As is well known, constant mean curvature (CMC) spacelike hypersurfaces play an important role in solving the Einstein equations, both in solving the contraints and the evolution equations. In this paper we review the CMC existence result obtained by the authors in [10] and consider some new existence results motivated by a conjecture of Dilts and Holst [8]. We also address some issues concerning the conformal structure of cosmological spacetimes.


title: ASER: Towards Large-scale Commonsense Knowledge Acquisition via Higher-order Selectional Preference over Eventualities

abstract: Commonsense knowledge acquisition and reasoning have long been a core artificial intelligence problem. However, in the past, there has been a lack of scalable methods to collect commonsense knowledge. In this paper, we propose to develop principles for collecting commonsense knowledge based on selectional preference. We generalize the definition of selectional preference from one-hop linguistic syntactic relations to higher-order relations over linguistic graphs. Unlike previous commonsense knowledge definition (e.g., ConceptNet), selectional preference (SP) knowledge only relies on statistical distribution over linguistic graphs, which can be efficiently and accurately acquired from the unlabeled corpus with modern tools. Following this principle, we develop a large-scale eventuality (a linguistic term covering activity, state, and event)-based knowledge graph ASER, where each eventuality is represented as a dependency graph, and the relation between them is a discourse relation defined in shallow discourse parsing. The higher-order selectional preference over collected linguistic graphs reflects various kinds of commonsense knowledge. Moreover, motivated by the observation that humans understand events by abstracting the observed events to a higher level and can thus transfer their knowledge to new events, we propose a conceptualization module to significantly boost the coverage of ASER. In total, ASER contains 648 million edges between 438 million eventualities. After conceptualization with Probase, a selectional preference based concept-instance relational knowledge base, our concept graph contains 15 million conceptualized eventualities and 224 million edges between them. Detailed analysis is provided to demonstrate its quality. All the collected data, APIs, and tools are available at https://github.com/HKUST-KnowComp/ASER.


title: Semantic Distance: A New Metric for ASR Performance Analysis Towards Spoken Language Understanding

abstract: Word Error Rate (WER) has been the predominant metric used to evaluate the performance of automatic speech recognition (ASR) systems. However, WER is sometimes not a good indicator for downstream Natural Language Understanding (NLU) tasks, such as intent recognition, slot filling, and semantic parsing in task-oriented dialog systems. This is because WER takes into consideration only literal correctness instead of semantic correctness, the latter of which is typically more important for these downstream tasks. In this study, we propose a novel Semantic Distance (SemDist) measure as an alternative evaluation metric for ASR systems to address this issue. We define SemDist as the distance between a reference and hypothesis pair in a sentence-level embedding space. To represent the reference and hypothesis as a sentence embedding, we exploit RoBERTa, a state-of-the-art pre-trained deep contextualized language model based on the transformer architecture. We demonstrate the effectiveness of our proposed metric on various downstream tasks, including intent recognition, semantic parsing, and named entity recognition.


title: A cell-centered Lagrangian ADER-MOOD finite volume scheme on unstructured meshes for a class of hyper-elasticity models

abstract: In this paper we present a conservative cell-centered Lagrangian finite volume scheme for the solution of the hyper-elasticity equations on unstructured multidimensional grids. The starting point of the new method is the Eucclhyd scheme, which is here combined with the a posteriori Multidimensional Optimal Order Detection (MOOD) limiting strategy to ensure robustness and stability at shock waves with piece-wise linear spatial reconstruction. The ADER (Arbitrary high order schemes using DERivatives) approach is adopted to obtain second-order of accuracy in time as well. This method has been tested in an hydrodynamics context and the present work aims at extending it to the case of hyper-elasticity models. Such models are presented in a fully Lagrangian framework and the dedicated Lagrangian numerical scheme is derived in terms of nodal solver, GCL compliance, subcell forces and compatible discretization. The Lagrangian numerical method is implemented in 3D under MPI parallelization framework allowing to handle genuinely large meshes. A relative large set of numerical test cases is presented to assess the ability of the method to achieve effective second order of accuracy on smooth flows, maintaining an essentially non-oscillatory behavior and general robustness across discontinuities and ensuring at least physical admissibility of the solution where appropriate. Pure elastic neo-Hookean and non-linear materials are considered for our benchmark test problems in 2D and 3D. These test cases feature material bending, impact, compression, non-linear deformation and further bouncing/detaching motions.


title: A predefined-time first-order exact differentiator based on time-varying gains

abstract: Recently, a first-order differentiator based on time-varying gains was introduced in the literature, in its non recursive form, for a class of differentiable signals $y(t)$, satisfying $|\ddot{y}(t)|\leq L(t-t_0)$, for a known function $L(t-t_0)$, such that $\frac{1}{L(t-t_0)}\left|\frac{d {L}(t-t_0)}{dt}\right|\leq M$ with a known constant $M$. It has been shown that such differentiator is globally finite-time convergent. In this paper, we redesign such an algorithm, using time base generators (a class of time-varying gains), to obtain a differentiator algorithm for the same class of signals, with guaranteed convergence before a desired time, i.e., with fixed-time convergence with an a priori user-defined upper bound for the settling time. Thus, our approach can be applied for scenarios under time-constraints. We present numerical examples exposing the contribution with respect to state-of-the-art algorithms.


title: Feedback linearization of nonlinear differential-algebraic control systems

abstract: In this paper, we study feedback linearization problems for nonlinear differential-algebraic control systems (DACSs). We consider two kinds of feedback equivalences, namely, the external feedback equivalence, which is defined (locally) on the whole generalized state space, and the internal feedback equivalence, which is defined on the locally maximal controlled invariant submanifold (i.e., on the set where solutions exist). Necessary and sufficient conditions are given for the locally internal and the locally external feedback linearizability of DACSs with the help of a notion called the explicitation with driving variables, which attaches a class of ordinary differential equation control systems (ODECSs) to a given DACS. We show that the feedback linearizability of a DACS is closely related to the involutivity of the linearizability distributions of the explicitation systems. Finally, we apply our results of feedback linearization of DACSs to an academical example and a constrained mechanical system.


title: Influence of surface band bending on a narrow band gap semiconductor: Tunneling atomic force studies of graphite with Bernal and rhombohedral stacking orders

abstract: Tunneling atomic force microscopy (TUNA) was used at ambient conditions to measure the current-voltage ($I$-$V$) characteristics at clean surfaces of highly oriented graphite samples with Bernal and rhombohedral stacking orders. The characteristic curves measured on Bernal-stacked graphite surfaces can be understood with an ordinary self-consistent semiconductor modeling and quantum mechanical tunneling current derivations. We show that the absence of a voltage region without measurable current in the $I$-$V$ spectra is not a proof of the lack of an energy band gap. It can be induced by a surface band bending due to a finite contact potential between tip and sample surface. Taking this into account in the model, we succeed to obtain a quantitative agreement between simulated and measured tunnel spectra for band gaps $(12 \ldots 37)$\,meV, in agreement to those extracted from the exponential temperature decrease of the longitudinal resistance measured in graphite samples with Bernal stacking order. In contrast, the surface of relatively thick graphite samples with rhombohedral stacking reveals the existence of a maximum in the first derivative $dI/dV$, a behavior compatible with the existence of a flat band. The characteristics of this maximum are comparable to those obtained at low temperatures with similar techniques.


title: Learning Latent and Hierarchical Structures in Cognitive Diagnosis Models

abstract: Cognitive Diagnosis Models (CDMs) are a special family of discrete latent variable models that are widely used in modern educational, psychological, social and biological sciences. A key component of CDMs is a binary $Q$-matrix characterizing the dependence structure between the items and the latent attributes. Additionally, researchers also assume in many applications certain hierarchical structures among the latent attributes to characterize their dependence. In most CDM applications, the attribute-attribute hierarchical structures, the item-attribute $Q$-matrix, the item-level diagnostic model, as well as the number of latent attributes, need to be fully or partially pre-specified, which however may be subjective and misspecified as noted by many recent studies. This paper considers the problem of jointly learning these latent and hierarchical structures in CDMs from observed data with minimal model assumptions. Specifically, a penalized likelihood approach is proposed to select the number of attributes and estimate the latent and hierarchical structures simultaneously. An efficient expectation-maximization (EM) algorithm and a latent structure recovery algorithm are developed, and statistical consistency theory is also established under mild conditions. The good performance of the proposed method is illustrated by simulation studies and a real data application in educational assessment.


title: A Concise Review of Transfer Learning

abstract: The availability of abundant labeled data in recent years led the researchers to introduce a methodology called transfer learning, which utilizes existing data in situations where there are difficulties in collecting new annotated data. Transfer learning aims to boost the performance of a target learner by applying another related source data. In contrast to the traditional machine learning and data mining techniques, which assume that the training and testing data lie from the same feature space and distribution, transfer learning can handle situations where there is a discrepancy between domains and distributions. These characteristics give the model the potential to utilize the available related source data and extend the underlying knowledge to the target task achieving better performance. This survey paper aims to give a concise review of traditional and current transfer learning settings, existing challenges, and related approaches.


title: What Will it Take to Fix Benchmarking in Natural Language Understanding?

abstract: Evaluation for many natural language understanding (NLU) tasks is broken: Unreliable and biased systems score so highly on standard benchmarks that there is little room for researchers who develop better systems to demonstrate their improvements. The recent trend to abandon IID benchmarks in favor of adversarially-constructed, out-of-distribution test sets ensures that current models will perform poorly, but ultimately only obscures the abilities that we want our benchmarks to measure. In this position paper, we lay out four criteria that we argue NLU benchmarks should meet. We argue most current benchmarks fail at these criteria, and that adversarial data collection does not meaningfully address the causes of these failures. Instead, restoring a healthy evaluation ecosystem will require significant progress in the design of benchmark datasets, the reliability with which they are annotated, their size, and the ways they handle social bias.


title: Semi-Supervised Clustering with Inaccurate Pairwise Annotations

abstract: Pairwise relational information is a useful way of providing partial supervision in domains where class labels are difficult to acquire. This work presents a clustering model that incorporates pairwise annotations in the form of must-link and cannot-link relations and considers possible annotation inaccuracies (i.e., a common setting when experts provide pairwise supervision). We propose a generative model that assumes Gaussian-distributed data samples along with must-link and cannot-link relations generated by stochastic block models. We adopt a maximum-likelihood approach and demonstrate that, even when supervision is weak and inaccurate, accounting for relational information significantly improves clustering performance. Relational information also helps to detect meaningful groups in real-world datasets that do not fit the original data-distribution assumptions. Additionally, we extend the model to integrate prior knowledge of experts' accuracy and discuss circumstances in which the use of this knowledge is beneficial.


title: Which Sampling Densities are Suitable for Spectral Clustering on Unbounded Domains?

abstract: We consider a random geometric graph with vertices sampled from a probability measure supported on $\mathbb R^d$, and study its connectivity. We show the graph is typically disconnected, unless the sampling density has superexponential decay. In the later setting, we identify an asymptotic threshold value for the radius parameter of the graph such that, for radius values beyond the threshold, some concentration properties hold for the sampled points of the graph, while the graph is disconnected for radius values below the same threshold. Properties of point processes are well-known to be closely related to the analysis of geometric learning problems, such as spectral clustering. This work can be seen as a first step towards understanding the consistency of spectral clustering when the probability measure has unbounded support. In particular, we narrow down the setting under which spectral clustering algorithms on $\mathbb R^d$ may be expected to achieve consistency, to a sufficiently fast decay of the sampling density (superexponential) and a sufficiently slowly decaying radius parameter value as a function of $n$, the number of sampled points.


title: Pairwise intersecting convex sets and cylinders in $\R^3$

abstract: We prove that given a finite collection of cylinders in $\R^3$ with the property that any two them intersect, then there is a line intersecting an $\alpha$ fraction of the cylinders where $\alpha=\frac 1{28}$. This is a special case of an interesting conjecture.


title: Automatic Micro-Expression Apex Frame Spotting using Local Binary Pattern from Six Intersection Planes

abstract: Facial expressions are one of the most effective ways for non-verbal communications, which can be expressed as the Micro-Expression (ME) in the high-stake situations. The MEs are involuntary, rapid, and, subtle, and they can reveal real human intentions. However, their feature extraction is very challenging due to their low intensity and very short duration. Although Local Binary Pattern from Three Orthogonal Plane (LBP-TOP) feature extractor is useful for the ME analysis, it does not consider essential information. To address this problem, we propose a new feature extractor called Local Binary Pattern from Six Intersection Planes (LBP-SIPl). This method extracts LBP code on six intersection planes, and then it combines them. Results show that the proposed method has superior performance in apex frame spotting automatically in comparison with the relevant methods on the CASME database. Simulation results show that, using the proposed method, the apex frame has been spotted in 43% of subjects in the CASME database, automatically. Also, the mean absolute error of 1.76 is achieved, using our novel proposed method.


title: Revisiting Rashomon: A Comment on "The Two Cultures"

abstract: Here, I provide some reflections on Prof. Leo Breiman's "The Two Cultures" paper. I focus specifically on the phenomenon that Breiman dubbed the "Rashomon Effect", describing the situation in which there are many models that satisfy predictive accuracy criteria equally well, but process information in the data in substantially different ways. This phenomenon can make it difficult to draw conclusions or automate decisions based on a model fit to data. I make connections to recent work in the Machine Learning literature that explore the implications of this issue, and note that grappling with it can be a fruitful area of collaboration between the algorithmic and data modeling cultures.


title: Distributed Learning in Wireless Networks: Recent Progress and Future Challenges

abstract: The next-generation of wireless networks will enable many machine learning (ML) tools and applications to efficiently analyze various types of data collected by edge devices for inference, autonomy, and decision making purposes. However, due to resource constraints, delay limitations, and privacy challenges, edge devices cannot offload their entire collected datasets to a cloud server for centrally training their ML models or inference purposes. To overcome these challenges, distributed learning and inference techniques have been proposed as a means to enable edge devices to collaboratively train ML models without raw data exchanges, thus reducing the communication overhead and latency as well as improving data privacy. However, deploying distributed learning over wireless networks faces several challenges including the uncertain wireless environment, limited wireless resources (e.g., transmit power and radio spectrum), and hardware resources. This paper provides a comprehensive study of how distributed learning can be efficiently and effectively deployed over wireless edge networks. We present a detailed overview of several emerging distributed learning paradigms, including federated learning, federated distillation, distributed inference, and multi-agent reinforcement learning. For each learning framework, we first introduce the motivation for deploying it over wireless networks. Then, we present a detailed literature review on the use of communication techniques for its efficient deployment. We then introduce an illustrative example to show how to optimize wireless networks to improve its performance. Finally, we introduce future research opportunities. In a nutshell, this paper provides a holistic set of guidelines on how to deploy a broad range of distributed learning frameworks over real-world wireless communication networks.


title: Model-based testing in practice: An experience report from the web applications domain

abstract: In the context of a large software testing company, we have deployed the model-based testing (MBT) approach to take the company's test automation practices to higher levels of maturity /and capability. We have chosen, from a set of open-source/commercial MBT tools, an open-source tool named GraphWalker, and have pragmatically used MBT for end-to-end test automation of several large web and mobile applications under test. The MBT approach has provided, so far in our project, various tangible and intangible benefits in terms of improved test coverage (number of paths tested), improved test-design practices, and also improved real-fault detection effectiveness. The goal of this experience report (applied research report), done based on "action research", is to share our experience of applying and evaluating MBT as a software technology (technique and tool) in a real industrial setting. We aim at contributing to the body of empirical evidence in industrial application of MBT by sharing our industry-academia project on applying MBT in practice, the insights that we have gained, and the challenges and questions that we have faced and tackled so far. We discuss an overview of the industrial setting, provide motivation, explain the events leading to the outcomes, discuss the challenges faced, summarize the outcomes, and conclude with lessons learned, take-away messages, and practical advices based on the described experience. By learning from the best practices in this paper, other test engineers could conduct more mature MBT in their test projects.


title: Label-GCN: An Effective Method for Adding Label Propagation to Graph Convolutional Networks

abstract: We show that a modification of the first layer of a Graph Convolutional Network (GCN) can be used to effectively propagate label information across neighbor nodes, for binary and multi-class classification problems. This is done by selectively eliminating self-loops for the label features during the training phase of a GCN. The GCN architecture is otherwise unchanged, without any extra hyper-parameters, and can be used in both a transductive and inductive setting. We show through several experiments that, depending on how many labels are available during the inference phase, this strategy can lead to a substantial improvement in the model performance compared to a standard GCN approach, including with imbalanced datasets.


title: 3D Yang-Mills Glueballs vs Closed Effective Strings

abstract: Recent lattice results strongly support the Axionic String Ansatz (ASA) for quantum numbers of glueballs in 3D Yang-Mills theory. The ASA treats glueballs as closed bosonic strings. The corresponding worldsheet theory is a deformation of the minimal Nambu-Goto theory. In order to understand better the ASA strings and as a first step towards a perturbative calculation of the glueball mass splittings we compare the ASA spectrum to the closed effective string theory. Namely, we model glueballs as excitations around the folded rotating rod solution with a large angular momentum $J$. The resulting spectrum agrees with the ASA in the regime of validity of the effective theory, i.e., in the vicinity of the leading Regge trajectory. In particular, closed effective string theory correctly predicts that only glueballs of even spin $J$ show up at the leading Regge trajectory. Interestingly though, the closed effective string theory overestimates the number of glueball states far above the leading Regge trajectory.


title: Adaptive Clustering of Robust Semantic Representations for Adversarial Image Purification

abstract: Deep Learning models are highly susceptible to adversarial manipulations that can lead to catastrophic consequences. One of the most effective methods to defend against such disturbances is adversarial training but at the cost of generalization of unseen attacks and transferability across models. In this paper, we propose a robust defense against adversarial attacks, which is model agnostic and generalizable to unseen adversaries. Initially, with a baseline model, we extract the latent representations for each class and adaptively cluster the latent representations that share a semantic similarity. We obtain the distributions for the clustered latent representations and from their originating images, we learn semantic reconstruction dictionaries (SRD). We adversarially train a new model constraining the latent space representation to minimize the distance between the adversarial latent representation and the true cluster distribution. To purify the image, we decompose the input into low and high-frequency components. The high-frequency component is reconstructed based on the most adequate SRD from the clean dataset. In order to evaluate the most adequate SRD, we rely on the distance between robust latent representations and semantic cluster distributions. The output is a purified image with no perturbation. Image purification on CIFAR-10 and ImageNet-10 using our proposed method improved the accuracy by more than 10% compared to state-of-the-art results.


title: Unified Detection of Digital and Physical Face Attacks

abstract: State-of-the-art defense mechanisms against face attacks achieve near perfect accuracies within one of three attack categories, namely adversarial, digital manipulation, or physical spoofs, however, they fail to generalize well when tested across all three categories. Poor generalization can be attributed to learning incoherent attacks jointly. To overcome this shortcoming, we propose a unified attack detection framework, namely UniFAD, that can automatically cluster 25 coherent attack types belonging to the three categories. Using a multi-task learning framework along with k-means clustering, UniFAD learns joint representations for coherent attacks, while uncorrelated attack types are learned separately. Proposed UniFAD outperforms prevailing defense methods and their fusion with an overall TDR = 94.73% @ 0.2% FDR on a large fake face dataset consisting of 341K bona fide images and 448K attack images of 25 types across all 3 categories. Proposed method can detect an attack within 3 milliseconds on a Nvidia 2080Ti. UniFAD can also identify the attack types and categories with 75.81% and 97.37% accuracies, respectively.


title: OGLE-2018-BLG-1185b : A Low-Mass Microlensing Planet Orbiting a Low-Mass Dwarf

abstract: We report the analysis of planetary microlensing event OGLE-2018-BLG-1185, which was observed by a large number of ground-based telescopes and by the $Spitzer$ Space Telescope. The ground-based light curve indicates a low planet-host star mass ratio of $q = (6.9 \pm 0.2) \times 10^{-5}$, which is near the peak of the wide-orbit exoplanet mass-ratio distribution. We estimate the host star and planet masses with a Bayesian analysis using the measured angular Einstein radius under the assumption that stars of all masses have an equal probability to host this planet. The flux variation observed by $Spitzer$ was marginal, but still places a constraint on the microlens parallax. Imposing a conservative constraint that this flux variation should be $\Delta f_{\rm Spz} < 4$ instrumental flux units indicates a host mass of $M_{\rm host} = 0.37^{+0.35}_{-0.21}\ M_\odot$ and a planet mass of $m_{\rm p} = 8.4^{+7.9}_{-4.7}\ M_\oplus$. A Bayesian analysis including the full parallax constraint from $Spitzer$ suggests smaller host star and planet masses of $M_{\rm host} = 0.091^{+0.064}_{-0.018}\ M_\odot$ and $m_{\rm p} = 2.1^{+1.5}_{-0.4}\ M_\oplus$, respectively. Future high-resolution imaging observations with $HST$ or ELTs could distinguish between these two scenarios and help to reveal the planetary system properties in more detail.


title: Content-defined Merkle Trees for Efficient Container Delivery

abstract: Containerization simplifies the sharing and deployment of applications when environments change in the software delivery chain. To deploy an application, container delivery methods push and pull container images. These methods operate on file and layer (set of files) granularity, and introduce redundant data within a container. Several container operations such as upgrading, installing, and maintaining become inefficient, because of copying and provisioning of redundant data. In this paper, we reestablish recent results that block-level deduplication reduces the size of individual containers, by verifying the result using content-defined chunking. Block-level deduplication, however, does not improve the efficiency of push/pull operations which must determine the specific blocks to transfer. We introduce a content-defined Merkle Tree (\CDMT{}) over deduplicated storage in a container. \CDMT{} indexes deduplicated blocks and determines changes to blocks in logarithmic time on the client. \CDMT{} efficiently pushes and pulls container images from a registry, especially as containers are upgraded and (re-)provisioned on a client. We also describe how a registry can efficiently maintain the \CDMT{} index as new image versions are pushed. We show the scalability of \CDMT{} over Merkle Trees in terms of disk and network I/O savings using 15 container images and 233 image versions from Docker Hub.


title: Identity and Posture Recognition in Smart Beds with Deep Multitask Learning

abstract: Sleep posture analysis is widely used for clinical patient monitoring and sleep studies. Earlier research has revealed that sleep posture highly influences symptoms of diseases such as apnea and pressure ulcers. In this study, we propose a robust deep learning model capable of accurately detecting subjects and their sleeping postures using the publicly available data acquired from a commercial pressure mapping system. A combination of loss functions is used to discriminate subjects and their sleeping postures simultaneously. The experimental results show that our proposed method can identify the patients and their in-bed posture with almost no errors in a 10-fold cross-validation scheme. Furthermore, we show that our network achieves an average accuracy of up to 99% when faced with new subjects in a leave-one-subject-out validation procedure on the three most common sleeping posture categories. We demonstrate the effects of the combined cost function over its parameter and show that learning both tasks simultaneously improves performance significantly. Finally, we evaluate our proposed pipeline by testing it over augmented images of our dataset. The proposed algorithm can ultimately be used in clinical and smart home environments as a complementary tool with other available automated patient monitoring systems.


title: The Origin of the Orbital Parameter Distribution of Merging Halos

abstract: We describe a simple model which explains the qualitative and (approximate) quantitative features of the distribution of orbital velocities of merging pairs of dark matter halos. Our model considers a primary dark matter halo as a perturber in a background of secondary halos with velocities described by linear theory. By evaluating the ensemble of secondary halos on orbits within the perturbing halo's "loss cone" we derive the distribution of orbital parameters of these captured halos. This model is able provide qualitative explanations for the features of this distribution as measured from N-body simulations, and is in approximate quantitative agreement with those measurements. As the velocity dispersion of the background halos is larger on smaller scales our model predicts an overall increase in the characteristic velocities of merging halos, relative to the virial velocities of those halos, in lower mass systems. Our model also provides a simple explanation for the measured independence of the orbital velocity distribution function on redshift when considered at fixed peak height. By connecting the orbital parameter distribution to the underlying power spectrum our model also allows for estimates to be made of the effect of modifying that power spectrum, for example by including a truncation at large wavenumber. For plausible warm dark matter models we find that this truncation has only a small effect on the predicted distributions.


title: Alternating projections with applications to Gerchberg-Saxton error reduction

abstract: We consider convergence of alternating projections between non-convex sets and obtain applications to convergence of the Gerchberg-Saxton error reduction method, of the Gaussian expectation-maximization algorithm, and of Cadzow's algorithm.


title: Near-Precise Parameter Approximation for Multiple Multiplications on A Single DSP Block

abstract: A multiply-accumulate (MAC) operation is the main computation unit for DSP applications. DSP blocks are one of the efficient solutions to implement MACs in FPGA's. However, since the DSP blocks have wide multiplier and adder blocks, MAC operations using low bit-length parameters lead to an underutilization problem. Hence, an efficient approximation technique is introduced. The technique includes manipulation and approximation of the low bit-length fixed-point parameters based upon a Single DSP - Multiple Multiplication (SDMM) execution. The SDMM changes the traditional MAC implementation in the DSP block by separating multiplication and accumulation operations. While the accumulator hardware available in the DSP block is used for multiple parameter multiplication, parallel LUTs are employed for the accumulation part of the MAC operation. The accuracy of the developed optimization technique was evaluated for different CNN weight bit precisions using the Alexnet and VGG-16 networks and the Tiny ImageNet dataset. The optimization can be implemented without loss of accuracy in almost all cases, while it causes slight accuracy losses in a few cases. Through these optimizations, the SDMM is performed at the cost of a small hardware overhead. For example, a single DSP block executes 3 8-bit fixed-point parameter multiplications. As a result of our optimizations, the parameters are represented in a different format on off-chip memory, providing up to 33% compression without any hardware cost. The compression rate can be further increased by up to 97% when used in conjunction with other compression methods for the VGG-16. Reaching this compression rate requires extra hardware cost. A prototype systolic array architecture was implemented employing our optimizations on a Xilinx Zynq FPGA. It reduced the number of DSP blocks by 66.6%, 75%, and 83.3% for 8, 6, and 4-bit input variables, respectively.


title: Temporal patterns of synchrony in a pyramidal-interneuron gamma (PING) network

abstract: Synchronization in neural system plays an important role in many brain functions. Synchronization in the gamma frequency band (30Hz-100Hz) is involved in a variety of cognitive phenomena; abnormalities of the gamma synchronization are found in schizophrenia and autism spectrum disorder. Frequently, the strength of synchronization is not very high and is intermittent even on short time scales (a few cycles of oscillations). That is, the network exhibits intervals of synchronization followed by intervals of desynchronization. Neural circuits dynamics may show different distributions of desynchronization durations even if the synchronization strength is fixed. In this study, we use a conductance-based neural network exhibiting pyramidal-interneuron (PING) gamma rhythm to study the temporal patterning of synchronized neural oscillations. We found that changes in the synaptic strength (as well as changes in the membrane kinetics) can alter the temporal patterning of synchrony. Moreover, we found that the changes in the temporal pattern of synchrony may be independent of the changes in the average synchrony strength. Even though the temporal patterning may vary, there is a tendency for dynamics with short (although potentially numerous) desynchronizations, similar to what was observed in experimental studies of neural activity synchronization in the brain. Recent studies suggested that the short desynchronizations dynamics may facilitate the formation and the break-up of transient neural assemblies. Thus, the results of this study suggest that changes of synaptic strength may alter the temporal patterning of the gamma synchronization as to make the neural networks more efficient in the formation of neural assemblies and the facilitation of cognitive phenomena.


title: A data-driven personalized smart lighting recommender system

abstract: Recommender systems attempts to identify and recommend the most preferable item (product-service) to an individual user. These systems predict user interest in items based on related items, users, and the interactions between items and users. We aim to build an auto-routine and color scheme recommender system that leverages a wealth of historical data and machine learning methods. We introduce an unsupervised method to recommend a routine for lighting. Moreover, by analyzing users' daily logs, geographical location, temporal and usage information we understand user preference and predict their preferred color for lights. To do so, we cluster users based on their geographical information and usage distribution. We then build and train a predictive model within each cluster and aggregate the results. Results indicate that models based on similar users increases the prediction accuracy, with and without prior knowledge about user preferences.


title: Sculpting the plasmonic responses of nanoparticles by directed electron beam irradiation

abstract: Spatial confinement of matter in functional nanostructures has propelled these systems to the forefront of nanoscience, both as a playground for exotic physics and quantum phenomena and in multiple applications including plasmonics, optoelectronics, and sensing. In parallel, the emergence of monochromated electron energy loss spectroscopy (EELS) has enabled exploration of local nanoplasmonic functionalities within single nanoparticles and the collective response of nanoparticle assemblies, providing deep insight into the associated mechanisms. However, modern synthesis processes for plasmonic nanostructures are often limited in the types of accessible geometry and materials, and even then, limited to spatial precisions on the order of tens of nm, precluding the direct exploration of critical aspects of the structure-property relationships. Here, we use the atomic-sized probe of the scanning transmission electron microscope (STEM) to perform precise sculpting and design of nanoparticle configurations. Furthermore, using low-loss (EELS), we provide dynamic analyses of evolution of the plasmonic response during the sculpting process. We show that within self-assembled systems of nanoparticles, individual nanoparticles can be selectively removed, reshaped, or arbitrarily patterned with nanometer-level resolution, effectively modifying the plasmonic response in both space and energy domains. This process significantly increases the scope for design possibilities and presents opportunities for arbitrary structure development, which are ultimately key for nanophotonic design. Nanosculpting introduces yet another capability to the electron microscope.


title: Learning Optical Flow from a Few Matches

abstract: State-of-the-art neural network models for optical flow estimation require a dense correlation volume at high resolutions for representing per-pixel displacement. Although the dense correlation volume is informative for accurate estimation, its heavy computation and memory usage hinders the efficient training and deployment of the models. In this paper, we show that the dense correlation volume representation is redundant and accurate flow estimation can be achieved with only a fraction of elements in it. Based on this observation, we propose an alternative displacement representation, named Sparse Correlation Volume, which is constructed directly by computing the k closest matches in one feature map for each feature vector in the other feature map and stored in a sparse data structure. Experiments show that our method can reduce computational cost and memory use significantly, while maintaining high accuracy compared to previous approaches with dense correlation volumes. Code is available at https://github.com/zacjiang/scv .


title: Killing tensors and photon surfaces in foliated spacetimes

abstract: We present a purely geometric method for constructing a rank two Killing tensor in a spacetime with a codimension one foliation that lifts the trivial Killing tensors from slices to the entire manifold. The resulting Killing tensor can be nontrivial. A deep connection is found between the existence of such a Killing tensor and the presence of generalized photon surfaces in spacetime with two Killing vector fields. This technique generates Killing tensors in a purely algebraic way, without solving differential equations. The use of our method is demonstrated for Kerr, Kerr-Newman-NUT-AdS metrics and Kerr-NUT-AdS multicharge gauged supergravity solution.


title: Thermal Hall Effect of Chiral Spin Fluctuations

abstract: Using a two-dimensional square lattice Heisenberg model with a Rashba-type Dzyaloshinskii-Moriya interaction, we demonstrate that chiral spin fluctuations can give rise to a thermal Hall effect in the absence of any static spin texture or momentum space topology. It is shown by means of Monte Carlo and stochastic spin dynamics simulations that the thermal Hall response is finite at elevated temperature outside of the linear spin wave regime and consistent with the presence of thermal fluctuation-induced nontrivial topology. Our result suggests that the high-fluctuation phases outside of the conventional regime of magnonics may yet be a promising area of exploration for spin-based electronics.


title: Passage from the Boltzmann equation with Diffuse Boundary to the Incompressible Euler equation with Heat Convection

abstract: We derive the incompressible Euler equations with heat convection with the no-penetration boundary condition from the Boltzmann equation with the diffuse boundary in the hydrodynamic limit for the scale of large Reynold number. Inspired by the recent framework in [30], we consider the Navier-Stokes-Fourier system with no-slip boundary conditions as an intermediary approximation and develop a Hilbert-type expansion of the Boltzmann equation around the global Maxwellian that allows the nontrivial heat transfer by convection in the limit. To justify our expansion and the limit, a new direct estimate of the heat flux and its derivatives in the Navier-Stokes-Fourier system is established adopting a recent Green's function approach in the study of the inviscid limit.


title: Variations on the Tait-Kneser theorem

abstract: The Tait-Kneser theorem, first demonstrated by Peter G. Tait in 1896, states that the osculating circles along a plane curve with monotone non-vanishing curvature are pairwise disjoint and nested. This note contains a proof of this theorem using the Lorentzian geometry of the space of circles. We show how a similar proof applies to two variations on the theorem, concerning the osculating Hooke and Kepler conics along a plane curve. We also prove a version of the 4-vertex theorem for Kepler conics.


title: Collective Synchronous Spiking in a Brain Network of Coupled Nonlinear Oscillators

abstract: A network of propagating nonlinear oscillatory modes (waves) in the human brain is shown to generate collectively synchronized spiking activity (hypersynchronous spiking) when both amplitude and phase coupling between modes are taken into account. The nonlinear behavior of the modes participating in the network are the result of the nonresonant dynamics of weakly evanescent cortical waves that, as shown recently, adhere to an inverse frequency-wave number dispersion relation when propagating through an inhomogeneous anisotropic media characteristic of the brain cortex. This description provides a missing link between simplistic models of synchronization in networks of small amplitude phase coupled oscillators and in networks built with various empirically fitted models of pulse or amplitude coupled spiking neurons. Overall the phase-amplitude coupling mechanism presented in the Letter shows significantly more efficient synchronization compared to current standard approaches and demonstrates an emergence of collective synchronized spiking from subthreshold oscillations that neither phase nor amplitude coupling alone are capable of explaining.


title: Strategy Synthesis for Partially-known Switched Stochastic Systems

abstract: We present a data-driven framework for strategy synthesis for partially-known switched stochastic systems. The properties of the system are specified using linear temporal logic (LTL) over finite traces (LTLf), which is as expressive as LTL and enables interpretations over finite behaviors. The framework first learns the unknown dynamics via Gaussian process regression. Then, it builds a formal abstraction of the switched system in terms of an uncertain Markov model, namely an Interval Markov Decision Process (IMDP), by accounting for both the stochastic behavior of the system and the uncertainty in the learning step. Then, we synthesize a strategy on the resulting IMDP that maximizes the satisfaction probability of the LTLf specification and is robust against all the uncertainties in the abstraction. This strategy is then refined into a switching strategy for the original stochastic system. We show that this strategy is near-optimal and provide a bound on its distance (error) to the optimal strategy. We experimentally validate our framework on various case studies, including both linear and non-linear switched stochastic systems.


title: Insight about Detection, Prediction and Weather Impact of Coronavirus (Covid-19) using Neural Network

abstract: The world is facing a tough situation due to the catastrophic pandemic caused by novel coronavirus (COVID-19). The number people affected by this virus are increasing exponentially day by day and the number has already crossed 6.4 million. As no vaccine has been discovered yet, the early detection of patients and isolation is the only and most effective way to reduce the spread of the virus. Detecting infected persons from chest X-Ray by using Deep Neural Networks, can be applied as a time and laborsaving solution. In this study, we tried to detect Covid-19 by classification of Covid-19, pneumonia and normal chest X-Rays. We used five different Convolutional Pre-Trained Neural Network models (VGG16, VGG19, Xception, InceptionV3 and Resnet50) and compared their performance. VGG16 and VGG19 shows precise performance in classification. Both models can classify between three kinds of X-Rays with an accuracy over 92%. Another part of our study was to find the impact of weather factors (temperature, humidity, sun hour and wind speed) on this pandemic using Decision Tree Regressor. We found that temperature, humidity and sun-hour jointly hold 85.88% impact on escalation of Covid-19 and 91.89% impact on death due to Covid-19 where humidity has 8.09% impact on death. We also tried to predict the death of an individual based on age, gender, country, and location due to COVID-19 using the LogisticRegression, which can predict death of an individual with a model accuracy of 94.40%.


title: A Machine Learning Model for Nowcasting Epidemic Incidence

abstract: Due to delay in reporting, the daily national and statewide COVID-19 incidence counts are often unreliable and need to be estimated from recent data. This process is known in economics as nowcasting. We describe in this paper a simple random forest statistical model for nowcasting the COVID - 19 daily new infection counts based on historic data along with a set of simple covariates, such as the currently reported infection counts, day of the week, and time since first reporting. We apply the model to adjust the daily infection counts in Ohio, and show that the predictions from this simple data-driven method compare favorably both in quality and computational burden to those obtained from the state-of-the-art hierarchical Bayesian model employing a complex statistical algorithm.


title: Geometry of curved Yang-Mills-Higgs gauge theories

abstract: This is my Ph.D. thesis defended at 31 May 2021, and it is devoted to the study of the geometry of curved Yang-Mills-Higgs gauge theory (CYMH GT), a theory introduced by Alexei Kotov and Thomas Strobl. This theory reformulates classical gauge theory, in particular, the Lie algebra (and its action) is generalized to a Lie algebroid $E$, equipped with a connection $\nabla$, and the field strength has an extra term $\zeta$. In the classical situation $E$ is an action Lie algebroid, $\nabla$ is then the canonical flat connection with respect to such an $E$, and $\zeta\equiv 0$. The shortened main results of this Ph.D.thesis are the following; see the abstract in the thesis itself for more information: 1. Reformulating curved Yang-Mills-Higgs gauge theory, also including a thorough introduction and a coordinate-free formulation. Especially the infinitesimal gauge transformation will be generalized to a derivation on vector bundle $V$-valued functionals, induced by a Lie algebroid connection. 2. We will discuss what type of connection for the definition of the infinitesimal gauge transformation should be used, and this is argued by studying the commutator of two infinitesimal gauge transformations, viewed as derivations on $V$-valued functionals. We take the connection on $W$ then in such a way that the commutator is again an infinitesimal gauge transformation. 3. Defining an equivalence of CYMH GTs given by a field redefinition. In order to preserve the physics, this equivalence is constructed in such a way that the Lagrangian of the studied theory is invariant under this field redefinition. It is then natural to study whether there are equivalence classes admitting representatives with flat $\nabla$ and/or zero $\zeta$, and we will do so especially for Lie algebra bundles, tangent bundles and their direct products as Lie algebroids.


title: Dynamic Encoder Transducer: A Flexible Solution For Trading Off Accuracy For Latency

abstract: We propose a dynamic encoder transducer (DET) for on-device speech recognition. One DET model scales to multiple devices with different computation capacities without retraining or finetuning. To trading off accuracy and latency, DET assigns different encoders to decode different parts of an utterance. We apply and compare the layer dropout and the collaborative learning for DET training. The layer dropout method that randomly drops out encoder layers in the training phase, can do on-demand layer dropout in decoding. Collaborative learning jointly trains multiple encoders with different depths in one single model. Experiment results on Librispeech and in-house data show that DET provides a flexible accuracy and latency trade-off. Results on Librispeech show that the full-size encoder in DET relatively reduces the word error rate of the same size baseline by over 8%. The lightweight encoder in DET trained with collaborative learning reduces the model size by 25% but still gets similar WER as the full-size baseline. DET gets similar accuracy as a baseline model with better latency on a large in-house data set by assigning a lightweight encoder for the beginning part of one utterance and a full-size encoder for the rest.


title: SILVERRUSH X: Machine Learning-Aided Selection of $9318$ LAEs at $z=2.2$, $3.3$, $4.9$, $5.7$, $6.6$, and $7.0$ from the HSC SSP and CHORUS Survey Data

abstract: We present a new catalog of $9318$ Ly$\alpha$ emitter (LAE) candidates at $z = 2.2$, $3.3$, $4.9$, $5.7$, $6.6$, and $7.0$ that are photometrically selected by the SILVERRUSH program with a machine learning technique from large area (up to $25.0$ deg$^2$) imaging data with six narrowband filters taken by the Subaru Strategic Program with Hyper Suprime-Cam (HSC SSP) and a Subaru intensive program, Cosmic HydrOgen Reionization Unveiled with Subaru (CHORUS). We construct a convolutional neural network that distinguishes between real LAEs and contaminants with a completeness of $94$% and a contamination rate of $1$%, enabling us to efficiently remove contaminants from the photometrically selected LAE candidates. We confirm that our LAE catalogs include $177$ LAEs that have been spectroscopically identified in our SILVERRUSH programs and previous studies, ensuring the validity of our machine learning selection. In addition, we find that the object-matching rates between our LAE catalogs and our previous results are $\simeq 80$-$100$% at bright NB magnitudes of $\lesssim 24$ mag. We also confirm that the surface number densities of our LAE candidates are consistent with previous results. Our LAE catalogs will be made public on our project webpage.


title: Growth of barchan dunes of bidispersed granular mixtures

abstract: Barchans are dunes of crescentic shape found on Earth, Mars and other celestial bodies, growing usually on polydisperse granular beds. In this Letter, we investigate experimentally the growth of subaqueous barchans consisting of bidisperse grains. We found that the grain distribution within the dune changes with the employed pair, and that a transient stripe appears on the dune surface. We propose that observed patterns result from the competition between fluid entrainment and easiness of rolling for each grain type, and that grains segregate with a diffusion-like mechanism. Our results provide new insights into barchan structures found in other environments.


title: Significant improvement in planetary system simulations from statistical averaging

abstract: Symplectic integrators are widely used for the study of planetary dynamics and other $N$-body problems. In a study of the outer Solar system, we demonstrate that individual symplectic integrations can yield biased errors in the semi-major axes and possibly other orbital elements. The bias is resolved by studying an ensemble of initial conditions of the outer Solar system. Such statistical sampling could significantly improve measurement of planetary system properties like their secular frequencies. We also compared the distributions of action-like variables between high and low accuracy integrations; traditional statistical metrics are unable to distinguish the distribution functions.

categories: astro-ph.EP astro-ph.GA astro-ph.IM nlin.CD