title: AMP: Adversarial Motion Priors for Stylized Physics-Based Character Control

abstract: Synthesizing graceful and life-like behaviors for physically simulated characters has been a fundamental challenge in computer animation. Data-driven methods that leverage motion tracking are a prominent class of techniques for producing high fidelity motions for a wide range of behaviors. However, the effectiveness of these tracking-based methods often hinges on carefully designed objective functions, and when applied to large and diverse motion datasets, these methods require significant additional machinery to select the appropriate motion for the character to track in a given scenario. In this work, we propose to obviate the need to manually design imitation objectives and mechanisms for motion selection by utilizing a fully automated approach based on adversarial imitation learning. High-level task objectives that the character should perform can be specified by relatively simple reward functions, while the low-level style of the character's behaviors can be specified by a dataset of unstructured motion clips, without any explicit clip selection or sequencing. These motion clips are used to train an adversarial motion prior, which specifies style-rewards for training the character through reinforcement learning (RL). The adversarial RL procedure automatically selects which motion to perform, dynamically interpolating and generalizing from the dataset. Our system produces high-quality motions that are comparable to those achieved by state-of-the-art tracking-based techniques, while also being able to easily accommodate large datasets of unstructured motion clips. Composition of disparate skills emerges automatically from the motion prior, without requiring a high-level motion planner or other task-specific annotations of the motion clips. We demonstrate the effectiveness of our framework on a diverse cast of complex simulated characters and a challenging suite of motor control tasks.


title: A decision-making machine learning approach in Hermite spectral approximations of partial differential equations

abstract: The accuracy and effectiveness of Hermite spectral methods for the numerical discretization of partial differential equations on unbounded domains, are strongly affected by the amplitude of the Gaussian weight function employed to describe the approximation space. This is particularly true if the problem is under-resolved, i.e., there are no enough degrees of freedom. The issue becomes even more crucial when the equation under study is time-dependent, forcing in this way the choice of Hermite functions where the corresponding weight depends on time. In order to adapt dynamically the approximation space, it is here proposed an automatic decision-making process that relies on machine learning techniques, such as deep neural networks and support vector machines. The algorithm is numerically tested with success on a simple 1D problem, but the main goal is its exportability in the context of more serious applications.


title: Majorana correlations in the Kitaev model with ordered-flux structures

abstract: We study the effects of the flux configurations on the emergent Majorana fermions in the $S=1/2$ Kitaev model on a honeycomb lattice, where quantum spins are fractionalized into itinerant Majorana fermions and localized fluxes. A quantum spin liquid appears as the ground state of the Kitaev model in the flux-free sector, which has intensively been investigated so far. In this flux sector, the Majorana fermion system has linear dispersions and shows power law behavior in the Majorana correlations. On the other hand, periodically-arranged flux configurations yield low-energy excitations in the Majorana fermion system, which are distinctly different from those in the flux-free state. We find that one of the periodically arranged flux states results in the gapped Majorana dispersion and the exponential decay in the Majorana correlations. The Kitaev system with another flux configuration exhibits a semi-Dirac like dispersion, leading to the power law decay with a smaller power than that in the flux-free sector along symmetry axes. We also examine the effect of the randomness in the flux configurations and clarify that the Majorana density of states is filled by increasing the flux density, and power-law decay in the Majorana correlations remains. The present results could be important to control the motion of Majorana fermions, which carries the spin excitations, in the Kitaev candidate materials.


title: Dynamic Models for the Beginning, Hubble Law and the Future of the Universe Based on Strong Cosmological Principle and Yang-Mills Gravity

abstract: We discuss highly simplified dynamic models for the beginning, expansion and future of the universe based on the strong cosmological principle and Yang-Mills gravity in flat space-time. We derive a relativistic Okubo equation of motion for galaxies with a time-dependent effective metric tensor $G_{\mu\nu}(t)$. The strong cosmological principle states that $G_{\mu\nu}(t)=\e_{\mu\nu} A^2(t)$ for $t \ge 0$. In a model (HHK) with Yang-Mills gravity in the super-macroscopic limit, one has $A(t)= a_o t^{1/2}$, which leads to the initial mass run away velocity $\dot{r}(0)=c$, associated with $r(0)=r_o>0$. Thus, the Okubo equation of motion for galaxies predicts a `detonation' at the beginning of the universe. The Okubo equation also implies $r(\infty) \to \infty$, $\dot{r}(\infty) \to 0$ with zero redshift for the future of the universe. In addition, the Okubo equation leads to the usual Hubble's law $\dot{r}(t) \approx H(t) r(t)$, where $H(t)=\dot{A}(t)/A(t)$ in non-relativistic approximation. We also discuss a model with a strict Hubble linear relation $\dot{r}(t) \approx const.\times r(t)$ for all time. This model gives a silent beginning of the universe: $\dot{r}(t)=0, \ \ddot{r}(t)\to\infty$ as $t \to 0$; and final radius $r(t) \to \infty,$ final velocity, $\dot{r}(t) \to c$, $\ddot{r}(t)\to 0$ as $t \to \infty$. In all models with the strong cosmological principle in flat space-time, Hubble's recession velocities are predicted to have a maximum, i.e., the speed of light, as measured in an inertial frame.


title: A flexible and fast PyTorch toolkit for simulating training and inference on analog crossbar arrays

abstract: We introduce the IBM Analog Hardware Acceleration Kit, a new and first of a kind open source toolkit to simulate analog crossbar arrays in a convenient fashion from within PyTorch (freely available at https://github.com/IBM/aihwkit). The toolkit is under active development and is centered around the concept of an "analog tile" which captures the computations performed on a crossbar array. Analog tiles are building blocks that can be used to extend existing network modules with analog components and compose arbitrary artificial neural networks (ANNs) using the flexibility of the PyTorch framework. Analog tiles can be conveniently configured to emulate a plethora of different analog hardware characteristics and their non-idealities, such as device-to-device and cycle-to-cycle variations, resistive device response curves, and weight and output noise. Additionally, the toolkit makes it possible to design custom unit cell configurations and to use advanced analog optimization algorithms such as Tiki-Taka. Moreover, the backward and update behavior can be set to "ideal" to enable hardware-aware training features for chips that target inference acceleration only. To evaluate the inference accuracy of such chips over time, we provide statistical programming noise and drift models calibrated on phase-change memory hardware. Our new toolkit is fully GPU accelerated and can be used to conveniently estimate the impact of material properties and non-idealities of future analog technology on the accuracy for arbitrary ANNs.


title: Auxiliary Function Approach for Determining Symmetry Energy at Supra-saturation Densities

abstract: Nuclear symmetry energy $E_{\rm{sym}}(\rho)$ at density $\rho$ is normally expanded or simply parameterized as a function of $\chi=(\rho-\rho_0)/3\rho_0$ in the form of $E_{\rm{sym}}(\rho)\approx S+L\chi+2^{-1}K_{\rm{sym}}\chi^2+6^{-1}J_{\rm{sym}}\chi^3+\cdots$ using its magnitude $S$, slope $L $, curvature $K_{\rm{sym}}$ and skewness $J_{\rm{sym}}$ at the saturation density $\rho_0$ of nuclear matter. Much progress has been made in recent years in constraining especially the $S$ and $L$ parameters using various terrestrial experiments and astrophysical observations. However, such kind of expansions/parameterizations do not converge at supra-saturation densities where $\chi$ is not small enough, hindering an accurate determination of high-density $E_{\rm{sym}}(\rho)$ even if its characteristic parameters at $\rho_0$ are all well determined by experiments/observations. By expanding the $E_{\rm{sym}}(\rho)$ in terms of a properly chosen auxiliary function $\Pi_{\rm{sym}}(\chi,\Theta_{\rm{sym}})$ with a parameter $\Theta_{\rm{sym}}$ fixed accurately by an experimental $E_{\rm{sym}}(\rho_{\rm{r}})$ value at a reference density $\rho_{\rm{r}}$, we show that the shortcomings of the $\chi$-expansion can be completely removed or significantly reduced in determining the high-density behavior of $E_{\rm{sym}}(\rho)$. In particular, using two significantly different auxiliary functions, we show that the new approach effectively incorporates higher $\chi$-order contributions and converges to the same $E_{\rm{sym}}(\rho)$ much faster than the conventional $\chi$-expansion at densities $\lesssim3\rho_0$. Several quantitative demonstrations using Monte Carlo simulations are given.


title: Beam-driven ECH waves: A parametric study

abstract: Electron cyclotron harmonic (ECH) waves play a significant role in driving the diffuse aurora, which constitutes more than 75% of the particle energy input into the ionosphere. ECH waves in magnetospheric plasmas have long been thought to be excited predominantly by the loss cone anisotropy (velocity-space gradients) that arises naturally in a planetary dipole field. Recent THEMIS observations, however, indicate that an electron beam can also excite such waves in Earth's magnetotail. The ambient and beam plasma conditions under which electron beam excitation can take place are unknown. Knowledge of such conditions would allow us to further explore the relative contribution of this excitation mechanism to ECH wave scattering of magnetospheric electrons at Earth and the outer planets. Using the hot plasma dispersion relation, we address the nature of beam-driven ECH waves and conduct a comprehensive parametric survey of this instability. We find that growth is provided by beam electron cyclotron resonances of both first and higher orders. We also find that these waves are unstable under a wide range of plasma conditions. The growth rate increases with beam density, beam velocity, and hot electron temperature; it decreases with increasing beam temperature and beam temperature anisotropy, hot electron density, and cold electron density and temperature. Such conditions abound in Earth's magnetotail, where magnetospheric electrons heated by earthward convection and magnetic reconnection coexist with colder ionospheric electrons.


title: The persistent, the anti-persistent and the Brownian: when does the Hurst exponent warn us of impending catastrophes?

abstract: The analogy between self-similar time series with given Hurst exponent H and Markovian, Gaussian stochastic processes with multiplicative noise and entropic index q (Borland, PRE 57, 6, 6634-6642, 1998) allows us to explain the empirical results reported in (Pavithran et al., EPL, 129 2020 24004) and (Pavithran et al. Sci. Reports 10.1 (2020) 1-8) with the help of the properties of the nonextensive entropy Sq of index q: a dominant oscillating mode arises as H goes to zero in many different systems and its amplitude is proportional to 1/ H^2 . Thus, a decrease of H acts as precursor of large oscillations of the state variable, which corresponds to catastrophic events in many problems of practical interest. In contrast, if H goes to 1 then the time series is strongly intermittent, fluctuations of the state variable follow a power law whose exponent depends on H, and exceedingly large event are basically unpredictable. These predictions agree with observations in problems of aeroacoustics, aeroelasticity, electric engineering, hydrology, laser physics, meteorology, plasma physics, plasticity, polemology, seismology and thermoacoustics.


title: GPU Domain Specialization via Composable On-Package Architecture

abstract: As GPUs scale their low precision matrix math throughput to boost deep learning (DL) performance, they upset the balance between math throughput and memory system capabilities. We demonstrate that converged GPU design trying to address diverging architectural requirements between FP32 (or larger) based HPC and FP16 (or smaller) based DL workloads results in sub-optimal configuration for either of the application domains. We argue that a Composable On-PAckage GPU (COPAGPU) architecture to provide domain-specialized GPU products is the most practical solution to these diverging requirements. A COPA-GPU leverages multi-chip-module disaggregation to support maximal design reuse, along with memory system specialization per application domain. We show how a COPA-GPU enables DL-specialized products by modular augmentation of the baseline GPU architecture with up to 4x higher off-die bandwidth, 32x larger on-package cache, 2.3x higher DRAM bandwidth and capacity, while conveniently supporting scaled-down HPC-oriented designs. This work explores the microarchitectural design necessary to enable composable GPUs and evaluates the benefits composability can provide to HPC, DL training, and DL inference. We show that when compared to a converged GPU design, a DL-optimized COPA-GPU featuring a combination of 16x larger cache capacity and 1.6x higher DRAM bandwidth scales per-GPU training and inference performance by 31% and 35% respectively and reduces the number of GPU instances by 50% in scale-out training scenarios.


title: Robust Classification Under $\ell_0$ Attack for the Gaussian Mixture Model

abstract: It is well-known that machine learning models are vulnerable to small but cleverly-designed adversarial perturbations that can cause misclassification. While there has been major progress in designing attacks and defenses for various adversarial settings, many fundamental and theoretical problems are yet to be resolved. In this paper, we consider classification in the presence of $\ell_0$-bounded adversarial perturbations, a.k.a. sparse attacks. This setting is significantly different from other $\ell_p$-adversarial settings, with $p\geq 1$, as the $\ell_0$-ball is non-convex and highly non-smooth. Under the assumption that data is distributed according to the Gaussian mixture model, our goal is to characterize the optimal robust classifier and the corresponding robust classification error as well as a variety of trade-offs between robustness, accuracy, and the adversary's budget. To this end, we develop a novel classification algorithm called FilTrun that has two main modules: Filtration and Truncation. The key idea of our method is to first filter out the non-robust coordinates of the input and then apply a carefully-designed truncated inner product for classification. By analyzing the performance of FilTrun, we derive an upper bound on the optimal robust classification error. We also find a lower bound by designing a specific adversarial strategy that enables us to derive the corresponding robust classifier and its achieved error. For the case that the covariance matrix of the Gaussian mixtures is diagonal, we show that as the input's dimension gets large, the upper and lower bounds converge; i.e. we characterize the asymptotically-optimal robust classifier. Throughout, we discuss several examples that illustrate interesting behaviors such as the existence of a phase transition for adversary's budget determining whether the effect of adversarial perturbation can be fully neutralized.


title: Normal stability of slow manifolds in nearly-periodic Hamiltonian systems

abstract: M. Kruskal showed that each nearly-periodic dynamical system admits a formal $U(1)$ symmetry, generated by the so-called roto-rate. We prove that such systems also admit nearly-invariant manifolds of each order, near which rapid oscillations are suppressed. We study the nonlinear normal stability of these slow manifolds for nearly-periodic Hamiltonian systems on barely symplectic manifolds -- manifolds equipped with closed, non-degenerate $2$-forms that may be degenerate to leading order. In particular, we establish a sufficient condition for long-term normal stability based on second derivatives of the well-known adiabatic invariant. We use these results to investigate the problem of embedding guiding center dynamics of a magnetized charged particle as a slow manifold in a nearly-periodic system. We prove that one previous embedding, and two new embeddings enjoy long-term normal stability, and thereby strengthen the theoretical justification for these models.

categories: math.DS math-ph math.MP physics.plasm-ph


title: Exploring Consequential Robot Sound: Should We Make Robots Quiet and Kawaii-et?

abstract: All robots create consequential sound -- sound produced as a result of the robot's mechanisms -- yet little work has explored how sound impacts human-robot interaction. Recent work shows that the sound of different robot mechanisms affects perceived competence, trust, human-likeness, and discomfort. However, the physical sound characteristics responsible for these perceptions have not been clearly identified. In this paper, we aim to explore key characteristics of robot sound that might influence perceptions. A pilot study from our past work showed that quieter and higher-pitched robots may be perceived as more competent and less discomforting. To better understand how variance in these attributes affects perception, we performed audio manipulations on two sets of industrial robot arm videos within a series of four new studies presented in this paper. Results confirmed that quieter robots were perceived as less discomforting. In addition, higher-pitched robots were perceived as more energetic, happy, warm, and competent. Despite the robot's industrial purpose and appearance, participants seemed to prefer more "cute" (or "kawaii") sound profiles, which could have implications for the design of more acceptable and fulfilling sound profiles for human-robot interactions with practical collaborative robots.


title: Fully anisotropic finite strain viscoelasticity based on a reverse multiplicative decomposition and logarithmic strains

abstract: In this paper we present a novel formulation for phenomenological anisotropic finite visco-hyperelasticity. The formulation is based on a multiplicative decomposition of the equilibrated deformation gradient into nonequilibrated elastic and viscous contributions. The proposal in this paper is a decomposition reversed respect to that from Sidoroff allowing for anisotropic viscous contributions. Independent anisotropic stored energies are employed for equilibrated and non-equilibrated parts. The formulation uses logarithmic strain measures in order to be teamed with spline-based hyperelasticity. Some examples compare the results with formulations that use the Sidoroff decomposition and also show the enhanced capabilities of the present model.


title: The Dawes Review 9: The role of cold gas stripping on the star formation quenching of satellite galaxies

abstract: One of the key open questions in extragalactic astronomy is what stops star formation in galaxies. While it is clear that the cold gas reservoir, which fuels the formation of new stars, must be affected first, how this happens and what are the dominant physical mechanisms involved is still a matter of debate. At least for satellite galaxies, it is generally accepted that internal processes alone cannot be responsible for fully quenching their star formation, but that environment should play an important, if not dominant, role. In nearby clusters, we see examples of cold gas being removed from the star-forming disks of galaxies moving through the intracluster medium, but whether active stripping is widespread and/or necessary to halt star formation in satellites, or quenching is just a consequence of the inability of these galaxies to replenish their cold gas reservoirs, remains unclear. In this work, we review the current status of environmental studies of cold gas in star-forming satellites in the local Universe from an observational perspective, focusing on the evidence for a physical link between cold gas stripping and quenching of the star formation. We find that stripping of cold gas is ubiquitous in satellite galaxies in both group and cluster environments. While hydrodynamical mechanisms such as ram pressure are important, the emerging picture across the full range of dark matter halos and stellar masses is a complex one, where different physical mechanisms may act simultaneously and cannot always be easily separated. Most importantly, we show that stripping does not always lead to full quenching, as only a fraction of the cold gas reservoir might be affected at the first pericentre passage. We argue that this is a key point to reconcile apparent tensions between statistical and detailed analyses of satellite galaxies...(abridged)


title: Contextualized Streaming End-to-End Speech Recognition with Trie-Based Deep Biasing and Shallow Fusion

abstract: How to leverage dynamic contextual information in end-to-end speech recognition has remained an active research area. Previous solutions to this problem were either designed for specialized use cases that did not generalize well to open-domain scenarios, did not scale to large biasing lists, or underperformed on rare long-tail words. We address these limitations by proposing a novel solution that combines shallow fusion, trie-based deep biasing, and neural network language model contextualization. These techniques result in significant 19.5% relative Word Error Rate improvement over existing contextual biasing approaches and 5.4%-9.3% improvement compared to a strong hybrid baseline on both open-domain and constrained contextualization tasks, where the targets consist of mostly rare long-tail words. Our final system remains lightweight and modular, allowing for quick modification without model re-training.


title: The Ultraviolet Index is well estimated by the terrestrial irradiance at 310nm

abstract: Ultraviolet (UV) exposure significantly contributes to non-melanoma skin cancer. In the context of health, UV exposure is the product of time and the UV Index (UVI), a weighted sum of the irradiance I(lambda) over all wavelengths from lambda = 250 to 400nm. In our analysis of the United States Environmental Protection Agency's UV-Net database of over four-hundred thousand spectral irradiance measurements taken over several years, we found that the UVI is well estimated by UVI = 77 I(310nm). To better understand this result, we applied an optical atmospheric model of the terrestrial irradiance spectra and found that it applies across a wide range of conditions.


title: Defect-mediated dynamics of coherent structures in active nematics

abstract: Active fluids, such as cytoskeletal filaments, bacterial colonies and epithelial cell layers, exhibit distinctive orientational coherence, often characterized by nematic order and topological defects. By contrast, little is known about positional coherence -- i.e., how a hidden dynamic skeleton organizes the underlying chaotic motion -- despite this being one of their most prominent and experimentally accessible features. Using a combination of dynamical systems theory, experiments on two-dimensional mixtures of microtubules and kinesin and hydrodynamic simulations, we characterize positional coherence in active nematics. These coherent structures can be identified in the framework of Lagrangian dynamics as moving attractors and repellers, which orchestrate complex motion. To understand the interaction of positional and orientational coherence on the dynamics of defects, we then analysed observations and simulations and see that +1/2 defects move and deform the attractors, thus functioning as control centers for collective motion. Additionally, we find that regions around isolated +1/2 defects undergo high bending and low stretching/shearing deformations, consistent with the local stress distribution. The stress is minimum at the defect, while high differential stress along the defect orientation induces folding. Our work offers a new perspective to describe self-organization in active fluids, with potential applications to multicellular systems.


title: Supersolid-like states in a two-dimensional trapped spin-orbit-coupled spin-1 condensate

abstract: We study supersolid-like states in a quasi-two-dimensional trapped Rashba and Dresselhaus spin-orbit (SO) coupled spin-1 condensate. For small strengths of SO coupling $\gamma$ ($\gamma \lessapprox 0.75$), in the ferromagnetic phase, circularly-symmetric $(0,\pm 1, \pm 2)$- and $(\mp 1, 0,\pm 1)$-type states are formed where the numbers in the parentheses denote the angular momentum of the vortex at the center of the components and where the upper (lower) sign correspond to Rashba (Dresselhaus) coupling; in the antiferromagnetic phase, only $(\mp 1, 0,\pm 1)$-type states are formed. For large strengths of SO coupling, supersolid-like superlattice and superstripe states are formed in the ferromagnetic phase. In the antiferromagnetic phase, for large strengths of SO coupling, supersolid-like superstripe and multi-ring states are formed. For an equal mixture of Rashba and Dresselhaus SO couplings, only a superstripe state is found. All these states are found to be dynamically stable and hence accessible in an experiment and will enhance the fundamental understanding of crystallization onto spatially periodic states in solids.


title: Landau-Lifshitz-Bloch equation for ferrimagnets with higher-order interaction

abstract: We present a micromagnetic formulation for modeling the magnetization dynamics and thermal equilibrium in ferrimagnetic materials at low and elevated temperatures. The formulation is based on a mean field approximation (MFA). In this formulation, the ferrimagnet is described micromagnetically by two coupled sublattices with corresponding interactions, including inter- and intra-sublattice micromagnetic exchange as well as four-spin interactions described as an inter-sublattice molecular field with a cubic dependence of the magnetization. The MFA is used to derive a Landau Lifshitz Bloch type equation for ferrimagnetic material, including cases with a ferromagnetic - antiferromagnetic phase transitions. For validation, the results obtained via the presented model are compared with recent experimental data for phase transitions in FeRh.


title: Designing Efficient and High-performance AI Accelerators with Customized STT-MRAM

abstract: In this paper, we demonstrate the design of efficient and high-performance AI/Deep Learning accelerators with customized STT-MRAM and a reconfigurable core. Based on model-driven detailed design space exploration, we present the design methodology of an innovative scratchpad-assisted on-chip STT-MRAM based buffer system for high-performance accelerators. Using analytically derived expression of memory occupancy time of AI model weights and activation maps, the volatility of STT-MRAM is adjusted with process and temperature variation aware scaling of thermal stability factor to optimize the retention time, energy, read/write latency, and area of STT-MRAM. From the analysis of modern AI workloads and accelerator implementation in 14nm technology, we verify the efficacy of our designed AI accelerator with STT-MRAM STT-AI. Compared to an SRAM-based implementation, the STT-AI accelerator achieves 75% area and 3% power savings at iso-accuracy. Furthermore, with a relaxed bit error rate and negligible AI accuracy trade-off, the designed STT-AI Ultra accelerator achieves 75.4%, and 3.5% savings in area and power, respectively over regular SRAM-based accelerators.


title: The G 305 Star-forming Region: II. Irregular variable stars

abstract: We present a catalog of 167 newly discovered, irregular variables spanning a $\sim$7 deg${^2}$ area that encompasses the G 305 star-forming complex, one of the most luminous giant H II regions in the Galaxy. We aim to unveil and characterize the young stellar object (YSO) population of the region by analyzing the $K_{\rm s}$-band variability and $JHK_{\rm s}$ infrared colors from the {\it VISTA Variables in the V\'ia L\'actea} (VVV) survey. Additionally, SDSS-IV APOGEE-2 infrared spectra of selected objects are analyzed. The sample show relatively high amplitudes ($0.661<\Delta K_{\rm S} <3.521$ mag). Most of them resemble sources with outbursts with amplitude $>1$ mag and duration longer than a few days, typically at least a year, known as {\it Eruptive Variables}. About 60% are likely to be Class II/Flat/I objects. This is also confirmed by the spectral index $\alpha$ when available. From the analysis of APOGEE-2 near-infrared spectra of sources in the region, another 122 stars are classified as YSOs, and displays some infrared variability. The measured effective temperature $T_{\rm eff}$ peak is around 4000K and they are slightly super-solar in metal abundance. The modal radial velocity is approximately $-$41 km/s. Combining available catalogs of YSOs in the region with our data, we investigate the spatial distributions of 700 YSOs. They are clearly concentrated within the central cavity formed by the massive clusters Danks 1 and 2. The calculated surface density for the entire catalog is 0.025 YSOs/pc$^{-2}$, while the central cavity contains 10 times more objects per area (0.238 YSOs/pc$^{-2}$).


title: Big Three Dragons: A [N II] 122 $\mu$m Constraint and New Dust-continuum Detection of A $z = 7.15$ Bright Lyman Break Galaxy with ALMA

abstract: We present new Atacama Large Millimeter/submillimeter Array Band 7 observational results of a Lyman break galaxy at $ z=7.15 $, B14-65666 ("Big Three Dragons"), which is an object detected in [OIII] 88 $\rm{\mu m}$, [CII] 158 $\rm{\mu m}$, and dust-continuum emission during the epoch of reionization. Our targets are the [NII] 122 $\rm{\mu m}$ fine-structure emission line and underlying 120 $\rm{\mu m}$ dust continuum. The dust continuum is detected with a $ \sim $19$ \sigma $ significance. From far-infrared spectral energy distribution sampled at 90, 120, and 160 $\rm{\mu m}$, we obtaine a best-fit dust temperature of $ 40 $ K ($ 79 $ K) and an infrared luminosity of $ \log_{10}(L_{\rm IR}/{\rm L}_\odot)=11.6$ ($12.1$) at the emissivity index $ \beta = 2.0 $ (1.0). The [NII] 122 $\rm{\mu m}$ line is not detected. The 3$ \sigma $ upper limit of the [NII] luminosity is $ 8.1 \times 10^7\ {\rm L}_\odot$. From the [NII], [OIII], and [CII] line luminosities, we use the Cloudy photoionization code to estimate nebular parameters as functions of metallicity. If the metallicity of the galaxy is high ($ Z > 0.4\ {\rm Z}_\odot$), the ionization parameter and hydrogen density are $ \log_{10} U \simeq -2.7\pm0.1$ and $ n_\text{H} \simeq 50$-$250\ {\rm cm}^{-3}$, respectively, which are comparable to those measured in low-redshift galaxies. The nitrogen-to-oxygen abundance ratio, $\rm{N/O}$, is constrained to be sub-solar. At $ Z < 0.4\ {\rm Z}_\odot$, the allowed $ U $ drastically increases as the assumed metallicity decreases. For high ionization parameters, the $\rm{N/O}$ constraint becomes weak. Finally, our Cloudy models predict the location of B14-65666 on the BPT diagram, thereby allowing a comparison with low-redshift galaxies.


title: Melnikov method for non-conservative perturbations of the three-body problem

abstract: We consider the planar circular restricted three-body problem (PCRTBP), as a model for the motion of a spacecraft relative to the Earth-Moon system. We focus on the Lagrange equilibrium points $L_1$ and $L_2$. There are families of Lyapunov periodic orbits around either $L_1$ or $L_2$, forming Lyapunov manifolds. There also exist homoclinic orbits to the Lyapunov manifolds around either $L_1$ or $L_2$, as well as heteroclinic orbits between the Lyapunov manifold around $L_1$ and the one around $L_2$. The motion along the homoclinic/heteroclinic orbits can be described via the scattering map, which gives the future asymptotic of a homoclinic orbit as a function of the past asymptotic. In contrast with the more customary Melnikov theory, we do not need to assume that the asymptotic orbits have a special nature (periodic, quasi-periodic, etc.). We add a non-conservative, time-dependent perturbation, as a model for a thrust applied to the spacecraft for some duration of time, or for some other effect, such as solar radiation pressure. We compute the first order approximation of the perturbed scattering map, in terms of fast convergent integrals of the perturbation along homoclinic/heteroclinic orbits of the unperturbed system. As a possible application, this result can be used to determine the trajectory of the spacecraft upon using the thrust.


title: One-sided topological conjugacy of normal subshifts and gauge actions on the associated $C^*$-algebras

abstract: The class of normal subshifts includes irreducible infinite topological Markov shifts, irreducible infinite sofic shifts, synchronized systems, Dyck shifts, $\beta$-shifts, substitution minimal shifts, and so on. We will characterize one-sided topological conjugacy classes of normal subshifts in terms of the associated $C^*$-algebras and its gauge actions with potentials.


title: Noncollinear ferrielectricity and morphotropic phase boundary in GeS monolayer

abstract: Two-dimensional polarity is intriguing but remains in the early stage. Here a structural evolution diagram is established for GeS monolayer, which leads a noncollinear ferrielectric $\delta$-phase energetically as stable as the ferroelectric $\alpha$-phase. Its ferrielectricity is induced by the phonon frustration, i.e., the competition between ferroelectric and antiferroelectric modes, providing more routes to tune its polarity. Besides its prominent properties like large band gap, large polarization, and high Curie temperature, more interestingly, the morphotropic phase boundary between $\alpha$- and $\delta$-phases is highly possible, which is crucial to obtain giant piezoelectricity for lead-free applications.


title: Attention Head Masking for Inference Time Content Selection in Abstractive Summarization

abstract: How can we effectively inform content selection in Transformer-based abstractive summarization models? In this work, we present a simple-yet-effective attention head masking technique, which is applied on encoder-decoder attentions to pinpoint salient content at inference time. Using attention head masking, we are able to reveal the relation between encoder-decoder attentions and content selection behaviors of summarization models. We then demonstrate its effectiveness on three document summarization datasets based on both in-domain and cross-domain settings. Importantly, our models outperform prior state-of-the-art models on CNN/Daily Mail and New York Times datasets. Moreover, our inference-time masking technique is also data-efficient, requiring only 20% of the training samples to outperform BART fine-tuned on the full CNN/DailyMail dataset.


title: Tuned Compositional Feature Replays for Efficient Stream Learning

abstract: Our brains extract durable, generalizable knowledge from transient experiences of the world. Artificial neural networks come nowhere close to this ability. When tasked with learning to classify objects by training on non-repeating video frames in temporal order (online stream learning), models that learn well from shuffled datasets catastrophically forget old knowledge upon learning new stimuli. We propose a new continual learning algorithm, Compositional Replay Using Memory Blocks (CRUMB), which mitigates forgetting by replaying feature maps reconstructed by combining generic parts. CRUMB concatenates trainable and re-usable "memory block" vectors to compositionally reconstruct feature map tensors in convolutional neural networks. Storing the indices of memory blocks used to reconstruct new stimuli enables memories of the stimuli to be replayed during later tasks. This reconstruction mechanism also primes the neural network to minimize catastrophic forgetting by biasing it towards attending to information about object shapes more than information about image textures, and stabilizes the network during stream learning by providing a shared feature-level basis for all training examples. These properties allow CRUMB to outperform an otherwise identical algorithm that stores and replays raw images, while occupying only 3.6% as much memory. We stress-tested CRUMB alongside 13 competing methods on 7 challenging datasets. To address the limited number of existing online stream learning datasets, we introduce 2 new benchmarks by adapting existing datasets for stream learning. With only 3.7-4.1% as much memory and 15-43% as much runtime, CRUMB mitigates catastrophic forgetting more effectively than the state-of-the-art. Our code is available at https://github.com/MorganBDT/crumb.git.


title: Dissecting User-Perceived Latency of On-Device E2E Speech Recognition

abstract: As speech-enabled devices such as smartphones and smart speakers become increasingly ubiquitous, there is growing interest in building automatic speech recognition (ASR) systems that can run directly on-device; end-to-end (E2E) speech recognition models such as recurrent neural network transducers and their variants have recently emerged as prime candidates for this task. Apart from being accurate and compact, such systems need to decode speech with low user-perceived latency (UPL), producing words as soon as they are spoken. This work examines the impact of various techniques - model architectures, training criteria, decoding hyperparameters, and endpointer parameters - on UPL. Our analyses suggest that measures of model size (parameters, input chunk sizes), or measures of computation (e.g., FLOPS, RTF) that reflect the model's ability to process input frames are not always strongly correlated with observed UPL. Thus, conventional algorithmic latency measurements might be inadequate in accurately capturing latency observed when models are deployed on embedded devices. Instead, we find that factors affecting token emission latency, and endpointing behavior have a larger impact on UPL. We achieve the best trade-off between latency and word error rate when performing ASR jointly with endpointing, while utilizing the recently proposed alignment regularization mechanism.


title: Noncollinear topological textures in two-dimensional van der Waals materials: From magnetic to polar systems

abstract: In recent years, noncollinear topological textures have long gained increasing research attentions for their high values of both fundamental researches and potential applications. The recent discovery of intrinsic orders in magnetic and polar two-dimensional van der Waals materials provides a new ideal platform for the investigation of noncollinear topological textures. Here, we review the theoretical and experimental progresses on noncollinear topological textures in two-dimensional van der Waals materials in very recent years. During these years, magnetic skyrmions of both Bloch and N\'eel types have been observed experimentally in a few two-dimensional van der Waals materials and related heterostructures. Concurrently, more theoretic predictions basing on various mechanisms have been reported about different noncollinear topological textures in two-dimensional van der Waals materials, such as skyrmions, bimerons, anti-biskyrmions and skyrmionium, which are still waiting to be confirmed in experiments. Besides, noncollinear topological electric dipole orders have also been predicted in two-dimensional van der Waals materials. Taking advantage of the intrinsic two-dimensional nature and high integratability, the two-dimensional van der Waals materials will play an important role in the investigation on noncollinear topological textures in both magnetic and polar systems.


title: Quantum-Probe Field Microscopy of Ultrafast Terahertz Excitations

abstract: Rapid evolutions of microscopic fields govern the majority of elementary excitations in condensed matter and drive microelectronic currents at increasing frequencies. Beyond nominal "radio frequencies", however, access to local electric waveforms remains a challenge. Several imaging schemes resolve sub-wavelength fields up to multi-Terahertz (THz) frequencies - including scanning-probe techniques, electro-optic sampling or recent ultrafast electron microscopy. Yet, various constraints on sample geometries, acquisition speed and maximum fields limit applications. Here, we introduce ubiquitous far-field microscopy of ultrafast local electric fields based on drop-cast quantum-dot probes. Our approach, termed Quantum-probe Field Microscopy (QFIM), combines fluorescence imaging of visible photons with phase-resolved sampling of electric fields deeply in the sub-wavelength regime. We capture stroboscopic movies of localized and propagating ultrafast Terahertz excitations with sub-picosecond temporal resolution. The scheme employs field-driven modulations of optical absorption in colloidal quantum-dots via the quantum-confined Stark-effect, accessible via far-field luminescence. The QFIM approach is compatible with strong-field sample excitation and sub-micrometer resolution - introducing a route towards ultrafast field imaging in active nanostructures during operation.


title: Generation of new exciting regressors for consistent on-line estimation of unknown constant parameters

abstract: The problem of parameter estimation from a standard vector linear regression equation in the absence of sufficient excitation in the regressor is addressed. The first step to solve the problem consists in transforming this equation into a set of scalar ones using the well-known dynamic regressor extension and mixing technique. Then a novel procedure to generate new scalar exciting regressors is proposed.} The superior performance of a classical gradient estimator using this new regressor, instead of the original one, is illustrated with comprehensive simulations.


title: A capacitive displacement system for studying the piezoelectric strain and its temperature variation

abstract: A capacitive displacement system was constructed to measure the electric-field-induced piezoelectric strain in the simple form of either a bulk or thin film. The system can determine an AC displacement of 2 pm precisely by using a lock-in detection, and can measure the large displacement within a range of $\pm$ 25 $\mu$m with a sub-nanometer resolution. The system can also be used to measure the variation in strain within a temperature range of 210 - 450 K, allowing the evaluation of the temperature coefficient of a piezoelectric constant and the studies on the effects of a phase transition on the piezoelectric response. Experimental results on quartz, PZT ceramics and thin films, and BaTiO$_3$ confirm the capabilities of the developed system.


title: Quantum States of a Skyrmion in a 2D Antiferromagnet

abstract: Quantum states of a skyrmion in a 2D antiferromagnetic lattice are obtained by quantizing the scaling parameter of Belavin-Polyakov model. Skyrmion classical collapse due to violation of the translational invariance of the continuous spin-field model by the lattice is replaced in quantum mechanics by transitions between discrete energy levels of the skyrmion. Rates of transitions due to the emission of magnons are computed. Ways of detecting quantization of skyrmion states are discussed.


title: Particle MPC for Uncertain and Learning-Based Control

abstract: As robotic systems move from highly structured environments to open worlds, incorporating uncertainty from dynamics learning or state estimation into the control pipeline is essential for robust performance. In this paper we present a nonlinear particle model predictive control (PMPC) approach to control under uncertainty, which directly incorporates any particle-based uncertainty representation, such as those common in robotics. Our approach builds on scenario methods for MPC, but in contrast to existing approaches, which either constrain all or only the first timestep to share actions across scenarios, we investigate the impact of a \textit{partial consensus horizon}. Implementing this optimization for nonlinear dynamics by leveraging sequential convex optimization, our approach yields an efficient framework that can be tuned to the particular information gain dynamics of a system to mitigate both over-conservatism and over-optimism. We investigate our approach for two robotic systems across three problem settings: time-varying, partially observed dynamics; sensing uncertainty; and model-based reinforcement learning, and show that our approach improves performance over baselines in all settings.


title: Intelligent Building Control Systems for Thermal Comfort and Energy-Efficiency: A Systematic Review of Artificial Intelligence-Assisted Techniques

abstract: Building operations represent a significant percentage of the total primary energy consumed in most countries due to the proliferation of Heating, Ventilation and Air-Conditioning (HVAC) installations in response to the growing demand for improved thermal comfort. Reducing the associated energy consumption while maintaining comfortable conditions in buildings are conflicting objectives and represent a typical optimization problem that requires intelligent system design. Over the last decade, different methodologies based on the Artificial Intelligence (AI) techniques have been deployed to find the sweet spot between energy use in HVAC systems and suitable indoor comfort levels to the occupants. This paper performs a comprehensive and an in-depth systematic review of AI-based techniques used for building control systems by assessing the outputs of these techniques, and their implementations in the reviewed works, as well as investigating their abilities to improve the energy-efficiency, while maintaining thermal comfort conditions. This enables a holistic view of (1) the complexities of delivering thermal comfort to users inside buildings in an energy-efficient way, and (2) the associated bibliographic material to assist researchers and experts in the field in tackling such a challenge. Among the 20 AI tools developed for both energy consumption and comfort control, functions such as identification and recognition patterns, optimization, predictive control. Based on the findings of this work, the application of AI technology in building control is a promising area of research and still an ongoing, i.e., the performance of AI-based control is not yet completely satisfactory. This is mainly due in part to the fact that these algorithms usually need a large amount of high-quality real-world data, which is lacking in the building or, more precisely, the energy sector.


title: When Pigs Fly: Contextual Reasoning in Synthetic and Natural Scenes

abstract: Context is of fundamental importance to both human and machine vision; e.g., an object in the air is more likely to be an airplane than a pig. The rich notion of context incorporates several aspects including physics rules, statistical co-occurrences, and relative object sizes, among others. While previous work has focused on crowd-sourced out-of-context photographs from the web to study scene context, controlling the nature and extent of contextual violations has been a daunting task. Here we introduce a diverse, synthetic Out-of-Context Dataset (OCD) with fine-grained control over scene context. By leveraging a 3D simulation engine, we systematically control the gravity, object co-occurrences and relative sizes across 36 object categories in a virtual household environment. We conducted a series of experiments to gain insights into the impact of contextual cues on both human and machine vision using OCD. We conducted psychophysics experiments to establish a human benchmark for out-of-context recognition, and then compared it with state-of-the-art computer vision models to quantify the gap between the two. We propose a context-aware recognition transformer model, fusing object and contextual information via multi-head attention. Our model captures useful information for contextual reasoning, enabling human-level performance and better robustness in out-of-context conditions compared to baseline models across OCD and other out-of-context datasets. All source code and data are publicly available at https://github.com/kreimanlab/WhenPigsFlyContext


title: $\alpha$-cluster structures above double shell closures via double-folding potentials from chiral effective field theory

abstract: $\alpha$-cluster structures above double shell closures are among the cornerstones for nuclear $\alpha$-cluster physics. Semi-microscopic cluster models (SMCMs) are important theoretical models to study their properties. A crucial ingredient of SMCM is the effective potential between the alpha cluster and the doubly magic nucleus. We derive new double-folding potentials between $\alpha$ clusters and doubly magic nuclei from soft local chiral nucleon-nucleon potentials given by chiral effective field theory ($\chi$EFT) at the next-to-next-to-leading order. The $\alpha$-cluster structures in ${}^{8}\text{Be}$, ${}^{20}\text{Ne}$, ${}^{44,52}\text{Ti}$, and ${}^{212}\text{Po}$ are explored to validate these new double-folding potentials. The $\alpha$ decay of ${}^{104}\text{Te}$ is also studied in the light of recent experimental results. Our study shows that double-folding potentials from $\chi$EFT are the new reliable effective potentials for the SMCM approach to $\alpha$-cluster structures above double shell closures, with both conceptual and phenomenological merits.


title: Electronic structure and charge-density wave transition in monolayer VS_{2}

abstract: Vanadium disulfide (VS_{2}) attracts elevated interests for its charge-density wave (CDW) phase transition, ferromagnetism, and catalytic reactivity, but the electronic structure of monolayer has not been well understood yet. Here we report synthesis of epitaxial 1T VS_{2} monolayer on bilayer graphene grown by molecular-beam epitaxy (MBE). Angle-resolved photoemission spectroscopy (ARPES) measurements reveal that Fermi surface with six elliptical pockets centered at the M points shows gap opening at low temperature. Temperature-dependence of the gap size suggests existence of CDW phase transition above room temperature. Our observations provide important evidence to understand the strongly correlated electron physics and the related surface catalytic properties in two-dimensional transition-metal dichalcogenides (TMDCs).


title: Persistent currents in rings of ultracold fermionic atoms

abstract: We have produced persistent currents of ultracold fermionic atoms trapped in a ring, with lifetimes greater than 10 seconds in the strongly-interacting regime. These currents remain stable well into the BCS regime at sufficiently low temperature. We drive a circulating BCS superfluid into the normal phase and back by changing the interaction strength and find that the probability for quantized superflow to reappear is remarkably insensitive to the time spent in the normal phase and the minimum interaction strength. After ruling out spontaneous current formation for our experimental conditions, we argue that the reappearance of superflow is due to weak damping of normal currents in this limit. These results establish that ultracold fermionic atoms with tunable interactions can be used to create matter-wave circuits similar to those previously created with weakly-interacting bosonic atoms.


title: Understanding Medical Conversations: Rich Transcription, Confidence Scores & Information Extraction

abstract: In this paper, we describe novel components for extracting clinically relevant information from medical conversations which will be available as Google APIs. We describe a transformer-based Recurrent Neural Network Transducer (RNN-T) model tailored for long-form audio, which can produce rich transcriptions including speaker segmentation, speaker role labeling, punctuation and capitalization. On a representative test set, we compare performance of RNN-T models with different encoders, units and streaming constraints. Our transformer-based streaming model performs at about 20% WER on the ASR task, 6% WDER on the diarization task, 43% SER on periods, 52% SER on commas, 43% SER on question marks and 30% SER on capitalization. Our recognizer is paired with a confidence model that utilizes both acoustic and lexical features from the recognizer. The model performs at about 0.37 NCE. Finally, we describe a RNN-T based tagging model. The performance of the model depends on the ontologies, with F-scores of 0.90 for medications, 0.76 for symptoms, 0.75 for conditions, 0.76 for diagnosis, and 0.61 for treatments. While there is still room for improvement, our results suggest that these models are sufficiently accurate for practical applications.


title: Quantum Theory of Measurement

abstract: We describe a quantum mechanical measurement as a variational principle including interaction between the system under measurement and the measurement apparatus. Augmenting the action with a nonlocal term (a double integration over the duration of the interaction) results in a theory capable of describing both the measurement process (agreement between system state and pointer state) and the collapse of both systems into a single eigenstate (or superposition of degenerate eigenstates) of the relevant operator. In the absence of the interaction, a superposition of states is stable, and the theory agrees with the predictions of standard quantum theory. Because the theory is nonlocal, the resulting wave equation is an integrodifferential equation (IDE). We demonstrate these ideas using a simple Lagrangian for both systems, as proof of principle. The variational principle is time-symmetric and retrocausal, so the solution for the measurement process is determined by boundary conditions at both initial and final times; the initial condition is determined by the experimental preparation and the final condition is the natural boundary condition of variational calculus. We hypothesize that one or more hidden variables (not ruled out by Bell's Theorem, due both to the retrocausality and the nonlocality of the theory) influence the outcome of the measurement, and that distributions of the hidden variables that arise plausibly in a typical ensemble of experimental realizations give rise to outcome frequencies consistent with Born's rule. We outline steps in a theoretical validation of the hypothesis. We discuss the role of both initial and final conditions to determine a solution at intermediate times, the mechanism by which a system responds to measurement, time symmetry of the new theory, causality concerns, and issues surrounding solution of the IDE.


title: Multiple Symmetry-Protected Dirac Nodal Lines in A Quasi-One-Dimensional Semimetal

abstract: Nodal-line semimetals (NLSMs) contains Dirac/Weyl type band-crossing nodes extending into shapes of line, loop and chain in the reciprocal space, leading to novel band topology and transport responses. Robust NLSMs against spin-orbit coupling typically occur in three-dimensional materials with more symmetry operations to protect the line nodes of band crossing, while the possibilities in lower-dimensional materials are rarely discussed. Here we demonstrate robust NLSM phase in a quasi-one-dimensional nonmagnetic semimetal TaNiTe5. Combining angle-resolved photoemission spectroscopy measurements and first-principles calculations, we reveal how reduced dimension can interact with nonsymmorphic symmetry and result into multiple Dirac-type nodal lines with four-fold degeneracy. Our findings suggest rich physics and application in (quasi-)one-dimensional topological materials and call for further investigation on the interplay between the quantum confinement and nontrivial band topology.


title: On the Benefits of Traffic "Reprofiling'' -- The Single Hop Case

abstract: The need to guarantee hard delay bounds to traffic flows with deterministic traffic profiles, e.g., token buckets, arises in a number of network settings. Of interest are solutions that offer such guarantees while minimizing network bandwidth. The paper explores a basic building block towards realizing such solutions, namely, a single hop configuration. The main results are in the form of optimal solutions for meeting local deadlines under schedulers of varying complexity and therefore cost. The results demonstrate how judiciously modifying flows' traffic profiles, i.e., reprofiling them, can help simple schedulers reduce the bandwidth they require, often performing nearly as well as more complex ones.


title: Propagation mechanism of surface-enhanced resonant Raman scattering light through one-dimensional plasmonic hotspot along silver nanowire dimer junction

abstract: We investigate the propagation of surface-enhanced resonant Raman scattering (SERRS) light by several micrometers through a one-dimensional hotspot (1D HS) located between a plasmonic nanowire dimer (NWD). The propagation exhibits the properties, e.g. an effective propagation induced by excitation and detection polarization orthogonal to the 1D HS long axis, the propagation profiles composed of bright short and dark long propagations, SERRS spectral shapes independent of localized plasmon (LP) resonance of NWDs, redshifts in the SERRS spectra at the edges of 1D HSs, and considerable NWD-by-NWD variations in the propagation lengths. These properties are well reproduced by numerical calculations based on electromagnetism. These calculations reveals the following propagation mechanism: excitation light resonantly coupled with LP at the edges of 1D HSs, and the light energy is transferred to two types of junction SP modes supporting the short and long propagations; these modes are attributed to the upper and lower branches of coupled two SP modes. This mechanism comprehensively clarifies the abovementioned properties.


title: Modulating Curie Temperature and Magnetic Anisotropy in Nanoscale Layered Cr_{2}Te_{3} Films: Implications for Room-Temperature Spintronics

abstract: Nanoscale layered ferromagnets have demonstrated fascinating two-dimensional magnetism down to atomic layers, providing a peculiar playground of spin orders for investigating fundamental physics and spintronic applications. However, strategy for growing films with designed magnetic properties is not well established yet. Herein, we present a versatile method to control the Curie temperature (T_{C}) and magnetic anisotropy during growth of ultrathin Cr_{2}Te_{3} films. We demonstrate increase of the TC from 165 K to 310 K in sync with magnetic anisotropy switching from an out-of-plane orientation to an in-plane one, respectively, via controlling the Te source flux during film growth, leading to different c-lattice parameters while preserving the stoichiometries and thicknesses of the films. We attributed this modulation of magnetic anisotropy to the switching of the orbital magnetic moment, using X-ray magnetic circular dichroism analysis. We also inferred that different c-lattice constants might be responsible for the magnetic anisotropy change, supported by theoretical calculations. These findings emphasize the potential of ultrathin Cr_{2}Te_{3} films as candidates for developing room-temperature spintronics applications and similar growth strategies could be applicable to fabricate other nanoscale layered magnetic compounds.


title: The Golden Ratio and Hydrodynamics

abstract: There are useful and useless golden ratios. The useful one helps in traffic. The useless and rather mysterious one arises in hydrodynamics of point vortices, which we discuss in detail.


title: Beyond Categorical Label Representations for Image Classification

abstract: We find that the way we choose to represent data labels can have a profound effect on the quality of trained models. For example, training an image classifier to regress audio labels rather than traditional categorical probabilities produces a more reliable classification. This result is surprising, considering that audio labels are more complex than simpler numerical probabilities or text. We hypothesize that high dimensional, high entropy label representations are generally more useful because they provide a stronger error signal. We support this hypothesis with evidence from various label representations including constant matrices, spectrograms, shuffled spectrograms, Gaussian mixtures, and uniform random matrices of various dimensionalities. Our experiments reveal that high dimensional, high entropy labels achieve comparable accuracy to text (categorical) labels on the standard image classification task, but features learned through our label representations exhibit more robustness under various adversarial attacks and better effectiveness with a limited amount of training data. These results suggest that label representation may play a more important role than previously thought. The project website is at \url{https://www.creativemachineslab.com/label-representation.html}.


title: Decay properties of Roper resonance in the holographic QCD

abstract: We investigate the one pion decay of the Roper resonance $N^*(1440)$$\to$$N$${\pi}$ in the Sakai-Sugimoto model of the holographic QCD. The nucleon and Roper resonance emerge as ground and first excited states of the collective radial motion of the instanton in the four dimensional space with one extra dimension. It is found that the ratio of the ${\pi}$$NN^*$ and ${\pi}$$NN$ couplings, and hence the ratio of $g_A^{NN^*}$ and $g_A^{NN}$, is well reproduced in comparison with the experimental data. The mechanism of this result is due to the collective nature of excitations, which is very different from that of the single particle nature of the constituent quark model. Our results are obtained in the large-$N_c$ and large ${\lambda}$ ('t~Hooft coupling) limit which are useful to test how baryon resonances share what are expected in these limits.


title: Hyperbolic Variational Graph Neural Network for Modeling Dynamic Graphs

abstract: Learning representations for graphs plays a critical role in a wide spectrum of downstream applications. In this paper, we summarize the limitations of the prior works in three folds: representation space, modeling dynamics and modeling uncertainty. To bridge this gap, we propose to learn dynamic graph representation in hyperbolic space, for the first time, which aims to infer stochastic node representations. Working with hyperbolic space, we present a novel Hyperbolic Variational Graph Neural Network, referred to as HVGNN. In particular, to model the dynamics, we introduce a Temporal GNN (TGNN) based on a theoretically grounded time encoding approach. To model the uncertainty, we devise a hyperbolic graph variational autoencoder built upon the proposed TGNN to generate stochastic node representations of hyperbolic normal distributions. Furthermore, we introduce a reparameterisable sampling algorithm for the hyperbolic normal distribution to enable the gradient-based learning of HVGNN. Extensive experiments show that HVGNN outperforms state-of-the-art baselines on real-world datasets.


title: Relationship between the TC of smart meta-superconductor Bi(Pb)SrCaCuO and inhomogeneous phase content

abstract: A smart meta-superconductor Bi(Pb)SrCaCuO (B(P)SCCO) may increase the critical transition temperature (TC) of B(P)SCCO by electroluminescence (EL) energy injection of inhomogeneous phases. However, the increase amplitude {\Delta}TC ({\Delta}TC=TC-T(C,pure)) of TC is relatively small. In this study, a smart meta-superconductor B(P)SCCO with different matrix sizes was designed. Three kinds of raw materials with different particle sizes were used, and different series of Y2O3:Sm3+, Y2O3, Y2O3:Eu3+, and Y2O3:Eu3++Ag doped samples and pure B(P)SCCO were prepared. Results indicated that the TC of the Y2O3 or Y2O3:Sm3+ non-luminescent dopant doping sample is lower than that of pure B(P)SCCO. However, the TC of the Y2O3:Eu3++Ag or Y2O3:Eu3+ luminescent inhomogeneous phase doping sample is higher than that of pure B(P)SCCO. With the decrease of the raw material particle size from 30 to 5 {\mu}m, the particle size of the B(P)SCCO superconducting matrix in the prepared samples decreases, and the doping content of the Y2O3:Eu3++Ag or Y2O3:Eu3+ increases from 0.2% to 0.4%. Meanwhile, the increase of the inhomogeneous phase content enhances the {\Delta}TC. When the particle size of raw material is 5 {\mu}m, the doping concentration of the luminescent inhomogeneous phase can be increased to 0.4%. At this time, the zero-resistance temperature and onset transition temperature of the Y2O3:Eu3++Ag doped sample are 4 and 6.3 K higher than those of pure B(P)SCCO, respectively.


title: Achieving Domain Generalization in Underwater Object Detection by Domain Mixup and Contrastive Learning

abstract: The performance of existing underwater object detection methods degrades seriously when facing domain shift caused by complicated underwater environments. Due to the limitation of the number of domains in the dataset, deep detectors easily memorize a few seen domains, which leads to low generalization ability. There are two common ideas to improve the domain generalization performance. First, it can be inferred that the detector trained on as many domains as possible is domain-invariant. Second, for the images with the same semantic content in different domains, their hidden features should be equivalent. This paper further excavates these two ideas and proposes a domain generalization framework (named DMC) that learns how to generalize across domains from Domain Mixup and Contrastive Learning. First, based on the formation of underwater images, an image in an underwater environment is the linear transformation of another underwater environment. Thus, a style transfer model, which outputs a linear transformation matrix instead of the whole image, is proposed to transform images from one source domain to another, enriching the domain diversity of the training data. Second, mixup operation interpolates different domains on the feature level, sampling new domains on the domain manifold. Third, contrastive loss is selectively applied to features from different domains to force the model to learn domain invariant features but retain the discriminative capacity. With our method, detectors will be robust to domain shift. Also, a domain generalization benchmark S-UODAC2020 for detection is set up to measure the performance of our method. Comprehensive experiments on S-UODAC2020 and two object recognition benchmarks (PACS and VLCS) demonstrate that the proposed method is able to learn domain-invariant representations, and outperforms other domain generalization methods.


title: IoT Security: Botnet detection in IoT using Machine learning

abstract: The acceptance of Internet of Things (IoT) applications and services has seen an enormous rise of interest in IoT. Organizations have begun to create various IoT based gadgets ranging from small personal devices such as a smart watch to a whole network of smart grid, smart mining, smart manufacturing, and autonomous driver-less vehicles. The overwhelming amount and ubiquitous presence have attracted potential hackers for cyber-attacks and data theft. Security is considered as one of the prominent challenges in IoT. The key scope of this research work is to propose an innovative model using machine learning algorithm to detect and mitigate botnet-based distributed denial of service (DDoS) attack in IoT network. Our proposed model tackles the security issue concerning the threats from bots. Different machine learning algorithms such as K- Nearest Neighbour (KNN), Naive Bayes model and Multi-layer Perception Artificial Neural Network (MLP ANN) were used to develop a model where data are trained by BoT-IoT dataset. The best algorithm was selected by a reference point based on accuracy percentage and area under the receiver operating characteristics curve (ROC AUC) score. Feature engineering and Synthetic minority oversampling technique (SMOTE) were combined with machine learning algorithms (MLAs). Performance comparison of three algorithms used was done in class imbalance dataset and on the class balanced dataset.


title: Flexi-Transducer: Optimizing Latency, Accuracy and Compute forMulti-Domain On-Device Scenarios

abstract: Often, the storage and computational constraints of embeddeddevices demand that a single on-device ASR model serve multiple use-cases / domains. In this paper, we propose aFlexibleTransducer(FlexiT) for on-device automatic speech recognition to flexibly deal with multiple use-cases / domains with different accuracy and latency requirements. Specifically, using a single compact model, FlexiT provides a fast response for voice commands, and accurate transcription but with more latency for dictation. In order to achieve flexible and better accuracy and latency trade-offs, the following techniques are used. Firstly, we propose using domain-specific altering of segment size for Emformer encoder that enables FlexiT to achieve flexible de-coding. Secondly, we use Alignment Restricted RNNT loss to achieve flexible fine-grained control on token emission latency for different domains. Finally, we add a domain indicator vector as an additional input to the FlexiT model. Using the combination of techniques, we show that a single model can be used to improve WERs and real time factor for dictation scenarios while maintaining optimal latency for voice commands use-cases


title: TENT: Efficient Quantization of Neural Networks on the tiny Edge with Tapered FixEd PoiNT

abstract: In this research, we propose a new low-precision framework, TENT, to leverage the benefits of a tapered fixed-point numerical format in TinyML models. We introduce a tapered fixed-point quantization algorithm that matches the numerical format's dynamic range and distribution to that of the deep neural network model's parameter distribution at each layer. An accelerator architecture for the tapered fixed-point with TENT framework is proposed. Results show that the accuracy on classification tasks improves up to ~31 % with an energy overhead of ~17-30 % as compared to fixed-point, for ConvNet and ResNet-18 models.


title: DeepEverest: Accelerating Declarative Top-K Queries for Deep Neural Network Interpretation

abstract: We design, implement, and evaluate DeepEverest, a system for the efficient execution of interpretation by example queries over the activation values of a deep neural network. DeepEverest consists of an efficient indexing technique and a query execution algorithm with various optimizations. We prove that the proposed query execution algorithm is instance optimal. Experiments with our prototype show that DeepEverest, using less than 20% of the storage of full materialization, significantly accelerates individual queries by up to 63x and consistently outperforms other methods on multi-query workloads that simulate DNN interpretation processes.


title: Model-theoretic Elekes-Szab\'o for stable and o-minimal hypergraphs

abstract: A theorem of Elekes and Szab\'{o} recognizes algebraic groups among certain complex algebraic varieties with maximal size intersections with finite grids. We establish a generalization to relations of any arity and dimension, definable in: 1) stable structures with distal expansions (includes algebraically and differentially closed fields of characteristic $0$); and 2) $o$-minimal expansions of groups. Our methods provide explicit bounds on the power saving exponent in the non-group case. Ingredients of the proof include: a higher arity generalization of the abelian group configuration theorem in stable structures, along with a purely combinatorial variant characterizing Latin hypercubes that arise from abelian groups; and Zarankiewicz-style bounds for hypergraphs definable in distal structures.


title: Hippocampus-heuristic Character Recognition Network for Zero-shot Learning

abstract: The recognition of Chinese characters has always been a challenging task due to their huge variety and complex structures. The latest research proves that such an enormous character set can be decomposed into a collection of about 500 fundamental Chinese radicals, and based on which this problem can be solved effectively. While with the constant advent of novel Chinese characters, the number of basic radicals is also expanding. The current methods that entirely rely on existing radicals are not flexible for identifying these novel characters and fail to recognize these Chinese characters without learning all of their radicals in the training stage. To this end, this paper proposes a novel Hippocampus-heuristic Character Recognition Network (HCRN), which references the way of hippocampus thinking, and can recognize unseen Chinese characters (namely zero-shot learning) only by training part of radicals. More specifically, the network architecture of HCRN is a new pseudo-siamese network designed by us, which can learn features from pairs of input training character samples and use them to predict unseen Chinese characters. The experimental results show that HCRN is robust and effective. It can accurately predict about 16,330 unseen testing Chinese characters relied on only 500 trained Chinese characters. The recognition accuracy of HCRN outperforms the state-of-the-art Chinese radical recognition approach by 15% (from 85.1% to 99.9%) for recognizing unseen Chinese characters.


title: Clustering Students and Inferring Skill Set Profiles with Skill Hierarchies

abstract: Cognitive diagnosis models (CDMs) are a popular tool for assessing students' mastery of sets of skills. Given a set of $K$ skills tested on an assessment, students are classified into one of $2^K$ latent skill set profiles that represent whether they have mastered each skill or not. Traditional approaches to estimating these profiles are computationally intensive and become infeasible on large datasets. Instead, proxy skill estimates can be generated from the observed responses and then clustered, and these clusters can be assigned to different profiles. Building on previous work, we consider how to optimally perform this clustering when not all $2^K$ profiles are possible, e.g. because of hierarchical relationships among the skills, and when not all possible profiles are present in the population. We compare hierarchical clustering and several k-means variants, including semisupervised clustering using simulated student responses. The empty k-means algorithm paired with a novel method for generating starting centers yields the best overall performance.


title: In-Line Image Transformations for Imbalanced, Multiclass Computer Vision Classification of Lung Chest X-Rays

abstract: Artificial intelligence (AI) is disrupting the medical field as advances in modern technology allow common household computers to learn anatomical and pathological features that distinguish between healthy and disease with the accuracy of highly specialized, trained physicians. Computer vision AI applications use medical imaging, such as lung chest X-Rays (LCXRs), to facilitate diagnoses by providing second-opinions in addition to a physician's or radiologist's interpretation. Considering the advent of the current Coronavirus disease (COVID-19) pandemic, LCXRs may provide rapid insights to indirectly aid in infection containment, however generating a reliably labeled image dataset for a novel disease is not an easy feat, nor is it of highest priority when combating a global pandemic. Deep learning techniques such as convolutional neural networks (CNNs) are able to select features that distinguish between healthy and disease states for other lung pathologies; this study aims to leverage that body of literature in order to apply image transformations that would serve to balance the lack of COVID-19 LCXR data. Furthermore, this study utilizes a simple CNN architecture for high-performance multiclass LCXR classification at 94 percent accuracy.


title: IronMask: Modular Architecture for Protecting Deep Face Template

abstract: Convolutional neural networks have made remarkable progress in the face recognition field. The more the technology of face recognition advances, the greater discriminative features into a face template. However, this increases the threat to user privacy in case the template is exposed. In this paper, we present a modular architecture for face template protection, called IronMask, that can be combined with any face recognition system using angular distance metric. We circumvent the need for binarization, which is the main cause of performance degradation in most existing face template protections, by proposing a new real-valued error-correcting-code that is compatible with real-valued templates and can therefore, minimize performance degradation. We evaluate the efficacy of IronMask by extensive experiments on two face recognitions, ArcFace and CosFace with three datasets, CMU-Multi-PIE, FEI, and Color-FERET. According to our experimental results, IronMask achieves a true accept rate (TAR) of 99.79% at a false accept rate (FAR) of 0.0005% when combined with ArcFace, and 95.78% TAR at 0% FAR with CosFace, while providing at least 115-bit security against known attacks.


title: Survey of Imbalanced Data Methodologies

abstract: Imbalanced data set is a problem often found and well-studied in financial industry. In this paper, we reviewed and compared some popular methodologies handling data imbalance. We then applied the under-sampling/over-sampling methodologies to several modeling algorithms on UCI and Keel data sets. The performance was analyzed for class-imbalance methods, modeling algorithms and grid search criteria comparison.


title: Direct Observation of an Incommensurate Charge Density Wave in the BiS2-based Superconductor NdO1-xFxBiS2

abstract: The nature of superconductivity in BiS$_2$-based superconductors has been controversial while ab-initio calculations proposed this system in close proximity to a charge-density-wave (CDW) phase. Using high-energy high-flux X-ray diffraction, we reveal an intrinsic and long-range CDW phase coexisting with superconductivity in NdO$_{1-x}$F$_{x}$BiS$_2$ superconductor ($x$ = 0.37 and 0.3). The CDW wavevector in NdO$_{0.63}$F$_{0.37}$BiS$_2$ correspond Q$_{\rm{CDW}}$ = (0.17, 0.17, 0.5) and is associated with transverse atomic displacements. Interestingly, this wavevector does not match theoretical expectations based on either phonon softening or Fermi surface nesting. In NdO$_{0.7}$F$_{0.3}$BiS$_2$, where the superconducting transition temperature is highest, the CDW satellites are slightly broader and weaker compared to NdO$_{0.63}$F$_{0.37}$BiS$_2$, possibly suggesting the competition with the superconductivity. Lastly, we measure a thermal diffuse scattering across the superconducting transition temperature and find no meaningful changes in favor of the unconventional pairing mechanism. Our result suggests the importance of understanding CDW which might hold a key to the superconductivity in the BiS$_2$-based superconductor.


title: HBert + BiasCorp -- Fighting Racism on the Web

abstract: Subtle and overt racism is still present both in physical and online communities today and has impacted many lives in different segments of the society. In this short piece of work, we present how we're tackling this societal issue with Natural Language Processing. We are releasing BiasCorp, a dataset containing 139,090 comments and news segment from three specific sources - Fox News, BreitbartNews and YouTube. The first batch (45,000 manually annotated) is ready for publication. We are currently in the final phase of manually labeling the remaining dataset using Amazon Mechanical Turk. BERT has been used widely in several downstream tasks. In this work, we present hBERT, where we modify certain layers of the pretrained BERT model with the new Hopfield Layer. hBert generalizes well across different distributions with the added advantage of a reduced model complexity. We are also releasing a JavaScript library and a Chrome Extension Application, to help developers make use of our trained model in web applications (say chat application) and for users to identify and report racially biased contents on the web respectively.


title: 3D-to-2D Distillation for Indoor Scene Parsing

abstract: Indoor scene semantic parsing from RGB images is very challenging due to occlusions, object distortion, and viewpoint variations. Going beyond prior works that leverage geometry information, typically paired depth maps, we present a new approach, a 3D-to-2D distillation framework, that enables us to leverage 3D features extracted from large-scale 3D data repository (e.g., ScanNet-v2) to enhance 2D features extracted from RGB images. Our work has three novel contributions. First, we distill 3D knowledge from a pretrained 3D network to supervise a 2D network to learn simulated 3D features from 2D features during the training, so the 2D network can infer without requiring 3D data. Second, we design a two-stage dimension normalization scheme to calibrate the 2D and 3D features for better integration. Third, we design a semantic-aware adversarial training model to extend our framework for training with unpaired 3D data. Extensive experiments on various datasets, ScanNet-V2, S3DIS, and NYU-v2, demonstrate the superiority of our approach. Also, experimental results show that our 3D-to-2D distillation improves the model generalization.


title: Content-Aware GAN Compression

abstract: Generative adversarial networks (GANs), e.g., StyleGAN2, play a vital role in various image generation and synthesis tasks, yet their notoriously high computational cost hinders their efficient deployment on edge devices. Directly applying generic compression approaches yields poor results on GANs, which motivates a number of recent GAN compression works. While prior works mainly accelerate conditional GANs, e.g., pix2pix and CycleGAN, compressing state-of-the-art unconditional GANs has rarely been explored and is more challenging. In this paper, we propose novel approaches for unconditional GAN compression. We first introduce effective channel pruning and knowledge distillation schemes specialized for unconditional GANs. We then propose a novel content-aware method to guide the processes of both pruning and distillation. With content-awareness, we can effectively prune channels that are unimportant to the contents of interest, e.g., human faces, and focus our distillation on these regions, which significantly enhances the distillation quality. On StyleGAN2 and SN-GAN, we achieve a substantial improvement over the state-of-the-art compression method. Notably, we reduce the FLOPs of StyleGAN2 by 11x with visually negligible image quality loss compared to the full-size model. More interestingly, when applied to various image manipulation tasks, our compressed model forms a smoother and better disentangled latent manifold, making it more effective for image editing.


title: Multi-Scale Context Aggregation Network with Attention-Guided for Crowd Counting

abstract: Crowd counting aims to predict the number of people and generate the density map in the image. There are many challenges, including varying head scales, the diversity of crowd distribution across images and cluttered backgrounds. In this paper, we propose a multi-scale context aggregation network (MSCANet) based on single-column encoder-decoder architecture for crowd counting, which consists of an encoder based on a dense context-aware module (DCAM) and a hierarchical attention-guided decoder. To handle the issue of scale variation, we construct the DCAM to aggregate multi-scale contextual information by densely connecting the dilated convolution with varying receptive fields. The proposed DCAM can capture rich contextual information of crowd areas due to its long-range receptive fields and dense scale sampling. Moreover, to suppress the background noise and generate a high-quality density map, we adopt a hierarchical attention-guided mechanism in the decoder. This helps to integrate more useful spatial information from shallow feature maps of the encoder by introducing multiple supervision based on semantic attention module (SAM). Extensive experiments demonstrate that the proposed approach achieves better performance than other similar state-of-the-art methods on three challenging benchmark datasets for crowd counting. The code is available at https://github.com/KingMV/MSCANet


title: One Thing One Click: A Self-Training Approach for Weakly Supervised 3D Semantic Segmentation

abstract: Point cloud semantic segmentation often requires largescale annotated training data, but clearly, point-wise labels are too tedious to prepare. While some recent methods propose to train a 3D network with small percentages of point labels, we take the approach to an extreme and propose "One Thing One Click," meaning that the annotator only needs to label one point per object. To leverage these extremely sparse labels in network training, we design a novel self-training approach, in which we iteratively conduct the training and label propagation, facilitated by a graph propagation module. Also, we adopt a relation network to generate per-category prototype and explicitly model the similarity among graph nodes to generate pseudo labels to guide the iterative training. Experimental results on both ScanNet-v2 and S3DIS show that our self-training approach, with extremely-sparse annotations, outperforms all existing weakly supervised methods for 3D semantic segmentation by a large margin, and our results are also comparable to those of the fully supervised counterparts.


title: The pion and kaon $\langle x^3 \rangle$ from lattice QCD and PDF reconstruction from Mellin moments

abstract: We present a calculation of the pion and kaon Mellin moment $\langle x^3 \rangle$ extracted directly in lattice QCD using a three-derivative local operator. We use one ensemble of gauge configurations with two degenerate light, a strange and a charm quark ($N_f=2+1+1$) of maximally twisted mass fermions with clover improvement. The ensemble reproduces a pion mass $\sim260$ MeV, and a kaon mass $\sim530$ MeV. Excited-states contamination is evaluated using four values of the source-sink time separation within the range of $1.12-1.67$ fm. We use an operator that is free of mixing, and apply a multiplicative renormalization function calculated non-perturbatively. Our results are converted to the $\overline{\rm MS}$ scheme and evolved at a scale of 2 GeV, using three-loop expressions in perturbation theory. The final values are $\langle x^3 \rangle_\pi^{u^+}=0.024(18)_{\rm stat}(2)_{\rm syst}$, $\langle x^3 \rangle_K^{u^+}=0.035(6)_{\rm stat}(3)_{\rm syst}$, and $\langle x^3 \rangle_K^{s^+}=0.075(5)_{\rm stat}(1)_{\rm syst}$, where the systematic error is the uncertainty due to excited state contamination. We combine $\langle x^3 \rangle$ with the two lower moments to obtain the ratios $\langle x^3 \rangle/\langle x \rangle$ and $\langle x^3 \rangle/\langle x^2 \rangle$, as well as ratios between the pion and kaon moments. In addition, we reconstruct the $x$-dependence of the pion and kaon PDFs via 2- and 3-parameter fits to our results. We find that the reconstruction is feasible and that our lattice data favor a large $x$-dependence that falls as $(1-x)^2$ for both the pion and kaon PDFs. We integrate the reconstructed PDFs to extract the higher moments with $4\leq n\leq 6$. Finally, we compare the pion and kaon PDFs, as well as the ratios of their moments, to address the effect of SU(3) flavor symmetry breaking.


title: Subcritical hybrid inflation in a generalized superconformal model

abstract: We study a generalized superconformal model that gives rise to a subcritical regime of $D$-term hybrid inflation. Exhibiting the model both in a Jordan frame and in the Einstein frame, the effective potential of the subcritical regime is derived in the Einstein frame. It turns out the inflaton-waterfall field dynamics leads to various types of inflaton potential. Consequently the tensor-to-scalar ratio is found to range from $10^{-4}$ ($10^{-3}$) to $0.1$ for getting 60 (50) $e$-folds before the end of inflation.


title: Tree tensor network classifiers for machine learning: from quantum-inspired to quantum-assisted

abstract: We describe a quantum-assisted machine learning (QAML) method in which multivariate data is encoded into quantum states in a Hilbert space whose dimension is exponentially large in the length of the data vector. Learning in this space occurs through applying a low-depth quantum circuit with a tree tensor network (TTN) topology, which acts as an unsupervised feature extractor to identify the most relevant quantum states in a data-driven fashion. This unsupervised feature extractor then feeds a supervised linear classifier and encodes the output in a small-dimensional quantum register. In contrast to previous work on \emph{quantum-inspired} TTN classifiers, in which the embedding map and class decision weights did not map the data to well-defined quantum states, we present an approach that can be implemented on gate-based quantum computing devices. In particular, we identify an embedding map with accuracy similar to exponential machines (Novikov \emph{et al.}, arXiv:1605.03795), but which produces valid quantum states from classical data vectors, and utilize manifold-based gradient optimization schemes to produce isometric operations mapping quantum states to a register of qubits defining a class decision. We detail methods for efficiently obtaining one- and two-point correlation functions of the decision boundary vectors of the quantum model, which can be used for model interpretability, as well as methods for obtaining classifications from partial data vectors. Further, we show that the use of isometric tensors can significantly aid in the human interpretability of the correlation functions extracted from the decision weights, and may produce models that are less susceptible to adversarial perturbations. We demonstrate our methodologies in applications utilizing the MNIST handwritten digit dataset and a multivariate timeseries dataset of human activity recognition.


title: Modeling and Computation of Liquid Crystals

abstract: Liquid crystal is a typical kind of soft matter that is intermediate between crystalline solids and isotropic fluids. The study of liquid crystals has made tremendous progress over the last four decades, which is of great importance on both fundamental scientific researches and widespread applications in industry. In this paper, we review the mathematical models and their connections of liquid crystals, and survey the developments of numerical methods for finding the rich configurations of liquid crystals.


title: Being-ahead: Benchmarking and Exploring Accelerators for Hardware-Efficient AI Deployment

abstract: Customized hardware accelerators have been developed to provide improved performance and efficiency for DNN inference and training. However, the existing hardware accelerators may not always be suitable for handling various DNN models as their architecture paradigms and configuration tradeoffs are highly application-specific. It is important to benchmark the accelerator candidates in the earliest stage to gather comprehensive performance metrics and locate the potential bottlenecks. Further demands also emerge after benchmarking, which require adequate solutions to address the bottlenecks and improve the current designs for targeted workloads. To achieve these goals, in this paper, we leverage an automation tool called DNNExplorer for benchmarking customized DNN hardware accelerators and exploring novel accelerator designs with improved performance and efficiency. Key features include (1) direct support to popular machine learning frameworks for DNN workload analysis and accurate analytical models for fast accelerator benchmarking; (2) a novel accelerator design paradigm with high-dimensional design space support and fine-grained adjustability to overcome the existing design drawbacks; and (3) a design space exploration (DSE) engine to generate optimized accelerators by considering targeted AI workloads and available hardware resources. Results show that accelerators adopting the proposed novel paradigm can deliver up to 4.2X higher throughput (GOP/s) than the state-of-the-art pipeline design in DNNBuilder and up to 2.0X improved efficiency than the recently published generic design in HybridDNN given the same DNN model and resource budgets. With DNNExplorer's benchmarking and exploration features, we can be ahead at building and optimizing customized AI accelerators and enable more efficient AI applications.


title: The set of bounded continuous nowhere locally uniformly continuous functions is not Borel

abstract: It is known that for $X$ a nowhere locally compact metric space, the set of bounded continuous, nowhere locally uniformly continuous real-valued functions on $X$ contains a dense $G_\delta$ set in the space $C_b(X)$ of all bounded continuous real-valued functions on $X$ in the supremum norm. Furthermore, when $X$ is separable, the set of bounded continuous, nowhere locally uniformly continuous real-valued functions on $X$ is itself a $G_\delta$ set. We show that in contrast, when $X$ is nonseparable, this set of functions is not even a Borel set.


title: Depth Completion with Twin Surface Extrapolation at Occlusion Boundaries

abstract: Depth completion starts from a sparse set of known depth values and estimates the unknown depths for the remaining image pixels. Most methods model this as depth interpolation and erroneously interpolate depth pixels into the empty space between spatially distinct objects, resulting in depth-smearing across occlusion boundaries. Here we propose a multi-hypothesis depth representation that explicitly models both foreground and background depths in the difficult occlusion-boundary regions. Our method can be thought of as performing twin-surface extrapolation, rather than interpolation, in these regions. Next our method fuses these extrapolated surfaces into a single depth image leveraging the image data. Key to our method is the use of an asymmetric loss function that operates on a novel twin-surface representation. This enables us to train a network to simultaneously do surface extrapolation and surface fusion. We characterize our loss function and compare with other common losses. Finally, we validate our method on three different datasets; KITTI, an outdoor real-world dataset, NYU2, indoor real-world depth dataset and Virtual KITTI, a photo-realistic synthetic dataset with dense groundtruth, and demonstrate improvement over the state of the art.


title: Two modifications for Loidreau's code-based cryptosystem

abstract: This paper presents two modifications for Loidreau's code-based cryptosystem. Loidreau's cryptosystem is a rank metric code-based cryptosystem constructed by using Gabidulin codes in the McEliece setting. Recently a polynomial-time key recovery attack was proposed to break Loidreau's cryptosystem in some cases. To prevent this attack, we propose the use of subcodes to disguise the secret codes in Modification \Rmnum{1}. In Modification \Rmnum{2}, we choose a random matrix of low column rank over $\mathbb{F}_q$ to mix with the secret matrix. According to our analysis, these two modifications can both resist the existing structural attacks. Additionally, we adopt the systematic generator matrix of the public code to make a reduction in the public-key size. In additon to stronger resistance against structural attacks and more compact representation of public keys, our modifications also have larger information transmission rates.


title: Physical interpretation of Newman-Janis rotating systems. I. A unique family of Kerr-Schild systems

abstract: The Newman-Janis algorithm and its generalizations can be used mathematically to generate rotating solutions from nonrotating spherically-symmetric solutions within general relativity. The energy-momentum tensors of these solutions may or may not represent the same physical system, in the sense of both being a perfect fluid, or an electromagnetic field, or a $\Lambda$-term, and so on. In a series of two papers, we compare the structure of the eigenvalues and eigenvectors of the rotating and nonrotating energy-momentum tensors (their Segre types) and look for the existence of equations of state relating the energy density and the principal pressures. Part I covers Kerr-Schild systems, Part II more general systems. We find that there is a unique family of stationary axisymmetric Kerr-Schild systems that obey the same equation of state in both the rotating and nonrotating configurations. This family includes the Kerr and Kerr-Newman black holes, as well as rotating spacetimes whose mass function in the nonrotating limit contains a constrained superposition of a cloud of strings term, a Reissner-Nordstrom term, a cosmological constant term, and a Schwarzschild term. We describe the common equation of state relating energy density and pressure in this family of spacetimes and discuss some of its properties.