title: Content Addressable Memory Without Catastrophic Forgetting by Heteroassociation with a Fixed Scaffold

abstract: Content-addressable memory (CAM) networks, so-called because stored items can be recalled by partial or corrupted versions of the items, exhibit near-perfect recall of a small number of information-dense patterns below capacity and a 'memory cliff' beyond, such that inserting a single additional pattern results in catastrophic loss of all stored patterns. We propose a novel CAM architecture, Memory Scaffold with Heteroassociation (MESH), that factorizes the problems of internal attractor dynamics and association with external content to generate a CAM continuum without a memory cliff: Small numbers of patterns are stored with complete information recovery matching standard CAMs, while inserting more patterns still results in partial recall of every pattern, with a graceful trade-off between pattern number and pattern richness. Motivated by the architecture of the Entorhinal-Hippocampal memory circuit in the brain, MESH is a tripartite architecture with pairwise interactions that uses a predetermined set of internally stabilized states together with heteroassociation between the internal states and arbitrary external patterns. We show analytically and experimentally that for any number of stored patterns, MESH nearly saturates the total information bound (given by the number of synapses) for CAM networks, outperforming all existing CAM models.


title: Floquet topological systems with flat bands: Edge modes, Berry curvature, and Orbital magnetization

abstract: Results are presented for Floquet systems in two spatial dimensions where the Floquet driving breaks an effective time reversal symmetry. The driving protocol also induces flat bands that correspond to anomalous Floquet phases where the Chern number is zero and yet chiral edge modes exist. Analytic expressions for the edge modes, Berry curvature, and the orbital magnetization are derived for the flat bands. Results are also presented for the static Haldane model for parameters when the bands are flat. Floquet driving of the same model is shown to give rise to Chern insulators as well as anomalous Floquet phases. The orbital magnetization for these different topological phases are presented and are found to be enhanced at half filling by the broken particle-hole symmetry of the Haldane model.


title: CIC: Contrastive Intrinsic Control for Unsupervised Skill Discovery

abstract: We introduce Contrastive Intrinsic Control (CIC), an algorithm for unsupervised skill discovery that maximizes the mutual information between state-transitions and latent skill vectors. CIC utilizes contrastive learning between state-transitions and skills to learn behavior embeddings and maximizes the entropy of these embeddings as an intrinsic reward to encourage behavioral diversity. We evaluate our algorithm on the Unsupervised Reinforcement Learning Benchmark, which consists of a long reward-free pre-training phase followed by a short adaptation phase to downstream tasks with extrinsic rewards. CIC substantially improves over prior methods in terms of adaptation efficiency, outperforming prior unsupervised skill discovery methods by 1.79x and the next leading overall exploration algorithm by 1.18x.


title: Dilated Continuous Random Field for Semantic Segmentation

abstract: Mean field approximation methodology has laid the foundation of modern Continuous Random Field (CRF) based solutions for the refinement of semantic segmentation. In this paper, we propose to relax the hard constraint of mean field approximation - minimizing the energy term of each node from probabilistic graphical model, by a global optimization with the proposed dilated sparse convolution module (DSConv). In addition, adaptive global average-pooling and adaptive global max-pooling are implemented as replacements of fully connected layers. In order to integrate DSConv, we design an end-to-end, time-efficient DilatedCRF pipeline. The unary energy term is derived either from pre-softmax and post-softmax features, or the predicted affordance map using a conventional classifier, making it easier to implement DilatedCRF for varieties of classifiers. We also present superior experimental results of proposed approach on the suction dataset comparing to other CRF-based approaches.


title: Variants of normality and steadfastness deform

abstract: The cancellation problem asks whether $A[X_1,X_2,\ldots,X_n] \cong B[Y_1,Y_2,\ldots,Y_n]$ implies $A \cong B$. Hamann introduced the class of steadfast rings as the rings for which a version of the cancellation problem considered by Abhyankar, Eakin, and Heinzer holds. By work of Asanuma, Hamann, and Swan, steadfastness can be characterized in terms of $p$-seminormality, which is a variant of normality introduced by Swan. We prove that $p$-seminormality and steadfastness deform for reduced Noetherian local rings. We also prove that $p$-seminormality and steadfastness are stable under adjoining formal power series variables for reduced (not necessarily Noetherian) rings. Our methods also give new proofs of the facts that normality and weak normality deform, which are of independent interest.


title: DexVIP: Learning Dexterous Grasping with Human Hand Pose Priors from Video

abstract: Dexterous multi-fingered robotic hands have a formidable action space, yet their morphological similarity to the human hand holds immense potential to accelerate robot learning. We propose DexVIP, an approach to learn dexterous robotic grasping from human-object interactions present in in-the-wild YouTube videos. We do this by curating grasp images from human-object interaction videos and imposing a prior over the agent's hand pose when learning to grasp with deep reinforcement learning. A key advantage of our method is that the learned policy is able to leverage free-form in-the-wild visual data. As a result, it can easily scale to new objects, and it sidesteps the standard practice of collecting human demonstrations in a lab -- a much more expensive and indirect way to capture human expertise. Through experiments on 27 objects with a 30-DoF simulated robot hand, we demonstrate that DexVIP compares favorably to existing approaches that lack a hand pose prior or rely on specialized tele-operation equipment to obtain human demonstrations, while also being faster to train. Project page: https://vision.cs.utexas.edu/projects/dexvip-dexterous-grasp-pose-prior


title: Design Constraints of Disturbance Observer-based Motion Control Systems are Stricter in the Discrete-Time Domain

abstract: This paper shows that the design constraints of the Disturbance Observer (DOb) based robust motion control systems become stricter when they are implemented using computers or microcontrollers. The stricter design constraints put new upper bounds on the plant-model mismatch and the bandwidth of the DOb, thus limiting the achievable robustness against disturbances and the phase-lead effect in the inner-loop. Violating the design constraints may yield severe stability and performance issues in practice; therefore, they should be considered in tuning the control parameters of the robust motion controller. This paper also shows that continuous-time analysis methods fall-short in deriving the fundamental design constraints on the nominal plant model and the bandwidth of the digital DOb. Therefore, we may observe unexpected stability and performance issues when tuning the control parameters of the digital robust motion controllers in the continuous-time domain. To improve the robust stability and performance of the motion controllers, this paper explains the fundamental design constraints of the DOb by employing the generalised continuous and discrete Bode Integral Theorems in a unified framework. Simulation and experimental results are given to verify the proposed analysis method.


title: Prominent electron-hole asymmetry in thermoelectric transport of LaCoO$_3$

abstract: We have measured the electrical resistivity and the thermopower of the electron-doped perovskite cobaltites LaCo$_{1-y}$Te$_y$O$_3$. In contrast to the hole-doped systems such as metallic ferromagnets La$_{1-x}M_x$CoO$_3$ ($M$ = Ca, Sr, Ba), the electron-doped samples show an insulating behavior even in a heavily doped range due to a spin-state blockade mechanism that an electron hopping from high-spin Co$^{2+}$ to low-spin Co$^{3+}$ site is energetically suppressed. We find that, despite the electron doping, the thermopower shows relatively large positive values above $y=0.05$, strikingly distinct from the hole-doped case where it comes close to zero with doping. This prominent electron-hole asymmetry seen in the thermopower originates from a bipolar conduction which consists of a slight amount of mobile holes and the main immobile electrons, demonstrating an impact of spin-state blockade on thermoelectric transport.


title: Hadronic structure on the light-front IV: Heavy and light Baryons

abstract: This work is a continuation in our series of papers, that addresses quark models of hadronic structure on the light front. The chief focus of this paper is the quantum-mechanical solution of the three-quark model Hamiltonian, describing baryons. In Jacobi coordinates, we use a harmonic oscillator basis for the transverse directions. For the longitudinal momentum fractions $x_i$, the pertinent basis follows from quantum mechanics in a "triangular cup" potential, which we solve exactly. We calculate the masses and light front wave functions for the flavor symmetric $\frac 32^+$ baryons $bbb,ccc,sss,uuu$.


title: A Unified Robust Motion Controller Synthesis for Compliant Robots Driven by Series Elastic Actuators

abstract: This paper proposes a unified robust motion controller for the position and force control problems of compliant robot manipulators driven by Series Elastic Actuators (SEAs). It is shown that the dynamic model of the compliant robot includes not only matched but also mismatched disturbances that act on the system through a different channel from the control input. To tackle this complex robust control problem, the unified robust motion controller is synthesised by employing a second-order Disturbance Observer (DOb), which allows us to estimate not only disturbances but also their first and second order derivatives, and a novel controller design approach in state space. By using the Brunovsky canonical form transformation and the estimations of disturbances and their first and second order derivatives, the dynamic model of the robot is reconstructed so that a new system model that includes only matched disturbances is obtained for compliant robots driven by SEAs. The robust position and force controllers are simply designed by eliminating the matched disturbances of the reconstructed system model via the conventional DOb-based robust control method. The stability and performance of the proposed robust motion controllers are verified by simulations.


title: Trajectories of charged particles in knotted electromagnetic fields

abstract: We investigate the trajectories of point charges in the background of finite-action vacuum solutions of Maxwell's equations known as knot solutions. More specifically, we work with a basis of electromagnetic knots generated by the so-called "de Sitter method". We find a variety of behaviors depending on the field configuration and the parameter set used. This includes an acceleration of particles by the electromagnetic field from rest to ultrarelativistic speeds, a quick convergence of their trajectories into a few narrow cones asymptotically for sufficiently high value of the coupling, and a pronounced twisting and turning of trajectories in a coherent fashion. This work is part of an effort to improve the understanding of knotted electromagnetic fields and the trajectories of charged particles they generate, and may be relevant for experimental applications.


title: A self-organizing multi-agent system for distributed voltage regulation

abstract: This paper presents a distributed voltage regulation method based on multi-agent system control and network self-organization for a large distribution network. The network autonomously organizes itself into small subnetworks through the epsilon decomposition of the sensitivity matrix, and agents group themselves into these subnetworks with the communication links being autonomously determined. Each subnetwork controls its voltage by locating the closest local distributed generation and optimizing their outputs. This simplifies and reduces the size of the optimization problem and the interaction requirements. This approach also facilitates adaptive grouping of the network by self-reorganizing to maintain a stable state in response to time-varying network requirements and changes. The effectiveness of the proposed approach is validated through simulations on a model of a real heavily-meshed secondary distribution network. Simulation results and comparisons with other methods demonstrate the ability of the subnetworks to autonomously and independently regulate the voltage and to adapt to unpredictable network conditions over time, thereby enabling autonomous and flexible distribution networks.


title: Earth rotation and time-domain reconstruction of polarization states for continuous gravitational waves from a known pulsar

abstract: We consider effects of the Earth rotation on antenna patterns of a ground-based gravitational wave (GW) detector in a general metric theory that allows at most six polarization states (two spin-0, two spin-1 and two spin-2) in a four-dimensional spacetime. By defining the cyclically averaged antenna matrix for continuous GWs from a known pulsar, we show that waveforms for each polarization state can be uniquely reconstructed in time domain from a given set of the strain outputs at a single detector. Constraining the propagation speed of extra polarization modes, if they coexist with the transverse-traceless modes, is also discussed. We examine also possible effects due to the length-of-day modulation as well as a secular change in the pulsar spin period.


title: Fractional Motion Estimation for Point Cloud Compression

abstract: Motivated by the success of fractional pixel motion in video coding, we explore the design of motion estimation with fractional-voxel resolution for compression of color attributes of dynamic 3D point clouds. Our proposed block-based fractional-voxel motion estimation scheme takes into account the fundamental differences between point clouds and videos, i.e., the irregularity of the distribution of voxels within a frame and across frames. We show that motion compensation can benefit from the higher resolution reference and more accurate displacements provided by fractional precision. Our proposed scheme significantly outperforms comparable methods that only use integer motion. The proposed scheme can be combined with and add sizeable gains to state-of-the-art systems that use transforms such as Region Adaptive Graph Fourier Transform and Region Adaptive Haar Transform.


title: Industry Experiences with Large-Scale Refactoring

abstract: Software refactoring plays an important role in software engineering. Developers often turn to refactoring when they want to restructure software to improve its quality without changing its external behavior. Studies show that small-scale (floss) refactoring is common in industry and can often be performed by a single developer in short sessions, even though developers do much of this work manually instead of using refactoring tools. However, some refactoring efforts are much larger in scale, requiring entire teams and months of effort, and the role of tools in these efforts is not as well studied. In this paper, we report on a survey we conducted with developers to understand large-scale refactoring, its prevalence, and how tools support it. Our results from 107 industry developers demonstrate that projects commonly go through multiple large-scale refactorings, each of which requires considerable effort. While there is often a desire to refactor, other business concerns such as developing new features often take higher priority. Our study finds that developers use several categories of tools to support large-scale refactoring and rely more heavily on general-purpose tools like IDEs than on tools designed specifically to support refactoring. Tool support varies across the different activities, with some particularly challenging activities seeing little use of tools in practice. Our study demonstrates a clear need for better large-scale refactoring tools and an opportunity for refactoring researchers to make a difference in industry. The results we summarize in this paper is one concrete step towards this goal.


title: Axion cosmology in the presence of non-trivial Nambu-Goldstone modes

abstract: Axion cosmology is reexamined taking into account effect of kinetic pseudo Nambu-Goldstone modes, with its importance recently pointed out. When Peccei-Quinn (PQ) symmetry is broken by a chiral U(1) singlet, it is found that the effect of kinetic Nambu-Goldstone mode makes the axion dark matter untenable. When PQ symmetry is extended and is broken by two singlets, we find axion cosmology to work, but there are several differences from the axion cosmology studied in the literature. The differences are (1) ordinary type of dark matter scaling as $1/{\rm cosmic \; scale\; factor}^3$ arising from a modulus field and not from the usual angular field, (2) mass of the dark matter quantum in the ultralight range, $(10^{-32} \sim 10^{-14})\,$eV, (3) emergence of dark energy with the present density of order (a few meV)$^4$ consistent with observations, (4) presence of a long range spin-dependent force, (5) slow-roll inflation after PQ symmetry breaking when conformal coupling to gravity is introduced.


title: Ground Experiment of Full-Duplex Multi-UAV System Enabled by Directional Antennas

abstract: A high performance multi-UAV communication system, which bridges multiple UAVs and ground station, is one of the key enablers to realize a variety of UAV-based systems. To address the issues such as the low spectrum efficiency caused by the co-channel interference, we have proposed a spectrum-efficient full-duplex multi-UA V communication system with low hardware complexity. In this paper, on-ground experiments are conducted to confirm the feasibility and effectiveness of the key feature of the proposed system, i.e., co-channel interference cancellation among UAVs by directional antennas and UAV position control, instead of energy-consuming dedicated self-interference cancellers on UAVs in traditional full-duplex systems. Channel power of interference link between a pair of two UAVs reusing the same channel is measured, and the achievable channel capacity is also measured by a prototype system implemented by software-defined radio devices. The results of different antennas and different antenna heights are also compared. The experimental results agree well with the designs and confirm the feasibility and effectiveness of the proposed system. This ground experiment is a work in progress to provide preliminary results for the multi-UAV-based experiments in the air in the future.


title: Full-Duplex Aerial Communication System for Multiple UAVs with Directional Antennas

abstract: UAV-based wireless systems, such as wireless relay and remote sensing, have attracted great attentions from academia and industry. To realize them, a high-performance wireless aerial communication system, which bridges UAVs and ground stations, is one of the key enablers. However, there are still issues hindering its development, such as the severe co-channel interference among UAVs, and the limited payload/battery-life of UAVs. To address the challenges, we propose an aerial communication system which enables system-level full-duplex communication of multiple UAVs with lower hardware complexities than ideal full-duplex communication systems. In the proposed system, each channel is re-assigned to the uplink and downlink of a pair of UAVs, and each UAV employ a pair of separated channels for its uplink and downlink. The co-channel interference between UAVs that reuse same channels is eliminated by exploiting advantages of UAVs' maneuverability and high-gain directional antennas equipped in UAVs and ground stations, so that dedicated cancellers are not necessary in the proposed system. The system design and performance analysis are given, and the simulation results well agree with the designs.


title: Spectrum Sharing between Directional-Antenna- Equipped UAV System and Terrestrial Systems

abstract: Unmanned aerial vehicles (UAVs)-based applications, such as surveillance systems and wireless relays, are attracting increasing attention from academia and industrial fields. The high-performance aerial communication system is one of the key enablers for them. However, due to the low attenuation of radio waves in the air-to-ground channels, the interference between aerial and terrestrial communication systems would significantly deteriorate their communication performance and greatly limit the potential UAV applications. To address the problem, in this paper, the spectrum sharing strategy between a multiple UAV communication system, in which both UAVs and ground station (GS) are equipped with directional antennas, and terrestrial systems is proposed. The GS position is selected and the flyable areas of the UAVs using certain spectrum resources are defined in advance using prior knowledge from spectrum monitoring on terrestrial communication systems to minimize interference and maximize the flyable areas of the UAVs instead of the low-efficient dynamic channel sensing and allocation for interference elimination. The simulations are conducted through a case study of the spectrum sharing between a multi-UAV video transmission system and the terrestrial wireless local area network (WLAN) system in the 5.7GHz band. The simulation results show that thanks to the proposed system the entire area can be enabled for UAV flight.


title: Stochastic Gravitational-Wave Backgrounds: Current Detection Efforts and Future Prospects

abstract: The collection of individually resolvable gravitational wave (GW) events makes up a tiny fraction of all GW signals which reach our detectors, while most lie below the confusion limit and go undetected. Like voices in a crowded room, the collection of unresolved signals gives rise to a background which is well-described via stochastic variables, and hence referred to as the stochastic GW background (SGWB). In this review, we provide an overview of stochastic GW signals, and characterise them based on features of interest such as generation processes and observational properties. We then review the current detection strategies for stochastic backgrounds, offering a ready-to-use manual for stochastic GW searches in real data. In the process, we distinguish between interferometric measurements of GWs, either by ground-based or space-based laser interferometers, and timing-residuals analyses with pulsar timing arrays (PTAs). These detection methods have been applied to real data both by the large GW collaborations and smaller research groups, and the most recent and instructive results are reported here. We close this review with an outlook on future observations with third generation detectors, space-based interferometers, and potential non-interferometric detection methods proposed in the literature.


title: Blind Image Deconvolution Using Variational Deep Image Prior

abstract: Conventional deconvolution methods utilize hand-crafted image priors to constrain the optimization. While deep-learning-based methods have simplified the optimization by end-to-end training, they fail to generalize well to blurs unseen in the training dataset. Thus, training image-specific models is important for higher generalization. Deep image prior (DIP) provides an approach to optimize the weights of a randomly initialized network with a single degraded image by maximum a posteriori (MAP), which shows that the architecture of a network can serve as the hand-crafted image prior. Different from the conventional hand-crafted image priors that are statistically obtained, it is hard to find a proper network architecture because the relationship between images and their corresponding network architectures is unclear. As a result, the network architecture cannot provide enough constraint for the latent sharp image. This paper proposes a new variational deep image prior (VDIP) for blind image deconvolution, which exploits additive hand-crafted image priors on latent sharp images and approximates a distribution for each pixel to avoid suboptimal solutions. Our mathematical analysis shows that the proposed method can better constrain the optimization. The experimental results further demonstrate that the generated images have better quality than that of the original DIP on benchmark datasets. The source code of our VDIP is available at https://github.com/Dong-Huo/VDIP-Deconvolution.


title: Bootstrap Confidence Regions for Learned Feature Embeddings

abstract: Algorithmic feature learners provide high-dimensional vector representations for non-matrix structured signals, like images, audio, text, and graphs. Low-dimensional projections derived from these representations can be used to explore variation across collections of these data. However, it is not clear how to assess the uncertainty associated with these projections. We adapt methods developed for bootstrapping principal components analysis to the setting where features are learned from non-matrix data. We empirically compare the derived confidence regions in simulations, varying factors that influence both feature learning and the bootstrap. Approaches are illustrated on spatial proteomic data. Code, data, and trained models are released as an R compendium.


title: CLA-NeRF: Category-Level Articulated Neural Radiance Field

abstract: We propose CLA-NeRF -- a Category-Level Articulated Neural Radiance Field that can perform view synthesis, part segmentation, and articulated pose estimation. CLA-NeRF is trained at the object category level using no CAD models and no depth, but a set of RGB images with ground truth camera poses and part segments. During inference, it only takes a few RGB views (i.e., few-shot) of an unseen 3D object instance within the known category to infer the object part segmentation and the neural radiance field. Given an articulated pose as input, CLA-NeRF can perform articulation-aware volume rendering to generate the corresponding RGB image at any camera pose. Moreover, the articulated pose of an object can be estimated via inverse rendering. In our experiments, we evaluate the framework across five categories on both synthetic and real-world data. In all cases, our method shows realistic deformation results and accurate articulated pose estimation. We believe that both few-shot articulated object rendering and articulated pose estimation open doors for robots to perceive and interact with unseen articulated objects.


title: Semi-supervised 3D Object Detection via Temporal Graph Neural Networks

abstract: 3D object detection plays an important role in autonomous driving and other robotics applications. However, these detectors usually require training on large amounts of annotated data that is expensive and time-consuming to collect. Instead, we propose leveraging large amounts of unlabeled point cloud videos by semi-supervised learning of 3D object detectors via temporal graph neural networks. Our insight is that temporal smoothing can create more accurate detection results on unlabeled data, and these smoothed detections can then be used to retrain the detector. We learn to perform this temporal reasoning with a graph neural network, where edges represent the relationship between candidate detections in different time frames. After semi-supervised learning, our method achieves state-of-the-art detection performance on the challenging nuScenes and H3D benchmarks, compared to baselines trained on the same amount of labeled data. Project and code are released at https://www.jianrenw.com/SOD-TGNN/.


title: Mixed Variational Finite Elements for Implicit, General-Purpose Simulation of Deformables

abstract: We propose and explore a new, general-purpose method for the implicit time integration of elastica. Key to our approach is the use of a mixed variational principle. In turn its finite element discretization leads to an efficient alternating projections solver with a superset of the desirable properties of many previous fast solution strategies. This framework fits a range of elastic constitutive models and remains stable across a wide span of timestep sizes, material parameters (including problems that are quasi-static and approximately rigid). It is efficient to evaluate and easily applicable to volume, surface, and rods models. We demonstrate the efficacy of our approach on a number of simulated examples across all three codomains.


title: Violation of Ericksen inequalities in lyotropic chromonic liquid crystals

abstract: By analyzing elastic theory for nematic liquid crystals, we distinguish three regimes of elastic constants. In one regime, the Ericksen inequalities are satisfied, and the ground state of the director field is uniform. In a second regime, certain necessary inequalities are violated, and the free energy is thermodynamically unstable. Between those possibilities, there is an intermediate regime, where the Ericksen inequalities are violated but the system is still stable. Remarkably, lyotropic chromonic liquid crystals are in the intermediate regime. We investigate the nonuniform structure of the director field in that regime, show that it depends sensitively on system geometry, and discuss the implications for lyotropic chromonic liquid crystals.


title: LayoutEnhancer: Generating Good Indoor Layouts from Imperfect Data

abstract: We address the problem of indoor layout synthesis, which is a topic of continuing research interest in computer graphics. The newest works made significant progress using data-driven generative methods; however, these approaches rely on suitable datasets. In practice, desirable layout properties may not exist in a dataset, for instance, specific expert knowledge can be missing in the data. We propose a method that combines expert knowledge, for example, knowledge about ergonomics, with a data-driven generator based on the popular Transformer architecture. The knowledge is given as differentiable scalar functions, which can be used both as weights or as additional terms in the loss function. Using this knowledge, the synthesized layouts can be biased to exhibit desirable properties, even if these properties are not present in the dataset. Our approach can also alleviate problems of lack of data and imperfections in the data. Our work aims to improve generative machine learning for modeling and provide novel tools for designers and amateurs for the problem of interior layout creation.


title: The DIVING$^{3D}$ Survey -- Deep IFS View of Nuclei of Galaxies -- I. Definition and Sample Presentation

abstract: We present the Deep Integral Field Spectrograph View of Nuclei of Galaxies (DIVING$^{3D}$) survey, a seeing-limited optical 3D spectroscopy study of the central regions of all 170 galaxies in the Southern hemisphere with B < 12.0 and |b| > 15 degrees. Most of the observations were taken with the Integral Field Unit of the Gemini Multi-Object Spectrograph, at the Gemini South telescope, but some are also being taken with the Southern Astrophysical Research Telescope (SOAR) Integral Field Spectrograph. The DIVING$^{3D}$ survey was designed for the study of nuclear emission-line properties, circumnuclear (within scales of hundreds of pc) emission-line properties, stellar and gas kinematics and stellar archaeology. The data have a combination of high spatial and spectral resolution not matched by previous surveys and will result in significant contributions for studies related to, for example, the statistics of low-luminosity active galactic nuclei, the ionization mechanisms in Low-Ionization Nuclear Emission-Line Regions, the nature of transition objects, among other topics.


title: Deep Reference Priors: What is the best way to pretrain a model?

abstract: What is the best way to exploit extra data -- be it unlabeled data from the same task, or labeled data from a related task -- to learn a given task? This paper formalizes the question using the theory of reference priors. Reference priors are objective, uninformative Bayesian priors that maximize the mutual information between the task and the weights of the model. Such priors enable the task to maximally affect the Bayesian posterior, e.g., reference priors depend upon the number of samples available for learning the task and for very small sample sizes, the prior puts more probability mass on low-complexity models in the hypothesis space. This paper presents the first demonstration of reference priors for medium-scale deep networks and image-based data. We develop generalizations of reference priors and demonstrate applications to two problems. First, by using unlabeled data to compute the reference prior, we develop new Bayesian semi-supervised learning methods that remain effective even with very few samples per class. Second, by using labeled data from the source task to compute the reference prior, we develop a new pretraining method for transfer learning that allows data from the target task to maximally affect the Bayesian posterior. Empirical validation of these methods is conducted on image classification datasets. Code is available at https://github.com/grasp-lyrl/deep_reference_priors.


title: Rethinking the notion of oracle: A prequel to Lawvere-Tierney topologies for computability theorists

abstract: We present three different perspectives of oracle. First, an oracle is a blackbox; second, an oracle is a tool to change the way we access mathematical objects; and third, an oracle is a factor that causes a change in truth values. Formally, the second perspective advocates that an oracle is an endofunctor on the category of coded sets (preserving underlying sets) -- we associate it with a universal closure operator. The third perspective advocates that an oracle is an operation on the object of truth values -- we associate it with a Lawvere-Tierney topology. These three perspectives create a link between the three fields, computability theory, synthetic descriptive set theory, and effective topos theory.


title: New formulas for moments and functions of the multivariate normal distribution extending Stein's lemma and Isserlis theorem

abstract: We prove a formula for the evaluation of expectations containing a scalar function of a Gaussian random vector multiplied by a product of the random vector components, each one raised at a non-negative integer power. Some powers could be of zeroth-order, and, for expectations containing only one vector component to the first power, the formula reduces to Stein's lemma for the multivariate normal distribution. On the other hand, by setting the said function inside expectation equal to one, we easily derive Isserlis theorem and its generalizations, regarding higher order moments of a Gaussian random vector. We provide two proofs of the formula, with the first being a rigorous proof via mathematical induction. The second is a formal, constructive derivation based on treating the expectation not as an integral, but as the consecutive actions of pseudodifferential operators defined via the moment-generating function of the Gaussian random vector.


title: Sketching stochastic valuation functions

abstract: We consider the problem of sketching a set valuation function, which is defined as the expectation of a valuation function of independent random item values. We show that for monotone subadditive or submodular valuation functions satisfying a weak homogeneity condition, or certain other conditions, there exist discretized distributions of item values with $O(k\log(k))$ support sizes that yield a sketch valuation function which is a constant-factor approximation, for any value query for a set of items of cardinality less than or equal to $k$. The discretized distributions can be efficiently computed by an algorithm for each item's value distribution separately. Our results hold under conditions that accommodate a wide range of valuation functions arising in applications, such as the value of a team corresponding to the best performance of a team member, constant elasticity of substitution production functions exhibiting diminishing returns used in economics and consumer theory, and others. Sketch valuation functions are particularly valuable for finding approximate solutions to optimization problems such as best set selection and welfare maximization. They enable computationally efficient evaluation of approximate value oracle queries and provide an approximation guarantee for the underlying optimization problem.


title: Underapproximation by Egyptian fractions

abstract: An increasing sequence $(x_i)_{i=1}^n$ of positive integers is an $n$-term Egyptian underapproximation of $\theta \in (0,1]$ if $\sum_{i=1}^n \frac{1}{x_i} < \theta$. A greedy algorithm constructs an $n$-term underapproximation of $\theta$. For some but not all numbers $\theta$, the greedy algorithm gives a unique best $n$-term underapproximation for all $n$. An infinite set of rational numbers is constructed for which the greedy underapproximations are best, and numbers for which the greedy algorithm is not best are also studied.


title: Tight Cuts in Bipartite Grafts I: Capital Distance Components

abstract: This paper is the first from a series of papers that provide a characterization of maximum packings of $T$-cuts in bipartite graphs. Given a connected graph, a set $T$ of an even number of vertices, and a minimum $T$-join, an edge weighting can be defined, from which distances between vertices can be defined. Furthermore, given a specified vertex called root, vertices can be classified according to their distances from the root, and this classification of vertices can be used to define a family of subgraphs called {\em distance components}. Seb\"o provided a theorem that revealed a relationship between distance components, minimum $T$-joins, and $T$-cuts. In this paper, we further investigate the structure of distance components in bipartite graphs. Particularly, we focus on {\em capital} distance components, that is, those that include the root. We reveal the structure of capital distance components in terms of the $T$-join analogue of the general Kotzig-Lov\'asz canonical decomposition.


title: 100-kT Magnetic field generation using paisley targets by femtosecond laser-plasma interactions

abstract: A target using a paisley pattern generates 100-kT-level magnetic fields. Laser irradiation induces local charge separation on the target, which creates surface currents along the concave surface, generating a magnetic field. For a laser intensity of $10^{21}$ W/cm$^2$, the target generates a 150-kT magnetic field. We developed a simple model to describe the magnetic field as a function of laser intensity and target radius. A double paisley configuration extends the lifetime of the magnetic field to the picosecond scale. The paisley design generates comparable results even if it is simplified. Thus, it is a robust and modular target suitable for magnetic field applications such as 100-kT magnetic field generation and magnetic reconnection.


title: The binding of atomic hydrogen on graphene from density functional theory and diffusion Monte Carlo calculations

abstract: In this work density functional theory (DFT) and diffusion Monte Carlo (DMC) methods are used to calculate the binding energy of a H atom chemisorbed on the graphene surface. The Perdew-Burke-Ernzerhof (PBE) value of the binding energy is about 20% larger in magnitude than the diffusion Monte Carlo result. The inclusion of exact exchange through the use of the Heyd-Scuseria-Ernzerhof (HSE) functional brings the DFT value of the binding energy closer in line with the DMC result. It is also found that there are significant differences in the charge distributions determined using PBE and DMC approaches.


title: Federated Active Learning (F-AL): an Efficient Annotation Strategy for Federated Learning

abstract: Federated learning (FL) has been intensively investigated in terms of communication efficiency, privacy, and fairness. However, efficient annotation, which is a pain point in real-world FL applications, is less studied. In this project, we propose to apply active learning (AL) and sampling strategy into the FL framework to reduce the annotation workload. We expect that the AL and FL can improve the performance of each other complementarily. In our proposed federated active learning (F-AL) method, the clients collaboratively implement the AL to obtain the instances which are considered as informative to FL in a distributed optimization manner. We compare the test accuracies of the global FL models using the conventional random sampling strategy, client-level separate AL (S-AL), and the proposed F-AL. We empirically demonstrate that the F-AL outperforms baseline methods in image classification tasks.


title: Hyperbolicity of varieties with big linear representation of $\pi_1$

abstract: We show the following algebraicity result for a complex projective variety $X$ with big representation of $\pi_1$ into a semi-simple algebraic group: There exists a proper subvariety $Z \subset X$ such that for any algebraic curve $C$, any holomorphic map $\gamma:\, C \to X$ with $\gamma(C) \not\subset Z$ is induced from an algebraic morphism. As an application, we prove pseudo-Brody hyperbolicity of certain varieties with big reductive representations of $\pi_1$.


title: Playing impartial games on a simplicial complex as an extension of the emperor sum theory

abstract: In this paper, we considered impartial games on a simplicial complex. Each vertex of a given simplicial complex acts as a position of an impartial game. Each player in turn chooses a face of the simplicial complex and, for each position on each vertex of that face, the player can make an arbitrary number of moves. Moreover, the player can make only a single move for each position on each vertex, not on that face. We show how the P-positions of this game can be characterized using the P-position length. This result can be considered an extension of the emperor sum theory. While the emperor sum only allowed multiple moves for a single component, this study examines the case where multiple moves can be made for multiple components, and clarifies areas that the emperor sum theory did not cover.


title: Recognition-Aware Learned Image Compression

abstract: Learned image compression methods generally optimize a rate-distortion loss, trading off improvements in visual distortion for added bitrate. Increasingly, however, compressed imagery is used as an input to deep learning networks for various tasks such as classification, object detection, and superresolution. We propose a recognition-aware learned compression method, which optimizes a rate-distortion loss alongside a task-specific loss, jointly learning compression and recognition networks. We augment a hierarchical autoencoder-based compression network with an EfficientNet recognition model and use two hyperparameters to trade off between distortion, bitrate, and recognition performance. We characterize the classification accuracy of our proposed method as a function of bitrate and find that for low bitrates our method achieves as much as 26% higher recognition accuracy at equivalent bitrates compared to traditional methods such as Better Portable Graphics (BPG).


title: RFUniverse: A Multiphysics Simulation Platform for Embodied AI

abstract: Multiphysics phenomena, the coupling effects involving different aspects of physics laws, are pervasive in the real world and can often be encountered when performing everyday household tasks. Intelligent agents which seek to assist or replace human laborers will need to learn to cope with such phenomena in household task settings. To equip the agents with such kind of abilities, the research community needs a simulation environment, which will have the capability to serve as the testbed for the training process of these intelligent agents, to have the ability to support multiphysics coupling effects. Though many mature simulation software for multiphysics simulation have been adopted in industrial production, such techniques have not been applied to robot learning or embodied AI research. To bridge the gap, we propose a novel simulation environment named RFUniverse. This simulator can not only compute rigid and multi-body dynamics, but also multiphysics coupling effects commonly observed in daily life, such as air-solid interaction, fluid-solid interaction, and heat transfer. Because of the unique multiphysics capacities of this simulator, we can benchmark tasks that involve complex dynamics due to multiphysics coupling effects in a simulation environment before deploying to the real world. RFUniverse provides multiple interfaces to let the users interact with the virtual world in various ways, which is helpful and essential for learning, planning, and control. We benchmark three tasks with reinforcement learning, including food cutting, water pushing, and towel catching. We also evaluate butter pushing with a classic planning-control paradigm. This simulator offers an enhancement of physics simulation in terms of the computation of multiphysics coupling effects.


title: Differentiable Digital Signal Processing Mixture Model for Synthesis Parameter Extraction from Mixture of Harmonic Sounds

abstract: A differentiable digital signal processing (DDSP) autoencoder is a musical sound synthesizer that combines a deep neural network (DNN) and spectral modeling synthesis. It allows us to flexibly edit sounds by changing the fundamental frequency, timbre feature, and loudness (synthesis parameters) extracted from an input sound. However, it is designed for a monophonic harmonic sound and cannot handle mixtures of harmonic sounds. In this paper, we propose a model (DDSP mixture model) that represents a mixture as the sum of the outputs of multiple pretrained DDSP autoencoders. By fitting the output of the proposed model to the observed mixture, we can directly estimate the synthesis parameters of each source. Through synthesis parameter extraction experiments, we show that the proposed method has high and stable performance compared with a straightforward method that applies the DDSP autoencoder to the signals separated by an audio source separation method.


title: Dynamical photon sphere and time evolving shadow around black holes with temporal accretion

abstract: A photon sphere is known as the geometrical structure shaping a black hole shadow. The mechanism is well understood for static or stationary black hole spacetimes such as the Schwarzschild and the Kerr spacetimes. In this paper, we investigate and explicitly specify a photon sphere that shapes a black hole shadow in a dynamical spacetime while taking the global structure of the spacetime into account. We consider dynamical and eternal black hole cases of the Vaidya spacetime, which represents a spherically symmetric black hole with accreting null dust. First, we numerically show that there are the dynamical photon sphere and photon orbits corresponding to the shadow edge in a moderate accretion case. Second, the photon spheres are derived analytically in special cases. Finally, we discuss the relation between our photon sphere and the several notions defined as a photon sphere generalization.


title: Periapsis shifts in dark matter distribution around a black hole

abstract: We consider the periapsis shifts of bound orbits of stars on static clouds around a black hole. The background spacetime is constructed from a Schwarzschild black hole surrounded by a static and spherically symmetric self-gravitating system of massive particles, which satisfies all the standard energy conditions and physically models the gravitational effect of dark matter distribution around a nonrotating black hole. Using nearly circular bound orbits of stars, we obtain a simple formula for the precession rate. This formula explicitly shows that the precession rate is determined by a positive contribution (i.e., a prograde shift) from the conventional general-relativistic effect and a negative contribution (i.e., a retrograde shift) from the local matter density. The four quantities for such an orbit (i.e., the orbital shift angle, the radial oscillation period, the redshift, and the star position mapped onto the celestial sphere) determine the local values of the background model functions. Furthermore, we not only evaluate the precession rate of nearly circular bound orbits in several specific models but also simulate several bound orbits with large eccentricity and their periapsis shifts. The present exact model demonstrates that the retrograde precession does not mean any exotic central objects such as naked singularities or wormholes but simply the existence of significant energy density of matters on the star orbit around the black hole.


title: Constraining low redshift [CII] Emission by Cross-Correlating FIRAS and BOSS Data

abstract: We perform a tomographic cross-correlation analysis of archival FIRAS data and the BOSS galaxy redshift survey to constrain the amplitude of [CII] $^2P_{3/2}\rightarrow$ $^2P_{1/2}$ fine structure emission. Our analysis employs spherical harmonic tomography (SHT), which is based on the angular cross-power spectrum between FIRAS maps and BOSS galaxy over-densities at each pair of redshift bins, over a redshift range of $0.24<z<0.69$. We develop the SHT approach for intensity mapping, where it has several advantages over existing power spectral estimators. Our analysis constrains the product of the [CII] bias and [CII] specific intensity, $b_{[CII]}I_{[CII]i}$, to be $<0.31$ MJy/sr at $z {\approx} 0.35$ and $<0.28$ MJy/sr at $z {\approx} 0.57$ at $95\%$ confidence. These limits are consistent with most current models of the [CII] signal, as well as with higher-redshift [CII] cross-power spectrum measurements from the Planck satellite and BOSS quasars. We also show that our analysis, if applied to data from a more sensitive instrument such as the proposed PIXIE satellite, can detect pessimistic [CII] models at high significance.


title: Disentangling multiple scattering with deep learning: application to strain mapping from electron diffraction patterns

abstract: Implementation of a fast, robust, and fully-automated pipeline for crystal structure determination and underlying strain mapping for crystalline materials is important for many technological applications. Scanning electron nanodiffraction offers a procedure for identifying and collecting strain maps with good accuracy and high spatial resolutions. However, the application of this technique is limited, particularly in thick samples where the electron beam can undergo multiple scattering, which introduces signal nonlinearities. Deep learning methods have the potential to invert these complex signals, but previous implementations are often trained only on specific crystal systems or a small subset of the crystal structure and microscope parameter phase space. In this study, we implement a Fourier space, complex-valued deep neural network called FCU-Net, to invert highly nonlinear electron diffraction patterns into the corresponding quantitative structure factor images. We trained the FCU-Net using over 200,000 unique simulated dynamical diffraction patterns which include many different combinations of crystal structures, orientations, thicknesses, microscope parameters, and common experimental artifacts. We evaluated the trained FCU-Net model against simulated and experimental 4D-STEM diffraction datasets, where it substantially out-performs conventional analysis methods. Our simulated diffraction pattern library, implementation of FCU-Net, and trained model weights are freely available in open source repositories, and can be adapted to many different diffraction measurement problems.


title: Ferrimagnetically ordered states in the Hubbard model on the hexagonal golden-mean tiling

abstract: We study magnetic properties of the half-filled Hubbard model on the two-dimensional hexagonal golden-mean tiling. We find that the vertex model of the tiling is bipartite, with a sublattice imbalance of $\sqrt{5}/(6\tau^3)$ (where $\tau$ is the golden mean), and that the non-interacting tight-binding model gives macroscopically degenerate states at $E=0$. We clarify that each sublattice has specific types of confined states, which in turn leads to an interesting spatial pattern in the local magnetizations in the weak coupling regime. Furthermore, this allows us to analytically obtain the lower bound on the fraction of the confined states as $(\tau+9)/(6\tau^6)\sim 0.0986$, which is conjectured to be the exact fraction. These results imply that a ferrimagnetically ordered state is realized even in the weak coupling limit. The introduction of the Coulomb interaction lifts the macroscopic degeneracy at the Fermi level, and induces finite staggered magnetization as well as uniform magnetization. Likewise, the spatial distribution of the magnetizations continuously changes with increasing interaction strength. The crossover behavior in the magnetically ordered states is also addressed in terms of the perpendicular space analysis.


title: A pilot study of the Earable device to measure facial muscle and eye movement tasks among healthy volunteers

abstract: Many neuromuscular disorders impair function of cranial nerve enervated muscles. Clinical assessment of cranial muscle function has several limitations. Clinician rating of symptoms suffers from inter-rater variation, qualitative or semi-quantitative scoring, and limited ability to capture infrequent or fluctuating symptoms. Patient-reported outcomes are limited by recall bias and poor precision. Current tools to measure orofacial and oculomotor function are cumbersome, difficult to implement, and non-portable. Here, we show how Earable, a wearable device, can discriminate certain cranial muscle activities such as chewing, talking, and swallowing. We demonstrate using data from a pilot study of 10 healthy participants how Earable can be used to measure features from EMG, EEG, and EOG waveforms from subjects performing mock Performance Outcome Assessments (mock-PerfOs), utilized widely in clinical research. Our analysis pipeline provides a framework for how to computationally process and statistically rank features from the Earable device. Finally, we demonstrate that Earable data may be used to classify these activities. Our results, conducted in a pilot study of healthy participants, enable a more comprehensive strategy for the design, development, and analysis of wearable sensor data for investigating clinical populations. Additionally, the results from this study support further evaluation of Earable or similar devices as tools to objectively measure cranial muscle activity in the context of a clinical research setting. Future work will be conducted in clinical disease populations, with a focus on detecting disease signatures, as well as monitoring intra-subject treatment responses. Readily available quantitative metrics from wearable sensor devices like Earable support strategies for the development of novel digital endpoints, a hallmark goal of clinical research.


title: Control of sensitivity in vortex-type magnetic tunnel junction magnetometer sensors by the pinned layer geometry

abstract: The tuning of sensitivity and dynamic range in linear magnetic sensors is required in various applications. We demonstrate the control and design of the sensitivity in magnetic tunnel junction (MTJ) sensors with a vortex-type sensing layer. In this work, we develop sensor MTJs with NiFe sensing layers having a vortex magnetic configuration. We demonstrate that by varying the pinned layer size, the sensitivity to magnetic field is tuned linearly. We obtain a high magnetoresistance ratio of 140 %, and we demonstrate a controllable sensitivity from 0.85 to 4.43 %/Oe, while keeping the vortex layer fixed in size. We compare our experimental results with micromagnetic simulations. We find that the linear displacement of vortex core by an applied field makes the design of vortex sensors simple. The control of the pinned layer geometry is an effective method to increase the sensitivity, without affecting the vortex state of the sensing layer. Furthermore, we propose that the location of the pinned layer can be used to realize more sensing functionalities from a single sensor.


title: A Structure Theorem for Bad 3-Orbifolds

abstract: We explicitly construct a collection of bad 3-orbifolds, \(\mathcal{X}\), satisfying the following properties: \begin{enumerate} \item The underlying topological space of any \(X \in \mathcal{X}\) is homeomorphic to $S^2\times I$ or $(S^2\times S^1)\backslash B^3$. \item The boundary of any \(X \in \mathcal{X}\) consists of one or two spherical 2-orbifolds. \item Any bad 3-orbifold is obtained from a good 3-orbifold by repeating, finitely many times, the following operation: remove one or two orbifold-balls, and glue in some \(X \in \mathcal{X}\). \end{enumerate} Conversely, any bad 3-orbifold \(\OO\) contains some \(X \in \mathcal{X}\) as a sub-orbifold; we call removing \(X\) and capping the resulting boundary \em cut-and-cap.\em\ Then by cutting-and-capping finitely many times we obtain a good orbifold.


title: Kinetic gas disks surrounding Schwarzschild black holes

abstract: We describe stationary and axisymmetric gas configurations surrounding black holes. They consist of a collisionless relativistic kinetic gas of identical massive particles following bound orbits in a Schwarzschild exterior spacetime and are modeled by a one-particle distribution function which is the product of a function of the energy and a function of the orbital inclination associated with the particle's trajectory. The morphology of the resulting configuration is analyzed.


title: INPUT Team Description Paper in 2022

abstract: INPUT is a team participating in the RoboCup Soccer Small League (SSL). It aims to show the world the technological capabilities of the Nagaoka region of Niigata Prefecture, which is where the team members are from. For this purpose, we are working on one of the projects from the Nagaoka Activation Zone of Energy (NAZE). Herein, we introduce two robots, v2019 and v2022, as well as AI systems that will be used in RoboCup 2022. In addition, we describe our efforts to develop robots in collaboration with companies in the Nagaoka area.


title: GNNRank: Learning Global Rankings from Pairwise Comparisons via Directed Graph Neural Networks

abstract: Recovering global rankings from pairwise comparisons has wide applications from time synchronization to sports team ranking. Pairwise comparisons corresponding to matches in a competition can be construed as edges in a directed graph (digraph), whose nodes represent e.g. competitors with an unknown rank. In this paper, we introduce neural networks into the ranking recovery problem by proposing the so-called GNNRank, a trainable GNN-based framework with digraph embedding. Moreover, new objectives are devised to encode ranking upsets/violations. The framework involves a ranking score estimation approach, and adds an inductive bias by unfolding the Fiedler vector computation of the graph constructed from a learnable similarity matrix. Experimental results on extensive data sets show that our methods attain competitive and often superior performance against baselines, as well as showing promising transfer ability. Codes and preprocessed data are at: \url{https://github.com/SherylHYX/GNNRank}.


title: Strongly aperiodic SFTs on hyperbolic groups: where to find them and why we love them

abstract: D. B. Cohen, C. Goodman-Strauss, and the author proved that a hyperbolic group admits an "SA SFT" if and only if it has at most one end. This paper has two distinct parts: the first is a conversation explaining what an SA SFT is and how they may be of use. In the second part I attempt to explain both old and new ideas that go into the proof. References to specific claims in the original paper are given, with the hope that any interested reader may be able to find the details there more accessible after reading this exposition.


title: Criterion of nonsolvability of a finite group and recognition of direct squares of simple groups

abstract: The spectrum $\omega(G)$ of a finite group $G$ is the set of orders of its elements. The following sufficient criterion of nonsolvability is proved: if among the prime divisors of the order of a group $G$, there are four different primes such that $\omega(G)$ contains all their pairwise products but not a product of any three of these numbers, then $G$ is nonsolvable. Using this result, we show that for $q\geqslant 8$ and $q\neq 32$, the direct square $Sz(q)\times Sz(q)$ of the simple exceptional Suzuki group $Sz(q)$ is uniquely characterized by its spectrum in the class of finite groups, while for $Sz(32)\times Sz(32)$, there are exactly four finite groups with the same spectrum.


title: The combinatorics of hopping particles and positivity in Markov chains

abstract: The asymmetric simple exclusion process (ASEP) is a model for translation in protein synthesis and traffic flow; it can be defined as a Markov chain describing particles hopping on a one-dimensional lattice. In this article I give an overview of some of the connections of the stationary distribution of the ASEP to combinatorics (tableaux and multiline queues) and special functions (Askey-Wilson polynomials, Macdonald polynomials, and Schubert polynomials). I also make some general observations about positivity in Markov chains.


title: On the rank of $\pi_1(\mathrm{Symp}_0)$

abstract: We show that for any positive integer $k$ there exists a closed symplectic $4$-manifold $(M,\omega)$, such that $H^1_\mathrm{dR}(M;\mathbb{R})$ is a $k$-dimensional real vector space and its Flux group is equal to $H^1_\mathrm{dR}(M_1;\mathbb{Z})$.


title: Semantic Annotation and Querying Framework based on Semi-structured Ayurvedic Text

abstract: Knowledge bases (KB) are an important resource in a number of natural language processing (NLP) and information retrieval (IR) tasks, such as semantic search, automated question-answering etc. They are also useful for researchers trying to gain information from a text. Unfortunately, however, the state-of-the-art in Sanskrit NLP does not yet allow automated construction of knowledge bases due to unavailability or lack of sufficient accuracy of tools and methods. Thus, in this work, we describe our efforts on manual annotation of Sanskrit text for the purpose of knowledge graph (KG) creation. We choose the chapter Dhanyavarga from Bhavaprakashanighantu of the Ayurvedic text Bhavaprakasha for annotation. The constructed knowledge graph contains 410 entities and 764 relationships. Since Bhavaprakashanighantu is a technical glossary text that describes various properties of different substances, we develop an elaborate ontology to capture the semantics of the entity and relationship types present in the text. To query the knowledge graph, we design 31 query templates that cover most of the common question patterns. For both manual annotation and querying, we customize the Sangrahaka framework previously developed by us. The entire system including the dataset is available from https://sanskrit.iitk.ac.in/ayurveda/ . We hope that the knowledge graph that we have created through manual annotation and subsequent curation will help in development and testing of NLP tools in future as well as studying of the Bhavaprakasanighantu text.


title: WebFormer: The Web-page Transformer for Structure Information Extraction

abstract: Structure information extraction refers to the task of extracting structured text fields from web pages, such as extracting a product offer from a shopping page including product title, description, brand and price. It is an important research topic which has been widely studied in document understanding and web search. Recent natural language models with sequence modeling have demonstrated state-of-the-art performance on web information extraction. However, effectively serializing tokens from unstructured web pages is challenging in practice due to a variety of web layout patterns. Limited work has focused on modeling the web layout for extracting the text fields. In this paper, we introduce WebFormer, a Web-page transFormer model for structure information extraction from web documents. First, we design HTML tokens for each DOM node in the HTML by embedding representations from their neighboring tokens through graph attention. Second, we construct rich attention patterns between HTML tokens and text tokens, which leverages the web layout for effective attention weight computation. We conduct an extensive set of experiments on SWDE and Common Crawl benchmarks. Experimental results demonstrate the superior performance of the proposed approach over several state-of-the-art methods.


title: Confinement effects on the spatially inhomogeneous dynamics in metallic glass films

abstract: We develop the Elastically Collective Nonlinear Langevin Equation theory to investigate, for the first time, glassy dynamics in capped metallic glass thin films. Finite-size effects on the spatial gradient of structural relaxation time and glass transition temperature (Tg) are calculated at different temperatures and vitrification criteria. Molecular dynamics is significantly slowed down near rough solid surfaces and the dynamics at location far from the interfaces is sped up. In thick films, the mobility gradient normalized by the bulk value well obeys the double-exponential form since interference effects between two surfaces are weak. Reducing the film thickness induces a strong dynamic coupling between two surfaces and flattens the relaxation gradient. The normalized gradient of the glass transition temperature is independent of vitrification timescale criterion and can be fitted by a superposition function as the films are not ultra-thin. The local fragility is found to remain unchanged with location. This finding suggests that one can use Angell plots of bulk relaxation time and the Tg spatial gradient to characterize glassy dynamics in metallic glass films. Our computational results agree well with experimental data and simulation.

categories: cond-mat.soft cond-mat.mtrl-sci cond-mat.other cond-mat.stat-mech physics.app-ph


title: Approximating Absolute Galois Groups

abstract: This paper formulates a group condition which is enjoyed by absolute Galois groups, and which guarantees that profinite groups satisfying the condition can be approximated as an inverse limit of groups which are profinite analogues of Bieberbach groups. The condition is a key ingredient in the study of the "representational assembly" approach to descent problems in algebraic K-theory.


title: Information-theoretic point symmetry classifications/quantifications of an electron diffraction spot pattern from a crystal with strong translational pseudosymmetry

abstract: The recently developed information-theoretic approach to crystallographic symmetry classifications and quantifications in two dimensions (2D) from digital transmission electron and scanning probe microscope images is adapted for the analysis of an experimental selected-area transmission electron diffraction spot pattern. The extracted lattice parameters of this crystal are within experimental error bars consistent with a metric tensor that suggests the presence of hexagonal translation symmetry. The point symmetry of the combined low, medium, and high resolution spots is, however, no higher than 2mm. The likelihood of this electron diffraction pattern belonging to a rectangular-centered crystal rather than a hexagonal crystal is quantified on the basis of its information-theoretic point group symmetry classifications. Presumably due to a slight misorientation away from the exact [001] zone axis combined with the curvature of the Ewald sphere and a real structure that includes intergrowth of quadruple NbO and triple BaNbO3 blocks of varying sizes and orientations, the group of highest resolution spots, i.e. d-spacings between 0.125 to 0.085 nm, feature point symmetry .m. only. The crystallographic Rsym values of traditional classifications into the point groups that are compatible with the experimentally obtained primitive lattice parameters are provided for comparison purposes. As it is common practice in diffraction based crystallography, point symmetry classification and quantification results for the group of highest resolution spots are provided separately from their counterparts for the combined low, medium, and high resolution spots.


title: Second-Order Topological Insulator in van der Waals Heterostructures of CoBr$_2$/Pt$_2$HgSe$_3$/CoBr$_2$

abstract: Second-order topological insulator, which has (d-2)-dimensional topological hinge or corner states, has been observed in three-dimensional materials, but has yet not been observed in two-dimensional system. In this Letter, we theoretically propose the realization of second-order topological insulator in the van der Waals heterostructure of CoBr$_2$/Pt$_2$HgSe$_3$/CoBr$_2$. Pt$_2$HgSe$_3$ is a large gap $\mathbb{Z}_2$ topological insulator. With in-plane exchange field from neighboring CoBr$_2$, a large band gap above 70 meV opens up at the edge. The corner states, which are robust against edge disorders and irregular shapes, are confirmed in the nanoflake. We further show that the second-order topological states can also be realized in the heterostructure of jacutingaite family $\mathbb{Z}_2$ topological insulators. We believe that our work will be beneficial for the experimental realization of second-order topological insulators in van der Waals layered materials.


title: Topological Graph-based Analysis of Solid-State Ion Migration

abstract: To accelerate the development of novel ion-conducting materials, we present a general graph-theoretic analysis framework for ion migration in any crystalline structure. The nodes of the graph represent metastable sites of the migrating ion and the edges represent discrete migration events between adjacent sites. Starting from a collection of possible metastable migration sites, the framework assigns a weight to the edges by calculating the individual migration energy barriers between those sites. Connected pathways in the periodic simulation cell corresponding to macroscopic ion migration are identified by searching for the lowest-cost cycle in the periodic migration graph. To exemplify the utility of the framework, we present the automatic analyses of Li migration in different polymorphs of VO(PO4), with the resulting identification of two distinct crystal structures with simple migration pathways demonstrating overall < 300 meV migration barriers.


title: Characterizing Oscillations in Heterogeneous Populations of Coordinators and Anticoordinators

abstract: Oscillations often take place in populations of decision makers that are either a coordinator, who takes action only if enough others do so, or an anticoordinator, who takes action only if few others do so. Populations consisting of exclusively one of these types are known to reach an equilibrium, where every individual is satisfied with her decision. Yet it remains unknown whether oscillations take place in a population consisting of both types, and if they do, what features they share. We study a well-mixed population of individuals, which are either a coordinator or anticoordinator, each associated with a possibly unique threshold and initialized with the strategy A or B. At each time, an agent becomes active to update her strategy based on her threshold: an active coordinator (resp. anticoordinator) updates her strategy to A (resp. B) if the portion of other agents who have chosen A exceeds (falls short of) her threshold, and updates to B (resp. A) otherwise. We define the state of the population dynamics as the distribution over the thresholds of those who have chosen A. We show that the population can admit several minimally positively invariant sets, where the solution trajectory oscillates. We explicitly characterize a class of positively invariant sets, prove their invariance, and provide a necessary and sufficient condition for their stability. Our results highlight the possibility of non-trivial, complex oscillations in the absence of noise and population structure and shed light on the reported oscillations in nature and human societies.


title: Blockchain in the Quantum World

abstract: Blockchain is one of the most discussed and highly accepted technologies, primarily due to its application in almost every field where third parties are needed for trust. Blockchain technology relies on distributed consensus for trust, which is accomplished using hash functions and public-key cryptography. Most of the cryptographic algorithms in use today are vulnerable to quantum attacks. In this work, a systematic literature review is done so that it can be repeated, starting with identifying the research questions. Focusing on these research questions, literature is analysed to find the answers to these questions. The survey is completed by answering the research questions and identification of the research gaps. It is found in the literature that 30% of the research solutions are applicable for the data layer, 24% for the application and presentation layer, 23% for the network layer, 16% for the consensus layer and only 1% for hardware and infrastructure layer. We also found that 6% of the solutions are not blockchain-based but present different distributed ledger technology.


title: Effective polarization in proton-induced $\alpha$ knockout reactions

abstract: The effective polarization of the residual nucleus in the proton-induced $\alpha$ knockout reaction is investigated within the distorted wave impulse approximation framework. The strong absorption of the emitted $\alpha$ particle results in strong selectivity on the reaction "position" depending on the third component of the single-particle orbital angular momentum of the $\alpha$ particle inside a nucleus, hence on the spin direction of the reaction residue. This is caused by a mechanism that is similar to the Maris effect, the effective polarization in the proton-induced proton knockout reactions. However, as a distinct feature of the effective polarization in the $\alpha$ knockout process, the spin degrees of freedom of the reacting particles play no role. The $\alpha$ knockout process with complete kinematics can be a useful polarization technique for the residual nucleus, without actively controlling the spin of the proton.


title: The plain and simple parquet approximation: single- and multi-boson exchange in the two-dimensional Hubbard model

abstract: The parquet approach to vertex corrections is unbiased but computationally demanding. Most applications are therefore restricted to small cluster sizes or rely on various simplifying approximations. We have recently shown that the bosonization of the parquet diagrams provides interpretative and algorithmic advantages over the original purely fermionic formulation. Here we present first results of the numerical implementation of this method by applying it to the half-filled Hubbard model on the square lattice at weak coupling. The improved algorithmic performance allows us to evaluate the parquet approximation for a $16\times16$ lattice, retaining the full momentum and frequency structure of the various vertex functions. We discuss their symmetries and consider parametrizations of their momentum dependence using the truncated unity approximation.


title: Topological Superconductor AuSn4: A first principle study

abstract: Topological semimetals such as Weyl or Dirac semimetals with superconductivity have emerged as a new class of topological materials to realize and study Majorana Fermion. This article reports the Density Functional Theory (DFT) calculated bulk electronic band structure of recently discovered topological superconductor candidate AuSn4. The study has been performed on AuSn4 considering two space groups symmetries viz. Aea2 and Ccce, as reported earlier. This study is further extended to the calculation of Z2 invariants. The Fermi surfaces corresponding to the bands, which are responsible for non-trivial band topology, along with the surface states, are also mapped. The complete study suggests that AuSn4 is a topological semimetal. On AuSn4, it is the first report in the literature showing the non-trivial band topology based on first-principle calculations.


title: Realization of Kane-Mele Model in $\pmb X\bf{N_4}$-Embedded Graphene ($\pmb X$=Pt, Ir, Rh, Os)

abstract: Monolayer graphene embedded with transition metal nitride (i.e., $X$N$_4$) has been experimentally synthesized recently, where a transition metal atom together with four nitrogen atoms as a unit are embedded in graphene to form a stable planar single-atom-thick structure. We provide a systematic study on the structural, electronic and topological properties of these $X$N$_4$-embedded graphene by utilizing both first-principles calculations and tight-binding model. We find that $X$N$_4$-embedded graphene ($X$=Pt, Ir, Rh, Os) can open topologically nontrivial band gaps that host \emph{two-dimensional} $\mathbb{Z}_2$ topological insulators. We further show that the low-energy bands near the band gaps can be perfectly captured by a modified Kane-Mele model Hamiltonian. Our work not only provides concrete two-dimensional materials that are very rare to realize \emph{two-dimensional} $\mathbb{Z}_2$ topological insulators, but also makes the graphene system to be realistic in hosting Kane-Mele type $\mathbb{Z}_2$ topological insulators.


title: Protection or Peril of Following the Crowd in a Pandemic-Concurrent Flood Evacuation

abstract: The decisions of whether and how to evacuate during a climate disaster are influenced by a wide range of factors, including sociodemographics, emergency messaging, and social influence. Further complexity is introduced when multiple hazards occur simultaneously, such as a flood evacuation taking place amid a viral pandemic that requires physical distancing. Such multi-hazard events can necessitate a nuanced navigation of competing decision-making strategies wherein a desire to follow peers is weighed against contagion risks. To better understand these nuances, we distributed an online survey during a pandemic surge in July 2020 to 600 individuals in three midwestern and three southern states in the United States with high risk of flooding. In this paper, we estimate a random parameter logit model in both preference space and willingness-to-pay space. Our results show that the directionality and magnitude of the influence of peers' choices of whether and how to evacuate vary widely across respondents. Overall, the decision of whether to evacuate is positively impacted by peer behavior, while the decision of how to evacuate is negatively impacted by peers. Furthermore, an increase in flood threat level lessens the magnitude of these impacts. These findings have important implications for the design of tailored emergency messaging strategies. Specifically, emphasizing or deemphasizing the severity of each threat in a multi-hazard scenario may assist in: (1) encouraging a reprioritization of competing risk perceptions and (2) magnifying or neutralizing the impacts of social influence, thereby (3) nudging evacuation decision-making toward a desired outcome.


title: Can Population III stars be major origins of both merging binary black holes and extremely metal poor stars?

abstract: Population (Pop) III stars, first stars, or metal-free stars are made of primordial gas. We have examined if they can be dominant origins of merging binary black holes (BHs) and extremely metal-poor stars. The abundance pattern of EMP stars is helpful to trace back the properties of Pop III stars. We have confirmed previous arguments that the observed BH merger rate needs Pop III star formation efficiency 10 times larger than theoretically predicted values, while the cosmic reionization history still permits such a high Pop III star formation efficiency. On the other hand, we have newly found that the elemental abundance pattern of EMP stars only allows the Pop III initial mass function with the minimum mass of $\sim 15 - 27$ $M_\odot$. In other words, the minimum mass must not deviate largely from the critical mass below and above which Pop III stars leave behind neutron stars and BHs, respectively. Pop III stars may be still a dominant origin of merging binary BHs but our study has reduced the allowed parameter space under a hypothesis that EMP stars are formed from primordial gas mixed with Pop III supernova ejecta.


title: Are strongly confined colloids good models for two dimensional liquids?

abstract: Quasi-two-dimensional (quasi-2D) colloidal hard-sphere suspensions confined in a slit geometry are widely used as two dimensional (2D) model systems in experiments that probe the glassy relaxation dynamics of 2D systems. However, the question to what extent these quasi-2D systems indeed represent 2D systems is rarely brought up. Here, we use computer simulations that take into account hydrodynamic interactions to show that dense quasi-2D colloidal bi-disperse hard-sphere suspensions exhibit much more rapid diffusion and relaxation than their 2D counterparts at the same area fraction. This difference is induced by the additional vertical space in the quasi-2D samples in which the small colloids can move out of the 2D plane, therefore allowing overlap between particles in the projected trajectories. Surprisingly, this difference in the dynamics can be accounted for if, instead of using the surface density, one characterizes the systems by means of a suitable structural quantity related to the radial distribution function. This implies that in the two geometries the relevant physics for glass-formation is essentially identical. Our results provide not only practical implications on 2D colloidal experiments but also interesting insights into the 3D-to-2D crossover in glass-forming systems.

categories: cond-mat.soft cond-mat.dis-nn cond-mat.mtrl-sci cond-mat.stat-mech


title: Improving deep neural network generalization and robustness to background bias via layer-wise relevance propagation optimization

abstract: Features in images' backgrounds can spuriously correlate with the images' classes, representing background bias. They can influence the classifier's decisions, causing shortcut learning (Clever Hans effect). The phenomenon generates deep neural networks (DNNs) that perform well on standard evaluation datasets but generalize poorly to real-world data. Layer-wise Relevance Propagation (LRP) explains DNNs' decisions. Here, we show that the optimization of LRP heatmaps can minimize the background bias influence on deep classifiers, hindering shortcut learning. By not increasing run-time computational cost, the approach is light and fast. Furthermore, it applies to virtually any classification architecture. After injecting synthetic bias in images' backgrounds, we compared our approach (dubbed ISNet) to eight state-of-the-art DNNs, quantitatively demonstrating its superior robustness to background bias. Mixed datasets are common for COVID-19 and tuberculosis classification with chest X-rays, fostering background bias. By focusing on the lungs, the ISNet reduced shortcut learning. Thus, its generalization performance on external (out-of-distribution) test databases significantly surpassed all implemented benchmark models.


title: Diffusion of chiral active particles in a Poiseuille flow

abstract: We study the diffusive behavior of chiral active (self-propelled) Brownian particles in a two-dimensional microchannel with a Poiseuille flow. Using numerical simulations, we show that the behavior of the transport coefficients of particles, for example, the average velocity $v$ and the effective diffusion coefficient $D_{eff}$, strongly depends on flow strength $u_0$, translational diffusion constant $D_0$, rotational diffusion rate $D_\theta$, and chirality of the active particles $\Omega$. It is demonstrated that the particles can exhibit upstream drift, resulting in a negative $v$, for the optimal parameter values of $u_0$, $D_\theta$, and $\Omega$. Interestingly, the direction of $v$ can be controlled by tuning these parameters. We observe that for some optimal values of $u_0$ and $\Omega$, the chiral particles aggregate near a channel wall, and the corresponding $D_{eff}$ is enhanced. However, for the nonchiral particles ($\Omega = 0$), the $D_{eff}$ is suppressed by the presence of Poiseuille flow. It is expected that these findings have a great potential for developing microfluidic and lab-on-a-chip devices for separating the active particles.


title: Periodic Traveling Waves in an Integro-Difference Equation With Non-Monotonic Growth and Strong Allee Effect

abstract: We derive sufficient conditions for the existence of a periodic traveling wave solution to an integro-difference equation with a piecewise constant growth function exhibiting a stable period2 cycle and strong Allee effect. The mean traveling wave speed is shown to be the asymptotic spreading speed of solutions with compactly supported initial data under appropriate conditions. We then conduct case studies for the Laplace kernel and uniform kernel.


title: A Network Map of The Witcher

abstract: The Witcher, a fantasy novel series by Andrzej Sapkowski, has inspired multiple computer games and was even launched on Netflix in 2019, with the latest season airing in December 2021. Fictional storylines such as The Witcher, can be well summarized and simplified by network science, extracting the backbone of a complex series of events. In other words, network mapping and data science can transform thousands of pages into one simple, visual, social map. This exemplary visualization also highlights the power of network science by uncovering hidden patterns, such as influencers, hubs, and cliques in the interplay of hundreds of people and their countless encounters. As these methods can be applied to novels and their adaptations as well, they also allow us to compare the original and the adapted pieces, from the cast to the plots. Therefore, in this article, I provide a social network analysis about the societal characteristics of The Witcher, comparing the novels and the TV show.


title: Kuchowicz gravastars in the braneworld formalism

abstract: In the current letter, we study isotropic static spherically symmetric gravastars without charge under the framework of braneworld gravity (dimensionally reduced RS-II braneworld with positive brane tension) using the metric potential of Kuchowicz type (which is physically acceptable, non-singular and stable) in the Mazur-Motolla conjuncture. We derived the Kuchowicz free parameters from the junction conditions assuming Schwarzschild vacuum without cosmological constant. As well, we assume that the interior is filled with Dark Energy (DE-like) fluid, shell with ultrarelativistic stiff fluid. Adopting this conditions, we probed several physical aspects of the gravastars, such as proper length, shell energy and entropy, surface redshift and adiabatic index, interior region mass.


title: Kernelized Multiplicative Weights for 0/1-Polyhedral Games: Bridging the Gap Between Learning in Extensive-Form and Normal-Form Games

abstract: While extensive-form games (EFGs) can be converted into normal-form games (NFGs), doing so comes at the cost of an exponential blowup of the strategy space. So, progress on NFGs and EFGs has historically followed separate tracks, with the EFG community often having to catch up with advances (e.g., last-iterate convergence and predictive regret bounds) from the larger NFG community. In this paper we show that the Optimistic Multiplicative Weights Update (OMWU) algorithm -- the premier learning algorithm for NFGs -- can be simulated on the normal-form equivalent of an EFG in linear time per iteration in the game tree size using a kernel trick. The resulting algorithm, Kernelized OMWU (KOMWU), applies more broadly to all convex games whose strategy space is a polytope with 0/1 integral vertices, as long as the kernel can be evaluated efficiently. In the particular case of EFGs, KOMWU closes several standing gaps between NFG and EFG learning, by enabling direct, black-box transfer to EFGs of desirable properties of learning dynamics that were so far known to be achievable only in NFGs. Specifically, KOMWU gives the first algorithm that guarantees at the same time last-iterate convergence, lower dependence on the size of the game tree than all prior algorithms, and $\tilde{\mathcal{O}}(1)$ regret when followed by all players.


title: $\mathfrak{gl}(1 \vert 1)$-Alexander polynomial for $3$-manifolds

abstract: As an extension of Reshetikhin and Turaev's invariant, Costantino, Geer and Patureau-Mirand constructed $3$-manifold invariants in the setting of relative $G$-modular categories, which include both semisimple and non-semisimple ribbon tensor categories as examples. In this paper, we follow their method to construct a $3$-manifold invariant from Viro's $\mathfrak{gl}(1\vert 1)$-Alexander polynomial. We take lens spaces $L(7, 1)$ and $L(7, 2)$ as examples to show that this invariant can distinguish homotopy equivalent manifolds.


title: Stretching of a fractal polymer around a disc reveals KPZ-like statistics

abstract: While stretching of a polymer along a flat surface is hardly different from the classical Pincus problem of pulling chain ends in free space, the role of curved geometry in conformational statistics of the stretched chain is an exciting open question. Here by means of the scaling analyses and computer simulations we examine stretching of a fractal polymer chain around a disc in 2D (or a cylinder in 3D) of radius $R$. Surprisingly, we reveal that the typical excursions of the polymer away from the surface scale as $\Delta \sim R^{\beta}$, with the Kardar-Parisi-Zhang (KPZ) growth exponent $\beta=1/3$, for any fractal dimension of the chain. Moreover, we find that the curvature-induced correlation length of a fractal chain behaves as $S^* \sim R^{1/z}$ with the KPZ dynamic exponent $z=3/2$, suggesting that the crossover from flat to curved geometry of a stretched polymer corresponds to the crossover from large to short time scales in the KPZ stochastic growth. Thus, we argue that curvature of an underlying boundary furnishes universal KPZ-like statistics to the stretched fractal paths, which further suggests numerous connections with several branches of mathematical physics.

categories: cond-mat.soft cond-mat.stat-mech physics.bio-ph physics.chem-ph


title: A Criterion for Decoding on the BSC

abstract: We present an approach to showing that a linear code is resilient to random errors. We use this approach to obtain decoding results for both transitive codes and Reed-Muller codes. We give three kinds of results about linear codes in general, and transitive linear codes in particular. 1) We give a tight bound on the weight distribution of every transitive linear code $C \subseteq \mathbb{F}_2^N$: $\Pr_{c \in C}[|c| = \alpha N] \leq 2^{-(1-h(\alpha)) \mathsf{dim}(C)}$. 2) We give a criterion that certifies that a linear code $C$ can be decoded on the binary symmetric channel. Let $K_s(x)$ denote the Krawtchouk polynomial of degree $s$, and let $C^\perp$ denote the dual code of $C$. We show that bounds on $\mathbb{E}_{c \in C^{\perp}}[ K_{\epsilon N}(|c|)^2]$ imply that $C$ recovers from errors on the binary symmetric channel with parameter $\epsilon$. Weaker bounds can be used to obtain list-decoding results using similar methods. One consequence of our criterion is that whenever the weight distribution of $C^\perp$ is sufficiently close to the binomial distribution in some interval around $\frac{N}{2}$, $C$ is resilient to $\epsilon$-errors. 3) We combine known estimates for the Krawtchouk polynomials with our weight bound for transitive codes, and with known weight bounds for Reed-Muller codes, to obtain list-decoding results for both these families of codes. In some regimes, our bounds for Reed-Muller codes achieve the information-theoretic optimal trade-off between rate and list size.


title: E-Polynomials and Terwilliger algebra related to codes

abstract: This paper investigates the Terwilliger algebra of some group association schemes related to codes. In addition, it also shows the generators of invariant rings appearing by E-polynomials.


title: Globally Consistent and Tightly Coupled 3D LiDAR Inertial Mapping

abstract: This paper presents a real-time 3D mapping framework based on global matching cost minimization and LiDAR-IMU tight coupling. The proposed framework comprises a preprocessing module and three estimation modules: odometry estimation, local mapping, and global mapping, which are all based on the tight coupling of the GPU-accelerated voxelized GICP matching cost factor and the IMU preintegration factor. The odometry estimation module employs a keyframe-based fixed-lag smoothing approach for efficient and low-drift trajectory estimation, with a bounded computation cost. The global mapping module constructs a factor graph that minimizes the global registration error over the entire map with the support of IMU constraints, ensuring robust optimization in feature-less environments. The evaluation results on the Newer College dataset and KAIST urban dataset show that the proposed framework enables accurate and robust localization and mapping in challenging environments.


title: Adversarial Imitation Learning from Video using a State Observer

abstract: The imitation learning research community has recently made significant progress towards the goal of enabling artificial agents to imitate behaviors from video demonstrations alone. However, current state-of-the-art approaches developed for this problem exhibit high sample complexity due, in part, to the high-dimensional nature of video observations. Towards addressing this issue, we introduce here a new algorithm called Visual Generative Adversarial Imitation from Observation using a State Observer VGAIfO-SO. At its core, VGAIfO-SO seeks to address sample inefficiency using a novel, self-supervised state observer, which provides estimates of lower-dimensional proprioceptive state representations from high-dimensional images. We show experimentally in several continuous control environments that VGAIfO-SO is more sample efficient than other IfO algorithms at learning from video-only demonstrations and can sometimes even achieve performance close to the Generative Adversarial Imitation from Observation (GAIfO) algorithm that has privileged access to the demonstrator's proprioceptive state information.


title: Efficient Simulation of Quantum Many-body Thermodynamics by Tailoring Zero-temperature Tensor Network

abstract: Numerical annealing and renormalization group have conceived various successful approaches to study the thermodynamics of strongly-correlated systems where perturbation or expansion theories fail to work. As the process of lowering the temperatures is usually involved in different manners, these approaches in general become much less efficient or accurate at the low temperatures. In this work, we propose to access the finite-temperature properties from the tensor network (TN) representing the zero-temperature partition function. We propose to "scissor" a finite part from such an infinite-size TN, and "stitch" it to possess the periodic boundary condition along the imaginary-time direction. We dub this approach as TN tailoring. Exceptional accuracy is achieved with a fine-tune process, surpassing the previous methods including the linearized tensor renormalization group [Phys. Rev. Lett. 106, 127202 (2011)], continuous matrix product operator [Phys. Rev. Lett. 125, 170604 (2020)], and etc. High efficiency is demonstrated, where the time cost is nearly independent of the target temperature including the extremely-low temperatures. The proposed idea can be extended to higher-dimensional systems of bosons and fermions.


title: Sequential Search with Off-Policy Reinforcement Learning

abstract: Recent years have seen a significant amount of interests in Sequential Recommendation (SR), which aims to understand and model the sequential user behaviors and the interactions between users and items over time. Surprisingly, despite the huge success Sequential Recommendation has achieved, there is little study on Sequential Search (SS), a twin learning task that takes into account a user's current and past search queries, in addition to behavior on historical query sessions. The SS learning task is even more important than the counterpart SR task for most of E-commence companies due to its much larger online serving demands as well as traffic volume. To this end, we propose a highly scalable hybrid learning model that consists of an RNN learning framework leveraging all features in short-term user-item interactions, and an attention model utilizing selected item-only features from long-term interactions. As a novel optimization step, we fit multiple short user sequences in a single RNN pass within a training batch, by solving a greedy knapsack problem on the fly. Moreover, we explore the use of off-policy reinforcement learning in multi-session personalized search ranking. Specifically, we design a pairwise Deep Deterministic Policy Gradient model that efficiently captures users' long term reward in terms of pairwise classification error. Extensive ablation experiments demonstrate significant improvement each component brings to its state-of-the-art baseline, on a variety of offline and online metrics.