title: Commuting functions in class K and families of wandering Baker domains

abstract: Given commuting functions f,g, with at most a countable compact set of essential singularities, recent results for entire functions are extended to prove that Julia sets match, J(f)=J(g), in a particular case in the class K. With this result on hand, a general form of functions in this class, is constructed with wandering Baker domains.


title: Dynamical Friction and Tidal Interactions

abstract: We discuss dynamical friction in an $N$-body system in the presence of tidal interactions caused by a distant external source. Using the distant tide approximation, we develop a perturbation scheme for the calculation of dynamical friction that takes tidal effects into account to linear order. In this initial analytic approach to the problem, we neglect the influence of tides on the distribution function of stars in the background stellar system. Our result for the dynamical friction force in the appropriate limit is in agreement with Chandrasekhar's formula in the absence of tides. We provide preliminary estimates for the tidal contributions to the dynamical friction force. The astrophysical implications of our results are briefly discussed.


title: Manifold-preserved GANs

abstract: Generative Adversarial Networks (GANs) have been widely adopted in various fields. However, existing GANs generally are not able to preserve the manifold of data space, mainly due to the simple representation of discriminator for the real/generated data. To address such open challenges, this paper proposes Manifold-preserved GANs (MaF-GANs), which generalize Wasserstein GANs into high-dimensional form. Specifically, to improve the representation of data, the discriminator in MaF-GANs is designed to map data into a high-dimensional manifold. Furthermore, to stabilize the training of MaF-GANs, an operation with precise and universal solution for any K-Lipschitz continuity, called Topological Consistency is proposed. The effectiveness of the proposed method is justified by both theoretical analysis and empirical results. When adopting DCGAN as the backbone on CelebA (256*256), the proposed method achieved 12.43 FID, which outperforms the state-of-the-art model like Realness GAN (23.51 FID) by a large margin. Code will be made publicly available.


title: Scenario adaptive disruption prediction study for next generation burning-plasma tokamaks

abstract: Next generation high performance (HP) tokamaks risk damage from unmitigated disruptions at high current and power. Achieving reliable disruption prediction for a device's HP operation based on its low performance (LP) data is key to success. In this letter, through explorative data analysis and dedicated numerical experiments on multiple existing tokamaks, we demonstrate how the operational regimes of tokamaks can affect the power of a trained disruption predictor. First, our results suggest data-driven disruption predictors trained on abundant LP discharges work poorly on the HP regime of the same tokamak, which is a consequence of the distinct distributions of the tightly correlated signals related to disruptions in these two regimes. Second, we find that matching operational parameters among tokamaks strongly improves cross-machine accuracy which implies our model learns from the underlying scalings of dimensionless physics parameters like q_{95}, \beta_{p} and confirms the importance of these parameters in disruption physics and cross machine domain matching from the data-driven perspective. Finally, our results show how in the absence of HP data from the target devices, the best predictivity of the HP regime for the target machine can be achieved by combining LP data from the target with HP data from other machines. These results provide a possible disruption predictor development strategy for next generation tokamaks, such as ITER and SPARC, and highlight the importance of developing on existing machines baseline scenario discharges of future tokamaks to collect more relevant disruptive data.


title: AI Accelerator Survey and Trends

abstract: Over the past several years, new machine learning accelerators were being announced and released every month for a variety of applications from speech recognition, video object detection, assisted driving, and many data center applications. This paper updates the survey of AI accelerators and processors from past two years. This paper collects and summarizes the current commercial accelerators that have been publicly announced with peak performance and power consumption numbers. The performance and power values are plotted on a scatter graph, and a number of dimensions and observations from the trends on this plot are again discussed and analyzed. This year, we also compile a list of benchmarking performance results and compute the computational efficiency with respect to peak performance.


title: AutoInit: Analytic Signal-Preserving Weight Initialization for Neural Networks

abstract: Neural networks require careful weight initialization to prevent signals from exploding or vanishing. Existing initialization schemes solve this problem in specific cases by assuming that the network has a certain activation function or topology. It is difficult to derive such weight initialization strategies, and modern architectures therefore often use these same initialization schemes even though their assumptions do not hold. This paper introduces AutoInit, a weight initialization algorithm that automatically adapts to different neural network architectures. By analytically tracking the mean and variance of signals as they propagate through the network, AutoInit appropriately scales the weights at each layer to avoid exploding or vanishing signals. Experiments demonstrate that AutoInit improves performance of convolutional, residual, and transformer networks across a range of activation function, dropout, weight decay, learning rate, and normalizer settings, and does so more reliably than data-dependent initialization methods. This flexibility allows AutoInit to initialize models for everything from small tabular tasks to large datasets such as ImageNet. Such generality turns out particularly useful in neural architecture search and in activation function discovery. In these settings, AutoInit initializes each candidate appropriately, making performance evaluations more accurate. AutoInit thus serves as an automatic configuration tool that makes design of new neural network architectures more robust. The AutoInit package provides a wrapper around TensorFlow models and is available at https://github.com/cognizant-ai-labs/autoinit.


title: Soft QCD results from ALICE

abstract: High-energy hadronic collisions are dominated by soft interactions with low momentum transfers. The description of these processes typically relies on phenomenological models. The soft QCD measurements, such as characterisation of the underlying event (UE) and study of light flavored hadrons, provide important constraints on the model parameters. They also provide additional insights into the recent measurements at the LHC where features normally attributed to QGP formation in Pb-Pb collisions have been observed even in pp and p-Pb collisions. Here, we present an analysis based on UE measurements applied to p-Pb collisions for the first time at the LHC to test the similarities between pp and p-Pb collisions. Furthermore, it is shown that the UE at midrapidity is correlated with the energy measured at forward rapidity by ALICE zero degree calorimeters (ZDC). Using ZDC, a multi-differential study is shown to disentangle initial and final-state effects on strange hadron production in pp collisions.


title: EVL: a typed functional language for event processing

abstract: We define EVL, a minimal higher-order functional language to deal with generic events. The notion of generic event extends the well-known notion of event traditionally used in a variety of areas, such as database management, concurrency, reactive systems and cybersecurity. Generic events were introduced in the context of a metamodel to specify obligations in access control systems. Event specifications are represented as records and we use polymorphic record types to type events in EVL. We show how the higher-order capabilities of EVL can be used in the context of Complex Event Processing (CEP), to define higher-order parameterised functions that deal with the usual CEP techniques.


title: Tensor Network States for Vibrational Spectroscopy

abstract: This review elaborates on the foundation, the advantages, and the prospects of tensor network representations for quantum states in vibrational spectroscopy. The focus is on the recently introduced matrix product state decomposition of nuclear quantum states and its optimization by the density matrix renormalization group algorithm.


title: On integer partitions and continued fraction type algorithms

abstract: We show that the additive-slow-Farey version of the traditional continued fractions algorithm has a natural interpretation as a method for producing integer partitions of a positive number $n$ into two smaller numbers, with multiplicity. We provide a complete description of how such integer partitions occur and of the conjugation for the corresponding Young shapes via the dynamics of the classical Farey tree. We use the dynamics of the Farey map to get a new formula for $p(2,n)$, the number of ways for partitioning $n$ into two smaller positive integers, with multiplicity. We then do the analogue using the additive-slow-Farey version of the Triangle map (a type of multi-dimensional continued fraction algorithm), giving us a method for producing integer partitions of a positive number $n$ into three smaller numbers, with multiplicity. However different aspects of this generalisations remain unclear.


title: SDTP: Semantic-aware Decoupled Transformer Pyramid for Dense Image Prediction

abstract: Although transformer has achieved great progress on computer vision tasks, the scale variation in dense image prediction is still the key challenge. Few effective multi-scale techniques are applied in transformer and there are two main limitations in the current methods. On one hand, self-attention module in vanilla transformer fails to sufficiently exploit the diversity of semantic information because of its rigid mechanism. On the other hand, it is hard to build attention and interaction among different levels due to the heavy computational burden. To alleviate this problem, we first revisit multi-scale problem in dense prediction, verifying the significance of diverse semantic representation and multi-scale interaction, and exploring the adaptation of transformer to pyramidal structure. Inspired by these findings, we propose a novel Semantic-aware Decoupled Transformer Pyramid (SDTP) for dense image prediction, consisting of Intra-level Semantic Promotion (ISP), Cross-level Decoupled Interaction (CDI) and Attention Refinement Function (ARF). ISP explores the semantic diversity in different receptive space. CDI builds the global attention and interaction among different levels in decoupled space which also solves the problem of heavy computation. Besides, ARF is further added to refine the attention in transformer. Experimental results demonstrate the validity and generality of the proposed method, which outperforms the state-of-the-art by a significant margin in dense image prediction tasks. Furthermore, the proposed components are all plug-and-play, which can be embedded in other methods.


title: Using Experimentally Calibrated Regularized Stokeslets to Assess Bacterial Flagellar Motility Near a Surface

abstract: The presence of a nearby boundary is likely to be important in the life cycle and evolution of motile flagellate bacteria. This has led many authors to employ numerical simulations to model near-surface bacterial motion and compute hydrodynamic boundary effects. A common choice has been the method of images for regularized Stokeslets (MIRS); however, the method requires discretization sizes and regularization parameters that are not specified by any theory. To determine appropriate regularization parameters for given discretization choices in MIRS, we conducted dynamically similar macroscopic experiments and fit the simulations to the data. In the experiments, we measured the torque on cylinders and helices of different wavelengths as they rotated in a viscous fluid at various distances to a boundary. We found that differences between experiments and optimized simulations were less than 5\% when using surface discretizations for cylinders and centerline discretizations for helices. Having determined optimal regularization parameters, we used MIRS to simulate an idealized free-swimming bacterium constructed of a cylindrical cell body and a helical flagellum moving near a boundary. We assessed the swimming performance of many bacterial morphologies by computing swimming speed, motor rotation rate, Purcell's propulsive efficiency, energy cost per distance, and a new metabolic energy cost defined to be the energy cost per body mass per distance. All five measures predicted the same optimal flagellar wavelength independently of body size and surface proximity. Although the measures disagreed on the optimal body size, they all predicted that body size is an important factor in the energy cost of bacterial motility near and far from a surface.

categories: physics.bio-ph cond-mat.soft physics.comp-ph physics.flu-dyn


title: PCNN: A physics-constrained neural network for multiphase flows

abstract: The present study develops a physics-constrained neural network (PCNN) to predict sequential patterns and motions of multiphase flows (MPFs), which includes strong interactions among various fluid phases. To predict the order parameters, which locate individual phases in the future time, a neural network (NN) is applied to quickly infer the dynamics of the phases by encoding observations. The multiphase consistent and conservative boundedness mapping algorithm (MCBOM) is next implemented to correct the predicted order parameters. This enforces the predicted order parameters to strictly satisfy the mass conservation, the summation of the volume fractions of the phases to be unity, the consistency of reduction, and the boundedness of the order parameters. Then, the density of the fluid mixture is updated from the corrected order parameters. Finally, the velocity in the future time is predicted by another NN with the same network structure, but the conservation of momentum is included in the loss function to shrink the parameter space. The proposed PCNN for MPFs sequentially performs (NN)-(MCBOM)-(NN), which avoids nonphysical behaviors of the order parameters, accelerates the convergence, and requires fewer data to make predictions. Numerical experiments demonstrate that the proposed PCNN is capable of predicting MPFs effectively.


title: Magnetoelectric effect in hydrogen harvesting: magnetic field as a trigger of catalytic reactions

abstract: Magnetic fields have been regarded as an additional stimulus for electro- and photocatalytic reactions, but not as a direct trigger for catalytic processes. Multiferroic/magnetoelectric materials, whose electrical polarization and surface charges can be magnetically altered, are especially suitable for triggering and control of catalytic reactions solely with magnetic fields. Here, we demonstrate that magnetic fields can be employed as an independent input energy source for hydrogen harvesting by means of the magnetoelectric effect. Composite multiferroic CoFe2O4-BiFeO3 core-shell nanoparticles act as catalysts for the hydrogen evolution reaction (HER) that is triggered when an alternating magnetic field is applied to an aqueous dispersion of the magnetoelectric nanocatalysts. Based on density functional calculations, we propose that the hydrogen evolution is driven by changes in the ferroelectric polarization direction of BiFeO3 caused by the magnetoelectric coupling. We believe our findings will open new avenues towards magnetically induced renewable energy harvesting.


title: Ensemble Learning using Error Correcting Output Codes: New Classification Error Bounds

abstract: New bounds on classification error rates for the error-correcting output code (ECOC) approach in machine learning are presented. These bounds have exponential decay complexity with respect to codeword length and theoretically validate the effectiveness of the ECOC approach. Bounds are derived for two different models: the first under the assumption that all base classifiers are independent and the second under the assumption that all base classifiers are mutually correlated up to first-order. Moreover, we perform ECOC classification on six datasets and compare their error rates with our bounds to experimentally validate our work and show the effect of correlation on classification accuracy.


abstract: Autonomous mobile robots deployed in outdoor environments must reason about different types of terrain for both safety (e.g., prefer dirt over mud) and deployer preferences (e.g., prefer dirt path over flower beds). Most existing solutions to this preference-aware path planning problem use semantic segmentation to classify terrain types from camera images, and then ascribe costs to each type. Unfortunately, there are three key limitations of such approaches -- they 1) require pre-enumeration of the discrete terrain types, 2) are unable to handle hybrid terrain types (e.g., grassy dirt), and 3) require expensive labelled data to train visual semantic segmentation. We introduce Visual Representation Learning for Preference-Aware Path Planning (VRL-PAP), an alternative approach that overcomes all three limitations: VRL-PAP leverages unlabeled human demonstrations of navigation to autonomously generate triplets for learning visual representations of terrain that are viewpoint invariant and encode terrain types in a continuous representation space. The learned representations are then used along with the same unlabeled human navigation demonstrations to learn a mapping from the representation space to terrain costs. At run time, VRL-PAP maps from images to representations and then representations to costs to perform preference-aware path planning. We present empirical results from challenging outdoor settings that demonstrate VRL-PAP 1) is successfully able to pick paths that reflect demonstrated preferences, 2) is comparable in execution to geometric navigation with a highly detailed manually annotated map (without requiring such annotations), 3) is able to generalize to novel terrain types with minimal additional unlabeled demonstrations.


title: Asynchronous and Distributed Data Augmentation for Massive Data Settings

abstract: Data augmentation (DA) algorithms are widely used for Bayesian inference due to their simplicity. In massive data settings, however, DA algorithms are prohibitively slow because they pass through the full data in any iteration, imposing serious restrictions on their usage despite the advantages. Addressing this problem, we develop a framework for extending any DA that exploits asynchronous and distributed computing. The extended DA algorithm is indexed by a parameter $r \in (0, 1)$ and is called Asynchronous and Distributed (AD) DA with the original DA as its parent. Any ADDA starts by dividing the full data into $k$ smaller disjoint subsets and storing them on $k$ processes, which could be machines or processors. Every iteration of ADDA augments only an $r$-fraction of the $k$ data subsets with some positive probability and leaves the remaining $(1-r)$-fraction of the augmented data unchanged. The parameter draws are obtained using the $r$-fraction of new and $(1-r)$-fraction of old augmented data. For many choices of $k$ and $r$, the fractional updates of ADDA lead to a significant speed-up over the parent DA in massive data settings, and it reduces to the distributed version of its parent DA when $r=1$. We show that the ADDA Markov chain is Harris ergodic with the desired stationary distribution under mild conditions on the parent DA algorithm. We demonstrate the numerical advantages of the ADDA in three representative examples corresponding to different kinds of massive data settings encountered in applications. In all these examples, our DA generalization is significantly faster than its parent DA algorithm for all the choices of $k$ and $r$. We also establish geometric ergodicity of the ADDA Markov chain for all three examples, which in turn yields asymptotically valid standard errors for estimates of desired posterior quantities.


title: Temporal Knowledge Graph Completion using Box Embeddings

abstract: Knowledge graph completion is the task of inferring missing facts based on existing data in a knowledge graph. Temporal knowledge graph completion (TKGC) is an extension of this task to temporal knowledge graphs, where each fact is additionally associated with a time stamp. Current approaches for TKGC primarily build on existing embedding models which are developed for (static) knowledge graph completion, and extend these models to incorporate time, where the idea is to learn latent representations for entities, relations, and timestamps and then use the learned representations to predict missing facts at various time steps. In this paper, we propose BoxTE, a box embedding model for TKGC, building on the static knowledge graph embedding model BoxE. We show that BoxTE is fully expressive, and possesses strong inductive capacity in the temporal setting. We then empirically evaluate our model and show that it achieves state-of-the-art results on several TKGC benchmarks.


title: Envy-Free and Pareto-Optimal Allocations for Agents with Asymmetric Random Valuations

abstract: We study the problem of allocating $m$ indivisible items to $n$ agents with additive utilities. It is desirable for the allocation to be both fair and efficient, which we formalize through the notions of envy-freeness and Pareto-optimality. While envy-free and Pareto-optimal allocations may not exist for arbitrary utility profiles, previous work has shown that such allocations exist with high probability assuming that all agents' values for all items are independently drawn from a common distribution. In this paper, we consider a generalization of this model where each agent's utilities are drawn independently from a distribution specific to the agent. We show that envy-free and Pareto-optimal allocations are likely to exist in this asymmetric model when $m=\Omega\left(n\log n\right)$, which is tight up to a log log gap that also remains open in the symmetric subsetting. Furthermore, these guarantees can be achieved by a polynomial-time algorithm.


title: Contractible spaces and coalescent homotopies

abstract: This paper deals with the existence, or absence, of coalescent contractions of contractible spaces. These are the contractions such that when the tracks of any two points meet, at time t0, they remain together thereafter. If a finite simplicial complex K is collapsible, then any collapse of K encodes coalescent contractions of K. Examples of contractible spaces where no coalescent contractions exist are the Dunce Hat and Bing's house. We establish a criteria for contractible finite simplicial complexes that ensures there are no coalescent contractions: the star-disc property. Keywords: contractible spaces, coalescent homotopies, dunce hat, Bing's house.


title: Hierarchical Policy for Non-prehensile Multi-object Rearrangement with Deep Reinforcement Learning and Monte Carlo Tree Search

abstract: Non-prehensile multi-object rearrangement is a robotic task of planning feasible paths and transferring multiple objects to their predefined target poses without grasping. It needs to consider how each object reaches the target and the order of object movement, which significantly deepens the complexity of the problem. To address these challenges, we propose a hierarchical policy to divide and conquer for non-prehensile multi-object rearrangement. In the high-level policy, guided by a designed policy network, the Monte Carlo Tree Search efficiently searches for the optimal rearrangement sequence among multiple objects, which benefits from imitation and reinforcement. In the low-level policy, the robot plans the paths according to the order of path primitives and manipulates the objects to approach the goal poses one by one. We verify through experiments that the proposed method can achieve a higher success rate, fewer steps, and shorter path length compared with the state-of-the-art.


title: Atrial Fibrillation: A Medical and Technological Review

abstract: Atrial Fibrillation (AF) is the most common type of arrhythmia (Greek a-, loss + rhythmos, rhythm = loss of rhythm) leading to hospitalization in the United States. Though sometimes AF is asymptomatic, it increases the risk of stroke and heart failure in patients, in addition to lowering the health-related quality of life (HRQOL). AF-related care costs the healthcare system between $6.0 to $26 billion each year. Early detection of AF and clinical attention can help improve symptoms and HRQOL of the patient, as well as bring down the cost of care. However, the prevalent paradigm of AF detection depends on electrocardiogram (ECG) recorded at a single point in time and does not shed light on the relation of the symptoms with heart rhythm or AF. In the recent decade, due to the democratization of health monitors and the advent of high-performing computers, Machine Learning algorithms have been proven effective in identifying AF, from the ECG of patients. This paper provides an overview of the symptoms of AF, its diagnosis, and future prospects for research in the field.


title: AirLoop: Lifelong Loop Closure Detection

abstract: Loop closure detection is an important building block that ensures the accuracy and robustness of simultaneous localization and mapping (SLAM) systems. Due to their generalization ability, CNN-based approaches have received increasing attention. Although they normally benefit from training on datasets that are diverse and reflective of the environments, new environments often emerge after the model is deployed. It is therefore desirable to incorporate the data newly collected during operation for incremental learning. Nevertheless, simply finetuning the model on new data is infeasible since it may cause the model's performance on previously learned data to degrade over time, which is also known as the problem of catastrophic forgetting. In this paper, we present AirLoop, a method that leverages techniques from lifelong learning to minimize forgetting when training loop closure detection models incrementally. We experimentally demonstrate the effectiveness of AirLoop on TartanAir, Nordland, and RobotCar datasets. To the best of our knowledge, AirLoop is one of the first works to achieve lifelong learning of deep loop closure detectors.


title: A Tutorial on Trusted and Untrusted non-3GPP Accesses in 5G Systems -- First Steps Towards a Unified Communications Infrastructure

abstract: Fifth-generation (5G) systems are designed to enable convergent access-agnostic service availability. This means that 5G services will be available over 5G New Radio air interface and also through other non-Third Generation Partnership Project (3GPP) access networks, e.g., IEEE 802.11 (Wi-Fi). 3GPP has recently published the Release 16 that includes trusted non-3GPP access network concept and wireless wireline convergence. The main goal of this tutorial is to present an overview of access to 5G core via non-3GPP access networks specified by 3GPP until Release 16 (i.e., untrusted, trusted, and wireline access). The tutorial describes aspects of the convergence of a 5G system and these non-3GPP access networks, such as the authentication and authorization procedures and the data session establishment from the point of view of protocol stack and exchanged messages between the network functions. In order to illustrate several concepts and part of 3GPP specification, we present a basic but fully operational implementation of untrusted non-3GPP access using WLAN. We perform experiments that demonstrate how a Wi-Fi user is authorized in a 5G core and establishes user plane connectivity to a data network. Moreover, we evaluate the performance of this access in terms of time consumed, number of messages, and protocol overhead to established data sessions.


title: Human Recognition based on Retinal Bifurcations and Modified Correlation Function

abstract: Nowadays high security is an important issue for most of the secure places and recent advances increase the needs of high-security systems. Therefore, needs to high security for controlling and permitting the allowable people to enter the high secure places, increases and extends the use of conventional recognition methods. Therefore, a novel identification method using retinal images is proposed in this paper. For this purpose, new mathematical functions are applied on corners and bifurcations. To evaluate the proposed method we use 40 retinal images from the DRIVE database, 20 normal retinal image from STARE database and 140 normal retinal images from local collected database and the accuracy rate is 99.34 percent.


title: Breaking the Computational Bottleneck: Design of Near-Optimal High-Memory Spatially-Coupled Codes

abstract: Spatially-coupled (SC) codes, known for their threshold saturation phenomenon and low-latency windowed decoding algorithms, are ideal for streaming applications and data storage systems. SC codes are constructed by partitioning an underlying block code, followed by rearranging and concatenating the partitioned components in a convolutional manner. The number of partitioned components determines the memory of SC codes. In this paper, we investigate the relation between the performance of SC codes and the density distribution of partitioning matrices. While adopting higher memories results in improved SC code performance, obtaining finite-length, high-performance SC codes with high memory is known to be computationally challenging. We break this computational bottleneck by developing a novel probabilistic framework that obtains (locally) optimal density distributions via gradient descent. Starting from random partitioning matrices abiding by the obtained distribution, we perform low-complexity optimization algorithms that minimize the number of detrimental objects to construct high-memory, high-performance quasi-cyclic SC codes. We apply our framework to various objects of interests, from the simplest short cycles, to more sophisticated objects such as concatenated cycles aiming at finer-grained optimization. Simulation results show that codes obtained through our proposed method notably outperform state-of-the-art SC codes with the same constraint length and optimized SC codes with uniform partitioning. The performance gain is shown to be universal over a variety of channels, from canonical channels such as additive white Gaussian noise and binary symmetric channels, to practical channels underlying flash memory and magnetic recording systems.


title: Berry curvature induced nonlinear magnetoresistivity in two dimensional systems

abstract: The band geometric properties of quantum materials play an elemental role in the linear and nonlinear transport of electrons. In this paper, we propose that the interplay of the Berry curvature, the orbital magnetic moment and the Lorentz force can induce a finite nonlinear resistivity in two dimensional systems in presence of a perpendicular magnetic field. The induced nonlinear magnetoresistivity scales linearly with the magnetic field and is purely quantum mechanical in origin. This novel transport signature can be used as an additional experimental probe for the geometric quantities in intrinsically time reversal symmetric systems.


title: A Distributed Process Model of Cryptographic Protocols

abstract: Cryptographic Protocols (CP) are distributed algorithms intended for secure communication in an insecure environment. They are used, for example, in electronic payments, electronic voting procedures, systems of confidential data processing, etc. Errors in CPs can bring to great financial and social damage, therefore it is necessary to use mathematical methods to substantiate the correctness and safety of CPs. In this paper, a distributed process model of CPs is presented, which allows one to formally describe CPs and their properties. It is shown how to solve the problems of verification of CPs on the base of this model.


title: Motility switching and front-back synchronisation in polarized cells

abstract: The combination of protrusions and retractions in the movement of polarized cells leads to understand the effect of possible synchronisation between the two ends of the cells. This synchronisation, in turn, could lead to different dynamics such as normal and fractional diffusion. Departing from a stochastic single cell trajectory, where a memory effect induces persistent movement, we derive a kinetic-renewal system at the mesoscopic scale. We investigate various scenarios with different levels of complexity, where the two ends of the cell move either independently or with partial or full synchronisation. We study the relevant macroscopic limits where we obtain diffusion, drift-diffusion or fractional diffusion, depending on the initial system. This article clarifies the form of relevant macroscopic equations that describe the possible effects of synchronised movement in cells, and sheds light on the switching between normal and fractional diffusion


title: Ariadne: PyTorch Library for Particle Track Reconstruction Using Deep Learning

abstract: Particle tracking is a fundamental part of the event analysis in high energy and nuclear physics. Events multiplicity increases each year along with the drastic growth of the experimental data which modern HENP detectors produce, so the classical tracking algorithms such as the well-known Kalman filter cannot satisfy speed and scaling requirements. At the same time, breakthroughs in the study of deep learning open an opportunity for the application of high-performance deep neural networks for solving tracking problems in a dense environment of experiments with heavy ions. However, there are no well-documented software libraries for deep learning track reconstruction yet. We introduce Ariadne, the first open-source library for particle tracking based on the PyTorch deep learning framework. The goal of our library is to provide a simple interface that allows one to prepare train and test datasets and to train and evaluate one of the deep tracking models implemented in the library on the data from your specific experiment. The user experience is greatly facilitated because of the system of gin-configurations. The modular structure of the library and abstract classes let the user develop his data processing pipeline and deep tracking model easily. The proposed library is open-source to facilitate academic research in the field of particle tracking based on deep learning.


title: G-CoS: GNN-Accelerator Co-Search Towards Both Better Accuracy and Efficiency

abstract: Graph Neural Networks (GNNs) have emerged as the state-of-the-art (SOTA) method for graph-based learning tasks. However, it still remains prohibitively challenging to inference GNNs over large graph datasets, limiting their application to large-scale real-world tasks. While end-to-end jointly optimizing GNNs and their accelerators is promising in boosting GNNs' inference efficiency and expediting the design process, it is still underexplored due to the vast and distinct design spaces of GNNs and their accelerators. In this work, we propose G-CoS, a GNN and accelerator co-search framework that can automatically search for matched GNN structures and accelerators to maximize both task accuracy and acceleration efficiency. Specifically, GCoS integrates two major enabling components: (1) a generic GNN accelerator search space which is applicable to various GNN structures and (2) a one-shot GNN and accelerator co-search algorithm that enables simultaneous and efficient search for optimal GNN structures and their matched accelerators. To the best of our knowledge, G-CoS is the first co-search framework for GNNs and their accelerators. Extensive experiments and ablation studies show that the GNNs and accelerators generated by G-CoS consistently outperform SOTA GNNs and GNN accelerators in terms of both task accuracy and hardware efficiency, while only requiring a few hours for the end-to-end generation of the best matched GNNs and their accelerators.


title: Multiband imaging of the HD 36546 debris disk: a refined view from SCExAO/CHARIS

abstract: We present the first multi-wavelength (near-infrared; $1.1 - 2.4$ $\mu m$) imaging of HD 36546's debris disk, using the Subaru Coronagraphic Extreme Adaptive Optics (SCExAO) system coupled with the Coronagraphic High Angular Resolution Imaging Spectrograph (CHARIS). As a 3-10 Myr old star, HD 36546 presents a rare opportunity to study a debris disk at very early stages. SCExAO/CHARIS imagery resolves the disk over angular separations of $\rho \sim 0.25" - 1.0"$ (projected separations of $\rm{r_{proj}} \sim 25 - 101$ $\rm{au}$) and enables the first spectrophotometric analysis of the disk. The disk's brightness appears symmetric between its eastern and western extents and it exhibits slightly blue near-infrared colors on average (e.g. $J-K =-0.4\pm0.1$) $-$ suggesting copious sub-micron sized or highly porous grains. Through detailed modeling adopting a Hong scattering phase function (SPF), instead of the more common Henyey-Greenstein function, and using the differential evolution optimization algorithm, we provide an updated schematic of HD 36546's disk. The disk has a shallow radial dust density profile ($\alpha_{in} \approx 1.0$ and $\alpha_{out} \approx -1.5$), a fiducial radius of $r_0 \approx 82.7$ au, an inclination of $i \approx 79.1^\circ$, and a position angle of $\rm PA \approx 80.1^\circ$. Through spine tracing, we find a spine that is consistent with our modeling, but also with a "swept-back wing" geometry. Finally, we provide constraints on companions, including limiting a companion responsible for a marginal Hipparcos-Gaia acceleration to a projected separation of $\lesssim 0.2''$ and to a minimum mass of $\lesssim 11$ $\rm M_{Jup}$.


title: Functional Tensor-Train Chebyshev Method for Multidimensional Quantum Dynamics Simulations

abstract: Methods for efficient simulations of multidimensional quantum dynamics are essential for theoretical studies of chemical systems where quantum effects are important, such as those involving rearrangements of protons or electronic configurations. Here, we introduce the functional tensor-train Chebyshev (FTTC) method for rigorous nuclear quantum dynamics simulations. FTTC is essentially the Chebyshev propagation scheme applied to the initial state, represented in continuous analogue tensor-train format. We demonstrate the capabilities of FTTC as applied to simulations of proton quantum dynamics in a 50-dimensional model of hydrogen-bonded DNA base pairs.


title: Cluster Assembly Times as a Cosmological Test

abstract: The abundance of galaxy clusters in the low-redshift universe provides an important cosmological test, constraining a product of the initial amplitude of fluctuations and the amount by which they have grown since early times. The degeneracy of the test with respect to these two factors remains a limitation of abundance studies. Clusters will have different mean assembly times, however, depending on the relative importance of initial fluctuation amplitude and subsequent growth. Thus, structural probes of cluster age such as concentration, shape or substructure may provide a new cosmological test that breaks the main degeneracy in number counts. We review analytic predictions for how mean assembly time should depend on cosmological parameters, and test these predictions using cosmological simulations. Given the overall sensitivity expected, we estimate the cosmological parameter constraints that could be derived from the cluster catalogues of forthcoming surveys such as Euclid, the Nancy Grace Roman Space Telescope, eROSITA, or CMB-S4. We show that by considering the structural properties of their cluster samples, such surveys could easily achieve errors of $\Delta \sigma_8$ = 0.01 or better.


title: Segmentation Driven Peeling for Visual Analysis of Electronic Transitions

abstract: Electronic transitions in molecules due to absorption or emission of light is a complex quantum mechanical process. Their study plays an important role in the design of novel materials. A common yet challenging task in the study is to determine the nature of those electronic transitions, i.e. which subgroups of the molecule are involved in the transition by donating or accepting electrons, followed by an investigation of the variation in the donor-acceptor behavior for different transitions or conformations of the molecules. In this paper, we present a novel approach towards the study of electronic transitions based on the visual analysis of a bivariate field, namely the electron density in the hole and particle Natural Transition Orbital (NTO). The visual analysis focuses on the continuous scatter plots (CSPs) of the bivariate field linked to their spatial domain. The method supports selections in the CSP visualized as fiber surfaces in the spatial domain, the grouping of atoms, and segmentation of the density fields to peel the CSP. This peeling operator is central to the visual analysis process and helps identify donors and acceptors. We study different molecular systems, identifying local excitation and charge transfer excitations to demonstrate the utility of the method.


title: On the analyticity of the nonlinear Fourier transform of the Benjamin-Ono equation on $\mathbb{T}$

abstract: We prove that the nonlinear Fourier transform of the Benjamin-Ono equation on $\mathbb{T}$, also referred to as Birkhoff map, is a real analytic diffeomorphism from the scale of Sobolev spaces $H^{s}_{0}(\mathbb{T},\mathbb{R})$, $s > -1/2$, to the scale of weighted $\ell^2-$sequence spaces, $\mathfrak{h}^{s +1/2}_{r,0}(\mathbb{N},\mathbb{C})$, $s >-1/2$. As an application we show that for any $-1/2<s<0$, the flow map of the Benjamin-Ono equation $\mathcal{S}_0^t : H^{s}_{0}(\mathbb{T},\mathbb{R})\to H^{s}_{0}(\mathbb{T},\mathbb{R})$ is {\em nowhere locally uniformly continuous} in $H^{s}_{0}(\mathbb{T},\mathbb{R})$.


title: Passive Optical Networking for 5G and Beyond 5G Low-Latency Mobile Fronthauling Services

abstract: Passive optical network (PON) technology offers an attractive cost-efficient alternative to support 5G and Beyond 5G mobile network fronthauling (MFH). However, MFH for such networks is challenging given its high bandwidth and strict latency requirements. To reduce these requirements, radio access network (RAN) functional splitting has been introduced in 5G networks; this provides more flexibility in resource allocation since the protocol stack is distributed between the centralized and the distributed units. In contrast to the conventional MFH requirement of the RF-PHY splitting, the MFH traffic produced by higher-layer splittings becomes more dependent on the actual user traffic load. By capitalizing on the new characteristics of the MFH traffic with RAN functional splitting, this article introduces a resource allocation mechanism to improve the performance of PONs serving MFH.


title: First Demonstration of the Korean eLoran Accuracy in a Narrow Waterway Using Improved ASF Maps

abstract: The vulnerabilities of global navigation satellite systems (GNSSs) to radio frequency jamming and spoofing have attracted significant research attention. In particular, the large-scale jamming incidents that occurred in South Korea substantiate the practical importance of implementing a complementary navigation system. This letter briefly summarizes the efforts of South Korea to deploy an enhanced long-range navigation (eLoran) system, which is a terrestrial low-frequency radio navigation system that can complement GNSSs. After four years of research and development, the Korean eLoran testbed system has been recently deployed and is operational since June 1, 2021. Although its initial performance at sea is satisfactory, navigation through a narrow waterway is still challenging because a complete survey of the additional secondary factor (ASF), which is the largest source of error for eLoran, is practically difficult in a narrow waterway. This letter proposes an alternative way to survey the ASF in a narrow waterway and improve the ASF map generation methods. Moreover, the performance of the proposed approach was validated experimentally.


title: The Undecidability of Network Coding with some Fixed-Size Messages and Edges

abstract: We consider a network coding setting where some of the messages and edges have fixed alphabet sizes, that do not change when we increase the common alphabet size of the rest of the messages and edges. We prove that the problem of deciding whether such network admits a coding scheme is undecidable. This can be considered as a partial solution to the conjecture that network coding (without fixed-size messages/edges) is undecidable. The proof, which makes heavy use of analogies with digital circuits, is essentially constructing a digital circuit of logic gates and flip-flops within a network coding model that is capable of simulating an arbitrary Turing machine.


title: High-Accuracy Absolute Magnetometry with Application to the Fermilab Muon $g-2$ Experiment

abstract: We present details of a high-accuracy absolute scalar magnetometer based on pulsed proton NMR. The $B$-field magnitude is determined from the precession frequency of proton spins in a cylindrical sample of water after accounting for field perturbations from probe materials, sample shape, and other corrections. Features of the design, testing procedures, and corrections necessary for qualification as an absolute scalar magnetometer are described. The device was tested at $B = 1.45$\,T but can be modified for a range exceeding 1--3\,T. The magnetometer was used to calibrate other NMR magnetometers and measure absolute magnetic field magnitudes to an accuracy of 19 parts per billion as part of a measurement of the muon magnetic moment anomaly at Fermilab.


title: Geometric Task Networks: Learning Efficient and Explainable Skill Coordination for Object Manipulation

abstract: Complex manipulation tasks can contain various execution branches of primitive skills in sequence or in parallel under different scenarios. Manual specifications of such branching conditions and associated skill parameters are not only error-prone due to corner cases but also quickly untraceable given a large number of objects and skills. On the other hand, learning from demonstration has increasingly shown to be an intuitive and effective way to program such skills for industrial robots. Parameterized skill representations allow generalization over new scenarios, which however makes the planning process much slower thus unsuitable for online applications. In this work, we propose a hierarchical and compositional planning framework that learns a Geometric Task Network (GTN) from exhaustive planners, without any manual inputs. A GTN is a goal-dependent task graph that encapsulates both the transition relations among skill representations and the geometric constraints underlying these transitions. This framework has shown to improve dramatically the offline learning efficiency, the online performance and the transparency of decision process, by leveraging the task-parameterized models. We demonstrate the approach on a 7-DoF robot arm both in simulation and on hardware solving various manipulation tasks.


title: ReaSCAN: Compositional Reasoning in Language Grounding

abstract: The ability to compositionally map language to referents, relations, and actions is an essential component of language understanding. The recent gSCAN dataset (Ruis et al. 2020, NeurIPS) is an inspiring attempt to assess the capacity of models to learn this kind of grounding in scenarios involving navigational instructions. However, we show that gSCAN's highly constrained design means that it does not require compositional interpretation and that many details of its instructions and scenarios are not required for task success. To address these limitations, we propose ReaSCAN, a benchmark dataset that builds off gSCAN but requires compositional language interpretation and reasoning about entities and relations. We assess two models on ReaSCAN: a multi-modal baseline and a state-of-the-art graph convolutional neural model. These experiments show that ReaSCAN is substantially harder than gSCAN for both neural architectures. This suggests that ReaSCAN can serve as a valuable benchmark for advancing our understanding of models' compositional generalization and reasoning capabilities.


title: Spectral splits and entanglement entropy in collective neutrino oscillations

abstract: In environments such as core-collapse supernovae, neutron star mergers, or the early universe, where the neutrino fluxes can be extremely high, neutrino-neutrino interactions are appreciable and contribute substantially to their flavor evolution. Such a system of interacting neutrinos can be regarded as a quantum many-body system, and prospects for nontrivial quantum correlations, i.e., entanglement, developing in a gas of interacting neutrinos have been investigated previously. In this work, we uncover an intriguing connection between the entropy of entanglement of individual neutrinos with the rest of the ensemble, and the occurrence of spectral splits in the energy spectra of these neutrinos, which develop as a result of collective neutrino oscillations. In particular, for various types of neutrino spectra, we demonstrate that the entanglement entropy is highest for the neutrinos whose locations in the energy spectrum are closest to the spectral split(s). This trend demonstrates that the quantum entanglement is strongest among the neutrinos that are close to these splits, a behavior that seems to persist even as the size of the many-body system is increased.


title: Dynamic and Systematic Survey of Deep Learning Approaches for Driving Behavior Analysis

abstract: Improper driving results in fatalities, damages, increased energy consumptions, and depreciation of the vehicles. Analyzing driving behaviour could lead to optimize and avoid mentioned issues. By identifying the type of driving and mapping them to the consequences of that type of driving, we can get a model to prevent them. In this regard, we try to create a dynamic survey paper to review and present driving behaviour survey data for future researchers in our research. By analyzing 58 articles, we attempt to classify standard methods and provide a framework for future articles to be examined and studied in different dashboards and updated about trends.


title: The Modular Stone-von Neumann Theorem

abstract: In this paper, we use the tools of nonabelian duality to formulate and prove a far-reaching generalization of the Stone-von Neumann Theorem to modular representations of actions and coactions of locally compact groups on elementary $ C^{\ast} $-algebras. This greatly extends the Covariant Stone-von Neumann Theorem for Actions of Abelian Groups recently proven by L. Ismert and the second author. Our approach is based on a new result about Hilbert $ C^{\ast} $-modules that is simple to state yet is widely applicable and can be used to streamline many previous arguments, so it represents an improvement -- in terms of both efficiency and generality -- in a long line of results in this area of mathematical physics that goes back to J. von Neumann's proof of the classical Stone-von Neumann Theorem.

categories: math.OA math-ph math.DS math.FA math.MP math.RT


title: Data-driven yaw misalignment correction for utility-scale wind turbines

abstract: In recent years, wind turbine yaw misalignment that tends to degrade the turbine power production and impact the blade fatigue loads raises more attention along with the rapid development of large-scale wind turbines. The state-of-the-art correction methods require additional instruments such as LiDAR to provide the ground truths and are not suitable for long-term operation and large-scale implementation due to the high costs. In the present study, we propose a framework that enables the effective and efficient detection and correction of static and dynamic yaw errors by using only turbine SCADA data, suitable for a low-cost regular inspection for large-scale wind farms in onshore, coastal, and offshore sites. This framework includes a short-period data collection of the turbine operating under multiple static yaw errors, a data mining correction for the static yaw error, and ultra-short-term dynamic yaw error forecasts with machine learning algorithms. Three regression algorithms, i.e., linear, support vector machine, and random forest, and a hybrid model based on the average prediction of the three, have been tested for dynamic yaw error prediction and compared using the field measurement data from a 2.5 MW turbine. For the data collected in the present study, the hybrid method shows the best performance and can reduce total yaw error by up to 85% (on average of 71%) compared to the cases without static and dynamic yaw error corrections. In addition, we have tested the transferability of the proposed method in the application of detecting other static and dynamic yaw errors.


title: Existence of a martingale solution of the stochastic Hall-MHD equations perturbed by Poisson type random forces on ${\mathbb{R}}^{3}$

abstract: Stochastic Hall-magnetohydrodynamics equations on ${\mathbb{R}}^{3}$ with random forces expressed in terms of the time homogeneous Poisson random measures are considered. We prove the existence of a global martingale solution. The construction of a solution is based on the Fourier truncation method, stochastic compactness method and a version of the Skorokhod theorem for non-metric spaces adequate for Poisson type random fields.


title: Smaller Gershgorin disks for multiple eigenvalues for complex matrices

abstract: Extending an earlier result for real matrices we show that multiple eigenvalues of a complex matrix lie in a reduced Gershgorin disk. One consequence is a slightly better estimate in the real case. Another one is a geometric application. Further results of a similar type are given for normal and almost symmetric matrices.


title: Machine Learning-Based COVID-19 Patients Triage Algorithm using Patient-Generated Health Data from Nationwide Multicenter Database

abstract: A prompt severity assessment model of patients confirmed for having infectious diseases could enable efficient diagnosis while alleviating burden on the medical system. This study aims to develop a SARS-CoV-2 severity assessment model and establish a medical system that allows patients to check the severity of their cases and informs them to visit the appropriate clinic center based on past treatment data of other patients with similar severity levels. This paper provides the development processes of a severity assessment model using machine learning techniques and its application on SARS-CoV-2 patients. The proposed model is trained on a nationwide dataset provided by a Korean government agency and only requires patients' basic personal data, allowing them to judge the severity of their own cases. After modeling, the boosting-based decision tree model was selected as the classifier while mortality rate was interpreted as the probability score. The dataset was collected from all Korean citizens who were confirmed with COVID-19 between February, 2020 and July, 2021. The experiments achieved high model performance with an approximate precision of $0{\cdot}923$ and AUROC score of $0{\cdot}950$ [$95$% Tolerance Interval $0{\cdot}940$-$0{\cdot}958$, $95$% Confidence Interval $0{\cdot}949$-$0{\cdot}950$]. Moreover, our experiments identified the most important variables affecting the severity in the model via sensitivity analysis. The prompt severity assessment model for managing infectious people has been attained through using a nationwide dataset. It has demonstrated its superior performance by surpassing that of conventional risk assessments. With the model's high performance and easily accessible features, the triage algorithm is expected to be particularly useful when patients monitor their health status by themselves through smartphone applications.


title: Rational singularities of nested Hilbert schemes

abstract: The Hilbert scheme of points $\mathrm{Hilb}^n(S)$ of a smooth surface $S$ is a well-studied parameter space, lying at the interface of algebraic geometry, commutative algebra, representation theory, combinatorics, and mathematical physics. The foundational result is a classical theorem of Fogarty, stating that $\mathrm{Hilb}^n(S)$ is a smooth variety of dimension $2n$. In recent years there has been growing interest in a natural generalization of $\mathrm{Hilb}^n(S)$, the nested Hilbert scheme $\mathrm{Hilb}^{(n_1,n_2)}(S)$, which parametrizes nested pairs of zero-dimensional subschemes $Z_1 \supseteq Z_2$ of $S$ with $\mathrm{deg} (Z_i)=n_i$. In contrast to Fogarty's theorem, $\mathrm{Hilb}^{(n_1,n_2)}(S)$ is almost always singular, and very little is known about its singularities. In this paper we aim to advance the knowledge of the geometry of these nested Hilbert schemes. Work by Fogarty in the 70's shows that $\mathrm{Hilb}^{(n,1)}(S)$ is a normal Cohen-Macaulay variety, and Song more recently proved that it has rational singularities. In our main result, we prove that the nested Hilbert scheme $\mathrm{Hilb}^{(n,2)}(S)$ has rational singularities. We employ an array of tools from commutative algebra to prove this theorem. Using Gr\"obner bases, we establish a connection between $\mathrm{Hilb}^{(n,2)}(S)$ and a certain variety of matrices with an action of the general linear group. This variety of matrices plays a central role in our work, and we analyze it by various algebraic techniques, including square-free Gr\"obner degenerations, the Stanley-Reisner correspondence, and the Kempf-Lascoux-Weyman technique of calculating syzygies. Along the way, we also obtain results on classes of irreducible and reducible nested Hilbert schemes, dimension of singular loci, and $F$-singularities in positive characteristic.


title: Inertial domain wall characterization in layered multisublattice antiferromagnets

abstract: The motion of a N\'eel-like ${180}^{\circ}$ domain wall induced by a time-dependent staggered spin-orbit field in the layered collinear antiferromagnet Mn$_2$Au is explored. Through an effective version of the two sublattice nonlinear $\sigma$-model which does not take into account the antiferromagnetic exchange interaction directed along the tetragonal c-axis, it is possible to replicate accurately the relativistic and inertial traces intrinsic to the magnetic texture dynamics obtained through atomistic spin dynamics simulations for quasistatic processes. In the case in which the steady-state magnetic soliton motion is extinguished due to the abrupt shutdown of the external stimulus, its stored relativistic exchange energy is transformed into a complex translational mobility, being the rigid domain wall profile approximation no longer suitable. Although it is not feasible to carry out a detailed follow-up of its temporal evolution in this case, it is possible to predict the inertial-based distance travelled by the domain wall in relation to its steady-state relativistic mass. This exhaustive dynamical characterization for different time-dependent regimes of the driving force is of potential interest in antiferromagnetic domain wall-based device applications.


title: Random Multi-Channel Image Synthesis for Multiplexed Immunofluorescence Imaging

abstract: Multiplex immunofluorescence (MxIF) is an emerging imaging technique that produces the high sensitivity and specificity of single-cell mapping. With a tenet of 'seeing is believing', MxIF enables iterative staining and imaging extensive antibodies, which provides comprehensive biomarkers to segment and group different cells on a single tissue section. However, considerable depletion of the scarce tissue is inevitable from extensive rounds of staining and bleaching ('missing tissue'). Moreover, the immunofluorescence (IF) imaging can globally fail for particular rounds ('missing stain''). In this work, we focus on the 'missing stain' issue. It would be appealing to develop digital image synthesis approaches to restore missing stain images without losing more tissue physically. Herein, we aim to develop image synthesis approaches for eleven MxIF structural molecular markers (i.e., epithelial and stromal) on real samples. We propose a novel multi-channel high-resolution image synthesis approach, called pixN2N-HD, to tackle possible missing stain scenarios via a high-resolution generative adversarial network (GAN). Our contribution is three-fold: (1) a single deep network framework is proposed to tackle missing stain in MxIF; (2) the proposed 'N-to-N' strategy reduces theoretical four years of computational time to 20 hours when covering all possible missing stains scenarios, with up to five missing stains (e.g., '(N-1)-to-1', '(N-2)-to-2'); and (3) this work is the first comprehensive experimental study of investigating cross-stain synthesis in MxIF. Our results elucidate a promising direction of advancing MxIF imaging with deep image synthesis.


title: Schur-Weyl duality for quantum toroidal superalgebras

abstract: We establish the Schur-Weyl type duality between double affine Hecke algebras and quantum toroidal superalgebras, generalizing the well known result of Vasserot-Varagnolo [VV96] to the super case.


title: Enumeration of self-reciprocal irreducible monic polynomials with prescribed leading coefficients over a finite field

abstract: A polynomial is called self-reciprocal (or palindromic) if the sequence of its coefficients is palindromic. In this paper we enumerate self-reciprocal irreducible monic polynomials over a finite field with prescribed leading coefficients. Asymptotic expression with explicit error bound is derived, which is used to show that such polynomials with degree $2n$ always exist provided that the number of prescribed leading coefficients is slightly less than $n/4$. Exact expressions are also obtained for fields with two or three elements and up to two prescribed leading coefficients.


title: Observability-Aware Trajectory Optimization: Theory, Viability, and State of the Art

abstract: Ideally, robots should move in ways that maximize the knowledge gained about the state of both their internal system and the external operating environment. Trajectory design is a challenging problem that has been investigated from a variety of perspectives, ranging from information-theoretic analyses to leaning-based approaches. Recently, observability-based metrics have been proposed to find trajectories that enable rapid and accurate state and parameter estimation. The viability and efficacy of these methods is not yet well understood in the literature. In this paper, we compare two state-of-the-art methods for observability-aware trajectory optimization and seek to add important theoretical clarifications and valuable discussion about their overall effectiveness. For evaluation, we examine the representative task of sensor-to-sensor extrinsic self-calibration using a realistic physics simulator. We also study the sensitivity of these algorithms to changes in the information content of the exteroceptive sensor measurements.


title: Earthquake Phase Association using a Bayesian Gaussian Mixture Model

abstract: Earthquake phase association algorithms aggregate picked seismic phases from a network of seismometers into individual earthquakes and play an important role in earthquake monitoring. Dense seismic networks and improved phase picking methods produce massive earthquake phase data sets, particularly for earthquake swarms and aftershocks occurring closely in time and space, making phase association a challenging problem. We present a new association method, the Gaussian Mixture Model Association (GaMMA), that combines the Gaussian mixture model for phase measurements (both time and amplitude), with earthquake location, origin time, and magnitude estimation. We treat earthquake phase association as an unsupervised clustering problem in a probabilistic framework, where each earthquake corresponds to a cluster of P and S phases with hyperbolic moveout of arrival times and a decay of amplitude with distance. We use a multivariate Gaussian distribution to model the collection of phase picks for an event, the mean of which is given by the predicted arrival time and amplitude from the causative event. We carry out the pick assignment for each earthquake and determine earthquake parameters (i.e., earthquake location, origin time, and magnitude) under the maximum likelihood criterion using the Expectation-Maximization (EM) algorithm. The GaMMA method does not require the typical association steps of other algorithms, such as grid-search or supervised training. The results on both synthetic test and the 2019 Ridgecrest earthquake sequence show that GaMMA effectively associates phases from a temporally and spatially dense earthquake sequence while producing useful estimates of earthquake location and magnitude.


title: Mean square stability of stochastic theta method for stochastic differential equations driven by fractional Brownian motion

abstract: In this paper, we study the mean-square stability of the solution and its stochastic theta scheme for the following stochastic differential equations drive by fractional Brownian motion with Hurst parameter $H\in (\frac 12,1)$: $$ dX(t)=f(t,X(t))dt+g(t,X(t))dB^{H}(t). $$ Firstly, we consider the special case when $f(t,X)=-\lambda\kappa t^{\kappa-1}X$ and $g(t,X)=\mu X$. The solution is explicit and is mean-square stable when $\kappa\geq 2H$. It is proved that if the parameter $2H\leq\kappa\le 3/2$ and $\frac{\sqrt{3/2}\cdot e}{\sqrt{3/2}\cdot e+1} (\approx 0.77)\leq \theta\leq 1$ or $\kappa>3/2$ and $1/2<\theta\le 1$, the stochastic theta method reproduces the mean-square stability; and that if $0<\theta<\frac 12$, the numerical method does not preserve this stability unconditionally. Secondly, we study the stability of the solution and its stochastic theta scheme for nonlinear equations. Due to the presence of long memory, even the problem of stability in the mean square sense of the solution has not been well studied since the conventional techniques powerful for stochastic differential equations driven by Brownian motion are no longer applicable. Let alone the stability of numerical schemes. We need to develop a completely new set of techniques to deal with this difficulty. Numerical examples are carried out to illustrate our theoretical results.


title: Augmenting semantic lexicons using word embeddings and transfer learning

abstract: Sentiment-aware intelligent systems are essential to a wide array of applications. These systems are driven by language models which broadly fall into two paradigms: Lexicon-based and contextual. Although recent contextual models are increasingly dominant, we still see demand for lexicon-based models because of their interpretability and ease of use. For example, lexicon-based models allow researchers to readily determine which words and phrases contribute most to a change in measured sentiment. A challenge for any lexicon-based approach is that the lexicon needs to be routinely expanded with new words and expressions. Here, we propose two models for automatic lexicon expansion. Our first model establishes a baseline employing a simple and shallow neural network initialized with pre-trained word embeddings using a non-contextual approach. Our second model improves upon our baseline, featuring a deep Transformer-based network that brings to bear word definitions to estimate their lexical polarity. Our evaluation shows that both models are able to score new words with a similar accuracy to reviewers from Amazon Mechanical Turk, but at a fraction of the cost.


title: PluGeN: Multi-Label Conditional Generation From Pre-Trained Models

abstract: Modern generative models achieve excellent quality in a variety of tasks including image or text generation and chemical molecule modeling. However, existing methods often lack the essential ability to generate examples with requested properties, such as the age of the person in the photo or the weight of the generated molecule. Incorporating such additional conditioning factors would require rebuilding the entire architecture and optimizing the parameters from scratch. Moreover, it is difficult to disentangle selected attributes so that to perform edits of only one attribute while leaving the others unchanged. To overcome these limitations we propose PluGeN (Plugin Generative Network), a simple yet effective generative technique that can be used as a plugin to pre-trained generative models. The idea behind our approach is to transform the entangled latent representation using a flow-based module into a multi-dimensional space where the values of each attribute are modeled as an independent one-dimensional distribution. In consequence, PluGeN can generate new samples with desired attributes as well as manipulate labeled attributes of existing examples. Due to the disentangling of the latent representation, we are even able to generate samples with rare or unseen combinations of attributes in the dataset, such as a young person with gray hair, men with make-up, or women with beards. We combined PluGeN with GAN and VAE models and applied it to conditional generation and manipulation of images and chemical molecule modeling. Experiments demonstrate that PluGeN preserves the quality of backbone models while adding the ability to control the values of labeled attributes.


title: Reverse inequalities for the Berezin number of operators

abstract: For a bounded linear operator $A$ on a reproducing kernel Hilbert space $\mathcal{H}(\Omega)$, with normalized reproducing kernel $\widehat{k}_{\lambda} = \frac{k_{\lambda}}{\lVert k_{\lambda}\lVert}$, the Berezin symbol, Berezin number and Berezin norm are defined respectively by $\widetilde{A}(\lambda) = \langle A\widehat{k}_{\lambda},\widehat{k}_{\lambda}\rangle$, $ber(A) = \sup_{\lambda\in\Omega}\left|\widetilde{A}(\lambda)\right|$ and $\left\|A\right\|_{ber} = \sup_{\lambda\in\Omega}\left\|A\widehat{k}_{\lambda}\right\|$. A straightforward comparison between these characteristics yields the inequalities $ber(A)\leq\left\|A\right\|_{ber}\leq\lVert A\lVert$. In this paper, we prove further inequalities relating them, and give special care to the corresponding reverse inequalities. In particular, we refine the first one of the above inequalities, namely we prove that \ $ber(A)\leq\left( \left\|A\right\|_{ber}^{2}-\inf_{\lambda\in\Omega}\left\lVert (A-\widetilde{A}(\lambda))\widehat{k}_{\lambda}\right\lVert^{2}\right) ^{\frac{1}{2}}$.


title: Hydroelectric Generation Forecasting with Long Short Term Memory (LSTM) Based Deep Learning Model for Turkey

abstract: Hydroelectricity is one of the renewable energy source, has been used for many years in Turkey. The production of hydraulic power plants based on water reservoirs varies based on different parameters. For this reason, the estimation of hydraulic production gains importance in terms of the planning of electricity generation. In this article, the estimation of Turkey's monthly hydroelectricity production has been made with the long-short-term memory (LSTM) network-based deep learning model. The designed deep learning model is based on hydraulic production time series and future production planning for many years. By using real production data and different LSTM deep learning models, their performance on the monthly forecast of hydraulic electricity generation of the next year has been examined. The obtained results showed that the use of time series based on real production data for many years and deep learning model together is successful in long-term prediction. In the study, it is seen that the 100-layer LSTM model, in which 120 months (10 years) hydroelectric generation time data are used according to the RMSE and MAPE values, are the highest model in terms of estimation accuracy, with a MAPE value of 0.1311 (13.1%) in the annual total and 1.09% as the monthly average distribution. In this model, the best results were obtained for the 100-layer LSTM model, in which the time data of 144 months (12 years) hydroelectric generation data are used, with a RMSE value of 29,689 annually and 2474.08 in monthly distribution. According to the results of the study, time data covering at least 120 months of production is recommended to create an acceptable hydropower forecasting model with LSTM.


title: A Machine Learning Pipeline to Examine Political Bias with Congressional Speeches

abstract: Computational methods to model political bias in social media involve several challenges due to heterogeneity, high-dimensional, multiple modalities, and the scale of the data. Political bias in social media has been studied in multiple viewpoints like media bias, political ideology, echo chambers, and controversies using machine learning pipelines. Most of the current methods rely heavily on the manually-labeled ground-truth data for the underlying political bias prediction tasks. Limitations of such methods include human-intensive labeling, labels related to only a specific problem, and the inability to determine the near future bias state of a social media conversation. In this work, we address such problems and give machine learning approaches to study political bias in two ideologically diverse social media forums: Gab and Twitter without the availability of human-annotated data. Our proposed methods exploit the use of transcripts collected from political speeches in US congress to label the data and achieve the highest accuracy of 70.5% and 65.1% in Twitter and Gab data respectively to predict political bias. We also present a machine learning approach that combines features from cascades and text to forecast cascade's political bias with an accuracy of about 85%.


title: Distributed Joint Power and Rate Control for NOMA/OFDMA in 5G and Beyond

abstract: In this paper, we study the problem of minimizing the uplink aggregate transmit power subject to the users' minimum data rate and peak power constraint on each sub-channel for multi-cell wireless networks. To address this problem, a distributed sub-optimal joint power and rate control algorithm called JPRC is proposed, which is applicable to both non-orthogonal frequency-division multiple access (NOMA) and orthogonal frequency-division multiple access (OFDMA) schemes. Employing JPRC, each user updates its transmit power using only local information. Simulation results illustrate that the JPRC algorithm can reach a performance close to that obtained by the optimal solution via exhaustive search, with the NOMA scheme achieving a 59\% improvement on the aggregate transmit power over the OFDMA counterpart. It is also shown that the JPRC algorithm can outperform existing distributed power control algorithms.


title: The Unreasonable Effectiveness of the Final Batch Normalization Layer

abstract: Early-stage disease indications are rarely recorded in real-world domains, such as Agriculture and Healthcare, and yet, their accurate identification is critical in that point of time. In this type of highly imbalanced classification problems, which encompass complex features, deep learning (DL) is much needed because of its strong detection capabilities. At the same time, DL is observed in practice to favor majority over minority classes and consequently suffer from inaccurate detection of the targeted early-stage indications. In this work, we extend the study done by Kocaman et al., 2020, showing that the final BN layer, when placed before the softmax output layer, has a considerable impact in highly imbalanced image classification problems as well as undermines the role of the softmax outputs as an uncertainty measure. This current study addresses additional hypotheses and reports on the following findings: (i) the performance gain after adding the final BN layer in highly imbalanced settings could still be achieved after removing this additional BN layer in inference; (ii) there is a certain threshold for the imbalance ratio upon which the progress gained by the final BN layer reaches its peak; (iii) the batch size also plays a role and affects the outcome of the final BN application; (iv) the impact of the BN application is also reproducible on other datasets and when utilizing much simpler neural architectures; (v) the reported BN effect occurs only per a single majority class and multiple minority classes i.e., no improvements are evident when there are two majority classes; and finally, (vi) utilizing this BN layer with sigmoid activation has almost no impact when dealing with a strongly imbalanced image classification tasks.


title: Simplex Averaging Operators: Quasi-Banach and $L^p$-Improving Bounds in Lower Dimensions

abstract: We establish some new $L^p$-improving bounds for the $k$-simplex averaging operators $S^k$ that hold in dimensions $d \geq k$. As a consequence of these $L^p$-improving bounds we obtain nontrivial bounds $S^k\colon L^{p_1}\times\cdots\times L^{p_k}\rightarrow L^r$ with $r < 1$. In particular we show that the triangle averaging operator $S^2$ maps $ L^{\frac{d+1}{d}}\times L^{\frac{d+1}{d}} \rightarrow L^{\frac{d+1}{2d}}$ in dimensions $d\geq 2$. This improves quasi-Banach bounds obtained by Palsson and Sovine and extends bounds obtained by Greenleaf, Iosevich, Krauss, and Liu for the case of $k = d = 2$.


title: A mixed invariant of non-orientable surfaces in equivariant Khovanov homology

abstract: We construct a mixed invariant of non-orientable surfaces from the Lee and Bar-Natan deformations of Khovanov homology and use it to distinguish pairs of surfaces bounded by the same knot, including some exotic examples.


title: Complex geodesics in tube domains and their role in the study of harmonic mappings in the disc

abstract: We continue the research on the structure of complex geodesics in tube domains over (bounded) convex bases. In some special cases a more explicit form of the geodesics than the existing ones are provided. As one of the consequences of our study an effective formula for the Kobayashi-Royden metric in the tube domain $T_{\mathbb B_n}$ at the origin is given. The results on the Kobayashi-Royden metric in a natural way provide versions of the Schwarz Lemma for harmonic mappings. We also present a result on harmonic mappings defined on the disc that may be seen as a generalisation of the Rad\'o-Kneser-Choquet Theorem for a class of harmonic bivalent mappings that lets understand better the geometry of complex geodesics in tube domains.


title: Multimodal Classification: Current Landscape, Taxonomy and Future Directions

abstract: Multimodal classification research has been gaining popularity in many domains that collect more data from multiple sources including satellite imagery, biometrics, and medicine. However, the lack of consistent terminology and architectural descriptions makes it difficult to compare different existing solutions. We address these challenges by proposing a new taxonomy for describing such systems based on trends found in recent publications on multimodal classification. Many of the most difficult aspects of unimodal classification have not yet been fully addressed for multimodal datasets including big data, class imbalance, and instance level difficulty. We also provide a discussion of these challenges and future directions.


title: Franz-Keldysh and Stark Effects in Two-Dimensional Metal Halide Perovskites

abstract: As the field of metal halide perovskites (MHP) matures, state-of-the-art techniques to measure basic properties such as the band gap and exciton binding energy continue to produce inconsistent values. This issue is persistent even for 2D MHPs wherein the large separation between exciton and continuum states should make such measurements more straightforward. In this study, we revert to the established theory of a 2D Wannier exciton in a uniform electric field to analyze the electroabsorption response of an archetypal 2D MHP system, phenethylammonium lead iodide (PEA2PbI4). The high level of agreement between the electroabsorption simulation and measurement allows for a deepened understanding of the exciton's redshift according to the quadratic Stark effect and the continuum wavefunction leaking according to the Franz-Keldysh effect. We find the field-dependency of each of these effects to be rich with information, yielding measurements of the exciton's Bohr radius, transition dipole moment, polarizability, and reduced effective mass. Most importantly, the exciton binding energy is unambiguously determined with 2% uncertainty. The high precision of these new measurement methods opens the opportunity for future studies to accurately determine the influence of chemical and environmental factors on the optoelectronic properties of MHPs and thereby increase the tunability of this important class of materials.


title: Change of human mobility during COVID-19: A United States case study

abstract: With the onset of COVID-19 and the resulting shelter in place guidelines combined with remote working practices, human mobility in 2020 has been dramatically impacted. Existing studies typically examine whether mobility in specific localities increases or decreases at specific points in time and relate these changes to certain pandemic and policy events. In this paper, we study mobility change in the US through a five-step process using mobility footprint data. (Step 1) Propose the delta Time Spent in Public Places (Delta-TSPP) as a measure to quantify daily changes in mobility for each US county from 2019-2020. (Step 2) Conduct Principal Component Analysis (PCA) to reduce the Delta-TSPP time series of each county to lower-dimensional latent components of change in mobility. (Step 3) Conduct clustering analysis to find counties that exhibit similar latent components. (Step 4) Investigate local and global spatial autocorrelation for each component. (Step 5) Conduct correlation analysis to investigate how various population characteristics and behavior correlate with mobility patterns. Results show that by describing each county as a linear combination of the three latent components, we can explain 59% of the variation in mobility trends across all US counties. Specifically, change in mobility in 2020 for US counties can be explained as a combination of three latent components: 1) long-term reduction in mobility, 2) no change in mobility, and 3) short-term reduction in mobility. We observe significant correlations between the three latent components of mobility change and various population characteristics, including political leaning, population, COVID-19 cases and deaths, and unemployment. We find that our analysis provides a comprehensive understanding of mobility change in response to the COVID-19 pandemic.


title: Anti-Neuron Watermarking: Protecting Personal Data Against Unauthorized Neural Networks

abstract: We study protecting a user's data (images in this work) against a learner's unauthorized use in training neural networks. It is especially challenging when the user's data is only a tiny percentage of the learner's complete training set. We revisit the traditional watermarking under modern deep learning settings to tackle the challenge. We show that when a user watermarks images using a specialized linear color transformation, a neural network classifier will be imprinted with the signature so that a third-party arbitrator can verify the potentially unauthorized usage of the user data by inferring the watermark signature from the neural network. We also discuss what watermarking properties and signature spaces make the arbitrator's verification convincing. To our best knowledge, this work is the first to protect an individual user's data ownership from unauthorized use in training neural networks.


title: Refined estimates of the blow-up profile for a strongly perturbed semilinear wave equations in one space dimension

abstract: We consider in this paper a class of strongly perturbed semilinear wave equations with a non-characteristic point in one space dimension, for general initial data. Working in the framework of similarity variables, in \cite {MZ} Merle and Zaag constructed an explicit stationary solution of the unperturbed problem and proved an exponential convergence to this family of solutions. If we follow the same strategy under our strongly perturbed equation we just obtain a polynomial convergence which is a rough estimate compared to the one obtained in the unperturbed problem. In order to refine this approximation, we constructed an implicit solution to the perturbed problem which approaches the stationary solutions of the unperturbed problem and we prove the exponential convergence to this prescribed blow-up profile.


title: Fast Charging Limits of Ideally Stable Metal Anodes in Liquid Electrolytes

abstract: Next-generation high-energy-density batteries require ideally stable metal anodes, for which smooth metal deposits during battery recharging are considered a sign of interfacial stability that can ensure high efficiency and long cycle life. With the recent successes, whether the absolute morphological stability guarantees absolute electrochemical stability and safety emerges as a critical question to be investigated in systematic experiments under practical conditions. Here, we use the ideally stable ingot-type sodium metal anode as a model system to identify the fast-charging limits, i.e. highest safe current density, of metal anodes. Our results show that metal penetration can still occur at relatively low current densities, but the overpotentials at the penetration depend on the pore sizes of the separators and surprisingly follow a simple mathematical model we developed as the Young-Laplace overpotential. Our study suggests that the success of stable metal batteries with even the ideally smooth metal anode requires the holistic design of the electrolyte, separator, and metal anodes to ensure the penetration-free operation.


title: Hybrid Data Augmentation and Deep Attention-based Dilated Convolutional-Recurrent Neural Networks for Speech Emotion Recognition

abstract: Speech emotion recognition (SER) has been one of the significant tasks in Human-Computer Interaction (HCI) applications. However, it is hard to choose the optimal features and deal with imbalance labeled data. In this article, we investigate hybrid data augmentation (HDA) methods to generate and balance data based on traditional and generative adversarial networks (GAN) methods. To evaluate the effectiveness of HDA methods, a deep learning framework namely (ADCRNN) is designed by integrating deep dilated convolutional-recurrent neural networks with an attention mechanism. Besides, we choose 3D log Mel-spectrogram (MelSpec) features as the inputs for the deep learning framework. Furthermore, we reconfigure a loss function by combining a softmax loss and a center loss to classify the emotions. For validating our proposed methods, we use the EmoDB dataset that consists of several emotions with imbalanced samples. Experimental results prove that the proposed methods achieve better accuracy than the state-of-the-art methods on the EmoDB with 87.12% and 88.47% for the traditional and GAN-based methods, respectively.


title: Laminar vortex dynamics around forward-swept wings

abstract: Forward-swept wings offer unique advantages in the aerodynamic performance of air vehicles. However, the low-Reynolds-number characteristics of such wings have not been explored in the past. In this work, we numerically study laminar separated flows over forward-swept wings with semi aspect ratios $sAR=0.5$ to 2 at a chord-based Reynolds number of 400. Forward-swept wings generate wakes that are significantly different from those of backward-swept wings. For low-aspect-ratio forward wings, the wakes remain steady due to the strong downwash effects induced by the tip vortices. For larger aspect ratio, the downwash effects weaken over the inboard regions of the wing, allowing unsteady vortex shedding to occur. Further larger aspect ratio allows for the formation of streamwise vortices for highly-swept wings, stabilizing the flow. Forward-swept wings can generate enhanced lift at high angles of attack than the unswept and backward-swept wings, with the cost of high drag. We show through force element analysis that the increased lift of forward-swept wings is attributed to the vortical structure that is maintained by the tip-vortex-induced downwash over the outboard region of wing span. The current findings offer a detailed understanding of the sweep effects on laminar separated flows over forward-swept wings, and invite innovative designs of high-lift devices.


title: Sharp Concentration Inequalities for the Centered Relative Entropy

abstract: We study the relative entropy between the empirical estimate of a discrete distribution and the true underlying distribution. If the minimum value of the probability mass function exceeds an $\alpha > 0$ (i.e. when the true underlying distribution is bounded sufficiently away from the boundary of the simplex), we prove an upper bound on the moment generating function of the centered relative entropy that matches (up to logarithmic factors in the alphabet size and $\alpha$) the optimal asymptotic rates, subsequently leading to a sharp concentration inequality for the centered relative entropy. As a corollary of this result we also obtain confidence intervals and moment bounds for the centered relative entropy that are sharp up to logarithmic factors in the alphabet size and $\alpha$.


title: Non-stationary spatio-temporal point process modeling for high-resolution COVID-19 data

abstract: Most COVID-19 studies commonly report figures of the overall infection at a state- or county-level. This aggregation tends to miss out on fine details of virus propagation. In this paper, we analyze a high-resolution COVID-19 dataset in Cali, Colombia, that records the precise time and location of every confirmed case. We develop a non-stationary spatio-temporal point process equipped with a neural network-based kernel to capture the heterogeneous correlations among COVID-19 cases. The kernel is carefully crafted to enhance expressiveness while maintaining model interpretability. We also incorporate some exogenous influences imposed by city landmarks. Our approach outperforms the state-of-the-art in forecasting new COVID-19 cases with the capability to offer vital insights into the spatio-temporal interaction between individuals concerning the disease spread in a metropolis.


title: Sampling discretization of integral norms and its application

abstract: The paper addresses the problem of sampling discretization of integral norms of elements of finite-dimensional subspaces satisfying some conditions. We prove sampling discretization results under two standard kinds of assumptions -- conditions on the entropy numbers and conditions in terms of the Nikol'skii-type inequalities. We prove some upper bounds on the number of sample points sufficient for good discretization and show that these upper bounds are sharp in a certain sense. Then we apply our general conditional results to subspaces with special structures, namely, subspaces with the tensor product structure. We demonstrate that applications of results based on the Nikol'skii-type inequalities provide somewhat better results than applications of results based on the entropy numbers conditions. Finally, we apply discretization results to the problem of sampling recovery.


title: Hindsight Foresight Relabeling for Meta-Reinforcement Learning

abstract: Meta-reinforcement learning (meta-RL) algorithms allow for agents to learn new behaviors from small amounts of experience, mitigating the sample inefficiency problem in RL. However, while meta-RL agents can adapt quickly to new tasks at test time after experiencing only a few trajectories, the meta-training process is still sample-inefficient. Prior works have found that in the multi-task RL setting, relabeling past transitions and thus sharing experience among tasks can improve sample efficiency and asymptotic performance. We apply this idea to the meta-RL setting and devise a new relabeling method called Hindsight Foresight Relabeling (HFR). We construct a relabeling distribution using the combination of "hindsight", which is used to relabel trajectories using reward functions from the training task distribution, and "foresight", which takes the relabeled trajectories and computes the utility of each trajectory for each task. HFR is easy to implement and readily compatible with existing meta-RL algorithms. We find that HFR improves performance when compared to other relabeling methods on a variety of meta-RL tasks.


title: JEM++: Improved Techniques for Training JEM

abstract: Joint Energy-based Model (JEM) is a recently proposed hybrid model that retains strong discriminative power of modern CNN classifiers, while generating samples rivaling the quality of GAN-based approaches. In this paper, we propose a variety of new training procedures and architecture features to improve JEM's accuracy, training stability, and speed altogether. 1) We propose a proximal SGLD to generate samples in the proximity of samples from the previous step, which improves the stability. 2) We further treat the approximate maximum likelihood learning of EBM as a multi-step differential game, and extend the YOPO framework to cut out redundant calculations during backpropagation, which accelerates the training substantially. 3) Rather than initializing SGLD chain from random noise, we introduce a new informative initialization that samples from a distribution estimated from training data. 4) This informative initialization allows us to enable batch normalization in JEM, which further releases the power of modern CNN architectures for hybrid modeling. Code: https://github.com/sndnyang/JEMPP


title: Joint Distribution Alignment via Adversarial Learning for Domain Adaptive Object Detection

abstract: Unsupervised domain adaptive object detection aims to adapt a well-trained detector from its original source domain with rich labeled data to a new target domain with unlabeled data. Recently, mainstream approaches perform this task through adversarial learning, yet still suffer from two limitations. First, they mainly align marginal distribution by unsupervised cross-domain feature matching, and ignore each feature's categorical and positional information that can be exploited for conditional alignment; Second, they treat all classes as equally important for transferring cross-domain knowledge and ignore that different classes usually have different transferability. In this paper, we propose a joint adaptive detection framework (JADF) to address the above challenges. First, an end-to-end joint adversarial adaptation framework for object detection is proposed, which aligns both marginal and conditional distributions between domains without introducing any extra hyperparameter. Next, to consider the transferability of each object class, a metric for class-wise transferability assessment is proposed, which is incorporated into the JADF objective for domain adaptation. Further, an extended study from unsupervised domain adaptation (UDA) to unsupervised few-shot domain adaptation (UFDA) is conducted, where only a few unlabeled training images are available in unlabeled target domain. Extensive experiments validate that JADF is effective in both the UDA and UFDA settings, achieving significant performance gains over existing state-of-the-art cross-domain detection methods.


title: Greedy UnMixing for Q-Learning in Multi-Agent Reinforcement Learning

abstract: This paper introduces Greedy UnMix (GUM) for cooperative multi-agent reinforcement learning (MARL). Greedy UnMix aims to avoid scenarios where MARL methods fail due to overestimation of values as part of the large joint state-action space. It aims to address this through a conservative Q-learning approach through restricting the state-marginal in the dataset to avoid unobserved joint state action spaces, whilst concurrently attempting to unmix or simplify the problem space under the centralized training with decentralized execution paradigm. We demonstrate the adherence to Q-function lower bounds in the Q-learning for MARL scenarios, and demonstrate superior performance to existing Q-learning MARL approaches as well as more general MARL algorithms over a set of benchmark MARL tasks, despite its relative simplicity compared with state-of-the-art approaches.


title: Continuous-Time Spline Visual-Inertial Odometry

abstract: We propose a continuous-time spline-based formulation for visual-inertial odometry (VIO). Specifically, we model the poses as a cubic spline, whose temporal derivatives are used to synthesize linear acceleration and angular velocity, which are compared to the measurements from the inertial measurement unit (IMU) for optimal state estimation. The spline boundary conditions create constraints between the camera and the IMU, with which we formulate VIO as a constrained nonlinear optimization problem. Continuous-time pose representation makes it possible to address many VIO challenges, e.g., rolling shutter distortion and sensors that may lack synchronization. We conduct experiments on two publicly available datasets that demonstrate the state-of-the-art accuracy and real-time computational efficiency of our method.