title: Highly Ordered Boron Nitride/Epigraphene Epitaxial Films on Silicon Carbide by Lateral Epitaxial Deposition

abstract: Realizing high-performance nanoelectronics requires control of materials at the nanoscale. Methods to produce high quality epitaxial graphene (EG) nanostructures on silicon carbide are known. The next step is to grow Van der Waals semiconductors on top of EG nanostructures. Hexagonal boron nitride (h-BN) is a wide bandgap semiconductor with a honeycomb lattice structure that matches that of graphene, making it ideally suited for graphene-based nanoelectronics. Here, we describe the preparation and characterization of multilayer h-BN grown epitaxially on EG using a migration-enhanced metalorganic vapor phase epitaxy process. As a result of the lateral epitaxial deposition (LED) mechanism, the grown h-BN/EG heterostructures have highly ordered epitaxial interfaces, as desired in order to preserve the transport properties of pristine graphene. Atomic scale structural and energetic details of the observed row-by-row, growth mechanism of the 2D epitaxial h-BN film are analyzed through first-principles simulations, demonstrating one-dimensional nucleation-free-energy-barrierless growth. This industrially relevant LED process can be applied to a wide variety of van der Waals materials.


title: Energy decay rates of solutions to a viscoelastic wave equation with variable exponents and weak damping

abstract: The goal of the present paper is to study the asymptotic behavior of solutions for the viscoelastic wave equation with variable exponents \[ u_{tt}-\Delta u+\int_0^tg(t-s)\Delta u(s)ds+a|u_t|^{m(x)-2}u_t=b|u|^{p(x)-2}u\] under initial-boundary condition, where the exponents $p(x)$ and $m(x)$ are given functions, and $a,~b>0$ are constants. More precisely, under the condition $g'(t)\le -\xi(t)g(t)$, here $\xi(t):\mathbb{R}^+\to\mathbb{R}^+$ is a non-increasing differential function with $\xi(0)>0,~\int_0^\infty\xi(s)ds=+\infty$, general decay results are derived. In addition, when $g$ decays polynomially, the exponential and polynomial decay rates are obtained as well, respectively. This work generalizes and improves earlier results in the literature.


title: Cancer image classification based on DenseNet model

abstract: Computer-aided diagnosis establishes methods for robust assessment of medical image-based examination. Image processing introduced a promising strategy to facilitate disease classification and detection while diminishing unnecessary expenses. In this paper, we propose a novel metastatic cancer image classification model based on DenseNet Block, which can effectively identify metastatic cancer in small image patches taken from larger digital pathology scans. We evaluate the proposed approach to the slightly modified version of the PatchCamelyon (PCam) benchmark dataset. The dataset is the slightly modified version of the PatchCamelyon (PCam) benchmark dataset provided by Kaggle competition, which packs the clinically-relevant task of metastasis detection into a straight-forward binary image classification task. The experiments indicated that our model outperformed other classical methods like Resnet34, Vgg19. Moreover, we also conducted data augmentation experiment and study the relationship between Batches processed and loss value during the training and validation process.


title: Characterization of saturated graphs related to pairs of disjoint matchings

abstract: We study the ratio, in a finite graph, of the sizes of the largest matching in any pair of disjoint matchings with the maximum total number of edges and the largest possible matching. Previously, it was shown that this ratio is between 4/5 and 1, and the class of graphs achieving 4/5 was completely characterized. In this paper, we first show that graph decompositions into paths and even cycles provide a new way to study this ratio. We then use this technique to characterize the graphs achieving ratio 1 among all graphs that can be covered by a certain choice of a maximum matching and maximum disjoint matchings.


title: Integrating Deep Learning in Domain Sciences at Exascale

abstract: This paper presents some of the current challenges in designing deep learning artificial intelligence (AI) and integrating it with traditional high-performance computing (HPC) simulations. We evaluate existing packages for their ability to run deep learning models and applications on large-scale HPC systems efficiently, identify challenges, and propose new asynchronous parallelization and optimization techniques for current large-scale heterogeneous systems and upcoming exascale systems. These developments, along with existing HPC AI software capabilities, have been integrated into MagmaDNN, an open-source HPC deep learning framework. Many deep learning frameworks are targeted at data scientists and fall short in providing quality integration into existing HPC workflows. This paper discusses the necessities of an HPC deep learning framework and how those needs can be provided (e.g., as in MagmaDNN) through a deep integration with existing HPC libraries, such as MAGMA and its modular memory management, MPI, CuBLAS, CuDNN, MKL, and HIP. Advancements are also illustrated through the use of algorithmic enhancements in reduced- and mixed-precision, as well as asynchronous optimization methods. Finally, we present illustrations and potential solutions for enhancing traditional compute- and data-intensive applications at ORNL and UTK with AI. The approaches and future challenges are illustrated in materials science, imaging, and climate applications.


title: Effect of leading-edge curvature actuation on flapping fin performance

abstract: Ray-finned fish are able to adapt the curvature of their fins through musculature at the base of the fin. In this work we numerically investigate the effects of such leading-edge curvature actuation on the hydrodynamic performance of a heaving and pitching fin. We present a geometric and numerical framework for constructing the shape of ray-membrane type fins with imposed leading-edge curvatures, under the constraint of membrane inextensibility. This algorithm is coupled with a 3D Navier-Stokes solver, enabling us to assess the hydrodynamic performance of such fins. To determine the space of possible shapes, we present a simple model for leading-edge curvature actuation through two coefficients that determine chordwise and spanwise curvature, respectively. We systematically vary these two parameters through regimes that mimic both passive elastic deformations and active curvatures against the hydrodynamic loading, and compute thrust and power coefficients, as well as hydrodynamic efficiency. Our results demonstrate that both thrust and efficiency are predominantly affected by chordwise curvature, with some small additional benefits of spanwise curvature on efficiency. The main improvements in performance are explained by the altered trailing-edge kinematics arising from leading-edge curvature actuation, which can largely be reproduced by a rigid fin whose trailing-edge kinematics follow that of the curving fin. Changes in fin camber, for fixed trailing-edge kinematics, mostly benefit efficiency. Based on our results, we discuss the use of leading-edge curvature actuation as a robust and versatile way to improve flapping fin performance.


title: Attentional-GCNN: Adaptive Pedestrian Trajectory Prediction towards Generic Autonomous Vehicle Use Cases

abstract: Autonomous vehicle navigation in shared pedestrian environments requires the ability to predict future crowd motion both accurately and with minimal delay. Understanding the uncertainty of the prediction is also crucial. Most existing approaches however can only estimate uncertainty through repeated sampling of generative models. Additionally, most current predictive models are trained on datasets that assume complete observability of the crowd using an aerial view. These are generally not representative of real-world usage from a vehicle perspective, and can lead to the underestimation of uncertainty bounds when the on-board sensors are occluded. Inspired by prior work in motion prediction using spatio-temporal graphs, we propose a novel Graph Convolutional Neural Network (GCNN)-based approach, Attentional-GCNN, which aggregates information of implicit interaction between pedestrians in a crowd by assigning attention weight in edges of the graph. Our model can be trained to either output a probabilistic distribution or faster deterministic prediction, demonstrating applicability to autonomous vehicle use cases where either speed or accuracy with uncertainty bounds are required. To further improve the training of predictive models, we propose an automatically labelled pedestrian dataset collected from an intelligent vehicle platform representative of real-world use. Through experiments on a number of datasets, we show our proposed method achieves an improvement over the state of art by 10% Average Displacement Error (ADE) and 12% Final Displacement Error (FDE) with fast inference speeds.


title: Socially Aware Crowd Navigation with Multimodal Pedestrian Trajectory Prediction for Autonomous Vehicles

abstract: Seamlessly operating an autonomous vehicle in a crowded pedestrian environment is a very challenging task. This is because human movement and interactions are very hard to predict in such environments. Recent work has demonstrated that reinforcement learning-based methods have the ability to learn to drive in crowds. However, these methods can have very poor performance due to inaccurate predictions of the pedestrians' future state as human motion prediction has a large variance. To overcome this problem, we propose a new method, SARL-SGAN-KCE, that combines a deep socially aware attentive value network with a human multimodal trajectory prediction model to help identify the optimal driving policy. We also introduce a novel technique to extend the discrete action space with minimal additional computational requirements. The kinematic constraints of the vehicle are also considered to ensure smooth and safe trajectories. We evaluate our method against the state of art methods for crowd navigation and provide an ablation study to show that our method is safer and closer to human behaviour.


title: Non-comoving Cold Dark Matter in a $\Lambda$CDM background

abstract: We examine the evolution of peculiar velocities of cold dark matter (CDM) in localized arrays of inhomogeneous cosmic structures in a $\Lambda$CDM background that can be identified as a frame comoving with the Cosmic Microwave (CMB). These arrays are constructed by smoothly matching to this cosmological background regions of Szekeres-II models whose source is an imperfect fluid reinterpreted as non-comoving dust, keeping only first order terms in $v/c$. Considering a single Szekeres-II region matched along two comoving interfaces to a $\Lambda$CDM background, the magnitudes of peculiar velocities within this region are compatible with values reported in the literature, while the present day Hubble expansion scalar differs from that of the $\Lambda$CDM background value by a 10\% factor, a result that might provide useful information to the ongoing debate on the $H_0$ tension. While the models cannot describe the virialization process, we show through a representative example that structures of galactic cluster mass reach the onset of this process at redshifts around $z\sim 3$.


title: An off-the-grid approach to multi-compartment magnetic resonance fingerprinting

abstract: We propose a novel numerical approach to separate multiple tissue compartments in image voxels and to estimate quantitatively their nuclear magnetic resonance (NMR) properties and mixture fractions, given magnetic resonance fingerprinting (MRF) measurements. The number of tissues, their types or quantitative properties are not a-priori known, but the image is assumed to be composed of sparse compartments with linearly mixed Bloch magnetisation responses within voxels. Fine-grid discretisation of the multi-dimensional NMR properties creates large and highly coherent MRF dictionaries that can challenge scalability and precision of the numerical methods for (discrete) sparse approximation. To overcome these issues, we propose an off-the-grid approach equipped with an extended notion of the sparse group lasso regularisation for sparse approximation using continuous (non-discretised) Bloch response models. Further, the nonlinear and non-analytical Bloch responses are approximated by a neural network, enabling efficient back-propagation of the gradients through the proposed algorithm. Tested on simulated and in-vivo healthy brain MRF data, we demonstrate effectiveness of the proposed scheme compared to the baseline multicompartment MRF methods.


title: V3H: View Variation and View Heredity for Incomplete Multi-view Clustering

abstract: Real data often appear in the form of multiple incomplete views. Incomplete multi-view clustering is an effective method to integrate these incomplete views. Previous methods only learn the consistent information between different views and ignore the unique information of each view, which limits their clustering performance and generalizations. To overcome this limitation, we propose a novel View Variation and View Heredity approach (V3H). Inspired by the variation and the heredity in genetics, V3H first decomposes each subspace into a variation matrix for the corresponding view and a heredity matrix for all the views to represent the unique information and the consistent information respectively. Then, by aligning different views based on their cluster indicator matrices, V3H integrates the unique information from different views to improve the clustering performance. Finally, with the help of the adjustable low-rank representation based on the heredity matrix, V3H recovers the underlying true data structure to reduce the influence of the large incompleteness. More importantly, V3H presents possibly the first work to introduce genetics to clustering algorithms for learning simultaneously the consistent information and the unique information from incomplete multi-view data. Extensive experimental results on fifteen benchmark datasets validate its superiority over other state-of-the-arts.


title: Efficient Fusion of Photonic W-states with Nonunitary Partial-swap Gates

abstract: We introduce a nonunitary partial-swap gate for fusing arbitrary small-sized photonic W-states into a large-scale entangled network of W-state efficiently without ancillary photons. A partial-swap gate is designed in an optical architecture based on linear optics elements. By introducing auxiliary degree of freedom, this gate provides a higher success probability with less cost. Our implementation can create a larger target state with a simpler set-up than previous proposals for W-state fusion. Also all "garbage" states are recyclable, i.e., there is no complete failure output in our scheme in principle.


title: The Weak Galerkin Finite Element Method for the Symmetric Hyperbolic Systems

abstract: In this paper, we present and analyze a weak Galerkin finite element (WG) method for solving the symmetric hyperbolic systems. This method is highly flexible by allowing the use of discontinuous finite elements on element and its boundary independently of each other. By introducing special weak derivative, we construct a stable weak Galerkin scheme and derive the optimal $L_2$-error estimate of $O(h^{k+\frac{1}{2}})$-order for the discrete solution when the $k$-order polynomials are used for $k\geq 0$. As application, we discuss this WG method for solving the singularly perturbed convection-diffusion-reaction equation and derive an $\varepsilon$-uniform error estimate of order $k+1/2$. Numerical examples are provided to show the effectiveness of the proposed WG method.


title: The Emerging Trends of Multi-Label Learning

abstract: Exabytes of data are generated daily by humans, leading to the growing need for new efforts in dealing with the grand challenges for multi-label learning brought by big data. For example, extreme multi-label classification is an active and rapidly growing research area that deals with classification tasks with an extremely large number of classes or labels; utilizing massive data with limited supervision to build a multi-label classification model becomes valuable for practical applications, etc. Besides these, there are tremendous efforts on how to harvest the strong learning capability of deep learning to better capture the label dependencies in multi-label learning, which is the key for deep learning to address real-world classification tasks. However, it is noted that there has been a lack of systemic studies that focus explicitly on analyzing the emerging trends and new challenges of multi-label learning in the era of big data. It is imperative to call for a comprehensive survey to fulfill this mission and delineate future research directions and new applications.


title: Complex-valued Iris Recognition Network

abstract: In this work, we design a fully complex-valued neural network for the task of iris recognition. Unlike the problem of general object recognition, where real-valued neural networks can be used to extract pertinent features, iris recognition depends on the extraction of both phase and magnitude information from the input iris texture in order to better represent its biometric content. This necessitates the extraction and processing of phase information that cannot be effectively handled by a real-valued neural network. In this regard, we design a fully complex-valued neural network that can better capture the multi-scale, multi-resolution, and multi-orientation phase and amplitude features of the iris texture. We show a strong correspondence of the proposed complex-valued iris recognition network with Gabor wavelets that are used to generate the classical IrisCode; however, the proposed method enables a new capability of automatic complex-valued feature learning that is tailored for iris recognition. We conduct experiments on three benchmark datasets - ND-CrossSensor-2013, CASIA-Iris-Thousand and UBIRIS.v2 - and show the benefit of the proposed network for the task of iris recognition. We exploit visualization schemes to convey how the complex-valued network, when compared to standard real-valued networks, extracts fundamentally different features from the iris texture.


title: Balance Regularized Neural Network Models for Causal Effect Estimation

abstract: Estimating individual and average treatment effects from observational data is an important problem in many domains such as healthcare and e-commerce. In this paper, we advocate balance regularization of multi-head neural network architectures. Our work is motivated by representation learning techniques to reduce differences between treated and untreated distributions that potentially arise due to confounding factors. We further regularize the model by encouraging it to predict control outcomes for individuals in the treatment group that are similar to control outcomes in the control group. We empirically study the bias-variance trade-off between different weightings of the regularizers, as well as between inductive and transductive inference.


title: Ranking Neural Checkpoints

abstract: This paper is concerned with ranking many pre-trained deep neural networks (DNNs), called checkpoints, for the transfer learning to a downstream task. Thanks to the broad use of DNNs, we may easily collect hundreds of checkpoints from various sources. Which of them transfers the best to our downstream task of interest? Striving to answer this question thoroughly, we establish a neural checkpoint ranking benchmark (NeuCRaB) and study some intuitive ranking measures. These measures are generic, applying to the checkpoints of different output types without knowing how the checkpoints are pre-trained on which dataset. They also incur low computation cost, making them practically meaningful. Our results suggest that the linear separability of the features extracted by the checkpoints is a strong indicator of transferability. We also arrive at a new ranking measure, NLEEP, which gives rise to the best performance in the experiments.


title: Modular Action Concept Grounding in Semantic Video Prediction

abstract: Recent works in video prediction have mainly focused on passive forecasting and low-level action-conditional prediction, which sidesteps the learning of interaction between agents and objects. We introduce the task of semantic action-conditional video prediction, which uses semantic action labels to describe those interactions and can be regarded as an inverse problem of action recognition. The challenge of this new task primarily lies in how to effectively inform the model of semantic action information. Inspired by the idea of Mixture of Experts, we embody each abstract label by a structured combination of various visual concept learners and propose a novel video prediction model, Modular Action Concept Network (MAC). Our method is evaluated on two newly designed synthetic datasets, CLEVR-Building-Blocks and Sapien-Kitchen, and one real-world dataset called Tower-Creation. Extensive experiments demonstrate that MAC can correctly condition on given instructions and generate corresponding future frames without need of bounding boxes. We further show that the trained model can make out-of-distribution generalization, be quickly adapted to new object categories and exploit its learnt features for object detection, showing the progression towards higher-level cognitive abilities. More visualizations can be found at http://www.pair.toronto.edu/mac/.


title: Effectiveness of MPC-friendly Softmax Replacement

abstract: Softmax is widely used in deep learning to map some representation to a probability distribution. As it is based on exp/log functions that are relatively expensive in multi-party computation, Mohassel and Zhang (2017) proposed a simpler replacement based on ReLU to be used in secure computation. However, we could not reproduce the accuracy they reported for training on MNIST with three fully connected layers. Later works (e.g., Wagh et al., 2019 and 2021) used the softmax replacement not for computing the output probability distribution but for approximating the gradient in back-propagation. In this work, we analyze the two uses of the replacement and compare them to softmax, both in terms of accuracy and cost in multi-party computation. We found that the replacement only provides a significant speed-up for a one-layer network while it always reduces accuracy, sometimes significantly. Thus we conclude that its usefulness is limited and one should use the original softmax function instead.


title: Geometry-Aware Universal Mirror-Prox

abstract: Mirror-prox (MP) is a well-known algorithm to solve variational inequality (VI) problems. VI with a monotone operator covers a large group of settings such as convex minimization, min-max or saddle point problems. To get a convergent algorithm, the step-size of the classic MP algorithm relies heavily on the problem dependent knowledge of the operator such as its smoothness parameter which is hard to estimate. Recently, a universal variant of MP for smooth/bounded operators has been introduced that depends only on the norm of updates in MP. In this work, we relax the dependence to evaluating the norm of updates to Bregman divergence between updates. This relaxation allows us to extends the analysis of universal MP to the settings where the operator is not smooth or bounded. Furthermore, we analyse the VI problem with a stochastic monotone operator in different settings and obtain an optimal rate up to a logarithmic factor.


title: Graph Attention Tracking

abstract: Siamese network based trackers formulate the visual tracking task as a similarity matching problem. Almost all popular Siamese trackers realize the similarity learning via convolutional feature cross-correlation between a target branch and a search branch. However, since the size of target feature region needs to be pre-fixed, these cross-correlation base methods suffer from either reserving much adverse background information or missing a great deal of foreground information. Moreover, the global matching between the target and search region also largely neglects the target structure and part-level information. In this paper, to solve the above issues, we propose a simple target-aware Siamese graph attention network for general object tracking. We propose to establish part-to-part correspondence between the target and the search region with a complete bipartite graph, and apply the graph attention mechanism to propagate target information from the template feature to the search feature. Further, instead of using the pre-fixed region cropping for template-feature-area selection, we investigate a target-aware area selection mechanism to fit the size and aspect ratio variations of different objects. Experiments on challenging benchmarks including GOT-10k, UAV123, OTB-100 and LaSOT demonstrate that the proposed SiamGAT outperforms many state-of-the-art trackers and achieves leading performance. Code is available at: https://git.io/SiamGAT


title: A Geometrically Exact Continuum Framework for Light-Matter Interaction in Photo-Active Polymers I. Variational Setting

abstract: Molecular photo-switches as, e.g., azobenzene molecules allow, when embedded into a polymeric matrix, for photo-active polymer compounds responding mechanically when exposed to light of certain wavelength. Photo-mechanics, i.e. light-matter interaction in photo-active polymers holds great promise for, e.g., remote and contact-free activation of photo-driven actuators. In a series of earlier contributions, Oates et al. developed a successful continuum formulation for the coupled electric, electronic and mechanical problem capturing azobenzene polymer compounds, thereby mainly focussing on geometrically linearized kinematics. Building on that formulation, we here explore the variational setting of a geometrically exact continuum framework based on Dirichlet's and Hamilton's principle as well as, noteworthy, Hamilton's equations. Thereby, when treating the dissipative case, we resort to incremental versions of the various variational problems via suited incorporation of a dissipation potential. In particular, the Hamiltonian setting of geometrically exact photo-mechanics is up to now largely under-explored even for the energetic case, arguably since the corresponding Lagrangian is degenerate in Dirac's sense. Moreover, in general, the Hamiltonian setting of dissipative dynamical systems is a matter of ongoing debate per se. In this contribution, by advocating a novel incremental version of the Hamiltonian setting exemplified for the dissipative case of photo-mechanics, we aim to also unify the variational approach to dissipative dynamical systems. Taken together, the variational setting of a geometrically exact continuum framework of photo-mechanics paves the way for forthcoming theoretical and numerical analyses.


title: On real algebraic links in the 3-sphere associated with mixed polynomials

abstract: In this paper we construct new classes of mixed singularities that provide realizations of real algebraic links in the $3$-sphere. Classifications and characterizations of real algebraic links are still open. These new classes of mixed singularities may help to shed light on the Benedetti-Shiota conjecture, which state that any fibered link on the $3$-sphere is a real algebraic link.


title: Flipped $U(1)$ extended Standard Model and Majorana dark matter

abstract: We propose a general flavor-independent extension of the Standard Model (SM) with the minimal particle content, based on the symmetry $SU(3)_C\times SU(2)_L\times U(1)_{Y'}\times U(1)_X\times Z_2$. In this scenario, the charge operator is identified in terms of the charges of two $U(1)$ gauge symmetries. The light neutrino masses are generated via Type-I seesaw mechanism only with two heavy right-handed neutrinos acquiring their Majorana masses through the $U(1)_{Y'}\times U(1)_X$ symmetry breaking. We study various experimental constraints on the parameters of the model and investigate the phenomenology of the right-handed neutrino dark matter (DM) candidate assigned a $Z_2$-odd parity. We find that the most important constraints are the observed DM relic abundance, the current LHC limits, and the ambiguity of the SM neutral gauge boson mass.


title: Large friction limit of the compressible Navier-Stokes equations with Navier Boundary conditions in general three-dimensional domains

abstract: In this paper, we study the Navier-Stokes equations of compressible, barotropic flow posed in a bounded set in $\mathbb{R}^3$ with different boundary conditions. Specifically, we prove that the local-in-time smooth solution of the Navier-Stokes equations with Navier boundary condition converges to the smooth solution of the Navier-Stokes equations with no-slip boundary condition as the Navier friction coefficient tends to infinity.


title: Affine connections on singular warped products

abstract: In this paper, we introduce semi-symmetric metric Koszul forms and semi-symmetric non-metric Koszul forms on singular semi-Riemannian manifolds. Semi-symmetric metric Koszul forms and semi-symmetric non-metric Koszul forms and their curvature of semi-regular warped products are expressed in terms of those of the factor manifolds. We also introduce Koszul forms associated to the almost product structure on singular almost product semi-Riemannian manifolds. Koszul forms associated to the almost product structure and their curvature of semi-regular almost product warped products are expressed in terms of those of the factor manifolds. Furthermore, we generalize the results in \cite{St2} to singular multiply warped products.


title: Structure-Aware Completion of Photogrammetric Meshes in Urban Road Environment

abstract: Photogrammetric mesh models obtained from aerial oblique images have been widely used for urban reconstruction. However, the photogrammetric meshes also suffer from severe texture problems, especially on the road areas due to occlusion. This paper proposes a structure-aware completion approach to improve the quality of meshes by removing undesired vehicles on the road seamlessly. Specifically, the discontinuous texture atlas is first integrated to a continuous screen space through rendering by the graphics pipeline; the rendering also records necessary mapping for deintegration to the original texture atlas after editing. Vehicle regions are masked by a standard object detection approach, e.g. Faster RCNN. Then, the masked regions are completed guided by the linear structures and regularities in the road region, which is implemented based on Patch Match. Finally, the completed rendered image is deintegrated to the original texture atlas and the triangles for the vehicles are also flattened for improved meshes. Experimental evaluations and analyses are conducted against three datasets, which are captured with different sensors and ground sample distances. The results reveal that the proposed method can quite realistic meshes after removing the vehicles. The structure-aware completion approach for road regions outperforms popular image completion methods and ablation study further confirms the effectiveness of the linear guidance. It should be noted that the proposed method is also capable to handle tiled mesh models for large-scale scenes. Dataset and code are available at vrlab.org.cn/~hanhu/projects/mesh.


title: Risk-Sensitive Motion Planning using Entropic Value-at-Risk

abstract: We consider the problem of risk-sensitive motion planning in the presence of randomly moving obstacles. To this end, we adopt a model predictive control (MPC) scheme and pose the obstacle avoidance constraint in the MPC problem as a distributionally robust constraint with a KL divergence ambiguity set. This constraint is the dual representation of the Entropic Value-at-Risk (EVaR). Building upon this viewpoint, we propose an algorithm to follow waypoints and discuss its feasibility and completion in finite time. We compare the policies obtained using EVaR with those obtained using another common coherent risk measure, Conditional Value-at-Risk (CVaR), via numerical experiments for a 2D system. We also implement the waypoint following algorithm on a 3D quadcopter simulation.


title: On The Round Complexity of Secure Quantum Computation

abstract: We construct the first constant-round protocols for secure quantum computation in the two-party (2PQC) and multi-party (MPQC) settings with security against malicious adversaries. Our protocols are in the common random string (CRS) model. - Assuming two-message oblivious transfer (OT), we obtain (i) three-message 2PQC, and (ii) five-round MPQC with only three rounds of online (input-dependent) communication; such OT is known from quantum-hard Learning with Errors (QLWE). - Assuming sub-exponential hardness of QLWE, we obtain (i) three-round 2PQC with two online rounds and (ii) four-round MPQC with two online rounds. - When only one (out of two) parties receives output, we achieve minimal interaction (two messages) from two-message OT; classically, such protocols are known as non-interactive secure computation (NISC), and our result constitutes the first maliciously-secure quantum NISC. Additionally assuming reusable malicious designated-verifier NIZK arguments for NP (MDV-NIZKs), we give the first MDV-NIZK for QMA that only requires one copy of the quantum witness. Finally, we perform a preliminary investigation into two-round secure quantum computation where each party must obtain output. On the negative side, we identify a broad class of simulation strategies that suffice for classical two-round secure computation that are unlikely to work in the quantum setting. Next, as a proof-of-concept, we show that two-round secure quantum computation exists with respect to a quantum oracle.


title: Polynomial mixing for time-changes of unipotent flows

abstract: Let $G$ be a connected semisimple Lie group with finite centre, and let $M= \Gamma \backslash G$ be a compact homogeneous manifold. Under a spectral gap assumption, we show that smooth time-changes of any unipotent flow on $M$ have polynomial decay of correlations. Our result applies also in the case where $M$ is a finite volume, non-compact quotient under some additional assumptions on the generator of the time-change. This generalizes a result by Forni and Ulcigrai (JMD, 2012) for smooth time-changes of horocycle flows on compact surfaces.


title: Learning the ground state of a non-stoquastic quantum Hamiltonian in a rugged neural network landscape

abstract: Strongly interacting quantum systems described by non-stoquastic Hamiltonians exhibit rich low-temperature physics. Yet, their study poses a formidable challenge, even for state-of-the-art numerical techniques. Here, we investigate systematically the performance of a class of universal variational wave-functions based on artificial neural networks, by considering the frustrated spin-$1/2$ $J_1-J_2$ Heisenberg model on the square lattice. Focusing on neural network architectures without physics-informed input, we argue in favor of using an ansatz consisting of two decoupled real-valued networks, one for the amplitude and the other for the phase of the variational wavefunction. By introducing concrete mitigation strategies against inherent numerical instabilities in the stochastic reconfiguration algorithm we obtain a variational energy comparable to that reported recently with neural networks that incorporate knowledge about the physical system. Through a detailed analysis of the individual components of the algorithm, we conclude that the rugged nature of the energy landscape constitutes the major obstacle in finding a satisfactory approximation to the ground state wavefunction, and prevents learning the correct sign structure. In particular, we show that in the present setup the neural network expressivity and Monte Carlo sampling are not primary limiting factors.

categories: physics.comp-ph cond-mat.quant-gas cond-mat.str-el quant-ph


title: Unitary groups and augmented Cuntz semigroups of separable simple Z-stable C*-algebras

abstract: Let $A$ be a separable simple exact ${\cal Z}$-stable $C^*$-algebra. We show that the unitay group of ${\tilde A}$ has the cancellation property. If $A$ has continuous scale, the Cuntz semigroup of $\tilde A$ has the strict comparison property and a weak cancellation property. Let $C$ be a 1-dimensional non-commutative CW complex with $K_1(C)=\{0\}.$ Suppose that $\lambda: {\rm Cu}^\sim(C)\to {\rm Cu}^\sim(A)$ is a morphism in Cuntz semigroups which is strictly positive. Then there exists a sequence of homomorphisms $\phi_n: C\to A$ such that $\lim_{n\to\infty}{\rm Cu}^\sim(\phi_n)=\lambda.$ This result leads to the proof that every separable amenable simple $C^*$-algebra in the UCT class has rationally generalized tracial rank at most one.


title: Collective Excitations and Optical Response of Ultrathin Carbon Nanotube Films

abstract: We present a theoretical study of the collective quasiparticle excitations responsible for the electromagnetic response of ultrathin plane-parallel homogeneous periodic single-wall carbon nanotube arrays and weakly inhomogeneous single-wall carbon nanotube films. We show that in addition to varying film composition, the collective response can be controlled by varying the film thickness. For single-type nanotube arrays, the real part of the dielectric response shows a broad negative refraction band near a quantum interband transition of the constituent nanotube, whereby the system behaves as a hyperbolic metamaterial at higher frequencies than those classical plasma oscillations have to offer. By decreasing nanotube diameters it is possible to push this negative refraction into the visible region, and using weakly inhomogeneous multi-type nanotube films broadens its bandwidth.


title: Inertial and gravitational effects on a geonium atom

abstract: We reveal all linear order inertial and gravitational effects on a non-relativistic Dirac particle (mass $m$) on the Earth up to the order of $1/m$ in the Foldy-Wouthuysen-like expansion. Applying the result to Penning trap experiments where a Dirac particle experiences the cyclotron motion and the spin precession in a cavity, i.e., a geonium atom, we study modifications to the $g$-factor of such as the electron. It is shown that each correction from gravity has different dependence on the cyclotron frequency and the mass $m$. Therefore, their magnitude change depending on situations. In a particular case of an electron $g$-factor measurement, the dominant correction to the observed $g$-factor comes from effects of the Earth's rotation, which is $\delta g / 2 \simeq 5.2 \times 10^{-17}$. It may be detectable in the near future.


title: Adhesive Shear Strength of Ice from Nanostructured Graphite Surfaces by Molecular Dynamics Simulations

abstract: The issue of ice accumulation at low-temperature circumstances causes multiple problems and serious damages in many civil infrastructures which substantially influence human daily life. However, despite the significant consideration in manufacturing anti-icing or icephobic surfaces, it is still demanding to design surfaces with well ice-repellent properties. Here in this study, we used all-atom molecular dynamics (MD) simulations to investigate ice shearing mechanism on atomistically smooth and nanotexture graphite substrates. We find that ice shearing strength strongly depends on ice temperature, the lattice structure of the surface substrate, the size of the surface nanotexture structure, and the depth of interdigitated water molecules. Our results indicate nanoscale surface roughness and depth of interdigitated water molecules tend to increase ice shear failure stress and for corrugated substrates, this is further raised with increasing the depth of interdigitated water molecules which is a result of strain being distributed well into the ice cube away from the interface. These results supply an in-depth understanding of the effect of surface nanotexture on ice shearing mechanism that provides useful information in designing anti-icing surfaces and provide for the first-time theoretical references in understanding the effect of surface nanotexture structure and depth of interlocked water on adhesive ice shear strength on nanotextured surfaces. Keywords: Ice, Graphene, Shear strength, Molecular dynamics simulation


title: The dually flat structure for singular models

abstract: The dually flat structure introduced by Amari-Nagaoka is highlighted in information geometry and related fields. In practical applications, however, the underlying pseudo-Riemannian metric may often be degenerate, and such an excellent geometric structure is rarely defined on the entire space. To fix this trouble, in the present paper, we propose a novel generalization of the dually flat structure for a certain class of singular models from the viewpoint of Lagrange and Legendre singularity theory - we introduce a quasi-Hessian manifold endowed with a possibly degenerate metric and a particular symmetric cubic tensor, which exceeds the concept of statistical manifolds and is adapted to the theory of (weak) contrast functions. In particular, we establish Amari-Nagaoka's extended Pythagorean theorem and projection theorem in this general setup, and consequently, most of applications of these theorems are suitably justified even for such singular cases. This work is motivated by various interests with different backgrounds from Frobenius structure in mathematical physics to Deep Learning in data science.


title: Elliptic zastava

abstract: We study the elliptic zastava spaces, their versions (twisted, Coulomb, Mirkovic local spaces, reduced) and relations with monowalls moduli spaces and Feigin-Odesskii moduli spaces of $G$-bundles with parabolic structure on an elliptic curve.


title: Adversarial Refinement Network for Human Motion Prediction

abstract: Human motion prediction aims to predict future 3D skeletal sequences by giving a limited human motion as inputs. Two popular methods, recurrent neural networks and feed-forward deep networks, are able to predict rough motion trend, but motion details such as limb movement may be lost. To predict more accurate future human motion, we propose an Adversarial Refinement Network (ARNet) following a simple yet effective coarse-to-fine mechanism with novel adversarial error augmentation. Specifically, we take both the historical motion sequences and coarse prediction as input of our cascaded refinement network to predict refined human motion and strengthen the refinement network with adversarial error augmentation. During training, we deliberately introduce the error distribution by learning through the adversarial mechanism among different subjects. In testing, our cascaded refinement network alleviates the prediction error from the coarse predictor resulting in a finer prediction robustly. This adversarial error augmentation provides rich error cases as input to our refinement network, leading to better generalization performance on the testing dataset. We conduct extensive experiments on three standard benchmark datasets and show that our proposed ARNet outperforms other state-of-the-art methods, especially on challenging aperiodic actions in both short-term and long-term predictions.


title: Improved Confidence Bounds for the Linear Logistic Model and Applications to Linear Bandits

abstract: We propose improved fixed-design confidence bounds for the linear logistic model. Our bounds significantly improve upon the state-of-the-art bound by Li et al. (2017) via recent developments of the self-concordant analysis of the logistic loss (Faury et al., 2020). Specifically, our confidence bound avoids a direct dependence on $1/\kappa$, where $\kappa$ is the minimal variance over all arms' reward distributions. In general, $1/\kappa$ scales exponentially with the norm of the unknown linear parameter $\theta^*$. Instead of relying on this worst-case quantity, our confidence bound for the reward of any given arm depends directly on the variance of that arm's reward distribution. We present two applications of our novel bounds to pure exploration and regret minimization logistic bandits improving upon state-of-the-art performance guarantees. For pure exploration, we also provide a lower bound highlighting a dependence on $1/\kappa$ for a family of instances.


title: Distributed algorithms to determine eigenvectors of matrices on spatially distributed networks

abstract: Eigenvectors of matrices on a network have been used for understanding spectral clustering and influence of a vertex. For matrices with small geodesic-width, we propose a distributed iterative algorithm in this letter to find eigenvectors associated with their given eigenvalues. We also consider the implementation of the proposed algorithm at the vertex/agent level in a spatially distributed network.


title: Laser-induced anti-Stokes fluorescence cooling of ytterbium-doped silica glass by more than 6 Kelvin

abstract: Laser cooling of a solid is achieved when a coherent laser illuminates the material, and the heat is extracted by resulting anti-Stokes fluorescence. Over the past year, net solid-state laser cooling was successfully demonstrated for the first time in Yb-doped silica glass in both bulk samples and fibers. Here, we improve the previously published results by one order of magnitude and report more than 6K of cooling below the ambient temperature. This result is the lowest temperature achieved in solid-state laser cooling of silica glass to date to the best of our knowledge. We present details on the experiment performed using a 20W laser operating at 1035nm wavelength and temperature measurements using both a thermal camera and the differential luminescence thermometry technique.


title: Proof of the Kakeya set conjecture over rings of integers modulo square-free $N$

abstract: A Kakeya set $S \subset (\mathbb{Z}/N\mathbb{Z})^n$ is a set containing a line in each direction. We show that, when $N$ is any square-free integer, the size of the smallest Kakeya set in $(\mathbb{Z}/N\mathbb{Z})^n$ is at least $C_{n,\epsilon} N^{n - \epsilon}$ for any $\epsilon$ -- resolving a special case of a conjecture of Hickman and Wright. Previously, such bounds were only known for the case of prime $N$. We also show that the case of general $N$ can be reduced to lower bounding the $\mathbb{F}_p$ rank of the incidence matrix of points and hyperplanes over $(\mathbb{Z}/p^k\mathbb{Z})^n$.


title: Detection and Classification of mental illnesses on social media using RoBERTa

abstract: Given the current social distancing regulations across the world, social media has become the primary mode of communication for most people. This has resulted in the isolation of many people suffering from mental illnesses who are unable to receive assistance in person. They have increasingly turned to social media to express themselves and to look for guidance in dealing with their illnesses. Keeping this in mind, we propose a solution to detect and classify mental illness posts on social media thereby enabling users to seek appropriate help. In this work, we detect and classify five prominent kinds of mental illnesses: depression, anxiety, bipolar disorder, ADHD and PTSD by analyzing unstructured user data on social media platforms. In addition, we are sharing a new high-quality dataset to drive research on this topic. We believe that our work is the first multi-class model that uses a Transformer-based architecture such as RoBERTa to analyze people's emotions and psychology. We also demonstrate how we stress-test our model using behavioral testing. With this research, we hope to be able to contribute to the public health system by automating some of the detection and classification process.


title: Substructures in the core of Abell 2319

abstract: We analysed the deep archival Chandra observations of the high-temperature galaxy cluster Abell 2319 to investigate the prominent cold front in its core. The main sharp arc of the front shows wiggles, or variations of the radius of the density jump along the arc. At the southern end of the arc is a feature that resembles a Kelvin-Helmholtz (KH) eddy, beyond which the sharp front dissolves. These features suggest that KH instabilities develop at the front. Under this assumption, we can place an upper limit on the ICM viscosity that is several times below the isotropic Spitzer value. Other features include a split of the cold front at its northern edge, which may be another KH eddy. There is a small pocket of hot, less-dense gas inside the cold front, which may indicate a `hole' in the front's magnetic insulation layer that lets the heat from the outer gas to penetrate inside the front. Finally, a large concave brightness feature southwest of the cluster core can be caused by the gasdynamic instabilities. We speculate that it can also be an inner boundary of a giant AGN bubble, similar to that in Ophiuchus. If the latter interpretation is supported by better radio data, this could be a remnant of another extremely powerful AGN outburst.


title: Modeling Functional Similarity in Source Code with Graph-Based Siamese Networks

abstract: Code clones are duplicate code fragments that share (nearly) similar syntax or semantics. Code clone detection plays an important role in software maintenance, code refactoring, and reuse. A substantial amount of research has been conducted in the past to detect clones. A majority of these approaches use lexical and syntactic information to detect clones. However, only a few of them target semantic clones. Recently, motivated by the success of deep learning models in other fields, including natural language processing and computer vision, researchers have attempted to adopt deep learning techniques to detect code clones. These approaches use lexical information (tokens) and(or) syntactic structures like abstract syntax trees (ASTs) to detect code clones. However, they do not make sufficient use of the available structural and semantic information hence, limiting their capabilities. This paper addresses the problem of semantic code clone detection using program dependency graphs and geometric neural networks, leveraging the structured syntactic and semantic information. We have developed a prototype tool HOLMES, based on our novel approach, and empirically evaluated it on popular code clone benchmarks. Our results show that HOLMES performs considerably better than the other state-of-the-art tool, TBCCD. We also evaluated HOLMES on unseen projects and performed cross dataset experiments to assess the generalizability of HOLMES. Our results affirm that HOLMES outperforms TBCCD since most of the pairs that HOLMES detected were either undetected or suboptimally reported by TBCCD.


title: On Evolution of Coherent States as Quantum Counterpart of Classical Dynamics

abstract: Quantum dynamics of coherent states is studied within quantum field theory using two complementary methods: by organizing the evolution as a Taylor series in elapsed time and by perturbative expansion in coupling within the interaction-picture formalism. One of the important aspects of our analysis consists in utilizing the operators and the vacuum of interacting theory in constructing the states, without invoking asymptotic particles. Focusing on a coherent state describing a spatially homogeneous field configuration, it is demonstrated that both adopted methods successfully account for nonlinear classical dynamics, giving distinguishable quantum effects. In particular, according to the time-expansion analysis the initial field-acceleration, with which the field departs from its initial expectation value, is governed by the tree-level potential with renormalized mass and bare coupling constant. The interaction-picture computation, instead, can be manipulated to give the nonlinear dynamics, determined in terms of renormalized coupling and mass. However, it results in a logarithmic initial-time singularity in the field-acceleration, reminiscent of the similar behaviour encountered within semi-classical formalism, for certain choices of the initial state for fluctuations. Within our coherent-state analysis, the above mentioned peculiarities are artefacts of an expansion: in the first case over infinitesimal time, while in the second case in the coupling constant. Despite this, we show that the evolution obtained within the interaction-picture analysis is valid for extended period of time. Moreover, on top of the desired classical dynamics, it serves us with interesting quantum corrections, previously proposed by Dvali-Gomez-Zell.


title: Magnetic Skyrmions for Unconventional Computing

abstract: Improvements in computing performance have significantly slowed down over the past few years owing to the intrinsic limitations of computing hardware. However, the demand for data computing has increased exponentially. To solve this problem, tremendous attention has been focused on the continuous scaling of Moore's Law as well as the advanced non-von Neumann computing architecture. A rich variety of unconventional computing paradigms has been raised with the rapid development of nanoscale devices. Magnetic skyrmions, spin swirling quasiparticles, have been endowed with great expectations for unconventional computing due to their potential as the smallest information carriers by exploiting their physics and dynamics. In this paper, we provide an overview of the recent progress of skyrmion-based unconventional computing from a joint device-application perspective. This paper aims to build up a panoramic picture, analyze the remaining challenges, and most importantly to shed light on the outlook of skyrmion based unconventional computing for interdisciplinary researchers.


title: Reinforcement Learning-based Disturbance Rejection Control for Uncertain Nonlinear Systems

abstract: This paper investigates the reinforcement learning (RL) based disturbance rejection control for uncertain nonlinear systems having non-simple nominal models. An extended state observer (ESO) is first designed to estimate the system state and the total uncertainty, which represents the perturbation to the nominal system dynamics. Based on the output of the observer, the control compensates for the total uncertainty in real time, and simultaneously, online approximates the optimal policy for the compensated system using a simulation of experience based RL technique. Rigorous theoretical analysis is given to show the practical convergence of the system state to the origin and the developed policy to the ideal optimal policy. It is worth mentioning that, the widely-used restrictive persistence of excitation (PE) condition is not required in the established framework. Simulation results are presented to illustrate the effectiveness of the proposed method.


title: NeuralAnnot: Neural Annotator for 3D Human Mesh Training Sets

abstract: Most 3D human mesh regressors are fully supervised with 3D pseudo-GT human model parameters and weakly supervised with GT 2D/3D joint coordinates as the 3D pseudo-GTs bring great performance gain. The 3D pseudo-GTs are obtained by annotators, systems that iteratively fit 3D human model parameters to GT 2D/3D joint coordinates of training sets in the pre-processing stage of the regressors. The fitted 3D parameters at the last fitting iteration become the 3D pseudo-GTs, used to fully supervise the regressors. Optimization-based annotators, such as SMPLify-X, have been widely used to obtain the 3D pseudo-GTs. However, they often produce wrong 3D pseudo-GTs as they fit the 3D parameters to GT of each sample independently. To overcome the limitation, we present NeuralAnnot, a neural network-based annotator. The main idea of NeuralAnnot is to employ a neural network-based regressor and dedicate it for the annotation. Assuming no 3D pseudo-GTs are available, NeuralAnnot is weakly supervised with GT 2D/3D joint coordinates of training sets. The testing results on the same training sets become 3D pseudo-GTs, used to fully supervise the regressors. We show that 3D pseudo-GTs of NeuralAnnot are highly beneficial to train the regressors. We made our 3D pseudo-GTs publicly available.


title: ROME: Robustifying Memory-Efficient NAS via Topology Disentanglement and Gradient Accumulation

abstract: Albeit being a prevalent architecture searching approach, differentiable architecture search (DARTS) is largely hindered by its substantial memory cost since the entire supernet resides in the memory. This is where the single-path DARTS comes in, which only chooses a single-path submodel at each step. While being memory-friendly, it also comes with low computational costs. Nonetheless, we discover a critical issue of single-path DARTS that has not been primarily noticed. Namely, it also suffers from severe performance collapse since too many parameter-free operations like skip connections are derived, just like DARTS does. In this paper, we propose a new algorithm called RObustifying Memory-Efficient NAS (ROME) to give a cure. First, we disentangle the topology search from the operation search to make searching and evaluation consistent. We then adopt Gumbel-Top2 reparameterization and gradient accumulation to robustify the unwieldy bi-level optimization. We verify ROME extensively across 15 benchmarks to demonstrate its effectiveness and robustness.


title: Towards an $\mathfrak{sl}_2$ action on the annular Khovanov spectrum

abstract: Given a link in the thickened annulus, its annular Khovanov homology carries an action of the Lie algebra $\mathfrak{sl}_2$, which is natural with respect to annular link cobordisms. We consider the problem of lifting this action to the stable homotopy refinement of the annular homology. As part of this program, the actions of the standard generators of $\mathfrak{sl}_2$ are lifted to maps of spectra. In particular, it follows that the $\mathfrak{sl}_2$ action on homology commutes with the action of the Steenrod algebra. The main new technical ingredients developed in this paper, which may be of independent interest, concern certain types of cancellations in the cube of resolutions and the resulting more intricate structure of the moduli spaces in the framed flow category.


title: An Empirical Study of Representation Learning for Reinforcement Learning in Healthcare

abstract: Reinforcement Learning (RL) has recently been applied to sequential estimation and prediction problems identifying and developing hypothetical treatment strategies for septic patients, with a particular focus on offline learning with observational data. In practice, successful RL relies on informative latent states derived from sequential observations to develop optimal treatment strategies. To date, how best to construct such states in a healthcare setting is an open question. In this paper, we perform an empirical study of several information encoding architectures using data from septic patients in the MIMIC-III dataset to form representations of a patient state. We evaluate the impact of representation dimension, correlations with established acuity scores, and the treatment policies derived from them. We find that sequentially formed state representations facilitate effective policy learning in batch settings, validating a more thoughtful approach to representation learning that remains faithful to the sequential and partial nature of healthcare data.


title: Learning Hidden Markov Models from Aggregate Observations

abstract: In this paper, we propose an algorithm for estimating the parameters of a time-homogeneous hidden Markov model from aggregate observations. This problem arises when only the population level counts of the number of individuals at each time step are available, from which one seeks to learn the individual hidden Markov model. Our algorithm is built upon expectation-maximization and the recently proposed aggregate inference algorithm, the Sinkhorn belief propagation. As compared with existing methods such as expectation-maximization with non-linear belief propagation, our algorithm exhibits convergence guarantees. Moreover, our learning framework naturally reduces to the standard Baum-Welch learning algorithm when observations corresponding to a single individual are recorded. We further extend our learning algorithm to handle HMMs with continuous observations. The efficacy of our algorithm is demonstrated on a variety of datasets.


title: Quantum Kinetic Equilibrium

abstract: We solved the Quantum Kinetic Equations (QKEs) for an active-sterile neutrino system in the early universe. While on the surface this may seem to be an overly simplistic system, other linear two-state systems can be mapped onto the active-sterile system. In the early universe, we find that solutions to the QKEs are well described by an adiabatic approximation where the off-diagonal terms of the density operator are constant on short (oscillation and/or scattering) timescales, but may slowly evolve on long (expansion) timescales. This "quantum kinetic equilibrium" attains as the quantum development of phase balances with the kinetic destruction of phase. In this work, we introduce and assess this equilibrium ansatz as the neutrino states evolve in the early universe with a non-zero lepton number, engendering level crossings that result in scattering-induced active-sterile neutrino transformation.


title: A Data-Driven and Integrated Evaluation of Area-wide Impacts of Double Parking Using Macroscopic and Microscopic Models

abstract: Double parking that often negatively affects traffic operations and safety is not a new phenomenon on urban streets. This study proposes a novel data-driven integrated framework for estimating the actual frequency of double parking so that both microscopic and macroscopic models can be utilized to quantify area-wide impacts in the presence of double parking. The findings of the study can provide transportation agencies with useful insights on identifying locations that will experience the greatest benefits by removing problematic double parking. As a result, various parking enforcement and management strategies can be planned more effectively.


title: Amplified endomorphisms of Fano fourfolds

abstract: Let $X$ be a smooth Fano fourfold admitting a conic bundle structure. We show that $X$ is toric if and only if $X$ admits an amplified endomorphism; in this case, $X$ is a rational variety.


title: The Grassmannian-like Coset Model and the Higher Spin Currents

abstract: In the Grassmannian-like coset model, $\frac{SU(N+M)_k}{SU(N)_k \times U(1)_{k N M (N+M)}}$, Creutzig and Hikida have found the charged spin-$2,3$ currents and the neutral spin-$2,3$ currents previously. In this paper, as an extension of Gaberdiel-Gopakumar conjecture found ten years ago, we calculate the operator product expansion (OPE) between the charged spin-$2$ current and itself, the OPE between the charged spin-$2$ current and the charged spin-$3$ current and the OPE between the neutral spin-$3$ current and itself for generic $N, M$ and $k$. From the second OPE, we obtain the new charged quasi primary spin-$4$ current while from the last one, the new neutral primary spin-$4$ current is found implicitly. The infinity limit of $k$ in the structure constants of the OPEs is described in the context of asymptotic symmetry of $M \times M$ matrix generalization of $AdS_3$ higher spin theory. Moreover, the OPE between the charged spin-$3$ current and itself is determined for fixed $(N,M)=(5,4)$ with arbitrary $k$ up to the third order pole. We also obtain the OPEs between charged spin-$1,2,3$ currents and neutral spin-$3$ current. From the last OPE, we realize that there exists the presence of the above charged quasi primary spin-$4$ current in the second order pole for fixed $(N,M)=(5,4)$. We comment on the complex free fermion realization.


title: Data-driven Holistic Framework for Automated Laparoscope Optimal View Control with Learning-based Depth Perception

abstract: Laparoscopic Field of View (FOV) control is one of the most fundamental and important components in Minimally Invasive Surgery (MIS), nevertheless, the traditional manual holding paradigm may easily bring fatigue to surgical assistants, and misunderstanding between surgeons also hinders assistants to provide a high-quality FOV. Targeting this problem, we here present a data-driven framework to realize an automated laparoscopic optimal FOV control. To achieve this goal, we offline learn a motion strategy of laparoscope relative to the surgeon's hand-held surgical tool from our in-house surgical videos, developing our control domain knowledge and an optimal view generator. To adjust the laparoscope online, we first adopt a learning-based method to segment the two-dimensional (2D) position of the surgical tool, and further leverage this outcome to obtain its scale-aware depth from dense depth estimation results calculated by our novel unsupervised RoboDepth model only with the monocular camera feedback, hence in return fusing the above real-time 3D position into our control loop. To eliminate the misorientation of FOV caused by Remote Center of Motion (RCM) constraints when moving the laparoscope, we propose a novel distortion constraint using an affine map to minimize the visual warping problem, and a null-space controller is also embedded into the framework to optimize all types of errors in a unified and decoupled manner. Experiments are conducted using Universal Robot (UR) and Karl Storz Laparoscope/Instruments, which prove the feasibility of our domain knowledge and learning enabled framework for automated camera control.


title: Unsupervised domain adaptation based COVID-19 CT infection segmentation network

abstract: Automatic segmentation of infection areas in computed tomography (CT) images has proven to be an effective diagnosis approach for COVID-19. However, due to the limited number of pixel-level annotated medical images, accurate segmentation remains a major challenge. In this paper, we propose an unsupervised domain adaptation based segmentation network to improve the segmentation performance of the infection areas in COVID-19 CT images. In particular, we propose to utilize the synthetic data and limited unlabeled real COVID-19 CT images to jointly train the segmentation network. Furthermore, we develop a novel domain adaptation module, which is used to align the two domains and effectively improve segmentation network's generalization capability to the real domain. Besides, we propose an unsupervised adversarial training scheme, which encourages the segmentation network to learn the domain-invariant feature, so that the robust feature can be used for segmentation. Experimental results demonstrate that our method can achieve state-of-the-art segmentation performance on COVID-19 CT images.


title: Global Weak Solutions to the Navier-Stokes-Darcy-Boussinesq System for Thermal Convection in Coupled Free and Porous Media Flows

abstract: We study the Navier-Stokes-Darcy-Boussinesq system that models the thermal convection of a fluid overlying a saturated porous medium in a general decomposed domain. In both two and three spatial dimensions, we first prove the existence of global weak solutions to the initial boundary value problem subject to the Lions and Beavers-Joseph-Saffman-Jones interface conditions. The proof is based on a proper time-implicit discretization scheme combined with the Leray-Schauder principle and compactness arguments. Next, we establish a weak-strong uniqueness result such that a weak solution coincides with a strong solution emanating from the same initial data as long as the latter exists.


title: Percolative Charge Transport In Binary Nanocrystal Solids

abstract: We simulated electron transport across a binary nanocrystal solid (BNS) of PbSe NCs with diameters of 6.5nm and 5.1nm. We used our Hierarchical Nanoparticle Transport Simulator HINTS to model the transport in these BNSs. The mobility exhibits a minimum at a Large-NC-fraction f_LNC=0.25. The mobility minimum is deep at T=80K and partially smoothed at T=300K. We explain this minimum as follows. As the LNC fraction f_LNC starts growing from zero, the few LNCs act as traps for the electrons traversing the BNS because their relevant energy level is lower. Therefore, increasing the f_LNC concentration of these traps decreases the mobility. As increasing f_LNC reaches the percolation threshold f_LNC=f_p, the LNCs form sample-spanning networks that enable electrons to traverse the entire BNS via these percolating LNC networks. Transport through the growing percolating LNC networks drives the rapid growth of the mobility as f_LNC grows past f_p. Therefore, the electron mobility exhibits a pronounced minimum as a function of f_LNC, centered at f_LNC=f_p. The position of the mobility minimum shifts to larger LNC fractions as the electron density increases. We have studied the trends of this mobility minimum with temperature, electron density, charging energy, ligand length, and disorder. We account for the trends by a "renormalized trap model", in which capturing an electron renormalizes a deep LNC trap into a shallow trap or a kinetic obstacle, depending on the charging energy. We verified this physical picture by constructing and analyzing heat maps of the mobile electrons in the BNS.


title: BiOpt: Bi-Level Optimization for Few-Shot Segmentation

abstract: Few-shot segmentation is a challenging task that aims to segment objects of new classes given scarce support images. In the inductive setting, existing prototype-based methods focus on extracting prototypes from the support images; however, they fail to utilize semantic information of the query images. In this paper, we propose Bi-level Optimization (BiOpt), which succeeds to compute class prototypes from the query images under inductive setting. The learning procedure of BiOpt is decomposed into two nested loops: inner and outer loop. On each task, the inner loop aims to learn optimized prototypes from the query images. An init step is conducted to fully exploit knowledge from both support and query features, so as to give reasonable initialized prototypes into the inner loop. The outer loop aims to learn a discriminative embedding space across different tasks. Extensive experiments on two benchmarks verify the superiority of our proposed BiOpt algorithm. In particular, we consistently achieve the state-of-the-art performance on 5-shot PASCAL-$5^i$ and 1-shot COCO-$20^i$.


title: RVCoreP-32IC: A high-performance RISC-V soft processor with an efficient fetch unit supporting the compressed instructions

abstract: In this paper, we propose a high-performance RISC-V soft processor with an efficient fetch unit supporting the compressed instructions targeting on FPGA. The compressed instruction extension in RISC-V can reduce the program size by about 25%. But it needs a complicated logic for the instruction fetch unit and has a significant impact on performance. We propose an instruction fetch unit that supports the compressed instructions while exhibiting high performance. Furthermore, we propose a RISC-V soft processor using this unit. We implement this proposed processor in Verilog HDL and verify the behavior using Verilog simulation and an actual Xilinx Atrix-7 FPGA board. We compare the results of some benchmarks and the amount of hardware with related works. DMIPS, CoreMark value, and Embench value of the proposed processor achieved 42.5%, 41.1% and 21.3% higher performance than the related work, respectively.


title: Restricted Airspace Protection using Multi-UAV Spatio-TemporalMulti-Task Allocation

abstract: This paper addresses the problem of restricted airspace protection from invaders using the cooperative multi-UAV system. The objective is to detect and capture the invaders cooperatively by a team of homogeneous UAVs (called evaders)before invaders enter the restricted airspace. The problem of restricted airspace protection problem is formulated as a Multi-UAV Spatio-Temporal Multi-Task Allocation problem and is referred as MUST-MTA. The MUST-MTA problem is solved using a modified consensus-based bundled auction method. Here, the spatial and time constraints are handled by combining both spatial and temporal loss component. The solution identifies the sequence of spatial locations to be reached by the evader at specific time instants to neutralize the invaders. The performance of MUST-MTA with the consensus approach is evaluated in a simulated environment. The Monte-Carlo simulation results clearly indicate the efficacy of the proposed approach in restricted airspace protection against intruders


title: Asymptotics of the Empirical Bootstrap Method Beyond Asymptotic Normality

abstract: One of the most commonly used methods for forming confidence intervals for statistical inference is the empirical bootstrap, which is especially expedient when the limiting distribution of the estimator is unknown. However, despite its ubiquitous role, its theoretical properties are still not well understood for non-asymptotically normal estimators. In this paper, under stability conditions, we establish the limiting distribution of the empirical bootstrap estimator, derive tight conditions for it to be asymptotically consistent, and quantify the speed of convergence. Moreover, we propose three alternative ways to use the bootstrap method to build confidence intervals with coverage guarantees. Finally, we illustrate the generality and tightness of our results by a series of examples, including uniform confidence bands, two-sample kernel tests, minmax stochastic programs and the empirical risk of stacked estimators.


title: From period to quasi-period to chaos: A continuous spectrum of orbits of charged particles trapped in a dipole magnetic field

abstract: Via evaluation of the Lyapunov exponent, we report the discovery of three prominent sets of phase space regimes of quasi-periodic orbits of charged particles trapped in a dipole magnetic field. Besides the low energy regime that has been studied extensively and covers more than 10% in each dimension of the phase space of trapped orbits, there are two sets of high energy regimes, the largest of which covers more than 4% in each dimension of the phase space of trapped orbits. Particles in these high energy orbits may be observed in space and be realized in plasma experiments on the Earth. It is well-known that there are quasi-periodic orbits around stable periodic orbits in Hamiltonian systems with 2 degrees of freedom and these quasi-periodic orbits are stable as well. Since periodic orbits appear to have a negligible measure in the phase space, they are difficult to realize in nature. Quasi-periodic orbits, on the other hand, may occupy a finite volume in the 4 dimensional (4D) phase space and be readily detectable. A chaotic orbit has at least one positive Lyapunov exponent. The Lyapunov exponents of quasi-periodic orbits, on the other hand, should be zero. Via calculation of the Lyapunov exponent of orbits of trapped charged particles in a dipole magnetic field, we scanned the corresponding phase space and found several prominent regimes of quasi-periodic orbits associated with stable periodic orbits in the equatorial plane. These regimes appear to be connected to some small regimes of quasi-periodic orbits associated with stable periodic orbits in the Meridian plane. Our numerical results also show a continuous spectrum of these orbits from stable periodic, to quasi-periodic with vanishing Lyapunov exponents, and eventually to chaotic ones with at least one positive Lyapunov exponent and there are unstable periodic orbits with a positive maximum Lyapunov exponent.


title: Vertical Phase Mixing across the Galactic Disk

abstract: By combining the {\it LAMOST} and {\it Gaia} data, we investigate the vertical phase mixing across the Galactic disk. Our results confirm the existence of the phase space snail shells (or phase spirals) from 6 to 12 kpc. We find that grouping stars by the guiding radius ($R_{g}$), instead of the present radius ($R$) further enhances the snail shell signal in the following aspects: (1) clarity of the snail shell shape is increased; (2) more wraps of the snail shell can be seen; (3) the phase spaces are less affected by the lack of stars closer to the disk mid-plane due to extinction; (4) the phase space snail shell is amplified in greater radial ranges. Compared to the $R$-based snail shell, the quantitatively measured shapes are similar, except that the $R_{g}$-based snail shells show more wraps with better contrast. These lines of evidence lead to the conclusion that the guiding radius (angular momentum) is a fundamental parameter tracing the phase space snail shell across the Galactic disk. Results of our test particle simulations with impulse approximation verify that particles grouped according to $R_{g}$ reveal well-defined and sharper snail shell features. By comparing the radial profiles of the pitch angle between observation and simulation, the external perturbation can be constrained to $\sim$500$-$700 Myr ago. For future vertical phase mixing study, it is recommended to use the guiding radius with additional constraints on orbital hotness (ellipticity) to improve the clarity of the phase snail.


title: India's Rise in Nanoelectronics Research

abstract: Modern semiconductors innovation has a strong relation to scale and skill. While India has a significant demand for semiconductors, it has a daunting challenge to create a semiconductor ecosystem. Yet, India has quietly come a long way. Starting with Centers of Excellence in Nanoelectronics (CENs) initiated in 2006 and broad science and technology funding, India has transformed its nanoelectronics research ecosystem. From negligible contributions as late as 2011, India has risen to be a top contributor to IEEE Electron Devices journals today. Our study presents important observations in terms of ecosystem development. First, there is a 6 year incubation time from infrastructure initiation to first papers. Then, 4 more years to become globally competitive. Second, growth in experimental research is essential along with modeling & simulations. Finally, the aspirational goals of translational research to contribute to the global technology roadmap requires cutting-edge manufacturing infrastructure & ecosystem access, which still needs development. The learning informs a call to action for the research ecosystem i.e. academia, industry, and policy-makers. First, sustain and amplify successful strategies of national research infrastructure & funding growth. Second, enhance international collaborations to add further scale & infrastructure to R&D. Finally, strengthen the industry-academia-policy consortium approach to transform to an innovation-based economy. Ultimately, the electron devices community is entering an exciting phase where Beyond Moore offers open opportunities in materials, devices to systems, and algorithms. India must build on its success to play a significant role in this new world of disruptive innovation.


title: \L ojasiewicz exponents of a certain analytic functions

abstract: We consider the exponent of \L ojasiewicz inequality $\|\partial\,f(\mathbf z)\| \ge c |f(\mathbf z|^\theta$ for two classes of analytic functions and we will give an explicit estimation for $\theta$. First we consider certain non-degenerate functions which is not convenient. In \S 3.4, we give an example of a polynomial for which $\theta_0(f)$ is not constant on the moduli space and in \S 3.5, we show that the behaviors of the \L ojasiewicz exponents is not similar as the Milnor numbers by an example. In the last section (\S 4), we give also an estimation for product functions $f(\mathbf z)=f_1(\mathbf z)\cdots f_k(\mathbf z)$ associated to a family of a certain convenient non-degenerate complete intersection varieties. In either class, the singularity is not isolated. We will give explicit estimations of the \L ojasiewicz exponent $\theta_0(f)$ using combinatorial data of the Newton boundary of $f$. We generalize this estimation for non-reduced function $g=f_1^{m_1}\cdots f_k^{m_k}$.


title: Many-body wavefunctions for quantum impurities out of equilibrium. II. Charge fluctuations

abstract: We extend the general formalism discussed in the previous paper [A. B. Culver and N. Andrei, Phys. Rev. B 103, 195106 (2021)] to two models with charge fluctuations: the interacting resonant level model and the Anderson impurity model. In the interacting resonant level model, we find the exact time-evolving wavefunction and calculate the steady state impurity occupancy to leading order in the interaction. In the Anderson impurity model, we find the nonequilibrium steady state for small or large Coulomb repulsion $U$, and we find that the steady state current to leading order in $U$ agrees with a Keldysh perturbation theory calculation.


title: New Extraction of the Cosmic Birefringence from the Planck 2018 Polarization Data

abstract: We search for evidence of parity-violating physics in the Planck 2018 polarization data, and report on a new measurement of the cosmic birefringence angle, $\beta$. The previous measurements are limited by the systematic uncertainty in the absolute polarization angles of the Planck detectors. We mitigate this systematic uncertainty completely by simultaneously determining $\beta$ and the angle miscalibration using the observed cross-correlation of the $E$- and $B$-mode polarization of the cosmic microwave background and the Galactic foreground emission. We show that the systematic errors are effectively mitigated and achieve a factor-of-$2$ smaller uncertainty than the previous measurement, finding $\beta=0.35 \pm 0.14\,\deg$ (68% C.L.), which excludes $\beta = 0$ at $99.2$% C.L. This corresponds to the statistical significance of $2.4\sigma$.


title: Multi-RIS Aided 3D Secure Precise Wireless Transmission

abstract: In this paper, multiple reconfigurable intelligent surfaces (RIS) aided secure precise wireless transmission (SPWT) schemes are proposed in the three-dimensional (3D) wireless communication scenario. Unavailable direct path channels from transmitter to receivers are considered when the direct paths are obstructed by obstacles. Then, multiple RISs are utilized to achieve SPWT through the reflection path among transmitter, RISs and receivers in order to enhance the communication performance and energy efficiency simultaneously. First, a maximum-signal-to-interference-and-noise ratio (MSINR) scheme is proposed in a single user scenario. Then, the multi-user scenario is considered where the illegitimate users are regarded as eavesdroppers. A maximum-secrecy-rate (MSR) scheme and a maximum-signal-to-leakage-and-noise ratio (MSLNR) are proposed. The former achieves a better secrecy rate (SR) performance but incurs a higher complexity. The latter has a lower complexity than the MSR scheme with an SR performance loss. Simulation results show that both single-user scheme and multi-user scheme can achieve SPWT which transmits confidential message precisely to location of desired users. Moreover, MSLNR scheme has a lower complexity than the MSR scheme, while the SR performance is close to that of the MSR scheme.


title: Learning Quantized Neural Nets by Coarse Gradient Method for Non-linear Classification

abstract: Quantized or low-bit neural networks are attractive due to their inference efficiency. However, training deep neural networks with quantized activations involves minimizing a discontinuous and piecewise constant loss function. Such a loss function has zero gradients almost everywhere (a.e.), which makes the conventional gradient-based algorithms inapplicable. To this end, we study a novel class of \emph{biased} first-order oracle, termed coarse gradient, for overcoming the vanished gradient issue. A coarse gradient is generated by replacing the a.e. zero derivatives of quantized (i.e., stair-case) ReLU activation composited in the chain rule with some heuristic proxy derivative called straight-through estimator (STE). Although having been widely used in training quantized networks empirically, fundamental questions like when and why the ad-hoc STE trick works, still lacks theoretical understanding. In this paper, we propose a class of STEs with certain monotonicity, and consider their applications to the training of a two-linear-layer network with quantized activation functions for non-linear multi-category classification. We establish performance guarantees for the proposed STEs by showing that the corresponding coarse gradient methods converge to the global minimum, which leads to a perfect classification. Lastly, we present experimental results on synthetic data as well as MNIST dataset to verify our theoretical findings and demonstrate the effectiveness of our proposed STEs.


title: Application of Facial Recognition using Convolutional Neural Networks for Entry Access Control

abstract: The purpose of this paper is to design a solution to the problem of facial recognition by use of convolutional neural networks, with the intention of applying the solution in a camera-based home-entry access control system. More specifically, the paper focuses on solving the supervised classification problem of taking images of people as input and classifying the person in the image as one of the authors or not. Two approaches are proposed: (1) building and training a neural network called WoodNet from scratch and (2) leveraging transfer learning by utilizing a network pre-trained on the ImageNet database and adapting it to this project's data and classes. In order to train the models to recognize the authors, a dataset containing more than 150 000 images has been created, balanced over the authors and others. Image extraction from videos and image augmentation techniques were instrumental for dataset creation. The results are two models classifying the individuals in the dataset with high accuracy, achieving over 99% accuracy on held-out test data. The pre-trained model fitted significantly faster than WoodNet, and seems to generalize better. However, these results come with a few caveats. Because of the way the dataset was compiled, as well as the high accuracy, one has reason to believe the models over-fitted to the data to some degree. An added consequence of the data compilation method is that the test dataset may not be sufficiently different from the training data, limiting its ability to validate generalization of the models. However, utilizing the models in a web-cam based system, classifying faces in real-time, shows promising results and indicates that the models generalized fairly well for at least some of the classes (see the accompanying video).


title: Approximation of a Multivariate Function of Bounded Variation from its Scattered Data

abstract: This paper addresses the problem of approximating a function of bounded variation from its scattered data. Radial basis function(RBF) interpolation methods are known to approximate only functions in their native spaces, and to date, there has been no known proof that they can approximate functions outside the native space associated with the particular RBF being used. In this paper, we describe a scattered data interpolation method which can approximate any function of bounded variation from its scattered data as the data points grow dense. As the class of functions of bounded variation is a much wider class than the native spaces of the RBF, this method provides a crucial advantage over RBF interpolation methods.


title: Sparse generative modeling via parameter-reduction of Boltzmann machines: application to protein-sequence families

abstract: Boltzmann machines (BM) are widely used as generative models. For example, pairwise Potts models (PM), which are instances of the BM class, provide accurate statistical models of families of evolutionarily related protein sequences. Their parameters are the local fields, which describe site-specific patterns of amino-acid conservation, and the two-site couplings, which mirror the coevolution between pairs of sites. This coevolution reflects structural and functional constraints acting on protein sequences during evolution. The most conservative choice to describe the coevolution signal is to include all possible two-site couplings into the PM. This choice, typical of what is known as Direct Coupling Analysis, has been successful for predicting residue contacts in the three-dimensional structure, mutational effects, and in generating new functional sequences. However, the resulting PM suffers from important over-fitting effects: many couplings are small, noisy and hardly interpretable; the PM is close to a critical point, meaning that it is highly sensitive to small parameter perturbations. In this work, we introduce a general parameter-reduction procedure for BMs, via a controlled iterative decimation of the less statistically significant couplings, identified by an information-based criterion that selects either weak or statistically unsupported couplings. For several protein families, our procedure allows one to remove more than $90\%$ of the PM couplings, while preserving the predictive and generative properties of the original dense PM, and the resulting model is far away from criticality, hence more robust to noise.


title: 3D Registration for Self-Occluded Objects in Context

abstract: While much progress has been made on the task of 3D point cloud registration, there still exists no learning-based method able to estimate the 6D pose of an object observed by a 2.5D sensor in a scene. The challenges of this scenario include the fact that most measurements are outliers depicting the object's surrounding context, and the mismatch between the complete 3D object model and its self-occluded observations. We introduce the first deep learning framework capable of effectively handling this scenario. Our method consists of an instance segmentation module followed by a pose estimation one. It allows us to perform 3D registration in a one-shot manner, without requiring an expensive iterative procedure. We further develop an on-the-fly rendering-based training strategy that is both time- and memory-efficient. Our experiments evidence the superiority of our approach over the state-of-the-art traditional and learning-based 3D registration methods.


title: Hierarchically Decoupled Spatial-Temporal Contrast for Self-supervised Video Representation Learning

abstract: We present a novel technique for self-supervised video representation learning by: (a) decoupling the learning objective into two contrastive subtasks respectively emphasizing spatial and temporal features, and (b) performing it hierarchically to encourage multi-scale understanding. Motivated by their effectiveness in supervised learning, we first introduce spatial-temporal feature learning decoupling and hierarchical learning to the context of unsupervised video learning. We show by experiments that augmentations can be manipulated as regularization to guide the network to learn desired semantics in contrastive learning, and we propose a way for the model to separately capture spatial and temporal features at multiple scales. We also introduce an approach to overcome the problem of divergent levels of instance invariance at different hierarchies by modeling the invariance as loss weights for objective re-weighting. Experiments on downstream action recognition benchmarks on UCF101 and HMDB51 show that our proposed Hierarchically Decoupled Spatial-Temporal Contrast (HDC) makes substantial improvements over directly learning spatial-temporal features as a whole and achieves competitive performance when compared with other state-of-the-art unsupervised methods. Code will be made available.


title: Boundedness from below conditions for a general scalar potential of two real scalars fields and the Higgs boson

abstract: The most general scalar potential of two real scalar fields and a Higgs boson is a quartic homogeneous polynomial about 3 variables, which defines a 4th order 3 dimensional symmetric tensor. Hence, the boundedness from below of such a scalar potential involves the positive (semi-)definiteness of the corresponding tensor. So, we mainly discuss analytical expressions of positive (semi-)definiteness for such a special 4th order 3-dimension symmetric tensor in this paper. Firstly, an analytically necessary and sufficient condition is given to test the positive (semi-)definiteness of a 4th order 2 dimensional symmetric tensor. Furthermore, by means of such a result, the necessary and sufficient conditions of the boundedness from below are obtained for a general scalar potential of two real scalar fields and the Higgs boson.


title: Evaluating Input Representation for Language Identification in Hindi-English Code Mixed Text

abstract: Natural language processing (NLP) techniques have become mainstream in the recent decade. Most of these advances are attributed to the processing of a single language. More recently, with the extensive growth of social media platforms focus has shifted to code-mixed text. The code-mixed text comprises text written in more than one language. People naturally tend to combine local language with global languages like English. To process such texts, current NLP techniques are not sufficient. As a first step, the text is processed to identify the language of the words in the text. In this work, we focus on language identification in code-mixed sentences for Hindi-English mixed text. The task of language identification is formulated as a token classification task. In the supervised setting, each word in the sentence has an associated language label. We evaluate different deep learning models and input representation combinations for this task. Mainly, character, sub-word, and word embeddings are considered in combination with CNN and LSTM based models. We show that sub-word representation along with the LSTM model gives the best results. In general sub-word representations perform significantly better than other input representations. We report the best accuracy of 94.52% using a single layer LSTM model on the standard SAIL ICON 2017 test set.


title: An automatic-adaptivity stabilized finite element method via residual minimization for heterogeneous, anisotropic advection-diffusion-reaction problems

abstract: In this paper, we describe a stable finite element formulation for advection-diffusion-reaction problems that allows for robust automatic adaptive strategies to be easily implemented. We consider locally vanishing, heterogeneous, and anisotropic diffusivities, as well as advection-dominated diffusion problems. The general stabilized finite element framework was described and analyzed in arXiv:1907.12605v3 for linear problems in general, and tested for pure advection problems. The method seeks for the discrete solution through a residual minimization process on a proper stable discontinuous Galerkin (dG) dual norm. This technique leads to a saddle-point problem that delivers a stable discrete solution and a robust error estimate that can drive mesh adaptivity. In this work, we demonstrate the efficiency of the method in extreme scenarios, delivering stable solutions. The quality and performance of the solutions are comparable to classical discontinuous Galerkin formulations in the respective discrete space norm on each mesh. Meanwhile, this technique allows us to solve on coarse meshes and adapt the solution to achieve a user-specified solution quality.


title: Group $C^*$-algebras of locally compact groups acting on trees

abstract: We study the group $C^*$-algebras $C^*_{L^{p+}}(G)$ - constructed from $L^p$-integrability properties of matrix coefficients of unitary representations - of locally compact groups $G$ acting on (semi-)homogeneous trees of sufficiently large degree. These group $C^*$-algebras lie between the universal and the reduced group $C^*$-algebra. By directly investigating these $L^p$-integrability properties, we first show that for every non-compact, closed subgroup $G$ of the automorphism group $\mathrm{Aut}(T)$ of a (semi-)homogeneous tree $T$ that acts transitively on the boundary $\partial T$ and every $2 \leq q < p \leq \infty$, the canonical quotient map $C^*_{L^{p+}}(G) \twoheadrightarrow C^*_{L^{q+}}(G)$ is not injective. This reproves a result of Samei and Wiersma. We prove that under the additional assumptions that $G$ acts transitively on $T$ and that it has Tits' independence property, the group $C^*$-algebras $C^*_{L^{p+}}(G)$ are the only group $C^*$-algebras coming from $G$-invariant ideals in the Fourier-Stieltjes algebra $B(G)$. Additionally, we show that given a group $G$ as before, every group $C^*$-algebra $C^*_{\mu}(G)$ that is distinguishable (as a group $C^*$-algebra) from the universal group $C^*$-algebra of $G$ and whose dual space $C^*_\mu(G)^*$ is a $G$-invariant ideal in $B(G)$ is abstractly ${}^*$-isomorphic to the reduced group $C^*$-algebra of $G$.


title: Federated learning with class imbalance reduction

abstract: Federated learning (FL) is a promising technique that enables a large amount of edge computing devices to collaboratively train a global learning model. Due to privacy concerns, the raw data on devices could not be available for centralized server. Constrained by the spectrum limitation and computation capacity, only a subset of devices can be engaged to train and transmit the trained model to centralized server for aggregation. Since the local data distribution varies among all devices, class imbalance problem arises along with the unfavorable client selection, resulting in a slow converge rate of the global model. In this paper, an estimation scheme is designed to reveal the class distribution without the awareness of raw data. Based on the scheme, a device selection algorithm towards minimal class imbalance is proposed, thus can improve the convergence performance of the global model. Simulation results demonstrate the effectiveness of the proposed algorithm.