title: Bio-inspired robot perception coupled with robot-modeled human perception

abstract: My overarching research goal is to provide robots with perceptional abilities that allow interactions with humans in a human-like manner. To develop these perceptional abilities, I believe that it is useful to study the principles of the human visual system. I use these principles to develop new computer vision algorithms and validate their effectiveness in intelligent robotic systems. I am enthusiastic about this approach as it offers the dual benefit of uncovering principles inherent in the human visual system, as well as applying these principles to its artificial counterpart. Fig. 1 contains a depiction of my research.


title: A Taxonomy of Snow Crystal Growth Behaviors: 1. Using c-axis Ice Needles as Seed Crystals

abstract: I describe a new approach to the classification of snow crystal morphologies that focuses on the most common growth behaviors that appear in normal air under conditions of constant applied temperature and water-vapor supersaturation. The resulting morphological structures are generally robust with respect to small environmental changes and thus should be especially amenable to computational modeling. Because spontaneous structure formation depends on initial conditions, the choice of seed crystal can be an important consideration, and I have found that slender c-axis ice needles provide an exceptionally good starting point for this series of investigations. A sharp needle tip exposes a single basal surface that often simplifies subsequent morphological development, and the absence of a nearby substrate allows for the exploration of a broad range of supersaturations with well-controlled boundary conditions. The overarching goal of this endeavor is to facilitate detailed quantitative comparisons between laboratory ice-growth experiments and corresponding computational models, which will should greatly improve our understanding of the ice/vapor molecular attachment kinetics as well as our ability to model diffusion-limited growth dynamics in the ice/vapor system. This specific case-study of water ice connects broadly to many areas in aqueous chemistry, cryobiology, and environmental science, while the physical principles of molecular attachment kinetics and diffusion-limited growth apply more generally to other systems in crystal growth and materials science.


title: Comparison between autosar platforms with functional safety for automotive software architectures

abstract: In the next Vehicle generations, connected and highly developed driving cars will have an important impact on the networking architecture and the interconnection between ECUs(Electronic Control Unit). The automotive industry begins to develop new and efficient strategies to improve the performance of the global system. AUTOSAR organization as part of this industry tries to present plenary solutions especially software architectures for new technologies in this field. Thus, in this paper, we present the aspects of new E/E architectures with upcoming technologies. We discuss a new solution presented by AUTOSAR organization to implement new software requirements for next generation cars. This solution aims to provide a safe environment for the features that require complex data processing and to communicate with AUTOSAR and non AUTOSAR Platforms. We summarize a comprehensive comparison between AUTOSAR adaptive and AUTOSAR classic in terms of functionality and application area. We provide functional Safety preliminaries for the global E/E architectures.


title: Proceedings of KDD 2021 Workshop on Data-driven Humanitarian Mapping: Harnessing Human-Machine Intelligence for High-Stake Public Policy and Resilience Planning

abstract: Humanitarian challenges, including natural disasters, food insecurity, climate change, racial and gender violence, environmental crises, the COVID-19 coronavirus pandemic, human rights violations, and forced displacements, disproportionately impact vulnerable communities worldwide. According to UN OCHA, 235 million people will require humanitarian assistance in 2021. Despite these growing perils, there remains a notable paucity of data science research to scientifically inform equitable public policy decisions for improving the livelihood of at-risk populations. Scattered data science efforts exist to address these challenges, but they remain isolated from practice and prone to algorithmic harms concerning lack of privacy, fairness, interpretability, accountability, transparency, and ethics. Biases in data-driven methods carry the risk of amplifying inequalities in high-stakes policy decisions that impact the livelihood of millions of people. Consequently, proclaimed benefits of data-driven innovations remain inaccessible to policymakers, practitioners, and marginalized communities at the core of humanitarian actions and global development. To help fill this gap, we propose the Data-driven Humanitarian Mapping Research Program, which focuses on developing novel data science methodologies that harness human-machine intelligence for high-stakes public policy and resilience planning. The proceedings of the 2nd Data-driven Humanitarian Mapping workshop at the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining. August 15th, 2021


title: Position-based Hash Embeddings For Scaling Graph Neural Networks

abstract: Graph Neural Networks (GNNs) bring the power of deep representation learning to graph and relational data and achieve state-of-the-art performance in many applications. GNNs compute node representations by taking into account the topology of the node's ego-network and the features of the ego-network's nodes. When the nodes do not have high-quality features, GNNs learn an embedding layer to compute node embeddings and use them as input features. However, the size of the embedding layer is linear to the product of the number of nodes in the graph and the dimensionality of the embedding and does not scale to big data and graphs with hundreds of millions of nodes. To reduce the memory associated with this embedding layer, hashing-based approaches, commonly used in applications like NLP and recommender systems, can potentially be used. However, a direct application of these ideas fails to exploit the fact that in many real-world graphs, nodes that are topologically close will tend to be related to each other (homophily) and as such their representations will be similar. In this work, we present approaches that take advantage of the nodes' position in the graph to dramatically reduce the memory required, with minimal if any degradation in the quality of the resulting GNN model. Our approaches decompose a node's embedding into two components: a position-specific component and a node-specific component. The position-specific component models homophily and the node-specific component models the node-to-node variation. Extensive experiments using different datasets and GNN models show that our methods are able to reduce the memory requirements by 88% to 97% while achieving, in nearly all cases, better classification accuracy than other competing approaches, including the full embeddings.


title: Invariant probability measures from pseudoholomorphic curves I

abstract: We introduce a method for constructing invariant probability measures of a large class of non-singular volume-preserving flows on closed, oriented odd-dimensional smooth manifolds using pseudoholomorphic curve techniques from symplectic geometry. These flows include any non-singular volume preserving flow in dimension three, and autonomous Hamiltonian flows on closed, regular energy levels in symplectic manifolds of any dimension. As an application, we use our method to prove the existence of obstructions to unique ergodicity for this class of flows, generalizing results of Taubes and Ginzburg-Niche.


title: Automatic non-invasive Cough Detection based on Accelerometer and Audio Signals

abstract: We present an automatic non-invasive way of detecting cough events based on both accelerometer and audio signals. The acceleration signals are captured by a smartphone firmly attached to the patient's bed, using its integrated accelerometer. The audio signals are captured simultaneously by the same smartphone using an external microphone. We have compiled a manually-annotated dataset containing such simultaneously-captured acceleration and audio signals for approximately 6000 cough and 68000 non-cough events from 14 adult male patients in a tuberculosis clinic. LR, SVM and MLP are evaluated as baseline classifiers and compared with deep architectures such as CNN, LSTM, and Resnet50 using a leave-one-out cross-validation scheme. We find that the studied classifiers can use either acceleration or audio signals to distinguish between coughing and other activities including sneezing, throat-clearing, and movement on the bed with high accuracy. However, in all cases, the deep neural networks outperform the shallow classifiers by a clear margin and the Resnet50 offers the best performance by achieving an AUC exceeding 0.98 and 0.99 for acceleration and audio signals respectively. While audio-based classification consistently offers a better performance than acceleration-based classification, we observe that the difference is very small for the best systems. Since the acceleration signal requires less processing power, and since the need to record audio is sidestepped and thus privacy is inherently secured, and since the recording device is attached to the bed and not worn, an accelerometer-based highly accurate non-invasive cough detector may represent a more convenient and readily accepted method in long-term cough monitoring.


title: IWAVE -- An Adaptive Filter Approach to Phase Lock and the Dynamic Characterisation of Pseudo-Harmonic Waves

abstract: We present a novel adaptive filtering approach to the dynamic characterisation of waves of varying frequency and amplitude embedded in arbitrary noise backgrounds. This method, known as IWAVE, possesses critical advantages over conventional techniques making it a useful new tool in the dynamic characterisation of a wide range of data containing embedded oscillating signals. After a review of existing techniques, we present the IWAVE algorithm, derive its key characteristics, and provide tests of its performance using simulated and real world data.


title: The Intrinsic Properties of Multiwavelength Energy Spectra for Fermi Teraelectronvolt Blazars

abstract: In this paper, we have selected a sample of 64 teraelectronvolt blazars, with redshift, from those classified in the fourth Fermi Large Area Telescope source catalog\footnote{\url{https://fermi.gsfc.nasa.gov/ssc/data/access/lat/8yr_catalog/}}. We have obtained the values of the relevant physical parameters by performing a log-parabolic fitting of the average-state multiwavelength spectral energy distributions. We estimate the range of the radiation zone parameters, such as the Doppler factor (${D}$), the magnetic field strength ($B$), the radiative zone radius ($R$) and the peak Lorentz factor (${\gamma _{\rm p}}$) of nonthermal electrons. Here, we show that (1) there is a strong linear positive correlation between the intrinsic synchrotron peak frequency and the intrinsic inverse Compton scattering (ICs) peak frequency among different types of blazars; (2) if radio bands are excluded, the spectral index of each band is negatively correlated with the intrinsic peak frequency; (3) there is a strong linear negative correlation between the curvature at the peak and the intrinsic peak frequency of the synchrotron bump, and a weak positive correlation between the curvature at the peak and the intrinsic peak frequency of the ICs bump; (4) there is a strong linear positive correlation between the intrinsic ICs peak luminosity and intrinsic $\gamma$-ray luminosity and between the intrinsic ICs peak frequency and peak Lorentz factor; (5) there is a strong negative linear correlation between $\rm log{\;B}$ and $\rm log{\;\gamma_{p}}$; and (6) there is no correlation between $\rm log{\;R}$ and $\rm log{\;\gamma_{p}}$.


title: Invariant probability measures from pseudoholomorphic curves II: Pseudoholomorphic curve constructions

abstract: In the previous work, we introduced a method for constructing invariant probability measures of a large class of non-singular volume-preserving flows on closed, oriented odd-dimensional smooth manifolds with pseudoholomorphic curve techniques from symplectic geometry. The technique requires existence of certain pseudoholomorphic curves satisfying some weak assumptions. In this work, we appeal to Gromov-Witten theory and Seiberg-Witten theory to construct large classes of examples where these pseudoholomorphic curves exist. Our argument uses neck stretching along with new analytical tools from Fish-Hofer's work on feral pseudoholomorphic curves.


title: Doubly stochastic matrices and Schur-Weyl duality for partition algebras

abstract: We prove that the permutations of $\{1,\dots, n\}$ having an increasing (resp., decreasing) subsequence of length $n-r$ index a subset of the set of all $r$th Kronecker powers of $n \times n$ permutation matrices which is a basis for the linear span of that set. Thanks to a known Schur--Weyl duality, this gives a new basis for the centralizer algebra of the partition algebra acting on the $r$th tensor power of a vector space. We give some related results on the set of doubly stochastic matrices in that algebra.


title: Decay estimates for unitary representations with applications to continuous- and discrete-time models

abstract: We present a new technique to obtain polynomial decay estimates for the matrix coefficients of unitary operators. Our approach, based on commutator methods, applies to nets of unitary operators, unitary representations of topological groups, and unitary operators given by the evolution group of a self-adjoint operator or by powers of a unitary operator. Our results are illustrated with a wide range of examples in quantum mechanics and dynamical systems, as for instance Schr\"odinger operators, Dirac operators, quantum waveguides, horocycle flows, adjacency matrices, Jacobi matrices, quantum walks or skew products.


title: Two-step Domain Adaptation for Mitosis Cell Detection in Histopathology Images

abstract: We propose a two-step domain shift-invariant mitosis cell detection method based on Faster RCNN and a convolutional neural network (CNN). We generate various domain-shifted versions of existing histopathology images using a stain augmentation technique, enabling our method to effectively learn various stain domains and achieve better generalization. The performance of our method is evaluated on the preliminary test data set of the MIDOG-2021 challenge. The experimental results demonstrate that the proposed mitosis detection method can achieve promising performance for domain-shifted histopathology images.


title: MiniF2F: a cross-system benchmark for formal Olympiad-level mathematics

abstract: We present miniF2F, a dataset of formal Olympiad-level mathematics problems statements intended to provide a unified cross-system benchmark for neural theorem proving. The miniF2F benchmark currently targets Metamath, Lean, Isabelle (partially) and HOL Light (partially) and consists of 488 problem statements drawn from the AIME, AMC, and the International Mathematical Olympiad (IMO), as well as material from high-school and undergraduate mathematics courses. We report baseline results using GPT-f, a neural theorem prover based on GPT-3 and provide an analysis of its performance. We intend for miniF2F to be a community-driven effort and hope that our benchmark will help spur advances in neural theorem proving.


title: The Taylor resolution over a skew polynomial ring

abstract: Let $\Bbbk$ be a field and let $I$ be a monomial ideal in the polynomial ring $Q=\Bbbk[x_1,\ldots,x_n]$. In her thesis, Taylor introduced a complex which provides a finite free resolution for $Q/I$ as a $Q$-module. Later, Gemeda constructed a differential graded structure on the Taylor resolution. More recently, Avramov showed that this differential graded algebra admits divided powers. We generalize each of these results to monomial ideals in a skew polynomial ring $R$. Under the hypothesis that the skew commuting parameters defining $R$ are roots of unity, we prove as an application that as $I$ varies among all ideals generated by a fixed number of monomials of degree at least two in $R$, there is only a finite number of possibilities for the Poincar\'{e} series of $\Bbbk$ over $R/I$ and for the isomorphism classes of the homotopy Lie algebra of $R/I$ in cohomological degree larger or equal to two.


title: Fluctuations and Selection Bias in 5 and 13 TeV p-p Collisions: Where are the jets?

abstract: The ALICE collaboration recently reported high-statistics $\bf p_t$ spectra from 5 TeV and 13 TeV p-p collisions with intent to determine the role of jets in high-multiplicity collisions. In the present study a two-component (soft + hard) model (TCM) of hadron production in p-p collisions is applied to ALICE $\bf p_t$ spectra. As in previous TCM studies of A-B collision systems jet and nonjet contributions to $\bf p_t$ spectra are accurately separated over the entire $\bf p_t$ acceptance. The statistical significance of data-model differences is established leading to insights concerning selection bias and spectrum model validity.


title: CPFN: Cascaded Primitive Fitting Networks for High-Resolution Point Clouds

abstract: Representing human-made objects as a collection of base primitives has a long history in computer vision and reverse engineering. In the case of high-resolution point cloud scans, the challenge is to be able to detect both large primitives as well as those explaining the detailed parts. While the classical RANSAC approach requires case-specific parameter tuning, state-of-the-art networks are limited by memory consumption of their backbone modules such as PointNet++, and hence fail to detect the fine-scale primitives. We present Cascaded Primitive Fitting Networks (CPFN) that relies on an adaptive patch sampling network to assemble detection results of global and local primitive detection networks. As a key enabler, we present a merging formulation that dynamically aggregates the primitives across global and local scales. Our evaluation demonstrates that CPFN improves the state-of-the-art SPFN performance by 13-14% on high-resolution point cloud datasets and specifically improves the detection of fine-scale primitives by 20-22%.


title: A universal relationship between stellar masses and binding energies of galaxies

abstract: In this study we demonstrate that stellar masses of galaxies (Mstar) are universally correlated through a double power law function with the product of the dynamical velocities (Ve) and sizes to one-fourth power (Re^0.25) of galaxies, both measured at the effective radii. The product VeRe^0.25 represents the fourth root of the total binding energies within effective radii of galaxies. This stellar mass-binding energy correlation has an observed scatter of 0.14 dex in log(VeRe^0.25) and 0.46 dex in log(Mstar). It holds for a variety of galaxy types over a stellar mass range of nine orders of magnitude, with little evolution over cosmic time. A toy model of self-regulation between binding energies and supernovae feedback is shown to be able to reproduce the observed slopes, but the underlying physical mechanisms are still unclear. The correlation can be a potential distance estimator with an uncertainty of 0.2 dex independent of the galaxy type.


title: Uncertainty Quantified Deep Learning for Predicting Dice Coefficient of Digital Histopathology Image Segmentation

abstract: Deep learning models (DLMs) can achieve state of the art performance in medical image segmentation and classification tasks. However, DLMs that do not provide feedback for their predictions such as Dice coefficients (Dice) have limited deployment potential in real world clinical settings. Uncertainty estimates can increase the trust of these automated systems by identifying predictions that need further review but remain computationally prohibitive to deploy. In this study, we use a DLM with randomly initialized weights and Monte Carlo dropout (MCD) to segment tumors from microscopic Hematoxylin and Eosin (H&E) dye stained prostate core biopsy RGB images. We devise a novel approach that uses multiple clinical region based uncertainties from a single image (instead of the entire image) to predict Dice of the DLM model output by linear models. Image level uncertainty maps were generated and showed correspondence between imperfect model segmentation and high levels of uncertainty associated with specific prostate tissue regions with or without tumors. Results from this study suggest that linear models can learn coefficients of uncertainty quantified deep learning and correlations ((Spearman's correlation (p<0.05)) to predict Dice scores of specific regions of medical images.


title: Universality, criticality and complexity of information propagation in social media

abstract: Information avalanches in social media are typically studied in a similar fashion as avalanches of neuronal activity in the brain. Whereas a large body of literature reveals substantial agreement about the existence of a unique process characterizing neuronal activity across organisms, the dynamics of information in online social media is far less understood. Statistical laws of information avalanches are found in previous studies to be not robust across systems, and radically different processes are used to represent plausible driving mechanisms for information propagation. Here, we analyze almost 1 billion time-stamped events collected from a multitude of online platforms -- including Telegram, Twitter and Weibo -- over observation windows longer than 10 years to show that the propagation of information in social media is a universal and critical process. Universality arises from the observation of identical macroscopic patterns across platforms, irrespective of the details of the specific system at hand. Critical behavior is deduced from the power-law distributions, and corresponding hyperscaling relations, characterizing size and duration of avalanches of information. Neuronal activity may be modeled as a simple contagion process, where only a single exposure to activity may be sufficient for its diffusion. On the contrary, statistical testing on our data indicates that a mixture of simple and complex contagion, where involvement of an individual requires exposure from multiple acquaintances, characterizes the propagation of information in social media. We show that the complexity of the process is correlated with the semantic content of the information that is propagated. Conversational topics about music, movies and TV shows tend to propagate as simple contagion processes, whereas controversial discussions on political/societal themes obey the rules of complex contagion.


title: The Generalized Bergman Game

abstract: Every positive integer may be written uniquely as a base-$\beta$ decomposition--that is a legal sum of powers of $\beta$--where $\beta$ is the dominating root of a non-increasing positive linear recurrence sequence. Guided by earlier work on a two-player game which produces the Zeckendorf Decomposition of an integer (see [Bai+19]), we define a broad class of two-player games played on an infinite tuple of non-negative integers which decompose a positive integer into its base-$\beta$ expansion. We call this game the Generalized Bergman Game. We prove that the longest possible Generalized Bergman game on an initial state $S$ with $n$ summands terminates in $\Theta(n^2)$ time, and we also prove that the shortest possible Generalized Bergman game on an initial state terminates between $\Omega(n)$ and $O(n^2)$ time. We also show a linear bound on the maximum length of the tuple used throughout the game.


title: Baryogenesis from ultra-slow-roll inflation

abstract: The ultra-slow-roll (USR) inflation represents a class of single-field models with sharp deceleration of the rolling dynamics on small scales, leading to a significantly enhanced power spectrum of the curvature perturbations and primordial black hole (PBH) formation. Such a sharp transition of the inflationary background can trigger the coherent motion of scalar condensates with effective potentials governed by the rolling rate of the inflaton field. We show that a scalar condensate carrying (a combination of) baryon or lepton number can achieve successful baryogenesis through the Affleck-Dine mechanism from unconventional initial conditions excited by the USR transition. Viable parameter space for creating the correct baryon asymmetry of the Universe naturally incorporates the specific limit for PBHs to contribute significantly to dark matter, shedding light on the cosmic coincidence problem between the baryon and dark matter densities today.


title: Effective scattering and Efimov physics in the presence of two-body dissipation

abstract: Two-body dissipation usually gives rise to a complex interaction. Here, we study the effect of two-body dissipation on few-body physics, including the fundamental two-body effective scattering and the three-body Efimov physics. By employing a two-channel model that incorporates the decay of closed-channel molecules (generating the two-body dissipation), we explicitly relate the real and imaginary part of the inverse scattering length (a_s^{-1}) to closed-channel detuning and decay rate. In particular, we show that the imaginary part of a_s^{-1} is given by the product of the molecule decay rate and the effective range. Such complex scattering length is found to generate an additional imaginary Coulomb potential when three atoms come close to each other, thereby suppressing the formation of trimer bound states and modifying the conventional discrete scaling in Efimov physics.


title: Contrastive Multiview Coding with Electro-optics for SAR Semantic Segmentation

abstract: In the training of deep learning models, how the model parameters are initialized greatly affects the model performance, sample efficiency, and convergence speed. Representation learning for model initialization has recently been actively studied in the remote sensing field. In particular, the appearance characteristics of the imagery obtained using the a synthetic aperture radar (SAR) sensor are quite different from those of general electro-optical (EO) images, and thus representation learning is even more important in remote sensing domain. Motivated from contrastive multiview coding, we propose multi-modal representation learning for SAR semantic segmentation. Unlike previous studies, our method jointly uses EO imagery, SAR imagery, and a label mask. Several experiments show that our approach is superior to the existing methods in model performance, sample efficiency, and convergence speed.


title: Exploring the Dynamics of Virulent and Avirulent Aphids: A Case for a "Within Plant" Refuge

abstract: The soybean aphid, Aphis glycines (Hemiptera: Aphididae), is an invasive pest that can cause severe yield loss to soybeans in the northcentral United States. A tactic to counter this pest is the use of aphid-resistant soybean varieties. However, the occurrence of virulent biotypes can alter plant physiology and impair the use of this management strategy. Soybean aphids can alter soybean physiology primarily by two mechanisms, feeding facilitation and the obviation of resistance, favoring subsequent colonization by additional conspecifics. We developed a non-local, differential equation population model, to explore the dynamics of these biological mechanisms on soybean plants co-infested with virulent and avirulent aphids. We then use demographic parameters from laboratory experiments to perform numerical simulations via the model. These simulations successfully mimic various aphid dynamics observed in the field. Our model showed an increase in colonization of virulent aphids increases the likelihood that aphid-resistance is suppressed, subsequently increasing the survival of avirulent aphids, producing an indirect, positive interaction between the biotypes. These results suggest the potential for a "within plant" refuge that could contribute to the sustainable use of aphid resistant soybeans.


title: FinQA: A Dataset of Numerical Reasoning over Financial Data

abstract: The sheer volume of financial statements makes it difficult for humans to access and analyze a business's financials. Robust numerical reasoning likewise faces unique challenges in this domain. In this work, we focus on answering deep questions over financial data, aiming to automate the analysis of a large corpus of financial documents. In contrast to existing tasks on general domain, the finance domain includes complex numerical reasoning and understanding of heterogeneous representations. To facilitate analytical progress, we propose a new large-scale dataset, FinQA, with Question-Answering pairs over Financial reports, written by financial experts. We also annotate the gold reasoning programs to ensure full explainability. We further introduce baselines and conduct comprehensive experiments in our dataset. The results demonstrate that popular, large, pre-trained models fall far short of expert humans in acquiring finance knowledge and in complex multi-step numerical reasoning on that knowledge. Our dataset -- the first of its kind -- should therefore enable significant, new community research into complex application domains. The dataset and code are publicly available\url{https://github.com/czyssrs/FinQA}.


title: Regulatory Feedback Effects on Tissue Growth Dynamics in a Two-Stage Cell Lineage Model

abstract: Identifying the mechanism of intercellular feedback regulation is critical for the basic understanding of tissue growth control in organisms. In this paper, we analyze a tissue growth model consisting of a single lineage of two cell types regulated by negative feedback signalling molecules that undergo spatial diffusion. By deriving the fixed points for the uniform steady states and carrying out linear stability analysis, phase diagrams are obtained analytically for arbitrary parameters of the model. Two different generic growth modes are found: blow-up growth and final-state controlled growth which are governed by the non-trivial fixed point and the trivial fixed point respectively, and can be sensitively switched by varying the negative feedback regulation on the proliferation of the stem cells. Analytic expressions for the characteristic time scales for these two growth modes are also derived. Remarkably, the trivial and non-trivial uniform steady states can coexist and a sharp transition occurs in the bistable regime as the relevant parameters are varied. Furthermore, the bi-stable growth properties allows for the external control to switch between these two growth modes. In addition, the condition for an early accelerated growth followed by a retarded growth can be derived. These analytical results are further verified by numerical simulations and provide insights on the growth behavior of the tissue. Our results are also discussed in the light of possible realistic biological experiments and tissue growth control strategy. Furthermore, by external feedback control of the concentration of regulatory molecules, it is possible to achieve a desired growth mode, as demonstrated with an analysis of boosted growth, catch-up growth and the design for the target of a linear growth dynamic.


title: Learning Coated Adversarial Camouflages for Object Detectors

abstract: An adversary can fool deep neural network object detectors by generating adversarial noises. Most of the existing works focus on learning local visible noises in an adversarial "patch" fashion. However, the 2D patch attached to a 3D object tends to suffer from an inevitable reduction in attack performance as the viewpoint changes. To remedy this issue, this work proposes the Coated Adversarial Camouflage (CAC) to attack the detectors in arbitrary viewpoints. Unlike the patch trained in the 2D space, our camouflage generated by a conceptually different training framework consists of 3D rendering and dense proposals attack. Specifically, we make the camouflage perform 3D spatial transformations according to the pose changes of the object. Based on the multi-view rendering results, the top-n proposals of the region proposal network are fixed, and all the classifications in the fixed dense proposals are attacked simultaneously to output errors. In addition, we build a virtual 3D scene to fairly and reproducibly evaluate different attacks. Extensive experiments demonstrate the superiority of CAC over the existing attacks, and it shows impressive performance both in the virtual scene and the real world. This poses a potential threat to the security-critical computer vision systems.


title: A Weight Initialization Based on the Linear Product Structure for Neural Networks

abstract: Weight initialization plays an important role in training neural networks and also affects tremendous deep learning applications. Various weight initialization strategies have already been developed for different activation functions with different neural networks. These initialization algorithms are based on minimizing the variance of the parameters between layers and might still fail when neural networks are deep, e.g., dying ReLU. To address this challenge, we study neural networks from a nonlinear computation point of view and propose a novel weight initialization strategy that is based on the linear product structure (LPS) of neural networks. The proposed strategy is derived from the polynomial approximation of activation functions by using theories of numerical algebraic geometry to guarantee to find all the local minima. We also provide a theoretical analysis that the LPS initialization has a lower probability of dying ReLU comparing to other existing initialization strategies. Finally, we test the LPS initialization algorithm on both fully connected neural networks and convolutional neural networks to show its feasibility, efficiency, and robustness on public datasets.


title: Online Dynamic Window (ODW) Assisted Two-stage LSTM Frameworks for Indoor Localization

abstract: Internet of Things (IoT)-based indoor localization has gained significant popularity recently to satisfy the ever-increasing requirements of indoor Location-based Services (LBS). In this context, Inertial Measurement Unit (IMU)-based localization is of interest as it provides a scalable solution independent of any proprietary sensors/modules. Existing IMU-based methodologies, however, are mainly developed based on statistical heading and step length estimation techniques that suffer from cumulative error issues and have extensive computational time requirements limiting their application for real-time indoor positioning. To address the aforementioned issues, we propose the Online Dynamic Window (ODW)-assisted two-stage Long Short Term Memory (LSTM) localization framework. Three ODWs are proposed, where the first model uses a Natural Language Processing (NLP)-inspired Dynamic Window (DW) approach, which significantly reduces the required computational time. The second framework is developed based on a Signal Processing Dynamic Windowing (SP-DW) approach to further reduce the required processing time of the two-stage LSTM-based model. The third ODW, referred to as the SP-NLP, combines the first two windowing mechanisms to further improve the overall achieved accuracy. Compared to the traditional LSTM-based positioning approaches, which suffer from either high tensor computation requirements or low accuracy, the proposed ODW-assisted models can perform indoor localization in a near-real time fashion with high accuracy. Performances of the proposed ODW-assisted models are evaluated based on a real Pedestrian Dead Reckoning (PDR) dataset. The results illustrate potentials of the proposed ODW-assisted techniques in achieving high classification accuracy with significantly reduced computational time, making them applicable for near real-time implementations.


title: Cognitive science as a source of forward and inverse models of human decisions for robotics and control

abstract: Those designing autonomous systems that interact with humans will invariably face questions about how humans think and make decisions. Fortunately, computational cognitive science offers insight into human decision-making using tools that will be familiar to those with backgrounds in optimization and control (e.g., probability theory, statistical machine learning, and reinforcement learning). Here, we review some of this work, focusing on how cognitive science can provide forward models of human decision-making and inverse models of how humans think about others' decision-making. We highlight relevant recent developments, including approaches that synthesize blackbox and theory-driven modeling, accounts that recast heuristics and biases as forms of bounded optimality, and models that characterize human theory of mind and communication in decision-theoretic terms. In doing so, we aim to provide readers with a glimpse of the range of frameworks, methodologies, and actionable insights that lie at the intersection of cognitive science and control research.


title: Quantum Walk to Train a Classical Artificial Neural Network

abstract: This work proposes a computational procedure that uses a quantum walk in a complete graph to train classical artificial neural networks. The idea is to apply the quantum walk to search the weight set values. However, it is necessary to simulate a quantum machine to execute the quantum walk. In this way, to minimize the computational cost, the methodology employed to train the neural network will adjust the synaptic weights of the output layer, not altering the weights of the hidden layer, inspired in the method of Extreme Learning Machine. The quantum walk algorithm as a search algorithm is quadratically faster than its classic analog. The quantum walk variance is $O(t)$ while the variance of its classic analog is $O(\sqrt{t})$, where $t$ is the time or iteration. In addition to computational gain, another advantage of the proposed procedure is to be possible to know \textit{a priori} the number of iterations required to obtain the solutions, unlike the classical training algorithms based on gradient descendent.


title: Magnetism of Kitaev spin-liquid candidate material RuBr$_3$

abstract: The ruthenium halide $\alpha$-RuCl$_{3}$ is a promising candidate for a Kitaev spin liquid. However, the microscopic model describing $\alpha$-RuCl$_{3}$ is still debated partly because of a lack of analogue materials for $\alpha$-RuCl$_{3}$, which prevents tracking of electronic properties as functions of controlled interaction parameters. Here, we report a successful synthesis of RuBr$_{3}$. The material RuBr$_{3}$~possesses BiI$_3$-type structure (space group: $R\overline{3}$) where Ru$^{3+}$ form an ideal honeycomb lattice. Although RuBr$_{3}$ has a negative Weiss temperature, it undergoes a zigzag antiferromagnetic transition at $T_\mathrm{N}=34$ K, as does $\alpha$-RuCl$_{3}$. Our analyses indicate that the Kitaev and non-Kitaev interactions can be modified in ruthenium trihalides by changing the ligand sites, which provides a new platform for exploring Kitaev spin liquids.


title: Evaluation of the importance of criteria for the selection of cryptocurrencies

abstract: In recent years, cryptocurrencies have gone from an obscure niche to a prominent place, with investment in these assets becoming increasingly popular. However, cryptocurrencies carry a high risk due to their high volatility. In this paper, criteria based on historical cryptocurrency data are defined in order to characterize returns and risks in different ways, in short time windows (7 and 15 days); then, the importance of criteria is analyzed by various methods and their impact is evaluated. Finally, the future plan is projected to use the knowledge obtained for the selection of investment portfolios by applying multi-criteria methods.


title: Search for the Chiral Magnetic Effect with Isobar Collisions at $\sqrt{s_{NN}}$ = 200 GeV by the STAR Collaboration at RHIC

abstract: The chiral magnetic effect (CME) is predicted to occur as a consequence of a local violation of $\cal P$ and $\cal CP$ symmetries of the strong interaction amidst a strong electro-magnetic field generated in relativistic heavy-ion collisions. Experimental manifestation of the CME involves a separation of positively and negatively charged hadrons along the direction of the magnetic field. Previous measurements of the CME-sensitive charge-separation observables remain inconclusive because of large background contributions. In order to better control the influence of signal and backgrounds, the STAR Collaboration performed a blind analysis of a large data sample of approximately 3.8 billion isobar collisions of $^{96}_{44}$Ru+$^{96}_{44}$Ru and $^{96}_{40}$Zr+$^{96}_{40}$Zr at $\sqrt{s_{\rm NN}}=200$ GeV. Prior to the blind analysis, the CME signatures are predefined as a significant excess of the CME-sensitive observables in Ru+Ru collisions over those in Zr+Zr collisions, owing to a larger magnetic field in the former. A precision down to 0.4% is achieved, as anticipated, in the relative magnitudes of the pertinent observables between the two isobar systems. Observed differences in the multiplicity and flow harmonics at the matching centrality indicate that the magnitude of the CME background is different between the two species. No CME signature that satisfies the predefined criteria has been observed in isobar collisions in this blind analysis.


title: Let Your Camera See for You: A Novel Two-Factor Authentication Method against Real-Time Phishing Attacks

abstract: Today, two-factor authentication (2FA) is a widely implemented mechanism to counter phishing attacks. Although much effort has been investigated in 2FA, most 2FA systems are still vulnerable to carefully designed phishing attacks, and some even request special hardware, which limits their wide deployment. Recently, real-time phishing (RTP) has made the situation even worse because an adversary can effortlessly establish a phishing website replicating a target website without any background of the web page design technique. Traditional 2FA can be easily bypassed by such RTP attacks. In this work, we propose a novel 2FA system to counter RTP attacks. The main idea is to request a user to take a photo of the web browser with the domain name in the address bar as the 2nd authentication factor. The web server side extracts the domain name information based on Optical Character Recognition (OCR), and then determines if the user is visiting this website or a fake one, thus defeating the RTP attacks where an adversary must set up a fake website with a different domain. We prototyped our system and evaluated its performance in various environments. The results showed that PhotoAuth is an effective technique with good scalability. We also showed that compared to other 2FA systems, PhotoAuth has several advantages, especially no special hardware or software support is needed on the client side except a phone, making it readily deployable.


title: AugLimb: Compact Robotic Limb for Human Augmentation

abstract: This work proposes a compact robotic limb, AugLimb, that can augment our body functions and support the daily activities. AugLimb adopts the double-layer scissor unit for the extendable mechanism which can achieve 2.5 times longer than the forearm length. The proposed device can be mounted on the user's upper arm, and transform into compact state without obstruction to wearers. The proposed device is lightweight with low burden exerted on the wearer. We developed the prototype of AugLimb to demonstrate the proposed mechanisms. We believe that the design methodology of AugLimb can facilitate human augmentation research for practical use. see http://www.jaist.ac.jp/~xie/auglimb.html


title: Probing the time variation of fine structure constant using galaxy clusters and quintessence model

abstract: We explore a possible time variation of the fine structure constant ($\alpha \equiv e^2/\hbar c$) using the Sunyaev-Zel'dovich effect measurements of galaxy clusters along with their X-ray observations. Specifically, the ratio of the integrated Compto-ionization parameter $Y_{SZ}D_A^2$ and its X-ray counterpart $Y_X$ is used as an observable to constrain the bounds on the variation of $\alpha$. Considering the violation of cosmic distance duality relation, this ratio depends on the fine structure constant as $\sim \alpha^3$. We use the quintessence model to provide the origin of $\alpha$ time variation. In order to give a robust test on $\alpha$ variation, two galaxy cluster samples, the 61 clusters provided by the Planck collaboration and the 58 clusters detected by the South Pole Telescope, are collected for analysis. Their X-ray observations are given by the XMM-Newton survey. Our results give $\zeta=-0.203^{+0.101}_{-0.099}$ for the Planck sample and $\zeta=-0.043^{+0.165}_{-0.148}$ for the SPT sample, indicating that $\alpha$ is constant with redshift within $3\sigma$ and $1\sigma$ for the two samples, respectively.


title: Quantum-Inspired Keyword Search on Multi-Model Databases

abstract: With the rising applications implemented in different domains, it is inevitable to require databases to adopt corresponding appropriate data models to store and exchange data derived from various sources. To handle these data models in a single platform, the community of databases introduces a multi-model database. And many vendors are improving their products from supporting a single data model to being multi-model databases. Although this brings benefits, spending lots of enthusiasm to master one of the multi-model query languages for exploring a database is unfriendly to most users. Therefore, we study using keyword searches as an alternative way to explore and query multi-model databases. In this paper, we attempt to utilize quantum physics's probabilistic formalism to bring the problem into vector spaces and represent events (e.g., words) as subspaces. Then we employ a density matrix to encapsulate all the information over these subspaces and use density matrices to measure the divergence between query and candidate answers for finding top-\textit{k} the most relevant results. In this process, we propose using pattern mining to identify compounds for improving accuracy and using dimensionality reduction for reducing complexity. Finally, empirical experiments demonstrate the performance superiority of our approaches over the state-of-the-art approaches.


title: MORTAL: A Tool of Automatically Designing Relational Storage Schemas for Multi-model Data through Reinforcement Learning

abstract: Considering relational databases having powerful capabilities in handling security, user authentication, query optimization, etc., several commercial and academic frameworks reuse relational databases to store and query semi-structured data (e.g., XML, JSON) or graph data (e.g., RDF, property graph). However, these works concentrate on managing one of the above data models with RDBMSs. That is, it does not exploit the underlying tools to automatically generate the relational schema for storing multi-model data. In this demonstration, we present a novel reinforcement learning-based tool called MORTAL. Specifically, given multi-model data containing different data models and a set of queries, it could automatically design a relational schema to store these data while having a great query performance. To demonstrate it clearly, we are centered around the following modules: generating initial state based on loaded multi-model data, influencing learning process by setting parameters, controlling generated relational schema through providing semantic constraints, improving the query performance of relational schema by specifying queries, and a highly interactive interface for showing query performance and storage consumption when users adjust the generated relational schema.


title: Implicit Behavioral Cloning

abstract: We find that across a wide range of robot policy learning scenarios, treating supervised policy learning with an implicit model generally performs better, on average, than commonly used explicit models. We present extensive experiments on this finding, and we provide both intuitive insight and theoretical arguments distinguishing the properties of implicit models compared to their explicit counterparts, particularly with respect to approximating complex, potentially discontinuous and multi-valued (set-valued) functions. On robotic policy learning tasks we show that implicit behavioral cloning policies with energy-based models (EBM) often outperform common explicit (Mean Square Error, or Mixture Density) behavioral cloning policies, including on tasks with high-dimensional action spaces and visual image inputs. We find these policies provide competitive results or outperform state-of-the-art offline reinforcement learning methods on the challenging human-expert tasks from the D4RL benchmark suite, despite using no reward information. In the real world, robots with implicit policies can learn complex and remarkably subtle behaviors on contact-rich tasks from human demonstrations, including tasks with high combinatorial complexity and tasks requiring 1mm precision.


title: Deep Dual Support Vector Data Description for Anomaly Detection on Attributed Networks

abstract: Networks are ubiquitous in the real world such as social networks and communication networks, and anomaly detection on networks aims at finding nodes whose structural or attributed patterns deviate significantly from the majority of reference nodes. However, most of the traditional anomaly detection methods neglect the relation structure information among data points and therefore cannot effectively generalize to the graph structure data. In this paper, we propose an end-to-end model of Deep Dual Support Vector Data description based Autoencoder (Dual-SVDAE) for anomaly detection on attributed networks, which considers both the structure and attribute for attributed networks. Specifically, Dual-SVDAE consists of a structure autoencoder and an attribute autoencoder to learn the latent representation of the node in the structure space and attribute space respectively. Then, a dual-hypersphere learning mechanism is imposed on them to learn two hyperspheres of normal nodes from the structure and attribute perspectives respectively. Moreover, to achieve joint learning between the structure and attribute of the network, we fuse the structure embedding and attribute embedding as the final input of the feature decoder to generate the node attribute. Finally, abnormal nodes can be detected by measuring the distance of nodes to the learned center of each hypersphere in the latent structure space and attribute space respectively. Extensive experiments on the real-world attributed networks show that Dual-SVDAE consistently outperforms the state-of-the-arts, which demonstrates the effectiveness of the proposed method.


title: PBW bases for modified quantum groups

abstract: We construct a basis for a modified quantum group of finite type, extending the PBW bases of positive and negative halves of a quantum group. Generalizing Lusztig's classic results on PBW bases, we show that this basis is orthogonal with respect to its natural bilinear form (and hence called a PBW basis), and moreover, the matrix for the PBW-expansion of the canonical basis is unital triangular. All these follow by a new construction of the modified quantum group of arbitrary type, which is built on limits of sequences of elements in tensor products of lowest and highest weight modules. Explicitly formulas are worked out in the rank one case.


title: Lax Formulae for Efficiently Solving Two Classes of State-Constrained Optimal Control Problems

abstract: This paper presents Lax formulae for solving the following optimal control problems: minimize the maximum (or the minimum) cost over a time horizon, while satisfying a state constraint. We present a viscosity theory, and by applying the theory to the Hamilton-Jacobi (HJ) equations, these Lax formulae are derived. A numerical algorithm for the Lax formulae is presented: under certain conditions, this algorithm's computational complexity is polynomial in the dimension of the state. For each class of optimal control problem, an example demonstrates the use and performance of the Lax formulae.


title: Storing Multi-model Data in RDBMSs based on Reinforcement Learning

abstract: How to manage various data in a unified way is a significant research topic in the field of databases. To address this problem, researchers have proposed multi-model databases to support multiple data models in a uniform platform with a single unified query language. However, since relational databases are predominant in the current market, it is expensive to replace them with others. Besides, due to the theories and technologies of RDBMSs having been enhanced over decades, it is hard to use few years to develop a multi-model database that can be compared with existing RDBMSs in handling security, query optimization, transaction management, etc. In this paper, we reconsider employing relational databases to store and query multi-model data. Unfortunately, the mismatch between the complexity of multi-model data structure and the simplicity of flat relational tables makes this difficult. Against this challenge, we utilize the reinforcement learning (RL) method to learn a relational schema by interacting with an RDBMS. Instead of using the classic Q-learning algorithm, we propose a variant Q-learning algorithm, called \textit{Double Q-tables}, to reduce the dimension of the original Q-table and improve learning efficiency. Experimental results show that our approach could learn a relational schema outperforming the existing multi-model storage schema in terms of query time and space consumption.


title: Determination of Sodium Abundance Ratio from Low-Resolution Stellar Spectra and Its Applications

abstract: We present a method to determine sodium-abundance ratios ([Na/Fe]) using the Na I D doublet lines in low-resolution ($R \sim$ 2000) stellar spectra. As stellar Na I D lines are blended with those produced by the interstellar medium (ISM), we developed a technique for removing the interstellar Na I D lines using the relationship between extinction, which is proportional to $E(B-V)$, and the equivalent width (EW) of the interstellar Na I D absorption lines. When measuring [Na/Fe], we also considered corrections for non-local thermodynamic equilibrium (NLTE) effects. Comparisons with data from high-resolution spectroscopic surveys suggest that the expected precision of [Na/Fe] from low-resolution spectra is better than 0.3 dex for stars with [Fe/H] $>$ $-$3.0. We also present a simple application employing the estimated [Na/Fe] values for a large number of stellar spectra from the Sloan Digital Sky Survey (SDSS). After classifying the SDSS stars into Na-normal, Na-high, and Na-extreme, we explore their relation to stars in Galactic globular clusters (GCs). We find that, while the Na-high SDSS stars exhibit a similar metallicity distribution function (MDF) to that of the GCs, indicating that the majority of such stars may have originated from GC debris, the MDF of the Na-normal SDSS stars follows that of typical disk and halo stars. As there is a high fraction of carbon-enhanced metal-poor stars among the Na-extreme stars, they may have a non-GC origin, perhaps due to mass-transfer events from evolved binary companions.


title: Two-step Dual-wavelength Flash Raman Mapping Method for Measuring Thermophysical Properties of Supported 2D Nanomaterials

abstract: The thermophysical properties of supported and free-standing nanomaterials would be different due to the substrate effect. To determine the thermophysical properties of supported 2D nanomaterials, this paper developed a two-step dual-wavelength flash Raman (DFR) mapping method. The thermal conductivity of the supported 2D nanomaterial and the thermal contact conductance between the sample and the substrate can be determined by steady-state step. And then the thermal diffusivity of the sample can be characterized by the transient step. Two models are also proposed in this paper. When the substrate temperature rises obviously, a full model considered the substrate temperature distribution is used to decouple the thermal diffusivity, thermal conductivity, and the thermal contact conductance. When the maximum substrate temperature rise is less than 20% of the maximum sample temperature rise, the temperature distribution and variation of the substrate is assumed proportionate to the sample, and then a simplified model can be used to analyse the thermal diffusivity and the other parameters. For the thermal diffusivity, the system error caused by simplifying assumptions is less than 1%, when a dimensionless parameter related to the thermal contact conductance and the thermal conductivity less than 1 and the maximum temperature rise of the substrate less than 15% of that of the supported sample.


title: Hitting distribution of a correlated planar Brownian motion in a disk

abstract: In this paper we study the hitting probability of a circumference $C_R$ for a correlated Brownian motion $\underline{B}(t)=\left(B_1(t), B_2(t)\right)$, $\rho$ being the correlation coefficient. The analysis starts by first mapping the circle $C_R$ into an ellipse $E$ with semiaxes depending on $\rho$ and transforming the differential operator governing the hitting distribution into the classical Laplace operator. By means of two different approaches (one obtained by applying elliptic coordinates) we obtain the desired distribution as a series of Poisson kernels.


title: V2X Communication Between Connected and Automated Vehicles (CAVs) and Unmanned Aerial Vehicles (UAVs)

abstract: Connectivity between ground vehicles can be utilized and expanded to include aerial vehicles for coordinated missions. Using Vehicle-to-Everything (V2X) communication technologies, a communication link can be established between Connected and Autonomous vehicles (CAVs) and Unmanned Aerial vehicles (UAVs). Hardware implementation and testing of a ground to air communication link is crucial for real-life applications. Two different communication links were established, Dedicated Short Range communication (DSRC) and 4G internet based WebSocket communication. Both links were tested separately both for stationary and dynamic test cases. One step further, both links were used together for a real-life use case scenario called Quick Clear demonstration. The aim was to first send ground vehicle location information from the CAV to the UAV through DSRC communication. On the UAV side, the connection between the DSRC modem and Raspberry Pi companion computer was established through User Datagram Protocol (UDP) to get the CAV location information to the companion computer. Raspberry Pi handles 2 different connection, it first connects to a traffic contingency management system (CMP) through Transmission Control Protocol (TCP) to send CAV and UAV location information to the CMP. Secondly, Raspberry Pi uses a WebSocket communication to connect to a web server to send photos taken by an on-board camera the UAV has. Quick Clear demo was conducted both for stationary test and dynamic flight tests. The results show that this communication structure can be utilized for real-life scenarios.


title: Resting state fMRI-based temporal coherence mapping

abstract: Long-range temporal coherence (LRTC) is quite common to dynamic systems and is fundamental to the system function. LRTC in the brain has been shown to be important to cognition. Assessing LRTC may provide critical information for understanding the potential underpinnings of brain organization, function, and cognition. To facilitate this overarching goal, we provide a method, which is named temporal coherence mapping (TCM), to explicitly quantify LRTC using resting state fMRI. TCM is based on correlation analysis of the transit states of the phase space reconstructed by temporal embedding. A few TCM properties were collected to measure LRTC, including the averaged correlation, anti-correlation, the ratio of correlation and anticorrelation, the mean coherent and incoherent duration, and the ratio between the coherent and incoherent time. TCM was first evaluated with simulations and then with the large Human Connectome Project data. Evaluation results showed that TCM metrics can successfully differentiate signals with different temporal coherence regardless of the parameters used to reconstruct the phase space. In human brain, TCM metrics except the ratio of the coherent/incoherent time showed high test-retest reproducibility; TCM metrics are related to age, sex, and total cognitive scores. In summary, TCM provides a first-of-its-kind tool to assess LRTC and the imbalance between coherence and incoherence; TCM properties are physiologically and cognitively meaningful.


title: On the control issues for higher-order nonlinear dispersive equations on the circle

abstract: The local and global control results for a general higher-order KdV-type operator posed on the unit circle are presented. Using spectral analysis, we are able to prove local results, that is, the equation is locally controllable and exponentially stable. To extend the local results to the global one we captured the smoothing properties of the Bourgain spaces, the so-called propagation of singularities, which are proved with a new perspective. These propagation, together with the Strichartz estimates, are the key to extending the local control properties to the global one, precisely, higher-order KdV-type equations are globally controllable and exponentially stabilizable in the Sobolev space $H^{s}(\mathbb{T})$ for any $s \geq 0$. Our results recover previous results in the literature for the KdV and Kawahara equations and extend, for a general higher-order operator of KdV-type, the Strichartz estimates as well as the propagation results, which are the main novelties of this work.


title: Multi Anchor Point Shrinkage for the Sample Covariance Matrix (Extended Version)

abstract: Portfolio managers faced with limited sample sizes must use factor models to estimate the covariance matrix of a high-dimensional returns vector. For the simplest one-factor market model, success rests on the quality of the estimated leading eigenvector "beta". When only the returns themselves are observed, the practitioner has available the "PCA" estimate equal to the leading eigenvector of the sample covariance matrix. This estimator performs poorly in various ways. To address this problem in the high-dimension, limited sample size asymptotic regime and in the context of estimating the minimum variance portfolio, Goldberg, Papanicolau, and Shkolnik developed a shrinkage method (the "GPS estimator") that improves the PCA estimator of beta by shrinking it toward a constant target unit vector. In this paper we continue their work to develop a more general framework of shrinkage targets that allows the practitioner to make use of further information to improve the estimator. Examples include sector separation of stock betas, and recent information from prior estimates. We prove some precise statements and illustrate the resulting improvements over the GPS estimator with some numerical experiments.


title: Modeling and Trajectory Optimization for Standing Long Jumping of a Quadruped with A Preloaded Elastic Prismatic Spine

abstract: This paper presents a novel methodology to model and optimize trajectories of a quadrupedal robot with spinal compliance to improve standing jump performance compared to quadrupeds with a rigid spine. We introduce an elastic model for a prismatic robotic spine that is actively preloaded and mechanically lock-enabled at initial and maximum length, and develop a constrained trajectory optimization method to co-optimize the elastic parameters and motion trajectories toward enhanced jumping distance. Results reveal that a less stiff spring is likely to facilitate jumping performance not as a direct propelling source but as a means to unleash more motor power for propelling by trading-off overall energy efficiency. We also visualize the impact of spring coefficients on the overall optimization routine from energetic perspectives to identify the suitable parameter region.


title: Federated Reconnaissance: Efficient, Distributed, Class-Incremental Learning

abstract: We describe federated reconnaissance, a class of learning problems in which distributed clients learn new concepts independently and communicate that knowledge efficiently. In particular, we propose an evaluation framework and methodological baseline for a system in which each client is expected to learn a growing set of classes and communicate knowledge of those classes efficiently with other clients, such that, after knowledge merging, the clients should be able to accurately discriminate between classes in the superset of classes observed by the set of clients. We compare a range of learning algorithms for this problem and find that prototypical networks are a strong approach in that they are robust to catastrophic forgetting while incorporating new information efficiently. Furthermore, we show that the online averaging of prototype vectors is effective for client model merging and requires only a small amount of communication overhead, memory, and update time per class with no gradient-based learning or hyperparameter tuning. Additionally, to put our results in context, we find that a simple, prototypical network with four convolutional layers significantly outperforms complex, state of the art continual learning algorithms, increasing the accuracy by over 22% after learning 600 Omniglot classes and over 33% after learning 20 mini-ImageNet classes incrementally. These results have important implications for federated reconnaissance and continual learning more generally by demonstrating that communicating feature vectors is an efficient, robust, and effective means for distributed, continual learning.


title: Asynchronous Federated Learning for Sensor Data with Concept Drift

abstract: Federated learning (FL) involves multiple distributed devices jointly training a shared model without any of the participants having to reveal their local data to a centralized server. Most of previous FL approaches assume that data on devices are fixed and stationary during the training process. However, this assumption is unrealistic because these devices usually have varying sampling rates and different system configurations. In addition, the underlying distribution of the device data can change dynamically over time, which is known as concept drift. Concept drift makes the learning process complicated because of the inconsistency between existing and upcoming data. Traditional concept drift handling techniques such as chunk based and ensemble learning-based methods are not suitable in the federated learning frameworks due to the heterogeneity of local devices. We propose a novel approach, FedConD, to detect and deal with the concept drift on local devices and minimize the effect on the performance of models in asynchronous FL. The drift detection strategy is based on an adaptive mechanism which uses the historical performance of the local models. The drift adaptation is realized by adjusting the regularization parameter of objective function on each local device. Additionally, we design a communication strategy on the server side to select local updates in a prudent fashion and speed up model convergence. Experimental evaluations on three evolving data streams and two image datasets show that \model~detects and handles concept drift, and also reduces the overall communication cost compared to other baseline methods.


title: Cross-correlation Power Spectra and Cosmic Birefringence of the CMB via Photon-neutrino Interaction

abstract: In the context of the standard model of particles, the weak interaction of cosmic microwave background (CMB) and cosmic neutrino background (C$\nu$B), can generate non-vanishing TB and EB power spectra in the order of one loop forward scattering, in the presence of scalar perturbation, which is in contrast with the standard scenario cosmology. Comparing our results with the current experimental data may provide, significant information about the nature of C$\nu$B, including CMB-C$\nu$B forward scattering for TB, TE, and EB power spectra. To this end, different cases were studied, including Majorana C$\nu$B and Dirac C$\nu$B. On the other hand, it was shown that the mean opacity due to cosmic neutrino background could behave as an anisotropic birefringent medium and change the linear polarization rotation angle. Considering the contributions from neutrino and anti-neutrino forward scattering with CMB photons (in the case of Dirac neutrino), we introduce relative neutrino and anti-neutrino density asymmetry ($\delta_\nu=\frac{\Delta n_\nu}{n_\nu}=\frac{n_\nu-n_{\bar{\nu}}}{n_\nu}$). Then, using the cosmic birefringence angle reported by the Planck data release $\beta=0.30^\circ\pm0.11^\circ$ ($68\%C.L.$), some constraints can be put on $\delta_\nu$. Also, the value of cosmic birefringence due to Majorana C$\nu$B medium is estimated at about $\beta|_\nu\simeq0.2$ rad. In this respect, since Majorana neutrino and anti-neutrino are exactly the same, both CB contributions will be added together. However, this value is at least two orders larger than the cosmic birefringence angle reported by the Planck data release, $\beta=0.30^\circ\pm0.11^\circ$ ($68\%C.L.$).


title: Study of $D_{s}^{+} \rightarrow K^{+} K^{-} \pi^{+}$ decay

abstract: We investigate the $D_{s}^{+} \rightarrow K^{+} K^{-} \pi^{+}$ decay theoretically with the final state interactions, which is based on the chiral unitary approach and takes into account the external and internal $W$-emission mechanisms at the quark level. Only considering three resonances contributions, the $f_0(980)$ in $S$-wave, the $\bar {K}^{*}(892)^{0}$ and $\phi(1020)$ in $P$-wave, one can make a good description of the recent experimental data from BESIII Collaboration, where the contribution from $S$-wave is found to be small. Besides, we also make a calculation of the corresponding branching fractions, which are consistent with the results of BESIII Collaboration and Particle Data Group.


title: DOA Estimation Using Massive Receive MIMO: Basic Principle and Key Techniques

abstract: As massive multiple-input multiple-output (MIMO) becomes popular, direction of arrival (DOA) measurement has been made a real renaissance due to the high-resolution achieved. Thus, there is no doubt about DOA estimation using massive MIMO. The purpose of this paper is to describe its basic principles and key techniques, to present the performance analysis, and to appreciate its engineering applications. It is anticipated that there are still many challenges in DOA estimation using massive receive MIMO, such as high circuit cost, high energy consumption and high complexity of the algorithm implementation. New researches and breakthroughs are illustrated to deal with those problems. Then, a new architecture, hybrid analog and digital (HAD) massive receive MIMO with low-resolution ADCs, is presented to strike a good balance among circuit cost, complexity and performance. Then, a novel three-dimensional (3D) angle of arrival (AOA) localization method based on geometrical center is proposed to compute the position of a passive emitter using single base station equipped with an ultra-massive MIMO system. And, it can achieve the Cramer-Rao low bound (CRLB). Here, the performance loss is also analyzed to quantify the minimum number of bits. DOA estimation will play a key role in lots of applications, such as directional modulation, beamforming tracking and alignment for 6G.


title: New highly precise weak gravitational lensing flexions measurement method based on ERA method

abstract: Weak gravitational lensing flexions are a kind of weak lensing distortion which are defined as the spin 1 and spin 3 combinations of the third order derivatives of gravitational lensing potential. Since the shear has spin 2 combination of the second order derivative, the flexion signal gives a partly independent information from shear signal and is more sensitive to the local mass distribution than shear signal. Thus its measurement is expected to play important roles in observational cosmology. However, since the weakness of the flexion signal as well as the complicatedness of its intrinsic noise made its accurate observation very difficult. We propose a new method of measuring the flexion signal using ERA method which is a method to measure weak lensing shear without any approximation. We find two particular combinations of the flexions which provide the quantities with only lensing information and free of intrinsic noise when taken average. It is confirmed by simple numerical simulation that the statistical average of these combinations do not in fact depend on the strength of the intrinsic distortion.


title: Fourier series representation of Ferrers function P

abstract: In this note we consider the Fourier expansion of the Ferrers function P of the first kind. We determine its mode of convergence.


title: A Survey of Exploration Methods in Reinforcement Learning

abstract: Exploration is an essential component of reinforcement learning algorithms, where agents need to learn how to predict and control unknown and often stochastic environments. Reinforcement learning agents depend crucially on exploration to obtain informative data for the learning process as the lack of enough information could hinder effective learning. In this article, we provide a survey of modern exploration methods in (Sequential) reinforcement learning, as well as a taxonomy of exploration methods.


title: Programmable thermocapillary shaping of thin liquid films

abstract: We present a method that leverages projected light patterns as a mechanism for freeform deformations of a thin liquid film via the thermocapillary effect. We developed a closed-form solution for the inverse problem of the thin-film evolution equation, allowing to obtain the projection pattern required in order to achieve a desired topography. We experimentally implement the method using a computer controlled light projector, which illuminates any desired pattern onto the bottom of a fluidic chamber patterned with heat absorbing metal pads. The resulting heat map induces surface tension gradients in the liquid-air interface, giving rise to thermocapillary flow that deforms the liquid surface. If a polymer is used for the liquid film, it can then be photocured to yield a solid device. Based on the inverse problem solutions and using this system, we demonstrate the fabrication of several diffractive optical elements (DOEs), including phase masks for extended depth of field imaging, and for 3D localization microscopy. The entire process, from projection to solidification, is completed in less than five minutes, and yields a sub-nanometric surface quality without any post-processing.


title: Singularities and heteroclinic connections in complex-valued evolutionary equations with a quadratic nonlinearity

abstract: In this paper, we consider the dynamics of solutions to complex-valued evolutionary partial differential equations (PDEs) and show existence of heteroclinic orbits from nontrivial equilibria to zero via computer-assisted proofs. We also show that the existence of unbounded solutions along unstable manifolds at the equilibrium follows from the existence of heteroclinic orbits. Our computer-assisted proof consists of three separate techniques of rigorous numerics: an enclosure of a local unstable manifold at the equilibria, a rigorous integration of PDEs, and a constructive validation of a trapping region around the zero equilibrium.


title: Novel Bayesian method for simultaneous detection of activation signatures and background connectivity for task fMRI data

abstract: In this paper, we introduce a new Bayesian approach for analyzing task fMRI data that simultaneously detects activation signatures and background connectivity. Our modeling involves a new hybrid tensor spatial-temporal basis strategy that enables scalable computing yet captures nearby and distant intervoxel correlation and long-memory temporal correlation. The spatial basis involves a composite hybrid transform with two levels: the first accounts for within-ROI correlation, and second between-ROI distant correlation. We demonstrate in simulations how our basis space regression modeling strategy increases sensitivity for identifying activation signatures, partly driven by the induced background connectivity that itself can be summarized to reveal biological insights. This strategy leads to computationally scalable fully Bayesian inference at the voxel or ROI level that adjusts for multiple testing. We apply this model to Human Connectome Project data to reveal insights into brain activation patterns and background connectivity related to working memory tasks.


title: Simultaneous Neural Network Approximation for Smooth Functions

abstract: We establish in this work approximation results of deep neural networks for smooth functions measured in Sobolev norms, motivated by recent development of numerical solvers for partial differential equations using deep neural networks. {Our approximation results are nonasymptotic in the sense that the error bounds are explicitly characterized in terms of both the width and depth of the networks simultaneously with all involved constants explicitly determined.} Namely, for $f\in C^s([0,1]^d)$, we show that deep ReLU networks of width $\mathcal{O}(N\log{N})$ and of depth $\mathcal{O}(L\log{L})$ can achieve a nonasymptotic approximation rate of $\mathcal{O}(N^{-2(s-1)/d}L^{-2(s-1)/d})$ with respect to the $\mathcal{W}^{1,p}([0,1]^d)$ norm for $p\in[1,\infty)$. If either the ReLU function or its square is applied as activation functions to construct deep neural networks of width $\mathcal{O}(N\log{N})$ and of depth $\mathcal{O}(L\log{L})$ to approximate $f\in C^s([0,1]^d)$, the approximation rate is $\mathcal{O}(N^{-2(s-n)/d}L^{-2(s-n)/d})$ with respect to the $\mathcal{W}^{n,p}([0,1]^d)$ norm for $p\in[1,\infty)$.


title: Eyes Tell All: Irregular Pupil Shapes Reveal GAN-generated Faces

abstract: Generative adversary network (GAN) generated high-realistic human faces have been used as profile images for fake social media accounts and are visually challenging to discern from real ones. In this work, we show that GAN-generated faces can be exposed via irregular pupil shapes. This phenomenon is caused by the lack of physiological constraints in the GAN models. We demonstrate that such artifacts exist widely in high-quality GAN-generated faces and further describe an automatic method to extract the pupils from two eyes and analysis their shapes for exposing the GAN-generated faces. Qualitative and quantitative evaluations of our method suggest its simplicity and effectiveness in distinguishing GAN-generated faces.


title: No umbrella needed: Confronting the hypothesis of iron rain on WASP-76b with post-processed general circulation models

abstract: High-resolution spectra are unique indicators of three-dimensional processes in exoplanetary atmospheres. For instance, in 2020, Ehrenreich et al. reported transmission spectra from the ESPRESSO spectrograph yielding an anomalously large Doppler blueshift from the ultra-hot Jupiter WASP-76b. Interpretations of these observations invoke toy model depictions of gas-phase iron condensation in lower-temperature regions of the planet's atmosphere. In this work, we forward model the atmosphere of WASP-76b with double-gray general circulation models (GCMs) and ray-striking radiative transfer to diagnose the planet's high-resolution transmission spectrum. We confirm that a physical mechanism driving strong east-west asymmetries across the terminator must exist to reproduce large Doppler blueshifts in WASP-76b's transmission spectrum. We identify low atmospheric drag and a deep radiative-convective boundary as necessary components of our GCM to produce this asymmetry (the latter is consistent with existing Spitzer phase curves). However, we cannot reproduce either the magnitude or the time-dependence of the WASP-76b Doppler signature with gas-phase iron condensation alone. Instead, we find that high-altitude, optically thick clouds composed of $\rm Al_2O_3$, Fe, or $\rm Mg_2SiO_4$ provide reasonable fits to the Ehrenreich et al. observations -- with marginal contributions from condensation. This fit is further improved by allowing a small orbital eccentricity ($e \approx 0.017$), consistent with prior WASP-76b orbital constraints. We additionally validate our forward-modeled spectra by reproducing lines of nearly all species detected in WASP-76b by Tabernero et al. 2021. Our procedure's success in diagnosing phase-resolved Doppler shifts demonstrates the benefits of physical, self-consistent, three-dimensional simulations in modeling high-resolution spectra of exoplanet atmospheres.


title: Determination of parameters of a potential model for tetraquark study by studying all S-wave mesons

abstract: The masses of low-lying S-wave mesons are evaluated in a constituent quark model (CQM) where the Cornell-like potential and one-gluon exchange spin-spin interaction are employed. To make the model applicable to both the light and heavy quark sectors, we introduce mass-dependent coupling coefficients. There are four free parameters in the model, which are determined by comparing the theoretical results with experimental data. The established model with one set of parameters may be applied to study higher excited meson states as well as multiquark systems in both the light and heavy quark sectors.


title: An Unsupervised Method for Building Sentence Simplification Corpora in Multiple Languages

abstract: The availability of parallel sentence simplification (SS) is scarce for neural SS modelings. We propose an unsupervised method to build SS corpora from large-scale bilingual translation corpora, alleviating the need for SS supervised corpora. Our method is motivated by the following two findings: neural machine translation model usually tends to generate more high-frequency tokens and the difference of text complexity levels exists between the source and target language of a translation corpus. By taking the pair of the source sentences of translation corpus and the translations of their references in a bridge language, we can construct large-scale pseudo parallel SS data. Then, we keep these sentence pairs with a higher complexity difference as SS sentence pairs. The building SS corpora with an unsupervised approach can satisfy the expectations that the aligned sentences preserve the same meanings and have difference in text complexity levels. Experimental results show that SS methods trained by our corpora achieve the state-of-the-art results and significantly outperform the results on English benchmark WikiLarge.


title: A Fokker-Planck feedback control framework for optimal personalized therapies in colon cancer-induced angiogenesis

abstract: In this paper, a new framework for obtaining personalized optimal treatment strategies in colon cancer-induced angiogenesis is presented. The dynamics of colon cancer is given by a It\'o stochastic process, which helps in modeling the randomness present in the system. The stochastic dynamics is then represented by the Fokker-Planck (FP) partial differential equation (PDE) that governs the evolution of the associated probability density function. The optimal therapies are obtained using a three step procedure. First, a finite dimensional FP-constrained optimization problem is formulated that takes input individual noisy patient data, and is solved to obtain the unknown parameters corresponding to the individual tumor characteristics. Next, a sensitivity analysis of the optimal parameter set is used to determine the parameters to be controlled, thus, helping in assessing the types of treatment therapies. Finally, a feedback FP control problem is solved to determine the optimal combination therapies. Numerical results with the combination drug, comprising of Bevacizumab and Capecitabine, demonstrate the efficiency of the proposed framework.


title: On the Bounds of Weak $(1,1)$ Norm of Hardy-Littlewood Maximal Operator with $L\log L({\mathbb S^{n-1}})$ Kernels

abstract: Let $\Omega\in L^1{({\mathbb S^{n-1}})}$, be a function of homogeneous of degree zero, and $M_\Omega$ be the Hardy-Littlewood maximal operator associated with $\Omega$ defined by $M_\Omega(f)(x) = \sup_{r>0}\frac1{r^n}\int_{|x-y|<r}|\Omega(x-y)f(y)|dy.$ It was shown by Christ and Rubio de Francia that $\|M_\Omega(f)\|_{L^{1,\infty}({\mathbb R^n})} \le C(\|\Omega\|_{L\log L({\mathbb S^{n-1}})}+1)\|f\|_{L^1({\mathbb R^n})}$ provided $\Omega\in L\log L {({\mathbb S^{n-1}})}$. In this paper, we show that, if $\Omega\in L\log L({\mathbb S^{n-1}})$, then for all $f\in L^1({\mathbb R^n})$, $M_\Omega$ enjoys the limiting weak-type behaviors that $$\lim_{\lambda\to 0^+}\lambda|\{x\in{\mathbb R^n}:M_\Omega(f)(x)>\lambda\}| = n^{-1}\|\Omega\|_{L^1({\mathbb S^{n-1}})}\|f\|_{L^1({\mathbb R^n})}.$$ This removes the smoothness restrictions on the kernel $\Omega$, such as Dini-type conditions, in previous results. To prove our result, we present a new upper bound of $\|M_\Omega\|_{L^1\to L^{1,\infty}}$, which essentially improves the upper bound $C(\|\Omega\|_{L\log L({\mathbb S^{n-1}})}+1)$ given by Christ and Rubio de Francia. As a consequence, the upper and lower bounds of $\|M_\Omega\|_{L^1\to L^{1,\infty}}$ are obtained for $\Omega\in L\log L {({\mathbb S^{n-1}})}$.


title: Transforming the Preparation of Physics GTAs: Curriculum Development

abstract: Graduate Teaching Assistants (GTAs) are key partners in the education of undergraduates. Given the potentially large impact GTAs can have on undergraduate student learning, it is important to provide them with appropriate preparation for teaching. But GTAs are students themselves, and not all of them desire to pursue an academic career. Fully integrating GTA preparation into the professional development of graduate students lowers the barrier to engagement so that all graduate students may benefit from the opportunity to explore teaching and its applications to many potential career paths. In this paper we describe the design and implementation of a GTA Preparation course for first-year Ph.D. students at the Georgia Tech School of Physics. Through a yearly cycle of implementation and revision, guided by the 3P Framework we developed (Pedagogy, Physics, Professional Development), the course has evolved into a robust and comprehensive professional development program that is well-received by physics graduate students.


title: Epitaxial Integration of a Perpendicularly Magnetized Ferrimagnetic Metal on a Ferroelectric oxide for Electric-Field Control

abstract: Ferrimagnets, which contain the advantages of both ferromagnets (detectable moments) and antiferromagnets (ultrafast spin dynamics), have recently attracted great attention. Here we report the optimization of epitaxial growth of a tetragonal perpendicularly magnetized ferrimagnet Mn2Ga on MgO. Electrical transport, magnetic properties and the anomalous Hall effect (AHE) were systematically studied. Furthermore, we successfully integrated high-quality epitaxial ferrimagnetic Mn2Ga thin films onto ferroelectric PMN-PT single crystals with a MgO buffer layer. It was found that the AHE of such a ferrimagnet can be effectively modulated by a small electric field over a large temperature range in a nonvolatile manner. This work thus demonstrates the great potential of ferrimagnets for developing high-density and low-power spintronic devices.


title: Architecture Aware Latency Constrained Sparse Neural Networks

abstract: Acceleration of deep neural networks to meet a specific latency constraint is essential for their deployment on mobile devices. In this paper, we design an architecture aware latency constrained sparse (ALCS) framework to prune and accelerate CNN models. Taking modern mobile computation architectures into consideration, we propose Single Instruction Multiple Data (SIMD)-structured pruning, along with a novel sparse convolution algorithm for efficient computation. Besides, we propose to estimate the run time of sparse models with piece-wise linear interpolation. The whole latency constrained pruning task is formulated as a constrained optimization problem that can be efficiently solved with Alternating Direction Method of Multipliers (ADMM). Extensive experiments show that our system-algorithm co-design framework can achieve much better Pareto frontier among network accuracy and latency on resource-constrained mobile devices.


title: A generalized bootstrap procedure of the standard error and confidence interval estimation for inverse probability of treatment weighting

abstract: The inverse probability of treatment weighting (IPTW) approach is commonly used in propensity score analysis to infer causal effects in regression models. Due to oversized IPTW weights and errors associated with propensity score estimation, the IPTW approach can underestimate the standard error of causal effect. To remediate this, bootstrap standard errors have been recommended to replace the IPTW standard error, but the ordinary bootstrap (OB) procedure might still result in underestimation of the standard error because of its inefficient sampling algorithm and un-stabilized weights. In this paper, we develop a generalized bootstrap (GB) procedure for estimating the standard error of the IPTW approach. Compared with the OB procedure, the GB procedure has much lower risk of underestimating the standard error and is more efficient for both point and standard error estimates. The GB procedure also has smaller risk of standard error underestimation than the ordinary bootstrap procedure with trimmed weights, with comparable efficiencies. We demonstrate the effectiveness of the GB procedure via a simulation study and a dataset from the National Educational Longitudinal Study-1988 (NELS-88).


title: Task-Oriented Communication for Multi-Device Cooperative Edge Inference

abstract: This paper investigates task-oriented communication for multi-device cooperative edge inference, where a group of distributed low-end edge devices transmit the extracted features of local samples to a powerful edge server for inference. While cooperative edge inference can overcome the limited sensing capability of a single device, it substantially increases the communication overhead and may incur excessive latency. To enable low-latency cooperative inference, we propose a learning-based communication scheme that optimizes local feature extraction and distributed feature encoding in a task-oriented manner, i.e., to remove data redundancy and transmit information that is essential for the downstream inference task rather than reconstructing the data samples at the edge server. Specifically, we leverage an information bottleneck (IB) principle to extract the task-relevant feature at each edge device and adopt a distributed information bottleneck (DIB) framework to formalize a single-letter characterization of the optimal rate-relevance tradeoff for distributed feature encoding. To admit flexible control of the communication overhead, we extend the DIB framework to a distributed deterministic information bottleneck (DDIB) objective that explicitly incorporates the representational costs of the encoded features. As the IB-based objectives are computationally prohibitive for high-dimensional data, we adopt variational approximations to make the optimization problems tractable. To compensate the potential performance loss due to the variational approximations, we also develop a selective retransmission (SR) mechanism to identify the redundancy in the encoded features of multiple edge devices to attain additional communication overhead reduction. Extensive experiments evidence that the proposed task-oriented communication scheme achieves a better rate-relevance tradeoff than baseline methods.


title: FADE: FAir Double Ensemble Learning for Observable and Counterfactual Outcomes

abstract: Methods for building fair predictors often involve tradeoffs between fairness and accuracy and between different fairness criteria, but the nature of these tradeoffs varies. Recent work seeks to characterize these tradeoffs in specific problem settings, but these methods often do not accommodate users who wish to improve the fairness of an existing benchmark model without sacrificing accuracy, or vice versa. These results are also typically restricted to observable accuracy and fairness criteria. We develop a flexible framework for fair ensemble learning that allows users to efficiently explore the fairness-accuracy space or to improve the fairness or accuracy of a benchmark model. Our framework can simultaneously target multiple observable or counterfactual fairness criteria, and it enables users to combine a large number of previously trained and newly trained predictors. We provide theoretical guarantees that our estimators converge at fast rates. We apply our method on both simulated and real data, with respect to both observable and counterfactual accuracy and fairness criteria. We show that, surprisingly, multiple unfairness measures can sometimes be minimized simultaneously with little impact on accuracy, relative to unconstrained predictors or existing benchmark models.


title: The rational cuspidal subgroup of $J_0(p^2M)$ with $M$ squarefree

abstract: For a positive integer $N$, let $\mathscr{C}_N(\mathbb{Q})$ be the rational cuspidal subgroup of $J_0(N)$ and $\mathscr{C}(N)$ be the rational cuspidal divisor class group of $X_0(N)$, which are both subgroups of the rational torsion subgroup of $J_0(N)$. We prove that two groups $\mathscr{C}_N(\mathbb{Q})$ and $\mathscr{C}(N)$ are equal when $N=p^2M$ for any prime $p$ and any squarefree integer $M$. To achieve this we show that all modular units on $X_0(N)$ can be written as products of certain functions $F_{m, h}$, which are constructed from generalized Dedekind eta functions. Also, we determine the necessary and sufficient conditions for such products to be modular units on $X_0(N)$ under a mild assumption.


title: What Have Been Learned & What Should Be Learned? An Empirical Study of How to Selectively Augment Text for Classification

abstract: Text augmentation techniques are widely used in text classification problems to improve the performance of classifiers, especially in low-resource scenarios. Whilst lots of creative text augmentation methods have been designed, they augment the text in a non-selective manner, which means the less important or noisy words have the same chances to be augmented as the informative words, and thereby limits the performance of augmentation. In this work, we systematically summarize three kinds of role keywords, which have different functions for text classification, and design effective methods to extract them from the text. Based on these extracted role keywords, we propose STA (Selective Text Augmentation) to selectively augment the text, where the informative, class-indicating words are emphasized but the irrelevant or noisy words are diminished. Extensive experiments on four English and Chinese text classification benchmark datasets demonstrate that STA can substantially outperform the non-selective text augmentation methods.


title: Effect of tensor force on lowering of 5/2$^{-}$ level in heavier Cu isotopes

abstract: The inversion of 3/2$^{-}$ and 5/2$^{-}$ levels in heavier Cu isotopes is one of the most visible example of shell-evolution, caused by the strong monopole attraction between the nucleons occupying the orbitals $\pi 0f_{5/2}$ and $\nu 0g_{9/2}$. The tensor part of the nucleon-nucleon interaction is expected to be the driving force behind this monopole migration. In shell model framework, usually spin-tensor decomposition is used to get the information of individual force components to the shell evolution, however, in the present scenario, this method can not apply on \textit{pfg} model space due to the missing spin-orbit partners $ 0f_{7/2}$ and $ 0g_{7/2}$. Therefore, we have analytically obtained the tensor force two-body matrix elements (TBMEs) for this model space using Yukawa potential, and subtract it from effective interaction jj44b \cite{}. The interaction without tensor part, named as jj44a, have been used for calculation of Ni, Zn, Ge and Cu isotopes with various physics viewpoints. In most of the cases, the theoretical results are in good agreement with the experiment only when tensor force is included to the interaction jj44a.


title: Problem Learning: Towards the Free Will of Machines

abstract: A machine intelligence pipeline usually consists of six components: problem, representation, model, loss, optimizer and metric. Researchers have worked hard trying to automate many components of the pipeline. However, one key component of the pipeline--problem definition--is still left mostly unexplored in terms of automation. Usually, it requires extensive efforts from domain experts to identify, define and formulate important problems in an area. However, automatically discovering research or application problems for an area is beneficial since it helps to identify valid and potentially important problems hidden in data that are unknown to domain experts, expand the scope of tasks that we can do in an area, and even inspire completely new findings. This paper describes Problem Learning, which aims at learning to discover and define valid and ethical problems from data or from the machine's interaction with the environment. We formalize problem learning as the identification of valid and ethical problems in a problem space and introduce several possible approaches to problem learning. In a broader sense, problem learning is an approach towards the free will of intelligent machines. Currently, machines are still limited to solving the problems defined by humans, without the ability or flexibility to freely explore various possible problems that are even unknown to humans. Though many machine learning techniques have been developed and integrated into intelligent systems, they still focus on the means rather than the purpose in that machines are still solving human defined problems. However, proposing good problems is sometimes even more important than solving problems, because a good problem can help to inspire new ideas and gain deeper understandings. The paper also discusses the ethical implications of problem learning under the background of Responsible AI.