title: Dopant-defect interactions and their impact on local crystal stoichiometry studies in Mg-doped GaN via atom probe tomography

abstract: In this work, doping-defect interactions relevant to self-compensation in p-type GaN were investigated using atom probe tomography. The 3D visualization of ion distribution revealed the formation of spherical Mg-rich clusters and the segregation of Mg dopant towards dislocations in MOCVD-grown GaN:Mg. Impurities related to self-compensation, such as oxygen and hydrogen, were identified and detected adjacent to Mg-rich dislocations. Crystal stoichiometry around the defect regions was investigated to understand how the defects can serve as traps and influence dopant diffusion. Non-stoichiometric regions of N:Ga were found adjacent to Mg-rich dislocations and overlapping with some Mg-rich clusters, indicating potential traps. Variations in N:Ga were not proportional to the Mg content, suggesting that the microfeatures (clusters and dislocations) interact differently with local chemistry. Techniques for defining the quality of an APT experiment through invalidation of artifacts are also demonstrated. Mg-rich defects and variations in N:Ga were found to be independent of artifacts related to the evaporation field in APT.


title: On epimorphisms in some categories of infinite-dimensional Lie groups

abstract: Let $X$ be a smooth compact connected manifold. Let $G=\mbox{Diff}\, X$ be the group of diffeomorphisms of $X$, equipped with the $C^\infty$-topology, and let $H$ be the stabilizer of some point in $X$. Then the inclusion $H\to G$, which is a morphism of two regular Fr\'echet--Lie groups, is an epimorphism in the category of smooth Lie groups modelled on complete locally convex spaces. At the same time, in the latter category, epimorphisms between finite dimensional Lie groups have dense range. We also prove that if $G$ is a Banach--Lie group and $H$ is a proper closed subgroup, the inclusion $H\to G$ is not an epimorphism in the category of Hausdorff groups.


title: Anomaly Detection for Scenario-based Insider Activities using CGAN Augmented Data

abstract: Insider threats are the cyber attacks from within the trusted entities of an organization. Lack of real-world data and issue of data imbalance leave insider threat analysis an understudied research area. To mitigate the effect of skewed class distribution and prove the potential of multinomial classification algorithms for insider threat detection, we propose an approach that combines generative model with supervised learning to perform multi-class classification using deep learning. The generative adversarial network (GAN) based insider detection model introduces Conditional Generative Adversarial Network (CGAN) to enrich minority class samples to provide data for multi-class anomaly detection. The comprehensive experiments performed on the benchmark dataset demonstrates the effectiveness of introducing GAN derived synthetic data and the capability of multi-class anomaly detection in insider activity analysis. Moreover, the method is compared with other existing methods against different parameters and performance metrics.


title: Nonlocal complement value problem for a global in time parabolic equation

abstract: The overreaching goal of this paper is to investigate the existence and uniqueness of weak solution of a semilinear parabolic equation with double nonlocality in space and in time variables that naturally arises while modeling a biological nano-sensor in the chaotic dynamics of a polymer chain. In fact, the problem under consideration involves a symmetric integrodifferential operator of L\'{e}vy type and a term called the interaction potential, that depends on the time-integral of the solution over the entire interval of solving the problem. Owing to the Galerkin approximation, the existence and uniqueness of a weak solution of the nonlocal complement value problem is proven for small time under fair conditions on the interaction potential.


title: Leveraging User Behavior History for Personalized Email Search

abstract: An effective email search engine can facilitate users' search tasks and improve their communication efficiency. Users could have varied preferences on various ranking signals of an email, such as relevance and recency based on their tasks at hand and even their jobs. Thus a uniform matching pattern is not optimal for all users. Instead, an effective email ranker should conduct personalized ranking by taking users' characteristics into account. Existing studies have explored user characteristics from various angles to make email search results personalized. However, little attention has been given to users' search history for characterizing users. Although users' historical behaviors have been shown to be beneficial as context in Web search, their effect in email search has not been studied and remains unknown. Given these observations, we propose to leverage user search history as query context to characterize users and build a context-aware ranking model for email search. In contrast to previous context-dependent ranking techniques that are based on raw texts, we use ranking features in the search history. This frees us from potential privacy leakage while giving a better generalization power to unseen users. Accordingly, we propose a context-dependent neural ranking model (CNRM) that encodes the ranking features in users' search history as query context and show that it can significantly outperform the baseline neural model without using the context. We also investigate the benefit of the query context vectors obtained from CNRM on the state-of-the-art learning-to-rank model LambdaMart by clustering the vectors and incorporating the cluster information. Experimental results show that significantly better results can be achieved on LambdaMart as well, indicating that the query clusters can characterize different users and effectively turn the ranking model personalized.


title: 3D Fully Convolutional Neural Networks with Intersection Over Union Loss for Crop Mapping from Multi-Temporal Satellite Images

abstract: Information on cultivated crops is relevant for a large number of food security studies. Different scientific efforts are dedicated to generating this information from remote sensing images by means of machine learning methods. Unfortunately, these methods do not take account of the spatial-temporal relationships inherent in remote sensing images. In our paper, we explore the capability of a 3D Fully Convolutional Neural Network (FCN) to map crop types from multi-temporal images. In addition, we propose the Intersection Over Union (IOU) loss function for increasing the overlap between the predicted classes and ground reference data. The proposed method was applied to identify soybean and corn from a study area situated in the US corn belt using multi-temporal Landsat images. The study shows that our method outperforms related methods, obtaining a Kappa coefficient of 91.8%. We conclude that using the IOU loss function provides a superior choice to learn individual crop types.


title: Boundary unique continuation on $C^1$-Dini domains and the size of the singular set

abstract: Let $u$ be a harmonic function in a $C^1$-Dini domain $D$ such that $u$ vanishes on a boundary surface ball $\partial D \cap B_{5R}(0)$. We consider an effective version of its singular set (up to boundary) $\mathcal{S}(u):=\{X\in \overline{D}: u(X) = |\nabla u(X)| = 0\} $ and give an estimate of its $(d-2)$-dimensional Minkowski content, which only depends on the upper bound of some modified frequency function of $u$ centered at $0$. Such results are already known in the interior and at the boundary of convex domains, when the standard frequency function is monotone at every point. The novelty of our work on Dini domains is how to compensate for the lack of such monotone quantities at boundary as well as interior points.


title: Evolution of the Stokes parameters, polarization singularities, and optical skyrmion

abstract: A physical theory is presented for polarized light from an aspect of polarization singularity.This is carried out by analyzing the evolution equation of the Stokes parameters that is derived from the nonlinear Schrodinger type equation. The problem is explored from two aspects:The first is concerning the single mode Stokes parameter that is described by the propagation distance $ z $. The trajectory of the polarization singularities is simply given by the points satisfying a rule: $ S_3 (z) = +(-)S_0 $ and $ 0 $ ($ S_3 $ represents the third component of the Stokes parameters), which form a tube like surface centered with the C-line surrounded by L-surfaces in the presence of the linear as well as the nonlinear birefringence. It is pointed out that the optical activity (or chirality) plays an "obstacle" to reveal the polarization singularity. As the other aspect, we consider the field theoretic aspect of the Stokes parameters, for which a special solution, called an optical skyrmion, is constructed to explicate the polarization singularity.The skyrmion forms a {tube}, and the dynamical content of which is briefly discussed. On the basis of the work presented here further analysis would be expected to reveal hidden aspects of polarization optics.


title: Stable intersections of regular conformal Cantor sets with large Hausdorff dimensions

abstract: In this paper we prove that among pairs $K,\,K' \subset \mathbb{C}$ of conformal dynamically defined Cantor sets with sum of Hausdorff dimensions $HD(K)+HD(K')>2$, there is an open and dense subset of such pairs verifying $\text{int}(K-K')\neq \emptyset$. This is motivated by the work \cite{MY}, where Moreira and Yoccoz proved a similar statement for dynamically defined Cantor sets in the real line. Here we adapt their argument to the context of conformal Cantor sets in the complex plane, this requires the introduction of several new concepts and a more detailed analysis in some parts of the argument.


title: Robust Classification using Hidden Markov Models and Mixtures of Normalizing Flows

abstract: We test the robustness of a maximum-likelihood (ML) based classifier where sequential data as observation is corrupted by noise. The hypothesis is that a generative model, that combines the state transitions of a hidden Markov model (HMM) and the neural network based probability distributions for the hidden states of the HMM, can provide a robust classification performance. The combined model is called normalizing-flow mixture model based HMM (NMM-HMM). It can be trained using a combination of expectation-maximization (EM) and backpropagation. We verify the improved robustness of NMM-HMM classifiers in an application to speech recognition.


title: Complex Multiplication and Noether-Lefschetz Loci of the Twistor Space of a K3 Surface

abstract: For an algebraic K3 surface with complex multiplication (CM), algebraic fibres of the associated twistor space away from the equator are again of CM type. In this paper, we show that algebraic fibres corresponding to points at the same altitude of the twistor base $S^2\simeq \mathbb{P}^1_\mathbb{C}$ share the same CM endomorphism field. Moreover, we determine all the admissible Picard numbers of the twistor fibres.


title: A Theory of Choice Bracketing under Risk

abstract: Aggregating risks from multiple sources can be complex and demanding, and decision makers usually adopt heuristics to simplify the evaluation process. This paper axiomatizes two closed related and yet different heuristics, narrow bracketing and correlation neglect, by relaxing the independence axiom in the expected utility theory. The flexibility of our framework allows for applications in various economic problems. First, our model can explain the experimental evidence of narrow bracketing over monetary gambles. Second, when one source represents background risk, we can accommodate Rabin (2000)'s critique and explain risk aversion over small gambles. Finally, when different sources represent consumptions in different periods, we unify three seemingly distinct models of time preferences and propose a novel model that simultaneously satisfies indifference to temporal resolution of uncertainty, separation of time and risk preferences, and recursivity in the domain of lotteries. As a direct application to macroeconomics and finance, we provide an alternative to Epstein and Zin (1989) which avoids the unreasonably high timing premium discussed in Epstein, Farhi, and Strzalecki (2014).


title: On the stability of the area law for the entanglement entropy of the Landau Hamiltonian

abstract: We consider the two-dimensional ideal Fermi gas subject to a magnetic field which is perpendicular to the Euclidean plane $\mathbb R^2$ and whose strength $B(x)$ at $x\in\mathbb R^2$ converges to some $B_0>0$ as $\|x\|\to\infty$. Furthermore, we allow for an electric potential $V_\varepsilon$ which vanishes at infinity. They define the single-particle Landau Hamiltonian of our Fermi gas (up to gauge fixing). Starting from the ground state of this Fermi gas with chemical potential $\mu\ge B_0$ we study the asymptotic growth of its bipartite entanglement entropy associated to $L\Lambda$ as $L\to\infty$ for some fixed bounded region $\Lambda\subset\mathbb R^2$. We show that its leading order in $L$ does not depend on the perturbations $B_\varepsilon := B_0 - B$ and $V_\varepsilon$ if they satisfy some mild decay assumptions. Our result holds for all $\alpha$-R\' enyi entropies $\alpha>1/3$; for $\alpha\le 1/3$, we have to assume in addition some differentiability of the perturbations $B_\varepsilon$ and $V_\varepsilon$. The case of a constant magnetic field $B_\varepsilon = 0$ and with $V_\varepsilon= 0$ was treated recently for general $\mu$ by Leschke, Sobolev and Spitzer. Our result thus proves the stability of that area law under the same regularity assumptions on the boundary $\partial \Lambda$.


title: A Tale of Three Datasets: Towards Characterizing Mobile Broadband Access in the United States

abstract: Understanding and improving mobile broadband deployment is critical to bridging the digital divide and targeting future investments. Yet accurately mapping mobile coverage is challenging. In 2019, the Federal Communications Commission (FCC) released a report on the progress of mobile broadband deployment in the United States. This report received a significant amount of criticism with claims that the cellular coverage, mainly available through Long-Term Evolution (LTE), was over-reported in some areas, especially those that are rural and/or tribal [12]. We evaluate the validity of this criticism using a quantitative analysis of both the dataset from which the FCC based its report and a crowdsourced LTE coverage dataset. Our analysis is focused on the state of New Mexico, a region characterized by diverse mix of demographics-geography and poor broadband access. We then performed a controlled measurement campaign in northern New Mexico during May 2019. Our findings reveal significant disagreement between the crowdsourced dataset and the FCC dataset regarding the presence of LTE coverage in rural and tribal census blocks, with the FCC dataset reporting higher coverage than the crowdsourced dataset. Interestingly, both the FCC and the crowdsourced data report higher coverage compared to our on-the-ground measurements. Based on these findings, we discuss our recommendations for improved LTE coverage measurements, whose importance has only increased in the COVID-19 era of performing work and school from home, especially in rural and tribal areas.


title: Radflow: A Recurrent, Aggregated, and Decomposable Model for Networks of Time Series

abstract: We propose a new model for networks of time series that influence each other. Graph structures among time series are found in diverse domains, such as web traffic influenced by hyperlinks, product sales influenced by recommendation, or urban transport volume influenced by road networks and weather. There has been recent progress in graph modeling and in time series forecasting, respectively, but an expressive and scalable approach for a network of series does not yet exist. We introduce Radflow, a novel model that embodies three key ideas: a recurrent neural network to obtain node embeddings that depend on time, the aggregation of the flow of influence from neighboring nodes with multi-head attention, and the multi-layer decomposition of time series. Radflow naturally takes into account dynamic networks where nodes and edges change over time, and it can be used for prediction and data imputation tasks. On real-world datasets ranging from a few hundred to a few hundred thousand nodes, we observe that Radflow variants are the best performing model across a wide range of settings. The recurrent component in Radflow also outperforms N-BEATS, the state-of-the-art time series model. We show that Radflow can learn different trends and seasonal patterns, that it is robust to missing nodes and edges, and that correlated temporal patterns among network neighbors reflect influence strength. We curate WikiTraffic, the largest dynamic network of time series with 366K nodes and 22M time-dependent links spanning five years. This dataset provides an open benchmark for developing models in this area, with applications that include optimizing resources for the web. More broadly, Radflow has the potential to improve forecasts in correlated time series networks such as the stock market, and impute missing measurements in geographically dispersed networks of natural phenomena.


title: On Numbers of Tuples of Nilpotent Matrices over Finite Fields under Simultaneous Conjugation

abstract: The problem of classifying tuples of nilpotent matrices over a field under simultaneous conjugation is considered "hopeless". However, for any given matrix order over a finite field, the number of concerned orbits is always finite. This paper gives a closed formula for the number of absolutely indecomposable orbits using the same methodology as Hua [5]; those orbits are non-splittable over field extensions. As a consequence, those numbers are always polynomials in the cardinality of the base field with integral coefficients. It is conjectured that those coefficients are always non-negative.


title: Constrained realizations of 2MRS density and peculiar velocity fields: growth rate and local flow

abstract: We generate constrained realizations (CRs) of the density and peculiar velocity fields within $200 \; h^{-1} \, \mathrm{Mpc}$ from the final release of the Two-Micron All-Sky Redshift Survey (2MRS) $-$ the densest all-sky redshift survey to date. The CRs are generated by combining a Wiener filter estimator in spherical Fourier-Bessel space with random realizations of log-normally distributed density fields and Poisson-sampled galaxy positions. The algorithm is tested and calibrated on a set of semi-analytic mock catalogs mimicking the environment of the Local Group (LG), to rigorously account for the statistical and systematic errors of the reconstruction method. By comparing our peculiar velocity CRs with the observed velocities from the Cosmicflows-3 catalog, we constrain the normalized linear growth rate to $f \sigma_8^\mathrm{lin} = 0.367 \pm 0.060$, which is consistent at the $1.1 \sigma$ level with the latest Planck results as well as other direct probes. Simultaneously, we estimate a bulk flow contribution from sources beyond the 2MRS reconstruction volume of $B^\mathrm{ext} = 199 \pm 68 \; \mathrm{km} \, \mathrm{s}^{-1}$ towards $l = 299 \pm 18^\circ$, $b = 8 \pm 19^\circ$. The total reconstructed velocity field at the position of the LG, smoothed with a $1 \; h^{-1} \, \mathrm{Mpc}$ Gaussian, is $685 \pm 75 \; \mathrm{km} \, \mathrm{s}^{-1}$ towards $l = 270.6 \pm 6.6^\circ$, $b = 35.5 \pm 7.2^\circ$, in good agreement with the observed CMB dipole. The total reconstructed bulk flow within different radii is compatible with other measurements. Within a $50 \; h^{-1} \, \mathrm{Mpc}$ Gaussian window we find a bulk flow of $274 \pm 50 \; \mathrm{km} \, \mathrm{s}^{-1}$ towards $l = 287 \pm 9^\circ$, $b = 11 \pm 10^\circ$. The code used to generate the CRs and obtain these results, dubbed CORAS, is made publicly available.


title: Accurate prediction of the properties of materials using the CAM-B3LYP Density Functional

abstract: Density functionals with asymptotic corrections to the long-range potential provide entry-level methods for calculations on molecules that can sustain charge transfer, but similar applications in Materials Science are rare. We describe an implementation of the CAM-B3LYP range-separated functional within the Vienna Ab-initio Simulation Package (VASP) framework, together with its analytical functional derivatives. Results obtained for eight representative materials: aluminum, diamond, graphene, silicon, NaCl, MgO, 2D h-BN and 3D h-BN, indicate that CAM-B3LYP predictions embody mean-absolute deviations (MAD) compared to HSE06 that are reduced by a factor of 6 for lattice parameters, 4 for quasiparticle band gaps, 3 for the lowest optical excitation energies, and 6 for exciton binding energies. Further, CAM-B3LYP appears competitive compared to ab initio G0W0 and Bethe-Salpeter equation (BSE) approaches. The CAM-B3LYP implementation in VASP was verified by comparison of optimized geometries and reaction energies for isolated molecules taken from the ACCDB database, evaluated in large periodic unit cells, to analogous results obtained using Gaussian basis sets. Using standard GW pseudopotentials and energy cutoffs for the plane-wave calculations and the aug-cc-pV5Z basis set for the atomic-basis ones, the MAD in energy for 1738 chemical reactions was 0.34 kcal mol-1, whilst for 480 unique bond lengths this was 0.0036 {\AA}; these values reduced to 0.28 kcal mol-1 (largest error 0.94 kcal mol-1) and 0.0009 {\AA} by increasing the plane-wave cuttoff energy to 850 eV.


title: Calibrating X-ray binary luminosity functions via optical reconnaissance I. The case of M83

abstract: Building on recent work by Chandar et al. (2020), we construct X-ray luminosity functions (XLFs) for different classes of X-ray binary (XRB) donors in the nearby star-forming galaxy M83 through a novel methodology: rather than classifying low- vs. high-mass XRBs based on the scaling of the number of X-ray sources with stellar mass and star formation rate, respectively, we utilize multi-band Hubble Space Telescope imaging data to classify each Chandra-detected compact X-ray source as a low-mass (i.e. donor mass <~ 3 solar masses), high-mass (donor mass >~ 8 solar masses) or intermediate-mass XRB based on either the location of its candidate counterpart on optical color-magnitude diagrams or the age of its host star cluster. In addition to the the standard (single and/or truncated) power-law functional shape, we approximate the resulting XLFs with a Schechter function. We identify a marginally significant (at the 1-to-2 sigma level) exponential downturn for the high-mass XRB XLF, at logLx ~ 38.48^{+0.52}_{-0.33} (in log CGS units). In contrast, the low- and intermediate-mass XRB XLFs, as well as the total XLF of M83, are formally consistent with sampling statistics from a single power-law. Our method suggests a non-negligible contribution from low- and possibly intermediate-mass XRBs to the total XRB XLF of M83, i.e. between 20 and 50%, in broad agreement with X-ray based XLFs. More generally, we caution against considerable contamination from X-ray emitting supernova remnants to the published, X-ray based XLFs of M83, and possibly all actively star-forming galaxies.


title: Intertwined Ferroelectricity and Topological State in Two-Dimensional Multilayer

abstract: The intertwined ferroelectricity and band topology will enable the non-volatile control of the topological states, which is of importance for nanoelectrics with low energy costing and high response speed. Nonetheless, the principle to design the novel system is unclear and the feasible approach to achieve the coexistence of two parameter orders is absent. Here, we propose a general paradigm to design 2D ferroelectric topological insulators by sliding topological multilayers on the basis of first-principles calculations. Taking trilayer Bi2Te3 as a model system, we show that in the van der Waals multilayer based 2D topological insulators, the in-plane and out-of-plane ferroelectricity can be induced through a specific interlayer sliding, to enable the coexistence of ferroelectric and topological orders. The strong coupling of the order parameters renders the topological states sensitive to polarization flip, realizing non-volatile ferroelectric control of topological properties. The revealed design-guideline and ferroelectric-topological coupling not only are useful for the fundamental research of the coupled ferroelectric and topological physics in 2D lattices, but also enable novel applications in nanodevices.


title: The challenges of changing teaching assistants' grading practices: Requiring students to show evidence of understanding

abstract: Teaching assistants (TAs) are often responsible for grading in introductory physics courses at large research universities. Their grading practices can shape students' approaches to problem solving and learning. Physics education research recommends grading practices that encourage students to provide evidence of understanding via explication of the problem-solving process. However, TAs may not necessarily grade in a manner that encourages students to provide evidence of understanding in their solutions. Within the context of a semester-long TA professional development course, we investigated whether encouraging TAs to use a grading rubric that appropriately weights the problem-solving process and having them reflect upon the benefits of using such a rubric prompts TAs to require evidence of understanding in student solutions. We examined how the TAs graded realistic student solutions to introductory physics problems before they were provided a rubric, whether TAs used the rubric as intended, whether they were consistent in grading similar solutions, and how TAs' grading criteria changed after discussing the benefits of a well-designed rubric. We find that many TAs typically applied the rubric consistently when grading similar student solutions but did not require students to provide evidence of understanding. TAs' written responses, class discussions, and individual interviews suggest that the instructional activities involving the grading rubrics in this study were not sufficient to change their grading practices. Interviews and class discussions suggest that helping TAs value a rubric that appropriately weights the problem-solving process may be challenging partly due to the TAs past educational experiences and the departmental context.


title: Crossover between trivial zero modes in Majorana nanowires

abstract: We consider the superconductor-semiconductor nanowire hybrid Majorana platform ("Majorana nanowire") in the presence of a deterministic spatially slowly varying inhomogeneous chemical potential and a random spatial quenched potential disorder, both of which are known to produce nontopological almost-zero-energy modes mimicking the theoretically predicted topological Majorana zero modes. We study the crossover among these mechanisms by calculating the tunnel conductance while varying the relative strength between inhomogeneous potential and random disorder in a controlled manner. We find that the entire crossover region manifests abundant trivial zero modes, many of which showing the apparent "quantization" of the zero-bias conductance peak at $ 2e^2/h $, with occasional disorder-dominated peaks exceeding $ 2e^2/h $. We present animations of the simulated crossover behavior and discuss experimental implications. Additionally, in order to simulate the realistic disorder in experimental nanowires, we also study in depth the case of disorder arising from random individual static impurities along the wire, and consider crossover associated with such impurity effects. Our results, when compared qualitatively with existing Majorana nanowire experimental results, indicate the dominant role of random disorder in the experiments. It turns out that all three mechanisms may produce trivial zero-bias peaks in the tunnel conductance, and the crossover among these physical mechanisms (i.e., when more than one mechanism is present in the system) is smooth and continuous, making it difficult a priori to conclude which mechanism is dominant in a particular sample just by a casual inspection of the zero-bias conductance peaks.


title: Axisymmetric deformation of compressible, nearly incompressible, and incompressible thin layers between two rigid surfaces

abstract: Accurate asymptotic solutions are presented for axisymmetric deformation of thin layers constrained by either two rigid plates or two rigid spheres. Those solutions are developed using Saint-Venant's principle and the layer thinness as the only assumptions. The solutions are valid in the entire range of Poisson's ratios, and allow one to distinguish among compressible, nearly incompressible, and incompressible layers. That classification involves both material and geometric parameters.


title: A Deep Adversarial Model for Suffix and Remaining Time Prediction of Event Sequences

abstract: Event suffix and remaining time prediction are sequence to sequence learning tasks. They have wide applications in different areas such as economics, digital health, business process management and IT infrastructure monitoring. Timestamped event sequences contain ordered events which carry at least two attributes: the event's label and its timestamp. Suffix and remaining time prediction are about obtaining the most likely continuation of event labels and the remaining time until the sequence finishes, respectively. Recent deep learning-based works for such predictions are prone to potentially large prediction errors because of closed-loop training (i.e., the next event is conditioned on the ground truth of previous events) and open-loop inference (i.e., the next event is conditioned on previously predicted events). In this work, we propose an encoder-decoder architecture for open-loop training to advance the suffix and remaining time prediction of event sequences. To capture the joint temporal dynamics of events, we harness the power of adversarial learning techniques to boost prediction performance. We consider four real-life datasets and three baselines in our experiments. The results show improvements up to four times compared to the state of the art in suffix and remaining time prediction of event sequences, specifically in the realm of business process executions. We also show that the obtained improvements of adversarial training are superior compared to standard training under the same experimental setup.


title: Block decomposition and statistics arising from permutation tableaux

abstract: Permutation statistics $\wnm$ and $\rlm$ are both arising from permutation tableaux. $\wnm$ was introduced by Chen and Zhou, which was proved equally distributed with the number of unrestricted rows of a permutation tableau. While $\rlm$ is showed by Nadeau equally distributed with the number of $1$'s in the first row of a permutation tableau. In this paper, we investigate the joint distribution of $\wnm$ and $\rlm$. Statistic $(\rlm,\wnm,\rlmin,\des,(\underline{321}))$ is shown equally distributed with $(\rlm,\rlmin,\wnm,\des,(\underline{321}))$ on $S_n$. Then the generating function of $(\rlm,\wnm)$ follows. An involution is constructed to explain the symmetric property of the generating function. Also, we study the triple statistic $(\wnm,\rlm,\asc)$, which is shown to be equally distributed with $(\rlmax-1,\rlmin,\asc)$ as studied by Josuat-Verg$\grave{e}$s. The main method we adopt throughout the paper is constructing bijections based on a block decomposition of permutations.


title: Some Computations on Instanton Knot Homology

abstract: In a recent paper, the first author and his collaborator developed a method to compute an upper bound of the dimension of instanton Floer homology via Heegaard Diagrams of 3-manifolds. For a knot inside S3, we further develop an algorithm that can compute an upper bound of the dimension of instanton knot homology from knot diagrams. We test the effectiveness of the algorithm and found that for all knots up to seven crossings, the algorithm provides sharp bounds. In the second half of the paper, we show that, if the instanton knot Floer homology of a knot has a specified form, then the knot must an instanton L-space knot.


title: Nearly Minimax Optimal Regret for Learning Infinite-horizon Average-reward MDPs with Linear Function Approximation

abstract: We study reinforcement learning in an infinite-horizon average-reward setting with linear function approximation, where the transition probability function of the underlying Markov Decision Process (MDP) admits a linear form over a feature mapping of the current state, action, and next state. We propose a new algorithm UCRL2-VTR, which can be seen as an extension of the UCRL2 algorithm with linear function approximation. We show that UCRL2-VTR with Bernstein-type bonus can achieve a regret of $\tilde{O}(d\sqrt{DT})$, where $d$ is the dimension of the feature mapping, $T$ is the horizon, and $\sqrt{D}$ is the diameter of the MDP. We also prove a matching lower bound $\tilde{\Omega}(d\sqrt{DT})$, which suggests that the proposed UCRL2-VTR is minimax optimal up to logarithmic factors. To the best of our knowledge, our algorithm is the first nearly minimax optimal RL algorithm with function approximation in the infinite-horizon average-reward setting.


title: Development and Validation of a conceptual survey instrument to evaluate introductory physics students' understanding of thermodynamics

abstract: We discuss the development and validation of a conceptual multiple-choice survey instrument called the Survey of Thermodynamic Processes and First and Second Laws (STPFaSL) suitable for introductory physics courses. The survey instrument uses common student difficulties with these concepts as resources in that the incorrect answers to the multiple-choice questions were guided by them. After the development and validation of the survey instrument, the final version was administered at six different institutions. It was administered to introductory physics students in various traditionally taught calculus-based and algebra-based classes in paper-pencil format before and after traditional lecture-based instruction in relevant concepts. We also administered the survey instrument to upper-level undergraduates majoring in physics and Ph.D. students for bench marking and for content validity and compared their performance with those of introductory students for whom the survey is intended. We find that although the survey instrument focuses on thermodynamics concepts covered in introductory courses, it is challenging even for advanced students. A comparison with the base line data on the validated survey instrument presented here can help instructors evaluate the effectiveness of innovative pedagogies designed to help students develop a solid grasp of these concepts.


title: An improvement of the integrability of the state space of the $\Phi^4_3$-process and the support of the $\Phi ^4_3$-measure constructed by the limit of stationary processes of approximating stochastic quantization equations

abstract: We improve the integrability of the state space of the $\Phi ^4_3$-process and the support of the $\Phi ^4_3$-measure on the torus obtained in [Albeverio, Kusuoka, Ann. Sc. Norm. Super. Pisa Cl. Sci. (5), 2020]. For the improvement, we improve the estimates of the H\"older continuity in time of the solutions to approximation equations. In the present paper, we only discuss the estimates different from those in [Albeverio, Kusuoka, Ann. Sc. Norm. Super. Pisa Cl. Sci. (5), 2020].


title: CAP-GAN: Towards Adversarial Robustness with Cycle-consistent Attentional Purification

abstract: Adversarial attack is aimed at fooling the target classifier with imperceptible perturbation. Adversarial examples, which are carefully crafted with a malicious purpose, can lead to erroneous predictions, resulting in catastrophic accidents. To mitigate the effects of adversarial attacks, we propose a novel purification model called CAP-GAN. CAP-GAN takes account of the idea of pixel-level and feature-level consistency to achieve reasonable purification under cycle-consistent learning. Specifically, we utilize the guided attention module and knowledge distillation to convey meaningful information to the purification model. Once a model is fully trained, inputs would be projected into the purification model and transformed into clean-like images. We vary the capacity of the adversary to argue the robustness against various types of attack strategies. On the CIFAR-10 dataset, CAP-GAN outperforms other pre-processing based defenses under both black-box and white-box settings.


title: On the $H^1(ds)$-gradient flow for the length functional

abstract: In this article we consider the length functional defined on the space of immersed planar curves. The $L^2(ds)$ Riemannian metric gives rise to the curve shortening flow as the gradient flow of the length functional. Motivated by the triviality of the metric topology in this space, we consider the gradient flow of the length functional with respect to the $H^1(ds)$-metric. Circles with radius $r_0$ shrink with $r(t) = \sqrt{W(e^{c-2t})}$ under the flow, where $W$ is the Lambert $W$ function and $c = r_0^2 + \log r_0^2$. We conduct a thorough study of this flow, giving existence of eternal solutions and convergence for general initial data, preservation of regularity in various spaces, qualitative properties of the flow after an appropriate rescaling, and numerical simulations.


title: Vehicle to Vehicle (V2V) Communication Protocol: Components, Benefits, Challenges, Safety and Machine Learning Applications

abstract: Vehicle to vehicle communication is a new technology that enables vehicles on roads to communicate with each other to reduce traffic, accidents and ensure the safety of people. The main objective of vehicle-to-vehicle communication protocol is to create an effective communication system for intelligent transport systems. The advancement in technology made vehicle industries to develop automatic vehicles that can share real-time information and protect each other from accidents. This research paper gives an explanation about the vehicle-to-vehicle communication process, benefits, and the challenges in enabling vehicle-to-vehicle communication as well as safety and machine learning applications.


title: I-vector Based Within Speaker Voice Quality Identification on connected speech

abstract: Voice disorders affect a large portion of the population, especially heavy voice users such as teachers or call-center workers. Most voice disorders can be treated effectively with behavioral voice therapy, which teaches patients to replace problematic, habituated voice production mechanics with optimal voice production technique(s), yielding improved voice quality. However, treatment often fails because patients have difficulty differentiating their habitual voice from the target technique independently, when clinician feedback is unavailable between therapy sessions. Therefore, with the long term aim to extend clinician feedback to extra-clinical settings, we built two systems that automatically differentiate various voice qualities produced by the same individual. We hypothesized that 1) a system based on i-vectors could classify these qualities as if they represent different speakers and 2) such a system would outperform one based on traditional voice signal processing algorithms. Training recordings were provided by thirteen amateur actors, each producing 5 perceptually different voice qualities in connected speech: normal, breathy, fry, twang, and hyponasal. As hypothesized, the i-vector system outperformed the acoustic measure system in classification accuracy (i.e. 97.5\% compared to 77.2\%, respectively). Findings are expected because the i-vector system maps features to an integrated space which better represents each voice quality than the 22-feature space of the baseline system. Therefore, an i-vector based system has potential for clinical application in voice therapy and voice training.


title: Log-time Prediction Markets for Interval Securities

abstract: We design a prediction market to recover a complete and fully general probability distribution over a random variable. Traders buy and sell interval securities that pay \$1 if the outcome falls into an interval and \$0 otherwise. Our market takes the form of a central automated market maker and allows traders to express interval endpoints of arbitrary precision. We present two designs in both of which market operations take time logarithmic in the number of intervals (that traders distinguish), providing the first computationally efficient market for a continuous variable. Our first design replicates the popular logarithmic market scoring rule (LMSR), but operates exponentially faster than a standard LMSR by exploiting its modularity properties to construct a balanced binary tree and decompose computations along the tree nodes. The second design consists of two or more parallel LMSR market makers that mediate submarkets of increasingly fine-grained outcome partitions. This design remains computationally efficient for all operations, including arbitrage removal across submarkets. It adds two additional benefits for the market designer: (1) the ability to express utility for information at various resolutions by assigning different liquidity values, and (2) the ability to guarantee a true constant bounded loss by appropriately decreasing the liquidity in each submarket.


title: Where to locate COVID-19 mass vaccination facilities?

abstract: The outbreak of COVID-19 led to a record-breaking race to develop a vaccine. However, the limited vaccine capacity creates another massive challenge: how to distribute vaccines to mitigate the near-end impact of the pandemic? In the United States in particular, the new Biden administration is launching mass vaccination sites across the country, raising the obvious question of where to locate these clinics to maximize the effectiveness of the vaccination campaign. This paper tackles this question with a novel data-driven approach to optimize COVID-19 vaccine distribution. We first augment a state-of-the-art epidemiological model, called DELPHI, to capture the effects of vaccinations and the variability in mortality rates across age groups. We then integrate this predictive model into a prescriptive model to optimize the location of vaccination sites and subsequent vaccine allocation. The model is formulated as a bilinear, non-convex optimization model. To solve it, we propose a coordinate descent algorithm that iterates between optimizing vaccine distribution and simulating the dynamics of the pandemic. As compared to benchmarks based on demographic and epidemiological information, the proposed optimization approach increases the effectiveness of the vaccination campaign by an estimated $20\%$, saving an extra $4000$ extra lives in the United States over a three-month period. The proposed solution achieves critical fairness objectives -- by reducing the death toll of the pandemic in several states without hurting others -- and is highly robust to uncertainties and forecast errors -- by achieving similar benefits under a vast range of perturbations.


title: On Ray Shooting for Triangles in 3-Space and Related Problems

abstract: We consider several problems that involve lines in three dimensions, and present improved algorithms for solving them. The problems include (i) ray shooting amid triangles in $R^3$, (ii) reporting intersections between query lines (segments, or rays) and input triangles, as well as approximately counting the number of such intersections, (iii) computing the intersection of two nonconvex polyhedra, (iv) detecting, counting, or reporting intersections in a set of lines in $R^3$, and (v) output-sensitive construction of an arrangement of triangles in three dimensions. Our approach is based on the polynomial partitioning technique. For example, our ray-shooting algorithm processes a set of $n$ triangles in $R^3$ into a data structure for answering ray shooting queries amid the given triangles, which uses $O(n^{3/2+\varepsilon})$ storage and preprocessing, and answers a query in $O(n^{1/2+\varepsilon})$ time, for any $\varepsilon>0$. This is a significant improvement over known results, obtained more than 25 years ago, in which, with this amount of storage, the query time bound is roughly $n^{5/8}$. The algorithms for the other problems have similar performance bounds, with similar improvements over previous results. We also derive a nontrivial improved tradeoff between storage and query time. Using it, we obtain algorithms that answer $m$ queries on $n$ objects in \[ \max \left\{ O(m^{2/3}n^{5/6+\varepsilon} + n^{1+\varepsilon}),\; O(m^{5/6+\varepsilon}n^{2/3} + m^{1+\varepsilon}) \right\} \] time, for any $\varepsilon>0$, again an improvement over the earlier bounds.


title: Predicting the Characteristics of Defect Transitions on Curved Surfaces

abstract: The energetically optimal position of lattice defects on intrinsically curved surfaces is a complex function of shape parameters. For open surfaces, a simple condition predicts the critical size for which a central disclination yields lower energy than a boundary disclination. In practice, this transition is modified by activation energies or more favorable intermediate defect positions. Here it is shown that these transition characteristics (continuous or discontinuous, first or second order) can also be inferred from analytical, general criteria evaluated from the surface shape. A universal scale of activation energy is found, and the criterion is generalized to predict transition order as symmetries such as that of the shape are broken. The results give practical insight into structural transitions to disorder in many cellular materials of technological and biological importance.


title: Confidence-Aware Learning Assistant

abstract: Not only correctness but also self-confidence play an important role in improving the quality of knowledge. Undesirable situations such as confident incorrect and unconfident correct knowledge prevent learners from revising their knowledge because it is not always easy for them to perceive the situations. To solve this problem, we propose a system that estimates self-confidence while solving multiple-choice questions by eye tracking and gives feedback about which question should be reviewed carefully. We report the results of three studies measuring its effectiveness. (1) On a well-controlled dataset with 10 participants, our approach detected confidence and unconfidence with 81% and 79% average precision. (2) With the help of 20 participants, we observed that correct answer rates of questions were increased by 14% and 17% by giving feedback about correct answers without confidence and incorrect answers with confidence, respectively. (3) We conducted a large-scale data recording in a private school (72 high school students solved 14,302 questions) to investigate effective features and the number of required training samples.


title: Field Evaluations of A Deep Learning-based Intelligent Spraying Robot with Flow Control for Pear Orchards

abstract: This paper proposes a variable flow control system in real time with deep learning using the segmentation of fruit trees in a pear orchard. The flow rate control in real time, undesired pressure fluctuation and theoretical modeling may differ from those in the real world. Therefore, two types of preliminary experiments were designed to examine the linear relationship of the flow rate modeling. Through a preliminary experiment, the parameters of the pulse width modulation (PWM) controller were optimized, and an actual field experiment was conducted to confirm the performance of the variable flow rate control system. As a result of the field experiment, the performance of the proposed system was satisfactory, as it showed that it could reduce pesticide use and the risk of pesticide exposure. Especially, since the field experiment was conducted in an unstructured environment, the proposed variable flow control system is expected to be sufficiently applicable to other orchards.


title: The Role of Momentum Parameters in the Optimal Convergence of Adaptive Polyak's Heavy-ball Methods

abstract: The adaptive stochastic gradient descent (SGD) with momentum has been widely adopted in deep learning as well as convex optimization. In practice, the last iterate is commonly used as the final solution to make decisions. However, the available regret analysis and the setting of constant momentum parameters only guarantee the optimal convergence of the averaged solution. In this paper, we fill this theory-practice gap by investigating the convergence of the last iterate (referred to as individual convergence), which is a more difficult task than convergence analysis of the averaged solution. Specifically, in the constrained convex cases, we prove that the adaptive Polyak's Heavy-ball (HB) method, in which only the step size is updated using the exponential moving average strategy, attains an optimal individual convergence rate of $O(\frac{1}{\sqrt{t}})$, as opposed to the optimality of $O(\frac{\log t}{\sqrt {t}})$ of SGD, where $t$ is the number of iterations. Our new analysis not only shows how the HB momentum and its time-varying weight help us to achieve the acceleration in convex optimization but also gives valuable hints how the momentum parameters should be scheduled in deep learning. Empirical results on optimizing convex functions and training deep networks validate the correctness of our convergence analysis and demonstrate the improved performance of the adaptive HB methods.


title: A Further Note on an Innovations Approach to Viterbi Decoding of Convolutional Codes

abstract: In this paper, we show that the soft-decision input to the main decoder in an SST Viterbi decoder is regarded as the innovation as well from the viewpoint of mutual information and mean-square error. It is assumed that a code sequence is transmitted symbol by symbol over an AWGN channel using BPSK modulation. Then we can consider the signal model, where the signal is composed of the signal-to-noise ratio (SNR) and the equiprobable binary input. By assuming that the soft-decision input to the main decoder is the innovation, we show that the minimum mean-square error (MMSE) in estimating the binary input is expressed in terms of the distribution of the encoded block for the main decoder. It is shown that the obtained MMSE satisfies indirectly the known relation between the mutual information and the MMSE in Gaussian channels. Thus the derived MMSE is justified, which in turn implies that the soft-decision input to the main decoder can be regarded as the innovation. Moreover, we see that the input-output mutual information is connected with the distribution of the encoded block for the main decoder.


title: An Energy Sharing Mechanism Achieving the Same Flexibility as Centralized Dispatch

abstract: Deploying distributed renewable energy at the demand side is an important measure to implement a sustainable society. However, the massive small solar and wind generation units are beyond the control of a central operator. To encourage users to participate in energy management and reduce the dependence on dispatchable resources, a peer-to-peer energy sharing scheme is proposed which releases the flexibility at the demand side. Every user makes decision individually considering only local constraints; the microgrid operator announces the sharing prices subjective to the coupling constraints without knowing users' local constraints. This can help protect privacy. We prove that the proposed mechanism can achieve the same disutility and flexibility as centralized dispatch, and develop an effective modified best response based algorithm for reaching the market equilibrium. The concept of absorbable region is presented to measure the operating flexibility under the proposed energy sharing mechanism. A linear programming based polyhedral projection algorithm is developed to compute that region. Case studies validate the theoretical results and show that the proposed method is scalable.


title: Multimodal Mobility Systems: Joint Optimization of Transit Network Design and Pricing

abstract: The performance of multimodal mobility systems relies on the seamless integration of conventional mass transit services and the advent of Mobility-on-Demand (MoD) services. Prior work is limited to individually improving various transport networks' operations or linking a new mode to an existing system. In this work, we attempt to solve transit network design and pricing problems of multimodal mobility systems en masse. An operator (public transit agency or private transit operator) determines the frequency settings of the mass transit system, flows of the MoD service, and prices for each trip to optimize the overall welfare. A primal-dual approach, inspired by the market design literature, yields a compact mixed integer linear programming (MILP) formulation. However, a key computational challenge remains in allocating an exponential number of hybrid modes accessible to travelers. We provide a tractable solution approach through a decomposition scheme and approximation algorithm that accelerates the computation and enables optimization of large-scale problem instances. Using a case study in Nashville, Tennessee, we demonstrate the value of the proposed model. We also show that our algorithm reduces the average runtime by 60\% compared to advanced MILP solvers. This result seeks to establish a generic and simple-to-implement way of revamping and redesigning regional mobility systems in order to meet the increase in travel demand and integrate traditional fixed-line mass transit systems with new demand-responsive services.


title: A Global to Local Double Embedding Method for Multi-person Pose Estimation

abstract: Multi-person pose estimation is a fundamental and challenging problem to many computer vision tasks. Most existing methods can be broadly categorized into two classes: top-down and bottom-up methods. Both of the two types of methods involve two stages, namely, person detection and joints detection. Conventionally, the two stages are implemented separately without considering their interactions between them, and this may inevitably cause some issue intrinsically. In this paper, we present a novel method to simplify the pipeline by implementing person detection and joints detection simultaneously. We propose a Double Embedding (DE) method to complete the multi-person pose estimation task in a global-to-local way. DE consists of Global Embedding (GE) and Local Embedding (LE). GE encodes different person instances and processes information covering the whole image and LE encodes the local limbs information. GE functions for the person detection in top-down strategy while LE connects the rest joints sequentially which functions for joint grouping and information processing in A bottom-up strategy. Based on LE, we design the Mutual Refine Machine (MRM) to reduce the prediction difficulty in complex scenarios. MRM can effectively realize the information communicating between keypoints and further improve the accuracy. We achieve the competitive results on benchmarks MSCOCO, MPII and CrowdPose, demonstrating the effectiveness and generalization ability of our method.


title: The Peculiar X-ray Transient Swift J0840.7-3516: an Unusual Low Mass X-ray Binary or a Tidal Disruption Event?

abstract: We report on the X-ray properties of the new transient Swift J0840.7$-$3516, discovered with Swift/BAT in 2020 February, using extensive data of Swift, MAXI, NICER, and NuSTAR. The source flux increased for $\sim 10^3$ s after the discovery, decayed rapidly over $\sim$ 5 orders of magnitude in 5 days, and then remained almost constant over 9 months. Large-amplitude short-term variations on time scales of 1--$10^4$ s were observed throughout the decay. In the initial flux rise, the source showed a hard power-law shaped spectrum with a photon index of $\sim 1.0$ extending up to $\sim 30$ keV, above which an exponential cutoff was present. The photon index increased in the following rapid decay and became $\sim 2$ at the end of the decay. A spectral absorption feature at 3--4 keV was detected in the decay. It is not straightforward to explain all the observed properties by any known class of X-ray sources. We discuss the possible nature of the source, including a Galactic low mass X-ray binary with multiple extreme properties and a tidal disruption event by a supermassive black hole or a Galactic neutron star.


title: Data-driven analysis of the electronic-structure factors controlling the work functions of perovskite oxides

abstract: Tuning the work functions of materials is of practical interest for maximizing the performance of microelectronic and (photo)electrochemical devices, as the efficiency of these systems depends on the ability to control electronic levels at surfaces and across interfaces. Perovskites are promising compounds to achieve such control. In this work, we examine the work functions of more than 1,000 perovskite oxide surfaces (ABO$_3$) by data-driven (machine-learning) analysis and identify the factors that determine their magnitude. While the work functions of BO$_2$-terminated surfaces are sensitive to the energy of the hybridized oxygen p bands, the work functions of AO-terminated surfaces exhibit a much less trivial dependence with respect to the filling of the d bands of the B-site atom and of its electronic affinity. This study shows the utility of interpretable data-driven models in analyzing the work functions of cubic perovskites from a limited number of electronic-structure descriptors.


title: A longitudinal analysis of students' motivational characteristics in introductory physics courses: Gender differences

abstract: The lack of diversity and the under-performance of underrepresented students in STEM courses have been the focus of researchers in the last decade. In particular, many hypotheses have been put forth for the reasons for the under-representation and under-performance of women in physics. Here, we present a framework for helping all students learn in science courses that takes into account four factors: 1) characteristics of instruction and learning tools, 2) implementation of instruction and learning tools, 3) student characteristics, and 4) students' environments. While there has been much research on factor 1 (characteristics of instruction and learning tools), there has been less focus on factor 2 (students' characteristics, and in particular, motivational factors). Here, we focus on the baseline motivational characteristics of introductory physics students obtained from survey data to inform factor 2 of the framework. A longitudinal analysis of students' motivational characteristics in two-semester introductory physics courses was performed by administering pre- and post-surveys that evaluated students' self-efficacy, grit, fascination with physics, value associated with physics, intelligence mindset, and physics epistemology. Female students reported lower self-efficacy, fascination and value, and had a more "fixed" view of intelligence in the context of physics compared to male students. Grit was the only factor on which female students reported averages that were equal to or higher than male students throughout introductory physics courses. These gender differences can at least partly be attributed to the societal stereotypes and biases about who belongs in physics and can excel in it. The findings inform the framework and have implications for the development and implementation of effective pedagogies and learning tools to help all students learn.


title: Nanoptera in weakly nonlinear woodpile and diatomic granular chains

abstract: We study ``nanoptera'', which are non-localized solitary waves with exponentially small but non-decaying oscillations, in two singularly-perturbed Hertzian chains with precompression. These two systems are woodpile chains (which we model as systems of Hertzian particles and springs) and diatomic Hertzian chains with alternating masses. We demonstrate that nanoptera arise from Stokes phenomena and appear as special curves, called Stokes curves, are crossed in the complex plane. We use techniques from exponential asymptotics to obtain approximations of the oscillation amplitudes. Our analysis demonstrates that traveling waves in a singularly perturbed woodpile chain have a single Stokes curve, across which oscillations appear. Comparing these asymptotic predictions with numerical simulations reveals that this accurately describes the non-decaying oscillatory behavior in a woodpile chain. We perform a similar analysis of a diatomic Hertzian chain, that the nanpteron solution has two distinct exponentially small oscillatory contributions. We demonstrate that there exists a set of mass ratios for which these two contributions cancel to produce localized solitary waves. This result builds on prior experimental and numerical observations that there exist mass ratios that support localized solitary waves in diatomic Hertzian chains without precompression. Comparing asymptotic and numerical results in a diatomic Hertzian chain with precompression reveals that our exponential asymptotic approach accurately predicts the oscillation amplitude for a wide range of system parameters, but it fails to identify several values of the mass ratio that correspond to localized solitary-wave solutions.


title: Magic thickness of 25 {\AA} makes periodic metal-insulator transitions

abstract: Novel quantum phenomena, including high-temperature superconductivity, topological properties, and charge/spin density waves, appear in low-dimensional conductive materials. It is possible to artificially create low-dimensional systems by fabricating ultrathin films, quantum wires, or quantum dots with flat interfaces. Some experiments have been performed on ultrathin compounds of strongly correlated electron systems. However, since it is technically difficult to control multiple elements precisely, most of the properties of artificially fabricated low-dimensional compounds fall into uncharted territory. Here we show that extraordinary metal-insulator transitions that oscillate depending on the scale occur in CaRuO_3 films with a thickness of around several unit cells. We grow high-crystalline CaRuO_3 ultrathin films, whose surface roughness is controlled at 199 pm, by molecular beam epitaxy. We observe that resistivity oscillates with a magic thickness of 25 {\AA}, which changes by 3 and 9 orders of magnitude at room temperature and at low temperature, respectively. These changes are much larger than quantum size effects. We also confirm the same periodicity with photoelectron spectroscopy by etching the ultrathin film. Considering the large energy, periodicity and anisotropy, we conclude that the oscillating transitions originate from the commensurability of Mott insulation triggered by Peierls instability arising from a dual restriction on the dimensions in wavenumber space and real space. We have shown the possibility of producing new functional materials by controlling film thickness on electron correlated compounds at the picometer level.


title: Multifractal analysis in non-uniformly hyperbolic interval maps

abstract: In this paper, we study the Hausdorff dimension of the generalized intrinsic level set with respect to the given ergodic meausre in a class of non-uniformly hyperbolic interval maps with finitely many branches.


title: Cross-modal Adversarial Reprogramming

abstract: With the abundance of large-scale deep learning models, it has become possible to repurpose pre-trained networks for new tasks. Recent works on adversarial reprogramming have shown that it is possible to repurpose neural networks for alternate tasks without modifying the network architecture or parameters. However these works only consider original and target tasks within the same data domain. In this work, we broaden the scope of adversarial reprogramming beyond the data modality of the original task. We analyze the feasibility of adversarially repurposing image classification neural networks for Natural Language Processing (NLP) and other sequence classification tasks. We design an efficient adversarial program that maps a sequence of discrete tokens into an image which can be classified to the desired class by an image classification model. We demonstrate that by using highly efficient adversarial programs, we can reprogram image classifiers to achieve competitive performance on a variety of text and sequence classification benchmarks without retraining the network.


title: Parameterized Energy-Optimal Regenerative Braking Strategy for Connected and Autonomous Electrified Vehicles: A Real-Time Dynamic Programming Approach

abstract: This paper presents a vehicle speed planning system called the energy-optimal deceleration planning system (EDPS), which aims to maximize energy recuperation of regenerative braking of connected and autonomous electrified vehicles. A recuperation energy-optimal speed profile is computed based on the impending deceleration requirements for turning or stopping at an intersection. This is computed to maximize the regenerative braking energy while satisfying the physical limits of an electrified powertrain. In automated driving, the powertrain of an electrified vehicle can be directly controlled by the vehicle control unit such that it follows the computed optimal speed profile. To obtain smooth optimal deceleration speed profiles, optimal deceleration commands are determined by a parameterized polynomial-based deceleration model that is obtained by regression analyses with real vehicle driving test data. The parameters are dependent on preview information such as residual time and distance as well as target speed. The key design parameter is deceleration time, which determines the deceleration speed profile to satisfy the residual time and distance constraints as well as the target speed requirement. The bounds of deceleration commands corresponding to the physical limits of the powertrain are deduced from realistic deceleration test driving. The state constraints are dynamically updated by considering the anticipated road load and the deceleration preference. For validation and comparisons of the EDPS with different preview distances, driving simulation tests with a virtual road environment and vehicle-to-infrastructure connectivity are presented. It is shown that the longer preview distance in the EDPS, the more energy-recuperation. In comparison with driver-in-the-loop simulation tests, EDPS-based autonomous driving shows improvements in energy recuperation and reduction in trip time.


title: Guided Interpolation for Adversarial Training

abstract: To enhance adversarial robustness, adversarial training learns deep neural networks on the adversarial variants generated by their natural data. However, as the training progresses, the training data becomes less and less attackable, undermining the robustness enhancement. A straightforward remedy is to incorporate more training data, but sometimes incurring an unaffordable cost. In this paper, to mitigate this issue, we propose the guided interpolation framework (GIF): in each epoch, the GIF employs the previous epoch's meta information to guide the data's interpolation. Compared with the vanilla mixup, the GIF can provide a higher ratio of attackable data, which is beneficial to the robustness enhancement; it meanwhile mitigates the model's linear behavior between classes, where the linear behavior is favorable to generalization but not to the robustness. As a result, the GIF encourages the model to predict invariantly in the cluster of each class. Experiments demonstrate that the GIF can indeed enhance adversarial robustness on various adversarial training methods and various datasets.


title: Correlations between $\gamma$-ray luminosity and magnetization of the jet as well as relativistic electron injection power:cases for Mrk 421, 3C 454.3 and 3C 279

abstract: By fitting high-quality and simultaneous multi-wavelength (MWL) spectral energy distributions (SEDs) at multiple epochs with a one-zone leptonic jet model, we study jet properties of the three famous blazars Mrk 421, 3C 454.3 and 3C 279. In the jet model, the emitting electron energy distributions (EEDs) are calculated by solving the kinetic equation of electron injection, escape, adiabatic and radiative energy losses. To explore multi-dimensional parameter space systematically, we employ a Markov chain Monte Carlo (MCMC) fitting technique. The properties of emission regions we derived here are consistent with those in previous studies, e.g., the particle-dominated and low-magnetization jet. The new finding is that there is a tight correlation between $\gamma$-ray luminosity and electron injection power and an anti-correlation between $\gamma$-ray luminosity and jet magnetization parameter. The results suggest that same energy-dissipative mechanism (like a shock) could be operating in the jets of different types of blazars, and the origin of $\gamma$-ray flares is associated with the particle acceleration process.


title: Symmetric Operations on Domains of Size at Most 4

abstract: To convert a fractional solution to an instance of a constraint satisfaction problem into a solution, a rounding scheme is needed, which can be described by a collection of symmetric operations with one of each arity. An intriguing possibility, raised in a recent paper by Carvalho and Krokhin, would imply that any clone of operations on a set $D$ which contains symmetric operations of arities $1, 2, \ldots, \lvert D \rvert$ contains symmetric operations of all arities in the clone. If true, then it is possible to check whether any given family of constraint satisfaction problems is solved by its linear programming relaxation. We characterize all idempotent clones containing symmetric operations of arities $1, 2, \ldots, \lvert D \rvert$ for all sets $D$ with size at most four and prove that each one contains symmetric operations of every arity, proving the conjecture above for $\lvert D \rvert \leq 4$.


title: A Modulation-Domain Loss for Neural-Network-based Real-time Speech Enhancement

abstract: We describe a modulation-domain loss function for deep-learning-based speech enhancement systems. Learnable spectro-temporal receptive fields (STRFs) were adapted to optimize for a speaker identification task. The learned STRFs were then used to calculate a weighted mean-squared error (MSE) in the modulation domain for training a speech enhancement system. Experiments showed that adding the modulation-domain MSE to the MSE in the spectro-temporal domain substantially improved the objective prediction of speech quality and intelligibility for real-time speech enhancement systems without incurring additional computation during inference.


title: Unbendable rational curves of Goursat type and Cartan type

abstract: We study unbendable rational curves, i.e., nonsingular rational curves in a complex manifold of dimension $n$ with normal bundles isomorphic to $\mathcal{O}_{\mathbb{P}^1}(1)^{\oplus p} \oplus \mathcal{O}_{\mathbb{P}^1}^{\oplus (n-1-p)}$ for some nonnegative integer $p$. Well-known examples arise from algebraic geometry as general minimal rational curves of uniruled projective manifolds. After describing the relations between the differential geometric properties of the natural distributions on the deformation spaces of unbendable rational curves and the projective geometric properties of their varieties of minimal rational tangents, we concentrate on the case of $p=1$ and $n \leq 5$, which is the simplest nontrivial situation. In this case, the families of unbendable rational curves fall essentially into two classes: Goursat type or Cartan type. Those of Goursat type arise from ordinary differential equations and those of Cartan type have special features related to contact geometry. We show that the family of lines on any nonsingular cubic 4-fold is of Goursat type, whereas the family of lines on a general quartic 5-fold is of Cartan type, in the proof of which the projective geometry of varieties of minimal rational tangents plays a key role.


title: Attribution Mask: Filtering Out Irrelevant Features By Recursively Focusing Attention on Inputs of DNNs

abstract: Attribution methods calculate attributions that visually explain the predictions of deep neural networks (DNNs) by highlighting important parts of the input features. In particular, gradient-based attribution (GBA) methods are widely used because they can be easily implemented through automatic differentiation. In this study, we use the attributions that filter out irrelevant parts of the input features and then verify the effectiveness of this approach by measuring the classification accuracy of a pre-trained DNN. This is achieved by calculating and applying an \textit{attribution mask} to the input features and subsequently introducing the masked features to the DNN, for which the mask is designed to recursively focus attention on the parts of the input related to the target label. The accuracy is enhanced under a certain condition, i.e., \textit{no implicit bias}, which can be derived based on our theoretical insight into compressing the DNN into a single-layer neural network. We also provide Gradient\,*\,Sign-of-Input (GxSI) to obtain the attribution mask that further improves the accuracy. As an example, on CIFAR-10 that is modified using the attribution mask obtained from GxSI, we achieve the accuracy ranging from 99.8\% to 99.9\% without additional training.


title: AI Ethics Needs Good Data

abstract: In this chapter we argue that discourses on AI must transcend the language of 'ethics' and engage with power and political economy in order to constitute 'Good Data'. In particular, we must move beyond the depoliticised language of 'ethics' currently deployed (Wagner 2018) in determining whether AI is 'good' given the limitations of ethics as a frame through which AI issues can be viewed. In order to circumvent these limits, we use instead the language and conceptualisation of 'Good Data', as a more expansive term to elucidate the values, rights and interests at stake when it comes to AI's development and deployment, as well as that of other digital technologies. Good Data considerations move beyond recurring themes of data protection/privacy and the FAT (fairness, transparency and accountability) movement to include explicit political economy critiques of power. Instead of yet more ethics principles (that tend to say the same or similar things anyway), we offer four 'pillars' on which Good Data AI can be built: community, rights, usability and politics. Overall we view AI's 'goodness' as an explicly political (economy) question of power and one which is always related to the degree which AI is created and used to increase the wellbeing of society and especially to increase the power of the most marginalized and disenfranchised. We offer recommendations and remedies towards implementing 'better' approaches towards AI. Our strategies enable a different (but complementary) kind of evaluation of AI as part of the broader socio-technical systems in which AI is built and deployed.


title: On the extreme rays of the cone of $3\times 3$ quasiconvex quadratic forms: Extremal determinats vs extremal and polyconvex forms

abstract: This work is concerned with the study of the extreme rays of the convex cone of $3\times 3$ quasiconvex quadratic forms (denoted by ${\cal C}_3$). We characterize quadratic forms $f\in {\cal C}_3,$ the determinant of the acoustic tensor of which is an extremal polynomial, and conjecture/discuss about other cases. We prove that in the case when the determinant of the acoustic tensor of a form $f\in {\cal C}_3$ is an extremal polynomial other than a perfect square, then the form must itself be an extreme ray of ${\cal C}_3;$ when the determinant is a perfect square, then the form is either an extreme ray of ${\cal C}_3$ or polyconvex; and finally, when the determinant is identically zero, then the form $f$ must be polyconvex. The zero determinant case plays an important role in the proofs of the other two cases. We also make a conjecture on the extreme rays of ${\cal C}_3,$ and discuss about weak and strong etremals of ${\cal C}_d$ for $d\geq 3.$ where it turns out that several properties of ${\cal C}_3$ do not hold for ${\cal C}_d$ for $d>3,$ and thus case $d=3$ is special. These results recover all previously known results (to our best knowledge) on examples of extreme points of ${\cal C}_3$ that were proved to be such. Our results also improve the ones proven by the first author and Milton [20].


title: Matrix Fej\'{e}r and Levin-Ste\v{c}kin Inequalities

abstract: Fe{j}\'er and Levin-Ste\v{c}kin inequalities treat integrals of the product of convex functions with symmetric functions. The main goal of this article is to present possible matrix versions of these inequalities. In particular, majorization results are shown of Fej\'{e}r type for both convex and log-convex functions. For matrix Levin-Ste\v{c}kin type, we present more rigorous results involving the partial Loewner ordering for Hermitian matrices.


title: Relaxation of optimal transport problem via strictly convex functions

abstract: An optimal transport problem on finite spaces is a linear program. Recently, a relaxation of the optimal transport problem via strictly convex functions, especially via the Kullback--Leibler divergence, sheds new light on data sciences. This paper provides the mathematical foundations and an iterative process based on a gradient descent for the relaxed optimal transport problem via Bregman divergences.


title: Machine Learning on Camera Images for Fast mmWave Beamforming

abstract: Perfect alignment in chosen beam sectors at both transmit- and receive-nodes is required for beamforming in mmWave bands. Current 802.11ad WiFi and emerging 5G cellular standards spend up to several milliseconds exploring different sector combinations to identify the beam pair with the highest SNR. In this paper, we propose a machine learning (ML) approach with two sequential convolutional neural networks (CNN) that uses out-of-band information, in the form of camera images, to (i) rapidly identify the locations of the transmitter and receiver nodes, and then (ii) return the optimal beam pair. We experimentally validate this intriguing concept for indoor settings using the NI 60GHz mmwave transceiver. Our results reveal that our ML approach reduces beamforming related exploration time by 93% under different ambient lighting conditions, with an error of less than 1% compared to the time-intensive deterministic method defined by the current standards.


title: OGLE-2018-BLG-0567Lb and OGLE-2018-BLG-0962Lb: Two Microlensing Planets through Planetary-Caustic Channel

abstract: We present the analyses of two microlensing events, OGLE-2018-BLG-0567 and OGLE-2018-BLG-0962. In both events, the short-lasting anomalies were densely and continuously covered by two high-cadence surveys. The light-curve modeling indicates that the anomalies are generated by source crossings over the planetary caustics induced by planetary companions to the hosts. The estimated planet/host separation (scaled to the angular Einstein radius $\theta_{\rm E}$) and mass ratio are $(s, q) = (1.81, 1.24\times10^{-3})$ and $(s, q) = (1.25, 2.38\times10^{-3})$, respectively. From Bayesian analyses, we estimate the host and planet masses as $(M_{\rm h}, M_{\rm p}) = (0.24_{-0.13}^{+0.16}\,M_{\odot}, 0.32_{-0.16}^{+0.34}\,M_{\rm J})$ and $(M_{\rm h}, M_{\rm p}) = (0.55_{-0.29}^{+0.32}\,M_{\odot}, 1.37_{-0.72}^{+0.80}\,M_{\rm J})$, respectively. These planetary systems are located at a distance of $7.07_{-1.15}^{+0.93}\,{\rm kpc}$ for OGLE-2018-BLG-0567 and $6.47_{-1.73}^{+1.04}\,{\rm kpc}$ for OGLE-2018-BLG-0962, suggesting that they are likely to be near the Galactic bulge. The two events prove the capability of current high-cadence surveys for finding planets through the planetary-caustic channel. We find that most published planetary-caustic planets are found in Hollywood events in which the source size strongly contributes to the anomaly cross section relative to the size of the caustic.


title: OntoZSL: Ontology-enhanced Zero-shot Learning

abstract: Zero-shot Learning (ZSL), which aims to predict for those classes that have never appeared in the training data, has arisen hot research interests. The key of implementing ZSL is to leverage the prior knowledge of classes which builds the semantic relationship between classes and enables the transfer of the learned models (e.g., features) from training classes (i.e., seen classes) to unseen classes. However, the priors adopted by the existing methods are relatively limited with incomplete semantics. In this paper, we explore richer and more competitive prior knowledge to model the inter-class relationship for ZSL via ontology-based knowledge representation and semantic embedding. Meanwhile, to address the data imbalance between seen classes and unseen classes, we developed a generative ZSL framework with Generative Adversarial Networks (GANs). Our main findings include: (i) an ontology-enhanced ZSL framework that can be applied to different domains, such as image classification (IMGC) and knowledge graph completion (KGC); (ii) a comprehensive evaluation with multiple zero-shot datasets from different domains, where our method often achieves better performance than the state-of-the-art models. In particular, on four representative ZSL baselines of IMGC, the ontology-based class semantics outperform the previous priors e.g., the word embeddings of classes by an average of 12.4 accuracy points in the standard ZSL across two example datasets (see Figure 4).


title: Radio Spectral Index Analysis of Southern Hemisphere Symbiotic Stars

abstract: Symbiotic stars show emission across the electromagnetic spectrum from a wide array of physical processes. At cm-waves both synchrotron and thermal emission is seen, often highly variable and associated with outbursts in the optical and X-rays. Most models of the radio emission include an ionized region within the dense wind of the red giant star, that is kept ionized by activity on the white dwarf companion or its accretion disk. In some cases there is on-going shell burning on the white dwarf due to its high mass accretion rate or a prior nova eruption, in other cases nuclear fusion occurs only occasionally as recurrent nova events. In this study we measure the spectral indices of a sample of symbiotic systems in the Southern Hemisphere using the Australia Telescope Compact Array. Putting our data together with results from other surveys, we derive the optical depths and brightness temperatures of some well-known symbiotic stars. Using parallax distances from Gaia Data Release 3, we determine the sizes and characteristic electron densities in the radio emission regions. The results show a range of a factor of 10^4 in radio luminosity, and a factor of 100 in linear size. These numbers are consistent with a picture where the rate of shell burning on the white dwarf determines the radio luminosity. Therefore, our findings also suggest that radio luminosity can be used to determine whether a symbiotic star is powered by accretion alone or also by shell burning.


title: Global Strong Solutions to the Compressible Magnetohydrodynamic Equations with Slip Boundary Conditions in 3D Bounded Domains

abstract: We deal with the barotropic compressible magnetohydrodynamic equations in three-dimensional (3D) bounded domain with slip boundary condition and vacuum. By a series of a priori estimates, especially the boundary estimates, we prove the global well-posedness of classical solution and the exponential decay rate to the initial-boundary-value problem of this system for the regular initial data with small energy but possibly large oscillations. The initial density of such a classical solution is allowed to contain vacuum states. Moreover, it is also shown that the oscillation of the density will grow unboundedly with an exponential rate when the initial state contains vacuum.


title: The Phase Transition of Discrepancy in Random Hypergraphs

abstract: Motivated by the Beck-Fiala conjecture, we study the discrepancy problem in two related models of random hypergraphs on $n$ vertices and $m$ edges. In the first (edge-independent) model, a random hypergraph $H_1$ is constructed by fixing a parameter $p$ and allowing each of the $n$ vertices to join each of the $m$ edges independently with probability $p$. In the parameter range in which $pn \rightarrow \infty$ and $pm \rightarrow \infty$, we show that with high probability (w.h.p.) $H_1$ has discrepancy at least $\Omega(2^{-n/m} \sqrt{pn})$ when $m = O(n)$, and at least $\Omega(\sqrt{pn \log\gamma })$ when $m \gg n$, where $\gamma = \min\{ m/n, pn\}$. In the second (edge-dependent) model, $d$ is fixed and each vertex of $H_2$ independently joins exactly $d$ edges uniformly at random. We obtain analogous results for this model by generalizing the techniques used for the edge-independent model with $p=d/m$. Namely, for $d \rightarrow \infty$ and $dn/m \rightarrow \infty$, we prove that w.h.p. $H_{2}$ has discrepancy at least $\Omega(2^{-n/m} \sqrt{dn/m})$ when $m = O(n)$, and at least $\Omega(\sqrt{(dn/m) \log\gamma})$ when $m \gg n$, where $\gamma =\min\{m/n, dn/m\}$. Furthermore, we obtain nearly matching asymptotic upper bounds on the discrepancy in both models (when $p=d/m$), in the dense regime of $m \gg n$. Specifically, we apply the partial colouring lemma of Lovett and Meka to show that w.h.p. $H_{1}$ and $H_{2}$ each have discrepancy $O( \sqrt{dn/m} \log(m/n))$, provided $d \rightarrow \infty$, $d n/m \rightarrow \infty$ and $m \gg n$. This result is algorithmic, and together with the work of Bansal and Meka characterizes how the discrepancy of each random hypergraph model transitions from $\Theta(\sqrt{d})$ to $o(\sqrt{d})$ as $m$ varies from $m=\Theta(n)$ to $m \gg n$.


title: Capturing Detailed Deformations of Moving Human Bodies

abstract: We present a new method to capture detailed human motion, sampling more than 1000 unique points on the body. Our method outputs highly accurate 4D (spatio-temporal) point coordinates and, crucially, automatically assigns a unique label to each of the points. The locations and unique labels of the points are inferred from individual 2D input images only, without relying on temporal tracking or any human body shape or skeletal kinematics models. Therefore, our captured point trajectories contain all of the details from the input images, including motion due to breathing, muscle contractions and flesh deformation, and are well suited to be used as training data to fit advanced models of the human body and its motion. The key idea behind our system is a new type of motion capture suit which contains a special pattern with checkerboard-like corners and two-letter codes. The images from our multi-camera system are processed by a sequence of neural networks which are trained to localize the corners and recognize the codes, while being robust to suit stretching and self-occlusions of the body. Our system relies only on standard RGB or monochrome sensors and fully passive lighting and the passive suit, making our method easy to replicate, deploy and use. Our experiments demonstrate highly accurate captures of a wide variety of human poses, including challenging motions such as yoga, gymnastics, or rolling on the ground.


title: Developing parsimonious ensembles using predictor diversity within a reinforcement learning framework

abstract: Heterogeneous ensembles that can aggregate an unrestricted number and variety of base predictors can effectively address challenging prediction problems. In particular, accurate ensembles that are also parsimonious, i.e., consist of as few base predictors as possible, can help reveal potentially useful knowledge about the target problem domain. Although ensemble selection offers a potential approach to achieving these goals, the currently available algorithms are limited in their abilities. In this paper, we present several algorithms that incorporate ensemble diversity into a reinforcement learning (RL)-based ensemble selection framework to build accurate and parsimonious ensembles. These algorithms, as well as several baselines, are rigorously evaluated on datasets from diverse domains in terms of the predictive performance and parsimony of their ensembles. This evaluation demonstrates that our diversity-incorporated RL-based algorithms perform better than the others for constructing simultaneously accurate and parsimonious ensembles. These algorithms can eventually aid the interpretation or reverse engineering of predictive models assimilated into effective ensembles. To enable such a translation, an implementation of these algorithms, as well the experimental setup they are evaluated in, has been made available at https://github.com/GauravPandeyLab/lens-learning-ensembles-using-reinforcement-learning.


title: Prospects for single-molecule electrostatic detection in molecular motor gliding motility assays

abstract: Molecular motor gliding motility assays based on myosin/actin or kinesin/microtubules are of interest for nanotechnology applications ranging from cargo-trafficking in lab-on-a-chip devices to novel biocomputation strategies. Prototype systems are typically monitored by expensive and bulky fluorescence microscopy systems and the development of integrated, direct electric detection of single filaments would strongly benefit applications and scale-up. We present estimates for the viability of such a detector by calculating the electrostatic potential change generated at a carbon nanotube transistor by a motile actin filament or microtubule under realistic gliding assay conditions. We combine this with detection limits based on previous state-of-the-art experiments using carbon nanotube transistors to detect catalysis by a bound lysozyme molecule and melting of a bound short-strand DNA molecule. Our results show that detection should be possible for both actin and microtubules using existing low ionic strength buffers given good device design, e.g., by raising the transistor slightly above the guiding channel floor. We perform studies as a function of buffer ionic strength, height of the transistor above the guiding channel floor, presence/absence of the casein surface passivation layer for microtubule assays and the linear charge density of the actin filaments/microtubules. We show that detection of microtubules is a more likely prospect given their smaller height of travel above the surface, higher negative charge density and the casein passivation, and may possibly be achieved with the nanoscale transistor sitting directly on the guiding channel floor.


title: On the Theory of Implicit Deep Learning: Global Convergence with Implicit Layers

abstract: A deep equilibrium model uses implicit layers, which are implicitly defined through an equilibrium point of an infinite sequence of computation. It avoids any explicit computation of the infinite sequence by finding an equilibrium point directly via root-finding and by computing gradients via implicit differentiation. In this paper, we analyze the gradient dynamics of deep equilibrium models with nonlinearity only on weight matrices and non-convex objective functions of weights for regression and classification. Despite non-convexity, convergence to global optimum at a linear rate is guaranteed without any assumption on the width of the models, allowing the width to be smaller than the output dimension and the number of data points. Moreover, we prove a relation between the gradient dynamics of the deep implicit layer and the dynamics of trust region Newton method of a shallow explicit layer. This mathematically proven relation along with our numerical observation suggests the importance of understanding implicit bias of implicit layers and an open problem on the topic. Our proofs deal with implicit layers, weight tying and nonlinearity on weights, and differ from those in the related literature.


title: Linear and orbital stability analysis for solitary-wave solutions of variable-coefficient scalar field equations

abstract: We study general semilinear scalar-field equations on the real line with variable coefficients in the linear terms. These coefficients are uniformly small, but slowly decaying, perturbations of a constant-coefficient operator. We are motivated by the question of how these perturbations of the equation may change the stability properties of kink solutions (one-dimensional topological solitons). We prove existence of a stationary kink solution in our setting, and perform a detailed spectral analysis of the corresponding linearized operator, based on perturbing the linearized operator around the constant-coefficient kink. We derive a formula that allows us to check whether a discrete eigenvalue emerges from the essential spectrum under this perturbation. Known examples suggest that this extra eigenvalue may have an important influence on the long-time dynamics in a neighborhood of the kink. We also establish orbital stability of solitary-wave solutions in the variable-coefficient regime, despite the possible presence of negative eigenvalues in the linearization.


title: Lower Bound on Irreversibility in Thermal Relaxation of Open Quantum Systems

abstract: We consider thermal relaxation process of a quantum system attached to a single or multiple reservoirs. Quantifying the degree of irreversibility by entropy production, we prove that the irreversibility of the thermal relaxation is lower-bounded by a relative entropy between the unitarily-evolved state and the final state. The bound characterizes the state discrepancy induced by the non-unitary dynamics, thus reflecting the dissipative nature of irreversibility. Intriguingly, the bound can be evaluated solely in terms of the initial and final states and the system Hamiltonian; hence, providing a feasible way to estimate entropy production without prior knowledge of the underlying coupling structure. Our finding refines the second law of thermodynamics and reveals a universal feature of thermal relaxation processes.


title: MATCH: Metadata-Aware Text Classification in A Large Hierarchy

abstract: Multi-label text classification refers to the problem of assigning each given document its most relevant labels from the label set. Commonly, the metadata of the given documents and the hierarchy of the labels are available in real-world applications. However, most existing studies focus on only modeling the text information, with a few attempts to utilize either metadata or hierarchy signals, but not both of them. In this paper, we bridge the gap by formalizing the problem of metadata-aware text classification in a large label hierarchy (e.g., with tens of thousands of labels). To address this problem, we present the MATCH solution -- an end-to-end framework that leverages both metadata and hierarchy information. To incorporate metadata, we pre-train the embeddings of text and metadata in the same space and also leverage the fully-connected attentions to capture the interrelations between them. To leverage the label hierarchy, we propose different ways to regularize the parameters and output probability of each child label by its parents. Extensive experiments on two massive text datasets with large-scale label hierarchies demonstrate the effectiveness of MATCH over state-of-the-art deep learning baselines.


title: Prompt Programming for Large Language Models: Beyond the Few-Shot Paradigm

abstract: Prevailing methods for mapping large generative language models to supervised tasks may fail to sufficiently probe models' novel capabilities. Using GPT-3 as a case study, we show that 0-shot prompts can significantly outperform few-shot prompts. We suggest that the function of few-shot examples in these cases is better described as locating an already learned task rather than meta-learning. This analysis motivates rethinking the role of prompts in controlling and evaluating powerful language models. In this work, we discuss methods of prompt programming, emphasizing the usefulness of considering prompts through the lens of natural language. We explore techniques for exploiting the capacity of narratives and cultural anchors to encode nuanced intentions and techniques for encouraging deconstruction of a problem into components before producing a verdict. Informed by this more encompassing theory of prompt programming, we also introduce the idea of a metaprompt that seeds the model to generate its own natural language prompts for a range of tasks. Finally, we discuss how these more general methods of interacting with language models can be incorporated into existing and future benchmarks and practical applications.


title: A Systematic Survey for z < 0.04 Changing-Look AGNs

abstract: We have conducted a systematic survey for z $<$ 0.04 active Galactic nuclei (AGNs) that may have changed spectral class over the past decade. We use SkyMapper, Pan-STARRS and the V\'eron-Cetty & V\'eron (2010) catalogue to search the entire sky for these ``changing-look'' AGNs using a variety of selection methods, where Pan-STARRS has a coverage of 3$\pi$ steradians (sky north of Declination $-30^\circ$) and SkyMapper has coverage of $\sim$ 21,000$~\rm{deg^2}$ (sky south of Declination $0^\circ$). We use small aperture photometry to measure how colour and flux have changed over time, where a change may indicate a change in spectral type. Optical colour and flux are used as a proxy for changing H$\alpha$ equivalent width, while WISE 3.4 $\mu$m flux is used to look for changes in the hot dust component. We have identified four AGNs with varying spectra selected using our optical colour selection method. Three AGNs were confirmed from recent observations with WiFeS on the 2.3 m telescope at Siding Spring and the other was identified from archival spectra alone. From this, we identify two new changing look AGNs; NGC 1346 and 2MASX J20075129-1108346. We also recover Mrk 915 and Mrk 609, which are known to have varying spectra in the literature, but they do not meet our specific criteria for changing look AGNs.