title: Towards Searching Efficient and Accurate Neural Network Architectures in Binary Classification Problems

abstract: In recent years, deep neural networks have had great success in machine learning and pattern recognition. Architecture size for a neural network contributes significantly to the success of any neural network. In this study, we optimize the selection process by investigating different search algorithms to find a neural network architecture size that yields the highest accuracy. We apply binary search on a very well-defined binary classification network search space and compare the results to those of linear search. We also propose how to relax some of the assumptions regarding the dataset so that our solution can be generalized to any binary classification problem. We report a 100-fold running time improvement over the naive linear search when we apply the binary search method to our datasets in order to find the best architecture candidate. By finding the optimal architecture size for any binary classification problem quickly, we hope that our research contributes to discovering intelligent algorithms for optimizing architecture size selection in machine learning.


title: A Two-Level Simulation-Assisted Sequential Distribution System Restoration Model With Frequency Dynamics Constraints

abstract: This paper proposes a service restoration model for unbalanced distribution systems and inverter-dominated microgrids (MGs), in which frequency dynamics constraints are developed to optimize the amount of load restoration and guarantee the dynamic performance of system frequency response during the restoration process. After extreme events, the damaged distribution systems can be sectionalized into several isolated MGs to restore critical loads and tripped non-black start distributed generations (DGs) by black start DGs. However, the high penetration of inverter-based DGs reduces the system inertia, which results in low-inertia issues and large frequency fluctuation during the restoration process. To address this challenge, we propose a two-level simulation-assisted sequential service restoration model, which includes a mixed integer linear programming (MILP)-based optimization model and a transient simulation model. The proposed MILP model explicitly incorporates the frequency response into constraints, by interfacing with transient simulation of inverter-dominated MGs. Numerical results on a modified IEEE 123-bus system have validated that the frequency dynamic performance of the proposed service restoration model are indeed improved.


title: Decoding the Spin-Matrix limit of strings on $AdS_5 \times S^5$

abstract: In this Letter, we explore nonrelativistic string solutions in various subsectors of the $ SU(1,2|3) $ SMT strings that correspond to different spin groups and satisfy the respective BPS bounds. In particular, we carry out an explicit analysis on rotating string solutions in the light of recently proposed SMT limits. We explore newly constructed SMT limits of type IIB (super) strings on $ AdS_5 \times S^5 $ and estimate the corresponding leading order stringy corrections near the respective BPS bounds.


title: Linguistically-Enriched and Context-Aware Zero-shot Slot Filling

abstract: Slot filling is identifying contiguous spans of words in an utterance that correspond to certain parameters (i.e., slots) of a user request/query. Slot filling is one of the most important challenges in modern task-oriented dialog systems. Supervised learning approaches have proven effective at tackling this challenge, but they need a significant amount of labeled training data in a given domain. However, new domains (i.e., unseen in training) may emerge after deployment. Thus, it is imperative that these models seamlessly adapt and fill slots from both seen and unseen domains -- unseen domains contain unseen slot types with no training data, and even seen slots in unseen domains are typically presented in different contexts. This setting is commonly referred to as zero-shot slot filling. Little work has focused on this setting, with limited experimental evaluation. Existing models that mainly rely on context-independent embedding-based similarity measures fail to detect slot values in unseen domains or do so only partially. We propose a new zero-shot slot filling neural model, LEONA, which works in three steps. Step one acquires domain-oblivious, context-aware representations of the utterance word by exploiting (a) linguistic features; (b) named entity recognition cues; (c) contextual embeddings from pre-trained language models. Step two fine-tunes these rich representations and produces slot-independent tags for each word. Step three exploits generalizable context-aware utterance-slot similarity features at the word level, uses slot-independent tags, and contextualizes them to produce slot-specific predictions for each word. Our thorough evaluation on four diverse public datasets demonstrates that our approach consistently outperforms the SOTA models by 17.52%, 22.15%, 17.42%, and 17.95% on average for unseen domains on SNIPS, ATIS, MultiWOZ, and SGD datasets, respectively.


title: Algebraic Tensor Products Revisited: Axiomatic Approach

abstract: This is an expository paper on tensor products where the standard approaches for constructing concrete instances of algebraic tensor products of linear spaces, via quotient spaces or via linear maps of bilinear maps, are reviewed by reducing them to different but isomorphic interpretations of an abstract notion, viz., the universal property, which is based on a pair of axioms.


title: Mechanism for Synchronization of Charge Oscillations in Dimer Lattices

abstract: We discuss the mechanism and the conditions for the appearance of synchronized charge oscillations which have been observed experimentally and theoretically after strong photoexcitation of dimerized systems. In the Hubbard model with on-site repulsion, the Bloch equations for a wave-number-dependent pseudospin -- whose components describe the charge-density difference, current density, and bond density between the two sublattices -- involve an alternatingly tilted pseudomagnetic field, which assists the synchronization of pseudospins with different wave numbers, irrespective of the initial condition. This fact is numerically confirmed by the dynamics in finite lattices based on the exact diagonalization method. In the presence of nearest-neighbor repulsion, however, the synchronization can be hindered by excitons. Therefore, the excitation of a sufficiently large density of free electron-hole pairs, but low density of excitons, is needed to achieve synchronization.


title: A Novel Approach for Earthquake Early Warning System Design using Deep Learning Techniques

abstract: Earthquake signals are non-stationary in nature and thus in real-time, it is difficult to identify and classify events based on classical approaches like peak ground displacement, peak ground velocity. Even the popular algorithm of STA/LTA requires extensive research to determine basic thresholding parameters so as to trigger an alarm. Also, many times due to human error or other unavoidable natural factors such as thunder strikes or landslides, the algorithm may end up raising a false alarm. This work focuses on detecting earthquakes by converting seismograph recorded data into corresponding audio signals for better perception and then uses popular Speech Recognition techniques of Filter bank coefficients and Mel Frequency Cepstral Coefficients (MFCC) to extract the features. These features were then used to train a Convolutional Neural Network(CNN) and a Long Short Term Memory(LSTM) network. The proposed method can overcome the above-mentioned problems and help in detecting earthquakes automatically from the waveforms without much human intervention. For the 1000Hz audio data set the CNN model showed a testing accuracy of 91.1% for 0.2-second sample window length while the LSTM model showed 93.99% for the same. A total of 610 sounds consisting of 310 earthquake sounds and 300 non-earthquake sounds were used to train the models. While testing, the total time required for generating the alarm was approximately 2 seconds which included individual times for data collection, processing, and prediction taking into consideration the processing and prediction delays. This shows the effectiveness of the proposed method for Earthquake Early Warning (EEW) applications. Since the input of the method is only the waveform, it is suitable for real-time processing, thus the models can also be used as an onsite EEW system requiring a minimum amount of preparation time and workload.


title: Evaluating Online and Offline Accuracy Traversal Algorithms for k-Complete Neural Network Architectures

abstract: Architecture sizes for neural networks have been studied widely and several search methods have been offered to find the best architecture size in the shortest amount of time possible. In this paper, we study compact neural network architectures for binary classification and investigate improvements in speed and accuracy when favoring overcomplete architecture candidates that have a very high-dimensional representation of the input. We hypothesize that an overcomplete model architecture that creates a relatively high-dimensional representation of the input will be not only be more accurate but would also be easier and faster to find. In an NxM search space, we propose an online traversal algorithm that finds the best architecture candidate in O(1) time for best case and O(N) amortized time for average case for any compact binary classification problem by using k-completeness as heuristics in our search. The two other offline search algorithms we implement are brute force traversal and diagonal traversal, which both find the best architecture candidate in O(NxM) time. We compare our new algorithm to brute force and diagonal searching as a baseline and report search time improvement of 52.1% over brute force and of 15.4% over diagonal search to find the most accurate neural network architecture when given the same dataset. In all cases discussed in the paper, our online traversal algorithm can find an accurate, if not better, architecture in significantly shorter amount of time.


title: Intrusion Detection Systems for Smart Home IoT Devices: Experimental Comparison Study

abstract: Smart homes are one of the most promising applications of the emerging Internet of Things (IoT) technology. With the growing number of IoT related devices such as smart thermostats, smart fridges, smart speaker, smart light bulbs and smart locks, smart homes promise to make our lives easier and more comfortable. However, the increased deployment of such smart devices brings an increase in potential security risks and home privacy breaches. In order to overcome such risks, Intrusion Detection Systems are presented as pertinent tools that can provide network-level protection for smart devices deployed in home environments. These systems monitor the network activities of the smart home-connected de-vices and focus on alerting suspicious or malicious activity. They also can deal with detected abnormal activities by hindering the impostors in accessing the victim devices. However, the employment of such systems in the context of a smart home can be challenging due to the devices hardware limitations, which may restrict their ability to counter the existing and emerging attack vectors. Therefore, this paper proposes an experimental comparison between the widely used open-source NIDSs namely Snort, Suricata and Bro IDS to find the most appropriate one for smart homes in term of detection accuracy and resources consumption including CP and memory utilization. Experimental Results show that Suricata is the best performing NIDS for smart homes


title: Characterizing categorically closed commutative semigroups

abstract: Let $\mathcal C$ be a class of Hausdorff topological semigroups which contains all zero-dimensional Hausdorff topological semigroups. A semigroup $X$ is called $\mathcal C$-$closed$ if $X$ is closed in each topological semigroup $Y\in \mathcal C$ containing $X$ as a discrete subsemigroup; $X$ is $projectively$ $\mathcal C$-$closed$ if for each congruence $\approx$ on $X$ the quotient semigroup $X/_\approx$ is $\mathcal C$-closed. A semigroup $X$ is called $chain$-$finite$ if for any infinite set $I\subseteq X$ there are elements $x,y\in I$ such that $xy\notin\{x,y\}$. We prove that a semigroup $X$ is $\mathcal C$-closed if it admits a homomorphism $h:X\to E$ to a chain-finite semilattice $E$ such that for every $e\in E$ the semigroup $h^{-1}(e)$ is $\mathcal C$-closed. Applying this theorem, we prove that a commutative semigroup $X$ is $\mathcal C$-closed if and only if $X$ is periodic, chain-finite, all subgroups of $X$ are bounded, and for any infinite set $A\subseteq X$ the product $AA$ is not a singleton. A commutative semigroup $X$ is projectively $\mathcal C$-closed if and only if $X$ is chain-finite, all subgroups of $X$ are bounded and the union $H(X)$ of all subgroups in $X$ has finite complement $X\setminus H(X)$.


title: Hierarchical Reinforcement Learning By Discovering Intrinsic Options

abstract: We propose a hierarchical reinforcement learning method, HIDIO, that can learn task-agnostic options in a self-supervised manner while jointly learning to utilize them to solve sparse-reward tasks. Unlike current hierarchical RL approaches that tend to formulate goal-reaching low-level tasks or pre-define ad hoc lower-level policies, HIDIO encourages lower-level option learning that is independent of the task at hand, requiring few assumptions or little knowledge about the task structure. These options are learned through an intrinsic entropy minimization objective conditioned on the option sub-trajectories. The learned options are diverse and task-agnostic. In experiments on sparse-reward robotic manipulation and navigation tasks, HIDIO achieves higher success rates with greater sample efficiency than regular RL baselines and two state-of-the-art hierarchical RL methods.


title: Overlap-Minimization Scheduling Strategy for Data Transmission in VANET

abstract: The vehicular ad-hoc network (VANET) based on dedicated short-range communication (DSRC) is a distributed communication system, in which all the nodes share the wireless channel with carrier sense multiple access/collision avoid (CSMA/CA) protocol. However, the competition and backoff mechanisms of CSMA/CA often bring additional delays and data packet collisions, which may hardly meet the QoS requirements in terms of delay and packets delivery ratio (PDR). Moreover, because of the distribution nature of security information in broadcast mode, the sender cannot know whether the receivers have received the information successfully. Similarly, this problem also exists in no-acknowledge (non-ACK) transmissions of VANET. Therefore, the probability of packet collisions should be considered in broadcast or non-ACK working modes. This paper presents a connection-level scheduling algorithm overlaid on CSMA/CA to schedule the start sending time of each transmission. By converting the object of reducing collision probability to minimizing the overlap of transmission durations of connections, the probability of backoff-activation can be greatly decreased. Then the delay and the probability of packet collisions can also be decreased. Numerical simulations have been conducted in our unified platform containing SUMO, Veins and Omnet++. The result shows that the proposed algorithm can effectively improve the PDR and reduce the packets collision in VANET.


title: Convergence of non-autonomous attractors for subquintic weakly damped wave equation

abstract: We study the non-autonomous weakly damped wave equation with subquintic growth condition on the nonlinearity. Our main focus is the class of Shatah--Struwe solutions, which satisfy the Strichartz estimates and are coincide with the class of solutions obtained by the Galerkin method. For this class we show the existence and smoothness of pullback, uniform, and cocycle attractors and the relations between them. We also prove that these non-autonomous attractors converge upper-semicontinuously to the global attractor for the limit autonomous problem if the time-dependent nonlinearity tends to time independent function in an appropriate way.


title: Big Data application in congestion detection and classification using Apache spark

abstract: With the era of big data, an explosive amount of information is now available. This enormous increase of Big Data in both academia and industry requires large-scale data processing systems. A large body of research is behind optimizing Spark's performance to make it state of the art, a fast and general data processing system. Many science and engineering fields have advanced with Big Data analytics, such as Biology, finance, and transportation. Intelligent transportation systems (ITS) gain popularity and direct benefit from the richness of information. The objective is to improve the safety and management of transportation networks by reducing congestion and incidents. The first step toward the goal is better understanding, modeling, and detecting congestion across a network efficiently and effectively. In this study, we introduce an efficient congestion detection model. The underlying network consists of 3017 segments in I-35, I-80, I-29, and I-380 freeways with an overall length of 1570 miles and averaged (0.4-0.6) miles per segment. The result of congestion detection shows the proposed method is 90% accurate while has reduced computation time by 99.88%.


title: Voltage controlled awakening of memristor-like dynamic current-voltage loops of ferroelectric triglycine sulphate

abstract: For the study of polarization reversal features in the structure of "mixed ionic-electronic conductor - on - ferroelectric" type, the hydrogen bonded molecular ferroelectric crystal triglycine sulphate (TGS) is used. The dynamic currant-voltage (I-V-) loops of thin TGS plates of polar (010) cut with dissimilar electrodes on the opposite surfaces (vacuum deposited Ag and Ag-paste diluted with a water-ethanol mixture) are investigated. After electroforming in the low-voltage vicinity of coercive voltage, during further cycling, a reversible transformation of I-V-loop shape occurs from typical of non-linear dielectrics to typical of memristive systems and than to typical of ferroelectrics (and vice versa) with a sequential increase (decrease) of drawing voltage amplitude. Such "awakening" and "falling asleep" of I-V-loops of the memristor type is apparently associated with reversible electromigration and accumulation of charged species (e.g., protons), in the hydrated surface layer of TGS as a component of electrochemical capacitor-on-ferroelectric structure. The observed transformation can be explained by considering the coupled ion transfer and polarization reversal taking into account the swinging of the boundary of the built-in chemical inhomogeneity under conditions of linear and/or nonlinear dynamics of ion drift and ionic concentration polarization caused by charged species transfer under the applied voltage.


title: Motion of an impurity in a two-leg ladder

abstract: We study the motion of an impurity in a two-leg ladder interacting with two fermionic baths along each leg, a simple model bridging cold atom quantum simulators with an idealised description of the basic transport processes in a layered heterostructure. Using the linked-cluster expansion we obtain exact analytical results for the single-particle Green's function and find that the long-time behaviour is dominated by an intrinsic orthogonality catastrophe associated to the motion of the impurity in each one-dimensional chain. We explore both the case of two identical legs as well as the case where the legs are characterised by different interaction strengths: in the latter case we observe a subleading correction which can be relevant for intermediate-time transport at an interface between different materials. In all the cases we do not find significant differences between the intra- and inter-leg Green's functions in the long-time limit.


title: von Neumann regular Hyperrings and applications to Real Reduced Multirings

abstract: A multiring ([Mar3]) is a kind of ring where is allowed the sum of two elements to be anon-empty subset of the structure instead of just one element -and an hyperring is a multiring with a strong distributive property. Thus a reduced hyperring where the prime spec is a Boolean topological space is called von Neumann regular hyperring (vNH). It is possible to associate to every such object a structural presheaf in the same way it is made with rings but there are some vNH such that this presheaf is not a sheaf. In this sense, we give a first-order characterization of vNH with a structural sheaf (geometric vNH or just GvNH) and how to transform a vNH in aGvNH -in fact, this transformation shows that the category GvNH is a reflexive subcategory of vNH. We also build a von Neumann regular hull for multirings and use this to give applications for algebraic theory of quadratic forms. More precisely, we work with Real Reduced Multiring (RRM, [Mar3]) -also known as Real Semigroup (RS, [DP1])-, a special kind of multirings that is useful to explore the real structure of rings, and show that a von Neumann hull of a RRM is again a RRM. This gives a generalization of sheafs arguments present in [DM4].


title: Hydrodynamic Equations for the Toda Lattice

abstract: 1. Introduction, 2. Dynamics of the classical Toda lattice, 3. Static properties, 4. Mean-field Dyson Brownian motion, 5. Hydrodynamics for hard rods, 6. Generalized hydrodynamic equations, 7. Linearized hydrodynamics and GGE dynamical correlations, 8. Domain wall initial states, 9. Toda fluid, 10. Hydrodynamics for the Lieb-Liniger delta-Bose gas, 11. Quantum Toda lattice, 12. Beyond the Euler time scale.

categories: cond-mat.stat-mech math-ph math.MP nlin.SI


title: Sensitivity of Mean-Field Fluctuations in Erlang loss models with randomized routing

abstract: In this paper, we study a large system of $N$ servers each with capacity to process at most $C$ simultaneous jobs and an incoming job is routed to a server if it has the lowest occupancy amongst $d$ (out of N) randomly selected servers. A job that is routed to a server with no vacancy is assumed to be blocked and lost. Such randomized policies are referred to JSQ(d) (Join the Shortest Queue out of $d$) policies. Under the assumption that jobs arrive according to a Poisson process with rate $N\lambda^{(N)}$ where $\lambda^{(N)}=\sigma-\frac{\beta}{\sqrt{N}}$, $\sigma\in\mb{R}_+$ and $\beta\in\mb{R}$, we establish functional central limit theorems (FCLTs) for the fluctuation process in both the transient and stationary regimes when service time distributions are exponential. In particular, we show that the limit is an Ornstein-Uhlenbeck process whose mean and variance depend on the mean-field of the considered model. Using this, we obtain approximations to the blocking probabilities for large $N$, where we can precisely estimate the accuracy of first-order approximations.


title: Values of zeta functions of arithmetic surfaces at $s=1$

abstract: We show that the recent conjecture of the first-named author for the special value at $s=1$ of the zeta function of an arithmetic surface is equivalent to the Birch-Swinnerton-Dyer conjecture for the Jacobian of the generic fibre.


title: Consistent Bayesian Community Detection

abstract: Stochastic Block Models (SBMs) are a fundamental tool for community detection in network analysis. But little theoretical work exists on the statistical performance of Bayesian SBMs, especially when the community count is unknown. This paper studies a special class of SBMs whose community-wise connectivity probability matrix is diagonally dominant, i.e., members of the same community are more likely to connect with one another than with members from other communities. The diagonal dominance constraint is embedded within an otherwise weak prior, and, under mild regularity conditions, the resulting posterior distribution is shown to concentrate on the true community count and membership allocation as the network size grows to infinity. A reversible-jump Markov Chain Monte Carlo posterior computation strategy is developed by adapting the allocation sampler of Mcdaid et al (2013). Finite sample properties are examined via simulation studies in which the proposed method offers competitive estimation accuracy relative to existing methods under a variety of challenging scenarios.


title: Electronic states in cylindrical core-multi-shell nanowire

abstract: The recent advances in nanowire (NW) growth technology have made possible the growth of more complex structures such as core-multi-shell (CMS) NWs. We propose the approach for calculation of electron subbands in cylindrical CMS NWs within the simple effective mass approximation. Numerical results are presented for ${\rm GaAs/Al_{0.3}Ga_{0.7}As}$ radial heterostructure with AlGaAs-core and 4 alternate GaAs and AlGaAs shells. The influence of an effective mass difference in heterolayers is discussed.


title: Modeling of fluid flow in a flexible vessel with elastic walls

abstract: We exploit a two-dimensional model [7], [6] and [1] describing the elastic behavior of the wall of a flexible blood vessel which takes interaction with surrounding muscle tissue and the 3D fluid flow into account. We study time periodic flows in a cylinder with such compound boundary conditions. The main result is that solutions of this problem do not depend on the period and they are nothing else but the time independent Poiseuille flow. Similar solutions of the Stokes equations for the rigid wall (the no-slip boundary condition) depend on the period and their profile depends on time.


title: Electronic states in nanowires with hexagonal cross-section

abstract: The electron spectrum in a uniform nanowire with a hexagonal cross-section is calculated by means of a numerical diagonalization of the effective-mass Hamiltonian. Two basis sets are utilized. The wave-functions of low-lying states are calculated and visualized. The approach has an advantage over mesh methods based on finite-differences (or finite-elements) schemes: non-physical solutions do not arise. Our scheme can be easily generalized to the case of multi-band (Luttinger or Kane) ${\bf k}\cdot{\bf p}$ Hamiltonians. The external fields (electrical, magnetic or strain) can be consistently introduced into the problem as well.


title: Dissecting the Meme Magic: Understanding Indicators of Virality in Image Memes

abstract: Despite the increasingly important role played by image memes, we do not yet have a solid understanding of the elements that might make a meme go viral on social media. In this paper, we investigate what visual elements distinguish image memes that are highly viral on social media from those that do not get re-shared, across three dimensions: composition, subjects, and target audience. Drawing from research in art theory, psychology, marketing, and neuroscience, we develop a codebook to characterize image memes, and use it to annotate a set of 100 image memes collected from 4chan's Politically Incorrect Board (/pol/). On the one hand, we find that highly viral memes are more likely to use a close-up scale, contain characters, and include positive or negative emotions. On the other hand, image memes that do not present a clear subject the viewer can focus attention on, or that include long text are not likely to be re-shared by users. We train machine learning models to distinguish between image memes that are likely to go viral and those that are unlikely to be re-shared, obtaining an AUC of 0.866 on our dataset. We also show that the indicators of virality identified by our model can help characterize the most viral memes posted on mainstream online social networks too, as our classifiers are able to predict 19 out of the 20 most popular image memes posted on Twitter and Reddit between 2016 and 2018. Overall, our analysis sheds light on what indicators characterize viral and non-viral visual content online, and set the basis for developing better techniques to create or moderate content that is more likely to catch the viewer's attention.


title: Deep Cox Mixtures for Survival Regression

abstract: Survival analysis is a challenging variation of regression modeling because of the presence of censoring, where the outcome measurement is only partially known, due to, for example, loss to follow up. Such problems come up frequently in medical applications, making survival analysis a key endeavor in biostatistics and machine learning for healthcare, with Cox regression models being amongst the most commonly employed models. We describe a new approach for survival analysis regression models, based on learning mixtures of Cox regressions to model individual survival distributions. We propose an approximation to the Expectation Maximization algorithm for this model that does hard assignments to mixture groups to make optimization efficient. In each group assignment, we fit the hazard ratios within each group using deep neural networks, and the baseline hazard for each mixture component non-parametrically. We perform experiments on multiple real world datasets, and look at the mortality rates of patients across ethnicity and gender. We emphasize the importance of calibration in healthcare settings and demonstrate that our approach outperforms classical and modern survival analysis baselines, both in terms of discriminative performance and calibration, with large gains in performance on the minority demographics.


title: PL2: Towards Predictable Low Latency in Rack-Scale Networks

abstract: High performance rack-scale offerings package disaggregated pools of compute, memory and storage hardware in a single rack to run diverse workloads with varying requirements, including applications that need low and predictable latency. The intra-rack network is typically high speed Ethernet, which can suffer from congestion leading to packet drops and may not satisfy the stringent tail latency requirements for some workloads (including remote memory/storage accesses). In this paper, we design a Predictable Low Latency(PL2) network architecture for rack-scale systems with Ethernet as interconnecting fabric. PL2 leverages programmable Ethernet switches to carefully schedule packets such that they incur no loss with NIC and switch queues maintained at small, near-zero levels. In our 100 Gbps rack-prototype, PL2 keeps 99th-percentile memcached RPC latencies under 60us even when the RPCs compete with extreme offered-loads of 400%, without losing traffic. Network transfers for a machine learning training task complete 30% faster than a receiver-driven scheme implementation modeled after Homa (222ms vs 321ms 99%ile latency per iteration).


title: Optical Tuning of Resistance Switching in Polycrystalline Gallium Phosphide Thin Films

abstract: The nanoscale resistive switching characteristics of gallium phosphide (GaP) thin films directly grown on Si are investigated as a function of incident light. Firstly, as-grown GaP films show a high RON/ROFF (~10^4), shown to arise from the formation of conductive channels along the grain boundaries. It is proposed that point defects (most likely Ga interstitials) and structural disorder at the grain boundaries provide the ideal environment to enable the filamentary switching process. Next, we explored if such defects can give rise to mid-gap states, and if so could they be activated by photonic excitation. Both first-principles calculations as well as UV-vis and photoluminescence spectroscopy strongly point to the possibility of mid-gap electronic states in the polycrystalline GaP film. Photoconductive atomic force microscopy (phAFM), a scanning probe technique, is used to image photocurrents generated as a function of incident photon energy (ranging from sub band-gap to above band-gap) on the GaP film surface. We observe photocurrents even for incident photon energies lower than the band-gap, consistent with the presence of mid-gap electronic states. Moreover the photocurrent magnitude is found to be directly proportional to the incident photon energy with a concomitant decrease in the filament resistance. This demonstrates GaP directly integrated on Si can be a promising photonic resistive switching materials system.


title: A Statistical Theory of Heavy Atoms: Asymptotic Behavior of the Energy and Stability of Matter

abstract: We give the asymptotic behavior of the ground state energy of Engel's and Dreizler's relativistic Thomas-Fermi-Weizs\"acker-Dirac functional for heavy atoms for fixed ratio of the atomic number and the velocity of light. Using a variation of the lower bound, we show stability of matter.


title: Development of a physically-informed neural network interatomic potential for tantalum

abstract: Large-scale atomistic simulations of materials heavily rely on interatomic potentials, which predict the system energy and atomic forces. One of the recent developments in the field is constructing interatomic potentials by machine-learning (ML) methods. ML potentials predict the energy and forces by numerical interpolation using a large reference database generated by quantum-mechanical calculations. While high accuracy of interpolation can be achieved, extrapolation to unknown atomic environments is unpredictable. The recently proposed physically-informed neural network (PINN) model significantly improves the transferability by combining a neural network regression with a physics-based bond-order interatomic potential. Here, we demonstrate that general-purpose PINN potentials can be developed for body-centered cubic (BCC) metals. The proposed PINN potential for tantalum reproduces the reference energies within 2.8 meV/atom. It accurately predicts a broad spectrum of physical properties of Ta, including (but not limited to) lattice dynamics, thermal expansion, energies of point and extended defects, the dislocation core structure and the Peierls barrier, the melting temperature, the structure of liquid Ta, and the liquid surface tension. The potential enables large-scale simulations of physical and mechanical behavior of Ta with nearly first-principles accuracy while being orders of magnitude faster. This approach can be readily extended to other BCC metals.


title: SceneGen: Learning to Generate Realistic Traffic Scenes

abstract: We consider the problem of generating realistic traffic scenes automatically. Existing methods typically insert actors into the scene according to a set of hand-crafted heuristics and are limited in their ability to model the true complexity and diversity of real traffic scenes, thus inducing a content gap between synthesized traffic scenes versus real ones. As a result, existing simulators lack the fidelity necessary to train and test self-driving vehicles. To address this limitation, we present SceneGen, a neural autoregressive model of traffic scenes that eschews the need for rules and heuristics. In particular, given the ego-vehicle state and a high definition map of surrounding area, SceneGen inserts actors of various classes into the scene and synthesizes their sizes, orientations, and velocities. We demonstrate on two large-scale datasets SceneGen's ability to faithfully model distributions of real traffic scenes. Moreover, we show that SceneGen coupled with sensor simulation can be used to train perception models that generalize to the real world.


title: ConE: A Concurrent Edit Detection Tool for Large Scale Software Development

abstract: Modern, complex software systems are being continuously extended and adjusted. The developers responsible for this may come from different teams or organizations, and may be distributed over the world. This may make it difficult to keep track of what other developers are doing, which may result in multiple developers concurrently editing the same code areas. This, in turn, may lead to hard-to-merge changes or even merge conflicts, logical bugs that are difficult to detect, duplication of work, and wasted developer productivity. To address this, we explore the extent of this problem in the pull request based software development model. We study half a year of changes made to six large repositories in Microsoft in which at least 1,000 pull requests are created each month. We find that files concurrently edited in different pull requests are more likely to introduce bugs. Motivated by these findings, we design, implement, and deploy a service named ConE (Concurrent Edit Detector) that proactively detects pull requests containing concurrent edits, to help mitigate the problems caused by them. ConE has been designed to scale, and to minimize false alarms while still flagging relevant concurrently edited files. Key concepts of ConE include the detection of the Extent of Overlap between pull requests, and the identification of Rarely Concurrently Edited Files. To evaluate ConE, we report on its operational deployment on 234 repositories inside Microsoft. ConE assessed 26,000 pull requests and made 775 recommendations about conflicting changes, which were rated as useful in over 70% (554) of the cases. From interviews with 48 users we learned that they believed ConE would save time in conflict resolution and avoiding duplicate work, and that over 90% intend to keep using the service on a daily basis.


title: GeoSim: Realistic Video Simulation via Geometry-Aware Composition for Self-Driving

abstract: Scalable sensor simulation is an important yet challenging open problem for safety-critical domains such as self-driving. Current works in image simulation either fail to be photorealistic or do not model the 3D environment and the dynamic objects within, losing high-level control and physical realism. In this paper, we present GeoSim, a geometry-aware image composition process which synthesizes novel urban driving scenarios by augmenting existing images with dynamic objects extracted from other scenes and rendered at novel poses. Towards this goal, we first build a diverse bank of 3D objects with both realistic geometry and appearance from sensor data. During simulation, we perform a novel geometry-aware simulation-by-composition procedure which 1) proposes plausible and realistic object placements into a given scene, 2) render novel views of dynamic objects from the asset bank, and 3) composes and blends the rendered image segments. The resulting synthetic images are realistic, traffic-aware, and geometrically consistent, allowing our approach to scale to complex use cases. We demonstrate two such important applications: long-range realistic video simulation across multiple camera sensors, and synthetic data generation for data augmentation on downstream segmentation tasks. Please check https://tmux.top/publication/geosim/ for high-resolution video results.


title: Geometry of Vaidya spacetimes

abstract: We investigate the geometrical structure of Vaidya's spacetime in the case of a white hole with decreasing mass, stabilising to a black hole in finite or infinite time or evaporating completely. Our approach relies on a detailed analysis of the ordinary differential equation describing the incoming principal null geodesics, among which are the generators of the past horizon. We devote special attention to the case of a complete evaporation in infinite time and establish the existence of an asymptotic light-like singularity of the conformal curvature, touching both the past space-like singularity and future time-like infinity. This singularity is present independently of the decay rate of the mass. We derive an explicit formula that relates directly the strength of this null singularity to the asymptotic behaviour of the mass function.


title: VideoClick: Video Object Segmentation with a Single Click

abstract: Annotating videos with object segmentation masks typically involves a two stage procedure of drawing polygons per object instance for all the frames and then linking them through time. While simple, this is a very tedious, time consuming and expensive process, making the creation of accurate annotations at scale only possible for well-funded labs. What if we were able to segment an object in the full video with only a single click? This will enable video segmentation at scale with a very low budget opening the door to many applications. Towards this goal, in this paper we propose a bottom up approach where given a single click for each object in a video, we obtain the segmentation masks of these objects in the full video. In particular, we construct a correlation volume that assigns each pixel in a target frame to either one of the objects in the reference frame or the background. We then refine this correlation volume via a recurrent attention module and decode the final segmentation. To evaluate the performance, we label the popular and challenging Cityscapes dataset with video object segmentations. Results on this new CityscapesVideo dataset show that our approach outperforms all the baselines in this challenging setting.


title: Restrained Italian domination in trees

abstract: Let $G=(V,E)$ be a graph. A subset $D$ of $V$ is a \textit{restrained dominating set} if every vertex in $V \setminus D$ is adjacent to a vertex in $D$ and to a vertex in $V \setminus D$. The \textit{restrained domination number}, denoted by $\gamma_r(G)$, is the smallest cardinality of a restrained dominating set of $G$. A function $f : V \rightarrow \{0, 1, 2\}$ is a \textit{restrained Italian dominating function} on $G$ if (i) for each vertex $v \in V$ for which $f(v)=0$, it holds that $\sum_{u \in N_G(v)} f(u) \geq 2$, (ii) the subgraph induced by $\{v \in V \mid f(v)=0 \}$ has no isolated vertices. The \textit{restrained Italian domination number}, denoted by $\gamma_{rI}(G)$, is the minimum weight taken over all restrained Italian dominating functions of $G$. It is known that $\gamma_r(G) \leq \gamma_{rI}(G) \leq 2\gamma_r(G)$ for any graph $G$. In this paper, we characterize the trees $T$ for which $\gamma_r(T) = \gamma_{rI}(T)$, and we also characterize the trees $T$ for which $\gamma_{rI}(T) = 2\gamma_r(T)$.


title: LookOut: Diverse Multi-Future Prediction and Planning for Self-Driving

abstract: In this paper, we present LookOut, a novel autonomy system that perceives the environment, predicts a diverse set of futures of how the scene might unroll and estimates the trajectory of the SDV by optimizing a set of contingency plans over these future realizations. In particular, we learn a diverse joint distribution over multi-agent future trajectories in a traffic scene that covers a wide range of future modes with high sample efficiency while leveraging the expressive power of generative models. Unlike previous work in diverse motion forecasting, our diversity objective explicitly rewards sampling future scenarios that require distinct reactions from the self-driving vehicle for improved safety. Our contingency planner then finds comfortable and non-conservative trajectories that ensure safe reactions to a wide range of future scenarios. Through extensive evaluations, we show that our model demonstrates significantly more diverse and sample-efficient motion forecasting in a large-scale self-driving dataset as well as safer and less-conservative motion plans in long-term closed-loop simulations when compared to current state-of-the-art models.


title: RVE-CV2X: A Scalable Emulation Framework for Real-Time Evaluation of CV2X-Based Connected Vehicle Applications

abstract: Vehicle-to-Everything (V2X) communication has become an integral component of Intelligent Transportation Systems (ITS) due to its ability to connect vehicles, pedestrians, infrastructure, and create situational awareness among vehicles. Cellular-Vehicle-to-Everything (C-V2X), based on 3rd Generation Partnership Project (3GPP) Release 14, is one such communication technology that has recently gained significant attention to cater the needs of V2X communication. However, for a successful deployment of C-V2X, it is of paramount significance to thoroughly test the performance of this technology. It is unfeasible to physically conduct a V2X communication experiment to test the performance of C-V2X by arranging hundreds of real vehicles and their transceiving on-board units. Although multiple simulators based on frameworks such as NS-3, OMNET++ and OPNET have proven to be reliable and economic alternatives to using real vehicles, all these simulators are time-consuming and require several orders of magnitudes longer than the actual simulation time. As opposed to physical field- and simulation-based testing, network emulators can provide more realistic and repeatable results for testing vehicular communication. This paper proposes a real-time, high-fidelity, hardware-in-the-loop network emulator (RVE-CV2X) based on C-V2X mode 4 that can provide scalable, reliable and repeatable testing scenarios for V2X communication. The accuracy of this emulator is verified by comparing it to an already validated C-V2X simulator based on the NS-3 framework.


title: AdvSim: Generating Safety-Critical Scenarios for Self-Driving Vehicles

abstract: As self-driving systems become better, simulating scenarios where the autonomy stack may fail becomes more important. Traditionally, those scenarios are generated for a few scenes with respect to the planning module that takes ground-truth actor states as input. This does not scale and cannot identify all possible autonomy failures, such as perception failures due to occlusion. In this paper, we propose AdvSim, an adversarial framework to generate safety-critical scenarios for any LiDAR-based autonomy system. Given an initial traffic scenario, AdvSim modifies the actors' trajectories in a physically plausible manner and updates the LiDAR sensor data to match the perturbed world. Importantly, by simulating directly from sensor data, we obtain adversarial scenarios that are safety-critical for the full autonomy stack. Our experiments show that our approach is general and can identify thousands of semantically meaningful safety-critical scenarios for a wide range of modern self-driving systems. Furthermore, we show that the robustness and safety of these systems can be further improved by training them with scenarios generated by AdvSim.


title: GPU Methodologies for Numerical Partial Differential Equations

abstract: In this thesis we develop techniques to efficiently solve numerical Partial Differential Equations (PDEs) using Graphical Processing Units (GPUs). Focus is put on both performance and re--usability of the methods developed, to this end a library, cuSten, for applying finite--difference stencils to numerical grids is presented herein. On top of this various batched tridiagonal and pentadiagonal matrix solvers are discussed. These have been benchmarked against the current state of the art and shown to improve performance in the solution of numerical PDEs. A variety of other benchmarks and use cases for the GPU methodologies are presented using the Cahn--Hilliard equation as a core example, but it is emphasised the methods are completely general. Finally through the application of the GPU methodologies to the Cahn--Hilliard equation new results are presented on the growth rates of the coarsened domains. In particular a statistical model is built up using batches of simulations run on GPUs from which the growth rates are extracted, it is shown that in a finite domain that the traditionally presented results of 1/3 scaling is in fact a distribution around this value. This result is discussed in conjunction with modelling via a stochastic PDE and sheds new light on the behaviour of the Cahn--Hilliard equation in finite domains.


title: A multilevel clustering technique for community detection

abstract: A network is a composition of many communities, i.e., sets of nodes and edges with stronger relationships, with distinct and overlapping properties. Community detection is crucial for various reasons, such as serving as a functional unit of a network that captures local interactions among nodes. Communities come in various forms and types, ranging from biologically to technology-induced ones. As technology-induced communities, social media networks such as Twitter and Facebook connect a myriad of diverse users, leading to a highly connected and dynamic ecosystem. Although many algorithms have been proposed for detecting socially cohesive communities on Twitter, mining and related tasks remain challenging. This study presents a novel detection method based on a scalable framework to identify related communities in a network. We propose a multilevel clustering technique (MCT) that leverages structural and textual information to identify local communities termed microcosms. Experimental evaluation on benchmark models and datasets demonstrate the efficacy of the approach. This study contributes a new dimension for the detection of cohesive communities in social networks. The approach offers a better understanding and clarity toward describing how low-level communities evolve and behave on Twitter. From an application point of view, identifying such communities can better inform recommendation, among other benefits.


title: A Variational Formulation of Accelerated Optimization on Riemannian Manifolds

abstract: It was shown recently by Su et al. (2016) that Nesterov's accelerated gradient method for minimizing a smooth convex function $f$ can be thought of as the time discretization of a second-order ODE, and that $f(x(t))$ converges to its optimal value at a rate of $\mathcal{O}(1/t^2)$ along any trajectory $x(t)$ of this ODE. A variational formulation was introduced in Wibisono et al. (2016) which allowed for accelerated convergence at a rate of $\mathcal{O}(1/t^p)$, for arbitrary $p>0$, in normed vector spaces. This framework was exploited in Duruisseaux et al. (2021) to design efficient explicit algorithms for symplectic accelerated optimization. In Alimisis et al. (2020), a second-order ODE was proposed as the continuous-time limit of a Riemannian accelerated algorithm, and it was shown that the objective function $f(x(t))$ converges to its optimal value at a rate of $\mathcal{O}(1/t^2)$ along solutions of this ODE. In this paper, we show that on Riemannian manifolds, the convergence rate of $f(x(t))$ to its optimal value can also be accelerated to an arbitrary convergence rate $\mathcal{O}(1/t^p)$, by considering a family of time-dependent Bregman Lagrangian and Hamiltonian systems on Riemannian manifolds. This generalizes the results of Wibisono et al. (2016) to Riemannian manifolds and also provides a variational framework for accelerated optimization on Riemannian manifolds. An approach based on the time-invariance property of the family of Bregman Lagrangians and Hamiltonians was used to construct very efficient optimization algorithms in Duruisseaux et al. (2021), and we establish a similar time-invariance property in the Riemannian setting. One expects that a geometric numerical integrator that is time-adaptive, symplectic, and Riemannian manifold preserving will yield a class of promising optimization algorithms on manifolds.


title: Self-Supervised Representation Learning from Flow Equivariance

abstract: Self-supervised representation learning is able to learn semantically meaningful features; however, much of its recent success relies on multiple crops of an image with very few objects. Instead of learning view-invariant representation from simple images, humans learn representations in a complex world with changing scenes by observing object movement, deformation, pose variation, and ego motion. Motivated by this ability, we present a new self-supervised learning representation framework that can be directly deployed on a video stream of complex scenes with many moving objects. Our framework features a simple flow equivariance objective that encourages the network to predict the features of another frame by applying a flow transformation to the features of the current frame. Our representations, learned from high-resolution raw video, can be readily used for downstream tasks on static images. Readout experiments on challenging semantic segmentation, instance segmentation, and object detection benchmarks show that we are able to outperform representations obtained from previous state-of-the-art methods including SimCLR and BYOL.


title: Diverse Complexity Measures for Dataset Curation in Self-driving

abstract: Modern self-driving autonomy systems heavily rely on deep learning. As a consequence, their performance is influenced significantly by the quality and richness of the training data. Data collecting platforms can generate many hours of raw data in a daily basis, however, it is not feasible to label everything. It is thus of key importance to have a mechanism to identify "what to label". Active learning approaches identify examples to label, but their interestingness is tied to a fixed model performing a particular task. These assumptions are not valid in self-driving, where we have to solve a diverse set of tasks (i.e., perception, and motion forecasting) and our models evolve over time frequently. In this paper we introduce a novel approach and propose a new data selection method that exploits a diverse set of criteria that quantize interestingness of traffic scenes. Our experiments on a wide range of tasks and models show that the proposed curation pipeline is able to select datasets that lead to better generalization and higher performance.


title: Universal Critical Exponents of the Magnetic Domain Wall Depinning Transition

abstract: Magnetic field driven domain wall dynamics in a ferrimagnetic GdFeCo thin film with perpendicular magnetic anisotropy is studied using low temperature magneto-optical Kerr microscopy. Measurements performed in a practically athermal condition allow for the direct experimental determination of the velocity ($ \beta = 0.30 \pm 0.03 $) and correlation length ($ \nu = 1.3 \pm 0.3 $) exponents of the depinning transition. The whole family of exponents characterizing the transition is deduced, providing evidence that the depinning of magnetic domain walls is better described by the quenched Edwards-Wilkinson universality class.


title: On the Robin function for the Fractional Laplacian on symmetric domains

abstract: In this work we prove the non-degeneracy of the critical points of the Robin function for the Fractional Laplacian under symmetry and convexity assumptions on the domain $\Omega$. This work extends to the fractional setting the results of M. Grossi concerning the classical Laplace operator.


title: TrafficSim: Learning to Simulate Realistic Multi-Agent Behaviors

abstract: Simulation has the potential to massively scale evaluation of self-driving systems enabling rapid development as well as safe deployment. To close the gap between simulation and the real world, we need to simulate realistic multi-agent behaviors. Existing simulation environments rely on heuristic-based models that directly encode traffic rules, which cannot capture irregular maneuvers (e.g., nudging, U-turns) and complex interactions (e.g., yielding, merging). In contrast, we leverage real-world data to learn directly from human demonstration and thus capture a more diverse set of actor behaviors. To this end, we propose TrafficSim, a multi-agent behavior model for realistic traffic simulation. In particular, we leverage an implicit latent variable model to parameterize a joint actor policy that generates socially-consistent plans for all actors in the scene jointly. To learn a robust policy amenable for long horizon simulation, we unroll the policy in training and optimize through the fully differentiable simulation across time. Our learning objective incorporates both human demonstrations as well as common sense. We show TrafficSim generates significantly more realistic and diverse traffic scenarios as compared to a diverse set of baselines. Notably, we can exploit trajectories generated by TrafficSim as effective data augmentation for training better motion planner.


title: Deep-Mobility: A Deep Learning Approach for an Efficient and Reliable 5G Handover

abstract: 5G cellular networks are being deployed all over the world and this architecture supports ultra-dense network (UDN) deployment. Small cells have a very important role in providing 5G connectivity to the end users. Exponential increases in devices, data and network demands make it mandatory for the service providers to manage handovers better, to cater to the services that a user desire. In contrast to any traditional handover improvement scheme, we develop a 'Deep-Mobility' model by implementing a deep learning neural network (DLNN) to manage network mobility, utilizing in-network deep learning and prediction. We use network key performance indicators (KPIs) to train our model to analyze network traffic and handover requirements. In this method, RF signal conditions are continuously observed and tracked using deep learning neural networks such as the Recurrent neural network (RNN) or Long Short-Term Memory network (LSTM) and system level inputs are also considered in conjunction, to take a collective decision for a handover. We can study multiple parameters and interactions between system events along with the user mobility, which would then trigger a handoff in any given scenario. Here, we show the fundamental modeling approach and demonstrate usefulness of our model while investigating impacts and sensitivities of certain KPIs from the user equipment (UE) and network side.


title: On Graded $1$-Absorbing Prime Submodules

abstract: Let $G$ be a group with identity $e$, $R$ be a commutative $G$-graded ring with unity $1$ and $M$ be a $G$-graded unital $R$-module. In this article, we introduce the concept of graded $1$-absorbing prime submodule. A proper graded $R$-submodule $N$ of $M$ is said to be a graded $1$-absorbing prime $R$-submodule of $M$ if for all non-unit homogeneous elements $x, y$ of $R$ and homogeneous element $m$ of $M$ with $xym\in N$, either $xy\in (N :_{R} M)$ or $m\in N$. We show that the new concept is a generalization of graded prime submodules at the same time it is a special graded $2$-absorbing submodule. Several properties of a graded $1$-absorbing prime submodule have been obtained. We investigate graded $1$-absorbing prime submodules when the components $\left\{M_{g}:g\in G\right\}$ are multiplication $R_{e}$-modules.


title: Adversarial Attacks On Multi-Agent Communication

abstract: Growing at a fast pace, modern autonomous systems will soon be deployed at scale, opening up the possibility for cooperative multi-agent systems. Sharing information and distributing workloads allow autonomous agents to better perform tasks and increase computation efficiency. However, shared information can be modified to execute adversarial attacks on deep learning models that are widely employed in modern systems. Thus, we aim to study the robustness of such systems and focus on exploring adversarial attacks in a novel multi-agent setting where communication is done through sharing learned intermediate representations of neural networks. We observe that an indistinguishable adversarial message can severely degrade performance, but becomes weaker as the number of benign agents increases. Furthermore, we show that black-box transfer attacks are more difficult in this setting when compared to directly perturbing the inputs, as it is necessary to align the distribution of learned representations with domain adaptation. Our work studies robustness at the neural network level to contribute an additional layer of fault tolerance to modern security protocols for more secure multi-agent systems.


title: GENIE: Toward Reproducible and Standardized Human Evaluation for Text Generation

abstract: While often assumed a gold standard, effective human evaluation of text generation remains an important, open area for research. We revisit this problem with a focus on producing consistent evaluations that are reproducible -- over time and across different populations. We study this goal in different stages of the human evaluation pipeline. In particular, we consider design choices for the annotation interface used to elicit human judgments and their impact on reproducibility. Furthermore, we develop an automated mechanism for maintaining annotator quality via a probabilistic model that detects and excludes noisy annotators. Putting these lessons together, we introduce GENIE: a system for running standardized human evaluations across different generation tasks. We instantiate GENIE with datasets representing four core challenges in text generation: machine translation, summarization, commonsense reasoning, and machine comprehension. For each task, GENIE offers a leaderboard that automatically crowdsources annotations for submissions, evaluating them along axes such as correctness, conciseness, and fluency. We have made the GENIE leaderboards publicly available, and have already ranked 50 submissions from 10 different research groups. We hope GENIE encourages further progress toward effective, standardized evaluations for text generation.


title: Asynchronous Multi-View SLAM

abstract: Existing multi-camera SLAM systems assume synchronized shutters for all cameras, which is often not the case in practice. In this work, we propose a generalized multi-camera SLAM formulation which accounts for asynchronous sensor observations. Our framework integrates a continuous-time motion model to relate information across asynchronous multi-frames during tracking, local mapping, and loop closing. For evaluation, we collected AMV-Bench, a challenging new SLAM dataset covering 482 km of driving recorded using our asynchronous multi-camera robotic platform. AMV-Bench is over an order of magnitude larger than previous multi-view HD outdoor SLAM datasets, and covers diverse and challenging motions and environments. Our experiments emphasize the necessity of asynchronous sensor modeling, and show that the use of multiple cameras is critical towards robust and accurate SLAM in challenging outdoor scenes. For additional information, please see the project website at: https://www.cs.toronto.edu/~ajyang/amv-slam


title: Stereo Camera Visual SLAM with Hierarchical Masking and Motion-state Classification at Outdoor Construction Sites Containing Large Dynamic Objects

abstract: At modern construction sites, utilizing GNSS (Global Navigation Satellite System) to measure the real-time location and orientation (i.e. pose) of construction machines and navigate them is very common. However, GNSS is not always available. Replacing GNSS with on-board cameras and visual simultaneous localization and mapping (visual SLAM) to navigate the machines is a cost-effective solution. Nevertheless, at construction sites, multiple construction machines will usually work together and side-by-side, causing large dynamic occlusions in the cameras' view. Standard visual SLAM cannot handle large dynamic occlusions well. In this work, we propose a motion segmentation method to efficiently extract static parts from crowded dynamic scenes to enable robust tracking of camera ego-motion. Our method utilizes semantic information combined with object-level geometric constraints to quickly detect the static parts of the scene. Then, we perform a two-step coarse-to-fine ego-motion tracking with reference to the static parts. This leads to a novel dynamic visual SLAM formation. We test our proposals through a real implementation based on ORB-SLAM2, and datasets we collected from real construction sites. The results show that when standard visual SLAM fails, our method can still retain accurate camera ego-motion tracking in real-time. Comparing to state-of-the-art dynamic visual SLAM methods, ours shows outstanding efficiency and competitive result trajectory accuracy.


title: Privacy-Preserving Learning of Human Activity Predictors in Smart Environments

abstract: The daily activities performed by a disabled or elderly person can be monitored by a smart environment, and the acquired data can be used to learn a predictive model of user behavior. To speed up the learning, several researchers designed collaborative learning systems that use data from multiple users. However, disclosing the daily activities of an elderly or disabled user raises privacy concerns. In this paper, we use state-of-the-art deep neural network-based techniques to learn predictive human activity models in the local, centralized, and federated learning settings. A novel aspect of our work is that we carefully track the temporal evolution of the data available to the learner and the data shared by the user. In contrast to previous work where users shared all their data with the centralized learner, we consider users that aim to preserve their privacy. Thus, they choose between approaches in order to achieve their goals of predictive accuracy while minimizing the shared data. To help users make decisions before disclosing any data, we use machine learning to predict the degree to which a user would benefit from collaborative learning. We validate our approaches on real-world data.


title: Joint Beamforming and Location Optimization for Secure Data Collection in Wireless Sensor Networks with UAV-Carried Intelligent Reflecting Surface

abstract: This paper considers unmanned aerial vehicle (UAV)-carried intelligent reflecting surface (IRS) for secure data collection in wireless sensor networks. An eavesdropper (Eve) lurks within the vicinity of the main receiver (Bob) while several randomly placed sensor nodes beamform collaboratively to the UAV-carried IRS that reflects the signal to the main receiver (Bob). The design objective is to maximise the achievable secrecy rate in the noisy communication channel by jointly optimizing the collaborative beamforming weights of the sensor nodes, the trajectory of the UAV and the reflection coefficients of the IRS elements. By designing the IRS reflection coefficients with and without the knowledge of the eavesdropper's channel, we develop a non-iterative sub-optimal solution for the secrecy rate maximization problem. It has been shown analytically that the UAV flight time and the randomness in the distribution of the sensor nodes, obtained by varying the sensor distribution area, can greatly affect secrecy performance. In addition, the maximum allowable number of IRS elements as well as a bound on the attainable average secrecy rate of the IRS aided noisy communication channel have also been derived. Extensive simulation results demonstrate the superior performance of the proposed algorithms compared to the existing schemes.


title: Disjointly non-singular operators on order continuous Banach lattices complement the unbounded norm topology

abstract: In this article we investigate the disjointly non-singular (DNS) operators. Following [8] we say that an operator $T$ from a Banach lattice $F$ into a Banach space $E$ is DNS, if no restriction of $T$ to a subspace generated by a disjoint sequence is strictly singular. We partially answer a question from [8] by showing that this class of operators forms an open subset of $L\left(F,E\right)$ as soon as $F$ is order continuous. Moreover, we show that in this case $T$ is DNS if and only if the norm topology is the minimal topology which is simultaneously stronger than the unbounded norm topology and the topology generated by $T$ as a map (we say that $T$ "complements" the unbounded norm topology in $F$). Since the class of DNS operators plays a similar role in the category of Banach lattices as the upper semi-Fredholm operators play in the category of Banach spaces, we investigate and indeed uncover a similar characterization of the latter class of operators, but this time they have to complement the weak topology.


title: Back-n White Neutron Source at CSNS and its Applications

abstract: Back-streaming neutrons from the spallation target of the China Spallation Neutron Source (CSNS) that emit through the incoming proton channel were exploited to build a white neutron beam facility (the so-called Back-n white neutron source), which was completed in March 2018. The Back-n neutron beam is very intense, at approximately 2*10^7 n/cm^2/s at 55 m from the target, and has a nominal proton beam with a power of 100 kW in the CSNS-I phase and a kinetic energy of 1.6 GeV and a thick tungsten target in multiple slices with modest moderation from the cooling water through the slices. In addition, the excellent energy spectrum spanning from 0.5 eV to 200 MeV, and a good time resolution related to the time-of-flight measurements make it a typical white neutron source for nuclear data measurements; its overall performance is among that of the best white neutron sources in the world. Equipped with advanced spectrometers, detectors, and application utilities, the Back-n facility can serve wide applications, with a focus on neutron-induced cross-section measurements. This article presents an overview of the neutron beam characteristics, the experimental setups, and the ongoing applications at Back-n.


title: Learning hydrodynamic equations for active matter from particle simulations and experiments

abstract: Recent advances in high-resolution imaging techniques and particle-based simulation methods have enabled the precise microscopic characterization of collective dynamics in various biological and engineered active matter systems. In parallel, data-driven algorithms for learning interpretable continuum models have shown promising potential for the recovery of underlying partial differential equations (PDEs) from continuum simulation data. By contrast, learning macroscopic hydrodynamic equations for active matter directly from experiments or particle simulations remains a major challenge. Here, we present a framework that leverages spectral basis representations and sparse regression algorithms to discover PDE models from microscopic simulation and experimental data, while incorporating the relevant physical symmetries. We illustrate the practical potential through applications to a chiral active particle model mimicking swimming cells and to recent microroller experiments. In both cases, our scheme learns hydrodynamic equations that reproduce quantitatively the self-organized collective dynamics observed in the simulations and experiments. This inference framework makes it possible to measure a large number of hydrodynamic parameters in parallel and directly from video data.


title: A Literature Review of Recent Graph Embedding Techniques for Biomedical Data

abstract: With the rapid development of biomedical software and hardware, a large amount of relational data interlinking genes, proteins, chemical components, drugs, diseases, and symptoms has been collected for modern biomedical research. Many graph-based learning methods have been proposed to analyze such type of data, giving a deeper insight into the topology and knowledge behind the biomedical data, which greatly benefit to both academic research and industrial application for human healthcare. However, the main difficulty is how to handle high dimensionality and sparsity of the biomedical graphs. Recently, graph embedding methods provide an effective and efficient way to address the above issues. It converts graph-based data into a low dimensional vector space where the graph structural properties and knowledge information are well preserved. In this survey, we conduct a literature review of recent developments and trends in applying graph embedding methods for biomedical data. We also introduce important applications and tasks in the biomedical domain as well as associated public biomedical datasets.


title: Membership Inference Attack on Graph Neural Networks

abstract: Graph Neural Networks (GNNs), which generalize traditional deep neural networks on graph data, have achieved state-of-the-art performance on several graph analytical tasks. We focus on how trained GNN models could leak information about the \emph{member} nodes that they were trained on. We introduce two realistic settings for performing a membership inference (MI) attack on GNNs. While choosing the simplest possible attack model that utilizes the posteriors of the trained model (black-box access), we thoroughly analyze the properties of GNNs and the datasets which dictate the differences in their robustness towards MI attack. While in traditional machine learning models, overfitting is considered the main cause of such leakage, we show that in GNNs the additional structural information is the major contributing factor. We support our findings by extensive experiments on four representative GNN models. To prevent MI attacks on GNN, we propose two effective defenses that significantly decreases the attacker's inference by up to 60% without degradation to the target model's performance. Our code is available at https://github.com/iyempissy/rebMIGraph.


title: S3: Neural Shape, Skeleton, and Skinning Fields for 3D Human Modeling

abstract: Constructing and animating humans is an important component for building virtual worlds in a wide variety of applications such as virtual reality or robotics testing in simulation. As there are exponentially many variations of humans with different shape, pose and clothing, it is critical to develop methods that can automatically reconstruct and animate humans at scale from real world data. Towards this goal, we represent the pedestrian's shape, pose and skinning weights as neural implicit functions that are directly learned from data. This representation enables us to handle a wide variety of different pedestrian shapes and poses without explicitly fitting a human parametric body model, allowing us to handle a wider range of human geometries and topologies. We demonstrate the effectiveness of our approach on various datasets and show that our reconstructions outperform existing state-of-the-art methods. Furthermore, our re-animation experiments show that we can generate 3D human animations at scale from a single RGB image (and/or an optional LiDAR sweep) as input.


title: Tracial smooth functions of non-commuting variables and the free Wasserstein manifold

abstract: We formulate a free probabilistic analog of the Wasserstein manifold on $\mathbb{R}^d$ (the formal Riemannian manifold of smooth probability densities on $\mathbb{R}^d$), and we use it to study smooth non-commutative transport of measure. The points of the free Wasserstein manifold $\mathscr{W}(\mathbb{R}^{*d})$ are smooth tracial non-commutative functions $V$ with quadratic growth at $\infty$, which correspond to minus the log-density in the classical setting. The space of smooth tracial non-commutative functions used here is a new one whose definition and basic properties we develop in the paper; they are scalar-valued functions of self-adjoint $d$-tuples from arbitrary tracial von Neumann algebras that can be approximated by trace polynomials. The space of non-commutative diffeomorphisms $\mathscr{D}(\mathbb{R}^{*d})$ acts on $\mathscr{W}(\mathbb{R}^{*d})$ by transport, and the basic relationship between tangent vectors for $\mathscr{D}(\mathbb{R}^{*d})$ and tangent vectors for $\mathscr{W}(\mathbb{R}^{*d})$ is described using the Laplacian $L_V$ associated to $V$ and its pseudo-inverse $\Psi_V$ (when defined). Following similar arguments to arXiv:1204.2182, arXiv:1701.00132, and arXiv:1906.10051 in the new setting, we give a rigorous proof for the existence of smooth transport along any path $t \mapsto V_t$ when $V$ is sufficiently close $(1/2) \sum_j \operatorname{tr}(x_j^2)$, as well as smooth triangular transport.


title: Understanding in Artificial Intelligence

abstract: Current Artificial Intelligence (AI) methods, most based on deep learning, have facilitated progress in several fields, including computer vision and natural language understanding. The progress of these AI methods is measured using benchmarks designed to solve challenging tasks, such as visual question answering. A question remains of how much understanding is leveraged by these methods and how appropriate are the current benchmarks to measure understanding capabilities. To answer these questions, we have analysed existing benchmarks and their understanding capabilities, defined by a set of understanding capabilities, and current research streams. We show how progress has been made in benchmark development to measure understanding capabilities of AI methods and we review as well how current methods develop understanding capabilities.


title: Dislocation content of grain boundary phase junctions and its relation to grain boundary excess properties

abstract: We analyze the dislocation content of grain boundary (GB) phase junctions, i.e., line defects separating two different GB phases coexisting on the same GB plane. While regular GB disconnections have been characterized for a variety of interfaces, GB phase junctions formed by GBs with different structures and different numbers of excess atoms have not been previously studied. We apply a general Burgers circuit analysis to calculate the Burgers vectors b of junctions in two {\Sigma}5 Cu boundaries previously simulated with molecular dynamics. The Burgers vectors of these junctions cannot be described by the displacement shift complete (DSC) lattice alone. We show that, in general, the normal component of b is not equal to the difference in the GB excess volumes, but contains another contribution from the numbers of GB atoms per unit area {\Delta}N required to transform one GB phase into another. In the boundaries studied, the latter component dominates and even changes the sign of b. We derive expressions for the normal and tangential components of b in terms of the DSC lattice vectors and the non-DSC part due to {\Delta}N and additional GB excess properties, including excess volume and shears. These expressions provide a connection between GB phase transformations driven by the GB free energy difference and the motion of GB junctions under applied normal and shear stresses. The proposed analysis quantifies b and therefore makes it possible to calculate the elastic part of the energy of these defects, evaluate their contribution to the nucleation barrier during GB phase transformations, and treat elastic interactions with other defects.


title: Demonstration and operation of quantum harmonic oscillators in an AlGaAs-GaAs heterostructure

abstract: The quantum harmonic oscillator (QHO), one of the most important and ubiquitous model systems in quantum mechanics, features equally spaced energy levels or eigenstates. Here we present a new class of nearly ideal QHOs formed by hydrogenic substitutional dopants in an AlGaAs/GaAs heterostructure. On the basis of model calculations, we demonstrate that, when a deta-doping Si donor substitutes the Ga/Al lattice site close to AlGaAs/GaAs heterointerface, a hydrogenic Si QHO, characterized by a restoring Coulomb force producing square law harmonic potential, is formed. This gives rise to QHO states with energy spacing of about ~8-9 meV. We experimentally confirm this proposal by utilizing gate tuning and measuring QHO states using an aluminum single-electron transistor (SET). A sharp and fast oscillation with period of ~7-8 mV appears in addition to the regular Coulomb blockade (CB) oscillation with much larger period, for positive gate biases above 0.5 V. The observation of fast oscillation and its behavior is quantitatively consistent with our theoretical result, manifesting the harmonic motion of electrons from the QHO. Our results might establish a general principle to design, construct and manipulate QHOs in semiconductor heterostructures, opening future possibilities for their quantum applications.


title: Telescopers for differential forms with one parameter

abstract: Telescopers for a function are linear differential (resp. difference) operators annihilated by the definite integral (resp. definite sum) of this function. They play a key role in Wilf-Zeilberger theory and algorithms for computing them have been extensively studied in the past thirty years. In this paper, we introduce the notion of telescopers for differential forms with $D$-finite function coefficients. These telescopers appear in several areas of mathematics, for instance parametrized differential Galois theory and mirror symmetry. We give a sufficient and necessary condition for the existence of telescopers for a differential form and describe a method to compute them if they exist. Algorithms for verifying this condition are also given.


title: Strong coupling between excitons and magnetic dipole quasi-bound states in the continuum in WS$_2$-TiO$_2$ hybrid metasurfaces

abstract: Enhancing the light-matter interactions in two-dimensional materials via optical metasurfaces has attracted much attention due to its potential to enable breakthrough in advanced compact photonic and quantum information devices. Here, we theoretically investigate a strong coupling between excitons in monolayer WS$_2$ and quasi-bound states in the continuum (quasi-BIC). In the hybrid structure composed of WS$_2$ coupled with asymmetric titanium dioxide nanobars, a remarkable spectral splitting and typical anticrossing behavior of the Rabi splitting can be observed, and such strong coupling effect can be modulated by shaping the thickness and asymmetry parameter of the proposed metasurfaces. It is found that the balance of line width of the quasi-BIC mode and local electric field enhancement should be considered since both of them affect the strong coupling, which is crucial to the design and optimization of metasurface devices. This work provides a promising way for controlling the light-matter interactions in strong coupling regime and opens the door for the future novel quantum, low-energy, distinctive nanodevices by advanced meta-optical engineering.


title: On Chevalley restriction theorem for semi-reductive algebraic groups and its applications

abstract: An algebraic group is called semi-reductive if it is a semi-direct product of a reductive subgroup and the unipotent radical. Such a semi-reductive algebraic group naturally arises and also plays a key role in the study of modular representations of non-classical finite-dimensional simple Lie algebras in positive characteristic, and some other cases. Let $G$ ba a connected semi-reductive algebraic group over an algebraically closed field $\mathbb{F}$ and $\mathfrak{g}=Lie(G)$. It turns out that $G$ has many same properties as reductive groups, such as the Bruhat decomposition. In this note, we obtain an analogue of classical Chevalley restriction theorem for $\mathfrak{g}$, which says that the $G$-invariant ring $\mathbb{F}[\mathfrak{g}]^G$ is a polynomial ring if $\mathfrak{g}$ satisfies a certain "posivity" condition suited for lots of cases we are interested in. As applications, we further investigate the nilpotent cones and resolutions of singularities for semi-reductive Lie algebras.


title: Searching for Nuclear Obscuration in the Infrared Spectra of Nearby FR I Radio Galaxies

abstract: How do active galactic nuclei with low optical luminosities produce powerful radio emission? Recent studies of active galactic nuclei with moderate radio and low optical luminosities (Fanaroff & Riley class I, FR I) searching for broad nuclear emission lines in polarized light, as predicted by some active galactic nucleus unification models, have found heterogeneous results. These models typically consist of a central engine surrounded by a torus of discrete dusty clouds. These clouds would absorb and scatter optical emission, blocking broad nuclear emission lines, and reradiate in mid-infrared. Some scattered broad-line emission may be observable, depending on geometry, which would be polarized. We present a wide-band infrared spectroscopic analysis of 10 nearby FR I radio galaxies to determine whether there is significant emission from a dusty obscuring structure. We used Markov Chain Monte Carlo algorithms to decompose Spitzer/IRS spectra of our sample. We constrained the wide-band behavior of our models with photometry from the Two Micron All Sky Survey, Spitzer/IRAC, Spitzer/MIPS, and Herschel/SPIRE. We find that one galaxy is best fit by a clumpy torus and three others show some thermal mid-infrared component. This suggests that in those three there is likely some obscuring dust structure that is inconsistent with our torus models and there must be some source of photons heating the dust. We conclude that 40% of our FR I radio galaxies show evidence of obscuring dusty material, possibly some other form of hidden broad-line nucleus, but only 10% favor the clumpy torus model specifically.


title: Physics-Informed Deep Learning for Traffic State Estimation

abstract: Traffic state estimation (TSE), which reconstructs the traffic variables (e.g., density) on road segments using partially observed data, plays an important role on efficient traffic control and operation that intelligent transportation systems (ITS) need to provide to people. Over decades, TSE approaches bifurcate into two main categories, model-driven approaches and data-driven approaches. However, each of them has limitations: the former highly relies on existing physical traffic flow models, such as Lighthill-Whitham-Richards (LWR) models, which may only capture limited dynamics of real-world traffic, resulting in low-quality estimation, while the latter requires massive data in order to perform accurate and generalizable estimation. To mitigate the limitations, this paper introduces a physics-informed deep learning (PIDL) framework to efficiently conduct high-quality TSE with small amounts of observed data. PIDL contains both model-driven and data-driven components, making possible the integration of the strong points of both approaches while overcoming the shortcomings of either. This paper focuses on highway TSE with observed data from loop detectors, using traffic density as the traffic variables. We demonstrate the use of PIDL to solve (with data from loop detectors) two popular physical traffic flow models, i.e., Greenshields-based LWR and three-parameter-based LWR, and discover the model parameters. We then evaluate the PIDL-based highway TSE using the Next Generation SIMulation (NGSIM) dataset. The experimental results show the advantages of the PIDL-based approach in terms of estimation accuracy and data efficiency over advanced baseline TSE methods.


title: Existence of solutions to nonlinear parabolic equations via majorant integral kernel

abstract: We establish the existence of solutions to the Cauchy problem for a large class of nonlinear parabolic equations including fractional semilinear parabolic equations, higher-order semilinear parabolic equations, and viscous Hamilton-Jacobi equations by using the majorant kernel introduced in [K. Ishige, T. Kawakami, and S. Okabe, Ann. Inst. H. Poincar\'e Anal. Non Lin\'eaire 37 (2020), 1185--1209].


title: Tailored Learning-Based Scheduling for Kubernetes-Oriented Edge-Cloud System

abstract: Kubernetes (k8s) has the potential to merge the distributed edge and the cloud but lacks a scheduling framework specifically for edge-cloud systems. Besides, the hierarchical distribution of heterogeneous resources and the complex dependencies among requests and resources make the modeling and scheduling of k8s-oriented edge-cloud systems particularly sophisticated. In this paper, we introduce KaiS, a learning-based scheduling framework for such edge-cloud systems to improve the long-term throughput rate of request processing. First, we design a coordinated multi-agent actor-critic algorithm to cater to decentralized request dispatch and dynamic dispatch spaces within the edge cluster. Second, for diverse system scales and structures, we use graph neural networks to embed system state information, and combine the embedding results with multiple policy networks to reduce the orchestration dimensionality by stepwise scheduling. Finally, we adopt a two-time-scale scheduling mechanism to harmonize request dispatch and service orchestration, and present the implementation design of deploying the above algorithms compatible with native k8s components. Experiments using real workload traces show that KaiS can successfully learn appropriate scheduling policies, irrespective of request arrival patterns and system scales. Moreover, KaiS can enhance the average system throughput rate by 14.3% while reducing scheduling cost by 34.7% compared to baselines.


title: Powers of sums and their associated primes

abstract: Let $A, B$ be polynomial rings over a field $k$, and $I\subseteq A, J\subseteq B$ proper homogeneous ideals. We analyze the associated primes of powers of $I+J\subseteq A\otimes_k B$ given the data on the summands. The associated primes of large enough powers of $I+J$ are determined. We then answer positively a question about the persistence property of $I+J$ in many new cases.


title: Acceleration of multiple precision matrix multiplication based on multi-component floating-point arithmetic using AVX2

abstract: In this paper, we report the results obtained from the acceleration of multi-binary64-type multiple precision matrix multiplication with AVX2. We target double-double (DD), triple-double (TD), and quad-double (QD) precision arithmetic designed by certain types of error-free transformation (EFT) arithmetic. Furthermore, we implement SIMDized EFT functions, which simultaneously compute with four binary64 numbers on x86_64 computing environment, and by using help of them, we also develop SIMDized DD, TD, and QD additions and multiplications. In addition, AVX2 load/store functions were adopted to efficiently speed up reading and storing matrix elements from/to memory. Owing to these combined techniques, our implemented multiple precision matrix multiplications have been accelerated more than three times compared with non-accelerated ones. Our accelerated matrix multiplication modifies the performance of parallelization with OpenMP.


title: Diagnosis of systemic risk and contagion across financial sectors

abstract: In normal times, it is assumed that financial institutions operating in non-overlapping sectors have complementary and distinct outcomes, typically reflected in mostly uncorrelated outcomes and asset returns. Such is the reasoning behind common "free lunches" to be had in investing, like diversifying assets across equity and bond sectors. Unfortunately, the recurrence of crises like the Great Financial Crisis of 2007-2008 demonstrate that such convenient assumptions often break down, with dramatic consequences for all financial actors. In hindsight, the emergence of systemic risk (as exemplified by failure in one part of a system spreading to ostensibly unrelated parts of the system) has been explained by narratives such as deregulation and leverage. But can we diagnose and quantify the ongoing emergence of systemic risk in financial systems? In this study, we focus on two previously-documented measures of systemic risk that require only easily available time series data (eg monthly asset returns): cross-correlation and principal component analysis. We apply these tests to daily and monthly returns on hedge fund indexes and broad-based market indexes, and discuss their results. We hope that a frank discussion of these simple, non-parametric measures can help inform legislators, lawmakers, and financial actors of potential crises looming on the horizon.


title: Auto4D: Learning to Label 4D Objects from Sequential Point Clouds

abstract: In the past few years we have seen great advances in object perception (particularly in 4D space-time dimensions) thanks to deep learning methods. However, they typically rely on large amounts of high-quality labels to achieve good performance, which often require time-consuming and expensive work by human annotators. To address this we propose an automatic annotation pipeline that generates accurate object trajectories in 3D space (i.e., 4D labels) from LiDAR point clouds. The key idea is to decompose the 4D object label into two parts: the object size in 3D that's fixed through time for rigid objects, and the motion path describing the evolution of the object's pose through time. Instead of generating a series of labels in one shot, we adopt an iterative refinement process where online generated object detections are tracked through time as the initialization. Given the cheap but noisy input, our model produces higher quality 4D labels by re-estimating the object size and smoothing the motion path, where the improvement is achieved by exploiting aggregated observations and motion cues over the entire trajectory. We validate the proposed method on a large-scale driving dataset and show a 25% reduction of human annotation efforts. We also showcase the benefits of our approach in the annotator-in-the-loop setting.


title: Acceleration of Tropical Cyclones As a Proxy For Extratropical Interactions: Synoptic-Scale Patterns and Long-Term Trends

abstract: It is well known that rapid changes in tropical cyclone motion occur during interaction with extratropical waves. While the translation speed has received much attention in the published literature, acceleration has not. Using a large data sample of Atlantic tropical cyclones, we formally examine the composite synoptic-scale patterns associated with tangential and \curvature components of their acceleration. During periods of rapid tangential acceleration, the composite tropical cyclone moves poleward between an upstream trough and downstream ridge of a developing extratropical wavepacket. The two systems subsequently merge in a manner that is consistent with extratropical transition. During rapid curvature acceleration, a prominent downstream ridge promotes recurvature of the tropical cyclone. In contrast, during rapid tangential or curvature deceleration, a ridge is located directly poleward of the tropical cyclone. Locally, this arrangement takes the form of a cyclone-anticyclone vortex pair somewhat akin to a dipole block. On average, the tangential acceleration peaks 18 hours prior to extratropical transition while the curvature acceleration peaks at recurvature. These findings confirm that rapid acceleration of tropical cyclones is mediated by interaction with extratropical baroclinic waves. Furthermore, The tails of the distribution of acceleration and translation speed show a robust reduction over the past 5 decades. We speculate that these trends may reflect the poleward shift and weakening of extratropical Rossby waves.


title: Lyapunov exponents for transfer operator cocycles of metastable maps: a quarantine approach

abstract: This works investigates the Lyapunov-Oseledets spectrum of transfer operator cocycles associated to one-dimensional random paired tent maps depending on a parameter $\epsilon$, quantifying the strength of the \emph{leakage} between two nearly invariant regions. We show that the system exhibits metastability, and identify the second Lyapunov exponent $\lambda_2^\epsilon$ within an error of order $\epsilon^2|\log \epsilon|$. This approximation agrees with the naive prediction provided by a time-dependent two-state Markov chain. Furthermore, it is shown that $\lambda_1^\epsilon=0$ and $\lambda_2^\epsilon$ are simple, and are the only exceptional Lyapunov exponents of magnitude greater than $-\log2+ O(\log\log\tfrac 1\epsilon/\log\tfrac 1\epsilon)$.


title: Data-driven discovery of multiscale chemical reactions governed by the law of mass action

abstract: In this paper, we propose a data-driven method to discover multiscale chemical reactions governed by the law of mass action. First, we use a single matrix to represent the stoichiometric coefficients for both the reactants and products in a system without catalysis reactions. The negative entries in the matrix denote the stoichiometric coefficients for the reactants and the positive ones for the products. Second, we find that the conventional optimization methods usually get stuck in the local minima and could not find the true solution in learning the multiscale chemical reactions. To overcome this difficulty, we propose a partial-parameters-freezing (PPF) technique to progressively determine the network parameters by using the fact that the stoichiometric coefficients are integers. With such a technique, the dimension of the searching space is gradually reduced in the training process and the global mimina can be eventually obtained. Several numerical experiments including the classical Michaelis-Menten kinetics, the hydrogen oxidation reactions, and the simplified GRI-3.0 mechanism verify the good performance of our algorithm in learning the multiscale chemical reactions. The code is available at \url{https://github.com/JuntaoHuang/multiscale-chemical-reaction}.

categories: physics.chem-ph cs.LG cs.NA math.NA math.OC physics.comp-ph


title: Cost-Efficient Online Hyperparameter Optimization

abstract: Recent work on hyperparameters optimization (HPO) has shown the possibility of training certain hyperparameters together with regular parameters. However, these online HPO algorithms still require running evaluation on a set of validation examples at each training step, steeply increasing the training cost. To decide when to query the validation loss, we model online HPO as a time-varying Bayesian optimization problem, on top of which we propose a novel \textit{costly feedback} setting to capture the concept of the query cost. Under this setting, standard algorithms are cost-inefficient as they evaluate on the validation set at every round. In contrast, the cost-efficient GP-UCB algorithm proposed in this paper queries the unknown function only when the model is less confident about current decisions. We evaluate our proposed algorithm by tuning hyperparameters online for VGG and ResNet on CIFAR-10 and ImageNet100. Our proposed online HPO algorithm reaches human expert-level performance within a single run of the experiment, while incurring only modest computational overhead compared to regular training.


title: Semiconductor-to-metal transition in bilayer MoSi$_2$N$_4$ and WSi$_2$N$_4$ with strain and electric field

abstract: With exceptional electrical and mechanical properties and at the same time air-stability, layered MoSi2N4 has recently draw great attention. However, band structure engineering via strain and electric field, which is vital for practical applications, has not yet been explored. In this work, we show that the biaxial strain and external electric field are effective ways for the band gap engineering of bilayer MoSi$_2$N$_4$ and WSi$_2$N$_4$. It is found that strain can lead to indirect band gap to direct band gap transition. On the other hand, electric field can result in semiconductor to metal transition. Our study provides insights into the band structure engineering of bilayer MoSi$_2$N$_4$ and WSi$_2$N$_4$ and would pave the way for its future nanoelectronics and optoelectronics applications.