title: The Operational Choi-Jamiolkowski Isomorphism

abstract: In this article, I use an operational formulation of the Choi-Jamio\l{}kowski isomorphism to explore an approach to quantum mechanics in which the state is not the fundamental object. I first situate this project in the context of generalized probabilistic theories and argue that this framework may be understood as a means of drawing conclusions about the intratheoretic causal structure of quantum mechanics which are independent of any specific ontological picture. I then give an operational formulation of the Choi-Jamio\l{}kowski isomorphism and show that in an operational theory which exhibits this isomorphism, several features of the theory which are usually regarded as properties of the quantum state can be derived from constraints on non-local correlations. This demonstrates that there is no need to postulate states to be the bearers of these properties, since they can be understood as consequences of a fundamental equivalence between multipartite and temporal correlations.


title: Generalized Kernel Two-Sample Tests

abstract: Kernel two-sample tests have been widely used for multivariate data to test equality of distributions. However, existing tests based on mapping distributions into a reproducing kernel Hilbert space mainly target specific alternatives and do not work well for some scenarios when the dimension of the data is moderate to high due to the curse of dimensionality. We propose a new test statistic that makes use of a common pattern under moderate and high dimensions and achieves substantial power improvements over existing kernel two-sample tests for a wide range of alternatives. We also propose alternative testing procedures that maintain high power with low computational cost, offering easy off-the-shelf tools for large datasets. The new approaches are compared to other state-of-the-art tests under various settings and show good performance. We showcase the new approaches through two applications: The comparison of musks and non-musks using the shape of molecules, and the comparison of taxi trips starting from John F. Kennedy airport in consecutive months. All proposed methods are implemented in an R package kerTests.


title: Author's Sentiment Prediction

abstract: We introduce PerSenT, a dataset of crowd-sourced annotations of the sentiment expressed by the authors towards the main entities in news articles. The dataset also includes paragraph-level sentiment annotations to provide more fine-grained supervision for the task. Our benchmarks of multiple strong baselines show that this is a difficult classification task. The results also suggest that simply fine-tuning document-level representations from BERT isn't adequate for this task. Making paragraph-level decisions and aggregating them over the entire document is also ineffective. We present empirical and qualitative analyses that illustrate the specific challenges posed by this dataset. We release this dataset with 5.3k documents and 38k paragraphs covering 3.2k unique entities as a challenge in entity sentiment analysis.


title: CheXphotogenic: Generalization of Deep Learning Models for Chest X-ray Interpretation to Photos of Chest X-rays

abstract: The use of smartphones to take photographs of chest x-rays represents an appealing solution for scaled deployment of deep learning models for chest x-ray interpretation. However, the performance of chest x-ray algorithms on photos of chest x-rays has not been thoroughly investigated. In this study, we measured the diagnostic performance for 8 different chest x-ray models when applied to photos of chest x-rays. All models were developed by different groups and submitted to the CheXpert challenge, and re-applied to smartphone photos of x-rays in the CheXphoto dataset without further tuning. We found that several models had a drop in performance when applied to photos of chest x-rays, but even with this drop, some models still performed comparably to radiologists. Further investigation could be directed towards understanding how different model training procedures may affect model generalization to photos of chest x-rays.


title: Early warning of precessing compact binary merger with third-generation gravitational-wave detectors

abstract: Rapid localization of gravitational-wave events is important for the success of the multi-messenger observations. The forthcoming improvements and constructions of gravitational-wave detectors will enable detecting and localizing compact-binary coalescence events even before mergers, which is called early warning. The performance of early warning can be improved by considering modulation of gravitational wave signal amplitude due to the Earth rotation and the precession of a binary orbital plane caused by the misaligned spins of compact objects. In this paper, for the first time we estimate localization precision in the early warning quantitatively, taking into account an orbital precession. We find that a neutron star-black hole binary at $z=0.1$ can typically be localized to $100\,\mathrm{deg}^2$ and $10\,\mathrm{deg^2}$ at the time of $12$ -- $15 \,\mathrm{minutes}$ and $50$ -- $300\,\mathrm{seconds}$ before merger, respectively, which cannot be achieved without the precession effect.


title: The role of quark matter surface tension in magnetars

abstract: In spite of its key role in compact star physics, the surface tension of quark matter is not well comprehended yet. In this work we analyze the behavior of the surface tension of three-flavor quark matter in the outer and inner core of cold deleptonized magnetars, proto magnetars born in core collapse supernovae, and hot magnetars produced in binary neutron stars mergers. We explore the role of temperature, baryon number density, trapped neutrinos, droplet size, and magnetic fields within the multiple reflection expansion formalism. Quark matter is described within the MIT bag model and is assumed to be in chemical equilibrium under weak interactions. We discuss some astrophysical consequences of our results.


title: Incorporating a Local Translation Mechanism into Non-autoregressive Translation

abstract: In this work, we introduce a novel local autoregressive translation (LAT) mechanism into non-autoregressive translation (NAT) models so as to capture local dependencies among tar-get outputs. Specifically, for each target decoding position, instead of only one token, we predict a short sequence of tokens in an autoregressive way. We further design an efficient merging algorithm to align and merge the out-put pieces into one final output sequence. We integrate LAT into the conditional masked language model (CMLM; Ghazvininejad et al.,2019) and similarly adopt iterative decoding. Empirical results on five translation tasks show that compared with CMLM, our method achieves comparable or better performance with fewer decoding iterations, bringing a 2.5xspeedup. Further analysis indicates that our method reduces repeated translations and performs better at longer sentences.


title: Deep Sketch-Based Modeling: Tips and Tricks

abstract: Deep image-based modeling received lots of attention in recent years, yet the parallel problem of sketch-based modeling has only been briefly studied, often as a potential application. In this work, for the first time, we identify the main differences between sketch and image inputs: (i) style variance, (ii) imprecise perspective, and (iii) sparsity. We discuss why each of these differences can pose a challenge, and even make a certain class of image-based methods inapplicable. We study alternative solutions to address each of the difference. By doing so, we drive out a few important insights: (i) sparsity commonly results in an incorrect prediction of foreground versus background, (ii) diversity of human styles, if not taken into account, can lead to very poor generalization properties, and finally (iii) unless a dedicated sketching interface is used, one can not expect sketches to match a perspective of a fixed viewpoint. Finally, we compare a set of representative deep single-image modeling solutions and show how their performance can be improved to tackle sketch input by taking into consideration the identified critical differences.


title: Fast or Slow: An Autonomous Speed Control Approach for UAV-assisted IoT Data Collection Networks

abstract: Unmanned Aerial Vehicles (UAVs) have been emerging as an effective solution for IoT data collection networks thanks to their outstanding flexibility, mobility, and low operation costs. However, due to the limited energy and uncertainty from the data collection process, speed control is one of the most important factors to optimize the energy usage efficiency and performance for UAV collectors. This work aims to develop a novel autonomous speed control approach to address this issue. To that end, we first formulate the dynamic speed control task of a UAV as a Markov decision process taking into account its energy status and location. In this way, the Q-learning algorithm can be adopted to obtain the optimal speed control policy for the UAV. To further improve the system performance, we develop an highly-effective deep dueling double Q-learning algorithm utilizing outstanding features of the deep neural networks as well as advanced dueling architecture to quickly stabilize the learning process and obtain the optimal policy. Through simulation results, we show that our proposed solution can achieve up to 40% greater performance compared with other conventional methods. Importantly, the simulation results also reveal significant impacts of UAV's energy and charging time on the system performance.


title: Hardness of Approximate Nearest Neighbor Search under L-infinity

abstract: We show conditional hardness of Approximate Nearest Neighbor Search (ANN) under the $\ell_\infty$ norm with two simple reductions. Our first reduction shows that hardness of a special case of the Shortest Vector Problem (SVP), which captures many provably hard instances of SVP, implies a lower bound for ANN with polynomial preprocessing time under the same norm. Combined with a recent quantitative hardness result on SVP under $\ell_\infty$ (Bennett et al., FOCS 2017), our reduction implies that finding a $(1+\varepsilon)$-approximate nearest neighbor under $\ell_\infty$ with polynomial preprocessing requires near-linear query time, unless the Strong Exponential Time Hypothesis (SETH) is false. This complements the results of Rubinstein (STOC 2018), who showed hardness of ANN under $\ell_1$, $\ell_2$, and edit distance. Further improving the approximation factor for hardness, we show that, assuming SETH, near-linear query time is required for any approximation factor less than $3$ under $\ell_\infty$. This shows a conditional separation between ANN under the $\ell_1/ \ell_2$ norm and the $\ell_\infty$ norm since there are sublinear time algorithms achieving better than $3$-approximation for the $\ell_1$ and $\ell_2$ norm. Lastly, we show that the approximation factor of $3$ is a barrier for any naive gadget reduction from the Orthogonal Vectors problem.


title: Large Zsigmondy Primes

abstract: If $a>b$ and $n>1$ are positive integers and $a$ and $b$ are relatively prime integers, then a large Zsigmondy prime for $(a,b,n)$ is a prime $p$ such that $p \,|\, a^n-b^n$ but $p \,\nmid \, a^m-b^m$ for $1 \leq m < n$ and either $p^2 \, | \, a^n - b^n$ or $ p > n + 1$. We classify all the triples of integers $(a, b, n)$ for which no large Zsigmondy prime exists.


title: 2d TQFT and baby universes

abstract: In this work, we extend a 2d topological gravity model of Marolf and Maxfield to have as its bulk action any open/closed TQFT obeying Atiyah's axioms. The holographic duals of these topological gravity models are ensembles of 1d topological theories with random dimension. Specifically, we find that the TQFT Hilbert space splits into sectors, between which correlators of boundary observables factorize, and that the corresponding sectors of the boundary theory have dimensions independently chosen from different Poisson distributions. As a special case, we study in detail the gravity model built from the bulk action of 2d Dijkgraaf-Witten theory, with or without end-of-the-world branes, and for arbitrary finite group $G$. The dual of this Dijkgraaf-Witten gravity model can be interpreted as a 1d topological theory whose Hilbert space is a random representation of $G$ and whose aforementioned sectors are labeled by the irreducible representations of $G$. These holographic interpretations of our gravity models require projecting out negative-norm states from the baby universe Hilbert space, which Marolf and Maxfield achieved by the (only seemingly) ad hoc solution of adding a nonlocal boundary term to the bulk action. In order to place their solution in the completely local framework of a TQFT with defects, we couple the boundaries of the gravity model to an auxiliary 2d TQFT in a non-gravitational (i.e. fixed topology) region. In this framework, the difficulty of negative-norm states can be remedied in a local way by the introduction of a defect line between the gravitational and non-gravitational regions. The gravity model is then holographically dual to an ensemble of boundary conditions in an open/closed TQFT without gravity.


title: Role of Nearly-Degenerate Vibrational Modes in Electron Transport through a Molecular Junction

abstract: We consider an open molecular junction in which electrons are coupled to multi-mode phonons. Using a master equation approach for equilibrated phonons, we show that nearly-degenerate phonon modes can be mapped into an effective single mode, which can result in a noticeable reduction of computational costs. As an illustration, we apply our theory to the OPV-5 molecule and show that we can obtain the consistent conductance spectra while reducing the computational time by orders of magnitude


title: EM-X-DL: Efficient Cross-Device Deep Learning Side-Channel Attack with Noisy EM Signatures

abstract: This work presents a Cross-device Deep-Learning based Electromagnetic (EM-X-DL) side-channel analysis (SCA), achieving >90% single-trace attack accuracy on AES-128, even in the presence of significantly lower signal-to-noise ratio (SNR), compared to the previous works. With an intelligent selection of multiple training devices and proper choice of hyperparameters, the proposed 256-class deep neural network (DNN) can be trained efficiently utilizing pre-processing techniques like PCA, LDA, and FFT on the target encryption engine running on an 8-bit Atmel microcontroller. Finally, an efficient end-to-end SCA leakage detection and attack framework using EM-X-DL demonstrates high confidence of an attacker with <20 averaged EM traces.


title: Stability of classical shock fronts for compressible hyperelastic materials of Hadamard type

abstract: This paper studies the uniform and weak Lopatinski\u{\i} conditions associated to classical (Lax) shock fronts of arbitrary amplitude for compressible hyperelastic materials of Hadamard type in several space dimensions. Thanks to the seminal works of Majda (Mem. Amer. Math. Soc. 43 (1983), no. 281; Mem. Amer. Math. Soc. 41 (1983), no. 275) and M\'etivier (Trans. Amer. Math. Soc. 296 (1986), pp. 431-479; Comm. Partial Diff. Eqs. 15 (1990), no. 7, pp. 983-1028), the uniform Lopatinski\u{\i} condition ensures the local-in-time, multidimensional, nonlinear stability of such fronts. The stability function (also called Lopatinski\u{\i} determinant) for shocks of arbitrary amplitude in this large class of hyperelastic materials is computed explicitly. This information is used to establish the conditions for uniform and weak shock stability in terms of the parameters of the shock and of the elastic moduli of the material.


title: Non-symmetric class $2$ association schemes obtained by doubling of skew-Hadamard matrices are non-schurian

abstract: We can obtain a non-symmetric class $2$ association scheme by a skew-Hadamard matrix. We begin with a skew-Hadamard matrix of order $n$, construct a skew-Hadamard matrix of order $2n$ by doubling construction, and a non-symmetric class $2$ association scheme of order $2n-1$. We will show that the association scheme obtained in this way never be schurian if $n$ is greater than or equal to $8$.


title: On the asymptotics of the shifted sums of Hecke eigenvalue squares

abstract: The purpose of this paper is to obtain asymptotics of shifted sums of Hecke eigenvalue squares on average. We show that for $X^{\frac{2}{3}+\epsilon} < H <X^{1-\epsilon},$ there are constants $B_{h}$ such that $$ \sum_{X\leq n \leq 2X} \lambda_{f}(n)^{2}\lambda_{f}(n+h)^{2}-B_{h}X=O_{f,A,\epsilon}\big(X (\log X)^{-A}\big)$$ for all but $O_{f,A,\epsilon}\big(H(\log X)^{-3A}\big)$ integers $h \in [1,H]$ where $\{\lambda_{f}(n)\}_{n\geq1}$ are normalized Hecke eigenvalues of a fixed holomorphic cusp form $f.$ Our method is based on the Hardy-Littlewood circle method. We divide the minor arcs into two parts $m_{1}$ and $m_{2}.$ In order to treat $m_{2},$ we use the Hecke relations, a bound of Miller to apply some arguments from a paper of Matom\"{a}ki, Radziwill and Tao. We apply Parseval's identity and Gallagher's lemma so as to treat $m_{1}.$


title: Adaptive Central-Upwind Scheme on Triangular Grids for the Saint-Venant System

abstract: In this work, we develop a robust adaptive well-balanced and positivity-preserving central-upwind scheme on unstructured triangular grids for shallow water equations. The numerical method is an extension of the scheme from [{\sc Liu {\em et al.}},J. of Comp. Phys, 374 (2018), pp. 213 - 236]. As a part of the adaptive central-upwind algorithm, we obtain local a posteriori error estimator for the efficient mesh refinement strategy. The accuracy, high-resolution, and efficiency of the new adaptive central-upwind scheme are demonstrated on a number of challenging tests for shallow water models.


title: I-POST: Intelligent Point of Sale and Transaction System

abstract: We propose a novel solution for the cashier problem. Current cashier system/Point of Sale (POS) terminals can be inefficient, cumbersome and time-consuming for the users. There is a need for a solution dependent on modern technology and ubiquitous computing resources. We present I-POST (Intelligent Point of Sale and Transaction) as a software system that uses smart devices, mobile phone and state of the art machine learning algorithms to process the user transactions in automated and real time manner. I-POST is an automated checkout system that allows the user to walk in a store, collect his items and exit the store. There is no need to stand and wait in a queue. The system uses object detection and facial recognition algorithm to process the authentication of the client and the state of the object. At point of exit, the classifier sends the data to the backend server which execute the payments. The system uses Convolution Neural Network (CNN) for the image recognition and processing. CNN is a supervised learning model that has found major application in pattern recognition problem. The current implementation uses two classifiers that work intrinsically to authenticate the user and track the items. The model accuracy for object recognition is 97%, the loss is 9.3%. We expect that such systems can bring efficiency to the market and has the potential for broad and diverse applications.


title: A non-energetic mechanism for glycine formation in the interstellar medium

abstract: The detection of the amino acid glycine and its amine precursor methylamine on the comet 67P/Churyumov-Gerasimenko by the Rosetta mission provides strong evidence for a cosmic origin of prebiotics on Earth. How and when such complex organic molecules form along the process of star- and planet-formation remains debated. We report the first laboratory detection of glycine formed in the solid phase through atom and radical-radical addition surface reactions under cold dense interstellar cloud conditions. Our experiments, supported by astrochemical models, suggest that glycine forms without the need for energetic irradiation, such as UV photons and cosmic rays, in interstellar water-rich ices, where it remains preserved, in a much earlier star-formation stage than previously assumed. We also confirm that solid methylamine is an important side-reaction product. A prestellar formation of glycine on ice grains provides the basis for a complex and ubiquitous prebiotic chemistry in space enriching the chemical content of planet-forming material.

categories: astro-ph.IM astro-ph.EP astro-ph.GA astro-ph.SR physics.chem-ph


title: Learning Models for Actionable Recourse

abstract: As machine learning models are increasingly deployed in high-stakes domains such as legal and financial decision-making, there has been growing interest in post-hoc methods for generating counterfactual explanations. Such explanations provide individuals adversely impacted by predicted outcomes (e.g., an applicant denied a loan) with recourse -- i.e., a description of how they can change their features to obtain a positive outcome. We propose a novel algorithm that leverages adversarial training and PAC confidence sets to learn models that theoretically guarantee recourse to affected individuals with high probability without sacrificing accuracy. We demonstrate the efficacy of our approach via extensive experiments on real data.


title: Limited-view Photoacoustic Imaging Reconstruction With Dual Domain Inputs Under Mutual Information Constraint

abstract: Based on photoacoustic effect, photoacoustic tomography is developing very fast in recent years, and becoming an important imaging tool for both preclinical and clinical studies. With enough ultrasound transducers placed around the biological tissue, PAT can provide both deep penetration and high image contrast by hybrid usage of light and sound. However, considering space and measurement environmental limitations, transducers are always placed in a limited-angle way, which means that the other side without transducer coverage suffers severe information loss. With conventional image reconstruction algorithms, the limited-view tissue induces artifacts and information loss, which may cause doctors misdiagnosis or missed diagnosis. In order to solve limited-view PA imaging reconstruction problem, we propose to use both time domain and frequency domain reconstruction algorithms to get delay-and-sum (DAS) image inputs and k-space image inputs. These dual domain images share nearly same texture information but different artifact information, which can teach network how to distinguish these two kinds of information at input level. In this paper, we propose Dual Domain Unet (DuDoUnet) with specially designed Information Sharing Block (ISB), which can further share two domains' information and distinguish artifacts. Besides, we use mutual information (MI) with an auxiliary network, whose inputs and outputs are both ground truth, to compensate prior knowledge of limited-view PA inputs. The proposed method is verified with a public clinical database, and shows superior results with SSIM = 93.5622% and PSNR = 20.8859.


title: Dynamics of test particles around a Bardeen black hole surrounded by perfect fluid dark matter

abstract: We study the dynamics of (i) neutral test particles, (ii) magnetically charged test particles, and (iii) test magnetic dipole around a regular Bardeen black hole surrounded by perfect fluid dark matter (PFDM). It has been shown how the magnetic charge of the black hole and the parameter of the surrounding PFDM can influence the innermost stable circular orbit (ISCO) radius of a test particle. We have found that the ISCO radius is strongly affected as a consequence of the combined effect of the magnetic charge parameter and the perfect fluid dark matter. The black hole magnetic charge parameter $g$ and the combined effect of perfect fluid dark matter can mimic the black hole rotation parameter up to $a/M\approx 0.9$. It has been observed that the ISCO for magnetic dipole disappears at the values exceeding the calculated upper value for the magnetic interaction parameter $\beta$. The upper limit decreases with the increase of both the dark matter and magnetic charge parameters. Finally, as an astrophysical application, we have analyzed degeneracy effects of spin of Kerr black holes and magnetic charge of regular Bardeen black holes for the different values of the dark matter parameter providing exactly the same value for ISCO radius of a magnetic dipole with the same value of the parameter $\beta=10.2$ of the magnetar called PSR J1745-2900 orbiting around supermassive black hole Sagittarius A*.


title: Identifying Depressive Symptoms from Tweets: Figurative Language Enabled Multitask Learning Framework

abstract: Existing studies on using social media for deriving mental health status of users focus on the depression detection task. However, for case management and referral to psychiatrists, healthcare workers require practical and scalable depressive disorder screening and triage system. This study aims to design and evaluate a decision support system (DSS) to reliably determine the depressive triage level by capturing fine-grained depressive symptoms expressed in user tweets through the emulation of Patient Health Questionnaire-9 (PHQ-9) that is routinely used in clinical practice. The reliable detection of depressive symptoms from tweets is challenging because the 280-character limit on tweets incentivizes the use of creative artifacts in the utterances and figurative usage contributes to effective expression. We propose a novel BERT based robust multi-task learning framework to accurately identify the depressive symptoms using the auxiliary task of figurative usage detection. Specifically, our proposed novel task sharing mechanism, co-task aware attention, enables automatic selection of optimal information across the BERT layers and tasks by soft-sharing of parameters. Our results show that modeling figurative usage can demonstrably improve the model's robustness and reliability for distinguishing the depression symptoms.


title: Total Completion Time Minimization for Scheduling with Incompatibility Cliques

abstract: This paper considers parallel machine scheduling with incompatibilities between jobs. The jobs form a graph and no two jobs connected by an edge are allowed to be assigned to the same machine. In particular, we study the case where the graph is a collection of disjoint cliques. Scheduling with incompatibilities between jobs represents a well-established line of research in scheduling theory and the case of disjoint cliques has received increasing attention in recent years. While the research up to this point has been focused on the makespan objective, we broaden the scope and study the classical total completion time criterion. In the setting without incompatibilities, this objective is well known to admit polynomial time algorithms even for unrelated machines via matching techniques. We show that the introduction of incompatibility cliques results in a richer, more interesting picture. Scheduling on identical machines remains solvable in polynomial time, while scheduling on unrelated machines becomes APX-hard. Furthermore, we study the problem under the paradigm of fixed-parameter tractable algorithms (FPT). In particular, we consider a problem variant with assignment restrictions for the cliques rather than the jobs. We prove that it is NP-hard and can be solved in FPT time with respect to the number of cliques. Moreover, we show that the problem on unrelated machines can be solved in FPT time for reasonable parameters, e.g., the parameter pair: number of machines and maximum processing time. The latter result is a natural extension of known results for the case without incompatibilities and can even be extended to the case of total weighted completion time. All of the FPT results make use of n-fold Integer Programs that recently have received great attention by proving their usefulness for scheduling problems.


title: On the energy and redshift distributions of fast radio bursts

abstract: Fast radio bursts (FRBs) are millisecond-duration radio transients from cosmological distances. Their isotropic energies follow a power-law distribution with a possible exponential cutoff, but their intrinsic redshift distribution, which contains information about the FRB sources, is not well understood. We attempt to constrain both distributions by means of Monte Carlo simulations and comparing the simulations results with the available FRB specific fluence distribution, dispersion measure (DM) distribution, and the estimated energy distribution data. Two redshift distribution models, one tracking the star formation history of the universe and another tracking compact binary mergers, are tested. For the latter model, we consider three merger delay timescale distribution (Gaussian, log-normal, and power law) models. Two FRB samples detected by Parkes and the Australian Square Kilometre Array Pathfinder (ASKAP), respectively, are used to confront the simulation results. We confirm the $\sim -1.8$ power law index for the energy distribution but the exponential cutoff energy of the distribution, if any, is unconstrained. For the best energy distribution model, none of the redshift distributions we considered are rejected by the data. A future, larger, uniform FRB sample (such as the one collected by the Canadian Hydrogen Intensity Mapping Experiment, CHIME) can provide better constraints on the intrinsic FRB redshift distribution using the methodology presented in this paper.


title: Step-like dependence of memory function on pulse width in spintronics reservoir computing

abstract: Physical reservoir computing is a type of recurrent neural network that applies the dynamical response from physical systems to information processing. However, the relation between computation performance and physical parameters/phenomena still remains unclear. This study reports our progress regarding the role of current-dependent magnetic damping in the computational performance of reservoir computing. The current-dependent relaxation dynamics of a magnetic vortex core results in an asymmetric memory function with respect to binary inputs. A fast relaxation caused by a large input leads to a fast fading of the input memory, whereas a slow relaxation by a small input enables the reservoir to keep the input memory for a relatively long time. As a result, a step-like dependence is found for the short-term memory and parity-check capacities on the pulse width of input data, where the capacities remain at 1.5 for a certain range of the pulse width, and drop to 1.0 for a long pulse-width limit. Both analytical and numerical analyses clarify that the step-like behavior can be attributed to the current-dependent relaxation time of the vortex core to a limit-cycle state. }


title: Augmenting BERT Carefully with Underrepresented Linguistic Features

abstract: Fine-tuned Bidirectional Encoder Representations from Transformers (BERT)-based sequence classification models have proven to be effective for detecting Alzheimer's Disease (AD) from transcripts of human speech. However, previous research shows it is possible to improve BERT's performance on various tasks by augmenting the model with additional information. In this work, we use probing tasks as introspection techniques to identify linguistic information not well-represented in various layers of BERT, but important for the AD detection task. We supplement these linguistic features in which representations from BERT are found to be insufficient with hand-crafted features externally, and show that jointly fine-tuning BERT in combination with these features improves the performance of AD classification by upto 5\% over fine-tuned BERT alone.


title: Accretion disks around naked singularities

abstract: We investigate here the thermal properties of accretion disks in a spacetime for some galactic density profiles in spherical symmetry. The matter distributions have a finite outer radius with a naked central singularity. The luminosities of the accretion disks for some density profile models are found to be higher than those for a Schwarzschild black hole of the same mass. The slopes for the luminosity distributions with respect to frequencies are significantly different, especially at higher frequencies, from that in the Schwarzschild black hole case. Such features may be used to distinguish black holes from naked singularities. The efficiencies for the conversion of the mass energy of the accreting gas into radiation and the strength of naked singularities are analyzed. The novel feature that we find is, the strength of the singularity is different depending on the profiles considered, and the stronger the singularity is, the higher is the efficiency for the accretion disk.


title: Experimental parameters, combined dynamics, and nonlinearity of a Magnonic-Opto-Electronic Oscillator (MOEO)

abstract: We report the construction and characterization of a comprehensive magnonic-opto-electronic oscillator (MOEO) system based on 1550-nm photonics and yttirum iron garnet (YIG) magnonics. The system exhibits a rich and synergistic parameter space because of the ability to control individual photonic, electronic, and magnonic components. Taking advantage of the spin wave dispersion of YIG, the frequency self-generation as well as the related nonlinear processes become sensitive to the external magnetic field. Besides being known as a narrowband filter and a delay element, the YIG delayline possesses spin wave modes that can be controlled to mix with the optoelectronic modes to generate higher-order harmonic beating modes. With the high sensitivity and external tunability, the MOEO system may find usefulness in sensing applications in magnetism and spintronics beyond optoelectronics and photonics.


title: Generalized Constraints as A New Mathematical Problem in Artificial Intelligence: A Review and Perspective

abstract: In this comprehensive review, we describe a new mathematical problem in artificial intelligence (AI) from a mathematical modeling perspective, following the philosophy stated by Rudolf E. Kalman that "Once you get the physics right, the rest is mathematics". The new problem is called "Generalized Constraints (GCs)", and we adopt GCs as a general term to describe any type of prior information in modelings. To understand better about GCs to be a general problem, we compare them with the conventional constraints (CCs) and list their extra challenges over CCs. In the construction of AI machines, we basically encounter more often GCs for modeling, rather than CCs with well-defined forms. Furthermore, we discuss the ultimate goals of AI and redefine transparent, interpretable, and explainable AI in terms of comprehension levels about machines. We review the studies in relation to the GC problems although most of them do not take the notion of GCs. We demonstrate that if AI machines are simplified by a coupling with both knowledge-driven submodel and data-driven submodel, GCs will play a critical role in a knowledge-driven submodel as well as in the coupling form between the two submodels. Examples are given to show that the studies in view of a generalized constraint problem will help us perceive and explore novel subjects in AI, or even in mathematics, such as generalized constraint learning (GCL).


title: Refractory doped titanium nitride nanoscale field emitters

abstract: Refractory materials exhibit high damage tolerance, which is attractive for the creation of nanoscale field-emission electronics and optoelectronics applications that require operation at high peak current densities and optical intensities. Recent results have demonstrated that the optical properties of titanium nitride, a refractory and CMOS-compatible plasmonic material, can be tuned by adding silicon and oxygen dopants. However, to fully leverage the potential of titanium (silicon oxy)nitride, a reliable and scalable fabrication process with few-nm precision is needed. In this work, we developed a fabrication process for producing engineered nanostructures with gaps between 10 and 15 nm, aspect ratios larger than 5 with almost 90{\deg} steep sidewalls. Using this process, we fabricated large-scale arrays of electrically-connected bow-tie nanoantennas with few-nm free-space gaps. We measured a typical variation of 4 nm in the average gap size. Using applied DC voltages and optical illumination, we tested the electronic and optoelectronic response of the devices, demonstrating sub-10-V tunneling operation across the free-space gaps, and quantum efficiency of up to 1E-3 at 1.2 {\mu}m, which is comparable to a bulk silicon photodiode at the same wavelength. Tests demonstrated that the titanium silicon oxynitride nanostructures did not significantly degrade, exhibiting less than 5 nm of shrinking of the average gap dimensions over few-{\mu}m^2 areas after roughly 6 hours of operation. Our results will be useful for developing the next generation of robust and CMOS-compatible nanoscale devices for high-speed and low-power field-emission electronics and optoelectronics applications.


title: Mostly Harmless Machine Learning: Learning Optimal Instruments in Linear IV Models

abstract: We offer straightforward theoretical results that justify incorporating machine learning in the standard linear instrumental variable setting. The key idea is to use machine learning, combined with sample-splitting, to predict the treatment variable from the instrument and any exogenous covariates, and then use this predicted treatment and the covariates as technical instruments to recover the coefficients in the second-stage. This allows the researcher to extract non-linear co-variation between the treatment and instrument that may dramatically improve estimation precision and robustness by boosting instrument strength. Importantly, we constrain the machine-learned predictions to be linear in the exogenous covariates, thus avoiding spurious identification arising from non-linear relationships between the treatment and the covariates. We show that this approach delivers consistent and asymptotically normal estimates under weak conditions and that it may be adapted to be semiparametrically efficient (Chamberlain, 1992). Our method preserves standard intuitions and interpretations of linear instrumental variable methods, including under weak identification, and provides a simple, user-friendly upgrade to the applied economics toolbox. We illustrate our method with an example in law and criminal justice, examining the causal effect of appellate court reversals on district court sentencing decisions.


title: Reliability Model for Incentive-Driven IoT Energy Services

abstract: We propose a novel reliability model for composing energy service requests. The proposed model is based on consumers' behavior and history of energy requests. The reliability model ensures the maximum incentives to providers. Incentives are used as a green solution to increase IoT users' participation in a crowdsourced energy sharing environment. Additionally, adaptive and priority scheduling compositions are proposed to compose the most reliable energy requests while maximizing providers' incentives. A set of experiments is conducted to evaluate the proposed approaches. Experimental results prove the efficiency of the proposed approaches.


title: Antiferromagnetically ordered state in the half-filled Hubbard model on the Socolar dodecagonal tiling

abstract: We investigate the antiferromagnetically ordered state in the half-filled Hubbard model on the Socolar dodecagonal tiling. When the interaction is introduced, the staggered magnetizations suddenly appear, which results from the existence of the macroscopically degenerate states in the tightbinding model. The increase of the interaction strength monotonically increases the magnetizations although its magnitude depends on the local environments. Magnetization profile is discussed in the perpendicular space. The similarity and difference are also addressed in magnetic properties in the Hubbard model on the Penrose, Ammann-Beenker, and Socolar dodecagonal tilings.


title: A Two-Stage Radar Sensing Approach based on MIMO-OFDM Technology

abstract: Recently, integrating the communication and sensing functions into a common network has attracted a great amount of attention. This paper considers the advanced signal processing techniques for enabling the radar to sense the environment via the communication signals. Since the technologies of orthogonal frequency division multiplexing (OFDM) and multiple-input multiple-output (MIMO) are widely used in the legacy cellular systems, this paper proposes a two-stage signal processing approach for radar sensing in an MIMO-OFDM system, where the scattered channels caused by various targets are estimated in the first stage, and the location information of the targets is then extracted from their scattered channels in the second stage. Specifically, based on the observations that radar sensing is similar to multi-path communication in the sense that different targets scatter the signal sent by the radar transmitter to the radar receiver with various delay, and that the number of scatters is limited, we show that the OFDM-based channel training approach together with the compressed sensing technique can be utilized to estimate the scattered channels efficiently in Stage I. Moreover, to tackle the challenge arising from range resolution for sensing the location of closely spaced targets, we show that the MIMO radar technique can be leveraged in Stage II such that the radar has sufficient spatial samples to even detect the targets in close proximity based on their scattered channels. Last, numerical examples are provided to show the effectiveness of our proposed sensing approach which merely relies on the existing MIMO-OFDM communication techniques.


title: $L^2$ boundedness of pseudodifferential operators on manifolds with ends

abstract: We investigate properties of pseudodifferential operators on $L^2$ space on manifold with ends including asymptotically conical or hyperbolic ends. Our pseudodifferential operators are a generalization of the canonical quantization which naturally appears in the quantum mechanics on curved spaces. We prove a Calder\'on-Vaillancourt type theorem for our pseudodifferential operators and discuss a construction of parametrix of elliptic differential operators on manifolds with ends.


title: Intermittent Visual Servoing: Efficiently Learning Policies Robust to Instrument Changes for High-precision Surgical Manipulation

abstract: Automation of surgical tasks using cable-driven robots is challenging due to backlash, hysteresis, and cable tension, and these issues are exacerbated as surgical instruments must often be changed during an operation. In this work, we propose a framework for automation of high-precision surgical tasks by learning sample efficient, accurate, closed-loop policies that operate directly on visual feedback instead of robot encoder estimates. This framework, which we call intermittent visual servoing (IVS), intermittently switches to a learned visual servo policy for high-precision segments of repetitive surgical tasks while relying on a coarse open-loop policy for the segments where precision is not necessary. To compensate for cable-related effects, we apply imitation learning to rapidly train a policy that maps images of the workspace and instrument from a top-down RGB camera to small corrective motions. We train the policy using only 180 human demonstrations that are roughly 2 seconds each. Results on a da Vinci Research Kit suggest that combining the coarse policy with half a second of corrections from the learned policy during each high-precision segment improves the success rate on the Fundamentals of Laparoscopic Surgery peg transfer task from 72.9% to 99.2%, 31.3% to 99.2%, and 47.2% to 100.0% for 3 instruments with differing cable-related effects. In the contexts we studied, IVS attains the highest published success rates for automated surgical peg transfer and is significantly more reliable than previous techniques when instruments are changed. Supplementary material is available at https://tinyurl.com/ivs-icra.


title: Edge states in quantum spin chains: the interplay among interaction, gradient magnetic field and Floquet engineering

abstract: We explore the edge defects induced by spin-spin interaction in a finite paradigmatic Heisenberg spin chain. By introducing a gradient magnetic field and a periodically-modulated spin-exchange strength, the resonance between modulation frequency and magnetic field gradient can also induce asymmetric defects at the edges, dubbed as Floquet-Wannier-Zeeman edge defects. The interplay between these two types of edge defects allows us to manipulate the magnon edge states from an isolated band into a continuum one. In the high-frequency regime, we analytically derive effective models to interpret the formation mechanisms for edge states by employing the multiscale perturbation analysis. Our study offers new insights to understand and control the magnon edge states governed by the interplay between edge defects induced by the spin-spin interaction and the Floquet-Wannier-Zeeman manipulation.


title: Universal Embeddings for Spatio-Temporal Tagging of Self-Driving Logs

abstract: In this paper, we tackle the problem of spatio-temporal tagging of self-driving scenes from raw sensor data. Our approach learns a universal embedding for all tags, enabling efficient tagging of many attributes and faster learning of new attributes with limited data. Importantly, the embedding is spatio-temporally aware, allowing the model to naturally output spatio-temporal tag values. Values can then be pooled over arbitrary regions, in order to, for example, compute the pedestrian density in front of the SDV, or determine if a car is blocking another car at a 4-way intersection. We demonstrate the effectiveness of our approach on a new large scale self-driving dataset, SDVScenes, containing 15 attributes relating to vehicle and pedestrian density, the actions of each actor, the speed of each actor, interactions between actors, and the topology of the road map.


title: Comparing computational entropies below majority (or: When is the dense model theorem false?)

abstract: Computational pseudorandomness studies the extent to which a random variable $\bf{Z}$ looks like the uniform distribution according to a class of tests $\cal{F}$. Computational entropy generalizes computational pseudorandomness by studying the extent which a random variable looks like a \emph{high entropy} distribution. There are different formal definitions of computational entropy with different advantages for different applications. Because of this, it is of interest to understand when these definitions are equivalent. We consider three notions of computational entropy which are known to be equivalent when the test class $\cal{F}$ is closed under taking majorities. This equivalence constitutes (essentially) the so-called \emph{dense model theorem} of Green and Tao (and later made explicit by Tao-Zeigler, Reingold et al., and Gowers). The dense model theorem plays a key role in Green and Tao's proof that the primes contain arbitrarily long arithmetic progressions and has since been connected to a surprisingly wide range of topics in mathematics and computer science, including cryptography, computational complexity, combinatorics and machine learning. We show that, in different situations where $\cal{F}$ is \emph{not} closed under majority, this equivalence fails. This in turn provides examples where the dense model theorem is \emph{false}.


title: When Does Uncertainty Matter?: Understanding the Impact of Predictive Uncertainty in ML Assisted Decision Making

abstract: As machine learning (ML) models are increasingly being employed to assist human decision makers, it becomes critical to provide these decision makers with relevant inputs which can help them decide if and how to incorporate model predictions into their decision making. For instance, communicating the uncertainty associated with model predictions could potentially be helpful in this regard. In this work, we carry out user studies (1,330 responses from 190 participants) to systematically assess how people with differing levels of expertise respond to different types of predictive uncertainty (i.e., posterior predictive distributions with different shapes and variances) in the context of ML assisted decision making for predicting apartment rental prices. We found that showing posterior predictive distributions led to smaller disagreements with the ML model's predictions, regardless of the shapes and variances of the posterior predictive distributions we considered, and that these effects may be sensitive to expertise in both ML and the domain. This suggests that posterior predictive distributions can potentially serve as useful decision aids which should be used with caution and take into account the type of distribution and the expertise of the human.


title: Picoscale Magnetoelasticity Governs Heterogeneous Magnetic Domains in a Noncentrosymmetric Ferromagnetic Weyl Semimetal

abstract: Magnetic Weyl semimetals are predicted to host emergent electromagnetic fields at heterogeneous strained phases or at the magnetic domain walls. Tunability and control of the topological and magnetic properties is crucial for revealing these phenomena, which are not well understood or fully realized yet. Here, we use a scanning SQUID microscope to image spontaneous magnetization and magnetic susceptibility of CeAlSi, a noncentrosymmetric ferromagnetic Weyl semimetal candidate. We observe large metastable domains alongside stable ferromagnetic domains. The metastable domains most likely embody a type of frustrated or glassy magnetic phase, with excitations that may be of an emergent and exotic nature. We find evidence that the heterogeneity of the two types of domains arises from magnetoelastic or magnetostriction effects. We show how these domains form, how they interact, and how they can be manipulated or stabilized with estimated lattice strains on picometer levels. CeAlSi is a frontier material for straintronics in correlated topological systems.


title: Robust and Stable Black Box Explanations

abstract: As machine learning black boxes are increasingly being deployed in real-world applications, there has been a growing interest in developing post hoc explanations that summarize the behaviors of these black boxes. However, existing algorithms for generating such explanations have been shown to lack stability and robustness to distribution shifts. We propose a novel framework for generating robust and stable explanations of black box models based on adversarial training. Our framework optimizes a minimax objective that aims to construct the highest fidelity explanation with respect to the worst-case over a set of adversarial perturbations. We instantiate this algorithm for explanations in the form of linear models and decision sets by devising the required optimization procedures. To the best of our knowledge, this work makes the first attempt at generating post hoc explanations that are robust to a general class of adversarial perturbations that are of practical interest. Experimental evaluation with real-world and synthetic datasets demonstrates that our approach substantially improves robustness of explanations without sacrificing their fidelity on the original data distribution.


title: Deep Partial Multi-View Learning

abstract: Although multi-view learning has made signifificant progress over the past few decades, it is still challenging due to the diffificulty in modeling complex correlations among different views, especially under the context of view missing. To address the challenge, we propose a novel framework termed Cross Partial Multi-View Networks (CPM-Nets), which aims to fully and flflexibly take advantage of multiple partial views. We fifirst provide a formal defifinition of completeness and versatility for multi-view representation and then theoretically prove the versatility of the learned latent representations. For completeness, the task of learning latent multi-view representation is specififically translated to a degradation process by mimicking data transmission, such that the optimal tradeoff between consistency and complementarity across different views can be implicitly achieved. Equipped with adversarial strategy, our model stably imputes missing views, encoding information from all views for each sample to be encoded into latent representation to further enhance the completeness. Furthermore, a nonparametric classifification loss is introduced to produce structured representations and prevent overfifitting, which endows the algorithm with promising generalization under view-missing cases. Extensive experimental results validate the effectiveness of our algorithm over existing state of the arts for classifification, representation learning and data imputation.


title: The Usability of Ownership

abstract: Ownership is the concept of tracking aliases and mutations to data, useful for both memory safety and system design. The Rust programming language implements ownership via the borrow checker, a static analyzer that extends the core type system. The borrow checker is a notorious learning barrier for new Rust users. In this paper, I focus on the gap between understanding ownership in theory versus its implementation in the borrow checker. As a sound and incomplete analysis, compiler errors may arise from either ownership-unsound behavior or limitations of the analyzer. Understanding this distinction is essential for fixing ownership errors. But how are users actually supposed to make the correct inference? Drawing on my experience with using and teaching Rust, I explore the many challenges in interpreting and responding to ownership errors. I also suggest educational and automated interventions that could improve the usability of ownership.


title: A Bootstrap Based Between-Study Heterogeneity Test in Meta-Analysis

abstract: Meta-analysis combines pertinent information from existing studies to provide an overall estimate of population parameters/effect sizes, as well as to quantify and explain the differences between studies. However, testing the between-study heterogeneity is one of the most troublesome topics in meta-analysis research. Additionally, no methods have been proposed to test whether the size of the heterogeneity is larger than a specific level. The existing methods, such as the Q test and likelihood ratio (LR) tests, are criticized for their failure to control the Type I error rate and/or failure to attain enough statistical power. Although better reference distribution approximations have been proposed in the literature, the expression is complicated and the application is limited. In this article, we propose bootstrap based heterogeneity tests combining the restricted maximum likelihood (REML) ratio test or Q test with bootstrap procedures, denoted as B-REML-LRT and B-Q respectively. Simulation studies were conducted to examine and compare the performance of the proposed methods with the regular LR tests, the regular Q test, and the improved Q test in both the random-effects meta-analysis and mixed-effects meta-analysis. Based on the results of Type I error rates and statistical power, B-Q is recommended. An R package \mathtt{boot.heterogeneity} is provided to facilitate the implementation of the proposed method.


title: On 3-Coloring of $(2P_4,C_5)$-Free Graphs

abstract: The 3-coloring of hereditary graph classes has been a deeply-researched problem in the last decade. A hereditary graph class is characterized by a (possibly infinite) list of minimal forbidden induced subgraphs $H_1,H_2,\ldots$; the graphs in the class are called $(H_1,H_2,\ldots)$-free. The complexity of 3-coloring is far from being understood, even for classes defined by a few small forbidden induced subgraphs. For $H$-free graphs, the complexity is settled for any $H$ on up to seven vertices. There are only two unsolved cases on eight vertices, namely $2P_4$ and $P_8$. For $P_8$-free graphs, some partial results are known, but to the best of our knowledge, $2P_4$-free graphs have not been explored yet. In this paper, we show that the 3-coloring problem is polynomial-time solvable on $(2P_4,C_5)$-free graphs.


title: Theoretical Rule-based Knowledge Graph Reasoning by Connectivity Dependency Discovery

abstract: Discovering precise and interpretable rules from knowledge graphs is regarded as an essential challenge, which can improve the performances of many downstream tasks and even provide new ways to approach some Natural Language Processing research topics. In this paper, we present a fundamental theory for rule-based knowledge graph reasoning, based on which the connectivity dependencies in the graph are captured via multiple rule types. It is the first time for some of these rule types in a knowledge graph to be considered. Based on these rule types, our theory can provide precise interpretations to unknown triples. Then, we implement our theory by what we call the RuleDict model. Results show that our RuleDict model not only provides precise rules to interpret new triples, but also achieves state-of-the-art performances on one benchmark knowledge graph completion task, and is competitive on other tasks.


title: Optimizing Large-Scale Fleet Management on a Road Network using Multi-Agent Deep Reinforcement Learning with Graph Neural Network

abstract: We propose a novel approach to optimize fleet management by combining multi-agent reinforcement learning with graph neural network. To provide ride-hailing service, one needs to optimize dynamic resources and demands over spatial domain. While the spatial structure was previously approximated with a regular grid, our approach represents the road network with a graph, which better reflects the underlying geometric structure. Dynamic resource allocation is formulated as multi-agent reinforcement learning, whose action-value function (Q function) is approximated with graph neural networks. We use stochastic policy update rule over the graph with deep Q-networks (DQN), and achieve superior results over the greedy policy update. We design a realistic simulator that emulates the empirical taxi call data, and confirm the effectiveness of the proposed model under various conditions.


title: LIAF-Net: Leaky Integrate and Analog Fire Network for Lightweight and Efficient Spatiotemporal Information Processing

abstract: Spiking neural networks (SNNs) based on Leaky Integrate and Fire (LIF) model have been applied to energy-efficient temporal and spatiotemporal processing tasks. Thanks to the bio-plausible neuronal dynamics and simplicity, LIF-SNN benefits from event-driven processing, however, usually faces the embarrassment of reduced performance. This may because in LIF-SNN the neurons transmit information via spikes. To address this issue, in this work, we propose a Leaky Integrate and Analog Fire (LIAF) neuron model, so that analog values can be transmitted among neurons, and a deep network termed as LIAF-Net is built on it for efficient spatiotemporal processing. In the temporal domain, LIAF follows the traditional LIF dynamics to maintain its temporal processing capability. In the spatial domain, LIAF is able to integrate spatial information through convolutional integration or fully-connected integration. As a spatiotemporal layer, LIAF can also be used with traditional artificial neural network (ANN) layers jointly. Experiment results indicate that LIAF-Net achieves comparable performance to Gated Recurrent Unit (GRU) and Long short-term memory (LSTM) on bAbI Question Answering (QA) tasks, and achieves state-of-the-art performance on spatiotemporal Dynamic Vision Sensor (DVS) datasets, including MNIST-DVS, CIFAR10-DVS and DVS128 Gesture, with much less number of synaptic weights and computational overhead compared with traditional networks built by LSTM, GRU, Convolutional LSTM (ConvLSTM) or 3D convolution (Conv3D). Compared with traditional LIF-SNN, LIAF-Net also shows dramatic accuracy gain on all these experiments. In conclusion, LIAF-Net provides a framework combining the advantages of both ANNs and SNNs for lightweight and efficient spatiotemporal information processing.


title: Stable Dispersion of Coal Fines during Hydraulic Fracturing Flowback in Coal Seam Gas Reservoirs An Experimental Study

abstract: In subterranean coal seam gas CSG reservoirs, massive amounts of small-sized coal fines are released during the production and development stages, especially during hydraulic fracturing stimulation. These coal fines inevitably cause mechanical pump failure and permeability damage due to aggregation and subsequent pore throat blockage. This aggregation behavior is thus of key importance in CSG production and needs to be minimized. Consequently, such coal fines dispersions need to be stabilized, which can be achieved by the formulation of improved fracturing fluids. Here, we thus systematically investigated the effectiveness of two additives; ethanol, 0.5 wt percent and SDBS, 0.001 and 0.01 wt percent, on dispersion stability for a wide range of conditions: pH 6 to 11, salinity of 0.1 to 0.6 M NaCl brine. Technically, the coal suspension flowed through a glass bead proppant pack, and fines retention was measured. We found that even trace amounts of sodium dodecylbenzene sulfonate SDBS i.e. 0.001 wt per cent drastically improved dispersion stability and reduced fines retention. The retention was further quantified by fractal dimensional analysis, which showed lower values for suspensions containing SDBS. This research advances current CSG applications and thus contributes to improved energy security.


title: Multiple Fourier series and lattice point problems

abstract: For the multiple Fourier series of the periodization of some radial functions on $\mathbb{R}^d$, we investigate the behavior of the spherical partial sum. We show the Gibbs-Wilbraham phenomenon, the Pinsky phenomenon and the third phenomenon for the multiple Fourier series, involving the convergence properties of them. The third phenomenon is closely related to the lattice point problems, which is a classical theme of the analytic number theory. We also prove that, for the case of two or three dimension, the convergence problem on the Fourier series is equivalent to the lattice point problems in a sense. In particular, the convergence problem at the origin in two dimension is equivalent to Hardy's conjecture on Gauss's circle problem.


title: Distributed Adaptive and Resilient Control of Multi-Robot Systems with Limited Field of View Interactions using Q-Learning

abstract: In this paper, we consider the problem of dynamically tuning gains for multi-robot systems (MRS) under potential based control design framework where the MRS team coordinates to maintain a connected topology while equipped with limited field of view sensors. Applying the potential-based control framework and assuming robot interaction is encoded by a triangular geometry, we derive a distributed control law in order to achieve the topology control objective. A typical shortcoming of potential-based control in distributed networks is that the overall system behavior is highly sensitive to gain-tuning. To overcome this limitation, we propose a distributed and adaptive gain controller that preserves a designed pairwise interaction strength, independent of the network size. Over that, we implement a control scheme that enables the MRS to be resilient against exogenous attacks on on-board sensors or actuator of the robots in MRS. In this regard, we model additive sensor and actuator faults which are induced externally to render the MRS unstable. However, applying $H_{\infty}$ control protocols by employing a static output-feedback design technique guarantees bounded $L_2$ gains of the error induced by the sensor and actuator fault signals. Finally, we apply policy iteration based Q-Learning to solve for adaptive gains for the discrete-time MRS. Simulation results are provided to support the theoretical findings.


title: aether: Distributed system emulation in Common Lisp

abstract: We describe a Common Lisp package suitable for the high-level design, specification, simulation, and instrumentation of real-time distributed algorithms and hardware on which to run them. We discuss various design decisions around the package structure, and we explore their consequences with small examples.


title: Dynamic Power Balancing Algorithm for Single-Phase Energy Storage Systems in LV Distribution Network with Unbalanced PV Systems Distribution

abstract: Unbalanced power, due to high penetration of single-phase PV rooftops into a four-wire multi-grounded LV distribution system, can result in significant rise in the neutral current and neutral voltage. This preprint proposes a distributed clustering algorithm for dynamic power balancing, using single-phase battery storage systems distributed in the LV distribution system, in order to reduce the neutral current and neutral voltage rise. The distributed clustering algorithm aggregates households connected to the same phase into clusters. Within each cluster, another distributed clustering algorithm is applied to calculate the total grid power exchanged but the corresponding phase. Then, the dynamic power balancing control is applied to balance the powers at the bus, based on battery storage systems' charge/discharge constraints, power minimization and willingness of the households to participate in the power balancing control.


title: Bi-tuning of Pre-trained Representations

abstract: It is common within the deep learning community to first pre-train a deep neural network from a large-scale dataset and then fine-tune the pre-trained model to a specific downstream task. Recently, both supervised and unsupervised pre-training approaches to learning representations have achieved remarkable advances, which exploit the discriminative knowledge of labels and the intrinsic structure of data, respectively. It follows natural intuition that both discriminative knowledge and intrinsic structure of the downstream task can be useful for fine-tuning, however, existing fine-tuning methods mainly leverage the former and discard the latter. A question arises: How to fully explore the intrinsic structure of data for boosting fine-tuning? In this paper, we propose Bi-tuning, a general learning framework to fine-tuning both supervised and unsupervised pre-trained representations to downstream tasks. Bi-tuning generalizes the vanilla fine-tuning by integrating two heads upon the backbone of pre-trained representations: a classifier head with an improved contrastive cross-entropy loss to better leverage the label information in an instance-contrast way, and a projector head with a newly-designed categorical contrastive learning loss to fully exploit the intrinsic structure of data in a category-consistent way. Comprehensive experiments confirm that Bi-tuning achieves state-of-the-art results for fine-tuning tasks of both supervised and unsupervised pre-trained models by large margins (e.g. 10.7\% absolute rise in accuracy on CUB in low-data regime).


title: Gabor single-frame and multi-frame multipliers in any given dimension

abstract: Functional Gabor single-frame or multi-frame generator multipliers are the matrices of function entries that preserve Parseval Gabor single-frame or multi-frame generators. An interesting and natural question is how to characterize all such multipliers. This question has been answered for several special cases including the case of single-frame generators in two dimensions and the case of multi-frame generators in one-dimension. In this paper we completely characterize multipliers for Gabor single-frame and multi-frame generators with respect to separable time-frequency lattices in any given dimension. Our approach is general and applies to the previously known cases as well.


title: Inertial and viscous flywheel sensing of nanoparticles

abstract: Rotational dynamics often challenge physical intuition while enabling unique realizations, from the rotor of a gyroscope that maintains its orientation regardless of the outer gimbals, to a tennis racket that rotates around its handle when tossed face-up in the air. In the context of inertial mass sensing, which can measure mass with atomic precision, rotational dynamics are normally considered a complication hindering measurement interpretation. Here, we exploit the rotational dynamics of a microfluidic device to develop a new modality in inertial resonant sensing. Combining theory with experiments, we show that this modality normally measures the volume of the particle while being insensitive to its density. Paradoxically, particle density only emerges when fluid viscosity becomes dominant over inertia. We explain this paradox via a viscosity-driven, hydrodynamic coupling between the fluid and the particle that activates the rotational inertia of the particle, converting it into a viscous flywheel. This modality now enables the simultaneous measurement of particle volume and mass in fluid, using a single, high-throughput measurement.


title: The unequal-time matter power spectrum: impact on weak lensing observables

abstract: We investigate the impact of a common approximation on weak lensing power spectra: the use of single-epoch matter power spectra in integrals over redshift. We disentangle this from the closely connected Limber's approximation. We derive the unequal-time matter power spectrum at one-loop in standard perturbation theory and effective field theory to deal with non-linear physics. We compare these formalisms and conclude that the unequal-time power spectrum using effective field theory breaks for larger scales. As an alternative, we introduce the midpoint approximation. We also provide, for the first time, a fitting function for the time evolution of the effective field theory counterterms based on the Quijote simulations. Then we compute the angular power spectrum using a range of approaches: the Limber's approximation, and the geometric and midpoint approximations. We compare our results with the exact calculation at all angular scales using the unequal-time power spectrum. We use DES Y1 and LSST-like redshift distributions for our analysis. We find that the use of the Limber's approximation in weak lensing diverges from the exact calculation of the angular power spectrum on large-angle separations, $\ell < 10$. Even though this deviation is of order $2\%$ maximum for cosmic lensing, we find the biggest effect for galaxy clustering and galaxy-galaxy lensing. We show that not only is this true for upcoming galaxy surveys, but also for current data such as DES Y1. Finally, we make our pipeline and analysis publicly available as a Python package called unequalpy.


title: Towards Optimal Problem Dependent Generalization Error Bounds in Statistical Learning Theory

abstract: We study problem-dependent rates, i.e., generalization errors that scale near-optimally with the variance, the effective loss, or the gradient norms evaluated at the "best hypothesis." We introduce a principled framework dubbed "uniform localized convergence," and characterize sharp problem-dependent rates for central statistical learning problems. From a methodological viewpoint, our framework resolves several fundamental limitations of existing uniform convergence and localization analysis approaches. It also provides improvements and some level of unification in the study of localized complexities, one-sided uniform inequalities, and sample-based iterative algorithms. In the so-called "slow rate" regime, we provides the first (moment-penalized) estimator that achieves the optimal variance-dependent rate for general "rich" classes; we also establish improved loss-dependent rate for standard empirical risk minimization. In the "fast rate" regime, we establish finite-sample problem-dependent bounds that are comparable to precise asymptotics. In addition, we show that iterative algorithms like gradient descent and first-order Expectation-Maximization can achieve optimal generalization error in several representative problems across the areas of non-convex learning, stochastic optimization, and learning with missing data.


title: Atrial Fibrillation Detection and ECG Classification based on CNN-BiLSTM

abstract: It is challenging to visually detect heart disease from the electrocardiographic (ECG) signals. Implementing an automated ECG signal detection system can help diagnosis arrhythmia in order to improve the accuracy of diagnosis. In this paper, we proposed, implemented, and compared an automated system using two different frameworks of the combination of convolutional neural network (CNN) and long-short term memory (LSTM) for classifying normal sinus signals, atrial fibrillation, and other noisy signals. The dataset we used is from the MIT-BIT Arrhythmia Physionet. Our approach demonstrated that the cascade of two deep learning network has higher performance than the concatenation of them, achieving a weighted f1 score of 0.82. The experimental results have successfully validated that the cascade of CNN and LSTM can achieve satisfactory performance on discriminating ECG signals.


title: Evaluating Curriculum Learning Strategies in Neural Combinatorial Optimization

abstract: Neural combinatorial optimization (NCO) aims at designing problem-independent and efficient neural network-based strategies for solving combinatorial problems. The field recently experienced growth by successfully adapting architectures originally designed for machine translation. Even though the results are promising, a large gap still exists between NCO models and classic deterministic solvers, both in terms of accuracy and efficiency. One of the drawbacks of current approaches is the inefficiency of training on multiple problem sizes. Curriculum learning strategies have been shown helpful in increasing performance in the multi-task setting. In this work, we focus on designing a curriculum learning-based training procedure that can help existing architectures achieve competitive performance on a large range of problem sizes simultaneously. We provide a systematic investigation of several training procedures and use the insights gained to motivate application of a psychologically-inspired approach to improve upon the classic curriculum method.


title: Indium Antimonide, constraints on practicality as a magneto-optical platform for topological surface plasmon polaritons

abstract: Magnetic-field-biased indium antimonide (InSb) is one of the most widely-discussed materials for supporting nonreciprocal surface plasmon polaritons (SPPs), which have recently been shown to be topological. In this work, we provide a critical assessment of InSb as a magneto-optical SPP platform, and show that it is only viable under a narrow set of conditions.


title: Gaussian RAM: Lightweight Image Classification via Stochastic Retina-Inspired Glimpse and Reinforcement Learning

abstract: Previous studies on image classification have mainly focused on the performance of the networks, not on real-time operation or model compression. We propose a Gaussian Deep Recurrent visual Attention Model (GDRAM)- a reinforcement learning based lightweight deep neural network for large scale image classification that outperforms the conventional CNN (Convolutional Neural Network) which uses the entire image as input. Highly inspired by the biological visual recognition process, our model mimics the stochastic location of the retina with Gaussian distribution. We evaluate the model on Large cluttered MNIST, Large CIFAR-10 and Large CIFAR-100 datasets which are resized to 128 in both width and height.


title: Revisiting Secure Computation Using Functional Encryption: Opportunities and Research Directions

abstract: Increasing incidents of security compromises and privacy leakage have raised serious privacy concerns related to cyberspace. Such privacy concerns have been instrumental in the creation of several regulations and acts to restrict the availability and use of privacy-sensitive data. The secure computation problem, initially and formally introduced as secure two-party computation by Andrew Yao in 1986, has been the focus of intense research in academia because of its fundamental role in building many of the existing privacy-preserving approaches. Most of the existing secure computation solutions rely on garbled-circuits and homomorphic encryption techniques to tackle secure computation issues, including efficiency and security guarantees. However, it is still challenging to adopt these secure computation approaches in emerging compute-intensive and data-intensive applications such as emerging machine learning solutions. Recently proposed functional encryption scheme has shown its promise as an underlying secure computation foundation in recent privacy-preserving machine learning approaches proposed. This paper revisits the secure computation problem using emerging and promising functional encryption techniques and presents a comprehensive study. We first briefly summarize existing conventional secure computation approaches built on garbled-circuits, oblivious transfer, and homomorphic encryption techniques. Then, we elaborate on the unique characteristics and challenges of emerging functional encryption based secure computation approaches and outline several research directions.


title: Motion Generation Using Bilateral Control-Based Imitation Learning with Autoregressive Learning

abstract: Robots that can execute various tasks automatically on behalf of humans are becoming an increasingly important focus of research in the field of robotics. Imitation learning has been studied as an efficient and high-performance method, and imitation learning based on bilateral control has been proposed as a method that can realize fast motion. However, because this method cannot implement autoregressive learning, this method may not generate desirable long-term behavior. Therefore, in this paper, we propose a method of autoregressive learning for bilateral control-based imitation learning. A new neural network model for implementing autoregressive learning is proposed. In this study, three types of experiments are conducted to verify the effectiveness of the proposed method. The performance is improved compared to conventional approaches; the proposed method has the highest rate of success. Owing to the structure and autoregressive learning of the proposed model, the proposed method can generate the desirable motion for successful tasks and have a high generalization ability for environmental changes.


title: Fast and Accurate Proper Orthogonal Decomposition using Efficient Sampling and Iterative Techniques for Singular Value Decomposition

abstract: In this paper, we propose a computationally efficient iterative algorithm for proper orthogonal decomposition (POD) using random sampling based techniques. In this algorithm, additional rows and columns are sampled and a merging technique is used to update the dominant POD modes in each iteration. We derive bounds for the spectral norm of the error introduced by a series of merging operations. We use an existing theorem to get an approximate measure of the quality of subspaces obtained on convergence of the iteration. Results on various datasets indicate that the POD modes and/or the subspaces are approximated with excellent accuracy with a significant runtime improvement over computing the truncated SVD. We also propose a method to compute the POD modes of large matrices that do not fit in the RAM using this iterative sampling and merging algorithms.


title: A Factor-Graph Approach for Optimization Problems with Dynamics Constraints

abstract: In this paper, we introduce dynamics factor graphs as a graphical framework to solve dynamics problems and kinodynamic motion planning problems with full consideration of whole-body dynamics and contacts. A factor graph representation of dynamics problems provides an insightful visualization of their mathematical structure and can be used in conjunction with sparse nonlinear optimizers to solve challenging, high-dimensional optimization problems in robotics. We can easily formulate kinodynamic motion planning as a trajectory optimization problem with factor graphs. We demonstrate the flexibility and descriptive power of dynamics factor graphs by applying them to control various dynamical systems, ranging from a simple cart pole to a 12-DoF quadrupedal robot.


title: Towards Semi-Supervised Semantics Understanding from Speech

abstract: Much recent work on Spoken Language Understanding (SLU) falls short in at least one of three ways: models were trained on oracle text input and neglected the Automatics Speech Recognition (ASR) outputs, models were trained to predict only intents without the slot values, or models were trained on a large amount of in-house data. We proposed a clean and general framework to learn semantics directly from speech with semi-supervision from transcribed speech to address these. Our framework is built upon pretrained end-to-end (E2E) ASR and self-supervised language models, such as BERT, and fine-tuned on a limited amount of target SLU corpus. In parallel, we identified two inadequate settings under which SLU models have been tested: noise-robustness and E2E semantics evaluation. We tested the proposed framework under realistic environmental noises and with a new metric, the slots edit F1 score, on two public SLU corpora. Experiments show that our SLU framework with speech as input can perform on par with those with oracle text as input in semantics understanding, while environmental noises are present, and a limited amount of labeled semantics data is available.


title: Constant periodic data and entropy of Anosov diffeomorphisms

abstract: We study the effects that the constant periodic data condition have on topological entropy of Anosov diffeomorphisms. Under constant periodic data condition we prove that Anosov diffeomorphism has finitely many measures of maximal entropy and each one of them is absolutely continuous with respect to Lebesgue. From this, in the setting of $C^{\infty}-$Anosov diffeomorphisms satisfying constant periodic data, we provide a characterization of transitivity property via measures of maximal entropy.


title: Cohen-Macaulay local rings with $e_2 = e_1-e+1$

abstract: In this paper we study Cohen-Macaulay local rings of dimension $d$, multiplicity $e$ and second Hilbert coefficient $e_2$ in the case $e_2 = e_1 - e + 1$. Let $h = \mu(\mathfrak{m}) - d$. If $e_2 \neq 0$ then in our case we can prove that type $A \geq e - h -1$. If type $A = e - h -1$ then we show that the associated graded ring $G(A)$ is Cohen-Macaulay. In the next case when type $A = e - h$ we determine all possible Hilbert series of $A$. In this case we show that the Hilbert Series of $A$ completely determines depth $G(A)$.


title: Enabling Interactive Transcription in an Indigenous Community

abstract: We propose a novel transcription workflow which combines spoken term detection and human-in-the-loop, together with a pilot experiment. This work is grounded in an almost zero-resource scenario where only a few terms have so far been identified, involving two endangered languages. We show that in the early stages of transcription, when the available data is insufficient to train a robust ASR system, it is possible to take advantage of the transcription of a small number of isolated words in order to bootstrap the transcription of a speech collection.


title: Analysis on Lambert-Tsallis functions

abstract: In this paper, we study the Lambert-Tsallis function, which is a generalization of the Lambert function with two real parameters. We give a condition on the parameters such that there exists a complex domain touching zero on boundary which is mapped bijectively to the upper half plane by the Lambert-Tsallis function.


title: The Ropelength of Special Alternating Knots

abstract: A long standing open conjecture states that if a link $\mathcal{K}$ is alternating, then its ropelength $L(\mathcal{K})$ is at least of the order $O(Cr(\mathcal{K}))$. A recent result shows that the maximum braid index of a link bounds the ropelength of the link from below. Thus in the case an alternating link has a maximum braid index proportional to its minimum crossing number, such as the $T(2,2n)$ torus link, then the ropelength of the link is bounded below by a constant multiple of its minimum crossing number. However if the maximum braid index of a link is small compared to its crossing number, then there are no known results about whether its ropelength is bounded below by a constant multiple of its crossing number. For example, the $T(2,2n+1)$ torus knot has a minimum knot diagram that looks almost identical to that of the $T(2,2n)$ torus link, yet whether its ropelength is bounded below by a constant multiple of $n$ remains open to date. In this paper, we provide a first such result, and in fact for a large class of alternating knots. Specifically, we prove that if an alternating knot (namely a link with only one component) has a reduced alternating knot diagram in which the crossings are either all positive or all negative (such a knot is called a special alternating knot), then its ropelength is bounded below by a constant multiple of its crossing number.


title: Secure Regenerating Codes for Reducing Storage and Bootstrap Costs in Sharded Blockchains

abstract: Blockchain is a distributed ledger with wide applications. Due to the increasing storage requirement for blockchains, the computation can be afforded by only a few miners. Sharding has been proposed to scale blockchains so that storage and transaction efficiency of the blockchain improves at the cost of security guarantee. This paper aims to consider a new protocol, Secure-Repair-Blockchain (SRB), which aims to decrease the storage cost at the miners. In addition, SRB also decreases the bootstrapping cost, which allows for new miners to easily join a sharded blockchain. In order to reduce storage, coding-theoretic techniques are used in SRB. In order to decrease the amount of data that is transferred to the new node joining a shard, the concept of exact repair secure regenerating codes is used. The proposed blockchain protocol achieves lower storage than those that do not use coding, and achieves lower bootstrapping cost as compared to the different baselines.


title: Optimal Private Median Estimation under Minimal Distributional Assumptions

abstract: We study the fundamental task of estimating the median of an underlying distribution from a finite number of samples, under pure differential privacy constraints. We focus on distributions satisfying the minimal assumption that they have a positive density at a small neighborhood around the median. In particular, the distribution is allowed to output unbounded values and is not required to have finite moments. We compute the exact, up-to-constant terms, statistical rate of estimation for the median by providing nearly-tight upper and lower bounds. Furthermore, we design a polynomial-time differentially private algorithm which provably achieves the optimal performance. At a technical level, our results leverage a Lipschitz Extension Lemma which allows us to design and analyze differentially private algorithms solely on appropriately defined "typical" instances of the samples.


title: Structure of the nucleon at leading and subleading twist in the covariant parton model

abstract: The covariant parton model is generalized to describe quark correlators in a systematic way. Previous results are reproduced for the T-even leading-twist transverse momentum dependent parton distribution functions (TMDs), and for the first time all T-even twist-3 TMDs are evaluated in this model. We apply the approach to evaluate the fully unintegrated quark correlator which allows us to understand the model-specific relations between different TMDs. We verify the consistency of the approach, present numerical results and compare to available TMD parametrizations.


title: Approximating the Weighted Minimum Label $s$-$t$ Cut Problem

abstract: In the weighted (minimum) {\sf Label $s$-$t$ Cut} problem, we are given a (directed or undirected) graph $G=(V,E)$, a label set $L = \{\ell_1, \ell_2, \dots, \ell_q \}$ with positive label weights $\{w_\ell\}$, a source $s \in V$ and a sink $t \in V$. Each edge edge $e$ of $G$ has a label $\ell(e)$ from $L$. Different edges may have the same label. The problem asks to find a minimum weight label subset $L'$ such that the removal of all edges with labels in $L'$ disconnects $s$ and $t$. The unweighted {\sf Label $s$-$t$ Cut} problem (i.e., every label has a unit weight) can be approximated within $O(n^{2/3})$, where $n$ is the number of vertices of graph $G$. However, it is unknown for a long time how to approximate the weighted {\sf Label $s$-$t$ Cut} problem within $o(n)$. In this paper, we provide an approximation algorithm for the weighted {\sf Label $s$-$t$ Cut} problem with ratio $O(n^{2/3})$. The key point of the algorithm is a mechanism to interpret label weight on an edge as both its length and capacity.


title: Privacy Preserving in Non-Intrusive Load Monitoring: A Differential Privacy Perspective

abstract: Smart meter devices enable a better understanding of the demand at the potential risk of private information leakage. One promising solution to mitigating such risk is to inject noises into the meter data to achieve a certain level of differential privacy. In this paper, we cast one-shot non-intrusive load monitoring (NILM) in the compressive sensing framework, and bridge the gap between theoretical accuracy of NILM inference and differential privacy's parameters. We then derive the valid theoretical bounds to offer insights on how the differential privacy parameters affect the NILM performance. Moreover, we generalize our conclusions by proposing the hierarchical framework to solve the multi-shot NILM problem. Numerical experiments verify our analytical results and offer better physical insights of differential privacy in various practical scenarios. This also demonstrates the significance of our work for the general privacy preserving mechanism design.


title: Existence and upper semicontinuity of random attractors for the 2D stochastic convective Brinkman-Forchheimer equations in bounded domains

abstract: In this work, we discuss the large time behavior of the solutions of the two dimensional stochastic convective Brinkman-Forchheimer (SCBF) equations in bounded domains. Under the functional setting $\V\hookrightarrow\H\hookrightarrow\V'$, where $\H$ and $\V$ are appropriate separable Hilbert spaces and the embedding $\V\hookrightarrow\H$ is compact, we establish the existence of random attractors in $\H$ for the stochastic flow generated by the 2D SCBF equations perturbed by small additive noise. We prove the upper semicontinuity of the random attractors for the 2D SCBF equations in $\H$, when the coefficient of random term approaches zero. Moreover, we obtain the existence of random attractors in a more regular space $\V$, using the pullback flattening property. The existence of random attractors ensures the existence of invariant compact random set and hence we show the existence of an invariant measure for the 2D SCBF equations.


title: Domain Generalization in Biosignal Classification

abstract: Objective: When training machine learning models, we often assume that the training data and evaluation data are sampled from the same distribution. However, this assumption is violated when the model is evaluated on another unseen but similar database, even if that database contains the same classes. This problem is caused by domain-shift and can be solved using two approaches: domain adaptation and domain generalization. Simply, domain adaptation methods can access data from unseen domains during training; whereas in domain generalization, the unseen data is not available during training. Hence, domain generalization concerns models that perform well on inaccessible, domain-shifted data. Method: Our proposed domain generalization method represents an unseen domain using a set of known basis domains, afterwhich we classify the unseen domain using classifier fusion. To demonstrate our system, we employ a collection of heart sound databases that contain normal and abnormal sounds (classes). Results: Our proposed classifier fusion method achieves accuracy gains of up to 16% for four completely unseen domains. Conclusion: Recognizing the complexity induced by the inherent temporal nature of biosignal data, the two-stage method proposed in this study is able to effectively simplify the whole process of domain generalization while demonstrating good results on unseen domains and the adopted basis domains. Significance: To our best knowledge, this is the first study that investigates domain generalization for biosignal data. Our proposed learning strategy can be used to effectively learn domain-relevant features while being aware of the class differences in the data.


title: Bottleneck Problems: Information and Estimation-Theoretic View

abstract: Information bottleneck (IB) and privacy funnel (PF) are two closely related optimization problems which have found applications in machine learning, design of privacy algorithms, capacity problems (e.g., Mrs. Gerber's Lemma), strong data processing inequalities, among others. In this work, we first investigate the functional properties of IB and PF through a unified theoretical framework. We then connect them to three information-theoretic coding problems, namely hypothesis testing against independence, noisy source coding and dependence dilution. Leveraging these connections, we prove a new cardinality bound for the auxiliary variable in IB, making its computation more tractable for discrete random variables. In the second part, we introduce a general family of optimization problems, termed as \textit{bottleneck problems}, by replacing mutual information in IB and PF with other notions of mutual information, namely $f$-information and Arimoto's mutual information. We then argue that, unlike IB and PF, these problems lead to easily interpretable guarantee in a variety of inference tasks with statistical constraints on accuracy and privacy. Although the underlying optimization problems are non-convex, we develop a technique to evaluate bottleneck problems in closed form by equivalently expressing them in terms of lower convex or upper concave envelope of certain functions. By applying this technique to binary case, we derive closed form expressions for several bottleneck problems.


title: Recursive Regret Matching: A General Method for Solving Time-invariant Nonlinear Zero-sum Differential Games

abstract: In this paper, a new method is proposed to compute the rolling Nash equilibrium of the time-invariant nonlinear two-person zero-sum differential games. The idea is to discretize the time to transform a differential game into a sequential game with several steps, and by introducing state-value function, transform the sequential game into a recursion consisting of several normal-form games, finally, each normal-form game is solved with action abstraction and regret matching. To improve the real-time property of the proposed method, the state-value function can be kept in memory. This method can deal with the situations that the saddle point exists or does not exist, and the analysises of the existence of the saddle point can be avoided. If the saddle point does not exist, the mixed optimal control pair can be obtained. At the end of this paper, some examples are taken to illustrate the validity of the proposed method.


title: A Transfer Learning Framework for Anomaly Detection Using Model of Normality

abstract: Convolutional Neural Network (CNN) techniques have proven to be very useful in image-based anomaly detection applications. CNN can be used as deep features extractor where other anomaly detection techniques are applied on these features. For this scenario, using transfer learning is common since pretrained models provide deep feature representations that are useful for anomaly detection tasks. Consequentially, anomaly can be detected by applying similarly measure between extracted features and a defined model of normality. A key factor in such approaches is the decision threshold used for detecting anomaly. While most of the proposed methods focus on the approach itself, slight attention has been paid to address decision threshold settings. In this paper, we tackle this problem and propose a welldefined method to set the working-point decision threshold that improves detection accuracy. We introduce a transfer learning framework for anomaly detection based on similarity measure with a Model of Normality (MoN) and show that with the proposed threshold settings, a significant performance improvement can be achieved. Moreover, the framework has low complexity with relaxed computational requirements.


title: Fog based Secure Framework for Personal Health Records Systems

abstract: The rapid development of personal health records (PHR) systems enables an individual to collect, create, store and share his PHR to authorized entities. Health care systems within the smart city environment require a patient to share his PRH data with a multitude of institutions' repositories located in the cloud. The cloud computing paradigm cannot meet such a massive transformative healthcare systems due to drawbacks including network latency, scalability and bandwidth. Fog computing relieves the burden of conventional cloud computing by availing intermediate fog nodes between the end users and the remote servers. Aiming at a massive demand of PHR data within a ubiquitous smart city, we propose a secure and fog assisted framework for PHR systems to address security, access control and privacy concerns. Built under a fog-based architecture, the proposed framework makes use of efficient key exchange protocol coupled with ciphertext attribute based encryption (CP-ABE) to guarantee confidentiality and fine-grained access control within the system respectively. We also make use of digital signature combined with CP-ABE to ensure the system authentication and users privacy. We provide the analysis of the proposed framework in terms of security and performance.