title: Batched Bandits with Crowd Externalities

abstract: In Batched Multi-Armed Bandits (BMAB), the policy is not allowed to be updated at each time step. Usually, the setting asserts a maximum number of allowed policy updates and the algorithm schedules them so that to minimize the expected regret. In this paper, we describe a novel setting for BMAB, with the following twist: the timing of the policy update is not controlled by the BMAB algorithm, but instead the amount of data received during each batch, called \textit{crowd}, is influenced by the past selection of arms. We first design a near-optimal policy with approximate knowledge of the parameters that we prove to have a regret in $\mathcal{O}(\sqrt{\frac{\ln x}{x}}+\epsilon)$ where $x$ is the size of the crowd and $\epsilon$ is the parameter error. Next, we implement a UCB-inspired algorithm that guarantees an additional regret in $\mathcal{O}\left(\max(K\ln T,\sqrt{T\ln T})\right)$, where $K$ is the number of arms and $T$ is the horizon.


title: Egocentric Hand-object Interaction Detection and Application

abstract: In this paper, we present a method to detect the hand-object interaction from an egocentric perspective. In contrast to massive data-driven discriminator based method like \cite{Shan20}, we propose a novel workflow that utilises the cues of hand and object. Specifically, we train networks predicting hand pose, hand mask and in-hand object mask to jointly predict the hand-object interaction status. We compare our method with the most recent work from Shan et al. \cite{Shan20} on selected images from EPIC-KITCHENS \cite{damen2018scaling} dataset and achieve $89\%$ accuracy on HOI (hand-object interaction) detection which is comparative to Shan's ($92\%$). However, for real-time performance, with the same machine, our method can run over $\textbf{30}$ FPS which is much efficient than Shan's ($\textbf{1}\sim\textbf{2}$ FPS). Furthermore, with our approach, we are able to segment script-less activities from where we extract the frames with the HOI status detection. We achieve $\textbf{68.2\%}$ and $\textbf{82.8\%}$ F1 score on GTEA \cite{fathi2011learning} and the UTGrasp \cite{cai2015scalable} dataset respectively which are all comparative to the SOTA methods.


title: QEMU-based hardware/software co-development for DAQ systems

abstract: Modern DAQ systems typically use the FPGA-based PCIe cards to concentrate and deliver the data to a computer used as an entry node of the data processing network. This paper presents a QEMU-based methodology for the co-development of the FPGA-based hardware part, the Linux kernel driver, and the data receiving application. This approach enables quick verification of the FPGA firmware architecture, organization of control registers, the functionality of the driver, and the user-space application. The developed design may be tested in different emulated architectures with a changeable CPU, IOMMU, size of memory, and the number of DAQ cards.


title: A multi-wavelength analysis of small-scale brightenings observed by IRIS

abstract: Small-scale brightenings in solar atmospheric observations are a manifestation of heating and/or energy transport events. We present statistical characteristics of brightenings from a new detection method applied to 1330, 1400, and 2796 \AA\ IRIS slitjaw image time series. 2377 events are recorded which coexist in all three channels, giving high confidence that they are real. $\approx$1800 of these are spatially coherent, equating to event densities of $\sim9.7\times10^{-5}$arcsec$^{-2}$s$^{-1}$ within a $90\arcsec\times100\arcsec$ FOV over 34.5 minutes. Power Law indices estimates are determined for total brightness ($2.78<\alpha<3.71$), maximum brightness ($3.84<\alpha<4.70$), and average area ($4.31<\alpha<5.70$) distributions. Duration and speed distributions do not obey a power law. A correlation is found between the events' spatial fragmentation, area, and duration, and a weak relationship with total brightness, showing that larger/longer-lasting events are more likely to fragment during their lifetime. Speed distributions show that all events are in motion, with an average speed of $\sim7$\kms. The events' spatial trajectories suggest that cooler 2796 \AA\ events tend to appear slightly later, and occupy a different position/trajectory to the hotter channel results. This suggests that either many of these are impulsive events caused by reconnection, with subsequent rapid cooling, or that the triggering event occurs near the TR, with a subsequent propagating disturbance to cooler atmospheric layers. The spatial distribution of events is not uniform, with broad regions devoid of events. A comparison of spatial distribution with properties of other atmospheric layers shows a tentative connection between high magnetic field strength, the corona's multithermality, and high IRIS brightening activity.


title: Unlocking the potential of deep learning for marine ecology: overview, applications, and outlook

abstract: The deep learning revolution is touching all scientific disciplines and corners of our lives as a means of harnessing the power of big data. Marine ecology is no exception. These new methods provide analysis of data from sensors, cameras, and acoustic recorders, even in real time, in ways that are reproducible and rapid. Off-the-shelf algorithms can find, count, and classify species from digital images or video and detect cryptic patterns in noisy data. Using these opportunities requires collaboration across ecological and data science disciplines, which can be challenging to initiate. To facilitate these collaborations and promote the use of deep learning towards ecosystem-based management of the sea, this paper aims to bridge the gap between marine ecologists and computer scientists. We provide insight into popular deep learning approaches for ecological data analysis in plain language, focusing on the techniques of supervised learning with deep neural networks, and illustrate challenges and opportunities through established and emerging applications of deep learning to marine ecology. We use established and future-looking case studies on plankton, fishes, marine mammals, pollution, and nutrient cycling that involve object detection, classification, tracking, and segmentation of visualized data. We conclude with a broad outlook of the field's opportunities and challenges, including potential technological advances and issues with managing complex data sets.


title: A Novel Initialization Method for HybridUnderwater Optical Acoustic Networks

abstract: To satisfy the high data rate requirement andreliable transmission demands in underwater scenarios, it isdesirable to construct an efficient hybrid underwater opticalacoustic network (UWOAN) architecture by considering the keyfeatures and critical needs of underwater terminals. In UWOANs,optical uplinks and acoustic downlinks are configured betweenunderwater nodes (UWNs) and the base station (BS), wherethe optical beam transmits the high data rate traffic to theBS, while the acoustic waves carry the control information torealize the network management. In this paper, we focus onsolving the network initializing problem in UWOANs, which isa challenging task due to the lack of GPS service and limiteddevice payload in underwater environments. To this end, weleverage acoustic waves for node localization and propose anovel network initialization method, which consists of UWNidentification, discovery, localization, as well as decomposition.Numerical simulations are also conducted to verify the proposedinitialization method.


title: Multi-Task Pre-Training for Plug-and-Play Task-Oriented Dialogue System

abstract: Pre-trained language models have been recently shown to benefit task-oriented dialogue (TOD) systems. Despite their success, existing methods often formulate this task as a cascaded generation problem which can lead to error accumulation across different sub-tasks and greater data annotation overhead. In this study, we present PPTOD, a unified plug-and-play model for task-oriented dialogue. In addition, we introduce a new dialogue multi-task pre-training strategy that allows the model to learn the primary TOD task completion skills from heterogeneous dialog corpora. We extensively test our model on three benchmark TOD tasks, including end-to-end dialogue modelling, dialogue state tracking, and intent classification. Experimental results show that PPTOD achieves new state of the art on all evaluated tasks in both high-resource and low-resource scenarios. Furthermore, comparisons against previous SOTA methods show that the responses generated by PPTOD are more factually correct and semantically coherent as judged by human annotators.


title: On the principal eigenvalue of the truncated Laplacian, and submanifolds with bounded mean curvature

abstract: In this paper, we study the principal eigenvalue $\mu(\mathscr{F}_k^-,E)$ of the fully nonlinear operator \[ \mathscr{F}_k^-[u] = \mathcal{P}_k^-(\nabla^2 u) - h |\nabla u| \] on a set $E \Subset \mathbb{R}^n$, where $h \in [0,\infty)$ and $\mathcal{P}_k^-(\nabla^2 u)$ is the sum of the smallest $k$ eigenvalues of the Hessian $\nabla^2 u$. We prove a lower estimate for $\mu(\mathscr{F}_k^-,E)$ in terms of a generalized Hausdorff measure $\mathscr{H}_\Psi(E)$, for suitable $\Psi$ depending on $k$, moving some steps in the direction of the conjecturally sharp estimate \[ \mu(\mathscr{F}_k^-,E) \ge C \mathscr{H}^k(E)^{-2/k}. \] The theorem is used to study the spectrum of bounded submanifolds in $\mathbb{R}^n$, improving on our previous work in the direction of a question posed by S.T. Yau. In particular, the result applies to solutions of Plateau's problem for CMC surfaces.


title: Synchronous Values of Games

abstract: We study synchronous values of games, especially synchronous games. It is known that a synchronous game has a perfect strategy if and only if it has a perfect synchronous strategy. However, we give examples of synchronous games, in particular graph colouring games, with synchronous value that is strictly smaller than their ordinary value. Thus, the optimal strategy for a synchronous game need not be synchronous. We derive a formula for the synchronous value of an XOR game as an optimization problem over a spectrahedron involving a matrix related to the cost matrix. We give an example of a game such that the synchronous value of repeated products of the game is strictly increasing. We show that the synchronous quantum bias of the XOR of two XOR games is not multiplicative. Finally, we derive geometric and algebraic conditions that a set of projections that yields the synchronous value of a game must satisfy.


title: A Convex Method of Generalized State Estimation using Circuit-theoretic Node-breaker Model

abstract: An accurate and up-to-date topology is critical for situational awareness of a power grid; however, wrong switch statuses due to physical damage, communication error, or cyber-attack, can often result in topology errors. To maintain situation awareness under the possible topology errors and bad data, this paper develops ckt-GSE, a circuit-theoretic generalized state estimation method using node-breaker (NB) model. Ckt- GSE is a convex and scalable model that jointly estimates AC state variables and network topology, with robustness against different data errors. The method first constructs an equivalent circuit representation of the AC power grid by developing and aggregating linear circuit models of SCADA meters, phasor measurement units(PMUs), and switching devices. Then based on this circuit, ckt-GSE defines a constrained optimization problem using weighted least absolute value (WLAV) objective to form a robust estimator. The problem is a Linear Programming (LP) problem whose solution includes accurate AC states and a sparse vector of noise terms to identify topology errors and bad data.This paper is the first to explore a circuit-theoretic approach for an AC-network constrained GSE algorithm that is: 1) applicable to the real-world data setting, 2) convex without relaxation, scalable with our circuit-based solver; and 3) robust with the ability to identify and reject different data errors


title: Posttraumatic Stress Disorder Hyperarousal Event Detection Using Smartwatch Physiological and Activity Data

abstract: Posttraumatic Stress Disorder (PTSD) is a psychiatric condition affecting nearly a quarter of the United States war veterans who return from war zones. Treatment for PTSD typically consists of a combination of in-session therapy and medication. However; patients often experience their most severe PTSD symptoms outside of therapy sessions. Mobile health applications may address this gap, but their effectiveness is limited by the current gap in continuous monitoring and detection capabilities enabling timely intervention. The goal of this article is to develop a novel method to detect hyperarousal events using physiological and activity-based machine learning algorithms. Physiological data including heart rate and body acceleration as well as self-reported hyperarousal events were collected using a tool developed for commercial off-the-shelf wearable devices from 99 United States veterans diagnosed with PTSD over several days. The data were used to develop four machine learning algorithms: Random Forest, Support Vector Machine, Logistic Regression and XGBoost. The XGBoost model had the best performance in detecting onset of PTSD symptoms with over 83% accuracy and an AUC of 0.70. Post-hoc SHapley Additive exPlanations (SHAP) additive explanation analysis showed that algorithm predictions were correlated with average heart rate, minimum heart rate and average body acceleration. Findings show promise in detecting onset of PTSD symptoms which could be the basis for developing remote and continuous monitoring systems for PTSD. Such systems may address a vital gap in just-in-time interventions for PTSD self-management outside of scheduled clinical appointments.


title: The Object at Hand: Automated Editing for Mixed Reality Video Guidance from Hand-Object Interactions

abstract: In this paper, we concern with the problem of how to automatically extract the steps that compose real-life hand activities. This is a key competence towards processing, monitoring and providing video guidance in Mixed Reality systems. We use egocentric vision to observe hand-object interactions in real-world tasks and automatically decompose a video into its constituent steps. Our approach combines hand-object interaction (HOI) detection, object similarity measurement and a finite state machine (FSM) representation to automatically edit videos into steps. We use a combination of Convolutional Neural Networks (CNNs) and the FSM to discover, edit cuts and merge segments while observing real hand activities. We evaluate quantitatively and qualitatively our algorithm on two datasets: the GTEA\cite{li2015delving}, and a new dataset we introduce for Chinese Tea making. Results show our method is able to segment hand-object interaction videos into key step segments with high levels of precision.


title: On the independence of Robinson's set of axioms for propositional calculus

abstract: We give a normal five-valued truth-table proving independence of one of the axioms in Robinson's set of axioms for propositional calculus from 1968, answering a question raised in his article, where he uses a non-normal truth-table. We also give a normal four-valued truth-table proving independence of one of the other axioms, where he uses a normal five-valued truth-table.


title: Improvising the Learning of Neural Networks on Hyperspherical Manifold

abstract: The impact of convolution neural networks (CNNs) in the supervised settings provided tremendous increment in performance. The representations learned from CNN's operated on hyperspherical manifold led to insightful outcomes in face recognition, face identification, and other supervised tasks. A broad range of activation functions were developed with hypersphere intuition which performs superior to softmax in euclidean space. The main motive of this research is to provide insights. First, the stereographic projection is implied to transform data from Euclidean space ($\mathbb{R}^{n}$) to hyperspherical manifold ($\mathbb{S}^{n}$) to analyze the performance of angular margin losses. Secondly, proving theoretically and practically that decision boundaries constructed on hypersphere using stereographic projection obliges the learning of neural networks. Experiments have demonstrated that applying stereographic projection on existing state-of-the-art angular margin objective functions improved performance for standard image classification data sets (CIFAR-10,100). Further, we ran our experiments on malaria-thin blood smear images, resulting in effective outcomes. The code is publicly available at:https://github.com/barulalithb/stereo-angular-margin.


title: Horndeski fermion-boson stars

abstract: We establish the existence of static and spherically symmetric fermion-boson stars, in a low energy effective model of (beyond) Horndeski theories. These stars are in equilibrium, and are composed by a mixing of scalar and fermionic matters that only interact gravitationally one with each other. Properties such as mass, radius, and compactness are studied, highlighting the existence of two families of configurations defined by the parameter $c_4$. These families have distinctive properties, although in certain limits both are reduced to their counterparts in General Relativity. Finally, by assuming the same conditions used in General Relativity, we find the maximum compactness of these hybrid stars and determine that it remains below the so-called Buchdahl's limit.


title: Spatial and temporal dynamics of RhoA activities of single breast tumor cells in a 3D environment revealed by a machine learning-assisted FRET technique

abstract: One of the hallmarks of cancer cells is their exceptional ability to migrate within the extracellular matrix (ECM) for gaining access to the circulatory system, a critical step of cancer metastasis. RhoA, a small GTPase, is known to be a key molecular switch that toggles between actomyosin contractility and lamellipodial protrusion during cell migration. Current understanding of RhoA activity in cell migration has been largely derived from studies of cells plated on a two-dimensional (2D) substrate using a FRET biosensor. There has been increasing evidence that cells behave differently in a more physiologically relevant three-dimensional (3D) environment, however, studies of RhoA activities in 3D have been hindered by low signal-to-noise ratio in fluorescence imaging. In this paper, we present a machine learning-assisted FRET technique to follow the spatiotemporal dynamics of RhoA activities of single breast tumor cells (MDA-MB-231) migrating in a 3D as well as a 2D environment using a RhoA biosensor. We found that RhoA activity is more polarized along the long axis of the cell for single cells migrating on 2D fibronectin-coated glass versus those embedded in 3D collagen matrices. In particular, RhoA activities of cells in 2D exhibit a distinct front-to-back and back-to-front movement during migration in contrast to those in 3D. Finally, regardless of dimensionality, RhoA polarization is found to be correlated with cell shape.


title: Density functions for QuickQuant and QuickVal

abstract: We prove that, for every $0 \leq t \leq 1$, the limiting distribution of the scale-normalized number of key comparisons used by the celebrated algorithm QuickQuant to find the $t$th quantile in a randomly ordered list has a Lipschitz continuous density function $f_t$ that is bounded above by $10$. Furthermore, this density $f_t(x)$ is positive for every $x > \min\{t, 1 - t\}$ and, uniformly in $t$, enjoys superexponential decay in the right tail. We also prove that the survival function $1 - F_t(x) = \int_x^{\infty}\!f_t(y)\,\mathrm{d}y$ and the density function $f_t(x)$ both have the right tail asymptotics $\exp [-x \ln x - x \ln \ln x + O(x)]$. We use the right-tail asymptotics to bound large deviations for the scale-normalized number of key comparisons used by QuickQuant.


title: Microemulsions in the driven Widom-Rowlinson lattice gas

abstract: An investigation of the two-dimensional Widom-Rowlinson lattice gas under an applied drive uncovered a remarkable non-equilibrium steady state in which uniform stripes (reminiscent of an equilibrium lamellar phase) form perpendicular to the drive direction [R. Dickman and R. K. P. Zia, Phys. Rev. E 97, 062126 (2018)]. Here we study this model at low particle densities in two and three dimensions, where we find a disordered phase with a characteristic length scale (a "microemulsion") along the drive direction. We develop a continuum theory of this disordered phase to derive a coarse-grained field-theoretic action for the non-equilibrium dynamics. The action has the form of two coupled driven diffusive systems with different characteristic velocities, generated by an interplay between the particle repulsion and the drive. We then show how fluctuation corrections in the field theory may generate the characteristic features of the microemulsion phase, including a peak in the static structure factor corresponding to the characteristic length scale. This work lays the foundation for understanding the stripe phenomenon more generally.


title: Tumor Spheroid Chemotaxis in Epidermal Growth Factor Gradients Revealed by a 3D Microfluidic Device

abstract: Epidermal growth factor (EGF), a potent cytokine, is known to promote tumor invasion both in vivo and in vitro. Previously, we observed that single breast tumor cells (MDA-MB-231 cell line) embedded within a 3D collagen matrix displayed enhanced motility but no discernible chemotaxis in the presence of linear EGF gradients using a microfluidic platform. Inspired by a recent theoretical development that clustered mammalian cells respond differently to chemical gradients than single cells, we studied tumor spheroid invasion within a 3D extracellular matrix (ECM) in the presence of EGF gradients. We found that EGF gradients promoted tumor cell detachment from the spheroid core, and the position of the tumor spheroid core showed a mild chemotactic response towards the EGF gradients. For those tumor cells detached from the spheroids, they showed an enhanced chemokinesis response in contrast to previous experimental results using single cells embedded within an ECM. No discernible chemotactic response towards the EGF gradients was found for the cells outside the spheroid core. This work demonstrates that a cluster of tumor cells responds differently than single tumor cells towards EGF gradients and highlights the importance of a tumor spheroid platform for chemotaxis studies.


title: Kernel distance measures for time series, random fields and other structured data

abstract: This paper introduces kdiff, a novel kernel-based measure for estimating distances between instances of time series, random fields and other forms of structured data. This measure is based on the idea of matching distributions that only overlap over a portion of their region of support. Our proposed measure is inspired by MPdist which has been previously proposed for such datasets and is constructed using Euclidean metrics, whereas kdiff is constructed using non-linear kernel distances. Also, kdiff accounts for both self and cross similarities across the instances and is defined using a lower quantile of the distance distribution. Comparing the cross similarity to self similarity allows for measures of similarity that are more robust to noise and partial occlusions of the relevant signals. Our proposed measure kdiff is a more general form of the well known kernel-based Maximum Mean Discrepancy (MMD) distance estimated over the embeddings. Some theoretical results are provided for separability conditions using kdiff as a distance measure for clustering and classification problems where the embedding distributions can be modeled as two component mixtures. Applications are demonstrated for clustering of synthetic and real-life time series and image data, and the performance of kdiff is compared to competing distance measures for clustering.


title: Least energy positive solutions of critical Schr\"{o}dinger systems with mixed competition and cooperation terms: the higher dimensional case

abstract: Let $\Omega\subset \mathbb{R}^{N}$ be a smooth bounded domain. In this paper we investigate the existence of least energy positive solutions to the following Schr\"{o}dinger system with $d\geq 2$ equations \begin{equation*} -\Delta u_{i}+\lambda_{i}u_{i}=|u_{i}|^{p-2}u_{i}\sum_{j = 1}^{d}\beta_{ij}|u_{j}|^{p} \text{ in } \Omega, \quad u_i=0 \text{ on } \partial \Omega, \qquad i=1,...,d, \end{equation*} in the case of a critical exponent $2p=2^*=\frac{2N}{N-2}$ in high dimensions $N\geq 5$. We treat the focusing case ($\beta_{ii}>0$ for every $i$) in the variational setting $\beta_{ij}=\beta_{ji}$ for every $i\neq j$, dealing with a Br\'ezis-Nirenberg type problem: $-\lambda_{1}(\Omega)<\lambda_{i}<0$, where $\lambda_{1}(\Omega)$ is the first eigenvalue of $(-\Delta,H^1_0(\Omega))$. We provide several sufficient conditions on the coefficients $\beta_{ij}$ that ensure the existence of least energy positive solutions; these include the situations of pure cooperation ($\beta_{ij}> 0$ for every $i\neq j$), pure competition ($\beta_{ij}\leq 0$ for every $i\neq j$) and coexistence of both cooperation and competition coefficients. Some proofs depend heavily on the fact that $1<p<2$, revealing some different phenomena comparing to the special case $N=4$. Our results provide a rather complete picture in the particular situation where the components are divided in two groups. Besides, based on the results about a phase separation phenomena, we prove the existence of least energy sign-changing solution to the Br\'ezis-Nirenberg problem \[ -\Delta u+\lambda u=\mu |u|^{2^*-2}u,\quad u\in H^1_0(\Omega), \] for $\mu>0$, $-\lambda_1(\Omega)<\lambda<0$ for all $N\geq 4$, a result which is new in dimensions $N=4,5$.


title: MetaHistoSeg: A Python Framework for Meta Learning in Histopathology Image Segmentation

abstract: Few-shot learning is a standard practice in most deep learning based histopathology image segmentation, given the relatively low number of digitized slides that are generally available. While many models have been developed for domain specific histopathology image segmentation, cross-domain generalization remains a key challenge for properly validating models. Here, tooling and datasets to benchmark model performance across histopathological domains are lacking. To address this limitation, we introduce MetaHistoSeg - a Python framework that implements unique scenarios in both meta learning and instance based transfer learning. Designed for easy extension to customized datasets and task sampling schemes, the framework empowers researchers with the ability of rapid model design and experimentation. We also curate a histopathology meta dataset - a benchmark dataset for training and validating models on out-of-distribution performance across a range of cancer types. In experiments we showcase the usage of MetaHistoSeg with the meta dataset and find that both meta-learning and instance based transfer learning deliver comparable results on average, but in some cases tasks can greatly benefit from one over the other.


title: Decentralized Role Assignment in Multi-Agent Teams via Empirical Game-Theoretic Analysis

abstract: We propose a method, based on empirical game theory, for a robot operating as part of a team to choose its role within the team without explicitly communicating with team members, by leveraging its knowledge about the team structure. To do this, we formulate the role assignment problem as a dynamic game, and borrow tools from empirical game-theoretic analysis to analyze such games. Based on this game-theoretic formulation, we propose a distributed controller for each robot to dynamically decide on the best role to take. We demonstrate our method in simulations of a collaborative planar manipulation scenario in which each agent chooses from a set of feedback control policies at each instant. The agents can effectively collaborate without communication to manipulate the object while also avoiding collisions using our method.


title: A Two-Time-Scale Stochastic Optimization Framework with Applications in Control and Reinforcement Learning

abstract: We study a new two-time-scale stochastic gradient method for solving optimization problems, where the gradients are computed with the aid of an auxiliary variable under samples generated by time-varying Markov random processes parameterized by the underlying optimization variable. These time-varying samples make gradient directions in our update biased and dependent, which can potentially lead to the divergence of the iterates. In our two-time-scale approach, one scale is to estimate the true gradient from these samples, which is then used to update the estimate of the optimal solution. While these two iterates are implemented simultaneously, the former is updated "faster" (using bigger step sizes) than the latter (using smaller step sizes). Our first contribution is to characterize the finite-time complexity of the proposed two-time-scale stochastic gradient method. In particular, we provide explicit formulas for the convergence rates of this method under different structural assumptions, namely, strong convexity, convexity, the Polyak-Lojasiewicz condition, and general non-convexity. We apply our framework to two problems in control and reinforcement learning. First, we look at the standard online actor-critic algorithm over finite state and action spaces and derive a convergence rate of O(k^(-2/5)), which recovers the best known rate derived specifically for this problem. Second, we study an online actor-critic algorithm for the linear-quadratic regulator and show that a convergence rate of O(k^(-2/3)) is achieved. This is the first time such a result is known in the literature. Finally, we support our theoretical analysis with numerical simulations where the convergence rates are visualized.


title: Here To Stay: Measuring Hologram Stability in Markerless Smartphone Augmented Reality

abstract: Markerless augmented reality (AR) has the potential to provide engaging experiences and improve outcomes across a wide variety of industries; the overlaying of virtual content, or holograms, onto a view of the real world without the need for predefined markers provides great convenience and flexibility. However, unwanted hologram movement frequently occurs in markerless smartphone AR due to challenging visual conditions or device movement, and resulting error in device pose tracking. We develop a method for measuring hologram positional errors on commercial smartphone markerless AR platforms, implement it as an open-source AR app, HoloMeasure, and use the app to conduct systematic quantitative characterizations of hologram stability across 6 different user actions, 3 different smartphone models, and over 200 different environments. Our study demonstrates significant levels of spatial instability in holograms in all but the simplest settings, and underscores the need for further enhancements to pose tracking algorithms for smartphone-based markerless AR.


title: Effects of collisional ion orbit loss on neoclassical tokamak radial electric fields

abstract: Ion orbit loss is considered important for generating the radially inward electric field $E_r$ in a tokamak edge plasma. In particular, this effect is emphasized in diverted tokamaks with a magnetic X point. In neoclassical equilibria, Coulomb collisions can scatter ions onto loss orbits and generate a radially outward current, which in steady state is balanced by the radially inward current from viscosity. To quantitatively measure this loss-orbit current in an edge pedestal, an ion-orbit-flux diagnostic has been implemented in the axisymmetric version of the gyrokinetic particle-in-cell code XGC. As the first application of this diagnostic, a neoclassical DIII-D H-mode plasma is studied using gyrokinetic ions and adiabatic electrons. The validity of the diagnostic is demonstrated by studying the collisional relaxation of $E_r$ in the core. After this demonstration, the loss-orbit current is numerically measured in the edge pedestal in quasisteady state. In this plasma, it is found that the radial electric force on ions from $E_r$ approximately balances the ion radial pressure gradient in the edge pedestal, with the radial force from the plasma flow term being a minor component. The effect of orbit loss on $E_r$ is found to be only mild. How ion orbit loss will affect $E_r$ in the full-current ITER plasma pedestal is left as a subsequent study topic.


title: GW200115: a non-spinning black hole -- neutron star merger

abstract: GW200115 was the second merger of a black hole and a neutron star confidently detected through gravitational waves. Inference on the signal allows for a large black hole spin misaligned with the orbital angular momentum, but shows little support for aligned spin values. We show that this is a natural consequence of measuring the parameters of a black hole -- neutron star binary with non-spinning components while assuming the priors used in the LIGO-Virgo-KAGRA analysis. We suggest that, a priori, a non-spinning binary is more consistent with current astrophysical understanding.


title: Chest X-Rays Image Classification from beta-Variational Autoencoders Latent Features

abstract: Chest X-Ray (CXR) is one of the most common diagnostic techniques used in everyday clinical practice all around the world. We hereby present a work which intends to investigate and analyse the use of Deep Learning (DL) techniques to extract information from such images and allow to classify them, trying to keep our methodology as general as possible and possibly also usable in a real world scenario without much effort, in the future. To move in this direction, we trained several beta-Variational Autoencoder (beta-VAE) models on the CheXpert dataset, one of the largest publicly available collection of labeled CXR images; from these models, latent features have been extracted and used to train other Machine Learning models, able to classify the original images from the features extracted by the beta-VAE. Lastly, tree-based models have been combined together in ensemblings to improve the results without the necessity of further training or models engineering. Expecting some drop in pure performance with the respect to state of the art classification specific models, we obtained encouraging results, which show the viability of our approach and the usability of the high level features extracted by the autoencoders for classification tasks.


title: Asymptotic formation and orbital stability of phase-locked states in Kuramoto--Lohe type synchronization models on Lie groups

abstract: It is known that the Kuramoto model has a critical coupling strength above which phase-locked states exist, and, by the work of Choi, Ha, Jung, and Kim (2012), that these phase-locked states are orbitally stable. This property of admitting orbitally stable phase-locked states is preserved under the nonabelian generalizations of the Kuramoto model pioneered by Lohe (2009). We provide a framework for understanding these phenomena, by formulating the aforementioned models as special cases of a general ODE model describing populations of particles on Lie groups with pairwise attractive Kuramoto-type interactions. This general model can be used in producing many specific models with orbitally stable nonabelian phase-locked states.


title: Critical temperature of one-dimensional Ising model with long-range interaction revisited

abstract: We present a generalized expression for the transfer matrix of finite and infinite one-dimensional spin chains within a magnetic field with spin pair interaction $J/r^p$, where $r\ = 1,2,\ldots,n_v$ is the distance between two spins, $n_v$ is the number of nearest neighbors reached by the interaction, and $p \in [1,2]$. With this generalized expression, we calculate the partition function, the Helmholtz free energy, and the specific heat for both finite and infinite ferromagnetic 1D Ising models within a zero external magnetic field. We focus on the temperature $T_{\text{max}}$ where specific heat reaches its maximum. We calculate $J/(k_B T_{\text{max}})$ numerically for every values of $n_v \in \{ 1,2,\ldots, 25\}$, which we interpolate and then extrapolate up to the critical temperature as a function of $p$, using a novel functional approach. Two different procedures are used to reach the infinite spin chain with an infinite interaction range: increasing the chain size and the interaction range by the same amount, and increasing the interaction range for the infinite chain. As we expected, both extrapolations lead to the same critical temperature, although by two different concurrent curves. Our critical temperatures as a function of $p$ fall within the upper and lower bounds reported in the literature and show a better coincidence with many existing approximations for $p$ close to 1 than for the $p$ values near 2. We report an averaged inverse critical temperature $J/(k_BT_c) = 0.532$ for the one-dimensional spin chain with $p=2$. It is worth mentioning that the well-known cases for near (original Ising model) and next-near neighbor interactions are recovered doing $n_v = 1$ and $n_v = 2$, respectively.


title: On Ricci flows with closed and smooth tangent flows

abstract: In this paper, we consider Ricci flows admitting closed and smooth tangent flows in the sense of Bamler [Bam20c]. The tangent flow in question can be either a tangent flow at infinity for an ancient Ricci flow, or a tangent flow at a singular point for a Ricci flow developing a finite-time singularity. Among other things, we prove: (1) that in these cases the tangent flow must be unique, (2) that if a Ricci flow with finite-time singularity has a closed singularity model, then the singularity is of Type I and the singularity model is the tangent flow at the singular point; this answers a question proposed in [CCGGIIKLLN10], (3) a dichotomy theorem that characterizes ancient Ricci flows admitting a closed and smooth backward sequential limit.


title: Gaps, Ambiguity, and Establishing Complexity-Class Containments via Iterative Constant-Setting

abstract: Cai and Hemachandra used iterative constant-setting to prove that Few $\subseteq$ $\oplus$P (and thus that FewP $\subseteq$ $\oplus$P). In this paper, we note that there is a tension between the nondeterministic ambiguity of the class one is seeking to capture, and the density (or, to be more precise, the needed "nongappy"-ness) of the easy-to-find "targets" used in iterative constant-setting. In particular, we show that even less restrictive gap-size upper bounds regarding the targets allow one to capture ambiguity-limited classes. Through a flexible, metatheorem-based approach, we do so for a wide range of classes including the logarithmic-ambiguity version of Valiant's unambiguous nondeterminism class UP. Our work lowers the bar for what advances regarding the existence of infinite, P-printable sets of primes would suffice to show that restricted counting classes based on the primes have the power to accept superconstant-ambiguity analogues of UP. As an application of our work, we prove that the Lenstra-Pomerance-Wagstaff Conjecture implies that all (O(1) + loglogn)-ambiguity NP sets are in the restricted counting class $\rm RC_{PRIMES}$.


title: Cosmological Constraints on First-Order Phase Transitions

abstract: First-order phase transitions exist in many models beyond the Standard Model and can generate detectable stochastic gravitational waves for a strong one. Using the cosmological observables in big bang nucleosynthesis and cosmic microwave background, we derive constraints on the phase transition temperature and strength parameter in a model-independent way. For a strong phase transition, we find that the phase transition temperature should be above around 2 MeV for both reheating photon and neutrino cases. For a weak one with the temperature below 1 MeV, the phase transition strength parameter is constrained to be smaller than around 0.1. Implications for using a first-order phase transition to explain the NANOGrav observed gravitational wave signal are also discussed.


title: Boost-RS: Boosted Embeddings for Recommender Systems and its Application to Enzyme-Substrate Interaction Prediction

abstract: Despite experimental and curation efforts, the extent of enzyme promiscuity on substrates continues to be largely unexplored and under documented. Recommender systems (RS), which are currently unexplored for the enzyme-substrate interaction prediction problem, can be utilized to provide enzyme recommendations for substrates, and vice versa. The performance of Collaborative-Filtering (CF) recommender systems however hinges on the quality of embedding vectors of users and items (enzymes and substrates in our case). Importantly, enhancing CF embeddings with heterogeneous auxiliary data, specially relational data (e.g., hierarchical, pairwise, or groupings), remains a challenge. We propose an innovative general RS framework, termed Boost-RS, that enhances RS performance by "boosting" embedding vectors through auxiliary data. Specifically, Boost-RS is trained and dynamically tuned on multiple relevant auxiliary learning tasks Boost-RS utilizes contrastive learning tasks to exploit relational data. To show the efficacy of Boost-RS for the enzyme-substrate prediction interaction problem, we apply the Boost-RS framework to several baseline CF models. We show that each of our auxiliary tasks boosts learning of the embedding vectors, and that contrastive learning using Boost-RS outperforms attribute concatenation and multi-label learning. We also show that Boost-RS outperforms similarity-based models. Ablation studies and visualization of learned representations highlight the importance of using contrastive learning on some of the auxiliary data in boosting the embedding vectors.


title: Impulse Response Characterization of a Commercial Multimode Fiber using Superconducting Nanowire Single-Photon Detectors

abstract: Time-of-flight measurements are key to study distributed mode coupling and differential mode group delay (DMDG) in multimode fibers (MMFs). However, current approaches using regular photodetectors with limited sensitivity preclude the detection of weak modal interactions in such fibers masking interesting physical effects. Here we demonstrate the use of high-sensitivity superconducting nanowire single-photon detectors (SNSPDs) to measure the mode transfer matrix of a commercial graded-index multimode fiber. Two high performance 45-mode multi-plane light conversion (MPLC) devices served as the mode multiplexer/demultiplexer. Distributed mode coupling and DMDG among different mode groups are accurately quantified from the impulse response measurement. We also observed cladding modes of the MMF as a pedestal of the pulse in the measurement. This work paves way for applications such as quantum communications using many spatial modes of the fiber.


title: A projection from filling currents to Teichm\"uller space

abstract: Let $S$ be a closed, genus $g$ surface. The space of geodesic currents on $S$ encompasses the set of closed curves up to homotopy, as well as Teichm\"uller space, and many other spaces of structures on $S$. We show that one can define a mapping class group equivariant, length-minimizing projection from the set of filling geodesic currents down to Teichm\"uller space, and prove some basic properties of this projection to show that it is well-behaved.


title: A Fast Detection Method of Break Points in Effective Connectivity Networks

abstract: There is increasing interest in identifying changes in the underlying states of brain networks. The availability of large scale neuroimaging data creates a strong need to develop fast, scalable methods for detecting and localizing in time such changes and also identify their drivers, thus enabling neuroscientists to hypothesize about potential mechanisms. This paper presents a fast method for detecting break points in exceedingly long time series neuroimaging data, based on vector autoregressive (Granger causal) models. It uses a multi-step strategy based on a regularized objective function that leads to fast identification of candidate break points, followed by clustering steps to select the final set of break points and subsequent estimation with false positives control of the underlying Granger causal networks. The latter provides insights into key changes in network connectivity that led to the presence of break points. The proposed methodology is illustrated on synthetic data varying in their length, dimensionality, number of break points, strength of the signal, and also applied to EEG data related to visual tasks.


title: Feature Selection on a Flare Forecasting Testbed: A Comparative Study of 24 Methods

abstract: The Space-Weather ANalytics for Solar Flares (SWAN-SF) is a multivariate time series benchmark dataset recently created to serve the heliophysics community as a testbed for solar flare forecasting models. SWAN-SF contains 54 unique features, with 24 quantitative features computed from the photospheric magnetic field maps of active regions, describing their precedent flare activity. In this study, for the first time, we systematically attacked the problem of quantifying the relevance of these features to the ambitious task of flare forecasting. We implemented an end-to-end pipeline for preprocessing, feature selection, and evaluation phases. We incorporated 24 Feature Subset Selection (FSS) algorithms, including multivariate and univariate, supervised and unsupervised, wrappers and filters. We methodologically compared the results of different FSS algorithms, both on the multivariate time series and vectorized formats, and tested their correlation and reliability, to the extent possible, by using the selected features for flare forecasting on unseen data, in univariate and multivariate fashions. We concluded our investigation with a report of the best FSS methods in terms of their top-k features, and the analysis of the findings. We wish the reproducibility of our study and the availability of the data allow the future attempts be comparable with our findings and themselves.


title: Polynomial Approximation of Symmetric Functions

abstract: We study the polynomial approximation of symmetric multivariate functions and of multi-set functions. Specifically, we consider $f(x_1, \dots, x_N)$, where $x_i \in \mathbb{R}^d$, and $f$ is invariant under permutations of its $N$ arguments. We demonstrate how these symmetries can be exploited to improve the cost versus error ratio in a polynomial approximation of the function $f$, and in particular study the dependence of that ratio on $d, N$ and the polynomial degree. These results are then used to construct approximations and prove approximation rates for functions defined on multi-sets where $N$ becomes a parameter of the input.


title: An Automated Scanning Transmission Electron Microscope Guided by Sparse Data Analytics

abstract: Artificial intelligence (AI) promises to reshape scientific inquiry and enable breakthrough discoveries in areas such as energy storage, quantum computing, and biomedicine. Scanning transmission electron microscopy (STEM), a cornerstone of the study of chemical and materials systems, stands to benefit greatly from AI-driven automation. However, present barriers to low-level instrument control, as well as generalizable and interpretable feature detection, make truly automated microscopy impractical. Here, we discuss the design of a closed-loop instrument control platform guided by emerging sparse data analytics. We demonstrate how a centralized controller, informed by machine learning combining limited $a$ $priori$ knowledge and task-based discrimination, can drive on-the-fly experimental decision-making. This platform unlocks practical, automated analysis of a variety of material features, enabling new high-throughput and statistical studies.


title: Stability of even-denominator fractional quantum Hall states in systems with strong Landau-level mixing

abstract: Mixing of Landau levels has been understood to be essential in governing the nature of the ground state for the even-denominator fractional quantum Hall effect. The incompressibility of the ground state at filling factor $5/2$ in the strong Landau-level-mixed systems, such as the ZnO quantum well, is not always stable. Here we present an approach to generally deal with this kind of systems and satisfactorily explain the recent experiments [Falson \textit{et al}. Sci. Adv. \textbf{4}, eaat8742 (2018)] by implementing the screening plus the thickness effect. Further, the phase diagrams of the incompressibility of the ground state indicate that the phase transitions can be explicitly extracted by observing the lowest gap of the collective modes when the magnetic field and the width of the quantum well are tuned. We also predict the incompressibility of the two-dimensional electron gas in higher Landau levels in another strong Landau-level-mixed system, viz., the black phosphorene, by considering the screening effect where the relevant even-denominator fractional quantum Hall effects can possibly be observed.


title: Fibonacci numbers, consecutive patterns, and inverse peaks

abstract: We give multiple proofs of two formulas concerning the enumeration of permutations avoiding a monotone consecutive pattern with a certain value for the inverse peak number or inverse left peak number statistic. The enumeration in both cases is given by a sequence related to Fibonacci numbers. We also show that there is exactly one permutation whose inverse peak number is zero among all permutations with any fixed descent composition, and we give a few elementary consequences of this fact. Our proofs involve generating functions, symmetric functions, regular expressions, and monomino-domino tilings.


title: A Prior Knowledge Based Tumor and Tumoral Subregion Segmentation Tool for Pediatric Brain Tumors

abstract: In the past few years, deep learning (DL) models have drawn great attention and shown superior performance on brain tumor and subregion segmentation tasks. However, the success is limited to segmentation of adult gliomas, where sufficient data have been collected, manually labeled, and published for training DL models. It is still challenging to segment pediatric tumors, because the appearances are different from adult gliomas. Hence, directly applying a pretained DL model on pediatric data usually generates unacceptable results. Because pediatric data is very limited, both labeled and unlabeled, we present a brain tumor segmentation model that is based on knowledge rather than learning from data. We also provide segmentation of more subregions for super heterogeneous tumor like atypical teratoid rhabdoid tumor (ATRT). Our proposed approach showed superior performance on both whole tumor and subregion segmentation tasks to DL based models on our pediatric data when training data is not available for transfer learning.


title: Measuring Sentence-Level and Aspect-Level (Un)certainty in Science Communications

abstract: Certainty and uncertainty are fundamental to science communication. Hedges have widely been used as proxies for uncertainty. However, certainty is a complex construct, with authors expressing not only the degree but the type and aspects of uncertainty in order to give the reader a certain impression of what is known. Here, we introduce a new study of certainty that models both the level and the aspects of certainty in scientific findings. Using a new dataset of 2167 annotated scientific findings, we demonstrate that hedges alone account for only a partial explanation of certainty. We show that both the overall certainty and individual aspects can be predicted with pre-trained language models, providing a more complete picture of the author's intended communication. Downstream analyses on 431K scientific findings from news and scientific abstracts demonstrate that modeling sentence-level and aspect-level certainty is meaningful for areas like science communication. Both the model and datasets used in this paper are released at https://blablablab.si.umich.edu/projects/certainty/.


title: Use of primary decomposition of polynomial ideals arising from indicator functions to enumerate orthogonal fractions

abstract: A polynomial indicator function of designs is first introduced by Fontana {\it et al}. (2000) for two-level cases. They give the structure of the indicator functions, especially the relation to the orthogonality of designs. These results are generalized by Aoki (2019) for general multi-level cases. As an application of these results, we can enumerate all orthogonal fractional factorial designs with given size and orthogonality using computational algebraic software. For example, Aoki (2019) gives classifications of orthogonal fractions of 2x2x2x2x3 designs with strength 3, which is derived by simple eliminations of variables. However, the computational feasibility of this naive approach depends on the size of the problems. In fact, it is reported that the computation of orthogonal fractions of 2x2x2x2x3 designs with strength 2 fails to carry out in Aoki (2019). In this paper, using the theory of primary decomposition, we enumerate and classify orthogonal fractions of 2x2x2x2x3 designs with strength 2. We show there are 35200 orthogonal half fractions of 2x2x2x2x3 designs with strength 2, classified into 63 equivalent classes.


title: CALDA: Improving Multi-Source Time Series Domain Adaptation with Contrastive Adversarial Learning

abstract: Unsupervised domain adaptation (UDA) provides a strategy for improving machine learning performance in data-rich (target) domains where ground truth labels are inaccessible but can be found in related (source) domains. In cases where meta-domain information such as label distributions is available, weak supervision can further boost performance. We propose a novel framework, CALDA, to tackle these two problems. CALDA synergistically combines the principles of contrastive learning and adversarial learning to robustly support multi-source UDA (MS-UDA) for time series data. Similar to prior methods, CALDA utilizes adversarial learning to align source and target feature representations. Unlike prior approaches, CALDA additionally leverages cross-source label information across domains. CALDA pulls examples with the same label close to each other, while pushing apart examples with different labels, reshaping the space through contrastive learning. Unlike prior contrastive adaptation methods, CALDA requires neither data augmentation nor pseudo labeling, which may be more challenging for time series. We empirically validate our proposed approach. Based on results from human activity recognition, electromyography, and synthetic datasets, we find utilizing cross-source information improves performance over prior time series and contrastive methods. Weak supervision further improves performance, even in the presence of noise, allowing CALDA to offer generalizable strategies for MS-UDA. Code is available at: https://github.com/floft/calda


title: Time Coordination of Multiple UAVs over Switching Communication Networks with Digraph Topologies

abstract: This paper presents a time-coordination algorithm for multiple UAVs executing cooperative missions. Unlike previous algorithms, it does not rely on the assumption that the communication between UAVs is bidirectional. Thus, the topology of the inter-UAV information flow can be characterized by digraphs. To achieve coordination with weak connectivity, we design a switching law that orchestrates switching between jointly connected digraph topologies. In accordance with the law, the UAVs with a transmitter switch the topology of their coordination information flow. A Lyapunov analysis shows that a decentralized coordination controller steers coordination errors to a neighborhood of zero. Simulation results illustrate that the algorithm attains coordination objectives with significantly reduced inter-UAV communication compared to previous work.


title: The Scott-Vogelius Method for Stokes Problem on Anisotropic Meshes

abstract: This paper analyzes the Scott-Vogelius divergence-free element pair on anisotropic meshes. Weexplore the behavior of the inf-sup stability constant with respect to the aspect ratio on meshes generated with astandard barycenter mesh refinement strategy, as well as a newly introduced incenter refinement strategy. Numericalexperiments are presented which support the theoretical results


title: Genomic prediction: progress and perspectives for rice improvement

abstract: Genomic prediction can be a powerful tool to achieve greater rates of genetic gain for quantitative traits if thoroughly integrated into a breeding strategy. In rice as in other crops, the interest in genomic prediction is very strong with a number of studies addressing multiple aspects of its use, ranging from the more conceptual to the more practical. In this chapter, we review the literature on rice (Oryza sativa) and summarize important considerations for the integration of genomic prediction in breeding programs. The irrigated breeding program at the International Rice Research Institute is used as a concrete example on which we provide data and R scripts to reproduce the analysis but also to highlight practical challenges regarding the use of predictions. The adage: "To someone with a hammer, everything looks like a nail" describes a common psychological pitfall that sometimes plagues the integration and application of new technologies to a discipline. We have designed this chapter to help rice breeders avoid that pitfall and appreciate the benefits and limitations of applying genomic prediction, as it is not always the best approach nor the first step to increasing the rate of genetic gain in every context.


title: Semiclassical analysis of axion-assisted and axion-driven pair production

abstract: We study the pair production of fermions in a time dependent axion background with and without an electric background. We construct the adiabatic mode functions which incorporate the gauge field and the axion velocity dependence of the dispersion relation. The semiclassical approach using this adiabatic basis shows two types of pair production. One is axion-assisted pair production: the presence of the axion velocity gives enhancement and interference effects on the pair production driven by the electric field. The other is axion-driven pair production: the time variation of the axion velocity causes the pair production even though the electric field is absent.


title: Multiple Change Point Detection in Reduced Rank High Dimensional Vector Autoregressive Models

abstract: We study the problem of detecting and locating change points in high-dimensional Vector Autoregressive (VAR) models, whose transition matrices exhibit low rank plus sparse structure. We first address the problem of detecting a single change point using an exhaustive search algorithm and establish a finite sample error bound for its accuracy. Next, we extend the results to the case of multiple change points that can grow as a function of the sample size. Their detection is based on a two-step algorithm, wherein the first step, an exhaustive search for a candidate change point is employed for overlapping windows, and subsequently, a backward elimination procedure is used to screen out redundant candidates. The two-step strategy yields consistent estimates of the number and the locations of the change points. To reduce computation cost, we also investigate conditions under which a surrogate VAR model with a weakly sparse transition matrix can accurately estimate the change points and their locations for data generated by the original model. This work also addresses and resolves a number of novel technical challenges posed by the nature of the VAR models under consideration. The effectiveness of the proposed algorithms and methodology is illustrated on both synthetic and two real data sets.


title: Theoretical analysis of Fresnel reflection and transmission in the presence of gain media

abstract: When a monochromatic electromagnetic plane-wave arrives at the flat interface between its transparent host (i.e., the incidence medium) and an amplifying (or gainy) second medium, the incident beam splits into a reflected wave and a transmitted wave. In general, there is a sign ambiguity in connection with the k-vector of the transmitted beam, which requires at the outset that one decide whether the transmitted beam should grow or decay as it recedes from the interface. The question has been posed and addressed most prominently in the context of incidence at large angles from a dielectric medium of high refractive index onto a gain medium of lower refractive index. Here, the relevant sign of the transmitted k-vector determines whether the evanescent-like waves within the gain medium exponentially grow or decay away from the interface. We examine this and related problems in a more general setting, where the incident beam is taken to be a finite-duration wavepacket whose footprint in the interfacial plane has a finite width. Cases of reflection from and transmission through a gainy slab of finite-thickness as well as those associated with a semi-infinite gain medium will be considered. The broadness of the spatiotemporal spectrum of our incident wavepacket demands that we develop a general strategy for deciding the signs of all the k-vectors that enter the gain medium. Such a strategy emerges from a consideration of the causality constraint that is naturally imposed on both the reflected and transmitted wavepackets.


title: Nonparametric Bounds on Treatment Effects with Imperfect Instruments

abstract: This paper extends the identification results in Nevo and Rosen (2012) to nonparametric models. We derive nonparametric bounds on the average treatment effect when an imperfect instrument is available. As in Nevo and Rosen (2012), we assume that the correlation between the imperfect instrument and the unobserved latent variables has the same sign as the correlation between the endogenous variable and the latent variables. We show that the monotone treatment selection and monotone instrumental variable restrictions, introduced by Manski and Pepper (2000, 2009), jointly imply this assumption. Moreover, we show how the monotone treatment response assumption can help tighten the bounds. The identified set can be written in the form of intersection bounds, which is more conducive to inference. We illustrate our methodology using the National Longitudinal Survey of Young Men data to estimate returns to schooling.


title: A Unified Convergence Analysis of a Second-Order Method of Multipliers for Nonlinear Conic Programming

abstract: In this paper, we accomplish a unified convergence analysis of a second-order method of multipliers (i.e., a second-order augmented Lagrangian method) for solving the conventional nonlinear conic optimization problems.Specifically, the algorithm that we investigated incorporates a specially designed nonsmooth (generalized) Newton step to furnish a second-order update rule for the multipliers.We first show in a unified fashion that under a few abstract assumptions, the proposed method is locally convergent and possesses a (nonasymptotic) superlinear convergence rate, even though the penalty parameter is fixed and/or the strict complementarity fails.Subsequently, we demonstrate that, for the three typical scenarios, i.e., the classic nonlinear programming, the nonlinear second-order cone programming, and the nonlinear semidefinite programming, these abstract assumptions are nothing but exactly the implications of the iconic sufficient conditions that were assumed for establishing the Q-linear convergence rates of the method of multipliers without assuming the strict complementarity.


title: The effect of charge, isospin, and strangeness in the QCD phase diagram critical end point

abstract: In this work, we discuss the deconfinement phase transition to quark matter in hot/dense matter. We {examine} the effect that different charge fractions, isospin fractions, net strangeness, and chemical equilibrium with respect to leptons have on the position of the coexistence line between different phases. In particular, we investigate how different sets of conditions that describe matter in neutron stars and their mergers, or matter created in heavy-ion collisions affect the position of the critical end point, namely where the first-order phase transition becomes a crossover. We also present an introduction to the topic of critical points, including a review of recent {advances} concerning QCD critical points.


title: Tipping the Scales: A Corpus-Based Reconstruction of Adjective Scales in the McGill Pain Questionnaire

abstract: Modern medical diagnosis relies on precise pain assessment tools in translating clinical information from patient to physician. The McGill Pain Questionnaire (MPQ) is a clinical pain assessment technique that utilizes 78 adjectives of different intensities in 20 different categories to quantity a patient's pain. The questionnaire's efficacy depends on a predictable pattern of adjective use by patients experiencing pain. In this study, I recreate the MPQ's adjective intensity orderings using data gathered from patient forums and modern NLP techniques. I extract adjective intensity relationships by searching for key linguistic contexts, and then combine the relationship information to form robust adjective scales. Of 17 adjective relationships predicted by this research, only 4 diverge from the MPQ's orderings, which is statistically significant at the 0.1 alpha level. The results suggest predictable patterns of adjective use by people experiencing pain, but call into question the MPQ's categories for grouping adjectives.


title: Bitcoin Transaction Strategy Construction Based on Deep Reinforcement Learning

abstract: The emerging cryptocurrency market has lately received great attention for asset allocation due to its decentralization uniqueness. However, its volatility and brand new trading mode have made it challenging to devising an acceptable automatically-generating strategy. This study proposes a framework for automatic high-frequency bitcoin transactions based on a deep reinforcement learning algorithm-proximal policy optimization (PPO). The framework creatively regards the transaction process as actions, returns as awards and prices as states to align with the idea of reinforcement learning. It compares advanced machine learning-based models for static price predictions including support vector machine (SVM), multi-layer perceptron (MLP), long short-term memory (LSTM), temporal convolutional network (TCN), and Transformer by applying them to the real-time bitcoin price and the experimental results demonstrate that LSTM outperforms. Then an automatically-generating transaction strategy is constructed building on PPO with LSTM as the basis to construct the policy. Extensive empirical studies validate that the proposed method performs superiorly to various common trading strategy benchmarks for a single financial product. The approach is able to trade bitcoins in a simulated environment with synchronous data and obtains a 31.67% more return than that of the best benchmark, improving the benchmark by 12.75%. The proposed framework can earn excess returns through both the period of volatility and surge, which opens the door to research on building a single cryptocurrency trading strategy based on deep learning. Visualizations of trading the process show how the model handles high-frequency transactions to provide inspiration and demonstrate that it can be expanded to other financial products.


title: Free energy in multi-species mixed $p$-spin spherical models

abstract: We prove a Parisi formula for the limiting free energy of multi-species spherical spin glasses with mixed $p$-spin interactions. The upper bound involves a Guerra-style interpolation and requires a convexity assumption on the model's covariance function. Meanwhile, the lower bound adapts the cavity method of Chen so that it can be combined with the synchronization technique of Panchenko; this part requires no convexity assumption. In order to guarantee that the resulting Parisi formula has a minimizer, we formalize the pairing of synchronization maps with overlap measures so that the constraint set is a compact metric space. This space is not related to the model's spherical structure and can be carried over to other multi-species settings.


title: Crisanti-Sommers formula and simultaneous symmetry breaking in multi-species spherical spin glasses

abstract: There is a rich history of expressing the limiting free energy of mean-field spin glasses as a variational formula over probability measures on $[0,1]$, where the measure represents the similarity (or "overlap") of two independently sampled spin configurations. At high temperatures, the formula's minimum is achieved at a measure which is a point mass, meaning sample configurations are asymptotically orthogonal up to a magnetic field correction. At low temperatures, though, a very different behavior emerges known as replica symmetry breaking (RSB). The deep wells in the energy landscape create more rigid structure, and the optimal overlap measure is no longer a point mass. The exact size of its support remains in many cases an open problem. Here we consider these themes for multi-species spherical spin glasses. Following a companion work in which we establish the Parisi variational formula, here we present this formula's Crisanti-Sommers representation. In the process, we gain new access to a problem unique to the multi-species setting. Namely, if RSB occurs for one species, does it necessarily occur for other species as well? We provide sufficient conditions for the answer to be yes. For instance, we show that if two species share any quadratic interaction, then RSB for one implies RSB for the other. Moreover, the level of symmetry breaking must be identical, even in cases of full RSB. In the presence of an external field, any type of interaction suffices.


title: Automated airway segmentation by learning graphical structure

abstract: In this research project, we put forward an advanced method for airway segmentation based on the existent convolutional neural network (CNN) and graph neural network (GNN). The method is originated from the vessel segmentation, but we ameliorate it and enable the novel model to perform better for datasets from computed tomography (CT) scans. Current methods for airway segmentation are considering the regular grid only. No matter what the detailed model is, including the 3-dimensional CNN or 2-dimensional CNN in three directions, the overall graph structures are not taken into consideration. In our model, with the neighbourhoods of airway taken into account, the graph structure is incorporated and the segmentation of airways are improved compared with the traditional CNN methods. We perform experiments on the chest CT scans, where the ground truth segmentation labels are produced manually. The proposed model shows that compared with the CNN-only method, the combination of CNN and GNN has a better performance in that the bronchi in the chest CT scans can be detected in most cases. In addition, the model we propose has a wide extension since the architecture is also utilitarian in fulfilling similar aims in other datasets. Hence, the state-of-the-art model is of great significance and highly applicable in our daily lives. Keywords: Airway segmentation, Convolutional neural network, Graph neural network


title: Conjectures of Sun about sums of polygonal numbers

abstract: In this paper, we show that certain sums of generalized $m$-gonal numbers represent every positive integer if and only if they represent every positive integer up to an explicit bound $C_m$, verifying a conjecture of Sun for sufficiently large positive integers.


title: TopoShot: Uncovering Ethereum's Network Topology Leveraging Replacement Transactions

abstract: Ethereum relies on a peer-to-peer overlay network to propagate information. The knowledge of Ethereum network topology holds the key to understanding Ethereum's security, availability, and user anonymity. From a measurement perspective, an Ethereum network's topology is routing-table information hidden inside individual Ethereum nodes, measuring which poses challenges and remains an open research problem in the existing literature. This paper presents TopoShot, a new method uniquely repurposing Ethereum's transaction replacement/eviction policies for topology measurement. TopoShot can be configured to support Geth, Parity, and other major Ethereum clients. As validated on local nodes, TopoShot achieves 100% measurement precision and high recall 88% - 97%. To efficiently measure the large Ethereum networks in the wild, we propose a non-trivial schedule to run pair-wise measurements in parallel. To enable ethical measurement on Ethereum mainnet, we propose workload-adaptive configurations of TopoShot to minimize the service interruption to target nodes/network. We systematically measure a variety of Ethereum networks and obtain new knowledge including the full-network topology in major testnets (Ropsten, Rinkeby and Goerli) and critical sub-network topology in the mainnet. The results on testnets show interesting graph-theoretic properties, such as all testnets exhibit graph modularity significantly lower than random graphs, implying resilience to network partitions. The mainnet results show biased neighbor selection strategies adopted by critical Ethereum services such as mining pools and transaction relays, implying a degree of centralization in real Ethereum networks.


title: Towards Better Data Augmentation using Wasserstein Distance in Variational Auto-encoder

abstract: VAE, or variational auto-encoder, compresses data into latent attributes, and generates new data of different varieties. VAE based on KL divergence has been considered as an effective technique for data augmentation. In this paper, we propose the use of Wasserstein distance as a measure of distributional similarity for the latent attributes, and show its superior theoretical lower bound (ELBO) compared with that of KL divergence under mild conditions. Using multiple experiments, we demonstrate that the new loss function exhibits better convergence property and generates artificial images that could better aid the image classification tasks.


title: Phonetic Word Embeddings

abstract: This work presents a novel methodology for calculating the phonetic similarity between words taking motivation from the human perception of sounds. This metric is employed to learn a continuous vector embedding space that groups similar sounding words together and can be used for various downstream computational phonology tasks. The efficacy of the method is presented for two different languages (English, Hindi) and performance gains over previous reported works are discussed on established tests for predicting phonetic similarity. To address limited benchmarking mechanisms in this field, we also introduce a heterographic pun dataset based evaluation methodology to compare the effectiveness of acoustic similarity algorithms. Further, a visualization of the embedding space is presented with a discussion on the various possible use-cases of this novel algorithm. An open-source implementation is also shared to aid reproducibility and enable adoption in related tasks.


title: Emergency Vehicles Audio Detection and Localization in Autonomous Driving

abstract: Emergency vehicles in service have right-of-way over all other vehicles. Hence, all other vehicles are supposed to take proper actions to yield emergency vehicles with active sirens. As this task requires the cooperation between ears and eyes for human drivers, it also needs audio detection as a supplement to vision-based algorithms for fully autonomous driving vehicles. In urban driving scenarios, we need to know both the existence of emergency vehicles and their relative positions to us to decide the proper actions. We present a novel system from collecting the real-world siren data to the deployment of models using only two cost-efficient microphones. We are able to achieve promising performance for each task separately, especially within the crucial 10m to 50m distance range to react (the size of our ego vehicle is around 5m in length and 2m in width). The recall rate to determine the existence of sirens is 99.16% , the median and mean angle absolute error is 9.64{\deg} and 19.18{\deg} respectively, and the median and mean distance absolute error of 9.30m and 10.58m respectively within that range. We also benchmark various machine learning approaches that can determine the siren existence and sound source localization which includes direction and distance simultaneously within 50ms of latency.


title: Introducing the DOME Activation Functions

abstract: In this paper, we introduce a novel non-linear activation function that spontaneously induces class-compactness and regularization in the embedding space of neural networks. The function is dubbed DOME for Difference Of Mirrored Exponential terms. The basic form of the function can replace the sigmoid or the hyperbolic tangent functions as an output activation function for binary classification problems. The function can also be extended to the case of multi-class classification, and used as an alternative to the standard softmax function. It can also be further generalized to take more flexible shapes suitable for intermediate layers of a network. We empirically demonstrate the properties of the function. We also show that models using the function exhibit extra robustness against adversarial attacks.


title: Heavy-quark spin polarization induced by the Kondo effect in a magnetic field

abstract: We propose a new mechanism of the heavy-quark spin polarization (HQSP) in quark matter induced by the Kondo effect under external magnetic field. The Kondo effect is caused by a condensate between a heavy and a light quark called the Kondo condensate leading to a mixing of the heavy and light quark spins. Thus the HQSP is driven through the Kondo effect from light quarks coupling with the magnetic field in quark matter. For demonstration, we employ the Nambu--Jona-Lasinio type model under a magnetic field, and investigate the HQSP within the linear response theory with vertex corrections required by the $U(1)_{\rm EM}$ electromagnetic gauge invariance. As a result, we find that the HQSP arises significantly with the appearance of the Kondo effect. Our findings are testable in future sign-problem-free lattice simulations.


title: High-Order Resonant Orbit Manifold Expansions For Mission Design In the Planar Circular Restricted 3-Body Problem

abstract: In recent years, stable and unstable manifolds of invariant objects (such as libration points and periodic orbits) have been increasingly recognized as an efficient tool for designing transfer trajectories in space missions. However, most methods currently used in mission design rely on using eigenvectors of the linearized dynamics as local approximations of the manifolds. Since such approximations are not accurate except very close to the base invariant object, this requires large amounts of numerical integration to globalize the manifolds and locate intersections. In this paper, we study hyperbolic resonant periodic orbits in the planar circular restricted 3-body problem, and transfer trajectories between them, by: 1) determining where to search for resonant periodic orbits; 2) developing and implementing a parameterization method for accurate computation of their invariant manifolds as Taylor series; and 3) developing a procedure to compute intersections of the computed stable and unstable manifolds. We develop and implement algorithms that accomplish these three goals, and demonstrate their application to the problem of transferring between resonances in the Jupiter-Europa system.


title: Benchmarking a Probabilistic Coprocessor

abstract: Computation in the past decades has been driven by deterministic computers based on classical deterministic bits. Recently, alternative computing paradigms and domain-based computing like quantum computing and probabilistic computing have gained traction. While quantum computers based on q-bits utilize quantum effects to advance computation, probabilistic computers based on probabilistic (p-)bits are naturally suited to solve problems that require large amount of random numbers utilized in Monte Carlo and Markov Chain Monte Carlo algorithms. These Monte Carlo techniques are used to solve important problems in the fields of optimization, numerical integration or sampling from probability distributions. However, to efficiently implement Monte Carlo algorithms the generation of random numbers is crucial. In this paper, we present and benchmark a probabilistic coprocessor based on p-bits that are naturally suited to solve these problems. We present multiple examples and project that a nanomagnetic implementation of our probabilistic coprocessor can outperform classical CPU and GPU implementations by multiple orders of magnitude.


title: Theoretical prediction of Curie temperature in two-dimensional ferromagnetic monolayer

abstract: Theoretical prediction of Curie temperature (TC) is of vital importance for designing the spintronic devices in two-dimensional (2D) ferromagnetic materials. Herein, based on the extensive investigation of Monte Carlo simulations, we summary and propose an improved method to estimate TC more precisely, which includes the different contributions of multiple near-neighbor interactions. Taking monolayer CrI3 as an example, the trends of TC with biaxial strain are investigated via Monte Carlo simulations, mean-field formulas and our method. Besides, our method is not only accurate and convenient to predicting the TC in 2D ferromagnetic honeycomb lattice CrI3 but it can be extended for predicting the TC of other 2D lattices. Our work paves the way to accelerate the prediction and discovery of novel 2D ferromagnets for spintronic applications.


title: Canonical diffeomorphisms of manifolds near spheres

abstract: For a given Riemannian manifold $(M^n, g)$ which is near standard sphere $(S^n, g_{round})$ in the Gromov-Hausdorff topology and satisfies $Rc \geq n-1$, it is known by Cheeger-Colding theory that $M$ is diffeomorphic to $S^n$. A diffeomorphism $\varphi: M \to S^n$ was constructed by Cheeger and Colding using Reifenberg method. In this note, we show that a desired diffeomorphism can be constructed canonically. Let $\{f_i\}_{i=1}^{n+1}$ be the first $(n+1)$-eigenfunctions of $(M, g)$ and $f=(f_1, f_2, \cdots, f_{n+1})$. Then the map $\tilde{f}=\frac{f}{|f|}: M \to S^n$ provides a diffeomorphism, and $\tilde{f}$ satisfies a uniform bi-H\"older estimate. We further show that this bi-H\"older estimate is sharp and cannot be improved to a bi-Lipschitz estimate. Our study could be considered as a continuation of the previous works of Colding and Petersen.


title: BFGS-ADMM for Large-Scale Distributed Optimization

abstract: We consider a class of distributed optimization problem where the objective function consists of a sum of strongly convex and smooth functions and a (possibly nonsmooth) convex regularizer. A multi-agent network is assumed, where each agent holds a private cost function and cooperates with its neighbors to compute the optimum of the aggregate objective. We propose a quasi-Newton Alternating Direction Method of Multipliers (ADMM) where the primal update is solved inexactly with approximated curvature information. By introducing an intermediate consensus variable, we achieve a block diagonal Hessian which eliminates the need for inner communication loops within the network when computing the update direction. We establish global linear convergence to the optimal primal-dual solution without the need for backtracking line search, under the assumption that component cost functions are strongly convex with Lipschitz continuous gradients. Numerical simulations on real datasets demonstrate the advantages of the proposed method over state of the art.


title: Unsupervised Landmark Detection Based Spatiotemporal Motion Estimation for 4D Dynamic Medical Images

abstract: Motion estimation is a fundamental step in dynamic medical image processing for the assessment of target organ anatomy and function. However, existing image-based motion estimation methods, which optimize the motion field by evaluating the local image similarity, are prone to produce implausible estimation, especially in the presence of large motion. In this study, we provide a novel motion estimation framework of Dense-Sparse-Dense (DSD), which comprises two stages. In the first stage, we process the raw dense image to extract sparse landmarks to represent the target organ anatomical topology and discard the redundant information that is unnecessary for motion estimation. For this purpose, we introduce an unsupervised 3D landmark detection network to extract spatially sparse but representative landmarks for the target organ motion estimation. In the second stage, we derive the sparse motion displacement from the extracted sparse landmarks of two images of different time points. Then, we present a motion reconstruction network to construct the motion field by projecting the sparse landmarks displacement back into the dense image domain. Furthermore, we employ the estimated motion field from our two-stage DSD framework as initialization and boost the motion estimation quality in light-weight yet effective iterative optimization. We evaluate our method on two dynamic medical imaging tasks to model cardiac motion and lung respiratory motion, respectively. Our method has produced superior motion estimation accuracy compared to existing comparative methods. Besides, the extensive experimental results demonstrate that our solution can extract well representative anatomical landmarks without any requirement of manual annotation. Our code is publicly available online.


title: Secure Machine Learning over Relational Data

abstract: A closer integration of machine learning and relational databases has gained steam in recent years due to the fact that the training data to many ML tasks is the results of a relational query (most often, a join-select query). In a federated setting, this poses an additional challenge, that the tables are held by different parties as their private data, and the parties would like to train the model without having to use a trusted third party. Existing work has only considered the case where the training data is stored in a flat table that has been vertically partitioned, which corresponds to a simple PK-PK join. In this paper, we describe secure protocols to compute the join results of multiple tables conforming to a general foreign-key acyclic schema, and how to feed the results in secret-shared form to a secure ML toolbox. Furthermore, existing secure ML systems reveal the PKs in the join results. We strengthen the privacy protection to higher levels and achieve zero information leakage beyond the trained model. If the model itself is considered sensitive, we show how differential privacy can be incorporated into our framework to also prevent the model from breaching individuals' privacy.


title: Constant-Cost Spatio-Angular Prefiltering of Glinty Appearance Using Tensor Decomposition

abstract: The detailed glinty appearance from complex surface microstructures enhances the level of realism, but is both space- and time-consuming to render, especially when viewed from far away (large spatial coverage) and/or illuminated by area lights (large angular coverage). In this paper, we formulate the glinty appearance rendering process as a spatio-angular range query problem of the Normal Distribution Functions (NDFs), and introduce an efficient spatio-angular prefiltering solution to it. We start by exhaustively precomputing all possible NDFs with differently sized positional coverages. Then we compress the precomputed data using tensor rank decomposition, which enables accurate and fast angular range queries. With our spatio-angular prefiltering scheme, we are able to solve both the storage and performance issues at the same time, leading to efficient rendering of glinty appearance with both constant storage and constant performance, regardless of the range of spatio-angular queries. Finally, we demonstrate that our method easily applies to practical rendering applications that were traditionally considered difficult. For example, efficient bidirectional reflection distribution function (BRDF) evaluation accurate NDF importance sampling, fast global illumination between glinty objects, high-frequency preserving rendering with environment lighting, and tile-based synthesis of glinty appearance.


title: Cosmic Flow Measurement and Mock Sampling Algorithm of Cosmicflows-4 Tully-Fisher Catalogue

abstract: Measurements of cosmic flows enable us to test whether cosmological models can accurately describe the evolution of the density field in the nearby Universe. In this paper, we measure the low-order kinematic moments of the cosmic flow field, namely bulk flow and shear moments, using the Cosmicflows-4 Tully-Fisher catalogue (CF4TF). To make accurate cosmological inferences with the CF4TF sample, it is important to make realistic mock catalogues. We present the mock sampling algorithm of CF4TF. These mock can accurately realize the survey geometry and luminosity selection function, enabling researchers to explore how these systematics affect the measurements. These mocks can also be further used to estimate the covariance matrix and errors of power spectrum and two-point correlation function in future work. In this paper, we use the mocks to test the cosmic flow estimator and find that the measurements are unbiased. The measured bulk flow in the local Universe is 376 $\pm$ 23 (error) $\pm$ 183 (cosmic variance) km s$^{-1}$ at depth $d_{\text{MLE}}=35$ Mpc $h^{-1}$, to the Galactic direction of $(l,b)=(298\pm 3^{\circ}, -6\pm 3^{\circ})$. Both the measured bulk and shear moments are consistent with the concordance $\Lambda$ Cold Dark Matter cosmological model predictions.


title: Graphical translating solitons for the mean curvature flow and isoparametric functions

abstract: In this paper, we consider a translating soliton for the mean curvature flow starting from a graph of a function on a domain in a unit sphere which is constant along each leaf of isoparametric foliation. First, we show that such a function is given as a composition of an isoparametric function on the sphere and a function which is given as a solution of a certain ordinary differential equation. Further, we analyze the shape of the graphs of the solutions of the ordinary differential equation. This analysis leads to the classification of the shape of such translating solitons. Finally, we investigate a domain of the function which is given as a composition of the isoparametric function and the solution of the ordinary differential equation in the case where the number of distinct principal curvatures of the isoparametric hypersurface defined by the regular level set for the isoparametric function is 1, 2, or 3.


title: Extended double covers of non-symmetric association schemes of class $2$

abstract: In this paper, we give a method to construct non-symmetric association schemes of class $3$ from non-symmetric association schemes of class $2$. This construction is a non-symmetric analogue of the construction of Taylor graphs as an antipodal double cover of a complete graph. We also mention how our construction interact with doubling introduced by Pasechnik.


title: Surveillance Evasion Through Bayesian Reinforcement Learning

abstract: We consider a task of surveillance-evading path-planning in a continuous setting. An Evader strives to escape from a 2D domain while minimizing the risk of detection (and immediate capture). The probability of detection is path-dependent and determined by the spatially inhomogeneous surveillance intensity, which is fixed but a priori unknown and gradually learned in the multi-episodic setting. We introduce a Bayesian reinforcement learning algorithm that relies on a Gaussian Process regression (to model the surveillance intensity function based on the information from prior episodes), numerical methods for Hamilton-Jacobi PDEs (to plan the best continuous trajectories based on the current model), and Confidence Bounds (to balance the exploration vs exploitation). We use numerical experiments and regret metrics to highlight the significant advantages of our approach compared to traditional graph-based algorithms of reinforcement learning.


title: Using Blockchain to Achieve Decentralized Privacy In IoT Healthcare

abstract: With the advent of the Internet of Things (IoT), e-health has become one of the main topics of research. Due to the sensitivity of patient information, patient privacy seems challenging. Nowadays, patient data is usually stored in the cloud in healthcare programs, making it difficult for users to have enough control over their data. The recent increment in announced cases of security and surveillance breaches compromising patients' privacy call into question the conventional model, in which third-parties gather and control immense amounts of patients' Healthcare data. In this work, we try to resolve the issues mentioned above by using blockchain technology. We propose a blockchain-based protocol suitable for e-health applications that does not require trust in a third party and provides an efficient privacy-preserving access control mechanism. Transactions in our proposed system, unlike Bitcoin, are not entirely financial, and we do not use conventional methods for consensus operations in blockchain like Proof of Work (PoW). It is not suitable for IoT applications because IoT devices have resources-constraints. Usage of appropriate consensus method helps us to increase network security and efficiency, as well as reducing network cost, i.e., bandwidth and processor usage. Finally, we provide security and privacy analysis of our proposed protocol.


title: GT U-Net: A U-Net Like Group Transformer Network for Tooth Root Segmentation

abstract: To achieve an accurate assessment of root canal therapy, a fundamental step is to perform tooth root segmentation on oral X-ray images, in that the position of tooth root boundary is significant anatomy information in root canal therapy evaluation. However, the fuzzy boundary makes the tooth root segmentation very challenging. In this paper, we propose a novel end-to-end U-Net like Group Transformer Network (GT U-Net) for the tooth root segmentation. The proposed network retains the essential structure of U-Net but each of the encoders and decoders is replaced by a group Transformer, which significantly reduces the computational cost of traditional Transformer architectures by using the grouping structure and the bottleneck structure. In addition, the proposed GT U-Net is composed of a hybrid structure of convolution and Transformer, which makes it independent of pre-training weights. For optimization, we also propose a shape-sensitive Fourier Descriptor (FD) loss function to make use of shape prior knowledge. Experimental results show that our proposed network achieves the state-of-the-art performance on our collected tooth root segmentation dataset and the public retina dataset DRIVE. Code has been released at https://github.com/Kent0n-Li/GT-U-Net.


title: Rapid GPU-Assisted Search and Parameterization-Based Refinement and Continuation of Connections between Tori in Periodically Perturbed Planar Circular Restricted 3-Body Problems

abstract: When the planar circular restricted 3-body problem (PCRTBP) is periodically perturbed, as occurs in many useful astrodynamics models, most unstable periodic orbits persist as whiskered tori. Intersections between stable and unstable manifolds of such tori provide natural heteroclinic pathways enabling spacecraft to greatly modify their orbits without using propellant. However, the 2D Poincar\'e sections used in PCRTBP studies no longer work to find these intersections. Thus, in this study, we develop new fast methods to search for and compute such heteroclinics. First, the dynamics are used to restrict the intersection search to only certain manifold subsets, greatly reducing the required computational effort. Next, we present a massively parallel procedure for carrying out this search by representing the manifolds as discrete meshes and adapting methods from computer graphics collision detection algorithms. Implementing the method in Julia and OpenCL, we obtain a 5-7x speedup by leveraging GPUs versus CPU-only execution. Finally, we show how to use manifold parameterizations to refine the approximate intersections found in the mesh search to very high accuracy, as well as to numerically continue the connections through families of tori; the families' Whitney differentiability enables interpolation of needed parameterizations. The ability to very rapidly find a heteroclinic intersection between tori of fixed frequencies thus allows the systematic exploration of intersections for tori of nearby frequencies as well, yielding a variety of potential zero-fuel spacecraft trajectories. We demonstrate the tools on the Jupiter-Europa planar elliptic RTBP.


title: Computation and Analysis of Jupiter-Europa and Jupiter-Ganymede Resonant Orbits in the Planar Concentric Circular Restricted 4-Body Problem

abstract: Many unstable periodic orbits of the planar circular restricted 3-body problem (PCRTBP) persist as invariant tori when a periodic forcing is added to the equations of motion. In this study, we compute tori corresponding to exterior Jupiter-Europa and interior Jupiter-Ganymede PCRTBP resonant periodic orbits in a concentric circular restricted 4-body problem (CCR4BP). Motivated by the 2:1 Laplace resonance between Europa and Ganymede's orbits, we then attempt the continuation of a Jupiter-Europa 3:4 resonant orbit from the CCR4BP into the Jupiter-Ganymede PCRTBP. We strongly believe that the resulting dynamical object is a KAM torus lying near but not on the 3:2 Jupiter-Ganymede resonance.