title: Non-Abelian gauge invariance from dynamical decoupling

abstract: Lattice gauge theories are fundamental to such distinct fields as particle physics, condensed matter or quantum information theory. The recent progress in the control of artificial quantum systems already allows for studying Abelian lattice gauge theories in table-top experiments. However, the realization of non-Abelian models remains challenging. Here, we employ a coherent quantum control scheme to enforce non-Abelian gauge invariance, and discuss this idea in detail for a one dimensional SU(2) lattice gauge system. Finally, we comment on how to extend our scheme to other non-Abelian gauge symmetries and higher spatial dimensions, which summarized, provides a promising route for the quantum simulation of non-Abelian lattice gauge theories.


title: BeBold: Exploration Beyond the Boundary of Explored Regions

abstract: Efficient exploration under sparse rewards remains a key challenge in deep reinforcement learning. To guide exploration, previous work makes extensive use of intrinsic reward (IR). There are many heuristics for IR, including visitation counts, curiosity, and state-difference. In this paper, we analyze the pros and cons of each method and propose the regulated difference of inverse visitation counts as a simple but effective criterion for IR. The criterion helps the agent explore Beyond the Boundary of explored regions and mitigates common issues in count-based methods, such as short-sightedness and detachment. The resulting method, BeBold, solves the 12 most challenging procedurally-generated tasks in MiniGrid with just 120M environment steps, without any curriculum learning. In comparison, the previous SoTA only solves 50% of the tasks. BeBold also achieves SoTA on multiple tasks in NetHack, a popular rogue-like game that contains more challenging procedurally-generated environments.


title: Smart Mobility Ontology: Current Trends and Future Directions

abstract: Ontology is the explicit and formal representation of the concepts in a domain and relations among them. Transportation science is a wide domain dealing with mobility over various complex and interconnected transportation systems, such as land, aviation, and maritime transport, and can take considerable advantage from ontology development. While several studies can be found in the recent literature, there exists a large potential to improve and develop a comprehensive smart mobility ontology. The current chapter aims to present different aspects of ontology development in general, such as ontology development methods, languages, tools, and software. Subsequently, it presents the currently available mobility-related ontologies developed across different domains, such as transportation, smart cities, goods mobility, sensors. Current gaps in the available ontologies are identified, and future directions regarding ontology development are proposed that can incorporate the forthcoming autonomous and connected vehicles, mobility as a service (MaaS), and other disruptive transportation technologies and services.


title: Evolved Massive Stars at Low-metallicity III. A Source Catalog for the Large Magellanic Cloud

abstract: We present a clean, magnitude-limited (IRAC1 or WISE1$\leq$15.0 mag) multiwavelength source catalog for the LMC. The catalog was built upon crossmatching ($1''$) and deblending ($3''$) between the SEIP source list and Gaia DR2, with strict constraints on the Gaia astrometric solution to remove the foreground contamination. The catalog contains 197,004 targets in 52 different bands including 2 ultraviolet, 21 optical, and 29 infrared bands. Additional information about radial velocities and spectral/photometric classifications were collected from the literature. The bright end of our sample is mostly comprised of blue helium-burning stars (BHeBs) and red HeBs with inevitable contamination of main sequence stars at the blue end. After applying modified magnitude and color cuts based on previous studies, we identify and rank 2,974 RSG, 508 YSG, and 4,786 BSG candidates in the LMC in six CMDs. The comparison between the CMDs of the LMC and SMC indicates that the most distinct difference appears at the bright red end of the optical and near-infrared CMDs, where the cool evolved stars (e.g., RSGs, AGB, and RGs) are located, which is likely due to the effect of metallicity and SFH. Further quantitative comparison of colors of massive star candidates in equal absolute magnitude bins suggests that, there is basically no difference for the BSG candidates, but large discrepancy for the RSG candidates as LMC targets are redder than the SMC ones, which may be due to the combined effect of metallicity on both spectral type and mass-loss rate, and also the age effect. The $T_{\rm eff}$ of massive star populations are also derived from reddening-free color of $(J-K_{\rm S})_0$. The $T_{\rm eff}$ ranges are $3500<T_{\rm eff}<5000$ K for RSG population, $5000<T_{\rm eff}<8000$ K for YSG population, and $T_{\rm eff}>8000$ K for BSG population, with larger uncertainties towards the hotter stars.


title: Post-Hurricane Damage Assessment Using Satellite Imagery and Geolocation Features

abstract: Gaining timely and reliable situation awareness after hazard events such as a hurricane is crucial to emergency managers and first responders. One effective way to achieve that goal is through damage assessment. Recently, disaster researchers have been utilizing imagery captured through satellites or drones to quantify the number of flooded/damaged buildings. In this paper, we propose a mixed data approach, which leverages publicly available satellite imagery and geolocation features of the affected area to identify damaged buildings after a hurricane. The method demonstrated significant improvement from performing a similar task using only imagery features, based on a case study of Hurricane Harvey affecting Greater Houston area in 2017. This result opens door to a wide range of possibilities to unify the advancement in computer vision algorithms such as convolutional neural networks and traditional methods in damage assessment, for example, using flood depth or bare-earth topology. In this work, a creative choice of the geolocation features was made to provide extra information to the imagery features, but it is up to the users to decide which other features can be included to model the physical behavior of the events, depending on their domain knowledge and the type of disaster. The dataset curated in this work is made openly available (DOI: 10.17603/ds2-3cca-f398).


title: Learning Prediction Intervals for Model Performance

abstract: Understanding model performance on unlabeled data is a fundamental challenge of developing, deploying, and maintaining AI systems. Model performance is typically evaluated using test sets or periodic manual quality assessments, both of which require laborious manual data labeling. Automated performance prediction techniques aim to mitigate this burden, but potential inaccuracy and a lack of trust in their predictions has prevented their widespread adoption. We address this core problem of performance prediction uncertainty with a method to compute prediction intervals for model performance. Our methodology uses transfer learning to train an uncertainty model to estimate the uncertainty of model performance predictions. We evaluate our approach across a wide range of drift conditions and show substantial improvement over competitive baselines. We believe this result makes prediction intervals, and performance prediction in general, significantly more practical for real-world use.


title: Computation Against a Neighbour: Addressing Large-Scale Distribution and Adaptivity with Functional Programming and Scala

abstract: Recent works in contexts like the Internet of Things (IoT) and large-scale Cyber-Physical Systems (CPS) propose the idea of programming distributed systems by focussing on their global behaviour across space and time. In this view, a potentially vast and heterogeneous set of devices is considered as an "aggregate" to be programmed as a whole, while abstracting away the details of individual behaviour and exchange of messages, which are expressed declaratively. One such a paradigm, known as aggregate programming, builds on computational models inspired by field-based coordination. Existing models such as the field calculus capture interaction with neighbours by a so-called "neighbouring field" (a map from neighbours to values). This requires ad-hoc mechanisms to smoothly compose with standard values, thus complicating programming and introducing clutter in aggregate programs, libraries and domain-specific languages (DSLs). To address this key issue we introduce the novel notion of "computation against a neighbour", whereby the evaluation of certain subexpressions of the aggregate program are affected by recent corresponding evaluations in neighbours. We capture this notion in the neighbours calculus (NC), a new field calculus variant which is shown to smoothly support declarative specification of interaction with neighbours, and correspondingly facilitate the embedding of field computations as internal DSLs in common general-purpose programming languages -- as exemplified by a Scala implementation, called ScaFi. This paper formalises NC, thoroughly compares it with respect to the classic field calculus, and shows its expressiveness by means of a case study in edge computing, developed in ScaFi.


title: Conformal Minimal Foliations on Semi-Riemannian Lie Groups

abstract: We study left-invariant foliations ${\mathcal F}$ on semi-Riemannian Lie groups $G$ generated by a subgroup $K$. We are interested in such foliations which are conformal and with minimal leaves of codimension two. We classify such foliations ${\mathcal F}$ when the subgroup $K$ is one of the important $\text{SU}(2)$, $\text{SL}_{2}(\mathbb R)$, $\text{SU}(2)\times\text{SU}(2)$, $\text{SU}(2)\times\text{SL}_{2}(\mathbb R)$, $\text{SU}(2)\times\text{SO}(2)$, $\text{SL}_{2}(\mathbb R)\times\text{SU}(2)$. This way we construct new multi-dimensional families of Lie groups $G$ carrying such foliations in each case. These foliations ${\mathcal F}$ produce local complex-valued harmonic morphisms on the corresponding Lie group $G$.


title: Weighted K-stability of polarized varieties and extremality of Sasaki manifolds

abstract: We use the correspondence between extremal Sasaki structures and weighted extremal Kahler metrics defined on a regular quotient of a Sasaki manifold, established by the first two authors, and Lahdili's theory of weighted K-stability in order to define a suitable notion of (relative) weighted K-stability for compact Sasaki manifolds of regular type. We show that the (relative) weighted K-stability with respect to a maximal torus is a necessary condition for the existence of a (possibly irregular) extremal Sasaki metric. We also compare weighted K-stability to the K-stability of the corresponding polarized affine cone (introduced by Collins-Szekelyhidi), and prove that they agree on the class of test configurations we consider. As a byproduct, we strengthen the obstruction to the existence of a scalar-flat Kahler cone metric from the K-semistability to the K-stability on these test configurations. We use our approach to give a characterization of the existence of a compatible extremal Sasaki structure on a principal circle bundle over an admissible ruled manifold, expressed in terms of the positivity of a single polynomial of one variable over a given interval.


title: Does Concentration Drive the Scatter in the Stellar-to-Halo Mass Relation of Galaxy Clusters?

abstract: Concentration is one of the key dark matter halo properties that could drive the scatter in the stellar-to-halo mass relation of massive clusters. We derive robust photometric stellar masses for a sample of brightest central galaxies (BCGs) in SDSS redMaPPer clusters at $0.17<z<0.3$, and split the clusters into two equal-halo mass subsamples by their BCG stellar mass $M_*$. The weak lensing profiles $\Delta\Sigma$ of the two cluster subsamples exhibit different slopes on scales below 1 M$pc/h$. To interpret such discrepancy, we perform a comprehensive Bayesian modelling of the two $\Delta\Sigma$ profiles by including different levels of miscentring effects between the two subsamples as informed by X-ray observations. We find that the two subsamples have the same average halo mass of $1.74 \times 10^{14} M_{\odot}/h$, but the concentration of the low-$M_*$ clusters is $5.87_{-0.60}^{+0.77}$, ${\sim}1.5\sigma$ smaller than that of their high-$M_*$ counterparts~($6.95_{-0.66}^{+0.78}$). Furthermore, both cluster weak lensing and cluster-galaxy cross-correlations indicate that the large-scale bias of the low-$M_*$, low-concentration clusters are ${\sim}10\%$ higher than that of the high-$M_*$, high-concentration systems, hence possible evidence of the cluster assembly bias effect. Our results reveal a remarkable physical connection between the stellar mass within 20{-}30 k$pc/h$, the dark matter mass within ${\sim}$ 200 k$pc/h$, and the cosmic overdensity on scales above 10 M$pc/h$, enabling a key observational test of theories of co-evolution between massive clusters and their central galaxies.


title: Open Problems in Cooperative AI

abstract: Problems of cooperation--in which agents seek ways to jointly improve their welfare--are ubiquitous and important. They can be found at scales ranging from our daily routines--such as driving on highways, scheduling meetings, and working collaboratively--to our global challenges--such as peace, commerce, and pandemic preparedness. Arguably, the success of the human species is rooted in our ability to cooperate. Since machines powered by artificial intelligence are playing an ever greater role in our lives, it will be important to equip them with the capabilities necessary to cooperate and to foster cooperation. We see an opportunity for the field of artificial intelligence to explicitly focus effort on this class of problems, which we term Cooperative AI. The objective of this research would be to study the many aspects of the problems of cooperation and to innovate in AI to contribute to solving these problems. Central goals include building machine agents with the capabilities needed for cooperation, building tools to foster cooperation in populations of (machine and/or human) agents, and otherwise conducting AI research for insight relevant to problems of cooperation. This research integrates ongoing work on multi-agent systems, game theory and social choice, human-machine interaction and alignment, natural-language processing, and the construction of social tools and platforms. However, Cooperative AI is not the union of these existing areas, but rather an independent bet about the productivity of specific kinds of conversations that involve these and other areas. We see opportunity to more explicitly focus on the problem of cooperation, to construct unified theory and vocabulary, and to build bridges with adjacent communities working on cooperation, including in the natural, social, and behavioural sciences.


title: Edge-Minimum Saturated k-Planar Drawings

abstract: For a class $\mathcal{D}$ of drawings of loopless (multi-)graphs in the plane, a drawing $D \in \mathcal{D}$ is \emph{saturated} when the addition of any edge to $D$ results in $D' \notin \mathcal{D}$ - this is analogous to saturated graphs in a graph class as introduced by Tur\'an (1941) and Erd\H{o}s, Hajnal, and Moon (1964). We focus on $k$-planar drawings, that is, graphs drawn in the plane where each edge is crossed at most $k$ times, and the classes $\mathcal{D}$ of all $k$-planar drawings obeying a number of restrictions, such as having no crossing incident edges, no pair of edges crossing more than once, or no edge crossing itself. While saturated $k$-planar drawings are the focus of several prior works, tight bounds on how sparse these can be are not well understood. We establish a generic framework to determine the minimum number of edges among all $n$-vertex saturated $k$-planar drawings in many natural classes. For example, when incident crossings, multicrossings and selfcrossings are all allowed, the sparsest $n$-vertex saturated $k$-planar drawings have $\frac{2}{k - (k \bmod 2)} (n-1)$ edges for any $k \geq 4$, while if all that is forbidden, the sparsest such drawings have $\frac{2(k+1)}{k(k-1)}(n-1)$ edges for any $k \geq 6$.


title: Orientation Ramsey thresholds for cycles and cliques

abstract: If $G$ is a graph and $\vec H$ is an oriented graph, we write $G\to \vec H$ to say that every orientation of the edges of $G$ contains $\vec H$ as a subdigraph. We consider the case in which $G=G(n,p)$, the binomial random graph. We determine the threshold $p_{\vec H}=p_{\vec H}(n)$ for the property $G(n,p)\to \vec H$ for the cases in which $\vec H$ is an acyclic orientation of a complete graph or of a cycle.


title: Cubes and adjoints of cross-polytopes

abstract: We describe a bijection between oriented cubes and adjoints of cross-polytopes. This correspondence is used to prove that the real affine cube is, up to reorientation in the same class, the unique oriented cube that is realizable. Moreover, its underlying matroid is, up to isomorphism, the unique combinatorial cube that is realizable over the reals.


title: The SAMI Galaxy Survey: Kinematics of stars and gas in brightest group galaxies; the role of group dynamics

abstract: We study the stellar and gas kinematics of the brightest group galaxies (BGGs) in dynamically relaxed and unrelaxed galaxy groups for a sample of 154 galaxies in the SAMI galaxy survey. We characterize the dynamical state of the groups using the luminosity gap between the two most luminous galaxies and the BGG offset from the luminosity centroid of the group. We find that the misalignment between the rotation axis of gas and stellar components is more frequent in the BGGs in unrelaxed groups, although with quite low statistical significance. Meanwhile galaxies whose stellar dynamics would be classified as `regular rotators' based on their kinemetry are more common in relaxed groups. We confirm that this dependency on group dynamical state remains valid at fixed stellar mass and Sersic index. The observed trend could potentially originate from a differing BGG accretion history in virialised and evolving groups. Amongst the halo relaxation probes, the group BGG offset appears to play a stronger role than the luminosity gap on the stellar kinematic differences of the BGGs. However, both the group BGG offset and luminosity gap appear to roughly equally drive the misalignment between the gas and stellar component of the BGGs in one direction. This study offers the first evidence that the dynamical state of galaxy groups may influence the BGG's stellar and gas kinematics and calls for further studies using a larger sample with higher signal-to-noise.


title: Analysis of obstacles immersed in viscous fluids using Brinkman's law for steady Stokes and Navier-Stokes equations

abstract: From the steady Stokes and Navier-Stokes models, a penalization method has been considered by several authors for approximating those fluid equations around obstacles. In this work, we present a justification for using fictitious domains to study obstacles immersed in incompressible viscous fluids through a simplified version of Brinkman's law for porous media. If the scalar function $\psi$ is considered as the inverse of permeability, it is possible to study the singularities of $\psi$ as approximations of obstacles (when $\psi$ tends to $\infty$) or of the domain corresponding to the fluid (when $\psi = 0$ or is very close to $0$). The strong convergence of the solution of the perturbed problem to the solution of the strong problem is studied, also considering error estimates that depend on the penalty parameter, both for fluids modeled with the Stokes and Navier-Stokes equations with inhomogeneous boundary conditions. A numerical experiment is presented that validates this result and allows to study the application of this perturbed problem simulation of flows and the identification of obstacles.


title: Planar Silicon Metamaterial Lenslet Arrays for Millimeter-wavelength Imaging

abstract: Large imaging arrays of detectors at millimeter and submillimeter wavelengths have applications that include measurements of the faint polarization signal in the Cosmic Microwave Background (CMB), and submillimeter astrophysics. We are developing planar lenslet arrays for millimeter-wavelength imaging using metamaterials microlithically fabricated using silicon wafers. This metamaterial technology has many potential advantages compared to conventional hemispherical lenslet arrays, including high precision and homogeneity, planar integrated anti-reflection layers, and a coefficient of thermal expansion matched to the silicon detector wafer. Here we describe the design process for a gradient-index (GRIN) metamaterial lenslet using metal-mesh patterned on silicon and a combination of metal-mesh and etched-hole metamaterial anti-reflection layers. We optimize the design using a bulk-material model to rapidly simulate and iterate on the lenslet design. We fabricated prototype GRIN metamaterial lenslet array and mounted it on a Polarbear/Simons Array 90/150~GHz band transition edge sensor (TES) bolometer detector array with sinuous planar antennas. Beam measurements of a prototype lenslet array agree reasonably well with the model simulations. We plan to further optimize the design and combine it with a broadband anti-reflection coating to achieve operation over 70--350~GHz bandwidth.


title: Multi-Modal Anomaly Detection for Unstructured and Uncertain Environments

abstract: To achieve high-levels of autonomy, modern robots require the ability to detect and recover from anomalies and failures with minimal human supervision. Multi-modal sensor signals could provide more information for such anomaly detection tasks; however, the fusion of high-dimensional and heterogeneous sensor modalities remains a challenging problem. We propose a deep learning neural network: supervised variational autoencoder (SVAE), for failure identification in unstructured and uncertain environments. Our model leverages the representational power of VAE to extract robust features from high-dimensional inputs for supervised learning tasks. The training objective unifies the generative model and the discriminative model, thus making the learning a one-stage procedure. Our experiments on real field robot data demonstrate superior failure identification performance than baseline methods, and that our model learns interpretable representations. Videos of our results are available on our website: https://sites.google.com/illinois.edu/supervised-vae .


title: High-Power Near-Concentric Fabry-Perot Cavity for Phase Contrast Electron Microscopy

abstract: Transmission electron microscopy (TEM) of vitrified biological macromolecules (cryo-EM) is limited by the weak phase contrast signal that is available from such samples. Using a phase plate would thus substantially improve the signal-to-noise ratio. We have previously demonstrated the use of a high-power Fabry-Perot cavity as a phase plate for TEM. We now report improvements to our laser cavity that allow us to achieve record continuous-wave intensities of over 450 GW/cm$^{2}$, sufficient to produce the optimal 90{\deg} phase shift for 300 keV electrons. In addition, we have performed the first cryo-EM reconstruction using a laser phase plate, demonstrating that the stability of this laser phase plate is sufficient for use during standard cryo-EM data collection.


title: Sparsity-driven Digital Terrain Model Extraction

abstract: We here introduce an automatic Digital Terrain Model (DTM) extraction method. The proposed sparsity-driven DTM extractor (SD-DTM) takes a high-resolution Digital Surface Model (DSM) as an input and constructs a high-resolution DTM using the variational framework. To obtain an accurate DTM, an iterative approach is proposed for the minimization of the target variational cost function. Accuracy of the SD-DTM is shown in a real-world DSM data set. We show the efficiency and effectiveness of the approach both visually and quantitatively via residual plots in illustrative terrain types.


title: Spectral band selection for vegetation properties retrieval using Gaussian processes regression

abstract: With current and upcoming imaging spectrometers, automated band analysis techniques are needed to enable efficient identification of most informative bands to facilitate optimized processing of spectral data into estimates of biophysical variables. This paper introduces an automated spectral band analysis tool (BAT) based on Gaussian processes regression (GPR) for the spectral analysis of vegetation properties. The GPR-BAT procedure sequentially backwards removes the least contributing band in the regression model for a given variable until only one band is kept. GPR-BAT is implemented within the framework of the free ARTMO's MLRA (machine learning regression algorithms) toolbox, which is dedicated to the transforming of optical remote sensing images into biophysical products. GPR-BAT allows (1) to identify the most informative bands in relating spectral data to a biophysical variable, and (2) to find the least number of bands that preserve optimized accurate predictions. This study concludes that a wise band selection of hyperspectral data is strictly required for optimal vegetation properties mapping.


title: A grid-point detection method based on U-net for a structured light system

abstract: Accurate detection of the feature points of the projected pattern plays an extremely important role in one-shot 3D reconstruction systems, especially for the ones using a grid pattern. To solve this problem, this paper proposes a grid-point detection method based on U-net. A specific dataset is designed that includes the images captured with the two-shot imaging method and the ones acquired with the one-shot imaging method. Among them, the images in the first group after labeled as the ground truth images and the images captured at the same pose with the one-shot method are cut into small patches with the size of 64x64 pixels then feed to the training set. The remaining of the images in the second group is the test set. The experimental results show that our method can achieve a better detecting performance with higher accuracy in comparison with the previous methods.


title: Does the dataset meet your expectations? Explaining sample representation in image data

abstract: Since the behavior of a neural network model is adversely affected by a lack of diversity in training data, we present a method that identifies and explains such deficiencies. When a dataset is labeled, we note that annotations alone are capable of providing a human interpretable summary of sample diversity. This allows explaining any lack of diversity as the mismatch found when comparing the \textit{actual} distribution of annotations in the dataset with an \textit{expected} distribution of annotations, specified manually to capture essential label diversity. While, in many practical cases, labeling (samples $\rightarrow$ annotations) is expensive, its inverse, simulation (annotations $\rightarrow$ samples) can be cheaper. By mapping the expected distribution of annotations into test samples using parametric simulation, we present a method that explains sample representation using the mismatch in diversity between simulated and collected data. We then apply the method to examine a dataset of geometric shapes to qualitatively and quantitatively explain sample representation in terms of comprehensible aspects such as size, position, and pixel brightness.


title: Enabling Collaborative Video Sensing at the Edge through Convolutional Sharing

abstract: While Deep Neural Network (DNN) models have provided remarkable advances in machine vision capabilities, their high computational complexity and model sizes present a formidable roadblock to deployment in AIoT-based sensing applications. In this paper, we propose a novel paradigm by which peer nodes in a network can collaborate to improve their accuracy on person detection, an exemplar machine vision task. The proposed methodology requires no re-training of the DNNs and incurs minimal processing latency as it extracts scene summaries from the collaborators and injects back into DNNs of the reference cameras, on-the-fly. Early results show promise with improvements in recall as high as 10% with a single collaborator, on benchmark datasets.


title: Effects of Magnetic And Aharanov-Bohm (AB) Fields on the Energy Spectra of the Yukawa Potential

abstract: In this article, the Yukawa potential is scrutinized taking into consideration the effects of magnetic and AB flux fields within the non-relativistic regime using the factorization method. The energy equation and wave function of the system are obtained in close form. We find that the all-encompassing effects result in a strongly attractive system and consequently there is a significant upward shift in the bound state energy of the system. We also find that to achieve a low-energy medium for the Yukawa potential, weak magnetic field is required, however the AB flux field can be used as a controller. The magnetic and AB fields eliminates the degeneracy from the spectra. From our findings, it could be concluded that to manipulate the energy spectra of this system, the AB-flux and magnetic field will do so greatly. The results from this study can be applied in condensed matter physics, atomic and molecular physics.


title: An anatomically-informed 3D CNN for brain aneurysm classification with weak labels

abstract: A commonly adopted approach to carry out detection tasks in medical imaging is to rely on an initial segmentation. However, this approach strongly depends on voxel-wise annotations which are repetitive and time-consuming to draw for medical experts. An interesting alternative to voxel-wise masks are so-called "weak" labels: these can either be coarse or oversized annotations that are less precise, but noticeably faster to create. In this work, we address the task of brain aneurysm detection as a patch-wise binary classification with weak labels, in contrast to related studies that rather use supervised segmentation methods and voxel-wise delineations. Our approach comes with the non-trivial challenge of the data set creation: as for most focal diseases, anomalous patches (with aneurysm) are outnumbered by those showing no anomaly, and the two classes usually have different spatial distributions. To tackle this frequent scenario of inherently imbalanced, spatially skewed data sets, we propose a novel, anatomically-driven approach by using a multi-scale and multi-input 3D Convolutional Neural Network (CNN). We apply our model to 214 subjects (83 patients, 131 controls) who underwent Time-Of-Flight Magnetic Resonance Angiography (TOF-MRA) and presented a total of 111 unruptured cerebral aneurysms. We compare two strategies for negative patch sampling that have an increasing level of difficulty for the network and we show how this choice can strongly affect the results. To assess whether the added spatial information helps improving performances, we compare our anatomically-informed CNN with a baseline, spatially-agnostic CNN. When considering the more realistic and challenging scenario including vessel-like negative patches, the former model attains the highest classification results (accuracy$\simeq$95\%, AUROC$\simeq$0.95, AUPR$\simeq$0.71), thus outperforming the baseline.


title: Unitary Cuntz semigroups of ideals and quotients

abstract: We define a notion of ideal for objects in the category of abstract unitary Cuntz semigroups introduced in [3] and termed Cu$^\sim$. We show that the set of ideals of a Cu$^\sim$-semigroup has a complete lattice structure. In fact, we prove that for any C$^*$-algebra of stable rank one $A$, the assignment $I\longmapsto$Cu$_1(I)$ defines a complete lattice isomorphism between the set of ideals of $A$ and the set of ideals of its unitary Cuntz semigroup Cu$_1(A)$. Further, we introduce a notion of quotients and exactness for the (non abelian) category Cu$^\sim$. We show that Cu$_1(A)/$Cu$_1(I)\simeq$ Cu$_1(A/I)$ for any ideal $I$ in $A$ and that the functor Cu$_1$ is exact. Finally, we link a Cu$^\sim$-semigroup with the Cu-semigroup of its positive elements and the abelian group of its maximal elements in a split-exact sequence. This result allows us to extract additional information that lies within the unitary Cuntz semigroup of a C$^*$-algebra of stable rank one.


title: Computation-free Nonparametric testing for Local and Global Spatial Autocorrelation with application to the Canadian Electorate

abstract: Measures of local and global spatial association are key tools for exploratory spatial data analysis. Many such measures exist including Moran's $I$, Geary's $C$, and the Getis-Ord $G$ and $G^*$ statistics. A parametric approach to testing for significance relies on strong assumptions, which are often not met by real world data. Alternatively, the most popular nonparametric approach, the permutation test, imposes a large computational burden especially for massive graphical networks. Hence, we propose a computation-free approach to nonparametric permutation testing for local and global measures of spatial autocorrelation stemming from generalizations of the Khintchine inequality from functional analysis and the theory of $L^p$ spaces. Our methodology is demonstrated on the results of the 2019 federal Canadian election in the province of Alberta. We recorded the percentage of the vote gained by the conservative candidate in each riding. This data is not normal, and the sample size is fixed at $n=34$ ridings making the parametric approach invalid. In contrast, running a classic permutation test for every riding, for multiple test statistics, with various neighbourhood structures, and multiple testing correction would require the simulation of millions of permutations. We are able to achieve similar statistical power on this dataset to the permutation test without the need for tedious simulation. We also consider data simulated across the entire electoral map of Canada.


title: Online Learning Demands in Max-min Fairness

abstract: We describe mechanisms for the allocation of a scarce resource among multiple users in a way that is efficient, fair, and strategy-proof, but when users do not know their resource requirements. The mechanism is repeated for multiple rounds and a user's requirements can change on each round. At the end of each round, users provide feedback about the allocation they received, enabling the mechanism to learn user preferences over time. Such situations are common in the shared usage of a compute cluster among many users in an organisation, where all teams may not precisely know the amount of resources needed to execute their jobs. By understating their requirements, users will receive less than they need and consequently not achieve their goals. By overstating them, they may siphon away precious resources that could be useful to others in the organisation. We formalise this task of online learning in fair division via notions of efficiency, fairness, and strategy-proofness applicable to this setting, and study this problem under three types of feedback: when the users' observations are deterministic, when they are stochastic and follow a parametric model, and when they are stochastic and nonparametric. We derive mechanisms inspired by the classical max-min fairness procedure that achieve these requisites, and quantify the extent to which they are achieved via asymptotic rates. We corroborate these insights with an experimental evaluation on synthetic problems and a web-serving task.


title: Effect of right censoring bias on survival analysis

abstract: Kaplan-Meier survival analysis represents the most objective measure of treatment efficacy in oncology, though subjected to potential bias, which is worrisome in an era of precision medicine. Independent of the bias inherent to the design and execution of clinical trials, bias may be the result of patient censoring, or incomplete observation. Unlike disease/progression free survival, overall survival is based on a well defined time point and thus avoids interval censoring, but right-censoring, due to incomplete follow-up, may still be a source of bias. We study three mechanisms of right-censoring and find that one of them, surrogate of patient lost to follow-up, is able to impact Kaplan-Meier survival, improving significantly the estimation of survival in comparison with complete follow-up datasets, as measured by the hazard ratio. We also present two bias indexes able to signal datasets with right-censoring associated overestimation of survival. These bias indexes can detect bias in public available datasets


title: Rigidity and Superfast Signal Propagation in Fluids and Solids in Non-Equilibrium Steady States

abstract: In the 1980s it was theoretically predicted that correlations of various observables in a fluid in a non-equilibrium steady state (NESS) are extraordinarily long-ranged, extending, in a well-defined sense, over the size of the system. This is to be contrasted with correlations in an equilibrium fluid, whose range is typically just a few particle diameters. These NESS correlations were later confirmed by numerous experimental studies. Unlike long-ranged correlations at critical points, these correlations are generic in the sense that they exist for any temperature as long as the system is in a NESS. In equilibrium systems, generic long-ranged correlations are caused by spontaneously broken continuous symmetries and are associated with a generalized rigidity, which in turn leads to a new propagating excitation or mode. For example, in a solid, spatial rigidity leads to transverse sound waves, while in a superfluid, phase rigidity leads to temperature waves known as second sound at finite temperatures, and phonons at zero temperature. More generally, long-ranged spatial correlations imply rigidity irrespective of their physical origin. This implies that a fluid in a NESS should also display a type of rigidity and related anomalous transport behavior. Here we show that this is indeed the case. For the particular case of a simple fluid in a constant temperature gradient, the anomalous transport behavior takes the form of a super-diffusive spread of a constant-pressure temperature perturbation. We also discuss the case of an elastic solid, where we predict a spread that is faster than ballistic.


title: FemtoSats for Exploring Permanently Shadowed Regions on the Moon

abstract: The recent, rapid advancement in space exploration is thanks to the accelerated miniaturization of electronics components on a spacecraft that is reducing the mass, volume and cost of satellites. Yet, access to space remains a distant dream as there is growing complexity in what is required of satellites and increasing space traffic. Interplanetary exploration is even harder and has limited possibilities for low cost mission. All of these factors make even CubeSats, the entry-level standard too expensive for most and therefore a better way needs to be found. The proposed solution in this report is a low-mass, low-cost, disposable solution that exploits the latest advances in electronics and is relatively easy to integrate: FemtoSats. FemtoSats are sub-100-gram spacecraft. The FemtoSat concept is based on launching a swarm where the main tasks are divided between the members of the swarm. This means that if one fails the swarm can take its place and therefore substitute it without risking the whole mission. In this paper we explore the utility of FemtoSats to perform first exploration and mapping of a Lunar PSR. This concept was recognized as finalist for the NASA BIG Competition in 2020. This is an example of a high-risk, high-reward mission where losing one FemtoSat does not mean the mission is in danger as it happens with regular satellite missions.


title: Selection of multiple donor gauges via Graphical Lasso for estimation of daily streamflow time series

abstract: A fundamental challenge in estimations of daily streamflow time series at sites with incomplete records is how to effectively and efficiently select reference or donor gauges from an existing gauge network to infer the missing data. While research on estimating missing streamflow time series is not new, the existing approaches either use a single reference streamflow gauge or employ a set of "ad-hoc" reference gauges, leaving a systematic selection of reference gauges as a long-standing open question. In this work, a novel method is introduced that facilitates systematical selection of multiple reference gauges from any given streamflow network. The idea is to mathematically characterize the network-wise correlation structure of a streamflow network via graphical Markov modeling, and further transforms a dense network into a sparsely connected one. The resulted underlying sparse graph from the graphical model encodes conditional independence conditions among all reference gauges from the streamflow network, allowing determination of an optimum subset of the donor gauges. The sparsity is discovered by using the Graphical Lasso algorithm with an L1-norm regularization parameter and a thresholding parameter. These two parameters are determined by a multi-objective optimization process. Furthermore, the graphical modeling approach is employed to solve another open problem in gauge removal planning decision (e.g., due to operation budget constraints): which gauges to remove would statistically guarantee the least loss of information by estimations from the remaining gauges? Our graphical model-based method is demonstrated with daily streamflow data from a network of 34 gauges over the Ohio River basin.


title: Optimization of Quantum-dot Qubit Fabrication via Machine Learning

abstract: Precise nanofabrication represents a critical challenge to developing semiconductor quantum-dot qubits for practical quantum computation. Here, we design and train a convolutional neural network to interpret in-line scanning electron micrographs and quantify qualitative features affecting device functionality. The high-throughput strategy is exemplified by optimizing a model lithographic process within a five-dimensional design space and by demonstrating a new approach to address lithographic proximity effects. The present results emphasize the benefits of machine learning for developing robust processes, shortening development cycles, and enforcing quality control during qubit fabrication.


title: Initial Design of a W-band Superconducting Kinetic Inductance Qubit (Kineticon)

abstract: Superconducting qubits are widely used in quantum computing research and industry. We describe a superconducting kinetic inductance qubit (and introduce the term Kineticon to describe it) operating at W-band frequencies with a nonlinear nanowire section that provides the anharmonicity required for two distinct quantum energy states. Operating the qubits at higher frequencies may relax the dilution refrigerator temperature requirements for these devices and paves the path for multiplexing a large number of qubits. Millimeter-wave operation requires superconductors with relatively high $T_c$, which implies high gap frequency, 2$\Delta/h$, beyond which photons break Cooper pairs. For example, NbTiN with $T_c =15\,\text{K}$ has a gap frequency near 1.4 THz, which is much higher than that of aluminum (90 GHz), allowing for operation throughout the millimeter-wave band. Here we describe a design and simulation of a W-band Kineticon qubit embedded in a 3-D cavity. We perform classical electromagnetic calculations of the resulting field distributions.


title: CUDA-Optimized real-time rendering of a Foveated Visual System

abstract: The spatially-varying field of the human visual system has recently received a resurgence of interest with the development of virtual reality (VR) and neural networks. The computational demands of high resolution rendering desired for VR can be offset by savings in the periphery, while neural networks trained with foveated input have shown perceptual gains in i.i.d and o.o.d generalization. In this paper, we present a technique that exploits the CUDA GPU architecture to efficiently generate Gaussian-based foveated images at high definition (1920x1080 px) in real-time (165 Hz), with a larger number of pooling regions than previous Gaussian-based foveation algorithms by several orders of magnitude, producing a smoothly foveated image that requires no further blending or stitching, and that can be well fit for any contrast sensitivity function. The approach described can be adapted from Gaussian blurring to any eccentricity-dependent image processing and our algorithm can meet demand for experimentation to evaluate the role of spatially-varying processing across biological and artificial agents, so that foveation can be added easily on top of existing systems rather than forcing their redesign (emulated foveated renderer). Altogether, this paper demonstrates how a GPU, with a CUDA block-wise architecture, can be employed for radially-variant rendering, with opportunities for more complex post-processing to ensure a metameric foveation scheme. Code is provided.


title: Fast Computation of the $N$-th Term of a $q$-Holonomic Sequence and Applications

abstract: In 1977, Strassen invented a famous baby-step/giant-step algorithm that computes the factorial $N!$ in arithmetic complexity quasi-linear in $\sqrt{N}$. In 1988, the Chudnovsky brothers generalized Strassen's algorithm to the computation of the $N$-th term of any holonomic sequence in essentially the same arithmetic complexity. We design $q$-analogues of these algorithms. We first extend Strassen's algorithm to the computation of the $q$-factorial of $N$, then Chudnovskys' algorithm to the computation of the $N$-th term of any $q$-holonomic sequence. Both algorithms work in arithmetic complexity quasi-linear in $\sqrt{N}$; surprisingly, they are simpler than their analogues in the holonomic case. We provide a detailed cost analysis, in both arithmetic and bit complexity models. Moreover, we describe various algorithmic consequences, including the acceleration of polynomial and rational solving of linear $q$-differential equations, and the fast evaluation of large classes of polynomials, including a family recently considered by Nogneng and Schost.


title: An iterative machine learning approach for discovering unexpected thermal conductivity enhancement in aperiodic superlattices

abstract: While machine learning (ML) has shown increasing effectiveness in optimizing materials properties under known physics, its application in challenging conventional wisdom and discovering new physics still remains challenging due to its interpolative nature. In this work, we demonstrate the potential of using ML for such applications by implementing an adaptive ML-accelerated search process that can discover unexpected lattice thermal conductivity ($\kappa_l$) enhancement instead of reduction in aperiodic superlattices (SLs) as compared to periodic superlattices. We use non-equilibrium molecular dynamics (NEMD) simulations for high-fidelity calculations of $\kappa_l$ for a small fraction of SLs in the search space, along with a convolutional neural network (CNN) which can rapidly predict $\kappa_l$ for a large number of structures. To ensure accurate prediction by the CNN for the target unknown structures, we iteratively identify aperiodic SLs containing structural features which lead to locally enhanced thermal transport, and include them as additional training data for the CNN in each iteration. As a result, our CNN can accurately predict the high $\kappa_l$ of aperiodic SLs that are absent from the initial training dataset, which allows us to identify the previously unseen exceptional structures. The identified RML structures exhibit increased coherent phonon contribution to thermal conductivity owing to the presence of closely spaced interfaces. Our work describes a general purpose machine learning approach for identifying low-probability-of-occurrence exceptional solutions within an extremely large subspace and discovering the underlying physics.


title: Rotation Sensitive Quench and Revival of Coherent Oscillations in a Ring Lattice

abstract: We consider ultracold atoms trapped in a toroidal trap with an azimuthal lattice for utility as a macroscopic simulator of quantum optics phenomena. We examine the dynamics induced by the adiabatic introduction of the lattice that serves to couple the normal modes, as an analog of a laser field coupling electronic states. The system is found to display two distinct behaviors, manifest in the angular momentum - coherent oscillation and self-trapping - reminiscent of non-linear dynamics, yet not requiring interatomic interactions. The choice is set by the interplay of discrete parameters, the specific initial mode and the periodicity of the lattice. However, rotation can cause continuous transition between the two regimes, causing periodic quenches and revivals in the oscillations as a function of the angular velocity. Curiously, the impact of rotation is determined entirely by the energy spectrum in the absence of the lattice, a feature that can be attributed to adiabaticity. We assess the effects of varying the lattice parameters, and consider applications in rotation sensing.


title: Design and performance of the PALM-3000 3.5 kHz upgrade

abstract: PALM-3000 (P3K), the second generation adaptive optics (AO) instrument for the 5.1 meter Hale telescope at Palomar Observatory, was released as a facility class instrument in October 2011 and has since been used on-sky for over 600 nights as a workhorse science instrument and testbed for coronagraph and detector development. In late 2019 P3K underwent a significant upgrade to its wavefront sensor (WFS) arm and real-time control (RTC) system to reinforce its position as a state-of-the-art AO facility and extend its faint-end capability for high-resolution imaging and precision radial velocity follow-up of Kepler and TESS targets. The main features of this upgrade include an EM-CCD WFS camera capable of 3.5 kHz framerates, and an advanced Digital signal Processor (DSP) based RTC system to replace the aging GPU based system. Similar to the pre-upgrade system, the Shack-Hartmann wavefront sensor supports multiple pupil sampling modes using a motorized lenslet stage. The default sampling mode with 64x64 subapertures has been re-commissioned on-sky in late 2019, with a successful return to science observations in November 2019. In 64x mode the upgraded system is already achieving K-band Strehl ratios up to 85% on sky and can lock on natural guide stars as faint as mV=16. A 16x16 subaperture mode is scheduled for on-sky commissioning in Fall 2020 and will extend the system's faint limit even further. Here we present the design and on-sky re-commissioning results of the upgraded system, dubbed P3K-II.


title: Accelerating Distributed Online Meta-Learning via Multi-Agent Collaboration under Limited Communication

abstract: Online meta-learning is emerging as an enabling technique for achieving edge intelligence in the IoT ecosystem. Nevertheless, to learn a good meta-model for within-task fast adaptation, a single agent alone has to learn over many tasks, and this is the so-called 'cold-start' problem. Observing that in a multi-agent network the learning tasks across different agents often share some model similarity, we ask the following fundamental question: "Is it possible to accelerate the online meta-learning across agents via limited communication and if yes how much benefit can be achieved? " To answer this question, we propose a multi-agent online meta-learning framework and cast it as an equivalent two-level nested online convex optimization (OCO) problem. By characterizing the upper bound of the agent-task-averaged regret, we show that the performance of multi-agent online meta-learning depends heavily on how much an agent can benefit from the distributed network-level OCO for meta-model updates via limited communication, which however is not well understood. To tackle this challenge, we devise a distributed online gradient descent algorithm with gradient tracking where each agent tracks the global gradient using only one communication step with its neighbors per iteration, and it results in an average regret $O(\sqrt{T/N})$ per agent, indicating that a factor of $\sqrt{1/N}$ speedup over the optimal single-agent regret $O(\sqrt{T})$ after $T$ iterations, where $N$ is the number of agents. Building on this sharp performance speedup, we next develop a multi-agent online meta-learning algorithm and show that it can achieve the optimal task-average regret at a faster rate of $O(1/\sqrt{NT})$ via limited communication, compared to single-agent online meta-learning. Extensive experiments corroborate the theoretic results.


title: Shifting and splitting of resonance lines due to dynamical friction in plasmas

abstract: A quasilinear plasma transport theory that incorporates Fokker-Planck dynamical friction (drag) and pitch angle scattering is self-consistently derived from first principles for an isolated, marginally-unstable mode resonating with an energetic minority species. It is found that drag fundamentally changes the structure of the wave-particle resonance, breaking its symmetry and leading to the shifting and splitting of resonance lines. In contrast, scattering broadens the resonance in a symmetric fashion. Comparison with fully nonlinear simulations shows that the proposed quasilinear system preserves the exact instability saturation amplitude and the corresponding particle redistribution of the fully nonlinear theory. Even in situations in which drag leads to a relatively small resonance shift, it still underpins major changes in the redistribution of resonant particles. This novel influence of drag is equally important in plasmas and gravitational systems. In fusion plasmas, the effects are especially pronounced for fast-ion-driven instabilities in tokamaks with low aspect ratio or negative triangularity, as evidenced by past observations. The same theory directly maps to the resonant dynamics of the rotating galactic bar and massive bodies in its orbit, providing new techniques for analyzing galactic dynamics.


title: Automated system to measure Tandem Gait to assess executive functions in children

abstract: As mobile technologies have become ubiquitous in recent years, computer-based cognitive tests have become more popular and efficient. In this work, we focus on assessing motor function in children by analyzing their gait movements. Although there has been a lot of research on designing automated assessment systems for gait analysis, most of these efforts use obtrusive wearable sensors for measuring body movements. We have devised a computer vision-based assessment system that only requires a camera which makes it easier to employ in school or home environments. A dataset has been created with 27 children performing the test. Furthermore in order to improve the accuracy of the system, a deep learning based model was pre-trained on NTU-RGB+D 120 dataset and then it was fine-tuned on our gait dataset. The results highlight the efficacy of proposed work for automating the assessment of children's performances by achieving 76.61% classification accuracy.


title: Wheeler-DeWitt quantization for point-particles

abstract: We present the Hamiltonian formulation of a relativistic point-particle coupled to Einstein gravity and its canonical quantization \`a la Wheeler-DeWitt. In the resulting quantum theory, the wave functional is a function of the particle coordinates and the 3-metric. It satisfies a particular Hamiltonian and diffeomorphism constraint, together with a Klein-Gordon-type equation. As usual in the Wheeler-DeWitt theory, the wave function is time-independent. This is also reflected in the Klein-Gordon-type equation, where the time derivative is absent. Before considering gravity, we consider the coupling of a particle with electromagnetism, which is treated similarly, but simpler.


title: Soft Pomeron in light of the LHC correlated data

abstract: The LHC has released precise measurements of elastic proton-proton scattering that provide a unique constraint on the asymptotic behavior of the scattering amplitude at high energies. Recent reanalyses of part of these data indicate that the central values of some forward quantities would be different than initially observed. We introduce correlation information between the original and the reanalyzed data sets in a way suitable for a global fitting analysis of all data. The careful treatment of correlated errors leads to much less stringent limits on the $\rho$ uncertainty and sets up the stage for describing the forward data using a scattering amplitude dominated by only crossing-even terms. In the light of these correlated data we determine the parameters of the soft Pomeron from the Regge theory. We use Born-level and eikonalized amplitudes. In the Born-level case we estimate the contribution of the double Pomeron exchange, while in the latter case we investigate the role of the eikonalization in both the one- and two-channel models. The role of the proton-Pomeron vertex form and of the nearest $t$-channel singularity in the Pomeron trajectory receives particular attention. We discuss the implications of our results and present predictions for the total cross section and the $\rho$ parameter in proton-proton collisions at LHC and cosmic ray energies.


title: Generating from the Strauss Process using stitching

abstract: The STrauss process is a point process with unnormalized density with respect to a Poisson point process, where each pair of points within a specified distance $r$ of each other contributes a factor $\lambda \in (0, 1)$ to the density. Basic Acceptance Rejection works spectacularly poorly for this problem, which is why several other perfect simulation methods have been developed. these methods, however, also work poorly for reasonably large values of $\lambda$. *Acceptance Rejection Stitching* is a new method that works much faster, allowing the simulation of point processes with values of $\lambda$ much larger than ever before.


title: Weinstein handlebodies for complements of smoothed toric divisors

abstract: We study the interactions between toric manifolds and Weinstein handlebodies. We define a partially-centered condition on a Delzant polytope, which we prove ensures that the complement of a corresponding partial smoothing of the toric divisor supports an explicit Weinstein structure. Many examples which fail this condition also fail to have Weinstein (or even exact) complement to the partially smoothed divisor. We investigate the combinatorial possibilities of Delzant polytopes that realize such Weinstein domain complements. We also develop an algorithm to construct a Weinstein handlebody diagram in Gompf standard form for the complement of such a partially smoothed toric divisor. The algorithm we develop more generally outputs a Weinstein handlebody diagram for any Weinstein 4-manifold constructed by attaching 2-handles to the disk cotangent bundle of any surface $F$, where the 2-handles are attached along the co-oriented conormal lifts of curves on $F$. We discuss how to use these diagrams to calculate invariants and provide numerous examples applying this procedure. For example, we provide Weinstein handlebody diagrams for the complements of the smooth and nodal cubics in $\mathbb{CP}^2$.


title: An information-theoretic framework to measure the dynamic interaction between neural spike trains

abstract: Understanding the interaction patterns among simultaneous recordings of spike trains from multiple neuronal units is a key topic in neuroscience. However, an optimal approach of assessing these interactions has not been established, as existing methods either do not consider the inherent point process nature of spike trains or are based on parametric assumptions that may lead to wrong inferences if not met. This work presents a framework, grounded in the field of information dynamics, for the model-free, continuous-time estimation of both undirected (symmetric) and directed (causal) interactions between pairs of spike trains. The framework decomposes the overall information exchanged dynamically between two point processes X and Y as the sum of the dynamic mutual information (dMI) between the histories of X and Y, plus the transfer entropy (TE) along the directions X->Y and Y->X. Building on recent work which derived theoretical expressions and consistent estimators for the TE in continuous time, we develop algorithms for estimating efficiently all measures in our framework through nearest neighbor statistics. These algorithms are validated in simulations of independent and coupled spike train processes, showing the accuracy of dMI and TE in the assessment of undirected and directed interactions even for weakly coupled and short realizations, and proving the superiority of the continuous-time estimator over the discrete-time method. Then, the usefulness of the framework is illustrated in a real data scenario of recordings from in-vitro preparations of spontaneously-growing cultures of cortical neurons, where we show the ability of dMI and TE to identify how the networks of undirected and directed spike train interactions change their topology through maturation of the neuronal cultures.


title: Mitigating Bias in Calibration Error Estimation

abstract: For an AI system to be reliable, the confidence it expresses in its decisions must match its accuracy. To assess the degree of match, examples are typically binned by confidence and the per-bin mean confidence and accuracy are compared. Most research in calibration focuses on techniques to reduce this empirical measure of calibration error, ECE_bin. We instead focus on assessing statistical bias in this empirical measure, and we identify better estimators. We propose a framework through which we can compute the bias of a particular estimator for an evaluation data set of a given size. The framework involves synthesizing model outputs that have the same statistics as common neural architectures on popular data sets. We find that binning-based estimators with bins of equal mass (number of instances) have lower bias than estimators with bins of equal width. Our results indicate two reliable calibration-error estimators: the debiased estimator (Brocker, 2012; Ferro and Fricker, 2012) and a method we propose, ECE_sweep, which uses equal-mass bins and chooses the number of bins to be as large as possible while preserving monotonicity in the calibration function. With these estimators, we observe improvements in the effectiveness of recalibration methods and in the detection of model miscalibration.


title: Sheaf Theory through Examples (Abridged Version)

abstract: This book provides an inviting tour through sheaf theory, from the perspective of applied category theory and pitched at a less specialized audience than is typical with introductions to sheaves. The book makes it as easy as possible for the reader new to sheaves, by motivating and developing the theory via a broad range of concrete examples and explicit constructions, including applications to n-colorings of graphs, satellite data, chess problems, Bayes nets, musical performance, complexes, and more. Included is an extended first chapter introducing and motivating all the necessary category-theoretical background, again with a strong emphasis on concrete examples. A new and unabridged version (including a fifth chapter on more advanced topics and a conclusion) will be available with MIT Press.


title: Magnetism at the interface of non-magnetic Cu and C$_{60}$

abstract: The signature of magnetism without a ferromagnet in a non-magnetic heterostructure is novel as well as fascinating from fundamental research point of view. It has been shown by Al'Mari et al: that magnetism can be induced at the interface of Cu/C60 due to change in density of states. However, the quantification of such interfacial magnetic moment has not been performed yet. In order to quantify the induced magnetic moment in Cu, we have performed X-ray magnetic circular dichroism (XMCD) measurements on Cu/C$_{60}$ multilayers. We have observed room temperature ferromagnetism in Cu/C$_{60}$ stack. Further XMCD measurements show that ~0.01 $\mu_B$/atom magnetic moment has been induced in Cu at the Cu/C$_{60}$ interface.


title: SimpleChrome: Encoding of Combinatorial Effects for Predicting Gene Expression

abstract: Due to recent breakthroughs in state-of-the-art DNA sequencing technology, genomics data sets have become ubiquitous. The emergence of large-scale data sets provides great opportunities for better understanding of genomics, especially gene regulation. Although each cell in the human body contains the same set of DNA information, gene expression controls the functions of these cells by either turning genes on or off, known as gene expression levels. There are two important factors that control the expression level of each gene: (1) Gene regulation such as histone modifications can directly regulate gene expression. (2) Neighboring genes that are functionally related to or interact with each other that can also affect gene expression level. Previous efforts have tried to address the former using Attention-based model. However, addressing the second problem requires the incorporation of all potentially related gene information into the model. Though modern machine learning and deep learning models have been able to capture gene expression signals when applied to moderately sized data, they have struggled to recover the underlying signals of the data due to the nature of the data's higher dimensionality. To remedy this issue, we present SimpleChrome, a deep learning model that learns the latent histone modification representations of genes. The features learned from the model allow us to better understand the combinatorial effects of cross-gene interactions and direct gene regulation on the target gene expression. The results of this paper show outstanding improvements on the predictive capabilities of downstream models and greatly relaxes the need for a large data set to learn a robust, generalized neural network. These results have immediate downstream effects in epigenomics research and drug development.


title: Engineered swift equilibration for arbitrary geometries

abstract: Engineered swift equilibration (ESE) is a class of driving protocols that enforce an equilibrium distribution with respect to external control parameters at the beginning and end of rapid state transformations of open, classical non-equilibrium systems. ESE protocols have previously been derived and experimentally realized for Brownian particles in simple, one-dimensional, time-varying trapping potentials; one recent study considered ESE in two-dimensional Euclidean configuration space. Here we extend the ESE framework to generic, overdamped Brownian systems in arbitrary curved configuration space and illustrate our results with specific examples not amenable to previous techniques. Our approach may be used to impose the necessary dynamics to control the full temporal configurational distribution in a wide variety of experimentally realizable settings.


title: A Closer Look at the Robustness of Vision-and-Language Pre-trained Models

abstract: Large-scale pre-trained multimodal transformers, such as ViLBERT and UNITER, have propelled the state of the art in vision-and-language (V+L) research to a new level. Although achieving impressive performance on standard tasks, to date, it still remains unclear how robust these pre-trained models are. To investigate, we conduct a host of thorough evaluations on existing pre-trained models over 4 different types of V+L specific model robustness: (i) Linguistic Variation; (ii) Logical Reasoning; (iii) Visual Content Manipulation; and (iv) Answer Distribution Shift. Interestingly, by standard model finetuning, pre-trained V+L models already exhibit better robustness than many task-specific state-of-the-art methods. To further enhance model robustness, we propose Mango, a generic and efficient approach that learns a Multimodal Adversarial Noise GeneratOr in the embedding space to fool pre-trained V+L models. Differing from previous studies focused on one specific type of robustness, Mango is task-agnostic, and enables universal performance lift for pre-trained models over diverse tasks designed to evaluate broad aspects of robustness. Comprehensive experiments demonstrate that Mango achieves new state of the art on 7 out of 9 robustness benchmarks, surpassing existing methods by a significant margin. As the first comprehensive study on V+L robustness, this work puts robustness of pre-trained models into sharper focus, pointing new directions for future study.


abstract: The primary goal of knowledge distillation (KD) is to encapsulate the information of a model learned from a teacher network into a student network, with the latter being more compact than the former. Existing work, e.g., using Kullback-Leibler divergence for distillation, may fail to capture important structural knowledge in the teacher network and often lacks the ability for feature generalization, particularly in situations when teacher and student are built to address different classification tasks. We propose Wasserstein Contrastive Representation Distillation (WCoRD), which leverages both primal and dual forms of Wasserstein distance for KD. The dual form is used for global knowledge transfer, yielding a contrastive learning objective that maximizes the lower bound of mutual information between the teacher and the student networks. The primal form is used for local contrastive knowledge transfer within a mini-batch, effectively matching the distributions of features between the teacher and the student networks. Experiments demonstrate that the proposed WCoRD method outperforms state-of-the-art approaches on privileged information distillation, model compression and cross-modal transfer.


title: The Planet as Exoplanet Analog Spectrograph (PEAS): Design and First-Light

abstract: Exoplanets are abundant in our galaxy and yet characterizing them remains a technical challenge. Solar System planets provide an opportunity to test the practical limitations of exoplanet observations with high signal-to-noise data that we cannot access for exoplanets. However, data on Solar System planets differ from exoplanets in that Solar System planets are spatially resolved while exoplanets are unresolved point-sources. We present a novel instrument designed to observe Solar System planets as though they are exoplanets, the Planet as Exoplanet Analog Spectrograph (PEAS). PEAS consists of a dedicated 0.5-m telescope and off-the-shelf optics, located at Lick Observatory. PEAS uses an integrating sphere to disk-integrate light from the Solar System planets, producing spatially mixed light more similar to the spectra we can obtain from exoplanets. This paper describes the general system design and early results of the PEAS instrument.


title: Policy Manifold Search for Improving Diversity-based Neuroevolution

abstract: Diversity-based approaches have recently gained popularity as an alternative paradigm to performance-based policy search. A popular approach from this family, Quality-Diversity (QD), maintains a collection of high-performing policies separated in the diversity-metric space, defined based on policies' rollout behaviours. When policies are parameterised as neural networks, i.e. Neuroevolution, QD tends to not scale well with parameter space dimensionality. Our hypothesis is that there exists a low-dimensional manifold embedded in the policy parameter space, containing a high density of diverse and feasible policies. We propose a novel approach to diversity-based policy search via Neuroevolution, that leverages learned latent representations of the policy parameters which capture the local structure of the data. Our approach iteratively collects policies according to the QD framework, in order to (i) build a collection of diverse policies, (ii) use it to learn a latent representation of the policy parameters, (iii) perform policy search in the learned latent space. We use the Jacobian of the inverse transformation (i.e.reconstruction function) to guide the search in the latent space. This ensures that the generated samples remain in the high-density regions of the original space, after reconstruction. We evaluate our contributions on three continuous control tasks in simulated environments, and compare to diversity-based baselines. The findings suggest that our approach yields a more efficient and robust policy search process.


title: Inexact-ADMM Based Federated Meta-Learning for Fast and Continual Edge Learning

abstract: In order to meet the requirements for performance, safety, and latency in many IoT applications, intelligent decisions must be made right here right now at the network edge. However, the constrained resources and limited local data amount pose significant challenges to the development of edge AI. To overcome these challenges, we explore continual edge learning capable of leveraging the knowledge transfer from previous tasks. Aiming to achieve fast and continual edge learning, we propose a platform-aided federated meta-learning architecture where edge nodes collaboratively learn a meta-model, aided by the knowledge transfer from prior tasks. The edge learning problem is cast as a regularized optimization problem, where the valuable knowledge learned from previous tasks is extracted as regularization. Then, we devise an ADMM based federated meta-learning algorithm, namely ADMM-FedMeta, where ADMM offers a natural mechanism to decompose the original problem into many subproblems which can be solved in parallel across edge nodes and the platform. Further, a variant of inexact-ADMM method is employed where the subproblems are `solved' via linear approximation as well as Hessian estimation to reduce the computational cost per round to $\mathcal{O}(n)$. We provide a comprehensive analysis of ADMM-FedMeta, in terms of the convergence properties, the rapid adaptation performance, and the forgetting effect of prior knowledge transfer, for the general non-convex case. Extensive experimental studies demonstrate the effectiveness and efficiency of ADMM-FedMeta, and showcase that it substantially outperforms the existing baselines.


title: Improved Digital Therapy for Developmental Pediatrics Using Domain-Specific Artificial Intelligence: Machine Learning Study

abstract: Background: Automated emotion classification could aid those who struggle to recognize emotions, including children with developmental behavioral conditions such as autism. However, most computer vision emotion recognition models are trained on adult emotion and therefore underperform when applied to child faces. Objective: We designed a strategy to gamify the collection and labeling of child emotion-enriched images to boost the performance of automatic child emotion recognition models to a level closer to what will be needed for digital health care approaches. Methods: We leveraged our prototype therapeutic smartphone game, GuessWhat, which was designed in large part for children with developmental and behavioral conditions, to gamify the secure collection of video data of children expressing a variety of emotions prompted by the game. Independently, we created a secure web interface to gamify the human labeling effort, called HollywoodSquares, tailored for use by any qualified labeler. We gathered and labeled 2155 videos, 39,968 emotion frames, and 106,001 labels on all images. With this drastically expanded pediatric emotion-centric database (>30 times larger than existing public pediatric emotion data sets), we trained a convolutional neural network (CNN) computer vision classifier of happy, sad, surprised, fearful, angry, disgust, and neutral expressions evoked by children. Results: The classifier achieved a 66.9% balanced accuracy and 67.4% F1-score on the entirety of the Child Affective Facial Expression (CAFE) as well as a 79.1% balanced accuracy and 78% F1-score on CAFE Subset A, a subset containing at least 60% human agreement on emotions labels. This performance is at least 10% higher than all previously developed classifiers evaluated against CAFE, the best of which reached a 56% balanced accuracy even when combining "anger" and "disgust" into a single class.


title: Online Service Migration in Mobile Edge with Incomplete System Information: A Deep Recurrent Actor-Critic Learning Approach

abstract: Multi-access Edge Computing (MEC) is an emerging computing paradigm that extends cloud computing to the network edge to support resource-intensive applications on mobile devices. As a crucial problem in MEC, service migration needs to decide how to migrate user services for maintaining the Quality-of-Service when users roam between MEC servers with limited coverage and capacity. However, finding an optimal migration policy is intractable due to the dynamic MEC environment and user mobility. Many existing studies make centralized migration decisions based on complete system-level information, which is time-consuming and also lacks desirable scalability. To address these challenges, we propose a novel learning-driven method, which is user-centric and can make effective online migration decisions by utilizing incomplete system-level information. Specifically, the service migration problem is modeled as a Partially Observable Markov Decision Process (POMDP). To solve the POMDP, we design a new encoder network that combines a Long Short-Term Memory (LSTM) and an embedding matrix for effective extraction of hidden information, and further propose a tailored off-policy actor-critic algorithm for efficient training. The extensive experimental results based on real-world mobility traces demonstrate that this new method consistently outperforms both the heuristic and state-of-the-art learning-driven algorithms and can achieve near-optimal results on various MEC scenarios.


title: Trex: Learning Execution Semantics from Micro-Traces for Binary Similarity

abstract: Detecting semantically similar functions -- a crucial analysis capability with broad real-world security usages including vulnerability detection, malware lineage, and forensics -- requires understanding function behaviors and intentions. This task is challenging as semantically similar functions can be implemented differently, run on different architectures, and compiled with diverse compiler optimizations or obfuscations. Most existing approaches match functions based on syntactic features without understanding the functions' execution semantics. We present Trex, a transfer-learning-based framework, to automate learning execution semantics explicitly from functions' micro-traces and transfer the learned knowledge to match semantically similar functions. Our key insight is that these traces can be used to teach an ML model the execution semantics of different sequences of instructions. We thus train the model to learn execution semantics from the functions' micro-traces, without any manual labeling effort. We then develop a novel neural architecture to learn execution semantics from micro-traces, and we finetune the pretrained model to match semantically similar functions. We evaluate Trex on 1,472,066 function binaries from 13 popular software projects. These functions are from different architectures and compiled with various optimizations and obfuscations. Trex outperforms the state-of-the-art systems by 7.8%, 7.2%, and 14.3% in cross-architecture, optimization, and obfuscation function matching, respectively. Ablation studies show that the pretraining significantly boosts the function matching performance, underscoring the importance of learning execution semantics.


title: Manufactured Solutions for the Method-of-Moments Implementation of the Electric-Field Integral Equation

abstract: Though the method-of-moments implementation of the electric-field integral equation plays an important role in computational electromagnetics, it provides many code-verification challenges due to the different sources of numerical error. In this paper, we provide an approach through which we can apply the method of manufactured solutions to isolate and verify the solution-discretization error. We accomplish this by manufacturing both the surface current and the Green's function. Because the arising equations are poorly conditioned, we reformulate them as a set of constraints for an optimization problem that selects the solution closest to the manufactured solution. We demonstrate the effectiveness of this approach for cases with and without coding errors.


title: Aging Bandits: Regret Analysis and Order-Optimal Learning Algorithm for Wireless Networks with Stochastic Arrivals

abstract: We consider a single-hop wireless network with sources transmitting time-sensitive information to the destination over multiple unreliable channels. Packets from each source are generated according to a stochastic process with known statistics and the state of each wireless channel (ON/OFF) varies according to a stochastic process with unknown statistics. The reliability of the wireless channels is to be learned through observation. At every time slot, the learning algorithm selects a single pair (source, channel) and the selected source attempts to transmit its packet via the selected channel. The probability of a successful transmission to the destination depends on the reliability of the selected channel. The goal of the learning algorithm is to minimize the Age-of-Information (AoI) in the network over $T$ time slots. To analyze the performance of the learning algorithm, we introduce the notion of AoI regret, which is the difference between the expected cumulative AoI of the learning algorithm under consideration and the expected cumulative AoI of a genie algorithm that knows the reliability of the channels a priori. The AoI regret captures the penalty incurred by having to learn the statistics of the channels over the $T$ time slots. The results are two-fold: first, we consider learning algorithms that employ well-known solutions to the stochastic multi-armed bandit problem (such as $\epsilon$-Greedy, Upper Confidence Bound, and Thompson Sampling) and show that their AoI regret scales as $\Theta(\log T)$; second, we develop a novel learning algorithm and show that it has $O(1)$ regret. To the best of our knowledge, this is the first learning algorithm with bounded AoI regret.

categories: eess.SY cs.IT cs.LG cs.SY math.IT stat.ML


title: Recovering affine curves over finite fields from $L$-functions

abstract: Let $K$ be the function field of a curve over a finite field of odd characteristic. We investigate using $L$-functions of Galois extensions of $K$ to effectively recover $K$. When $K$ is the function field of the projective line with four rational points removed, we show how to use $L$-functions of a ray class field to effectively recover the removed points up to automorphisms of the projective line. When $K$ is the function field of a plane curve, we show how to effectively recover the equation of that curve using $L$-functions of Artin-Schreier extensions of $K$.


title: The impact of a fossil magnetic field on dipolar mixed-mode frequencies in sub- and red-giant stars

abstract: Stars more massive than $\sim 1.3$ M$_\odot$ are known to develop a convective core during the main-sequence: the dynamo process triggered by this convection could be the origin of a strong magnetic field inside the core of the star, trapped when it becomes stably stratified and for the rest of its evolution. The presence of highly magnetized white dwarfs strengthens the hypothesis of buried fossil magnetic fields inside the core of evolved low-mass stars. If such a fossil field exists, it should affect the mixed modes of red giants as they are sensitive to processes affecting the deepest layers of these stars. The impact of a magnetic field on dipolar oscillations modes was one of Pr. Michael J. Thompson's research topics during the 90s when preparing the helioseismic SoHO space mission. As the detection of gravity modes in the Sun is still controversial, the investigation of the solar oscillation modes did not provide any hint of the existence of a magnetic field in the solar radiative core. Today we have access to the core of evolved stars thanks to the asteroseismic observation of mixed modes from CoRoT, Kepler, K2 and TESS missions. The idea of applying and generalizing the work done for the Sun came from discussions with Pr. Michael Thompson in early 2018 before we loss him. Following the path we drew together, we theoretically investigate the effect of a stable axisymmetric mixed poloidal and toroidal magnetic field, aligned with the rotation axis of the star, on the mixed modes frequencies of a typical evolved low-mass star. This enables us to estimate the magnetic perturbations to the eigenfrequencies of mixed dipolar modes, depending on the magnetic field strength and the evolutionary state of the star. We conclude that strong magnetic fields of $\sim$ 1MG should perturbe the mixed-mode frequency pattern enough for its effects to be detectable inside current asteroseismic data.


title: Quasi-convex subsets and the farthest direction in Alexandrov spaces with lower curvature bound

abstract: This paper aims to give a further study on quasi-convex subsets in Alexandrov spaces with lower curvature bound which are introduced in [SSW]. We first provide new insights on quasi-convex subsets (Theorem A and Corollary C), and then as applications of them we explore more properties of quasi-convex subsets.


title: Exploring the Dust Content of Galactic Halos with Herschel III. NGC 891

abstract: We present deep far-infrared observations of the nearby edge-on galaxy NGC 891 obtained with the Herschel Space Observatory and the Spitzer Space Telescope. The maps confirm the detection of thermal emission from the inner circumgalactic medium (halo) and spatially resolve a dusty superbubble and a dust spur (filament). The dust temperature of the halo component is lower than that of the disk but increases across a region of diameter ~8.0 kpc extending at least 7.7 kpc vertically from one side of the disk, a region we call a superbubble because of its association with thermal X-ray emission and a minimum in the synchrotron scaleheight. This outflow is breaking through the thick disk and developing into a galactic wind, which is of particular interest because NGC 891 is not considered a starburst galaxy; the star formation rate surface density, 0.03 Msun/year per square kiloparsec, and gas fraction, just 10% in the inner disk, indicate the threshold for wind formation is lower than previous work has suggested. We conclude that the star formation surface density is sufficient for superbubble blowout into the halo, but the cosmic ray electrons may play a critical role in determining whether this outflow develops into a fountain or escapes from the gravitational potential. The high dust-to-gas ratio in the dust spur suggests the material was pulled out of NGC 891 through the collision of a minihalo with the disk of NGC 891. We conclude that NGC 891 offers an example of both feedback and satellite interactions transporting dust into the halo of a typical galaxy.


title: StrokeGAN: Reducing Mode Collapse in Chinese Font Generation via Stroke Encoding

abstract: The generation of stylish Chinese fonts is an important problem involved in many applications. Most of existing generation methods are based on the deep generative models, particularly, the generative adversarial networks (GAN) based models. However, these deep generative models may suffer from the mode collapse issue, which significantly degrades the diversity and quality of generated results. In this paper, we introduce a one-bit stroke encoding to capture the key mode information of Chinese characters and then incorporate it into CycleGAN, a popular deep generative model for Chinese font generation. As a result we propose an efficient method called StrokeGAN, mainly motivated by the observation that the stroke encoding contains amount of mode information of Chinese characters. In order to reconstruct the one-bit stroke encoding of the associated generated characters, we introduce a stroke-encoding reconstruction loss imposed on the discriminator. Equipped with such one-bit stroke encoding and stroke-encoding reconstruction loss, the mode collapse issue of CycleGAN can be significantly alleviated, with an improved preservation of strokes and diversity of generated characters. The effectiveness of StrokeGAN is demonstrated by a series of generation tasks over nine datasets with different fonts. The numerical results demonstrate that StrokeGAN generally outperforms the state-of-the-art methods in terms of content and recognition accuracies, as well as certain stroke error, and also generates more realistic characters.


title: When is the sum of closed subspaces of a Hilbert space closed?

abstract: We provide a sufficient condition for a finite number of closed subspaces of a Hilbert space to be linearly independent and their sum to be closed. Under this condition a formula for the orthogonal projection onto the sum is given. We also show that this condition is sharp (in a certain sense).


title: Domain Adaptive Object Detection via Feature Separation and Alignment

abstract: Recently, adversarial-based domain adaptive object detection (DAOD) methods have been developed rapidly. However, there are two issues that need to be resolved urgently. Firstly, numerous methods reduce the distributional shifts only by aligning all the feature between the source and target domain, while ignoring the private information of each domain. Secondly, DAOD should consider the feature alignment on object existing regions in images. But redundancy of the region proposals and background noise could reduce the domain transferability. Therefore, we establish a Feature Separation and Alignment Network (FSANet) which consists of a gray-scale feature separation (GSFS) module, a local-global feature alignment (LGFA) module and a region-instance-level alignment (RILA) module. The GSFS module decomposes the distractive/shared information which is useless/useful for detection by a dual-stream framework, to focus on intrinsic feature of objects and resolve the first issue. Then, LGFA and RILA modules reduce the distributional shifts of the multi-level features. Notably, scale-space filtering is exploited to implement adaptive searching for regions to be aligned, and instance-level features in each region are refined to reduce redundancy and noise mentioned in the second issue. Various experiments on multiple benchmark datasets prove that our FSANet achieves better performance on the target domain detection and surpasses the state-of-the-art methods.


title: Leray theorems for $l_1$-norms of infinite chains

abstract: The paper is devoted to an adaptation of author's approach to Leray theorems in bounded cohomology theory to infinite chains. The main results are a stronger and more general form of Gromov's Vanishing-finiteness theorem and a generalization of the first part of his Cutting-of theorem. The proofs are elementary.


title: Spectral caustics of high-order harmonics in one-dimensional periodic crystals

abstract: We theoretically investigate the spectral caustics of high-order harmonics in solids. We analyze the 1-dimension model of solids HHG and find that, apart from the caustics originated from the van Hove singularities in the energy-band structure, another kind of catastrophe singularities also emerge when the different branches of electron-hole trajectories generating high-order harmonics coalesce into a single branch. We solve time-dependent Schr\"odinger equation in periodic potential and demonstrate the control of this kind of singularities in HHG with the aids of two-color laser fields. The diffraction patterns of the harmonic spectrum near the caustics agree well with the inter-band electron-hole recombination trajectories predicted by the semiconductor semi-classical equation. This work is expected to help to understand the HHG dynamics in solids and manipulate the harmonic spectrum by adjusting driving field parameters.


title: Testing the Stationarity Assumption in Software Effort Estimation Datasets

abstract: Software effort estimation (SEE) models are typically developed based on an underlying assumption that all data points are equally relevant to the prediction of effort for future projects. The dynamic nature of several aspects of the software engineering process could mean that this assumption does not hold in at least some cases. This study employs three kernel estimator functions to test the stationarity assumption in three software engineering datasets that have been used in the construction of software effort estimation models. The kernel estimators are used in the generation of non-uniform weights which are subsequently employed in weighted linear regression modeling. Prediction errors are compared to those obtained from uniform models. Our results indicate that, for datasets that exhibit underlying non-stationary processes, uniform models are more accurate than non-uniform models. In contrast, the accuracy of uniform and non-uniform models for datasets that exhibited stationary processes was essentially equivalent. The results of our study also confirm prior findings that the accuracy of effort estimation models is independent of the type of kernel estimator function used in model development.


title: Commuting involutions and elementary abelian subgroups of simple groups

abstract: Motivated in part by representation theoretic questions, we prove that if G is a finite quasi-simple group, then there exists an elementary abelian subgroup of G that intersects every conjugacy class of involutions of G.


title: Electric Field Calculation and PNS Prediction for Head and Body Gradient Coils

abstract: Purpose: To demonstrate and validate E-field calculation and PNS prediction methods that are accurate, computationally efficient and that could be used to inform regulatory standards. Methods: We describe a simplified method for calculating the spatial distribution of induced E-field over the volume of a body model given a gradient coil vector potential field. The method is easily programmed without finite element or finite difference software, allowing for straightforward and computationally-efficient E-field evaluation. Using these E-field calculations and a range of body models, population-weighted PNS thresholds are determined using established methods and compared against published experimental PNS data for two head gradient coils and one body gradient coil. Results: A head-gradient-appropriate chronaxie value of 669us was determined by meta-analysis. Prediction errors between our calculated PNS parameters and the corresponding experimentally measured values were ~5% for the body gradient and ~20% for the symmetric head gradient. Our calculated PNS parameters matched experimental measurements to within experimental uncertainty for 73% of deltaGmin estimates and 80% of SRmin estimates. Computation time is seconds for initial E-field maps and milliseconds for E-field updates for different gradient designs, allowing for highly efficient iterative optimization of gradient designs and enabling new dimensions in PNS-optimal gradient design. Conclusions: We have developed accurate and computationally efficient methods for prospectively determining PNS limits, with specific application to head gradient coils.


title: DialogXL: All-in-One XLNet for Multi-Party Conversation Emotion Recognition

abstract: This paper presents our pioneering effort for emotion recognition in conversation (ERC) with pre-trained language models. Unlike regular documents, conversational utterances appear alternately from different parties and are usually organized as hierarchical structures in previous work. Such structures are not conducive to the application of pre-trained language models such as XLNet. To address this issue, we propose an all-in-one XLNet model, namely DialogXL, with enhanced memory to store longer historical context and dialog-aware self-attention to deal with the multi-party structures. Specifically, we first modify the recurrence mechanism of XLNet from segment-level to utterance-level in order to better model the conversational data. Second, we introduce dialog-aware self-attention in replacement of the vanilla self-attention in XLNet to capture useful intra- and inter-speaker dependencies. Extensive experiments are conducted on four ERC benchmarks with mainstream models presented for comparison. The experimental results show that the proposed model outperforms the baselines on all the datasets. Several other experiments such as ablation study and error analysis are also conducted and the results confirm the role of the critical modules of DialogXL.


title: Non-uniform continuity on initial data for the two-component b-family system in Besov space

abstract: In this paper, we consider the Cauchy problem of a two-component b-family system, which includes the two-component Camassa-Holm system and the two-component Degasperis-Procesi system. It is shown that the solution map of the two-component b-family system is not uniformly continuous on the initial data in Besov spaces $B_{p, r}^{s-1}(\mathbb{R})\times B_{p, r}^s(\mathbb{R})$ with $s>\max\{1+\frac{1}{p}, \frac{3}{2}\}$, $1\leq p, r< \infty$. Our result covers and extends the previous non-uniform continuity in Sobolev spaces $H^{s-1}(\mathbb{R})\times H^s(\mathbb{R})$ for $s>\frac{5}{2}$ (Nonlinear Anal., 2014) to Besov spaces.