title: Comment on `Do electromagnetic waves always propagate along null geodesics?'

abstract: We study the propagation of Maxwellian electromagnetic waves in curved spacetimes in terms of the appropriate geometrical optics limit, notions of signal speed, and minimal coupling prescription from Maxwellian theory in flat spacetime. In the course of this, we counter a recent major claim by Asenjo and Hojman (2017) to the effect that the geometrical optics limit is partly ill-defined in G\"odel spacetime; we thereby dissolve the present tension concerning established results on wave propagation and the optical limit.


title: Randomized block Krylov methods for approximating extreme eigenvalues

abstract: Randomized block Krylov subspace methods form a powerful class of algorithms for computing the extreme eigenvalues of a symmetric matrix or the extreme singular values of a general matrix. The purpose of this paper is to develop new theoretical bounds on the performance of randomized block Krylov subspace methods for these problems. For matrices with polynomial spectral decay, the randomized block Krylov method can obtain an accurate spectral norm estimate using only a constant number of steps (that depends on the decay rate and the accuracy). Furthermore, the analysis reveals that the behavior of the algorithm depends in a delicate way on the block size. Numerical evidence confirms these predictions.


title: Multi-lane Cruising Using Hierarchical Planning and Reinforcement Learning

abstract: Competent multi-lane cruising requires using lane changes and within-lane maneuvers to achieve good speed and maintain safety. This paper proposes a design for autonomous multi-lane cruising by combining a hierarchical reinforcement learning framework with a novel state-action space abstraction. While the proposed solution follows the classical hierarchy of behavior decision, motion planning and control, it introduces a key intermediate abstraction within the motion planner to discretize the state-action space according to high level behavioral decisions. We argue that this design allows principled modular extension of motion planning, in contrast to using either monolithic behavior cloning or a large set of hand-written rules. Moreover, we demonstrate that our state-action space abstraction allows transferring of the trained models without retraining from a simulated environment with virtually no dynamics to one with significantly more realistic dynamics. Together, these results suggest that our proposed hierarchical architecture is a promising way to allow reinforcement learning to be applied to complex multi-lane cruising in the real world.


title: A cold electron-impact ion source driven by a photo-cathode -- New opportunities for the delivery of radioactive molecular beams?

abstract: The thick-target ISOL (Isotope mass Separation OnLine) method provides beams of more than 1000 radionuclides of 74 elements. The method is well established for elements with sufficiently high volatility at ca. 2000 {\deg}C. To extract non-volatile elements the formation of a volatile molecule is required. While successful in some cases (e.g. carbon or boron), most of these elements are not yet available as ISOL beam. A variety of volatile carrier molecules has been proposed for all elements produced in the target material, but their probability of survival during the extraction and ionization process is often limited by the high temperatures required for isotope diffusion in the thick targets and for ion source operation. While cold target concepts have already been proposed, the normal mode of operation of the typically used Versatile Arc Discharge Ion Source (VADIS) with a hot cathode is not well suited. Here, we report about first measurements with an electron-impact ion source operated at ambient temperature using electrons that were liberated via the photo-electric effect from a copper cathode.


title: Application of Social Network Analysis in Evaluating Risk and network resilience of Closed-Loop-Supply-Chain

abstract: Closed Loop Supply Chain (CLSC) networks are an attractive topic in both industry and academic research due to their positive environmental effects and waste reduction. Performance evaluation of CLSC networks is challenging due to the variety of facility types and complex relationships among them. In this study, a framework based on Social Network Analysis (SNA) is proposed to evaluate the individual components of a network and identify the critical facilities whose disruptions can affect the entire network. The proposed SNA metrics are applied to a CLSC network case study based on real data and the results and their interpretation are presented. Practical recommendations and actionable guidelines are provided are provided based on the results to mitigate the identified risks and improve the flexibility and resilience of the network. The SNAinSCM R package is developed and shared on GitHub to facilitate the computation and visualization of the discussed metrics


title: Sparse Deep Learning: A New Framework Immune to Local Traps and Miscalibration

abstract: Deep learning has powered recent successes of artificial intelligence (AI). However, the deep neural network, as the basic model of deep learning, has suffered from issues such as local traps and miscalibration. In this paper, we provide a new framework for sparse deep learning, which has the above issues addressed in a coherent way. In particular, we lay down a theoretical foundation for sparse deep learning and propose prior annealing algorithms for learning sparse neural networks. The former has successfully tamed the sparse deep neural network into the framework of statistical modeling, enabling prediction uncertainty correctly quantified. The latter can be asymptotically guaranteed to converge to the global optimum, enabling the validity of the down-stream statistical inference. Numerical result indicates the superiority of the proposed method compared to the existing ones.


title: MAP-CSI: Single-site Map-Assisted Localization Using Massive MIMO CSI

abstract: This paper presents a new map-assisted localization approach utilizing Chanel State Information (CSI) in Massive Multiple-Input Multiple-Output (MIMO) systems. Map-assisted localization is an environment-aware approach in which the communication system has information regarding the surrounding environment. By combining radio frequency ray tracing parameters of the multipath components (MPC) with the environment map, it is possible to accomplish localization. Unfortunately, in real-world scenarios, ray tracing parameters are typically not explicitly available. Thus, additional complexity is added at a base station to obtain this information. On the other hand, CSI is a common communication parameter, usually estimated for any communication channel. In this work, we leverage the already available CSI data to propose a novel map-assisted CSI localization approach, referred to as MAP-CSI. We show that Angle-of-Departure (AoD) and Time-of-Arrival (ToA) can be extracted from CSI and then be used in combination with the environment map to localize the user. We perform simulations on a public MIMO dataset and show that our method works for both line-of-sight (LOS) and non-line-of-sight (NLOS) scenarios. We compare our method to the state-of-the-art (SoA) method that uses the ray tracing data. Using MAP-CSI, we accomplish an average localization error of 1.8 m in LOS and 2.8 m in mixed (combination of LOS and NLOS samples) scenarios. On the other hand, SoA ray tracing has an average error of 1.0 m and 2.2 m, respectively, but requires explicit AoD and ToA information to perform the localization task.


title: Ramsey theory of homogeneous structures: current trends and open problems

abstract: This article highlights historical achievements in the partition theory of countable homogeneous relational structures, and presents recent work, current trends, and open problems. Exciting recent developments include new methods involving logic, topological Ramsey spaces, and category theory. The paper concentrates on big Ramsey degrees, presenting their essential structure where known and outlining areas for further development. Cognate areas, including infinite dimensional Ramsey theory of homogeneous structures and partition theory of uncountable structures, are also discussed.


title: Cellular Automata and Bootstrap Percolation

abstract: We study qualitative properties of two-dimensional freezing cellular automata with a binary state set initialized on a random configuration. If the automaton is also monotone, the setting is equivalent to bootstrap percolation. We explore the extent to which monotonicity constrains the possible asymptotic dynamics by proving two results that do not hold in the subclass of monotone automata. First, it is undecidable whether the automaton almost surely fills the space when initialized on a Bernoulli random configuration with density $p$, for some/all $0 < p < 1$. Second, there exists an automaton whose space-filling property depends on $p$ in a non-monotone way.


title: Recurrence, transience and degree distribution for the Tree Builder Random Walk

abstract: We investigate a self-interacting random walk, whose dynamically evolving environment is a random tree built by the walker itself, as it walks around. At time $n=1,2,\dots$, right before stepping, the walker adds a random number (possibly zero) $Z_n$ of leaves to its current position. We assume that the $Z_n$'s are independent, but, importantly, we do \emph{not} assume that they are identically distributed. We obtain non-trivial conditions on their distributions under which the random walk is recurrent. This result is in contrast with some previous work in which, under the assumption that $Z_n\sim \mathsf{Ber}(p)$ (thus i.i.d.), the random walk was shown to be ballistic for every $p \in (0,1]$. We also obtain results on the transience of the walk, and the possibility that it ``gets stuck.'' From the perspective of the environment, we provide structural information about the sequence of random trees generated by the model when $Z_n\sim \mathsf{Ber}(p_n)$, with $p_n=\Theta(n^{-\gamma})$ and $\gamma \in (2/3,1]$. We prove that the empirical degree distribution of this random tree sequence converges almost surely to a power-law distribution of exponent $3$, thus revealing a connection to the well known preferential attachment model.


title: A sampling-guided unsupervised learning method to capture percolation in complex networks

abstract: The use of machine learning techniques in classical and quantum systems has led to novel techniques to classify ordered and disordered phases, as well as uncover transition points in critical phenomena. Efforts to extend these methods to dynamical processes in complex networks is a field of active research. Network-percolation, a measure of resilience and robustness to structural failures, as well as a proxy for spreading processes, has numerous applications in social, technological, and infrastructural systems. A particular challenge is to identify the existence of a percolation cluster in a network in the face of noisy data. Here, we consider bond-percolation, and introduce a sampling approach that leverages the core-periphery structure of such networks at a microscopic scale, using onion decomposition, a refined version of the $k-$core. By selecting subsets of nodes in a particular layer of the onion spectrum that follow similar trajectories in the percolation process, percolating phases can be distinguished from non-percolating ones through an unsupervised clustering method. Accuracy in the initial step is essential for extracting samples with information-rich content, that are subsequently used to predict the critical transition point through the confusion scheme, a recently introduced learning method. The method circumvents the difficulty of missing data or noisy measurements, as it allows for sampling nodes from both the core and periphery, as well as intermediate layers. We validate the effectiveness of our sampling strategy on a spectrum of synthetic network topologies, as well as on two real-word case studies: the integration time of the US domestic airport network, and the identification of the epidemic cluster of COVID-19 outbreaks in three major US states. The method proposed here allows for identifying phase transitions in empirical time-varying networks.


title: A non-parametric Bayesian approach for adjusting partial compliance in sequential decision making

abstract: Existing methods in estimating the mean outcome under a given dynamic treatment regime rely on intention-to-treat analyses which estimate the effect of following a certain dynamic treatment regime regardless of compliance behavior of patients. There are two major concerns with intention-to-treat analyses: (1) the estimated effects are often biased toward the null effect; (2) the results are not generalizable and reproducible due to the potential differential compliance behavior. These are particularly problematic in settings with high level of non-compliance such as substance use disorder treatments. Our work is motivated by the Adaptive Treatment for Alcohol and Cocaine Dependence study (ENGAGE), which is a multi-stage trial that aimed to construct optimal treatment strategies to engage patients in therapy. Due to the relatively low level of compliance in this trial, intention-to-treat analyses essentially estimate the effect of being randomized to a certain treatment sequence which is not of interest. We fill this important gap by defining the target parameter as the mean outcome under a dynamic treatment regime given potential compliance strata. We propose a flexible non-parametric Bayesian approach, which consists of a Gaussian copula model for the potential compliances, and a Dirichlet process mixture model for the potential outcomes. Our simulations highlight the need for and usefulness of this approach in practice and illustrate the robustness of our estimator in non-linear and non-Gaussian settings.


title: Automatic Home-based Screening of Obstructive Sleep Apnea Using Single Channel Electrocardiogram and SPO2 Signals

abstract: Obstructive sleep apnea (OSA) is one of the most widespread respiratory diseases today. Complete or relative breathing cessations due to upper airway subsidence during sleep is OSA. It has confirmed potential influence on Covid-19 hospitalization and mortality, and is strongly associated with major comorbidities of severe Covid-19 infection. Un-diagnosed OSA may also lead to a variety of severe physical and mental side-effects. To score OSA severity, nocturnal sleep monitoring is performed under defined protocols and standards called polysomnography (PSG). This method is time-consuming, expensive, and requiring professional sleep technicians. Automatic home-based detection of OSA is welcome and in great demand. It is a fast and effective way for referring OSA suspects to sleep clinics for further monitoring. On-line OSA detection also can be a part of a closed-loop automatic control of the OSA therapeutic/assistive devices. In this paper, several solutions for online OSA detection are introduced and tested on 155 subjects of three different databases. The best combinational solution uses mutual information (MI) analysis for selecting out of ECG and SpO2-based features. Several methods of supervised and unsupervised machine learning are employed to detect apnoeic episodes. To achieve the best performance, the most successful classifiers in four different ternary combination methods are used. The proposed configurations exploit limited use of biological signals, have online working scheme, and exhibit uniform and acceptable performance (over 85%) in all the employed databases. The benefits have not been gathered all together in the previous published methods.


title: A Deep Learning Approach To Dead-Reckoning Navigation For Autonomous Underwater Vehicles With Limited Sensor Payloads

abstract: This paper presents a deep learning approach to aid dead-reckoning (DR) navigation using a limited sensor suite. A Recurrent Neural Network (RNN) was developed to predict the relative horizontal velocities of an Autonomous Underwater Vehicle (AUV) using data from an IMU, pressure sensor, and control inputs. The RNN network is trained using experimental data, where a doppler velocity logger (DVL) provided ground truth velocities. The predictions of the relative velocities were implemented in a dead-reckoning algorithm to approximate north and east positions. The studies in this paper were twofold I) Experimental data from a Long-Range AUV was investigated. Datasets from a series of surveys in Monterey Bay, California (U.S) were used to train and test the RNN network. II) The second study explore datasets generated by a simulated autonomous underwater glider. Environmental variables e.g ocean currents were implemented in the simulation to reflect real ocean conditions. The proposed neural network approach to DR navigation was compared to the on-board navigation system and ground truth simulated positions.


title: Evaluation of short-term temporal evolution of Pluto's surface composition from 2014-2017 with APO/TripleSpec

abstract: In this work we present the results of a spectral observing campaign of Pluto to search for temporal changes in surface composition on 1- to 3-year timescales. Near-infrared spectra of Pluto were obtained from June 2014 to August 2017 with the TripleSpec cross-dispersed spectrograph at the Apache Point Observatory's 3.5-meter Astrophysical Research Consortium (ARC) telescope. Observations were requested in order to obtain spectra of approximately the same sub-observer hemisphere $\sim$14 months apart, thus removing the effects of viewing geometry and rotation phase. Comparison of the CH$_4$ (methane) band areas and band center shifts between each component of these "matched pairs" revealed a surface in transition. Band areas for the 1.66 and 1.72 $\mu$m CH$_4$ absorption features exhibited a $>$5-$\sigma$ increase between 2014-06-17 and 2015-08-19, corresponding to a sub-observer hemisphere centered at $\sim$280$^{\circ}$E, with the latter date only 1 month after the New Horizons flyby of Pluto. The majority of matched pairs were obtained of the anti-Charon hemisphere, home to the bright, volatile-rich Sputnik Planitia, and did not present statistically significant changes in CH$_4$ band areas. CH$_4$ band center shifts, which provide information on the mixing state of CH$_4$ and N$_2$ in solid solution, were calculated between components of each matched pair, with no significant band shifts detected. The favored explanation for these combined results is the sublimation of more-volatile N$_2$ from the northern latitudes of Pluto in the lead-up to northern hemisphere summer solstice in 2029, leading to an increase in CH$_4$ concentration.


title: On grid homology for lens space links: combinatorial invariance and integral coefficients

abstract: Following the approach to grid homology of links in $S^3$, we prove combinatorially that the grid homology of links in lens spaces defined by Baker, Grigsby, and Hedden is a link invariant. Further, using the sign assignment defined by Celoria, we prove that the generalization of grid homology to integral coefficients is a link invariant.


title: Almost Yamabe Solitons on a Total Space of Almost Hermitian Submersions

abstract: This article presents the study of almost Hermitian submersion from an almost Yamabe soliton onto an almost Hermitian manifold. A non-trivial example is also mentioned in order to guarantee the existence of such solitons on the total space of almost Hermitian submersions. We mainly focus on Kaehler submersions from Kaehler manifolds which are special case of almost Hermitian submersions. Under certain conditions, we find out that the fibres and the base manifold of such submersions are almost Yamabe soliton. We give the characterizations for an almost Yamabe soliton of a Kaehler submersion to be shrinking, steady and expanding in terms of extrinsic horizontal scalar curvature. Moreover, we observe the behavior of torqued, recurrent and concurrent vector field of the total space of the Kaehler submersion. In particular, we obtain characterization for an almost Yamabe soliton consisting of concurrent vector fields. Meanwhile, we give some results of such submersions when the total space is Yamabe soliton which is a particular case of almost Yamabe soliton.


title: Online Distribution System State Estimation via Stochastic Gradient Algorithm

abstract: Distribution network operation is becoming more challenging because of the growing integration of intermittent and volatile distributed energy resources (DERs). This motivates the development of new distribution system state estimation (DSSE) paradigms that can operate at fast timescale based on real-time data stream of asynchronous measurements enabled by modern information and communications technology. To solve the real-time DSSE with asynchronous measurements effectively and accurately, this paper formulates a weighted least squares DSSE problem and proposes an online stochastic gradient algorithm to solve it. The performance of the proposed scheme is analytically guaranteed and is numerically corroborated with realistic data on IEEE-123 bus feeder.


title: ReDUCE: Reformulation of Mixed Integer Programs using Data from Unsupervised Clusters for Learning Efficient Strategies

abstract: Mixed integer convex and nonlinear programs, MICP and MINLP, are expressive but require long solving times. Recent work that combines learning methods on solver heuristics has shown potential to overcome this issue allowing for applications on larger scale practical problems. Gathering sufficient training data to employ these methods still present a challenge since getting data from traditional solvers are slow and newer learning approaches still require large amounts of data. In order to scale up and make these hybrid learning approaches more manageable we propose ReDUCE, a method that exploits structure within small to medium size datasets. We also introduce the bookshelf organization problem as an MINLP as a way to measure performance of solvers with ReDUCE. Results show that existing algorithms with ReDUCE can solve this problem within a few seconds, a significant improvement over the original formulation. ReDUCE is demonstrated as a high level planner for a robotic arm for the bookshelf problem.


title: Data-Driven Detection and Identification of IoT-Enabled Load-Altering Attacks in Power Grids

abstract: Advances in edge computing are powering the development and deployment of Internet of Things (IoT) systems to provide advanced services and resource efficiency. However, large-scale IoT-based load-altering attacks (LAAs) can seriously impact power grid operations, such as destabilising the grid's control loops. Timely detection and identification of any compromised nodes are essential to minimise the adverse effects of these attacks on power grid operations. In this work, two data-driven algorithms are proposed to detect and identify compromised nodes and the attack parameters of the LAAs. The first method, based on the Sparse Identification of Nonlinear Dynamics (SINDy) approach, adopts a sparse regression framework to identify attack parameters that best describe the observed dynamics. The second method, based on physics-informed neural networks (PINN), employs neural networks to infer the attack parameters from the measurements. Both algorithms are presented utilising edge computing for deployment over decentralised architectures. Extensive simulations are performed on IEEE 6-,14- and 39-bus systems to verify the effectiveness of the proposed methods. Numerical results confirm that the proposed algorithms outperform existing approaches, such as those based on unscented Kalman filter, support vector machines (SVM), and neural networks (NN), and effectively detect and identify locations of attack in a timely manner.


title: Cognitive control as a multivariate optimization problem

abstract: Research has characterized the various forms cognitive control can take, including enhancement of goal-relevant information, suppression of goal-irrelevant information, and overall inhibition of potential responses, and has identified computations and neural circuits that underpin this multitude of control types. Studies have also identified a wide range of situations that elicit adjustments in control allocation (e.g., those eliciting signals indicating an error or increased processing conflict), but the rules governing when a given situation will give rise to a given control adjustment remain poorly understood. Significant progress has recently been made on this front by casting the allocation of control as a decision-making problem, and developing unifying and normative models that prescribe when and how a change in incentives and task demands will result in changes in a given form of control. Despite their successes, these models, and the experiments that have been developed to test them, have yet to face their greatest challenge: deciding how to allocate control across the multiplicity of control signals that one could engage at any given time. Here, we will lay out the complexities of the inverse problem inherent to cognitive control allocation, and their close parallels to inverse problems within motor control (e.g., choosing between redundant limb movements). We discuss existing solutions to motor control`s inverse problems drawn from optimal control theory, which have proposed that effort costs act to regularize actions and transform motor planning into a well-posed problem. These same principles may help shed light on how our brains optimize over complex control configuration, while providing a new normative perspective on the origins of mental effort.


title: Expanding the Design Space for Electrically-Driven Soft Robots through Handed Shearing Auxetics

abstract: Handed Shearing Auxetics (HSA) are a promising structure for making electrically driven robots with distributed compliance that convert a motors rotation and torque into extension and force. We overcame past limitations on the range of actuation, blocked force, and stiffness by focusing on two key design parameters: the point of an HSA's auxetic trajectory that is energetically preferred, and the number of cells along the HSAs length. Modeling the HSA as a programmable spring, we characterize the effect of both on blocked force, minimum energy length, spring constant, angle range and holding torque. We also examined the effect viscoelasticity has on actuation forces over time. By varying the auxetic trajectory point, we were able to make actuators that can push, pull, or do both. We expanded the range of forces possible from 5N to 150N, and the range of stiffness from 2 N/mm to 89 N/mm. For a fixed point on the auxetic trajectory, we found decreasing length can improve force output, at the expense of needing higher torques, and having a shorter throw. We also found that the viscoelastic effects can limit the amount of force a 3D printed HSA can apply over time.


title: Asymptotic symmetry and asymptotic solutions to Ito stochastic differential equations

abstract: We consider several aspects of conjugating symmetry methods, including the method of invariants, with an asymptotic approach. In particular we consider how to extend to the stochastic setting several ideas which are well established in the deterministic one, such as conditional, partial and asymptotic symmetries. A number of explicit examples are presented.


title: Fast and Exact Convex Hull Simplification

abstract: Given a point set $P$ in the plane, we seek a subset $Q\subseteq P$, whose convex hull gives a smaller and thus simpler representation of the convex hull of $P$. Specifically, let $cost(Q,P)$ denote the Hausdorff distance between the convex hulls $\mathcal{CH}(Q)$ and $\mathcal{CH}(P)$. Then given a value $\varepsilon>0$ we seek the smallest subset $Q\subseteq P$ such that $cost(Q,P)\leq \varepsilon$. We also consider the dual version, where given an integer $k$, we seek the subset $Q\subseteq P$ which minimizes $cost(Q,P)$, such that $|Q|\leq k$. For these problems, when $P$ is in convex position, we respectively give an $O(n\log^2 n)$ time algorithm and an $O(n\log^3 n)$ time algorithm, where the latter running time holds with high probability. When there is no restriction on $P$, we show the problem can be reduced to APSP in an unweighted directed graph, yielding an $O(n^{2.5302})$ time algorithm when minimizing $k$ and an $O(\min\{n^{2.5302}, kn^{2.376}\})$ time algorithm when minimizing $\varepsilon$, using prior results for APSP. Finally, we show our near linear algorithms for convex position give 2-approximations for the general case.


title: Low Frequency Names Exhibit Bias and Overfitting in Contextualizing Language Models

abstract: We use a dataset of U.S. first names with labels based on predominant gender and racial group to examine the effect of training corpus frequency on tokenization, contextualization, similarity to initial representation, and bias in BERT, GPT-2, T5, and XLNet. We show that predominantly female and non-white names are less frequent in the training corpora of these four language models. We find that infrequent names are more self-similar across contexts, with Spearman's r between frequency and self-similarity as low as -.763. Infrequent names are also less similar to initial representation, with Spearman's r between frequency and linear centered kernel alignment (CKA) similarity to initial representation as high as .702. Moreover, we find Spearman's r between racial bias and name frequency in BERT of .492, indicating that lower-frequency minority group names are more associated with unpleasantness. Representations of infrequent names undergo more processing, but are more self-similar, indicating that models rely on less context-informed representations of uncommon and minority names which are overfit to a lower number of observed contexts.


title: Multi-Agent Algorithmic Recourse

abstract: The recent adoption of machine learning as a tool in real world decision making has spurred interest in understanding how these decisions are being made. Counterfactual Explanations are a popular interpretable machine learning technique that aims to understand how a machine learning model would behave if given alternative inputs. Many explanations attempt to go further and recommend actions an individual could take to obtain a more desirable output from the model. These recommendations are known as algorithmic recourse. Past work has largely focused on the effect algorithmic recourse has on a single agent. In this work, we show that when the assumption of a single agent environment is relaxed, current approaches to algorithmic recourse fail to guarantee certain ethically desirable properties. Instead, we propose a new game theory inspired framework for providing algorithmic recourse in a multi-agent environment that does guarantee these properties.


title: Piezo-deformable Mirrors for Active Mode Matching in Advanced LIGO

abstract: The detectors of the laser interferometer gravitational-wave observatory (LIGO) are broadly limited by the quantum noise and rely on the injection of squeezed states of light to achieve their full sensitivity. Squeezing improvement is limited by mode mismatch between the elements of the squeezer and the interferometer. In the current LIGO detectors, there is no way to actively mitigate this mode mismatch. This paper presents a new deformable mirror for wavefront control that meets the active mode matching requirements of advanced LIGO. The active element is a piezo-electric transducer, which actuates on the radius of curvature of a 5 mm thick mirror via an axisymmetric flexure. The operating range of the deformable mirror is 120+-8 mD in vacuum, with an additional 200 mD adjustment range accessible out of vacuum. The scattering into higher-order modes is measured to be <0.2% over the nominal beam radius. These piezo-deformable mirrors meet the stringent noise and vacuum requirements of advanced LIGO and will be used for the next observing run (O4) to control the mode-matching between the squeezer and the interferometer.


title: Contraction Theory for Nonlinear Stability Analysis and Learning-based Control: A Tutorial Overview

abstract: Contraction theory is an analytical tool to study differential dynamics of a non-autonomous (i.e., time-varying) nonlinear system under a contraction metric defined with a uniformly positive definite matrix, the existence of which results in a necessary and sufficient characterization of incremental exponential stability of multiple solution trajectories with respect to each other. By using a squared differential length as a Lyapunov-like function, its nonlinear stability analysis boils down to finding a suitable contraction metric that satisfies a stability condition expressed as a linear matrix inequality, indicating that many parallels can be drawn between well-known linear systems theory and contraction theory for nonlinear systems. Furthermore, contraction theory takes advantage of a superior robustness property of exponential stability used in conjunction with the comparison lemma. This yields much-needed safety and stability guarantees for neural network-based control and estimation schemes, without resorting to a more involved method of using uniform asymptotic stability for input-to-state stability. Such distinctive features permit systematic construction of a contraction metric via convex optimization, thereby obtaining an explicit exponential bound on the distance between a time-varying target trajectory and solution trajectories perturbed externally due to disturbances and learning errors. The objective of this paper is therefore to present a tutorial overview of contraction theory and its advantages in nonlinear stability analysis of deterministic and stochastic systems, with an emphasis on deriving formal robustness and stability guarantees for various learning-based and data-driven automatic control methods. In particular, we provide a detailed review of techniques for finding contraction metrics and associated control and estimation laws using deep neural networks.


title: A Survey of Novae in M83

abstract: The results of the first synoptic survey of novae in the barred spiral and starburst galaxy, M83 (NGC 5236), are presented. A total of 19 novae and one background supernova were discovered during the course of a nearly seven-year survey comprised of over 200 individual nights of observation between 2012 December 12 and 2019 March 14. After correcting for the limiting magnitude and the spatial and temporal coverage of the survey, the nova rate in M83 was found to be $R=19^{+5}_{-3}$ yr$^{-1}$. This rate, when normalized to the $K$-band luminosity of the galaxy, yields a luminosity-specific nova rate, $\nu_K = 3.0^{+0.9}_{-0.6}\times10^{-10}$ yr$^{-1} L_{\odot,K}^{-1}$. The spatial distribution of the novae is found to be more extended than the overall galaxy light suggesting that the observed novae are likely dominated by a disk population. This result is consistent with the observed nova light curves which reveal that the M83 novae are on average more luminous at maximum light and fade faster when compared with novae observed in M31. Generally, the more luminous M83 novae were observed to fade more rapidly, with the complete sample being broadly consistent with a linear Maximum-Magnitude vs Rate of Decline relation.


title: SolType: Refinement Types for Arithmetic Overflow in Solidity

abstract: As smart contracts gain adoption in financial transactions, it becomes increasingly important to ensure that they are free of bugs and security vulnerabilities. Of particular relevance in this context are arithmetic overflow bugs, as integers are often used to represent financial assets like account balances. Motivated by this observation, this paper presents SolType, a refinement type system for Solidity that can be used to prevent arithmetic over- and under-flows in smart contracts. SolType allows developers to add refinement type annotations and uses them to prove that arithmetic operations do not lead to over- and under-flows. SolType incorporates a rich vocabulary of refinement terms that allow expressing relationships between integer values and aggregate properties of complex data structures. Furthermore, our implementation, called Solid, incorporates a type inference engine and can automatically infer useful type annotations, including non-trivial contract invariants. To evaluate the usefulness of our type system, we use Solid to prove arithmetic safety of a total of 120 smart contracts. When used in its fully automated mode (i.e., using Solid's type inference capabilities), Solid is able to eliminate 86.3% of redundant runtime checks used to guard against overflows. We also compare Solid against a state-of-the-art arithmetic safety verifier called VeriSmart and show that Solid has a significantly lower false positive rate, while being significantly faster in terms of verification time.


title: Speech Technology for Everyone: Automatic Speech Recognition for Non-Native English with Transfer Learning

abstract: To address the performance gap of English ASR models on L2 English speakers, we evaluate fine-tuning of pretrained wav2vec 2.0 models (Baevski et al., 2020; Xu et al., 2021) on L2-ARCTIC, a non-native English speech corpus (Zhao et al., 2018) under different training settings. We compare \textbf{(a)} models trained with a combination of diverse accents to ones trained with only specific accents and \textbf{(b)} results from different single-accent models. Our experiments demonstrate the promise of developing ASR models for non-native English speakers, even with small amounts of L2 training data and even without a language model. Our models also excel in the zero-shot setting where we train on multiple L2 datasets and test on a blind L2 test set.


title: Unequal binary configurations of interacting Kerr-Newman black holes

abstract: In this paper, binary systems of unequal Kerr-Newman black holes located on the axis and apart by a massless strut are investigated. After adopting a fitting parametrization, the conditions on the axis and the one eliminating the individual magnetic charges are solved exactly with the aim to obtain a 7-parametric asymptotically flat exact solution. It is also deduced explicit analytical formulas for each half-length horizon ${\sigma}_{i}$, $i = 1,2$, in terms of arbitrary physical Komar parameters: mass $M_{i}$, electric charge $Q_{i}$, angular momentum $J_{i}$, and a coordinate distance $R$. All the thermodynamical properties for the black holes as well as the interaction force related to the strut are also given in a concise way. Our analysis permits us to derive in detail the physical limits of the solution and introduce some scenarios where the strut is absent during the merger process.


title: Collecting and Characterizing Natural Language Utterances for Specifying Data Visualizations

abstract: Natural language interfaces (NLIs) for data visualization are becoming increasingly popular both in academic research and in commercial software. Yet, there is a lack of empirical understanding of how people specify visualizations through natural language. To bridge this gap, we conducted an online study with 102 participants. We showed participants a series of ten visualizations for a given dataset and asked them to provide utterances they would pose to generate the displayed charts. The curated list of utterances generated from the study is provided below. This corpus of utterances can be used to evaluate existing NLIs for data visualization as well as for creating new systems and models to generate visualizations from natural language utterances.


title: A systematic evaluation of methods for cell phenotype classification using single-cell RNA sequencing data

abstract: Background: Single-cell RNA sequencing (scRNA-seq) yields valuable insights about gene expression and gives critical information about complex tissue cellular composition. In the analysis of single-cell RNA sequencing, the annotations of cell subtypes are often done manually, which is time-consuming and irreproducible. Garnett is a cell-type annotation software based the on elastic net method. Besides cell-type annotation, supervised machine learning methods can also be applied to predict other cell phenotypes from genomic data. Despite the popularity of such applications, there is no existing study to systematically investigate the performance of those supervised algorithms in various sizes of scRNA-seq data sets. Methods and Results: This study evaluates 13 popular supervised machine learning algorithms to classify cell phenotypes, using published real and simulated data sets with diverse cell sizes. The benchmark contained two parts. In the first part, we used real data sets to assess the popular supervised algorithms' computing speed and cell phenotype classification performance. The classification performances were evaluated using AUC statistics, F1-score, precision, recall, and false-positive rate. In the second part, we evaluated gene selection performance using published simulated data sets with a known list of real genes. Conclusion: The study outcomes showed that ElasticNet with interactions performed best in small and medium data sets. NB was another appropriate method for medium data sets. In large data sets, XGB works excellent. Ensemble algorithms were not significantly superior to individual machine learning methods. Adding interactions to ElasticNet can help, and the improvement was significant in small data sets.


title: Multi-view SA-LA Net: A framework for simultaneous segmentation of RV on multi-view cardiac MR Images

abstract: We proposed a multi-view SA-LA model for simultaneous segmentation of RV on the short-axis (SA) and long-axis (LA) cardiac MR images. The multi-view SA-LA model is a multi-encoder, multi-decoder U-Net architecture based on the U-Net model. One encoder-decoder pair segments the RV on SA images and the other pair on LA images. Multi-view SA-LA model assembles an extremely rich set of synergistic features, at the root of the encoder branch, by combining feature maps learned from matched SA and LA cardiac MR images. Segmentation performance is further enhanced by: (1) incorporating spatial context of LV as a prior and (2) performing deep supervision in the last three layers of the decoder branch. Multi-view SA-LA model was extensively evaluated on the MICCAI 2021 Multi- Disease, Multi-View, and Multi- Centre RV Segmentation Challenge dataset (M&Ms-2021). M&Ms-2021 dataset consists of multi-phase, multi-view cardiac MR images of 360 subjects acquired at four clinical centers with three different vendors. On the challenge cohort (160 subjects), the proposed multi-view SA-LA model achieved a Dice Score of 91% and Hausdorff distance of 11.2 mm on short-axis images and a Dice Score of 89.6% and Hausdorff distance of 8.1 mm on long-axis images. Moreover, multi-view SA-LA model exhibited strong generalization to unseen RV related pathologies including Dilated Right Ventricle (DSC: SA 91.41%, LA 89.63%) and Tricuspidal Regurgitation (DSC: SA 91.40%, LA 90.40%) with low variance (std_DSC: SA <5%, LA<6%).


title: Learning through atypical "phase transitions" in overparameterized neural networks

abstract: Current deep neural networks are highly overparameterized (up to billions of connection weights) and nonlinear. Yet they can fit data almost perfectly through variants of gradient descent algorithms and achieve unexpected levels of prediction accuracy without overfitting. These are formidable results that defy predictions of statistical learning and pose conceptual challenges for non-convex optimization. In this paper, we use methods from statistical physics of disordered systems to analytically study the computational fallout of overparameterization in non-convex binary neural network models, trained on data generated from a structurally simpler but "hidden" network. As the number of connection weights increases, we follow the changes of the geometrical structure of different minima of the error loss function and relate them to learning and generalization performance. A first transition happens at the so-called interpolation point, when solutions begin to exist (perfect fitting becomes possible). This transition reflects the properties of typical solutions, which however are in sharp minima and hard to sample. After a gap, a second transition occurs, with the discontinuous appearance of a different kind of "atypical" structures: wide regions of the weight space that are particularly solution-dense and have good generalization properties. The two kinds of solutions coexist, with the typical ones being exponentially more numerous, but empirically we find that efficient algorithms sample the atypical, rare ones. This suggests that the atypical phase transition is the relevant one for learning. The results of numerical tests with realistic networks on observables suggested by the theory are consistent with this scenario.


title: Learning Compact Representations of Neural Networks using DiscriminAtive Masking (DAM)

abstract: A central goal in deep learning is to learn compact representations of features at every layer of a neural network, which is useful for both unsupervised representation learning and structured network pruning. While there is a growing body of work in structured pruning, current state-of-the-art methods suffer from two key limitations: (i) instability during training, and (ii) need for an additional step of fine-tuning, which is resource-intensive. At the core of these limitations is the lack of a systematic approach that jointly prunes and refines weights during training in a single stage, and does not require any fine-tuning upon convergence to achieve state-of-the-art performance. We present a novel single-stage structured pruning method termed DiscriminAtive Masking (DAM). The key intuition behind DAM is to discriminatively prefer some of the neurons to be refined during the training process, while gradually masking out other neurons. We show that our proposed DAM approach has remarkably good performance over various applications, including dimensionality reduction, recommendation system, graph representation learning, and structured pruning for image classification. We also theoretically show that the learning objective of DAM is directly related to minimizing the L0 norm of the masking layer.


title: Fast Multi-Resolution Transformer Fine-tuning for Extreme Multi-label Text Classification

abstract: Extreme multi-label text classification (XMC) seeks to find relevant labels from an extreme large label collection for a given text input. Many real-world applications can be formulated as XMC problems, such as recommendation systems, document tagging and semantic search. Recently, transformer based XMC methods, such as X-Transformer and LightXML, have shown significant improvement over other XMC methods. Despite leveraging pre-trained transformer models for text representation, the fine-tuning procedure of transformer models on large label space still has lengthy computational time even with powerful GPUs. In this paper, we propose a novel recursive approach, XR-Transformer to accelerate the procedure through recursively fine-tuning transformer models on a series of multi-resolution objectives related to the original XMC objective function. Empirical results show that XR-Transformer takes significantly less training time compared to other transformer-based XMC models while yielding better state-of-the-art results. In particular, on the public Amazon-3M dataset with 3 million labels, XR-Transformer is not only 20x faster than X-Transformer but also improves the Precision@1 from 51% to 54%.


title: Touching Art -- A Method for Visualizing Tactile Experience

abstract: It is human to want to touch artworks, to feel their surface curvature and texture, their shapes and structures, and to feel the hand of the artist. Museum guards need to be constantly vigilant to protect art objects from adoring and exploring touches by visitors. This paper introduces a novel technique for capturing where and how art objects are touched. In this method, the users' touch either adds, or subtracts, microscopic fluorescent particles from a three-dimensional art object. Viewing the object under ultraviolet light reveals their touch traces and gestures. We present human touch behavior for a three-dimensional stylized landscape, and for two abstract and two representational art objects. We also present the results of video recordings of real-time behavior and user interviews. The resulting data show the kinds of touches, and where they are directed, and also reveal important individual differences. We feel this method opens the door to studying art perception through touch, and also enables new kinds of studies into touch behavior in other applications, including visualization, embodied cognition, and design.


title: Investigating Robustness of Dialog Models to Popular Figurative Language Constructs

abstract: Humans often employ figurative language use in communication, including during interactions with dialog systems. Thus, it is important for real-world dialog systems to be able to handle popular figurative language constructs like metaphor and simile. In this work, we analyze the performance of existing dialog models in situations where the input dialog context exhibits use of figurative language. We observe large gaps in handling of figurative language when evaluating the models on two open domain dialog datasets. When faced with dialog contexts consisting of figurative language, some models show very large drops in performance compared to contexts without figurative language. We encourage future research in dialog modeling to separately analyze and report results on figurative language in order to better test model capabilities relevant to real-world use. Finally, we propose lightweight solutions to help existing models become more robust to figurative language by simply using an external resource to translate figurative language to literal (non-figurative) forms while preserving the meaning to the best extent possible.


title: Transverse Hydraulic Fracture Initiation: Insights from Intermediate-Scale Hydraulic Fracture Tests

abstract: In a uniform stress field, a tensile hydraulic fracture will favor propagation in the plane formed by the maximum (most compressive) and intermediate principal stresses. For the propagation of hydraulic fractures in non-uniform stress fields, especially those where the principal stress directions change spatially, things become much more complex, are less well understood, and therefore are more difficult to predict. Such is often the case when a hydraulic fracture is initiated from a borehole drilled in the direction of the minimum principal stress. This is a well-known problem that has been the subject of several numerical and experimental studies. The purpose of this paper is to offer new insights from a series of hydraulic fracture tests conducted in sub-horizontal boreholes drilled in the Sanford Underground Research Facility. This project, called the Enhanced Geothermal Systems (EGS) Collab project, has developed a test bed at a depth of approximately 1478 meters underground consisting of sub-horizontal injection, production, and monitoring wells. This paper presents stimulation test data, and supporting geologic/geophysical characterization data. The test data are compared to previous numerical and experimental studies to determine how well this new experimental data compares with previous modeling, laboratory, and field tests.


title: Exotic series with Bernoulli, harmonic, Catalan, and Stirling numbers

abstract: In this paper, we present a formula for generating various exotic series in the spirit of Ovidiu Furdui and Alina Sintamarian. Our new series (evaluated in closed form) involve Bernoulli, harmonic, and Catalan numbers. Also Stirling numbers of the second kind, other special numbers, and exponential polynomials. The results include series identities with Laguerre polynomials and derangement polynomials.


title: On the Origins and Relevance of the Equal Transit Time Fallacy to Explain Lift

abstract: Recently, aerodynamics syllabi have changed in high schools, pilot ground training, and even undergraduate physics. In contrast, there has been no change in the basic theory taught to aeronautical or aerospace engineers. What has changed is technology, both experimentally and computationally. The internet and social media have also empowered citizen science such that the deficiencies in the legacy physics education around flight and lift are well known. The long-standing equal transit time (ETT) theory to explain lift has been proven false. If incorrect, why was it ever taught? Through a historical analysis of relevant fluid and aerodynamics literature, this study attempts to explain why ETT theory is part of our collectively lower-level cognitive understanding of lift and flight. It was found that in 1744 D'Alembert himself assumed this to be a feature of moving fluids, and while this initial intuition (ETT 1.0) was incorrect, the property of ETT (ETT 2.0) was derived in 1752 when applying Newton's laws of motion to fluids. This incorrect result was independently confirmed in 1757 by Euler! The conclusion is that an over simplified treatment of fluids predicts ETT, along with no lift and drag. This then leads to the open question, can ETT be taught at an appropriately low level as an explanation for lift?


title: Universality of breath figures on two-dimensional surfaces: an experimental study

abstract: Droplet condensation on surfaces produces patterns, called breath figures. Their evolution into self-similar structures is a classical example of self-organization. It is described by a scaling theory with scaling functions whose universality has recently been challenged by numerical work. Here, we provide a thorough experimental testing, where we inspect substrates with vastly different chemical properties, stiffness, and condensation rates. We critically survey the size distributions, and the related time-asymptotic scaling of droplet number and surface coverage. In the time-asymptotic regime they admit a data collapse: the data for all substrates and condensation rates lie on universal scaling functions.


title: Decomposing a graph into subgraphs with small components

abstract: The component size of a graph is the maximum number of edges in any connected component of the graph. Given a graph $G$ and two integers $k$ and $c$, $(k,c)$-Decomposition is the problem of deciding whether $G$ admits an edge partition into $k$ subgraphs with component size at most $c$. We prove that for any fixed $k \ge 2$ and $c \ge 2$, $(k,c)$-Decomposition is NP-complete in bipartite graphs. Also, when both $k$ and $c$ are part of the input, $(k,c)$-Decomposition is NP-complete even in trees. Moreover, $(k,c)$-Decomposition in trees is W[1]-hard with parameter $k$, and is FPT with parameter $c$. In addition, we present approximation algorithms for decomposing a tree either into the minimum number of subgraphs with component size at most $c$, or into $k$ subgraphs minimizing the maximum component size. En route to these results, we also obtain a fixed-parameter algorithm for Bin Packing with the bin capacity as parameter.


title: A Theoretical Overview of Neural Contraction Metrics for Learning-based Control with Guaranteed Stability

abstract: This paper presents a theoretical overview of a Neural Contraction Metric (NCM): a neural network model of an optimal contraction metric and corresponding differential Lyapunov function, the existence of which is a necessary and sufficient condition for incremental exponential stability of non-autonomous nonlinear system trajectories. Its innovation lies in providing formal robustness guarantees for learning-based control frameworks, utilizing contraction theory as an analytical tool to study the nonlinear stability of learned systems via convex optimization. In particular, we rigorously show in this paper that, by regarding modeling errors of the learning schemes as external disturbances, the NCM control is capable of obtaining an explicit bound on the distance between a time-varying target trajectory and perturbed solution trajectories, which exponentially decreases with time even under the presence of deterministic and stochastic perturbation. These useful features permit simultaneous synthesis of a contraction metric and associated control law by a neural network, thereby enabling real-time computable and probably robust learning-based control for general control-affine nonlinear systems.


title: Dirac series for complex $E_7$

abstract: This paper classifies the Dirac series for complex $E_7$. As applications, we verify a few conjectures raised in 2011, 2019 and 2020 for this exceptional Lie group. In particular, according to Conjecture 1.1 of Barbasch and Pandzic [BP], our classification should be helpful for understanding the unitary dual of complex $E_7$.


title: Deep Learning for Rain Fade Prediction in Satellite Communications

abstract: Line of sight satellite systems, unmanned aerial vehicles, high-altitude platforms, and microwave links that operate on frequency bands such as Ka-band or higher are extremely susceptible to rain. Thus, rain fade forecasting for these systems is critical because it allows the system to switch between ground gateways proactively before a rain fade event to maintain seamless service. Although empirical, statistical, and fade slope models can predict rain fade to some extent, they typically require statistical measurements of rain characteristics in a given area and cannot be generalized to a large scale system. Furthermore, such models typically predict near-future rain fade events but are incapable of forecasting far into the future, making proactive resource management more difficult. In this paper, a deep learning (DL)-based architecture is proposed that forecasts future rain fade using satellite and radar imagery data as well as link power measurements. Furthermore, the data preprocessing and architectural design have been thoroughly explained and multiple experiments have been conducted. Experiments show that the proposed DL architecture outperforms current state-of-the-art machine learning-based algorithms in rain fade forecasting in the near and long term. Moreover, the results indicate that radar data with weather condition information is more effective for short-term prediction, while satellite data with cloud movement information is more effective for long-term predictions.


title: Tao: A Learning Framework for Adaptive Nearest Neighbor Search using Static Features Only

abstract: Approximate nearest neighbor (ANN) search is a fundamental problem in areas such as data management,information retrieval and machine learning. Recently, Li et al. proposed a learned approach named AdaptNN to support adaptive ANN query processing. In the middle of query execution, AdaptNN collects a number of runtime features and predicts termination condition for each individual query, by which better end-to-end latency is attained. Despite its efficiency, using runtime features complicates the learning process and leads to performance degradation. Radically different from AdaptNN, we argue that it is promising to predict termination condition before query exetution. Particularly, we developed Tao, a general learning framework for Terminating ANN queries Adaptively using Only static features. Upon the arrival of a query, Tao first maps the query to a local intrinsic dimension (LID) number, and then predicts the termination condition using LID instead of runtime features. By decoupling prediction procedure from query execution, Tao eliminates the laborious feature selection process involved in AdaptNN. Besides, two design principles are formulated to guide the application of Tao and improve the explainability of the prediction model. We integrate two state-of-the-art indexing approaches, i.e., IMI and HNSW, into Tao, and evaluate the performance over several million to billion-scale datasets. Experimental results show that, in addition to its simplicity and generality , Tao achieves up to 2.69x speedup even compared to its counterpart, at the same high accuracy targets.


title: Clustering and Network Analysis for the Embedding Spaces of Sentences and Sub-Sentences

abstract: Sentence embedding methods offer a powerful approach for working with short textual constructs or sequences of words. By representing sentences as dense numerical vectors, many natural language processing (NLP) applications have improved their performance. However, relatively little is understood about the latent structure of sentence embeddings. Specifically, research has not addressed whether the length and structure of sentences impact the sentence embedding space and topology. This paper reports research on a set of comprehensive clustering and network analyses targeting sentence and sub-sentence embedding spaces. Results show that one method generates the most clusterable embeddings. In general, the embeddings of span sub-sentences have better clustering properties than the original sentences. The results have implications for future sentence embedding models and applications.


title: Light Field Saliency Detection with Dual Local Graph Learning andReciprocative Guidance

abstract: The application of light field data in salient object de-tection is becoming increasingly popular recently. The diffi-culty lies in how to effectively fuse the features within the fo-cal stack and how to cooperate them with the feature of theall-focus image. Previous methods usually fuse focal stackfeatures via convolution or ConvLSTM, which are both lesseffective and ill-posed. In this paper, we model the infor-mation fusion within focal stack via graph networks. Theyintroduce powerful context propagation from neighbouringnodes and also avoid ill-posed implementations. On the onehand, we construct local graph connections thus avoidingprohibitive computational costs of traditional graph net-works. On the other hand, instead of processing the twokinds of data separately, we build a novel dual graph modelto guide the focal stack fusion process using all-focus pat-terns. To handle the second difficulty, previous methods usu-ally implement one-shot fusion for focal stack and all-focusfeatures, hence lacking a thorough exploration of their sup-plements. We introduce a reciprocative guidance schemeand enable mutual guidance between these two kinds of in-formation at multiple steps. As such, both kinds of featurescan be enhanced iteratively, finally benefiting the saliencyprediction. Extensive experimental results show that theproposed models are all beneficial and we achieve signif-icantly better results than state-of-the-art methods.


title: Joint Estimation of System Inertia and Load Relief

abstract: Modern power systems with high share of renewable generation are at the risk of rapid changes in frequency and inertia resulting from contingencies. The importance of an accurate assessment of system and load relief, as well as frequency changes in the critical timescales is more pronounced in these power systems. This knowledge serves as an insight which will guide the solutions required for enhanced security and resilience. A novel procedure for simultaneously assessing system inertia and load relief using a closed-form system frequency response (SFR) model to fit measured disturbance data is presented. Results of applying the proposed approach on generator contingencies in the South West Interconnected System (SWIS) in Western Australia demonstrate the validity of the method and indicate that it can overcome some of the limitations observed in conventional inertia estimation methods based on the linearised swing equation, such as the sliding window and polynomial fit methods.


title: Electrically Switchable van der Waals Magnon Valves

abstract: Van der Waals magnets have emerged as a fertile ground for the exploration of highly tunable spin physics and spin-related technology. Two-dimensional (2D) magnons in van der Waals magnets are collective excitation of spins under strong confinement. Although considerable progress has been made in understanding 2D magnons, a crucial magnon device called the van der Waals magnon valve, in which the magnon signal can be completely and repeatedly turned on and off electrically, has yet to be realized. Here we demonstrate such magnon valves based on van der Waals antiferromagnetic insulator MnPS3. By applying DC electric current through the gate electrode, we show that the second harmonic thermal magnon (SHM) signal can be tuned from positive to negative. The guaranteed zero crossing during this tuning demonstrates a complete blocking of SHM transmission, arising from the nonlinear gate dependence of the non-equilibrium magnon density in the 2D spin channel. Using the switchable magnon valves we demonstrate a magnon-based inverter. These results illustrate the potential of van der Waals anti-ferromagnets for studying highly tunable spin-wave physics and for application in magnon-base circuitry in future information technology.


title: Graph Compression with Application to Model Selection

abstract: Many multivariate data such as social and biological data exhibit complex dependencies that are best characterized by graphs. Unlike sequential data, graphs are, in general, unordered structures. This means we can no longer use classic, sequential-based compression methods on these graph-based data. Therefore, it is necessary to develop new methods for graph compression. In this paper, we present universal source coding methods for the lossless compression of unweighted, undirected, unlabelled graphs. We encode in two steps: 1) transforming graph into a rooted binary tree, 2) the encoding rooted binary tree using graph statistics. Our coders showed better compression performance than other source coding methods on both synthetic and real-world graphs. We then applied our graph coding methods for model selection of Gaussian graphical models using minimum description length (MDL) principle finding the description length of the conditional independence graph. Experiments on synthetic data show that our approach gives better performance compared to common model selection methods. We also applied our approach to electrocardiogram (ECG) data in order to explore the differences between graph models of two groups of subjects.


title: Shape optimization of peristaltic pumps transporting rigid particles in Stokes flow

abstract: This paper presents a computational approach for finding the optimal shapes of peristaltic pumps transporting rigid particles in Stokes flow. In particular, we consider shapes that minimize the rate of energy dissipation while pumping a prescribed volume of fluid, number of particles and/or distance traversed by the particles over a set time period. Our approach relies on a recently developed fast and accurate boundary integral solver for simulating multiphase flows through periodic geometries of arbitrary shapes. In order to fully capitalize on the dimensionality reduction feature of the boundary integral methods, shape sensitivities must ideally involve evaluating the physical variables on the particle or pump boundaries only. We show that this can indeed be accomplished owing to the linearity of Stokes flow. The forward problem solves for the particle motion in a slip-driven pipe flow while the adjoint problems in our construction solve quasi-static Dirichlet boundary value problems backwards in time, retracing the particle evolution. The shape sensitivities simply depend on the solution of one forward and one adjoint (for each shape functional) problems. We validate these analytic shape derivative formulas by comparing against finite-difference based gradients and present several examples showcasing optimal pump shapes under various constraints.


title: Luminosity functions of globular clusters in five nearby spiral galaxies using HST/ACS images

abstract: We here present the luminosity function (LF) of globular clusters (GCs) in five nearby spiral galaxies using the samples of GC candidates selected in Hubble Space Telescope mosaic images in F435W, F555W and F814W filters. Our search, which surpasses the fractional area covered by all previous searches in these galaxies, has resulted in the detection of 158 GC candidates in M81, 1123 in M101, 226 in NGC4258, 293 in M51 and 173 in NGC628. The LFs constructed from this dataset, after correcting for relatively small contamination from reddened young clusters, are log-normal in nature, which was hitherto established only for the Milky Way (MW) and Andromeda among spiral galaxies. The magnitude at the turn-over (TO) corresponds to Mv(TO)=-7.41+/-0.14 in four of the galaxies with Hubble types Sc or earlier, in excellent agreement with Mv(TO)=-7.40+/-0.10 for the MW. The TO magnitude is equivalent to a mass of ~3x10^5 Msun for an old, metal-poor population. Mv(TO) is fainter by ~1.16 magnitude for the fifth galaxy, M101, which is of Hubble type Scd. The TO dependence on Hubble type implies that the GCs in early-type spirals are classical GCs, which have a universal TO, whereas the GC population in late-type galaxies is dominated by old disk clusters, which are in general less massive. The radial density distribution of GCs in our sample galaxies follows the S\'ersic function with exponential power-law indices, and effective radii of 4.0-9.5 kpc. GCs in the sample galaxies have a mean specific frequency of 1.10+/-0.24, after correcting for magnitude and radial incompleteness factors.


title: OSCAR: Data-Driven Operational Space Control for Adaptive and Robust Robot Manipulation

abstract: Learning performant robot manipulation policies can be challenging due to high-dimensional continuous actions and complex physics-based dynamics. This can be alleviated through intelligent choice of action space. Operational Space Control (OSC) has been used as an effective task-space controller for manipulation. Nonetheless, its strength depends on the underlying modeling fidelity, and is prone to failure when there are modeling errors. In this work, we propose OSC for Adaptation and Robustness (OSCAR), a data-driven variant of OSC that compensates for modeling errors by inferring relevant dynamics parameters from online trajectories. OSCAR decomposes dynamics learning into task-agnostic and task-specific phases, decoupling the dynamics dependencies of the robot and the extrinsics due to its environment. This structure enables robust zero-shot performance under out-of-distribution and rapid adaptation to significant domain shifts through additional finetuning. We evaluate our method on a variety of simulated manipulation problems, and find substantial improvements over an array of controller baselines. For more results and information, please visit https://cremebrule.github.io/oscar-web/.


title: Extensions of mod p representations of division algebras over non-Archimedean local fields

abstract: Let $F$ be a local field over $\mathbf{Q}_p$ or $\mathbf{F}_p((t))$, and let $D$ be a central simple division algebra over $F$ of degree $d$. In the $p$-adic case, we assume $p>de+1$ where $e$ is the ramification degree over $\mathbf{Q}_p$; otherwise, we need only assume $p$ and $d$ are coprime. For the subgroup $I_1=1+\varpi_D \mathcal{O}_D$ of $D^\times$ we determine the structure of $\mathrm{H}^1(I_1, \pi)$ as a representation of $D^\times/I_1$ for an arbitrary smooth irreducible representation $\pi$ of $D^\times$. We use this to compute the group $\mathrm{Ext}^1_{D^\times}(\pi,\pi')$ for arbitrary smooth irreducible representations $\pi$ and $\pi'$ of $D^\times$. In the $p$-adic case, via Poincar\'{e} duality we can compute the top cohomology groups and compute the highest degree extensions.


title: Effective equidistribution of expanding translates in the space of affine lattices

abstract: We prove a polynomially effective equidistribution result for expanding translates in the space of $d$-dimensional affine lattices for any $d\ge 2$.


title: Functional outlier detection for density-valued data with application to robustify distribution to distribution regression

abstract: Distributional data analysis, concerned with statistical analysis and modeling for data objects consisting of random probability density functions (PDFs) in the framework of functional data analysis (FDA), has received considerable interest in recent years. However, many important aspects remain unexplored, such as outlier detection and robustness. Existing functional outlier detection methods are mainly used for ordinary functional data and usually perform poorly when applied to PDFs. To fill this gap, this study focuses on PDF-valued outlier detection, as well as its application in robust distributional regression. Similar to ordinary functional data, detecting the shape outlier masked by the "curve net" formed by the bulk of the PDFs is the major challenge in PDF-outlier detection. To this end, we propose a tree-structured transformation system for feature extraction as well as converting the shape outliers to easily detectable magnitude outliers, relevant outlier detectors are designed for the specific transformed data. A multiple detection strategy is also proposed to account for detection uncertainties and to combine different detectors to form a more reliable detection tool. Moreover, we propose a distributional-regression-based approach for detecting the abnormal associations of PDF-valued two-tuples. As a specific application, the proposed outlier detection methods are applied to robustify a distribution-to-distribution regression method, and we develop a robust estimator for the regression operator by downweighting the detected outliers. The proposed methods are validated and evaluated by extensive simulation studies or real data applications. Relevant comparative studies demonstrate the superiority of the developed outlier detection method with other competitors in distributional outlier detection.


title: Universal Adversarial Spoofing Attacks against Face Recognition

abstract: We assess the vulnerabilities of deep face recognition systems for images that falsify/spoof multiple identities simultaneously. We demonstrate that, by manipulating the deep feature representation extracted from a face image via imperceptibly small perturbations added at the pixel level using our proposed Universal Adversarial Spoofing Examples (UAXs), one can fool a face verification system into recognizing that the face image belongs to multiple different identities with a high success rate. One characteristic of the UAXs crafted with our method is that they are universal (identity-agnostic); they are successful even against identities not known in advance. For a certain deep neural network, we show that we are able to spoof almost all tested identities (99\%), including those not known beforehand (not included in training). Our results indicate that a multiple-identity attack is a real threat and should be taken into account when deploying face recognition systems.


title: Unimodality and monotonic portions of certain domination polynomials

abstract: Given a simple graph $G$ on $n$ vertices, a subset of vertices $U \subseteq V(G)$ is dominating if every vertex of $V(G)$ is either in $U$ or adjacent to a vertex of $U$. The domination polynomial of $G$ is the generating function whose coefficients are the number of dominating sets of a given size. We show that the domination polynomial is unimodal, i.e., the coefficients are non-decreasing and then non-increasing, for several well-known families of graphs. In particular, we prove unimodality for spider graphs with at most $400$ legs (of arbitrary length), lollipop graphs, arbitrary direct products of complete graphs, and Cartesian products of two complete graphs. We show that for every graph, a portion of the coefficients are non-increasing, where the size of the portion depends on the upper domination number, and in certain cases this is sufficient to prove unimodality. Furthermore, we study graphs with $m$ universal vertices, i.e., vertices adjacent to every other vertex, and show that the last $(\frac{1}{2} - \frac{1}{2^{m+1}}) n$ coefficients of their domination polynomial are non-increasing.


title: The role of surface spin polarization on ceria-supported Pt nanoparticles

abstract: In this work, we employ first-principles simulations to investigate the spin polarization of CeO$_2$-(111) surface and its impact on interactions between a ceria support and Pt nanoparticles. For the first time, we report that the CeO$_2$-(111) surface exhibits a robust surface spin polarization due to the internal charge transfer between atomic Ce and O layers. In turn, it can lower the surface oxygen vacancy formation energy and enhance the oxide reducibility. We show that the inclusion of spin polarization can therefore significantly reduce the major activation barrier in the proposed reaction pathway of CO oxidation on ceria-supported Pt nanoparticles. For metal-support interactions, surface spin polarization enhances the bonding between Pt nanoparticle and ceria surface oxygen, while CO adsorption on Pt nanoparticles weakens the interfacial interaction regardless of spin polarization.


title: Asking questions on handwritten document collections

abstract: This work addresses the problem of Question Answering (QA) on handwritten document collections. Unlike typical QA and Visual Question Answering (VQA) formulations where the answer is a short text, we aim to locate a document snippet where the answer lies. The proposed approach works without recognizing the text in the documents. We argue that the recognition-free approach is suitable for handwritten documents and historical collections where robust text recognition is often difficult. At the same time, for human users, document image snippets containing answers act as a valid alternative to textual answers. The proposed approach uses an off-the-shelf deep embedding network which can project both textual words and word images into a common sub-space. This embedding bridges the textual and visual domains and helps us retrieve document snippets that potentially answer a question. We evaluate results of the proposed approach on two new datasets: (i) HW-SQuAD: a synthetic, handwritten document image counterpart of SQuAD1.0 dataset and (ii) BenthamQA: a smaller set of QA pairs defined on documents from the popular Bentham manuscripts collection. We also present a thorough analysis of the proposed recognition-free approach compared to a recognition-based approach which uses text recognized from the images using an OCR. Datasets presented in this work are available to download at docvqa.org


title: Improving Zero-shot Multilingual Neural Machine Translation for Low-Resource Languages

abstract: Although the multilingual Neural Machine Translation(NMT), which extends Google's multilingual NMT, has ability to perform zero-shot translation and the iterative self-learning algorithm can improve the quality of zero-shot translation, it confronts with two problems: the multilingual NMT model is prone to generate wrong target language when implementing zero-shot translation; the self-learning algorithm, which uses beam search to generate synthetic parallel data, demolishes the diversity of the generated source language and amplifies the impact of the same noise during the iterative learning process. In this paper, we propose the tagged-multilingual NMT model and improve the self-learning algorithm to handle these two problems. Firstly, we extend the Google's multilingual NMT model and add target tokens to the target languages, which associates the start tag with the target language to ensure that the source language can be translated to the required target language. Secondly, we improve the self-learning algorithm by replacing beam search with random sample to increases the diversity of the generated data and makes it properly cover the true data distribution. Experimental results on IWSLT show that the adjusted tagged-multilingual NMT separately obtains 9.41 and 7.85 BLEU scores over the multilingual NMT on 2010 and 2017 Romanian-Italian test sets. Similarly, it obtains 9.08 and 7.99 BLEU scores on Italian-Romanian zero-shot translation. Furthermore, the improved self-learning algorithm shows its superiorities over the conventional self-learning algorithm on zero-shot translations.


title: Enhanced symmetry energy bears universality of the r-process

abstract: The abundance of about half of the stable nuclei heavier than iron via the rapid neutron capture process or $r$-process is intimately related to the competition between neutron capture and $\beta$-decay rates, which ultimately depends on the binding energy of neutron-rich nuclei. The well-known Bethe-Weizs\"acker semi-empirical mass formula\cite{weiz,bethe} describes the binding energy of ground states -- i.e. nuclei with temperatures of $T\approx0$ MeV -- with the symmetry energy parameter converging between $23-27$ MeV for heavy nuclei. Here we find an unexpected enhancement of the symmetry energy at higher temperatures, $T\approx0.7-1.0$ MeV, from the available data of giant dipole resonances built on excited states. Although these are likely the temperatures where seed elements are created -- during the cooling down of the ejecta following neutron-star mergers\cite{mergersnucleo} or collapsars\cite{collapsar} -- the fact that the symmetry energy remains constant between $T\approx0.7-1.0$ MeV, suggests a similar trend down to $T\approx0.5$ MeV, where neutron-capture may start occurring. Calculations using this relatively larger symmetry energy yield a reduction of the binding energy per nucleon for heavy neutron-rich nuclei and inhibits radiative neutron-capture rates. This results in a substantial close in of the neutron dripline -- where nuclei become unbound -- which elucidates the long sought universality of heavy-element abundances through the $r$-process; as inferred from the similar abundances found in extremely metal-poor stars and the Sun.


title: Reversible Structural Transition of Two-Dimensional Copper Selenide on Cu(111)

abstract: Structural engineering opens a door to manipulating the structures and thus tuning the properties of two-dimensional materials. Here, we report a reversible structural transition in honeycomb CuSe monolayer on Cu(111) through scanning tunneling microscopy (STM) and Auger electron spectroscopy (AES). Direct selenization of Cu(111) gives rise to the formation of honeycomb CuSe monolayers with 1D moir\'e structures (stripe-CuSe), due to the asymmetric lattice distortions in CuSe induced by the lattice mismatch. Additional deposition of Se combined with post annealing results in the formation of honeycomb CuSe with quasi-ordered arrays of triangular holes (hole-CuSe), namely, the structural transition from stripe-CuSe to hole-CuSe. Further, annealing the hole-CuSe at higher temperature leads to the reverse structural transition, namely from hole-CuSe to stripe-CuSe. AES measurement unravels the Se content change in the reversible structural transition. Therefore, both the Se coverage and annealing temperature play significant roles in the reversible structural transition in CuSe on Cu(111). Our work provides insights in understanding of the structural transitions in 2D materials.


title: An Optimization-Based Meta-Learning Model for MRI Reconstruction with Diverse Dataset

abstract: Purpose: This work aims at developing a generalizable MRI reconstruction model in the meta-learning framework. The standard benchmarks in meta-learning are challenged by learning on diverse task distributions. The proposed network learns the regularization function in a variational model and reconstructs MR images with various under-sampling ratios or patterns that may or may not be seen in the training data by leveraging a heterogeneous dataset. Methods: We propose an unrolling network induced by learnable optimization algorithms (LOA) for solving our nonconvex nonsmooth variational model for MRI reconstruction. In this model, the learnable regularization function contains a task-invariant common feature encoder and task-specific learner represented by a shallow network. To train the network we split the training data into two parts: training and validation, and introduce a bilevel optimization algorithm. The lower-level optimization trains task-invariant parameters for the feature encoder with fixed parameters of the task-specific learner on the training dataset, and the upper-level optimizes the parameters of the task-specific learner on the validation dataset. Results: The average PSNR increases significantly compared to the network trained through conventional supervised learning on the seen CS ratios. We test the result of quick adaption on the unseen tasks after meta-training and in the meanwhile saving half of the training time; Conclusion: We proposed a meta-learning framework consisting of the base network architecture, design of regularization, and bi-level optimization-based training. The network inherits the convergence property of the LOA and interpretation of the variational model. The generalization ability is improved by the designated regularization and bilevel optimization-based training algorithm.


title: Quantum walks driven by quantum coins with two multiple eigenvalues

abstract: We consider a spectral analysis on the quantum walks on graph $G=(V,E)$ with the local coin operators $\{C_u\}_{u\in V}$ and the flip flop shift. The quantum coin operators have commonly two distinct eigenvalues $\kappa,\kappa'$ and $p=\dim(\ker(\kappa-C_u))$ for any $u\in V$ with $1\leq p\leq \delta(G)$, where $\delta(G)$ is the minimum degrees of $G$. We show that this quantum walk can be decomposed into a cellular automaton on $\ell^2(V;\mathbb{C}^p)$ whose time evolution is described by a self adjoint operator $T$ and its remainder. We obtain how the eigenvalues and its eigenspace of $T$ are lifted up to as those of the original quantum walk. As an application, we express the eigenpolynomial of the Grover walk on $\mathbb{Z}^d$ with the moving shift in the Fourier space.


title: Mobile Manipulation Leveraging Multiple Views

abstract: While both navigation and manipulation are challenging topics in isolation, many tasks require the ability to both navigate and manipulate in concert. To this end, we propose a mobile manipulation system that leverages novel navigation and shape completion methods to manipulate an object with a mobile robot. Our system utilizes uncertainty in the initial estimation of a manipulation target to calculate a predicted next-best-view. Without the need of localization, the robot then uses the predicted panoramic view at the next-best-view location to navigate to the desired location, capture a second view of the object, create a new model that predicts the shape of object more accurately than a single image alone, and uses this model for grasp planning. We show that the system is highly effective for mobile manipulation tasks through simulation experiments using real world data, as well as ablations on each component of our system.


title: Local Orthogonality Dimension

abstract: An orthogonal representation of a graph $G$ over a field $\mathbb{F}$ is an assignment of a vector $u_v \in \mathbb{F}^t$ to every vertex $v$ of $G$, such that $\langle u_v,u_v \rangle \neq 0$ for every vertex $v$ and $\langle u_v,u_{v'} \rangle = 0$ whenever $v$ and $v'$ are adjacent in $G$. The locality of the orthogonal representation is the largest dimension of a subspace spanned by the vectors associated with a closed neighborhood in the graph. We introduce a novel graph parameter, called the local orthogonality dimension, defined for a given graph $G$ and a given field $\mathbb{F}$, as the smallest possible locality of an orthogonal representation of $G$ over $\mathbb{F}$. We investigate the usefulness of topological methods for proving lower bounds on the local orthogonality dimension. We prove that graphs for which topological methods imply a lower bound of $t$ on their chromatic number have local orthogonality dimension at least $\lceil t/2 \rceil +1$ over every field, strengthening a result of Simonyi and Tardos on the local chromatic number. We show that for certain graphs this lower bound is tight, whereas for others, the local orthogonality dimension over the reals is equal to the chromatic number. More generally, we prove that for every complement of a line graph, the local orthogonality dimension over $\mathbb{R}$ coincides with the chromatic number. This strengthens a recent result by Daneshpajouh, Meunier, and Mizrahi, who proved that the local and standard chromatic numbers of these graphs are equal. As another extension of their result, we prove that the local and standard chromatic numbers are equal for some additional graphs, from the family of Kneser graphs. We also show an $\mathsf{NP}$-hardness result for the local orthogonality dimension and present an application of this graph parameter to the index coding problem from information theory.


title: One-Bit Matrix Completion with Differential Privacy

abstract: As a prevailing collaborative filtering method for recommendation systems, one-bit matrix completion requires data collected by users to provide personalized service. Due to insidious attacks and unexpected inference, the release of users' data often raises serious privacy concerns. To address this issue, differential privacy(DP) has been widely used in standard matrix completion models. To date, however, little has been known about how to apply DP to achieve privacy protection in one-bit matrix completion. In this paper, we propose a unified framework for ensuring a strong privacy guarantee of one-bit matrix completion with DP. In our framework, we develop four different private perturbation mechanisms corresponding to different stages of one-bit matrix completion. For each mechanism, we design a privacy-preserving algorithm and provide a theoretical recovery error bound under the proper conditions. Numerical experiments on synthetic and real-world datasets demonstrate the effectiveness of our proposal. Compared to the one-bit matrix completion without privacy protection, our proposed mechanisms can maintain high-level privacy protection with marginal loss of completion accuracy.


title: Is There More Pattern in Knowledge Graph? Exploring Proximity Pattern for Knowledge Graph Embedding

abstract: Modeling of relation pattern is the core focus of previous Knowledge Graph Embedding works, which represents how one entity is related to another semantically by some explicit relation. However, there is a more natural and intuitive relevancy among entities being always ignored, which is that how one entity is close to another semantically, without the consideration of any explicit relation. We name such semantic phenomenon in knowledge graph as proximity pattern. In this work, we explore the problem of how to define and represent proximity pattern, and how it can be utilized to help knowledge graph embedding. Firstly, we define the proximity of any two entities according to their statistically shared queries, then we construct a derived graph structure and represent the proximity pattern from global view. Moreover, with the original knowledge graph, we design a Chained couPle-GNN (CP-GNN) architecture to deeply merge the two patterns (graphs) together, which can encode a more comprehensive knowledge embedding. Being evaluated on FB15k-237 and WN18RR datasets, CP-GNN achieves state-of-the-art results for Knowledge Graph Completion task, and can especially boost the modeling capacity for complex queries that contain multiple answer entities, proving the effectiveness of introduced proximity pattern.


title: Structural Properties of Graph Products

abstract: Dujmovi\'{c}, Joret, Micek, Morin, Ueckerdt, and Wood [J. ACM 2020] established that every planar graph is a subgraph of the strong product of a graph with bounded treewidth and a path. Motivated by this result, this paper systematically studies various structural properties of cartesian, direct and strong products. In particular, we characterise when these graph products contain a given complete multipartite subgraph, determine tight bounds for their degeneracy, establish new lower bounds for the treewidth of cartesian and strong products, and characterise when they have bounded treewidth and when they have bounded pathwidth.


title: Semiclassical black holes and horizon singularities

abstract: In spherical symmetry, solutions of the semiclassical Einstein equations belong to one of two possible classes. Both classes contain solutions that -- depending on the dynamic behavior of the horizon -- describe evaporating physical black holes or expanding white holes (trapped/anti-trapped regions that form in finite time of a distant observer). These solutions are real-valued only if the null energy condition (NEC) is violated in the vicinity of the Schwarzschild sphere. We review their properties and describe the only consistent black hole formation scenario. While the curvature scalars are finite on the outer apparent/anti-trapping horizon, it is still a weakly singular surface. This singularity manifests itself in a mild firewall. Near the inner apparent horizon, the NEC is satisfied. Models of static regular black holes are known to be unstable, but since dynamic models of regular black holes are severely constrained by self-consistency requirements, their stability requires further investigation.


title: Pauli Oscillator In Noncommutative Space

abstract: In this study, we investigate the Pauli oscillator in a noncommutative space. In other words, we derive wave function and energy spectrum of a spin half non-relativistic charged particle that is moving under a constant magnetic field with an oscillator potential in noncommutative space. We obtain critical values of the deformation parameter and the magnetic field, which counteract the normal and anomalous Zeeman effects. Moreover, we find that the deformation parameter has to be smaller than $2.57\times 10^{-26}m^2$. Then, we derive the Helmholtz free energy, internal energy, specific heat, and entropy functions of the Pauli oscillator in the noncommutative space. With graphical methods, at first, we compare these functions with the ordinary ones, and then, we demonstrate the effects of magnetic field on these thermodynamic functions in the commutative and noncommutative space, respectively


title: Complex Spin Hamiltonian Represented by Artificial Neural Network

abstract: The effective spin Hamiltonian method is widely adopted to simulate and understand the behavior of magnetism. However, the magnetic interactions of some systems, such as itinerant magnets, are too complex to be described by any explicit function, which prevents an accurate description of magnetism in such systems. Here, we put forward a machine learning (ML) approach, applying an artificial neural network (ANN) and a local spin descriptor to develop effective spin potentials for any form of interaction. The constructed Hamiltonians include an explicit Heisenberg part and an implicit non-linear ANN part. Such a method successfully reproduces artificially constructed models and also sufficiently describe the itinerant magnetism of bulk Fe3GeTe2. Our work paves a new way for investigating complex magnetic phenomena (e.g., skyrmions) of magnetic materials.


title: Drift-Diffusion Dynamics and Phase Separation in Curved Cell Membranes and Dendritic Spines: Hybrid Discrete-Continuum Methods

abstract: We develop methods for investigating protein drift-diffusion dynamics in heterogeneous cell membranes and the roles played by geometry, diffusion, chemical kinetics, and phase separation. Our hybrid stochastic numerical methods combine discrete particle descriptions with continuum-level models for tracking the individual protein drift-diffusion dynamics when coupled to continuum fields. We show how our approaches can be used to investigate phenomena motivated by protein kinetics within dendritic spines. The spine geometry is hypothesized to play an important biological role regulating synaptic strength, protein kinetics, and self-assembly of clusters. We perform simulation studies for model spine geometries varying the neck size to investigate how phase-separation and protein organization is influenced by different shapes. We also show how our methods can be used to study the roles of geometry in reaction-diffusion systems including Turing instabilities. Our methods provide general approaches for investigating protein kinetics and drift-diffusion dynamics within curved membrane structures.

categories: physics.bio-ph cs.NA math.NA nlin.PS q-bio.SC stat.CO


title: Domain-Specific Bias Filtering for Single Labeled Domain Generalization

abstract: Conventional Domain Generalization (CDG) utilizes multiple labeled source datasets to train a generalizable model for unseen target domains. However, due to expensive annotation costs, the requirements of labeling all the source data are hard to be met in real-world applications. In this paper, we investigate a Single Labeled Domain Generalization (SLDG) task with only one source domain being labeled, which is more practical and challenging than the CDG task. A major obstacle in the SLDG task is the discriminability-generalization bias: the discriminative information in the labeled source dataset may contain domain-specific bias, constraining the generalization of the trained model. To tackle this challenging task, we propose a novel framework called Domain-Specific Bias Filtering (DSBF), which initializes a discriminative model with the labeled source data and then filters out its domain-specific bias with the unlabeled source data for generalization improvement. We divide the filtering process into (1) feature extractor debiasing via k-means clustering-based semantic feature re-extraction and (2) classifier rectification through attention-guided semantic feature projection. DSBF unifies the exploration of the labeled and the unlabeled source data to enhance the discriminability and generalization of the trained model, resulting in a highly generalizable model. We further provide theoretical analysis to verify the proposed domain-specific bias filtering process. Extensive experiments on multiple datasets show the superior performance of DSBF in tackling both the challenging SLDG task and the CDG task.