title: Fractional Sobolev regularity for solutions to a strongly degenerate parabolic equation

abstract: We carry on the investigation started in [2] about the regularity of weak solutions to the strongly degenerate parabolic equation \[ u_{t}-\mathrm{div}\left[(\vert Du\vert-1)_{+}^{p-1}\frac{Du}{\vert Du\vert}\right]=f\,\,\,\,\,\,\,\,\,\mathrm{in}\,\,\Omega_{T}=\Omega\times(0,T), \] where $\Omega$ is a bounded domain in $\mathbb{R}^{n}$ for $n\geq2$, $p\geq2$ and $\left(\,\cdot\,\right)_{+}$ stands for the positive part. Here, we weaken the assumption on the right-hand side, by assuming that $f\in L_{loc}^{p'}\left(0,T;B_{p',\infty,loc}^{\alpha}\left(\Omega\right)\right)$, with $\alpha\in(0,1)$ and $p'=p/(p-1)$. This leads us to obtain higher fractional differentiability results for a function of the spatial gradient $Du$ of the solutions. Moreover, we establish the higher summability of $Du$ with respect to the spatial variable. The main novelty of the above equation is that the structure function satisfies standard ellipticity and growth conditions only outside the unit ball centered at the origin. We would like to point out that the main result of this paper can be considered, on the one hand, as the parabolic counterpart of an elliptic result contained in [1], and on the other hand as the fractional version of some results established in [2].


title: Romeo and Juliet Meeting in Forest Like Regions

abstract: The game of rendezvous with adversaries is a game on a graph played by two players: Facilitator and Divider. Facilitator has two agents and Divider has a team of $k \ge 1$ agents. While the initial positions of Facilitator's agents are fixed, Divider gets to select the initial positions of his agents. Then, they take turns to move their agents to adjacent vertices (or stay put) with Facilitator's goal to bring both her agents at same vertex and Divider's goal to prevent it. The computational question of interest is to determine if Facilitator has a winning strategy against Divider with $k$ agents. Fomin, Golovach, and Thilikos [WG, 2021] introduced this game and proved that it is PSPACE-hard and co-W[2]-hard parameterized by the number of agents. This hardness naturally motivates the structural parameterization of the problem. The authors proved that it admits an FPT algorithm when parameterized by the modular width and the number of allowed rounds. However, they left open the complexity of the problem from the perspective of other structural parameters. In particular, they explicitly asked whether the problem admits an FPT or XP-algorithm with respect to the treewidth of the input graph. We answer this question in the negative and show that Rendezvous is co-NP-hard even for graphs of constant treewidth. Further, we show that the problem is co-W[1]-hard when parameterized by the feedback vertex set number and the number of agents, and is unlikely to admit a polynomial kernel when parameterized by the vertex cover number and the number of agents. Complementing these hardness results, we show that the Rendezvous is FPT when parameterized by both the vertex cover number and the solution size. Finally, for graphs of treewidth at most two and girds, we show that the problem can be solved in polynomial time.


title: One-loop divergences in higher-derivative gravity

abstract: We give a review of the one-loop divergences in higher derivative gravity theories. We first make the bilinear expansion in the quantum fluctuation on arbitrary backgrounds, introduce a higher-derivative gauge fixing and show that higher-derivative gauge fixing must have ghosts in addition to those naively expected. We give general formulae for the one-loop divergences in such theories, and give explicit results for theories with quadratic curvature terms. In this calculation, we need the heat kernel coefficients for the four-derivative minimal operators and two-derivative nonminimal vector operators, which are summarized. We also discuss the beta functions in the renormalization group, and show that the dimensionless couplings are asymptotically free. The calculation is also extended to the theories with arbitrary functions of $R$ and $R_{\mu\nu}^2$. We show that the result is independent of metric parametrization and gauge on shell.


title: SPICER: Self-Supervised Learning for MRI with Automatic Coil Sensitivity Estimation and Reconstruction

abstract: Deep model-based architectures (DMBAs) integrating physical measurement models and learned image regularizers are widely used in parallel magnetic resonance imaging (PMRI). Traditional DMBAs for PMRI rely on pre-estimated coil sensitivity maps (CSMs) as a component of the measurement model. However, estimation of accurate CSMs is a challenging problem when measurements are highly undersampled. Additionally, traditional training of DMBAs requires high-quality groundtruth images, limiting their use in applications where groundtruth is difficult to obtain. This paper addresses these issues by presenting SPICE as a new method that integrates self-supervised learning and automatic coil sensitivity estimation. Instead of using pre-estimated CSMs, SPICE simultaneously reconstructs accurate MR images and estimates high-quality CSMs. SPICE also enables learning from undersampled noisy measurements without any groundtruth. We validate SPICE on experimentally collected data, showing that it can achieve state-of-the-art performance in highly accelerated data acquisition settings (up to 10x).


title: Query The Agent: Improving sample efficiency through epistemic uncertainty estimation

abstract: Curricula for goal-conditioned reinforcement learning agents typically rely on poor estimates of the agent's epistemic uncertainty or fail to consider the agents' epistemic uncertainty altogether, resulting in poor sample efficiency. We propose a novel algorithm, Query The Agent (QTA), which significantly improves sample efficiency by estimating the agent's epistemic uncertainty throughout the state space and setting goals in highly uncertain areas. Encouraging the agent to collect data in highly uncertain states allows the agent to improve its estimation of the value function rapidly. QTA utilizes a novel technique for estimating epistemic uncertainty, Predictive Uncertainty Networks (PUN), to allow QTA to assess the agent's uncertainty in all previously observed states. We demonstrate that QTA offers decisive sample efficiency improvements over preexisting methods.


title: Implementing Fairness Constraints in Markets Using Taxes and Subsidies

abstract: Fisher markets are those where buyers with budgets compete for scarce items, a natural model for many real world markets including online advertising. A market equilibrium is a set of prices and allocations of items such that supply meets demand. We show how market designers can use taxes or subsidies in Fisher markets to ensure that market equilibrium outcomes fall within certain constraints. We show how these taxes and subsidies can be computed even in an online setting where the market designer does not have access to private valuations. We adapt various types of fairness constraints proposed in existing literature to the market case and show who benefits and who loses from these constraints, as well as the extent to which properties of markets including Pareto optimality, envy-freeness, and incentive compatibility are preserved. We find that some prior discussed constraints have few guarantees in terms of who is made better or worse off by their imposition.


title: Astrobotics: Swarm Robotics for Astrophysical Studies

abstract: This paper introduces the emerging field of astrobotics, that is, a recently-established branch of robotics to be of service to astrophysics and observational astronomy. We first describe a modern requirement of dark matter studies, i.e., the generation of the map of the observable universe, using astrobots. Astrobots differ from conventional two-degree-of-freedom robotic manipulators in two respects. First, the dense formation of astrobots give rise to the extremely overlapping dynamics of neighboring astrobots which make them severely subject to collisions. Second, the structure of astrobots and their mechanical specifications are specialized due to the embedded optical fibers passed through them. We focus on the coordination problem of astrobots whose solutions shall be collision-free, fast execution, and complete in terms of the astrobots' convergence rates. We also illustrate the significant impact of astrobots assignments to observational targets on the quality of coordination solutions To present the current state of the field, we elaborate the open problems including next-generation astrophysical projects including 20,000 astrobots, and other fields, such as space debris tracking, in which astrobots may be potentially used


title: Stochastic Neuromorphic Circuits for Solving MAXCUT

abstract: Finding the maximum cut of a graph (MAXCUT) is a classic optimization problem that has motivated parallel algorithm development. While approximate algorithms to MAXCUT offer attractive theoretical guarantees and demonstrate compelling empirical performance, such approximation approaches can shift the dominant computational cost to the stochastic sampling operations. Neuromorphic computing, which uses the organizing principles of the nervous system to inspire new parallel computing architectures, offers a possible solution. One ubiquitous feature of natural brains is stochasticity: the individual elements of biological neural networks possess an intrinsic randomness that serves as a resource enabling their unique computational capacities. By designing circuits and algorithms that make use of randomness similarly to natural brains, we hypothesize that the intrinsic randomness in microelectronics devices could be turned into a valuable component of a neuromorphic architecture enabling more efficient computations. Here, we present neuromorphic circuits that transform the stochastic behavior of a pool of random devices into useful correlations that drive stochastic solutions to MAXCUT. We show that these circuits perform favorably in comparison to software solvers and argue that this neuromorphic hardware implementation provides a path for scaling advantages. This work demonstrates the utility of combining neuromorphic principles with intrinsic randomness as a computational resource for new computational architectures.


title: Spot-on: A Checkpointing Framework for Fault-Tolerant Long-running Workloads on Cloud Spot Instances

abstract: Spot instances offer a cost-effective solution for applications running in the cloud computing environment. However, it is challenging to run long-running jobs on spot instances because they are subject to unpredictable evictions. Here, we present Spot-on, a generic software framework that supports fault-tolerant long-running workloads on spot instances through checkpoint and restart. Spot-on leverages existing checkpointing packages and is compatible with the major cloud vendors. Using a genomics application as a test case, we demonstrated that Spot-on supports both application-specific and transparent checkpointing methods. Compared to running applications using on-demand instances, it allows the completion of these workloads for a significant reduction in computing costs. Compared to running applications using application-specific checkpoint mechanisms, transparent checkpoint-protected applications reduce runtime by up to 40%, leading to further cost savings of up to 86%.


title: Star-Graph Multimodal Matching Component Analysis for Data Fusion and Transfer Learning

abstract: Previous matching component analysis (MCA) techniques map two data domains to a common domain for further processing in data fusion and transfer learning contexts. In this paper, we extend these techniques to the star-graph multimodal (SGM) case in which one particular data domain is connected to $m$ others via an objective function. We provide a particular feasible point for the resulting trace maximization problem in closed form and algorithms for its computation and iterative improvement, leading to our main result, the SGM maps. We also provide numerical examples demonstrating that SGM is capable of encoding into its maps more information than MCA when few training points are available. In addition, we develop a further generalization of the MCA covariance constraint, eliminating a previous feasibility condition and allowing larger values of the rank of the prescribed covariance matrix.


title: TF07 Snowmass Report: Theory of Collider Phenomena

abstract: Theoretical research has long played an essential role in interpreting data from high-energy particle colliders and motivating new accelerators to advance the energy and precision frontiers. Collider phenomenology is an essential interface between theoretical models and experimental observations, since theoretical studies inspire experimental analyses while experimental results sharpen theoretical ideas. This report -- from the Snowmass 2021 Theory Frontier topical group for Collider Phenomenology (TF07) -- showcases the dynamism, engagement, and motivations of collider phenomenologists by exposing selected exciting new directions and establishing key connections between cutting-edge theoretical advances and current and future experimental opportunities. By investing in collider phenomenology, the high-energy physics community can help ensure that theoretical advances are translated into concrete tools that enable and enhance current and future experiments, and in turn, experimental results feed into a more complete theoretical understanding and motivate new questions and explorations.


title: CCC-wav2vec 2.0: Clustering aided Cross Contrastive Self-supervised learning of speech representations

abstract: While Self-Supervised Learning has helped reap the benefit of the scale from the available unlabeled data, the learning paradigms are continuously being bettered. We present a new pre-training strategy named ccc-wav2vec 2.0, which uses clustering and an augmentation-based cross-contrastive loss as its self-supervised objective. Through the clustering module, we scale down the influence of those negative examples that are highly similar to the positive. The Cross-Contrastive loss is computed between the encoder output of the original sample and the quantizer output of its augmentation and vice-versa, bringing robustness to the pre-training strategy. ccc-wav2vec 2.0 achieves up to 15.6% and 12.7% relative WER improvement over the baseline wav2vec 2.0 on the test-clean and test-other sets, respectively, of LibriSpeech, without the use of any language model. The proposed method also achieves up to 14.9% relative WER improvement over the baseline wav2vec 2.0 when fine-tuned on Switchboard data. We make all our codes publicly available on GitHub.


title: Be Prospective, Not Retrospective: A Philosophy for Advancing Reproducibility in Modern Biological Research

abstract: The ubiquity of computation in modern scientific research inflicts new challenges for reproducibility. While most journals now require code and data be made available, the standards for organization, annotation, and validation remain lax, making the data and code often difficult to decipher or practically use. I believe that this is due to the documentation, collation, and validation of code and data only being done in retrospect. In this essay, I reflect on my experience contending with these challenges and present a philosophy for prioritizing reproducibility in modern biological research where balancing computational analysis and wet-lab experiments is commonplace. Modern tools used in scientific workflows (such as GitHub repositories) lend themselves well to this philosophy where reproducibility begins at project inception, not completion. To that end, I present and provide a programming-language agnostic template architecture that can be immediately copied and made bespoke to your next paper, whether your lab work is wet, dry, or somewhere in between.


title: Reward-Mixing MDPs with a Few Latent Contexts are Learnable

abstract: We consider episodic reinforcement learning in reward-mixing Markov decision processes (RMMDPs): at the beginning of every episode nature randomly picks a latent reward model among $M$ candidates and an agent interacts with the MDP throughout the episode for $H$ time steps. Our goal is to learn a near-optimal policy that nearly maximizes the $H$ time-step cumulative rewards in such a model. Previous work established an upper bound for RMMDPs for $M=2$. In this work, we resolve several open questions remained for the RMMDP model. For an arbitrary $M\ge2$, we provide a sample-efficient algorithm--$\texttt{EM}^2$--that outputs an $\epsilon$-optimal policy using $\tilde{O} \left(\epsilon^{-2} \cdot S^d A^d \cdot \texttt{poly}(H, Z)^d \right)$ episodes, where $S, A$ are the number of states and actions respectively, $H$ is the time-horizon, $Z$ is the support size of reward distributions and $d=\min(2M-1,H)$. Our technique is a higher-order extension of the method-of-moments based approach, nevertheless, the design and analysis of the \algname algorithm requires several new ideas beyond existing techniques. We also provide a lower bound of $(SA)^{\Omega(\sqrt{M})} / \epsilon^{2}$ for a general instance of RMMDP, supporting that super-polynomial sample complexity in $M$ is necessary.


title: Exploration of A Self-Supervised Speech Model: A Study on Emotional Corpora

abstract: Self-supervised speech models have grown fast during the past few years and have proven feasible for use in various downstream tasks. Some recent work has started to look at the characteristics of these models, yet many concerns have not been fully addressed. In this work, we conduct a study on emotional corpora to explore a popular self-supervised model -- wav2vec 2.0. Via a set of quantitative analysis, we mainly demonstrate that: 1) wav2vec 2.0 appears to discard paralinguistic information that is less useful for word recognition purposes; 2) for emotion recognition, representations from the middle layer alone perform as well as those derived from layer averaging, while the final layer results in the worst performance in some cases; 3) current self-supervised models may not be the optimal solution for downstream tasks that make use of non-lexical features. Our work provides novel findings that will aid future research in this area and theoretical basis for the use of existing models.


title: Role of Deep Learning in Wireless Communications

abstract: Traditional communication system design has always been based on the paradigm of first establishing a mathematical model of the communication channel, then designing and optimizing the system according to the model. The advent of modern machine learning techniques, specifically deep neural networks, has opened up opportunities for data-driven system design and optimization. This article draws examples from the optimization of reconfigurable intelligent surface, distributed channel estimation and feedback for multiuser beamforming, and active sensing for millimeter wave (mmWave) initial alignment to illustrate that a data-driven design that bypasses explicit channel modelling can often discover excellent solutions to communication system design and optimization problems that are otherwise computationally difficult to solve. We show that by performing an end-to-end training of a deep neural network using a large number of channel samples, a machine learning based approach can potentially provide significant system-level improvements as compared to the traditional model-based approach for solving optimization problems. The key to the successful applications of machine learning techniques is in choosing the appropriate neural network architecture to match the underlying problem structure.


title: Control of an atomic quadrupole transition in a phase-stable standing wave

abstract: Using a single calcium ion confined in a surface-electrode trap, we study the interaction of electric quadrupole transitions with a passively phase-stable optical standing wave field sourced by photonics integrated within the trap. We characterize the optical fields through spatial mapping of the Rabi frequencies of both carrier and motional sideband transitions as well as AC Stark shifts. Our measurements demonstrate the ability to engineer favorable combinations of sideband and carrier Rabi frequency as well as AC Stark shifts for specific tasks in quantum state control and metrology.


title: Precision measurements of jet and photon production at the ATLAS experiment

abstract: The production of jets and prompt isolated photons at hadron colliders provides stringent tests of perturbative QCD. We present the latest measurements of photon+jets and diphoton production using proton-proton collision data collected by the ATLAS experiment at the LHC. The measurements are compared to state-of-the-art NLO and NNLO predictions.


title: The Local to Unity Dynamic Tobit Model

abstract: This paper considers highly persistent time series that are subject to nonlinearities in the form of censoring or an occasionally binding constraint, such as are regularly encountered in macroeconomics. A tractable candidate model for such series is the dynamic Tobit with a root local to unity. We show that this model generates a process that converges weakly to a non-standard limiting process, that is constrained (regulated) to be positive. Surprisingly, despite the presence of censoring, the OLS estimators of the model parameters are consistent. We show that this allows OLS-based inferences to be drawn on the overall persistence of the process (as measured by the sum of the autoregressive coefficients), and for the null of a unit root to be tested in the presence of censoring. Our simulations illustrate that the conventional ADF test substantially over-rejects when the data is generated by a dynamic Tobit with a unit root, whereas our proposed test is correctly sized. We provide an application of our methods to testing for a unit root in the Swiss franc / euro exchange rate, during a period when this was subject to an occasionally binding lower bound.


title: Learning convergence prediction of astrobots in multi-object spectrographs

abstract: Astrobot swarms are used to capture astronomical signals to generate the map of the observable universe for the purpose of dark energy studies. The convergence of each swarm in the course of its coordination has to surpass a particular threshold to yield a satisfactory map. The current coordination methods do not always reach desired convergence rates. Moreover, these methods are so complicated that one cannot formally verify their results without resource-demanding simulations. Thus, we use support vector machines to train a model which can predict the convergence of a swarm based on the data of previous coordination of that swarm. Given a fixed parity, i.e., the rotation direction of the outer arm of an astrobot, corresponding to a swarm, our algorithm reaches a better predictive performance compared to the state of the art. Additionally, we revise our algorithm to solve a more generalized convergence prediction problem according to which the parities of astrobots may differ. We present the prediction results of a generalized scenario, associated with a 487-astrobot swarm, which are interestingly efficient and collision-free given the excessive complexity of this scenario compared to the constrained one.


title: From Threat Reports to Continuous Threat Intelligence: A Comparison of Attack Technique Extraction Methods from Textual Artifacts

abstract: The cyberthreat landscape is continuously evolving. Hence, continuous monitoring and sharing of threat intelligence have become a priority for organizations. Threat reports, published by cybersecurity vendors, contain detailed descriptions of attack Tactics, Techniques, and Procedures (TTP) written in an unstructured text format. Extracting TTP from these reports aids cybersecurity practitioners and researchers learn and adapt to evolving attacks and in planning threat mitigation. Researchers have proposed TTP extraction methods in the literature, however, not all of these proposed methods are compared to one another or to a baseline. \textit{The goal of this study is to aid cybersecurity researchers and practitioners choose attack technique extraction methods for monitoring and sharing threat intelligence by comparing the underlying methods from the TTP extraction studies in the literature.} In this work, we identify ten existing TTP extraction studies from the literature and implement five methods from the ten studies. We find two methods, based on Term Frequency-Inverse Document Frequency(TFIDF) and Latent Semantic Indexing (LSI), outperform the other three methods with a F1 score of 84\% and 83\%, respectively. We observe the performance of all methods in F1 score drops in the case of increasing the class labels exponentially. We also implement and evaluate an oversampling strategy to mitigate class imbalance issues. Furthermore, oversampling improves the classification performance of TTP extraction. We provide recommendations from our findings for future cybersecurity researchers, such as the construction of a benchmark dataset from a large corpus; and the selection of textual features of TTP. Our work, along with the dataset and implementation source code, can work as a baseline for cybersecurity researchers to test and compare the performance of future TTP extraction methods.


title: Convergence rates of the Kaczmarz-Tanabe method for linear systems

abstract: In this paper, we investigate the Kaczmarz-Tanabe method for exact and inexact linear systems. The Kaczmarz-Tanabe method is derived from the Kaczmarz method, but is more stable than that. We analyze the convergence and the convergence rate of the Kaczmarz-Tanabe method based on the singular value decomposition theory, and discover two important factors, i.e., the second maximum singular value of $Q$ and the minimum non-zero singular value of $A$, that influence the convergence speed and the amplitude of fluctuation of the Kaczmarz-Tanabe method (even for the Kaczmarz method). Numerical tests verify the theoretical results of the Kaczmarz-Tanabe method.


title: Consequences of dynamically unstable moons in extrasolar systems

abstract: Moons orbiting rocky exoplanets in compact orbits about other stars experience an accelerated tidal evolution, and can either merge with their parent planet or reach the limit of dynamical instability within a Hubble time. We review the parameter space over which moons become unbound, including the effects of atmospheric tides on the planetary spin. We find that such tides can change the final outcome from merger to escape, albeit over a limited parameter space. We also follow the further evolution of unbound moons, and demonstrate that the overwhelmingly most likely long-term outcome is that the unbound moon returns to collide with its original parent planet. The dust released by such a collision is estimated to reach optical depths approximately 0.001, exhibit characteristic temperatures of a few hundred degrees Kelvin, and last for a few thousand years. These properties make such events an attractive model for the emerging class of middle-aged main sequence stars that are observed to show transient clouds of warm dust. Furthermore, a late collision between a planet and a returning moon on a hyperbolic orbit may sterilise an otherwise habitable planet.


title: Spectral Regularization Allows Data-frugal Learning over Combinatorial Spaces

abstract: Data-driven machine learning models are being increasingly employed in several important inference problems in biology, chemistry, and physics which require learning over combinatorial spaces. Recent empirical evidence (see, e.g., [1], [2], [3]) suggests that regularizing the spectral representation of such models improves their generalization power when labeled data is scarce. However, despite these empirical studies, the theoretical underpinning of when and how spectral regularization enables improved generalization is poorly understood. In this paper, we focus on learning pseudo-Boolean functions and demonstrate that regularizing the empirical mean squared error by the L_1 norm of the spectral transform of the learned function reshapes the loss landscape and allows for data-frugal learning, under a restricted secant condition on the learner's empirical error measured against the ground truth function. Under a weaker quadratic growth condition, we show that stationary points which also approximately interpolate the training data points achieve statistically optimal generalization performance. Complementing our theory, we empirically demonstrate that running gradient descent on the regularized loss results in a better generalization performance compared to baseline algorithms in several data-scarce real-world problems.


title: A question on the Cauchy problem in the Gevrey classes for weakly hyperbolic equations

abstract: For a homogeneous polynomial $p$ in $\xi\in {\bf R}^n$ with Gevrey coefficients, it is known that the Cauchy problem for any realization of $p$ is well-posed in the Gevrey class of order $s<2$ if the characteristic roots are real. In this note, we give examples showing the situation of the converse direction, in particular the optimality of the Gevrey order $s=2$.


title: Nonlocal error bounds for piecewise affine functions

abstract: The paper is devoted to a detailed analysis of nonlocal error bounds for nonconvex piecewise affine functions. We both improve some existing results on error bounds for such functions and present completely new necessary and/or sufficient conditions for a piecewise affine function to have an error bound on various types of bounded and unbounded sets. In particular, we show that any piecewise affine function has an error bound on an arbitrary bounded set and provide several types of easily verifiable sufficient conditions for such functions to have an error bound on unbounded sets. We also present general necessary and sufficient conditions for a piecewise affine function to have an error bound on a finite union of polyhedral sets (in particular, to have a global error bound), whose derivation reveals a structure of sublevel sets and recession functions of piecewise affine functions.


title: Transferring dense object detection models to event-based data

abstract: Event-based image representations are fundamentally different to traditional dense images. This poses a challenge to apply current state-of-the-art models for object detection as they are designed for dense images. In this work we evaluate the YOLO object detection model on event data. To this end we replace dense-convolution layers by either sparse convolutions or asynchronous sparse convolutions which enables direct processing of event-based images and compare the performance and runtime to feeding event-histograms into dense-convolutions. Here, hyper-parameters are shared across all variants to isolate the effect sparse-representation has on detection performance. At this, we show that current sparse-convolution implementations cannot translate their theoretical lower computation requirements into an improved runtime.


title: Nanoextraction based on surface nanodroplets for chemical preconcentration and determination

abstract: Liquid-liquid extraction based on surface nanodroplets, namely nanoextraction, can continuously extract and enrich target analytes from the flow of a sample solution. This sample preconcentration technique is easy to operate in a continuous flow system with low organic solvent consumption and a high enrichment factor. In this review, the evolution from single drop microextraction to advanced nanoextraction will be briefly introduced. Also, the formation principle and key features of surface nanodroplets will be summarized. Further, the major findings of nanoextraction combined with in-droplet chemistry toward sensitive and quantitative detection will be discussed. Finally, we will give our perspectives on the future trend of nanoextraction.


title: Scattering theory and an index theorem on the radial part of SL(2,R)

abstract: We present the spectral and scattering theory of the Casimir operator acting on the radial part of SL(2,R). After a suitable decomposition, these investigations consist in studying a family of differential operators acting on the half-line. For these operators, explicit expressions can be found for the resolvent, for the spectral density, and for the Moeller wave operators, in terms of the Gauss hypergeometric function. An index theorem is also introduced and discussed. The resulting equality links various asymptotic behaviors of the hypergeometric function.


title: Measurability of neutron star tidal deformability from merging neutron star-black hole binaries

abstract: The neutron star-black hole binary (NSBH) system has been considered one of the promising detection candidates for ground-based gravitational-wave (GW) detectors such as LIGO and Virgo. The tidal effects of neutron stars (NSs) are imprinted on the GW signals emitted from NSBHs as well as binary neutron stars. In this work, we study how accurately the parameter $\lambda_{\rm NS}$ can be measured in GW parameter estimation for NSBH signals. We set the parameter range for the NSBH sources to $[4M_{\odot}, 10M_{\odot}]$ for the black hole mass, $[1M_{\odot}, 2M_{\odot}]$ for the NS mass, and $[-0.9, 0.9]$ for the dimensionless black hole spin. For realistic populations of sources distributed in different parameter spaces, we calculate the measurement errors of $\lambda_{\rm NS}$ ($\sigma_{\lambda_{\rm NS}}$) using the Fisher matrix method. In particular, we perform a single-detector analysis using the advanced LIGO and the Cosmic Explorer detectors and a multi-detector analysis using the 2G (advanced LIGO-Hanford, advanced LIGO-Livingstone, advanced Virgo, and KAGRA) and the 3G (Einstein Telescope and Cosmic Explorer) networks. We show the distribution of $\sigma_{\lambda_{\rm NS}}$ for the population of sources as a one-dimensional probability density function. Our result shows that the probability density function curves are similar in shape between advanced LIGO and Cosmic Explorer, but Cosmic Explorer can achieve $\sim 15$ times better accuracy overall in the measurement of $\lambda_{\rm NS}$. In the case of the network detectors, the probability density functions are maximum at $\sigma_{\lambda_{\rm NS}} \sim 130$ and $\sim 4$ for the 2G and the 3G networks, respectively, and the 3G network can achieve $\sim 10$ times better accuracy overall.


title: $(1-\epsilon)$-approximate fully dynamic densest subgraph: linear space and faster update time

abstract: We consider the problem of maintaining a $(1-\epsilon)$-approximation to the densest subgraph (DSG) in an undirected multigraph as it undergoes edge insertions and deletions (the fully dynamic setting). Sawlani and Wang [SW20] developed a data structure that, for any given $\epsilon > 0$, maintains a $(1-\epsilon)$-approximation with $O(\log^4 n/\epsilon^6)$ worst-case update time for edge operations, and $O(1)$ query time for reporting the density value. Their data structure was the first to achieve near-optimal approximation, and improved previous work that maintained a $(1/4 - \epsilon)$ approximation in amortized polylogarithmic update time [BHNT15]. In this paper we develop a data structure for $(1-\epsilon)$-approximate DSG that improves the one from [SW20] in two aspects. First, the data structure uses linear space improving the space bound in [SW20] by a logarithmic factor. Second, the data structure maintains a $(1-\epsilon)$-approximation in amortized $O(\log^2 n/\epsilon^4)$ time per update while simultaneously guaranteeing that the worst case update time is $O(\log^3 n \log \log n/\epsilon^6)$. We believe that the space and update time improvements are valuable for current large scale graph data sets. The data structure extends in a natural fashion to hypergraphs and yields improvements in space and update times over recent work [BBCG22] that builds upon [SW20].


title: Lyapunov Function Consistent Adaptive Network Signal Control with Back Pressure and Reinforcement Learning

abstract: In traffic signal control, flow-based (optimizing the overall flow) and pressure-based methods (equalizing and alleviating congestion) are commonly used but often considered separately. This study introduces a unified framework using Lyapunov control theory, defining specific Lyapunov functions respectively for these methods. We have found interesting results. For example, the well-recognized back-pressure method is equal to differential queue lengths weighted by intersection lane saturation flows. We further improve it by adding basic traffic flow theory. Rather than ensuring that the control system be stable, the system should be also capable of adaptive to various performance metrics. Building on insights from Lyapunov theory, this study designs a reward function for the Reinforcement Learning (RL)-based network signal control, whose agent is trained with Double Deep Q-Network (DDQN) for effective control over complex traffic networks. The proposed algorithm is compared with several traditional and RL-based methods under pure passenger car flow and heterogenous traffic flow including freight, respectively. The numerical tests demonstrate that the proposed method outperforms the alternative control methods across different traffic scenarios, covering corridor and general network situations each with varying traffic demands, in terms of the average network vehicle waiting time per vehicle.


title: Weighted Sobolev estimates of the truncated Beurling operator

abstract: Given a bounded planar domain $D$ with $W^{k+1, \infty}$ boundary, $ k\in \mathbb Z^+$, and a weight $\mu\in A_p, 1<p<\infty$, we show that the corresponding truncated Beurling transform is a bounded operator sending $W^{k, p}(D, \mu)$ into itself. Weighted Sobolev estimates for other Cauchy-type integrals are also obtained.


title: Federated Learning with Server Learning: Enhancing Performance for Non-IID Data

abstract: Federated Learning (FL) has emerged as a means of distributed learning using local data stored at clients with a coordinating server. Recent studies showed that FL can suffer from poor performance and slower convergence when training data at clients are not independent and identically distributed. Here we consider a new complementary approach to mitigating this performance degradation by allowing the server to perform auxiliary learning from a small dataset. Our analysis and experiments show that this new approach can achieve significant improvements in both model accuracy and convergence time even when the server dataset is small and its distribution differs from that of the aggregated data from all clients.


title: Learning to Reason With Relational Abstractions

abstract: Large language models have recently shown promising progress in mathematical reasoning when fine-tuned with human-generated sequences walking through a sequence of solution steps. However, the solution sequences are not formally structured and the resulting model-generated sequences may not reflect the kind of systematic reasoning we might expect an expert human to produce. In this paper, we study how to build stronger reasoning capability in language models using the idea of relational abstractions. We introduce new types of sequences that more explicitly provide an abstract characterization of the transitions through intermediate solution steps to the goal state. We find that models that are supplied with such sequences as prompts can solve tasks with a significantly higher accuracy, and models that are trained to produce such sequences solve problems better than those that are trained with previously used human-generated sequences and other baselines. Our work thus takes several steps toward elucidating and improving how language models perform on tasks requiring multi-step mathematical reasoning.


title: Digital Twin-Empowered Network Planning for Multi-Tier Computing

abstract: In this paper, we design a resource management scheme to support stateful applications, which will be prevalent in 6G networks. Different from stateless applications, stateful applications require context data while executing computing tasks from user terminals (UTs). Using a multi-tier computing paradigm with servers deployed at the core network, gateways, and base stations to support stateful applications, we aim to optimize long-term resource reservation by jointly minimizing the usage of computing, storage, and communication resources and the cost from reconfiguring resource reservation. The coupling among different resources and the impact of UT mobility create challenges in resource management. To address the challenges, we develop digital twin (DT) empowered network planning with two elements, i.e., multi-resource reservation and resource reservation reconfiguration. First, DTs are designed for collecting UT status data, based on which UTs are grouped according to their mobility patterns. Second, an algorithm is proposed to customize resource reservation for different groups to satisfy their different resource demands. Last, a Meta-learning-based approach is developed to reconfigure resource reservation for balancing the network resource usage and the reconfiguration cost. Simulation results demonstrate that the proposed DT-empowered network planning outperforms benchmark frameworks by using less resources and incurring lower reconfiguration costs.


title: Generalization Properties of Retrieval-based Models

abstract: Many modern high-performing machine learning models such as GPT-3 primarily rely on scaling up models, e.g., transformer networks. Simultaneously, a parallel line of work aims to improve the model performance by augmenting an input instance with other (labeled) instances during inference. Examples of such augmentations include task-specific prompts and similar examples retrieved from the training data by a nonparametric component. Remarkably, retrieval-based methods have enjoyed success on a wide range of problems, ranging from standard natural language processing and vision tasks to protein folding, as demonstrated by many recent efforts, including WebGPT and AlphaFold. Despite growing literature showcasing the promise of these models, the theoretical underpinning for such models remains underexplored. In this paper, we present a formal treatment of retrieval-based models to characterize their generalization ability. In particular, we focus on two classes of retrieval-based classification approaches: First, we analyze a local learning framework that employs an explicit local empirical risk minimization based on retrieved examples for each input instance. Interestingly, we show that breaking down the underlying learning task into local sub-tasks enables the model to employ a low complexity parametric component to ensure good overall accuracy. The second class of retrieval-based approaches we explore learns a global model using kernel methods to directly map an input instance and retrieved examples to a prediction, without explicitly solving a local learning task.


title: Dynamic Stochastic Ensemble with Adversarial Robust Lottery Ticket Subnetworks

abstract: Adversarial attacks are considered the intrinsic vulnerability of CNNs. Defense strategies designed for attacks have been stuck in the adversarial attack-defense arms race, reflecting the imbalance between attack and defense. Dynamic Defense Framework (DDF) recently changed the passive safety status quo based on the stochastic ensemble model. The diversity of subnetworks, an essential concern in the DDF, can be effectively evaluated by the adversarial transferability between different networks. Inspired by the poor adversarial transferability between subnetworks of scratch tickets with various remaining ratios, we propose a method to realize the dynamic stochastic ensemble defense strategy. We discover the adversarial transferable diversity between robust lottery ticket subnetworks drawn from different basic structures and sparsity. The experimental results suggest that our method achieves better robust and clean recognition accuracy by adversarial transferable diversity, which would decrease the reliability of attacks.


title: Optimal Sobolev regularity of $\bar\partial$ on the Hartogs triangle

abstract: In this paper, we show that for each $k\in \mathbb Z^+, p>4$, there exists a solution operator $\mathcal T_k$ to the $\bar\partial$ problem on the Hartogs triangle that maintains the same $W^{k, p}$ regularity as that of the data. According to a Kerzman-type example, this operator provides solutions with the optimal Sobolev regularity.


title: Inference Latency Prediction at the Edge

abstract: With the growing workload of inference tasks on mobile devices, state-of-the-art neural architectures (NAs) are typically designed through Neural Architecture Search (NAS) to identify NAs with good tradeoffs between accuracy and efficiency (e.g., latency). Since measuring the latency of a huge set of candidate architectures during NAS is not scalable, approaches are needed for predicting end-to-end inference latency on mobile devices. Such predictions are challenging due to hardware heterogeneity, optimizations applied by ML frameworks, and the diversity of neural architectures. Motivated by these challenges, in this paper, we first quantitatively assess characteristics of neural architectures and mobile devices that have significant effects on inference latency. Based on this assessment, we propose a latency prediction framework which addresses these challenges by developing operation-wise latency predictors, under a variety of settings and a number of hardware devices, with multi-core CPUs and GPUs, achieving high accuracy in end-to-end latency prediction, as shown by our comprehensive evaluations. To illustrate that our approach does not require expensive data collection, we also show that accurate predictions can be achieved on real-world NAs using only small amounts of profiling data.


title: U3E: Unsupervised and Erasure-based Evidence Extraction for Machine Reading Comprehension

abstract: More tasks in Machine Reading Comprehension(MRC) require, in addition to answer prediction, the extraction of evidence sentences that support the answer. However, the annotation of supporting evidence sentences is usually time-consuming and labor-intensive. In this paper, to address this issue and considering that most of the existing extraction methods are semi-supervised, we propose an unsupervised evidence extraction method (U3E). U3E takes the changes after sentence-level feature erasure in the document as input, simulating the decline in problem-solving ability caused by human memory decline. In order to make selections on the basis of fully understanding the semantics of the original text, we also propose metrics to quickly select the optimal memory model for this input changes. To compare U3E with typical evidence extraction methods and investigate its effectiveness in evidence extraction, we conduct experiments on different datasets. Experimental results show that U3E is simple but effective, not only extracting evidence more accurately, but also significantly improving model performance.


title: Training Diverse High-Dimensional Controllers by Scaling Covariance Matrix Adaptation MAP-Annealing

abstract: Pre-training a diverse set of neural network controllers in simulation has enabled robots to adapt online to damage in robot locomotion tasks. However, finding diverse, high-performing controllers requires expensive network training and extensive tuning of a large number of hyperparameters. On the other hand, Covariance Matrix Adaptation MAP-Annealing (CMA-MAE), an evolution strategies (ES)-based quality diversity algorithm, does not have these limitations and has achieved state-of-the-art performance on standard QD benchmarks. However, CMA-MAE cannot scale to modern neural network controllers due to its quadratic complexity. We leverage efficient approximation methods in ES to propose three new CMA-MAE variants that scale to high dimensions. Our experiments show that the variants outperform ES-based baselines in benchmark robotic locomotion tasks, while being comparable with or exceeding state-of-the-art deep reinforcement learning-based quality diversity algorithms.


title: TensorAnalyzer: Identification of Urban Patterns in Big Cities using Non-Negative Tensor Factorization

abstract: Extracting relevant urban patterns from multiple data sources can be difficult using classical clustering algorithms since we have to make a suitable setup of the hyperparameters of the algorithms and deal with outliers. It should be addressed correctly to help urban planners in the decision-making process for the further development of a big city. For instance, experts' main interest in criminology is comprehending the relationship between crimes and the socio-economic characteristics at specific georeferenced locations. In addition, the classical clustering algorithms take little notice of the intricate spatial correlations in georeferenced data sources. This paper presents a new approach to detecting the most relevant urban patterns from multiple data sources based on tensor decomposition. Compared to classical methods, the proposed approach's performance is attested to validate the identified patterns' quality. The result indicates that the approach can effectively identify functional patterns to characterize the data set for further analysis in achieving good clustering quality. Furthermore, we developed a generic framework named TensorAnalyzer, where the effectiveness and usefulness of the proposed methodology are tested by a set of experiments and a real-world case study showing the relationship between the crime events around schools and students performance and other variables involved in the analysis.


title: Revealing Spatial-temporal Taxi Demand Patterns after Vaccination in COVID-19 Pandemic

abstract: The COVID-19 pandemic has had an unprecedented impact on our daily lives. With the increase in vaccination rate, normalcy gradually returns, so is the taxi demand. However, the changes in the spatial-temporal taxi demand pattern and factors impacting the recovery of this demand after COVID-19 vaccination started remain unclear. With the multisource time-series data from Chicago, including pandemic severity, vaccination progress and taxi trip volume, the recovery pattern of taxi demand is analyzed. The result reveals the taxi trip volume and average travel distance increased in most community areas in the city of Chicago after taking the COVID-19 vaccine. Taxi demand recovers relatively faster in the airport and area near the central downtown than in other areas in Chicago. Considering the asynchrony of data, the Pearson coefficient and Dynamic Time Warping (DTW) are both applied to investigate the correlations among different time series. It found that the recovery of taxi demand is not only related to the pandemic severity but strongly correlated with vaccination progress. Then, the leading and lagging relationship between vaccination progress and taxi demand is investigated by Time Lagging Cross-Correlation method. Taxi demand starts to recover after the first-dose vaccination period started and before the second-dose vaccination period. However, it was not until mid-April that the recovery rate of taxi demand exceeded the growth of the vaccination rate.


title: LungViT: Ensembling Cascade of Texture Sensitive Hierarchical Vision Transformers for Cross-Volume Chest CT Image-to-Image Translation

abstract: Chest computed tomography (CT) at inspiration is often complemented by an expiratory CT to identify peripheral airways disease. Additionally, co-registered inspiratory-expiratory volumes can be used to derive various markers of lung function. Expiratory CT scans, however, may not be acquired due to dose or scan time considerations or may be inadequate due to motion or insufficient exhale; leading to a missed opportunity to evaluate underlying small airways disease. Here, we propose LungViT - a generative adversarial learning approach using hierarchical vision transformers for translating inspiratory CT intensities to corresponding expiratory CT intensities. LungViT addresses several limitations of the traditional generative models including slicewise discontinuities, limited size of generated volumes, and their inability to model texture transfer at volumetric level. We propose a shifted-window hierarchical vision transformer architecture with squeeze-and-excitation decoder blocks for modeling dependencies between features. We also propose a multiview texture similarity distance metric for texture and style transfer in 3D. To incorporate global information into the training process and refine the output of our model, we use ensemble cascading. LungViT is able to generate large 3D volumes of size 320 x 320 x 320. We train and validate our model using a diverse cohort of 1500 subjects with varying disease severity. To assess model generalizability beyond the development set biases, we evaluate our model on an out-of-distribution external validation set of 200 subjects. Clinical validation on internal and external testing sets shows that synthetic volumes could be reliably adopted for deriving clinical endpoints of chronic obstructive pulmonary disease.


title: Decision Making under Cumulative Prospect Theory: An Alternating Direction Method of Multipliers

abstract: This paper proposes a novel numerical method for solving the problem of decision making under cumulative prospect theory (CPT), where the goal is to maximize utility subject to practical constraints, assuming only finite realizations of the associated distribution are available. Existing methods for CPT optimization rely on particular assumptions that may not hold in practice. To overcome this limitation, we present the first numerical method with a theoretical guarantee for solving CPT optimization using an alternating direction method of multipliers (ADMM). One of its subproblems involves optimization with the CPT utility subject to a chain constraint, which presents a significant challenge. To address this, we develop two methods for solving this subproblem. The first method uses dynamic programming, while the second method is a modified version of the pooling-adjacent-violators algorithm that incorporates the CPT utility function. Moreover, we prove the theoretical convergence of our proposed ADMM method and the two subproblem-solving methods. Finally, we conduct numerical experiments to validate our proposed approach and demonstrate how CPT's parameters influence investor behavior using real-world data.


title: Improving the Domain Adaptation of Retrieval Augmented Generation (RAG) Models for Open Domain Question Answering

abstract: Retrieval Augment Generation (RAG) is a recent advancement in Open-Domain Question Answering (ODQA). RAG has only been trained and explored with a Wikipedia-based external knowledge base and is not optimized for use in other specialized domains such as healthcare and news. In this paper, we evaluate the impact of joint training of the retriever and generator components of RAG for the task of domain adaptation in ODQA. We propose \textit{RAG-end2end}, an extension to RAG, that can adapt to a domain-specific knowledge base by updating all components of the external knowledge base during training. In addition, we introduce an auxiliary training signal to inject more domain-specific knowledge. This auxiliary signal forces \textit{RAG-end2end} to reconstruct a given sentence by accessing the relevant information from the external knowledge base. Our novel contribution is unlike RAG, RAG-end2end does joint training of the retriever and generator for the end QA task and domain adaptation. We evaluate our approach with datasets from three domains: COVID-19, News, and Conversations, and achieve significant performance improvements compared to the original RAG model. Our work has been open-sourced through the Huggingface Transformers library, attesting to our work's credibility and technical consistency.


title: Cooperative Coverage with a Leader and a Wingmate in Communication-Constrained Environments

abstract: We consider a mission framework in which two unmanned vehicles (UVs), a leader and a wingmate, are required to provide cooperative coverage of an environment while being within a short communication range. This framework finds applications in underwater and/or military domains, where certain constraints are imposed on communication by either the application or the environment. An important objective of missions within this framework is to minimize the total travel and communication costs of the leader-wingmate duo. In this paper, we propose and formulate the problem of finding routes for the UVs that minimize the sum of their travel and communication costs as a network optimization problem of the form of a binary program (BP). The BP is computationally expensive, with the time required to compute optimal solutions increasing rapidly with the problem size. To address this challenge, here, we propose two algorithms, an approximation algorithm and a heuristic algorithm, to solve large-scale instances of the problem swiftly. We demonstrate the effectiveness and the scalability of these algorithms through an analysis of extensive numerical simulations performed over 500 instances, with the number of targets in the instances ranging from 6 to 100.


title: A quantum cosmology approach to cosmic coincidence and inflation

abstract: This work studies the quantum cosmology of a closed, spatially homogeneous, and isotropic FLRW minisuperspace model with electromagnetic radiation as a matter content. We solve the associated Wheeler-DeWitt (WDW) equation using the holographic regularization method and show that the electromagnetic zero-point energy forms the vacuum energy and provides a unified resolution to the horizon, flatness, singularity, and cosmic coincidence problems. This quantum cosmology approach composes an alternative to the usual inflationary paradigm and can be extended to more general matter contents and emergent gravity schemes.


title: MechRetro is a chemical-mechanism-driven graph learning framework for interpretable retrosynthesis prediction and pathway planning

abstract: Leveraging artificial intelligence for automatic retrosynthesis speeds up organic pathway planning in digital laboratories. However, existing deep learning approaches are unexplainable, like "black box" with few insights, notably limiting their applications in real retrosynthesis scenarios. Here, we propose MechRetro, a chemical-mechanism-driven graph learning framework for interpretable retrosynthetic prediction and pathway planning, which learns several retrosynthetic actions to simulate a reverse reaction via elaborate self-adaptive joint learning. By integrating chemical knowledge as prior information, we design a novel Graph Transformer architecture to adaptively learn discriminative and chemically meaningful molecule representations, highlighting the strong capacity in molecule feature representation learning. We demonstrate that MechRetro outperforms the state-of-the-art approaches for retrosynthetic prediction with a large margin on large-scale benchmark datasets. Extending MechRetro to the multi-step retrosynthesis analysis, we identify efficient synthetic routes via an interpretable reasoning mechanism, leading to a better understanding in the realm of knowledgeable synthetic chemists. We also showcase that MechRetro discovers a novel pathway for protokylol, along with energy scores for uncertainty assessment, broadening the applicability for practical scenarios. Overall, we expect MechRetro to provide meaningful insights for high-throughput automated organic synthesis in drug discovery.


title: Data-driven Approaches to Surrogate Machine Learning Model Development

abstract: We demonstrate the adaption of three established methods to the field of surrogate machine learning model development. These methods are data augmentation, custom loss functions and transfer learning. Each of these methods have seen widespread use in the field of machine learning, however, here we apply them specifically to surrogate machine learning model development. The machine learning model that forms the basis behind this work was intended to surrogate a traditional engineering model used in the UK nuclear industry. Previous performance of this model has been hampered by poor performance due to limited training data. Here, we demonstrate that through a combination of additional techniques, model performance can be significantly improved. We show that each of the aforementioned techniques have utility in their own right and in combination with one another. However, we see them best applied as part of a transfer learning operation. Five pre-trained surrogate models produced prior to this research were further trained with an augmented dataset and with our custom loss function. Through the combination of all three techniques, we see an improvement of at least $38\%$ in performance across the five models.


title: Scalability of Superconductor Electronics: Limitations Imposed by AC Clock and Flux Bias Transformers

abstract: Flux transformers are the necessary component of all superconductor digital integrated circuits utilizing ac power for logic cell excitation and clocking, and flux biasing, e.g., Adiabatic Quantum Flux Parametron (AQFP), Reciprocal Quantum Logic, superconducting sensor arrays, qubits, etc. We consider limitations to the integration scale (device number density) imposed by the critical current of the ac power transmission lines and cross coupling between the adjacent transformers. The former sets the minimum line width and the mutual coupling length in the transformer, whereas the latter sets the minimum spacing between the transformers. Decreasing linewidth of superconducting (Nb) wires increases kinetic inductance of the transformer's secondary, decreasing its length and mutual coupling to the primary. This limits the minimum size of transformers. As a result, there is a minimum linewidth ~100 nm which determines the maximum achievable scale of integration. Using AQFP circuits as an example, we calculate dependence of the AQFP number density on linewidth for various types of transformers and inductors available in the SFQ5ee fabrication process developed at MIT Lincoln Laboratory, and estimate the maximum circuit density as a few million AQFPs per cm^2. We propose an advanced fabrication process for a 10x increase in the density of AQFP and other ac-powered circuits. In this process, inductors are formed from a patterned bilayer of a geometrical inductance material (Nb) deposited over a layer of high kinetic inductance material (e.g., NbN). Individual pattering of the bilayer layers allows to create stripline inductors in a wide range of inductances, from the low values typical to Nb striplines to the high values typical for NbN thin films, and preserve sufficient mutual coupling in stripline transformers with extremely low crosstalk.


title: Shannon entropy: an econophysical approach to cryptocurrency portfolios

abstract: Cryptocurrency markets have attracted many interest for global investors because of their novelty, wide online availability, increasing capitalization and potential profits. In the econophysics tradition we show that many of the most available cryptocurrencies have return statistics that do not follow Gaussian distributions but heavy--tailed distributions instead. Entropy measures are also applied showing that portfolio diversification is a reasonable practice for decreasing return uncertainty.


title: Photon propagation in a material medium on a curved spacetime

abstract: We consider a nonlinear dielectric medium surrounding a static, charged and spherically symmetric compact body which gravitational field is driven by General Relativity (GR). Considering the propagating waves on the dielectric medium, we describe the trajectory of light as geodesics on an effective geometry given by Hadamard's discontinuities. We analyze some consequences of the effective geometry in the propagation of light, with relation to the predictions of the background gravitational field, that includes corrections on the geometrical redshift and on the gravitational deflection of light. We show that the background electromagnetic field polarize the material medium, such that different polarizations of light are distinguished by different corrections on these quantities. As a consequence, we have two possible paths for the trajectory of light in such configuration, that coincide if we turn off the electromagnetic field or if the permittivity is constant. We show that the effective metric associated to the negative polarization, for a given dependence of the dielectric permittivity, is conformally flat.


title: Research on the quantity and brightness evolution characteristics of Photospheric Bright Points groups

abstract: Context. Photospheric bright points (BPs), as the smallest magnetic element of the photosphere and the footpoint tracer of the magnetic flux tube, are of great significance to the study of BPs. Compared with the study of the characteristics and evolution of a few specific BPs, the study of BPs groups can provide us with a better understanding of the characteristics and overall activities of BPs groups. Aims. We aim to find out the evolution characteristics of the brightness and number of BPs groups at different brightness levels, and how these characteristics differ between quiet and active regions. Methods. We propose a hybrid BPs detection model (HBD Model) combining traditional technology and neural network. The Model is used to detect and calculate the BPs brightness characteristics of each frame of continuous high resolution image sequences of active and quiet regions in TiO-band of a pair of BBSO. Using machine learning clustering method, the PBs of each frame was divided into four levels groups (level1-level4) according to the brightness from low to high. Finally, Fourier transform and inverse Fourier transform are used to analyze the evolution of BPs brightness and quantity in these four levels groups. Results. The activities of BPs groups are not random and disorderly. In different levels of brightness, their quantity and brightness evolution show complex changes. Among the four levels of brightness, BPs in the active region were more active and intense than those in the quiet region. However, the quantity and brightness evolution of BPs groups in the quiet region showed the characteristics of large periodic changes and small periodic changes in the medium and high brightness levels (level3 and level4). The brightness evolution of PBs group in the quiet region has obvious periodic changes, but the active region is in a completely random and violent fluctuation state.


title: Geodesic Graph Neural Network for Efficient Graph Representation Learning

abstract: Graph Neural Networks (GNNs) have recently been applied to graph learning tasks and achieved state-of-the-art (SOTA) results. However, many competitive methods run GNNs multiple times with subgraph extraction and customized labeling to capture information that is hard for normal GNNs to learn. Such operations are time-consuming and do not scale to large graphs. In this paper, we propose an efficient GNN framework called Geodesic GNN (GDGNN) that requires only one GNN run and injects conditional relationships between nodes into the model without labeling. This strategy effectively reduces the runtime of subgraph methods. Specifically, we view the shortest paths between two nodes as the spatial graph context of the neighborhood around them. The GNN embeddings of nodes on the shortest paths are used to generate geodesic representations. Conditioned on the geodesic representations, GDGNN can generate node, link, and graph representations that carry much richer structural information than plain GNNs. We theoretically prove that GDGNN is more powerful than plain GNNs. We present experimental results to show that GDGNN achieves highly competitive performance with SOTA GNN models on various graph learning tasks while taking significantly less time.


title: IR2Net: Information Restriction and Information Recovery for Accurate Binary Neural Networks

abstract: Weight and activation binarization can efficiently compress deep neural networks and accelerate model inference, but cause severe accuracy degradation. Existing optimization methods for binary neural networks (BNNs) focus on fitting full-precision networks to reduce quantization errors, and suffer from the trade-off between accuracy and computational complexity. In contrast, considering the limited learning ability and information loss caused by the limited representational capability of BNNs, we propose IR$^2$Net to stimulate the potential of BNNs and improve the network accuracy by restricting the input information and recovering the feature information, including: 1) information restriction: for a BNN, by evaluating the learning ability on the input information, discarding some of the information it cannot focus on, and limiting the amount of input information to match its learning ability; 2) information recovery: due to the information loss in forward propagation, the output feature information of the network is not enough to support accurate classification. By selecting some shallow feature maps with richer information, and fusing them with the final feature maps to recover the feature information. In addition, the computational cost is reduced by streamlining the information recovery method to strike a better trade-off between accuracy and efficiency. Experimental results demonstrate that our approach still achieves comparable accuracy even with $ \sim $10x floating-point operations (FLOPs) reduction for ResNet-18. The models and code are available at https://github.com/pingxue-hfut/IR2Net.


title: What Can We Compute in a Single Round of the Congested Clique?

abstract: We show that any one-round algorithm that computes a minimum spanning tree (MST) in the unicast congested clique must use a link bandwidth of $\Omega(\log^3 n)$ bits in the worst case. Consequently, computing an MST under the standard assumption of $O(\log n)$-size messages requires at least $2$ rounds. This is the first round complexity lower bound in the unicast congested clique for a problem where the output size is small, i.e., $O(n\log n)$ bits. Our lower bound holds as long as every edge of the MST is output by an incident node. To the best of our knowledge, all prior lower bounds for the unicast congested clique either considered problems with large output sizes (e.g., triangle enumeration) or required every node to learn the entire output.


title: Optomechanical Effects in Nanocavity-enhanced Resonant Raman Scattering of a Single Molecule

abstract: In this article, we address the optomechanical effects in surface-enhanced resonant Raman scattering (SERRS) from a single molecule in a nano-particle on mirror (NPoM) nanocavity by developing a quantum master equation theory, which combines macroscopic quantum electrodynamics and electron-vibration interaction within the framework of open quantum system theory. We supplement the theory with electromagnetic simulations and time-dependent density functional theory calculations in order to study the SERRS of a methylene blue molecule in a realistic NPoM nanocavity. The simulations allow us not only to identify the conditions to achieve conventional optomechanical effects, such as vibrational pumping, non-linear scaling of Stokes and anti-Stokes scattering, but also to discovery distinct behaviors, such as the saturation of exciton population, the emergence of Mollow triplet side-bands, and higher-order Raman scattering. All in all, our study might guide further investigations of optomechanical effects in resonant Raman scattering.


title: ForestQB: An Adaptive Query Builder to Support Wildlife Research

abstract: This paper presents ForestQB, a SPARQL query builder, to assist Bioscience and Wildlife Researchers in accessing Linked-Data. As they are unfamiliar with the Semantic Web and the data ontologies, ForestQB aims to empower them to benefit from using Linked-Data to extract valuable information without having to grasp the nature of the data and its underlying technologies. ForestQB is integrating Form-Based Query builders with Natural Language to simplify query construction to match the user requirements. Demo available at https://iotgarage.net/demo/forestQB


title: Quashing a suspected selection bias in galaxy samples having dynamically-measured supermassive black holes

abstract: Local early-type galaxies with directly-measured black hole masses, $M_{\rm bh}$, have been reported to represent a biased sample relative to the population at large. Such galaxies with Spitzer Space Telescope imaging have been purported to possess velocity dispersions, $\sigma$, at least $\sim$0.1 dex larger for a given galaxy stellar mass, $M_{\rm *,gal}$, than is typically observed among thousands of early-type galaxies imaged by the Sloan Digital Sky Survey. This apparent offset led Shankar et al. to reduce the normalisation of the observed $M_{\rm bh} \propto \sigma^5$ relation by at least $\sim$0.5 dex to give their "intrinsic relations", including $\sigma$-based modifications to the $M_{\rm bh}$-$M_{\rm *,gal}$ relation. These modifications were based on the untested assumption that the stellar masses had been derived consistently between the two samples. Here, we provide the necessary check using galaxies common to the Spitzer Survey of Stellar Structure in Galaxies (S$^4$G) and the Sloan Digital Sky Survey (SDSS). We find that the stellar masses of galaxies with and without directly measured black holes had appeared offset from each other due to the use of inconsistent stellar mass-to-light ratios, $\Upsilon_*$, for the optical and infrared data. We briefly discuss the "intrinsic relations" and why some of these will at times appear to have had partial success when applied to data based on similarly inconsistent values of $\Upsilon_*$. Finally, we reiterate the importance of the $\upsilon$ (lower-case $\Upsilon$) term, which we previously introduced into the $M_{\rm bh}$-$M_{\rm *}$ relations to help avoid $\Upsilon_*$-related mismatches.


title: Feasibility on Detecting Door Slamming towards Monitoring Early Signs of Domestic Violence

abstract: By using low-cost microcontrollers and TinyML, we investigate the feasibility of detecting potential early warning signs of domestic violence and other anti-social behaviors within the home. We created a machine learning model to determine if a door was closed aggressively by analyzing audio data and feeding this into a convolutional neural network to classify the sample. Under test conditions, with no background noise, accuracy of 88.89\% was achieved, declining to 87.50\% when assorted background noises were mixed in at a relative volume of 0.5 times that of the sample. The model is then deployed on an Arduino Nano BLE 33 Sense attached to the door, and only begins sampling once an acceleration greater than a predefined threshold acceleration is detected. The predictions made by the model can then be sent via BLE to another device, such as a smartphone of Raspberry Pi.


title: Automatic Scene-based Topic Channel Construction System for E-Commerce

abstract: Scene marketing that well demonstrates user interests within a certain scenario has proved effective for offline shopping. To conduct scene marketing for e-commerce platforms, this work presents a novel product form, scene-based topic channel which typically consists of a list of diverse products belonging to the same usage scenario and a topic title that describes the scenario with marketing words. As manual construction of channels is time-consuming due to billions of products as well as dynamic and diverse customers' interests, it is necessary to leverage AI techniques to automatically construct channels for certain usage scenarios and even discover novel topics. To be specific, we first frame the channel construction task as a two-step problem, i.e., scene-based topic generation and product clustering, and propose an E-commerce Scene-based Topic Channel construction system (i.e., ESTC) to achieve automated production, consisting of scene-based topic generation model for the e-commerce domain, product clustering on the basis of topic similarity, as well as quality control based on automatic model filtering and human screening. Extensive offline experiments and online A/B test validates the effectiveness of such a novel product form as well as the proposed system. In addition, we also introduce the experience of deploying the proposed system on a real-world e-commerce recommendation platform.


title: Non-Reciprocal Supercurrents in a Field-Free Graphene Josephson Triode

abstract: Superconducting diodes are proposed non-reciprocal circuit elements that should exhibit non-dissipative transport in one direction while being resistive in the opposite direction. Multiple examples of such devices have emerged in the past couple of years, however their efficiency is typically limited, and most of them require magnetic field to function. Here we present a device achieving efficiencies upwards of 90% while operating at zero field. Our samples consist of a network of three graphene Josephson junctions linked by a common superconducting island, to which we refer as a Josephson triode. The triode is tuned by applying a control current to one of the contacts, thereby breaking the time-reversal symmetry of the current flow. The triode's utility is demonstrated by rectifying a small (tens of nA amplitude) applied square wave. We speculate that devices of this type could be realistically employed in the modern quantum circuits.


title: Quantum-improved phase estimation with a displacement-assisted SU(1,1) interferometer

abstract: By performing two local displacement operations (LDOs) inside an SU(1,1) interferometer, called as the displacement-assisted SU(1,1) [DSU(1,1)], both the phase sensitivity based on homodyne detection and quantum Fisher information (QFI) with and without photon losses are investigated in this paper. In this DSU(1,1) interferometer, we focus our attention on the extent to which the introduced LDO affects the phase sensitivity and the QFI, even in the realistic scenario. Our analyses show that the estimation performance of DSU(1,1) interferometer is always better than that of SU(1,1) interferometer without the LDO, especially the phase precision of the former in the ideal scenario gradually approaching to the Heisenberg limit via the increase of the LDO strength. More significantly, different from the latter, the robustness of the former can be enhanced markedly by regulating and controlling the LDO. Our findings would open an useful view for quantum-improved phase estimation of optical interferometers.


title: Magnetic Schr\"odinger operators and landscape functions

abstract: We study localization properties of low-lying eigenfunctions of magnetic Schr\"odinger operators $$\frac{1}{2} \left(- i\nabla - A(x)\right)^2 \phi + V(x) \phi = \lambda \phi,$$ where $V:\Omega \rightarrow \mathbb{R}_{\geq 0}$ is a given potential and $A:\Omega \rightarrow \mathbb{R}^d$ induces a magnetic field. We extend the Filoche-Mayboroda inequality and prove a refined inequality in the magnetic setting which can predict the points where low-energy eigenfunctions are localized. This result is new even in the case of vanishing magnetic field. Numerical examples illustrate the results.


title: Ensemble Kalman Filtering for Glacier Modeling

abstract: Working with a two-stage ice sheet model, we explore how statistical data assimilation methods can be used to improve predictions of glacier melt and relatedly, sea level rise. We find that the EnKF improves model runs initialized using incorrect initial conditions or parameters, providing us with better models of future glacier melt. We explore the necessary number of observations needed to produce an accurate model run. Further, we determine that the deviations from the truth in output that stem from having few data points in the pre-satellite era can be corrected with modern observation data. Finally, using data derived from our improved model we calculate sea level rise and model storm surges to understand the affect caused by sea level rise.

categories: math.DS cs.NA math.NA math.PR physics.ao-ph


title: Self-triggered Consensus of Multi-agent Systems with Quantized Relative State Measurements

abstract: This paper addresses the consensus problem of first-order continuous-time multi-agent systems over undirected graphs. Each agent samples relative state measurements in a self-triggered fashion and transmits the sum of the measurements to its neighbors. Moreover, we use finite-level dynamic quantizers and apply the zooming-in technique. The proposed joint design method for quantization and self-triggered sampling achieves asymptotic consensus, and inter-event times are strictly positive. Sampling times are determined explicitly with iterative procedures including the computation of the Lambert $W$-function. A simulation example is provided to illustrate the effectiveness of the proposed method.


title: Solar Diffraction of LIGO-Band Gravitational Waves

abstract: We show that chirping gravitational waves in the LIGO frequency band $f=1 - 5000$ Hz can be gravitationally diffracted by the Sun, due to the coincidence of its Fresnel length $r_F \propto \sqrt{1\, {\rm AU}/f}$ and the solar radius $r_\odot$. This solar diffraction is detectable through its frequency-dependent amplification of the wave, albeit with low event rates. We also advocate that solar diffraction allows probing the inner solar profile with the chirping evolution of frequencies. Along the course, we develop diffractive lensing in terms of simple convergence and shear of a lens and emphasize the relevance of high-frequency regimes including merger and ringdown phases for detection. This work not only presents an interesting opportunity with ongoing and future LIGO-band missions but also develops the diffractive lensing of long-wavelength waves in the universe. A similar phenomenon can also help discover non-relativistic wave dark matter, as studied in a sequel.


title: PrivacyCube: A Tangible Device for Improving Privacy Awareness in IoT

abstract: Consumers increasingly bring IoT devices into their living spaces without understanding how their data is collected, processed, and used. We present PrivacyCube, a novel tangible device designed to explore the extent to which privacy awareness in smart homes can be elevated. PrivacyCube visualises IoT devices' data consumption displaying privacy-related notices. PrivacyCube aims at assisting families to (i) understand key privacy aspects better and (ii) have conversations around data management practices of IoT devices. Thus, families can learn and make informed privacy decisions collectively.


title: Tracking the Evolution of Static Code Warnings: the State-of-the-Art and a Better Approach

abstract: Static bug detection tools help developers detect problems in the code, including bad programming practices and potential defects. Recent efforts to integrate static bug detectors in modern software development workflows, such as in code review and continuous integration, are shown to better motivate developers to fix the reported warnings on the fly. A proper mechanism to track the evolution of the reported warnings can better support such integration. Moreover, tracking the static code warnings will benefit many downstream software engineering tasks, such as learning the fix patterns for automated program repair, and learning which warnings are of more interest, so they can be prioritized automatically. In addition, the utilization of tracking tools enables developers to concentrate on the most recent and actionable static warnings rather than being overwhelmed by the thousands of warnings from the entire project. This, in turn, enhances the utilization of static analysis tools. Hence, precisely tracking the warnings by static bug detectors is critical to improving the utilization of static bug detectors further.


title: Limiting weak type behaviors of maximal operator on the positive real axis

abstract: In this note, we establish a discrete method to characterize the limiting weak type behaviors of the centered Hardy-Littlewood maximal operator on the positive real axis through testing on Dirac deltas. As an application, we give some new examples of the limiting weak-type behaviors of the maximal operator associated with several special measures.


title: Stabilization-free serendipity virtual element method for plane elasticity

abstract: We present a higher order stabilization-free virtual element method applied to plane elasticity problems. We utilize a serendipity approach to reduce the total number of degrees of freedom from the corresponding high-order approximations. The well-posedness of the problem is numerically studied via an eigenanalysis. The method is then applied to several benchmark problems from linear elasticity and we show that the method delivers optimal convergence rates in $L^2$ norm and energy seminorm that match theoretical estimates as well as the convergence rates from higher order virtual element methods.


title: Learning Algorithms for Intelligent Agents and Mechanisms

abstract: In this thesis, we research learning algorithms for optimal decision making in two different contexts, Reinforcement Learning in Part I and Auction Design in Part II. Reinforcement learning (RL) is an area of machine learning that is concerned with how an agent should act in an environment in order to maximize its cumulative reward over time. In Chapter 2, inspired by statistical physics, we develop a novel approach to Reinforcement Learning (RL) that not only learns optimal policies with enhanced desirable properties but also sheds new light on maximum entropy RL. In Chapter 3, we tackle the generalization problem in RL using a Bayesian perspective. We show that imperfect knowledge of the environments dynamics effectively turn a fully-observed Markov Decision Process (MDP) into a Partially Observed MDP (POMDP) that we call the Epistemic POMDP. Informed by this observation, we develop a new policy learning algorithm LEEP which has improved generalization properties. Designing an incentive compatible, individually rational auction that maximizes revenue is a challenging and intractable problem. Recently, deep learning based approaches have been proposed to learn optimal auctions from data. While successful, this approach suffers from a few limitations, including sample inefficiency, lack of generalization to new auctions, and training difficulties. In Chapter 4, we construct a symmetry preserving neural network architecture, EquivariantNet, suitable for anonymous auctions. EquivariantNet is not only more sample efficient but is also able to learn auction rules that generalize well to other settings. In Chapter 5, we propose a novel formulation of the auction learning problem as a two player game. The resulting learning algorithm, ALGNet, is easier to train, more reliable and better suited for non stationary settings.


title: Domain Generalization via Contrastive Causal Learning

abstract: Domain Generalization (DG) aims to learn a model that can generalize well to unseen target domains from a set of source domains. With the idea of invariant causal mechanism, a lot of efforts have been put into learning robust causal effects which are determined by the object yet insensitive to the domain changes. Despite the invariance of causal effects, they are difficult to be quantified and optimized. Inspired by the ability that humans adapt to new environments by prior knowledge, We develop a novel Contrastive Causal Model (CCM) to transfer unseen images to taught knowledge which are the features of seen images, and quantify the causal effects based on taught knowledge. Considering the transfer is affected by domain shifts in DG, we propose a more inclusive causal graph to describe DG task. Based on this causal graph, CCM controls the domain factor to cut off excess causal paths and uses the remaining part to calculate the causal effects of images to labels via the front-door criterion. Specifically, CCM is composed of three components: (i) domain-conditioned supervised learning which teaches CCM the correlation between images and labels, (ii) causal effect learning which helps CCM measure the true causal effects of images to labels, (iii) contrastive similarity learning which clusters the features of images that belong to the same class and provides the quantification of similarity. Finally, we test the performance of CCM on multiple datasets including PACS, OfficeHome, and TerraIncognita. The extensive experiments demonstrate that CCM surpasses the previous DG methods with clear margins.


title: Trust in Motion: Capturing Trust Ascendancy in Open-Source Projects using Hybrid AI

abstract: Open-source is frequently described as a driver for unprecedented communication and collaboration, and the process works best when projects support teamwork. Yet, open-source cooperation processes in no way protect project contributors from considerations of trust, power, and influence. Indeed, achieving the level of trust necessary to contribute to a project and thus influence its direction is a constant process of change, and developers take many different routes over many communication channels to achieve it. We refer to this process of influence-seeking and trust-building as trust ascendancy. This paper describes a methodology for understanding the notion of trust ascendancy and introduces the capabilities that are needed to localize trust ascendancy operations happening over open-source projects. Much of the prior work in understanding trust in open-source software development has focused on a static view of the problem using different forms of quantity measures. However, trust ascendancy is not static, but rather adapts to changes in the open-source ecosystem in response to new input. This paper is the first attempt to articulate and study these signals from a dynamic view of the problem. In that respect, we identify related work that may help illuminate research challenges, implementation tradeoffs, and complementary solutions. Our preliminary results show the effectiveness of our method at capturing the trust ascendancy developed by individuals involved in a well-documented 2020 social engineering attack. Our future plans highlight research challenges and encourage cross-disciplinary collaboration to create more automated, accurate, and efficient ways to model and then track trust ascendancy in open-source projects.


title: Predictive Edge Caching through Deep Mining of Sequential Patterns in User Content Retrievals

abstract: Edge caching plays an increasingly important role in boosting user content retrieval performance while reducing redundant network traffic. The effectiveness of caching ultimately hinges on the accuracy of predicting content popularity in the near future. However, at the network edge, content popularity can be extremely dynamic due to diverse user content retrieval behaviors and the low-degree of user multiplexing. It's challenging for the traditional reactive caching systems to keep up with the dynamic content popularity patterns. In this paper, we propose a novel Predictive Edge Caching (PEC) system that predicts the future content popularity using fine-grained learning models that mine sequential patterns in user content retrieval behaviors, and opportunistically prefetches contents predicted to be popular in the near future using idle network bandwidth. Through extensive experiments driven by real content retrieval traces, we demonstrate that PEC can adapt to highly dynamic content popularity, and significantly improve cache hit ratio and reduce user content retrieval latency over the state-of-art caching policies. More broadly, our study demonstrates that edge caching performance can be boosted by deep mining of user content retrieval behaviors.


title: Learning functional sections in medical conversations: iterative pseudo-labeling and human-in-the-loop approach

abstract: Medical conversations between patients and medical professionals have implicit functional sections, such as "history taking", "summarization", "education", and "care plan." In this work, we are interested in learning to automatically extract these sections. A direct approach would require collecting large amounts of expert annotations for this task, which is inherently costly due to the contextual inter-and-intra variability between these sections. This paper presents an approach that tackles the problem of learning to classify medical dialogue into functional sections without requiring a large number of annotations. Our approach combines pseudo-labeling and human-in-the-loop. First, we bootstrap using weak supervision with pseudo-labeling to generate dialogue turn-level pseudo-labels and train a transformer-based model, which is then applied to individual sentences to create noisy sentence-level labels. Second, we iteratively refine sentence-level labels using a cluster-based human-in-the-loop approach. Each iteration requires only a few dozen annotator decisions. We evaluate the results on an expert-annotated dataset of 100 dialogues and find that while our models start with 69.5% accuracy, we can iteratively improve it to 82.5%. The code used to perform all experiments described in this paper can be found here: https://github.com/curai/curai-research/tree/main/functional-sections.


title: Explainable Abuse Detection as Intent Classification and Slot Filling

abstract: To proactively offer social media users a safe online experience, there is a need for systems that can detect harmful posts and promptly alert platform moderators. In order to guarantee the enforcement of a consistent policy, moderators are provided with detailed guidelines. In contrast, most state-of-the-art models learn what abuse is from labelled examples and as a result base their predictions on spurious cues, such as the presence of group identifiers, which can be unreliable. In this work we introduce the concept of policy-aware abuse detection, abandoning the unrealistic expectation that systems can reliably learn which phenomena constitute abuse from inspecting the data alone. We propose a machine-friendly representation of the policy that moderators wish to enforce, by breaking it down into a collection of intents and slots. We collect and annotate a dataset of 3,535 English posts with such slots, and show how architectures for intent classification and slot filling can be used for abuse detection, while providing a rationale for model decisions.


title: Representing Marginalized Populations: Challenges in Anthropographics

abstract: Anthropographics are human-shaped visualizations that have primarily been used within visualization research and data journalism to show humanitarian and demographic data. However, anthropographics have typically been produced by a small group of designers, researchers, and journalists, and most use homogeneous representations of marginalized populations-representations that might have problematic implications for how viewers perceive the people they represent. In this paper, we use a critical lens to examine anthropographic visualization practices in projects about marginalized populations. We present critiques that identify three potential challenges related to the use of anthropographics and highlight possible unintended consequences-namely (1) creating homogeneous depictions of marginalized populations, (2) treating marginalization as an inclusion criteria, and (3) insufficiently contextualizing datasets about marginalization. Finally, we highlight opportunities for anthropographics research, including the need to develop techniques for representing demographic differences between marginalized populations and for studies exploring other potential effects of anthropographics.


title: Topological Continual Learning with Wasserstein Distance and Barycenter

abstract: Continual learning in neural networks suffers from a phenomenon called catastrophic forgetting, in which a network quickly forgets what was learned in a previous task. The human brain, however, is able to continually learn new tasks and accumulate knowledge throughout life. Neuroscience findings suggest that continual learning success in the human brain is potentially associated with its modular structure and memory consolidation mechanisms. In this paper we propose a novel topological regularization that penalizes cycle structure in a neural network during training using principled theory from persistent homology and optimal transport. The penalty encourages the network to learn modular structure during training. The penalization is based on the closed-form expressions of the Wasserstein distance and barycenter for the topological features of a 1-skeleton representation for the network. Our topological continual learning method combines the proposed regularization with a tiny episodic memory to mitigate forgetting. We demonstrate that our method is effective in both shallow and deep network architectures for multiple image classification datasets.


title: An intermediate phase induced by dilution in a correlated Dirac Fermi system

abstract: Substituting magnetic ions with nonmagnetic ions is a new way to study dilution. Using determinant quantum Monte Carlo calculations, we investigate an interacting Dirac fermion model with the on-site Coulomb repulsion being randomly zero on a fraction $x$ of sites. Based on conductivity, density of states and antiferromagnetic structure factor, our results reveal a novel intermediate insulating phase induced by the competition between dilution and repulsion. With increasing doping level of nonmagnetic ions, this nonmagnetic intermediate phase is found to emerge from the zero-temperature quantum critical point separating a metallic and a Mott insulating phase, whose robustness is proven over a wide range of interactions. Under the premise of strongly correlated materials, we suggest that doping nonmagnetic ions can effectively convert the system back to the paramagnetic metallic phase. This result not only agrees with experiments on the effect of dilution on magnetic order but also provides a possible direction for studies focusing on the metal-insulator transition in honeycomb lattice like materials.