title: Borel's rank theorem for Artin $L$-functions

abstract: Borel's rank theorem identifies the ranks of algebraic $K$-groups of the ring of integers of a number field with the orders of vanishing of the Dedekind zeta function attached to the field. Following the work of Gross, we establish a version of this theorem for Artin $L$-functions by considering equivariant algebraic $K$-groups of number fields with coefficients in rational Galois representations. This construction involves twisting algebraic $K$-theory spectra with rational equivariant Moore spectra. We further discuss integral equivariant Moore spectra attached to Galois representations and their potential applications in $L$-functions.


title: New Lower Bounds for Cap Sets

abstract: A cap set is a subset of $\mathbb{F}_3^n$ with no solutions to $x+y+z=0$ other than when $x=y=z$. In this paper, we provide a new lower bound on the size of a maximal cap set. Building on a construction of Edel, we use improved computational methods and new theoretical ideas to show that, for large enough $n$, there is always a cap set in $\mathbb{F}_3^n$ of size at least $2.218^n$.


title: Contractivity of the Method of Successive Approximations for Optimal Control

abstract: Strongly contracting dynamical systems have numerous properties (e.g., incremental ISS), find widespread applications (e.g., in controls and learning), and their study is receiving increasing attention. This work starts with the simple observation that, given a strongly contracting system, its adjoint dynamical system is also strongly contracting, with the same rate, with respect to the dual norm, under time reversal. As main implication of this dual contractivity, we show that the classic Method of Successive Approximations (MSA), an indirect method in optimal control, is a contraction mapping for short optimization intervals or large contraction rates. Consequently, we establish new convergence conditions for the MSA algorithm, which further imply uniqueness of the optimal control and sufficiency of Pontryagin's minimum principle under additional assumptions.


title: Uncertainty-Aware Tightly-Coupled GPS Fused LIO-SLAM

abstract: Delivery robots aim to achieve high precision to facilitate complete autonomy. A precise three-dimensional point cloud map of sidewalk surroundings is required to estimate self-location. With or without the loop closing method, the cumulative error increases gradually after mapping for larger urban or city maps due to sensor drift. Therefore, there is a high risk of using the drifted or misaligned map. This article presented a technique for fusing GPS to update the 3D point cloud and eliminate cumulative error. The proposed method shows outstanding results in quantitative comparison and qualitative evaluation with other existing methods.


title: Interior regularity for strong solutions to a class of fully nonlinear elliptic equations

abstract: We obtain local pointwise second derivative estimates for $W^{2,p}$-strong solutions to a class of fully nonlinear elliptic equations on Euclidean domains, motivated by problems in conformal geometry.


title: Introducing emotions in the reasoning cycle ofnormative aware agents

abstract: Human relationships are complex processes that often involve following certain rules that regulate interactions and/or expected outcomes. These rules may be imposed by an authority or established by society. In multi-agent systems, normative systems have extensively addressed aspects such as norm synthesis, norm conflict detection, as well as norm emergence. However, if human behaviour is to be adequately simulated, not only normative aspects but also emotional aspects have to be taken into account. In this paper, we propose a Jason agent architecture that incorporates norms and emotions in its reasoning process to determine which plan (actions) to execute. The proposal is evaluated through a scenario based on a social network, which allows us to analyse the benefits of using emotional normative agents to achieve simulations closer to real human world.


title: Resilience based Electric Sector Optimization in Response to Extreme Weather Conditions with Distributed Generation Systems

abstract: Extreme weather events stemming from climate change can cause significant damage and disruption to power systems. Failure to mitigate and adapt to climate change and its cascading effects can lead to short and long term issues. The profound costs of outage in power systems, integrated with the impacts on individual safety and security from loss of critical services, necessitate an urgent need to guarantee resilience in electric power systems. This article proposes a framework to optimize the electricity sector design to be more resilient to climate change and extreme weather events by using distributed generators. The proposed framework considers components dynamic behavior and interdependencies under an uncertain environment. The climate data and socio economic factors are used to generate demand and supply pattern scenarios. The generated scenarios are simulated and utilized in a stochastic optimization model to find the optimal resilience based system design.


title: An Unregularized Third Order Newton Method

abstract: In this paper, we propose a third-order Newton's method which in each iteration solves a semidefinite program as a subproblem. Our approach is based on moving to the local minimum of the third-order Taylor expansion at each iteration, rather than that of the second order. We show that this scheme has local cubic convergence. We then provide numerical experiments comparing this scheme to some standard algorithms.


title: Adapting Pretrained Text-to-Text Models for Long Text Sequences

abstract: We present an empirical study of adapting an existing pretrained text-to-text model for long-sequence inputs. Through a comprehensive study along three axes of the pretraining pipeline -- model architecture, optimization objective, and pretraining corpus, we propose an effective recipe to build long-context models from existing short-context models. Specifically, we replace the full attention in transformers with pooling-augmented blockwise attention, and pretrain the model with a masked-span prediction task with spans of varying length. In terms of the pretraining corpus, we find that using randomly concatenated short-documents from a large open-domain corpus results in better performance than using existing long document corpora which are typically limited in their domain coverage. With these findings, we build a long-context model that achieves competitive performance on long-text QA tasks and establishes the new state of the art on five long-text summarization datasets, often outperforming previous methods with larger model sizes. Our code has been released at https://github.com/facebookresearch/bart_ls.


title: Instance-dependent uniform tail bounds for empirical processes

abstract: We formulate a uniform tail bound for empirical processes indexed by a class of functions, in terms of the individual deviations of the functions rather than the worst-case deviation in the considered class. The tail bound is established by introducing an initial "deflation" step to the standard generic chaining argument. The resulting tail bound is the sum of the complexity of the "deflated function class" in terms of a generalization of Talagrand's $\gamma$ functional, and the deviation of the function instance, both of which are formulated based on the natural seminorm induced by the corresponding Cram\'{e}r functions. We also provide certain approximations for the mentioned seminorm when the function class lies in a given (exponential type) Orlicz space, that can be used to make the complexity term and the deviation term more explicit.


title: Multi band Fermi surface in 1T-VSe2 and its implication for charge density wave phase

abstract: Here, our angle resolved photoemission spectroscopy experiment reveled that the surface band structure of the 1T-VSe2 host electronic states that was not predicted or probed before. Earlier claims to support charge density wave phase can be all explained in terms of these new findings. Its Fermi surface found to be not gaped at any point of the Brillouin zone and warping effect on the electronic structure, attributed to the lattice distortion previously, is due to the different dispersion of the multiple bands. Based on these new findings and interpretations, charge density wave induced modification on the electronic structure of 1T-VSe2 needs to be reconstructed in the future studies.


title: Lamarckian Platform: Pushing the Boundaries of Evolutionary Reinforcement Learning towards Asynchronous Commercial Games

abstract: Despite the emerging progress of integrating evolutionary computation into reinforcement learning, the absence of a high-performance platform endowing composability and massive parallelism causes non-trivial difficulties for research and applications related to asynchronous commercial games. Here we introduce Lamarckian - an open-source platform featuring support for evolutionary reinforcement learning scalable to distributed computing resources. To improve the training speed and data efficiency, Lamarckian adopts optimized communication methods and an asynchronous evolutionary reinforcement learning workflow. To meet the demand for an asynchronous interface by commercial games and various methods, Lamarckian tailors an asynchronous Markov Decision Process interface and designs an object-oriented software architecture with decoupled modules. In comparison with the state-of-the-art RLlib, we empirically demonstrate the unique advantages of Lamarckian on benchmark tests with up to 6000 CPU cores: i) both the sampling efficiency and training speed are doubled when running PPO on Google football game; ii) the training speed is 13 times faster when running PBT+PPO on Pong game. Moreover, we also present two use cases: i) how Lamarckian is applied to generating behavior-diverse game AI; ii) how Lamarckian is applied to game balancing tests for an asynchronous commercial game.


title: In-Network Accumulation: Extending the Role of NoC for DNN Acceleration

abstract: Network-on-Chip (NoC) plays a significant role in the performance of a DNN accelerator. The scalability and modular design property of the NoC help in improving the performance of a DNN execution by providing flexibility in running different kinds of workloads. Data movement in a DNN workload is still a challenging task for DNN accelerators and hence a novel approach is required. In this paper, we propose the In-Network Accumulation (INA) method to further accelerate a DNN workload execution on a many-core spatial DNN accelerator for the Weight Stationary (WS) dataflow model. The INA method expands the router's function to support partial sum accumulation. This method avoids the overhead of injecting and ejecting an incoming partial sum to the local processing element. The simulation results on AlexNet, ResNet-50, and VGG-16 workloads show that the proposed INA method achieves 1.22x improvement in latency and 2.16x improvement in power consumption on the WS dataflow model.


title: Analytic Optimization-Based Microbubble Tracking in Ultrasound Super-Resolution Microscopy

abstract: Ultrasound localization microscopy (ULM) refers to a promising medical imaging modality that systematically leverages the advantages of contrast-enhanced ultrasound (CEUS) to surpass the diffraction barrier and delineate the microvascular map. Localization and tracking of microbubbles (MBs), two significant steps of ULM, facilitate generating the vascular map and the velocity distribution, respectively. Herein, we propose a novel MB tracking technique considering temporal pairing as a bubble-set registration problem. Iterative registration is performed between the bubble sets in two consecutive time instants by analytically optimizing a cost function that takes position and point-spread function (PSF) similarities as well as physically plausible levels of bubbles' movement into account. Furthermore, we infer MBs' parity in a fuzzy manner instead of binary. The proposed technique performs well in validation experiments with two synthetic and two in vivo datasets provided by the Ultrasound Localisation and TRacking Algorithms for Super Resolution (ULTRA-SR) Challenge.


title: Mutual Information Learned Classifiers: an Information-theoretic Viewpoint of Training Deep Learning Classification Systems

abstract: Deep learning systems have been reported to achieve state-of-the-art performances in many applications, and a key is the existence of well trained classifiers on benchmark datasets. As a main-stream loss function, the cross entropy can easily lead us to find models which demonstrate severe overfitting behavior. In this paper, we show that the existing cross entropy loss minimization problem essentially learns the label conditional entropy (CE) of the underlying data distribution of the dataset. However, the CE learned in this way does not characterize well the information shared by the label and the input. In this paper, we propose a mutual information learning framework where we train deep neural network classifiers via learning the mutual information between the label and the input. Theoretically, we give the population classification error lower bound in terms of the mutual information. In addition, we derive the mutual information lower and upper bounds for a concrete binary classification data model in $\mathbb{R}^n$, and also the error probability lower bound in this scenario. Empirically, we conduct extensive experiments on several benchmark datasets to support our theory. The mutual information learned classifiers (MILCs) achieve far better generalization performances than the conditional entropy learned classifiers (CELCs) with an improvement which can exceed more than 10\% in testing accuracy.


title: Comparing direct limit and inverse limit of even $K$-groups in multiple $\mathbb{Z}_p$-extensions

abstract: Iwasawa first established a duality relating the direct limit and the inverse limit of class groups in a $\mathbb{Z}_p$-extension, and this result has recently been extended to multiple $\mathbb{Z}_p$-extensions by many authors. In this paper, we establish an analogous duality for the direct limit and the inverse limit of higher even $K$-groups in a $\mathbb{Z}_p^d$-extension.


title: Observing a topological phase transition with deep neural networks from experimental images of ultracold atoms

abstract: Although classifying topological quantum phases have attracted great interests, the absence of local order parameter generically makes it challenging to detect a topological phase transition from experimental data. Recent advances in machine learning algorithms enable physicists to analyze experimental data with unprecedented high sensitivities, and identify quantum phases even in the presence of unavoidable noises. Here, we report a successful identification of topological phase transitions using a deep convolutional neural network trained with low signal-to-noise-ratio (SNR) experimental data obtained in a symmetry-protected topological system of spin-orbit-coupled fermions. We apply the trained network to unseen data to map out a whole phase diagram, which predicts the positions of the two topological phase transitions that are consistent with the results obtained by using the conventional method on higher SNR data. By visualizing the filters and post-convolutional results of the convolutional layer, we further find that the CNN uses the same information to make the classification in the system as the conventional analysis, namely spin imbalance, but with an advantage concerning SNR. Our work highlights the potential of machine learning techniques to be used in various quantum systems.


title: Practical considerations for sandwich variance estimation in two-stage regression settings

abstract: We present a practical approach for computing the sandwich variance estimator in two-stage regression model settings. As a motivating example for two-stage regression, we consider regression calibration, a popular approach for addressing covariate measurement error. The sandwich variance approach has been rarely applied in regression calibration, despite that it requires less computation time than popular resampling approaches for variance estimation, specifically the bootstrap. This is likely due to requiring specialized statistical coding. In practice, a simple bootstrap approach with Wald confidence intervals is often applied, but this approach can yield confidence intervals that do not achieve the nominal coverage level. We first outline the steps needed to compute the sandwich variance estimator. We then develop a convenient method of computation in R for sandwich variance estimation, which leverages standard regression model outputs and existing R functions and can be applied in the case of a simple random sample or complex survey design. We use a simulation study to compare the performance of the sandwich to a resampling variance approach for both data settings. Finally, we further compare these two variance estimation approaches for data examples from the Women's Health Initiative (WHI) and Hispanic Community Health Study/Study of Latinos (HCHS/SOL).


title: Toward Interactive Bug Reporting for (Android App) End-Users

abstract: Many software bugs are reported manually, particularly bugs that manifest themselves visually in the user interface. End-users typically report these bugs via app reviewing websites, issue trackers, or in-app built-in bug reporting tools, if available. While these systems have various features that facilitate bug reporting (e.g., textual templates or forms), they often provide limited guidance, concrete feedback, or quality verification to end-users, who are often inexperienced at reporting bugs and submit low-quality bug reports that lead to excessive developer effort in bug report management tasks. We propose an interactive bug reporting system for end-users (Burt), implemented as a task-oriented chatbot. Unlike existing bug reporting systems, Burt provides guided reporting of essential bug report elements (i.e., the observed behavior, expected behavior, and steps to reproduce the bug), instant quality verification, and graphical suggestions for these elements. We implemented a version of Burt for Android and conducted an empirical evaluation study with end-users, who reported 12 bugs from six Android apps studied in prior work. The reporters found that Burt's guidance and automated suggestions/clarifications are useful and Burt is easy to use. We found that Burt reports contain higher-quality information than reports collected via a template-based bug reporting system. Improvements to Burt, informed by the reporters, include support for various wordings to describe bug report elements and improved quality verification. Our work marks an important paradigm shift from static to interactive bug reporting for end-users.


title: Generate rather than Retrieve: Large Language Models are Strong Context Generators

abstract: Knowledge-intensive tasks, such as open-domain question answering (QA), require access to a large amount of world or domain knowledge. A common approach for knowledge-intensive tasks is to employ a retrieve-then-read pipeline that first retrieves a handful of relevant contextual documents from an external corpus such as Wikipedia and then predicts an answer conditioned on the retrieved documents. In this paper, we present a novel perspective for solving knowledge-intensive tasks by replacing document retrievers with large language model generators. We call our method generate-then-read (GenRead), which first prompts a large language model to generate contextutal documents based on a given question, and then reads the generated documents to produce the final answer. Furthermore, we propose a novel clustering-based prompting method that selects distinct prompts, resulting in the generated documents that cover different perspectives, leading to better recall over acceptable answers. We conduct extensive experiments on three different knowledge-intensive tasks, including open-domain QA, fact checking, and dialogue system. Notably, GenRead achieves 71.6 and 54.4 exact match scores on TriviaQA and WebQ, significantly outperforming the state-of-the-art retrieve-then-read pipeline DPR-FiD by +4.0 and +3.9, without retrieving any documents from any external knowledge source. Lastly, we demonstrate the model performance can be further improved by combining retrieval and generation. Our code and generated documents can be found at https://github.com/wyu97/GenRead.


title: Off-Policy Evaluation for Episodic Partially Observable Markov Decision Processes under Non-Parametric Models

abstract: We study the problem of off-policy evaluation (OPE) for episodic Partially Observable Markov Decision Processes (POMDPs) with continuous states. Motivated by the recently proposed proximal causal inference framework, we develop a non-parametric identification result for estimating the policy value via a sequence of so-called V-bridge functions with the help of time-dependent proxy variables. We then develop a fitted-Q-evaluation-type algorithm to estimate V-bridge functions recursively, where a non-parametric instrumental variable (NPIV) problem is solved at each step. By analyzing this challenging sequential NPIV problem, we establish the finite-sample error bounds for estimating the V-bridge functions and accordingly that for evaluating the policy value, in terms of the sample size, length of horizon and so-called (local) measure of ill-posedness at each step. To the best of our knowledge, this is the first finite-sample error bound for OPE in POMDPs under non-parametric models.


title: Infinite time bubble towers in the fractional heat equation with critical exponent

abstract: In this paper, we consider the fractional heat equation with critical exponent in $\mathbb{R}^n$ for $n>6s,s\in(0,1),$ \begin{equation*} u_t=-(-\Delta)^su+|u|^{\frac{4s}{n-2s}}u,\quad (x,t)\in \mathbb{R}^n\times\mathbb{R}. \end{equation*} We construct a bubble tower type solution both for the forward and backward problem by establishing the existence of the sign-changing solution with multiple blow-up at a single point with the form \begin{equation*} u(x,t)=(1+o(1))\sum_{j=1}^{k}(-1)^{j-1}\mu_j(t)^{-\frac{n-2s}{2}}U\left(\frac{x}{\mu_j(t)}\right) \quad\mbox{as}\quad t\to+\infty, \end{equation*} and the positive solution with multiple blow-up at a single point with the form \begin{equation*} u(x,t)=(1+o(1))\sum_{j=1}^{k}\mu_j(t)^{-\frac{n-2s}{2}}U\left(\frac{x}{\mu_j(t)}\right) \quad\mbox{as}\quad t\to-\infty, \end{equation*} respectively. Here $k\ge2$ is a positive integer, $$U(y)=\alpha_{n,s}\left(\frac{1}{1+|y|^2}\right)^{\frac{n-2s}{2}},$$ and \begin{equation*} \mu_j(t)=\beta_j |t|^{-\alpha_j}(1+o(1))~\mathrm{as}~t\to\pm\infty, \quad \alpha_j=\frac{1}{2s}\left(\frac{n-2s}{n-6s}\right)^{j-1}-\frac{1}{2s}, \end{equation*} for some certain positive numbers $\beta_j,j=1,\cdots,k.$


title: The Information Criterion GIC of Trend and Seasonal Adjustment Models

abstract: This paper presents an algorithm for computing the GIC and the TIC of the nonstationary state-space models. The gradient and Hessian of the log-likelihood neccesary in computing the GIC are obtained by the differential filter that is derived by extending the Kalman filter. Three examples of the nonstationary time series models, i.e., the trend model, statndard seasonal adjustment model and the seasonal adjustment model with stationary AR component are presented to exemplified the specification of structural matrices.


title: Energy Reconstruction and Calibration of the MicroBooNE LArTPC

abstract: The Liquid Argon Time Projection Chamber (LArTPC) is increasingly becoming the chosen technology for current and future precision neutrino oscillation experiments due to its superior capability in particle tracking and energy calorimetry. In LArTPCs, calorimetric information is critical for particle identification, which is the foundation for the neutrino cross-section and oscillation measurements as well as searches for beyond standard model physics. One of the primary challenges in employing LArTPC technology is characterizing its performance and quantifying the associated systematic uncertainties. MicroBooNE, the longest operating LArTPC to date, has performed numerous such measurements, including studies of detector physics and electromagnetic shower reconstruction. Here we present results on the operation and performance of the detector during its data taking, highlighting accomplishments toward calorimetric reconstruction, calibration, and detector physics.


title: Influence of oscillatory shear on nucleation in metallic glasses: a molecular dynamics study

abstract: The process of crystal nucleation can be accelerated or retarded by ultrasonic vibration, which is particularly attractive for the addictive manufacture and thermoplastic forming of metallic glasses, however, the effect and mechanism of oscillatory loading on the nucleation process are still elusive. By using molecular dynamics simulation, the changes in the time-temperature-transformation (TTT) curve under oscillatory external loading are systematically investigated in two typical binary alloys. A glass forming ability dependent response to the external loading is found, and the shortest incubation time is insensitive to the external loading, while the corresponding temperature can be significantly shifted. Within the framework of classical nucleation theory, a fitting formula is proposed to describe the simulation data quantitatively. In contrast to stationary shear, the elastic stress, rather than the strain rate, is the key parameter to control the evolution of TTT curve under oscillatory loading. Furthermore, the model shows that oscillatory loading can decouple the mobility and nucleation in the deeply supercooled liquid, hence the formation ability can be enhanced while the nucleation is suppressed, which is particularly helpful for the forming and manufacturing of metallic glasses.


title: Orthorhombic and triclinic modifications of the arsenate Cu4O(AsO4)2 and isotypic phosphates Cu4O(PO4)2: strongly frustrated antiferromagnetics

abstract: A structural-magnetic models of the orthorhombic and triclinic modifications of the arsenates Cu4O(AsO4)2 and isotypic phosphates Cu4O(PO4)2 has been built and analyzed. Their base elements are the complicated ribbons composed of antiferromagnetic Cu4 tetrahedra. Structurally, these tetrahedra have no shared copper atoms; however, there are strong antiferromagnetic (AFM) and ferromagnetic (FM) couplings between them, both within the complicated ribbons and between them. It has been established that both modifications are strongly frustrated 3-D antiferromagnetics due to competition between the nearest AFM interactions along the edges of the Cu4 tetrahedra and competition between interactions and a multiplicity of long-range secondary AFM and FM interactions. Additionally, a large number of weaker long-range interactions are competing among each other. However, there is a possibility of the ordering Dzyaloshinskii-Moriya (DM) interaction in the centrosymmetric orthorhombic modification (Pnma), because two of the three types of magnetic ions, Cu1 and Cu3, are in the partial position 4c, where the ions are not related by the inversion center. In the triclinic modification (P -1) of Cu4O(As(P)O4)2, all four copper ions are in the centrosymmetric equivalent position 2i, which prevents DM interactions. This centrosymmetry will allow magnetic interactions in the triclinic modification of Cu4O(As(P)O4)2 to be still frustrated at lower temperature. It is possible that the triclinic modification of these compounds is a quantum spin liquid.


title: Monotonic Neural Additive Models: Pursuing Regulated Machine Learning Models for Credit Scoring

abstract: The forecasting of credit default risk has been an active research field for several decades. Historically, logistic regression has been used as a major tool due to its compliance with regulatory requirements: transparency, explainability, and fairness. In recent years, researchers have increasingly used complex and advanced machine learning methods to improve prediction accuracy. Even though a machine learning method could potentially improve the model accuracy, it complicates simple logistic regression, deteriorates explainability, and often violates fairness. In the absence of compliance with regulatory requirements, even highly accurate machine learning methods are unlikely to be accepted by companies for credit scoring. In this paper, we introduce a novel class of monotonic neural additive models, which meet regulatory requirements by simplifying neural network architecture and enforcing monotonicity. By utilizing the special architectural features of the neural additive model, the monotonic neural additive model penalizes monotonicity violations effectively. Consequently, the computational cost of training a monotonic neural additive model is similar to that of training a neural additive model, as a free lunch. We demonstrate through empirical results that our new model is as accurate as black-box fully-connected neural networks, providing a highly accurate and regulated machine learning method.


title: Progressive with Purpose: Guiding Progressive Inpainting DNNs through Context and Structure

abstract: The advent of deep learning in the past decade has significantly helped advance image inpainting. Although achieving promising performance, deep learning-based inpainting algorithms still struggle from the distortion caused by the fusion of structural and contextual features, which are commonly obtained from, respectively, deep and shallow layers of a convolutional encoder. Motivated by this observation, we propose a novel progressive inpainting network that maintains the structural and contextual integrity of a processed image. More specifically, inspired by the Gaussian and Laplacian pyramids, the core of the proposed network is a feature extraction module named GLE. Stacking GLE modules enables the network to extract image features from different image frequency components. This ability is important to maintain structural and contextual integrity, for high frequency components correspond to structural information while low frequency components correspond to contextual information. The proposed network utilizes the GLE features to progressively fill in missing regions in a corrupted image in an iterative manner. Our benchmarking experiments demonstrate that the proposed method achieves clear improvement in performance over many state-of-the-art inpainting algorithms.


title: On the Convergence Theory of Meta Reinforcement Learning with Personalized Policies

abstract: Modern meta-reinforcement learning (Meta-RL) methods are mainly developed based on model-agnostic meta-learning, which performs policy gradient steps across tasks to maximize policy performance. However, the gradient conflict problem is still poorly understood in Meta-RL, which may lead to performance degradation when encountering distinct tasks. To tackle this challenge, this paper proposes a novel personalized Meta-RL (pMeta-RL) algorithm, which aggregates task-specific personalized policies to update a meta-policy used for all tasks, while maintaining personalized policies to maximize the average return of each task under the constraint of the meta-policy. We also provide the theoretical analysis under the tabular setting, which demonstrates the convergence of our pMeta-RL algorithm. Moreover, we extend the proposed pMeta-RL algorithm to a deep network version based on soft actor-critic, making it suitable for continuous control tasks. Experiment results show that the proposed algorithms outperform other previous Meta-RL algorithms on Gym and MuJoCo suites.


title: Adaptive Local-Component-aware Graph Convolutional Network for One-shot Skeleton-based Action Recognition

abstract: Skeleton-based action recognition receives increasing attention because the skeleton representations reduce the amount of training data by eliminating visual information irrelevant to actions. To further improve the sample efficiency, meta-learning-based one-shot learning solutions were developed for skeleton-based action recognition. These methods find the nearest neighbor according to the similarity between instance-level global average embedding. However, such measurement holds unstable representativity due to inadequate generalized learning on local invariant and noisy features, while intuitively, more fine-grained recognition usually relies on determining key local body movements. To address this limitation, we present the Adaptive Local-Component-aware Graph Convolutional Network, which replaces the comparison metric with a focused sum of similarity measurements on aligned local embedding of action-critical spatial/temporal segments. Comprehensive one-shot experiments on the public benchmark of NTU-RGB+D 120 indicate that our method provides a stronger representation than the global embedding and helps our model reach state-of-the-art.


title: PicT: A Slim Weakly Supervised Vision Transformer for Pavement Distress Classification

abstract: Automatic pavement distress classification facilitates improving the efficiency of pavement maintenance and reducing the cost of labor and resources. A recently influential branch of this task divides the pavement image into patches and addresses these issues from the perspective of multi-instance learning. However, these methods neglect the correlation between patches and suffer from a low efficiency in the model optimization and inference. Meanwhile, Swin Transformer is able to address both of these issues with its unique strengths. Built upon Swin Transformer, we present a vision Transformer named \textbf{P}avement \textbf{I}mage \textbf{C}lassification \textbf{T}ransformer (\textbf{PicT}) for pavement distress classification. In order to better exploit the discriminative information of pavement images at the patch level, the \textit{Patch Labeling Teacher} is proposed to leverage a teacher model to dynamically generate pseudo labels of patches from image labels during each iteration, and guides the model to learn the discriminative features of patches. The broad classification head of Swin Transformer may dilute the discriminative features of distressed patches in the feature aggregation step due to the small distressed area ratio of the pavement image. To overcome this drawback, we present a \textit{Patch Refiner} to cluster patches into different groups and only select the highest distress-risk group to yield a slim head for the final image classification. We evaluate our method on CQU-BPDD. Extensive results show that \textbf{PicT} outperforms the second-best performed model by a large margin of $+2.4\%$ in P@R on detection task, $+3.9\%$ in $F1$ on recognition task, and 1.8x throughput, while enjoying 7x faster training speed using the same computing resources. Our codes and models have been released on \href{https://github.com/DearCaat/PicT}{https://github.com/DearCaat/PicT}.


title: Combinatorial and Algebraic Enumeration: a survey of the work of Ian P. Goulden and David M. Jackson

abstract: In this survey we discuss some of the significant contributions of Ian Goulden and David Jackson in the areas of classical enumeration, symmetric functions, factorizations of permutations, and algebraic foundations of quantum field theory. Through their groundbreaking textbook, {\em Combinatorial Enumeration}, and their numerous research papers, both together and with their many students, they have had an influence in areas of bioinformatics, mathematical chemistry, algorithmic computer science, and theoretical physics. Here we review and set in context highlights of their 40 years of collaborative work.


title: Microscopic design of a topologically protected singlet-triplet qubit in an InAsP quantum dot array

abstract: We present here the steps enabling the microscopic design of a topologically protected singlet-triplet qubit in an InAsP quantum dot array embedded in an InP nanowire. The qubit is constructed with two Haldane spin-$\frac{1}{2}$ quasiparticles in a synthetic spin one chain. The qubit is described by a two-leg multi-orbital Hubbard Kanamori (HK) model with parameters obtained from the microscopic calculations of up to eight electrons in a single and double quantum dot. In this HK model describing long arrays of quantum dots, using both exact diagonalization and matrix product state (MPS) tools, we demonstrate a four-fold quasidegenerate ground state separated from excited states by a finite energy gap similar to a Heisenberg spin-1 chain in the Haldane phase. We demonstrate the existence of spin-$\frac{1}{2}$ quasiparticles at the edges of the chain by observing the magnetic field dependence of the low energy spectrum as a function of applied magnetic field. The applied magnetic field also isolates the singlet and $S^z=0$ triplet states from the other triplet components allowing these states to serve as a qubit basis. Most importantly, the regions in parameter space where the low energy spectrum of the multi-orbital Hubbard chain yields a Heisenberg spin-1 chain spectrum are mapped out. Due to the finite energy gap, this qubit has the potential to be protected against perturbations.


title: Can Shadows Reveal Biometric Information?

abstract: We study the problem of extracting biometric information of individuals by looking at shadows of objects cast on diffuse surfaces. We show that the biometric information leakage from shadows can be sufficient for reliable identity inference under representative scenarios via a maximum likelihood analysis. We then develop a learning-based method that demonstrates this phenomenon in real settings, exploiting the subtle cues in the shadows that are the source of the leakage without requiring any labeled real data. In particular, our approach relies on building synthetic scenes composed of 3D face models obtained from a single photograph of each identity. We transfer what we learn from the synthetic data to the real data using domain adaptation in a completely unsupervised way. Our model is able to generalize well to the real domain and is robust to several variations in the scenes. We report high classification accuracies in an identity classification task that takes place in a scene with unknown geometry and occluding objects.


title: ECSAS: Exploring Critical Scenarios from Action Sequence in Autonomous Driving

abstract: Critical scenario generation requires the ability of sampling critical combinations from the infinite parameter space in the logic scenario. Existing solutions aim to explore the correlation of action parameters in the initial scenario rather than action sequences. How to model action sequences so that one can further consider the effects of different action parameters in the scenario is the bottleneck of the problem. In this paper, we attack the problem by proposing the ECSAS framework. Specifically, we first propose a description language, BTScenario, allowing us to model action sequences of the scenarios. We then use reinforcement learning to search for combinations of critical action parameters. To increase efficiency, we further propose several optimizations, including action masking and replay buffer. We have implemented ECSAS, and experimental results show that it is more efficient than native approaches such as random and combination testing in various nontrivial scenarios.


title: Dynamical Reflection Maps

abstract: In this paper, by making use of category theory, we construct dynamical reflection maps, solutions to a version of the reflection equation associated with suitable dynamical Yang-Baxter maps, set-theoretic solutions to the braid relation that is equivalent to a version of the quantum Yang-Baxter equation. Quiver-theoretic solutions to the reflection equation are also discussed.


title: Deep Double Descent via Smooth Interpolation

abstract: The ability of overparameterized deep networks to interpolate noisy data, while at the same time showing good generalization performance, has been recently characterized in terms of the double descent curve for the test error. Common intuition from polynomial regression suggests that overparameterized networks are able to sharply interpolate noisy data, without considerably deviating from the ground-truth signal, thus preserving generalization ability. At present, a precise characterization of the relationship between interpolation and generalization for deep networks is missing. In this work, we quantify sharpness of fit of the training data interpolated by neural network functions, by studying the loss landscape w.r.t. to the input variable locally to each training point, over volumes around cleanly- and noisily-labelled training samples, as we systematically increase the number of model parameters and training epochs. Our findings show that loss sharpness in the input space follows both model- and epoch-wise double descent, with worse peaks observed around noisy labels. While small interpolating models sharply fit both clean and noisy data, large interpolating models express a smooth loss landscape, where noisy targets are predicted over large volumes around training data points, in contrast to existing intuition.


title: Revisiting Discrete Soft Actor-Critic

abstract: We study the adaption of soft actor-critic (SAC) from continuous action space to discrete action space. We revisit vanilla SAC and provide an in-depth understanding of its Q value underestimation and performance instability issues when applied to discrete settings. We thereby propose entropy-penalty and double average Q-learning with Q-clip to address these issues. Extensive experiments on typical benchmarks with discrete action space, including Atari games and a large-scale MOBA game, show the efficacy of our proposed method. Our code is at:https://github.com/coldsummerday/Revisiting-Discrete-SAC.


title: Generalized Gloves of Neural Additive Models: Pursuing transparent and accurate machine learning models in finance

abstract: For many years, machine learning methods have been used in a wide range of fields, including computer vision and natural language processing. While machine learning methods have significantly improved model performance over traditional methods, their black-box structure makes it difficult for researchers to interpret results. For highly regulated financial industries, transparency, explainability, and fairness are equally, if not more, important than accuracy. Without meeting regulated requirements, even highly accurate machine learning methods are unlikely to be accepted. We address this issue by introducing a novel class of transparent and interpretable machine learning algorithms known as generalized gloves of neural additive models. The generalized gloves of neural additive models separate features into three categories: linear features, individual nonlinear features, and interacted nonlinear features. Additionally, interactions in the last category are only local. The linear and nonlinear components are distinguished by a stepwise selection algorithm, and interacted groups are carefully verified by applying additive separation criteria. Empirical results demonstrate that generalized gloves of neural additive models provide optimal accuracy with the simplest architecture, allowing for a highly accurate, transparent, and explainable approach to machine learning.


title: Federated Learning from Pre-Trained Models: A Contrastive Learning Approach

abstract: Federated Learning (FL) is a machine learning paradigm that allows decentralized clients to learn collaboratively without sharing their private data. However, excessive computation and communication demands pose challenges to current FL frameworks, especially when training large-scale models. To prevent these issues from hindering the deployment of FL systems, we propose a lightweight framework where clients jointly learn to fuse the representations generated by multiple fixed pre-trained models rather than training a large-scale model from scratch. This leads us to a more practical FL problem by considering how to capture more client-specific and class-relevant information from the pre-trained models and jointly improve each client's ability to exploit those off-the-shelf models. In this work, we design a Federated Prototype-wise Contrastive Learning (FedPCL) approach which shares knowledge across clients through their class prototypes and builds client-specific representations in a prototype-wise contrastive manner. Sharing prototypes rather than learnable model parameters allows each client to fuse the representations in a personalized way while keeping the shared knowledge in a compact form for efficient communication. We perform a thorough evaluation of the proposed FedPCL in the lightweight framework, measuring and visualizing its ability to fuse various pre-trained models on popular FL datasets.


title: A Transponder Aggregator with Efficient Use of Filtering Function for Transponder Noise Suppression

abstract: Colorless, directionless, and contentionless reconfigurable optical add/drop multiplexing (CDC-ROADM) provides highly flexible physical layer network configuration. Such CDC-ROADM must operate in multiple wavelength bands which are being increasingly implemented in optical transmission systems. The operation in C+L bands requires switch devices used in CDC-ROADM to also be capable of multiband operation. Recent studies on wavelength division multiplexing (WDM) systems have pointed out the impact of amplified spontaneous emission (ASE) noise generated by signals of different wavelengths, which causes OSNR degradation. Therefore, it is desirable to filter out the ASE noise from different transponders when multiplexing multiple wavelengths at the transmitter side, especially in a system with non-wavelength selective combiners such as directional couplers and multicast switches. The use of transponder aggregators with filtering functions, such as the M x N wavelength selective switch (WSS), is preferable for this filtering. However, the downside of these devices is that it is difficult to provide economical multiband support. Therefore, we propose an economical transponder aggregator configuration by allowing a certain amount of ASE superposition and reducing the number of filtering functions. In this paper, we fabricated a prototype of the proposed transponder aggregator by combining silica-based planar lightwave circuit technology and C+L band WSS, both commercially available, and verified its feasibility through transmission experiments. The novel transponder aggregator is a practical solution for a multiband CDC-ROADM system with improved OSNR performance.


title: Joint PMD Tracking and Nonlinearity Compensation with Deep Neural Networks

abstract: Overcoming fiber nonlinearity is one of the core challenges limiting the capacity of optical fiber communication systems. Machine learning based solutions such as learned digital backpropagation (LDBP) and the recently proposed deep convolutional recurrent neural network (DCRNN) have been shown to be effective for fiber nonlinearity compensation (NLC). Incorporating distributed compensation of polarization mode dispersion (PMD) within the learned models can improve their performance even further but at the same time, it also couples the compensation of nonlinearity and PMD. Consequently, it is important to consider the time variation of PMD for such a joint compensation scheme. In this paper, we investigate the impact of PMD drift on the DCRNN model with distributed compensation of PMD. We propose a transfer learning based selective training scheme to adapt the learned neural network model to changes in PMD. We demonstrate that fine-tuning only a small subset of weights as per the proposed method is sufficient for adapting the model to PMD drift. Using decision directed feedback for online learning, we track continuous PMD drift resulting from a time-varying rotation of the state of polarization (SOP). We show that transferring knowledge from a pre-trained base model using the proposed scheme significantly reduces the re-training efforts for different PMD realizations. Applying the hinge model for SOP rotation, our simulation results show that the learned models maintain their performance gains while tracking the PMD.


title: Spatial populations with seed-bank: finite-systems scheme

abstract: We consider a system of interacting Fisher-Wright diffusions with seed-bank. Individuals carry type one of two types, live in colonies, and are subject to resampling and migration as long as they are active. Each colony has a structured seed-bank into which individuals can retreat to become dormant, suspending their resampling and migration until they become active again. As geographic space labelling the colonies we consider a countable Abelian group endowed with the discrete topology. In earlier work we showed that the system has a one-parameter family of equilibria controlled by the relative density of the two types. Moreover, these equilibria exhibit a dichotomy of coexistence (= locally multi-type equilibrium) versus clustering (= locally mono-type equilibrium). We identified the parameter regimes for which these two phases occur, and found that these regimes are different when the mean wake-up time of a dormant individual is finite or infinite. The goal of the present paper is to establish the finite-systems scheme, i.e., identify how a finite truncation of the system (both in the geographic space and in the seed-bank) behaves as both the time and the truncation level tend to infinity, properly tuned together. If the wake-up time has finite mean, then there is a single universality class for the scaling limit. On the other hand, if the wake-up time has infinite mean, then there are two universality classes depending on how fast the truncation level of the seed-bank grows compared to the truncation level of the geographic space.


title: A first-principles investigation of the linear thermal expansion coefficients of BeF$_2$: Giant thermal expansion

abstract: We present the results of a theoretical investigation of the linear thermal expansion coefficients (TECs) of BeF$_2$, within a direct Gruneisen formalism where symmetry-preserving deformations are employed. The required physical quantities such as the optimized crystal structures, elastic constants, mode Gruneisen parameters, and phonon density of states are calculated from first-principles. BeF$_2$ shows an extensive polymorphism at low pressures, and the lowest energy phases [$\alpha$-cristobalite with space group (SG) P$4_1 2_1 2$ and its similar phase with SG P$4_3 2_1 2$] are considered in addition to the experimentally observed $\alpha$-quartz phase. For benchmarking purposes, similar calculations are performed for the rutile phase of ZnF$_2$, where the volumetric TEC ($\alpha_v$), derived from the calculated linear TECs along the $a$ ($\alpha_a$) and $c$ ($\alpha_c$) directions, is in very good agreement with experimental data and previous theoretical results. For the considered phases of BeF$_2$, we do not find any negative thermal expansion (NTE). However we observe diverse thermal properties for the distinct phases. The linear TECs are very large, especially $\alpha_c$ of the $\alpha$-cristobalite phase and its similar phase, leading to giant $\alpha_v$ ($\sim 175 \times 10^{-6} {\rm K}^{-1}$ at 300 K). The giant $\alpha_v$ arises from large Gruneisen parameters of low-frequency phonon modes, and the C13 elastic constant that is negatively signed and large in magnitude for the $\alpha$-cristobalite phase. The elastic constants, high-frequency dielectric constants, Born effective charge tensors, and thermal properties of the above phases of BeF$_2$ are reported for the first time and hence serve as predictions.


title: Boosting Star-GANs for Voice Conversion with Contrastive Discriminator

abstract: Nonparallel multi-domain voice conversion methods such as the StarGAN-VCs have been widely applied in many scenarios. However, the training of these models usually poses a challenge due to their complicated adversarial network architectures. To address this, in this work we leverage the state-of-the-art contrastive learning techniques and incorporate an efficient Siamese network structure into the StarGAN discriminator. Our method is called SimSiam-StarGAN-VC and it boosts the training stability and effectively prevents the discriminator overfitting issue in the training process. We conduct experiments on the Voice Conversion Challenge (VCC 2018) dataset, plus a user study to validate the performance of our framework. Our experimental results show that SimSiam-StarGAN-VC significantly outperforms existing StarGAN-VC methods in terms of both the objective and subjective metrics.


title: Determine the Core Structure and Nuclear Equation of State of Rotating Core-Collapse Supernovae with Gravitational Waves by Convolutional Neural Networks

abstract: Detecting gravitational waves from a nearby core-collapse supernova would place meaningful constraints on the supernova engine and nuclear equation of state. Here we use Convolutional Neural Network models to identify the core rotational rates, rotation length scales, and the nuclear equation of state (EoS), using the 1824 waveforms from Richers et al. (2017) for a 12 solar mass progenitor. High prediction accuracy for the classifications of the rotation length scales ($93\%$) and the rotational rates ($95\%$) can be achieved using the gravitational wave signals from -10 ms to 6 ms core bounce. By including additional 48 ms signals during the prompt convection phase, we could achieve $96\%$ accuracy on the classification of four major EoS groups. Combining three models above, we could correctly predict the core rotational rates, rotation length scales, and the EoS at the same time with more than $85\%$ accuracy. Finally, applying a transfer learning method for additional 74 waveforms from FLASH simulations (Pan et al. 2018), we show that our model using Richers' waveforms could successfully predict the rotational rates from Pan's waveforms even for a continuous value with a mean absolute errors of 0.32 rad s$^{-1}$ only. These results demonstrate a much broader parameter regimes our model can be applied for the identification of core-collapse supernova events through GW signals.


title: The Core Inverse in a Banach Algebra with Involution

abstract: We present new additive results for the core inverse in a Banach algebra with involution. We obtain necessary and sufficient conditions under which the sum of two core invertible elements in a Banach algebra with involution is core invertible. Then we apply our results to block complex matrices and obtain certain conditions under which a block complex is core invertible. These generalize many known results, e.g.,~\cite[Theorem 4.3]{XCZ}, ~\cite[Theorem 2.5]{XS}.


title: Variational Inference for Infinitely Deep Neural Networks

abstract: We introduce the unbounded depth neural network (UDN), an infinitely deep probabilistic model that adapts its complexity to the training data. The UDN contains an infinite sequence of hidden layers and places an unbounded prior on a truncation L, the layer from which it produces its data. Given a dataset of observations, the posterior UDN provides a conditional distribution of both the parameters of the infinite neural network and its truncation. We develop a novel variational inference algorithm to approximate this posterior, optimizing a distribution of the neural network weights and of the truncation depth L, and without any upper limit on L. To this end, the variational family has a special structure: it models neural network weights of arbitrary depth, and it dynamically creates or removes free variational parameters as its distribution of the truncation is optimized. (Unlike heuristic approaches to model search, it is solely through gradient-based optimization that this algorithm explores the space of truncations.) We study the UDN on real and synthetic data. We find that the UDN adapts its posterior depth to the dataset complexity; it outperforms standard neural networks of similar computational complexity; and it outperforms other approaches to infinite-depth neural networks.


title: A Fast Algorithm for Implementation of Koul's Minimum Distance Estimators and Their Application to Image Segmentation

abstract: Minimum distance estimation methodology based on an empirical distribution function has been popular due to its desirable properties including robustness. Even though the statistical literature is awash with the research on the minimum distance estimation, the most of it is confined to the theoretical findings: only few statisticians conducted research on the application of the method to real world problems. Through this paper, we extend the domain of application of this methodology to various applied fields by providing a solution to a rather challenging and complicated computational problem. The problem this paper tackles is an image segmentation which has been used in various fields. We propose a novel method based on the classical minimum distance estimation theory to solve the image segmentation problem. The performance of the proposed method is then further elevated by integrating it with the ``segmenting-together" strategy. We demonstrate that the proposed method combined with the segmenting-together strategy successfully completes the segmentation problem when it is applied to the complex, real images such as magnetic resonance images.


title: Projected Gradient Descent Algorithms for Solving Nonlinear Inverse Problems with Generative Priors

abstract: In this paper, we propose projected gradient descent (PGD) algorithms for signal estimation from noisy nonlinear measurements. We assume that the unknown $p$-dimensional signal lies near the range of an $L$-Lipschitz continuous generative model with bounded $k$-dimensional inputs. In particular, we consider two cases when the nonlinear link function is either unknown or known. For unknown nonlinearity, similarly to \cite{liu2020generalized}, we make the assumption of sub-Gaussian observations and propose a linear least-squares estimator. We show that when there is no representation error and the sensing vectors are Gaussian, roughly $O(k \log L)$ samples suffice to ensure that a PGD algorithm converges linearly to a point achieving the optimal statistical rate using arbitrary initialization. For known nonlinearity, we assume monotonicity as in \cite{yang2016sparse}, and make much weaker assumptions on the sensing vectors and allow for representation error. We propose a nonlinear least-squares estimator that is guaranteed to enjoy an optimal statistical rate. A corresponding PGD algorithm is provided and is shown to also converge linearly to the estimator using arbitrary initialization. In addition, we present experimental results on image datasets to demonstrate the performance of our PGD algorithms.


title: Cyclic cocycles and one-loop corrections in the spectral action

abstract: We present an intelligible review of recent results concerning cyclic cocycles in the spectral action and one-loop quantization. We show that the spectral action, when perturbed by a gauge potential, can be written as a series of Chern-Simons actions and Yang-Mills actions of all orders. In the odd orders, generalized Chern-Simons forms are integrated against an odd $(b,B)$-cocycle, whereas, in the even orders, powers of the curvature are integrated against $(b,B)$-cocycles that are Hochschild cocycles as well. In both cases, the Hochschild cochains are derived from the Taylor series expansion of the spectral action Tr$(f(D+V))$ in powers of $V=\pi_D(A)$, but unlike the Taylor expansion we expand in increasing order of the forms in $A$. We then analyze the perturbative quantization of the spectral action in noncommutative geometry and establish its one-loop renormalizability as a gauge theory. We show that the one-loop counterterms are of the same Chern-Simons-Yang-Mills form so that they can be safely subtracted from the spectral action. A crucial role will be played by the appropriate Ward identities, allowing for a fully spectral formulation of the quantum theory at one loop.


title: A Max-relevance-min-divergence Criterion for Data Discretization with Applications on Naive Bayes

abstract: In many classification models, data is discretized to better estimate its distribution. Existing discretization methods often target at maximizing the discriminant power of discretized data, while overlooking the fact that the primary target of data discretization in classification is to improve the generalization performance. As a result, the data tend to be over-split into many small bins since the data without discretization retain the maximal discriminant information. Thus, we propose a Max-Dependency-Min-Divergence (MDmD) criterion that maximizes both the discriminant information and generalization ability of the discretized data. More specifically, the Max-Dependency criterion maximizes the statistical dependency between the discretized data and the classification variable while the Min-Divergence criterion explicitly minimizes the JS-divergence between the training data and the validation data for a given discretization scheme. The proposed MDmD criterion is technically appealing, but it is difficult to reliably estimate the high-order joint distributions of attributes and the classification variable. We hence further propose a more practical solution, Max-Relevance-Min-Divergence (MRmD) discretization scheme, where each attribute is discretized separately, by simultaneously maximizing the discriminant information and the generalization ability of the discretized data. The proposed MRmD is compared with the state-of-the-art discretization algorithms under the naive Bayes classification framework on 45 machine-learning benchmark datasets. It significantly outperforms all the compared methods on most of the datasets.


title: The fallacy of herd immunity

abstract: Here we show that herd immunity is not a measure we can implement, trust, control or depend on, and that waiting for herd immunity to play a role is tantamount to hope for the best. Herd immunity is not some protection, as it has been referred to, but a reduction in the chance of infection that a population can achieve only if more infections occur, which is paradoxical. The discussion on when there will be enough herd immunity for the COVID-19 epidemics to halt, delivers the public and policy makers the wrong message that we can wait for something to happen to relax containment measures. Here we review a non-orthodox construction of an epidemic that unveils what herd immunity really means, that is easy to understand by non-experts.


title: Embedded Topics in the Stochastic Block Model

abstract: Communication networks such as emails or social networks are now ubiquitous and their analysis has become a strategic field. In many applications, the goal is to automatically extract relevant information by looking at the nodes and their connections. Unfortunately, most of the existing methods focus on analysing the presence or absence of edges and textual data is often discarded. However, all communication networks actually come with textual data on the edges. In order to take into account this specificity, we consider in this paper networks for which two nodes are linked if and only if they share textual data. We introduce a deep latent variable model allowing embedded topics to be handled called ETSBM to simultaneously perform clustering on the nodes while modelling the topics used between the different clusters. ETSBM extends both the stochastic block model (SBM) and the embedded topic model (ETM) which are core models for studying networks and corpora, respectively. The inference is done using a variational-Bayes expectation-maximisation algorithm combined with a stochastic gradient descent. The methodology is evaluated on synthetic data and on a real world dataset.


title: NeurOLight: A Physics-Agnostic Neural Operator Enabling Parametric Photonic Device Simulation

abstract: Optical computing is an emerging technology for next-generation efficient artificial intelligence (AI) due to its ultra-high speed and efficiency. Electromagnetic field simulation is critical to the design, optimization, and validation of photonic devices and circuits. However, costly numerical simulation significantly hinders the scalability and turn-around time in the photonic circuit design loop. Recently, physics-informed neural networks have been proposed to predict the optical field solution of a single instance of a partial differential equation (PDE) with predefined parameters. Their complicated PDE formulation and lack of efficient parametrization mechanisms limit their flexibility and generalization in practical simulation scenarios. In this work, for the first time, a physics-agnostic neural operator-based framework, dubbed NeurOLight, is proposed to learn a family of frequency-domain Maxwell PDEs for ultra-fast parametric photonic device simulation. We balance the efficiency and generalization of NeurOLight via several novel techniques. Specifically, we discretize different devices into a unified domain, represent parametric PDEs with a compact wave prior, and encode the incident light via masked source modeling. We design our model with parameter-efficient cross-shaped NeurOLight blocks and adopt superposition-based augmentation for data-efficient learning. With these synergistic approaches, NeurOLight generalizes to a large space of unseen simulation settings, demonstrates 2-orders-of-magnitude faster simulation speed than numerical solvers, and outperforms prior neural network models by ~54% lower prediction error with ~44% fewer parameters. Our code is available at https://github.com/JeremieMelo/NeurOLight.


title: On the benefits of self-taught learning for brain decoding

abstract: Context. We study the benefits of using a large public neuroimaging database composed of fMRI statistic maps, in a self-taught learning framework, for improving brain decoding on new tasks. First, we leverage the NeuroVault database to train, on a selection of relevant statistic maps, a convolutional autoencoder to reconstruct these maps. Then, we use this trained encoder to initialize a supervised convolutional neural network to classify tasks or cognitive processes of unseen statistic maps from large collections of the NeuroVault database. Results. We show that such a self-taught learning process always improves the performance of the classifiers but the magnitude of the benefits strongly depends on the number of samples available both for pre-training and finetuning the models and on the complexity of the targeted downstream task. Conclusion. The pre-trained model improves the classification performance and displays more generalizable features, less sensitive to individual differences.


title: Flashlight: Scalable Link Prediction with Effective Decoders

abstract: Link prediction (LP) has been recognized as an important task in graph learning with its broad practical applications. A typical application of LP is to retrieve the top scoring neighbors for a given source node, such as the friend recommendation. These services desire the high inference scalability to find the top scoring neighbors from many candidate nodes at low latencies. There are two popular decoders that the recent LP models mainly use to compute the edge scores from node embeddings: the HadamardMLP and Dot Product decoders. After theoretical and empirical analysis, we find that the HadamardMLP decoders are generally more effective for LP. However, HadamardMLP lacks the scalability for retrieving top scoring neighbors on large graphs, since to the best of our knowledge, there does not exist an algorithm to retrieve the top scoring neighbors for HadamardMLP decoders in sublinear complexity. To make HadamardMLP scalable, we propose the Flashlight algorithm to accelerate the top scoring neighbor retrievals for HadamardMLP: a sublinear algorithm that progressively applies approximate maximum inner product search (MIPS) techniques with adaptively adjusted query embeddings. Empirical results show that Flashlight improves the inference speed of LP by more than 100 times on the large OGBL-CITATION2 dataset without sacrificing effectiveness. Our work paves the way for large-scale LP applications with the effective HadamardMLP decoders by greatly accelerating their inference.


title: Structure around $p\bar{p}$ threshold in $J/\psi$ radiative decays

abstract: In this paper, we study the structure around the $p\bar{p}$ threshold that appears in $\eta'\pi^+\pi^-$, $3(\pi^+\pi^-)$ and $K_S^0K_S^0\eta$ invariant mass spectra in the processes of relevant $J/\psi$ radiative decays. The $N\bar{N}$ rescattering is taken into account, and the distorted-wave Born approximation is applied to get the decaying amplitude through a two-step process: $J/\psi\to\gamma N\bar{N}\to\gamma\eta'\pi^+\pi^-$, $\gamma 3(\pi^+\pi^-)$ and $\gamma K_S^0K_S^0\eta$. The $N\bar{N}$ scattering amplitudes are obtained by solving the Lippmann-Schwinger equation with the potentials given by chiral effective field theory. To fix the unknown couplings, we fit the amplitudes to the datasets of the latest measurements on the invariant mass spectra of $J/\psi$ radiative decays, as well as the phase shifts and inelasticities given by partial wave analysis. We vary the cutoffs ($R$=0.9, 1.0, and 1.1 fm) and find that the solutions are stable. The structures around $p\bar{p}$ threshold found in the processes of $J/\psi\to\gamma\eta'\pi^+\pi^-$, $J/\psi\to\gamma3(\pi^+\pi^-)$ and $J/\psi\to\gamma K_S^0K_S^0\eta$ can be attributed to threshold behavior of $N\bar{N}$ intermediate states.


title: Multi-time Predictions of Wildfire Grid Map using Remote Sensing Local Data

abstract: Due to recent climate changes, we have seen more frequent and severe wildfires in the United States. Predicting wildfires is critical for natural disaster prevention and mitigation. Advances in technologies in data processing and communication enabled us to access remote sensing data. With the remote sensing data, valuable spatiotemporal statistical models can be created and used for resource management practices. This paper proposes a distributed learning framework that shares local data collected in ten locations in the western USA throughout the local agents. The local agents aim to predict wildfire grid maps one, two, three, and four weeks in advance while online processing the remote sensing data stream. The proposed model has distinct features that address the characteristic need in prediction evaluations, including dynamic online estimation and time-series modeling. Local fire event triggers are not isolated between locations, and there are confounding factors when local data is analyzed due to incomplete state observations. Compared to existing approaches that do not account for incomplete state observation within wildfire time-series data, on average, we can achieve higher prediction performance.


title: Multi-Tracer Groundwater Dating in Southern Oman using Bayesian Modelling

abstract: In the scope of assessing aquifer systems in areas where freshwater is scarce, estimation of transit times is a vital step to quantify the effect of groundwater abstraction. Transit time distributions of different shapes, mean residence times, and contributions are used to represent the hydrogeological conditions in aquifer systems and are typically inferred from measured tracer concentrations by inverse modeling. In this study, a multi-tracer sampling campaign was conducted in the Salalah Plain in Southern Oman including CFCs, SF6, 39Ar, 14C, and 4He. Based on the data of three tracers, a two-component Dispersion Model (DMmix) and a nonparametric model with six age bins were assumed and evaluated using Bayesian statistics. In a Markov Chain Monte Carlo approach, the maximum likelihood parameter estimates and their uncertainties were determined. Model performance was assessed using Bayes factor and leave-one-out cross-validation. Both models suggest that the groundwater in the Salalah Plain is composed of a very young component below 30 yr and a very old component beyond 1,000 yr, with the nonparametric model performing slightly better than the DMmix model. All wells except one exhibit reasonable goodness of fit. Our results support the relevance of Bayesian modeling in hydrology and the potential of nonparametric models for an adequate representation of aquifer dynamics.


title: Atmospheric ionization rates during a geomagnetic reversal

abstract: The Matuyama-Brunhes reversal of Earth's magnetic dipole field took place 0.78 Ma ago, and detailed temporally resolved paleomagnetic data are available for this period. A geomagnetic reversal is expected to impact the cosmic ray flux, which in turn might impact atmospheric ionization rates. In this study a model that yields atmospheric ionization for the entire globe based on an input magnetic field is presented. Taking the time dependent paleomagnetic data as input, a 3D time series of the atmospheric ionization rates during the reversal is produced. We show, that as the dipole field weakens, the atmospheric ionization increases at low latitudes. The increase is ca. 25% at the surface and up to a factor of 5 in the upper atmosphere. Globally, ionization rates increase around 13% at the surface and up to a factor of 2 in the upper atmosphere, whereas polar regions are largely unaffected. Finally, the change in ionization due to the solar 11-year cycle is greatly affected by the reversal. The relative change in atmospheric ionization between solar-minimum and solar-maximum varies between 2 and two orders of magnitude. All atmospheric ionization data is made available for download.

categories: physics.geo-ph astro-ph.EP astro-ph.SR physics.ao-ph physics.space-ph


title: Distributed Online Non-convex Optimization with Composite Regret

abstract: Regret has been widely adopted as the metric of choice for evaluating the performance of online optimization algorithms for distributed, multi-agent systems. However, data/model variations associated with agents can significantly impact decisions and requires consensus among agents. Moreover, most existing works have focused on developing approaches for (either strongly or non-strongly) convex losses, and very few results have been obtained regarding regret bounds in distributed online optimization for general non-convex losses. To address these two issues, we propose a novel composite regret with a new network regret-based metric to evaluate distributed online optimization algorithms. We concretely define static and dynamic forms of the composite regret. By leveraging the dynamic form of our composite regret, we develop a consensus-based online normalized gradient (CONGD) approach for pseudo-convex losses, and it provably shows a sublinear behavior relating to a regularity term for the path variation of the optimizer. For general non-convex losses, we first shed light on the regret for the setting of distributed online non-convex learning based on recent advances such that no deterministic algorithm can achieve the sublinear regret. We then develop the distributed online non-convex optimization with composite regret (DINOCO) without access to the gradients, depending on an offline optimization oracle. DINOCO is shown to achieve sublinear regret; to our knowledge, this is the first regret bound for general distributed online non-convex learning.


title: Extreme Multi-Domain, Multi-Task Learning With Unified Text-to-Text Transfer Transformers

abstract: Text-to-text transformers have shown remarkable success in the task of multi-task transfer learning, especially in natural language processing (NLP). However, while there have been several attempts to train transformers on different domains, there is usually a clear relationship between these domains, e.g.,, code summarization, where the natural language summary describes the code. There have been very few attempts to study how multi-task transfer learning works on tasks in significantly different domains. In this project, we investigated the behavior of multi-domain, multi-task learning using multi-domain text-to-text transfer transformers (MD-T5) on four tasks across two domains - Python Code and Chess. We carried out extensive experiments using three popular training strategies: Bert-style joint pretraining + successive finetuning, GPT-style joint pretraining + successive finetuning, and GPT-style joint pretraining + joint finetuning. Also, we evaluate the model on four metrics - Play Score, Eval Score, BLEU Score, and Multi-Domain Learning Score (MDLS). These metrics measure performance across the various tasks and multi-domain learning. We show that while negative knowledge transfer and catastrophic forgetting are still considerable challenges for all the models, the GPT-style joint pretraining + joint finetuning strategy showed the most promise in multi-domain, multi-task learning as it performs well across all four tasks while still keeping its multi-domain knowledge.


title: Low-degree robust Hellinger-Reissner finite element schemes for planar linear elasticity with symmetric stress tensors

abstract: In this paper, we study the construction of low-degree robust finite element schemes for planar linear elasticity on general triangulations. Firstly, we present a low-degree nonconforming Helling-Reissner finite element scheme. For the stress tensor space, the piecewise polynomial shape function space is $$ {\rm span}\left\{\left(\begin{array}{cc}1&0\\ 0 & 0\end{array}\right),\left(\begin{array}{cc}0&1\\ 1 & 0\end{array}\right),\left(\begin{array}{cc}0&0\\ 0 & 1\end{array}\right),\left(\begin{array}{cc}0&x\\ x & 0\end{array}\right),\left(\begin{array}{cc}0&y\\ y & 0\end{array}\right),\left(\begin{array}{cc}0&x^2-y^2\\ x^2-y^2 & 0\end{array}\right)\right\}, $$ the dimension of the total space is asymptotically 8 times of the number of vertices, and the supports of the basis functions are each a patch of an edge. The piecewise rigid body space is used for the displacement. Robust error estimations in $\mathbb{L}^2$ and broken $\mathbf{H}({\rm div})$ norms are presented. Secondly, we investigate the theoretical construction of schemes with lowest-degree polynomial shape function spaces. Specifically, a Hellinger-Reissner finite element scheme is constructed, with the local shape function space for the stress tensor being 5-dimensional which is of the lowest degree for the local approximation of $\mathbf{H}({\rm div};\mathbb{S})$, and the space for the displacement is piecewise constants. Robust error estimations in $\mathbb{L}^2$ and broken $\mathbf{H}({\rm div})$ norms are presented for regular solutions and data.


title: Stochastic MPC with Realization-Adaptive Constraint Tightening

abstract: This paper presents a stochastic model predictive controller (SMPC) for linear time-invariant systems in the presence of additive disturbances. The distribution of the disturbance is unknown and is assumed to have a bounded support. A sample-based strategy is used to compute sets of disturbance sequences necessary for robustifying the state chance constraints. These sets are constructed offline using samples of the disturbance extracted from its support. For online MPC implementation, we propose a novel reformulation strategy of the chance constraints, where the constraint tightening is computed by adjusting the offline computed sets based on the previously realized disturbances along the trajectory. The proposed MPC is recursive feasible and can lower conservatism over existing SMPC approaches at the cost of higher offline computational time. Numerical simulations demonstrate the effectiveness of the proposed approach.


abstract: Students from under-represented populations, including those at minority serving institutions have traditionally faced many barriers that have resulted in their being under-represented in High Energy Physics. These barriers include lack of research infrastructure and opportunities, insufficient mentoring, lack of support networks, and financial hardship, among many others. Recently the U.S. CMS Collaboration launched a pilot program U.S. CMS - PURSUE (Program for Undergraduate Research SUmmer Experience) to address these barriers. A 10-week paid internship program, the very first of its kind in an HEP experiment, was organised during the summer of 2022. Students were selected predominantly from Minority Serving Institutions with no research program in HEP. This pilot program provided a structured hands-on research experience under the mentor-ship of U.S. CMS scientists from several collaborating institutions. In addition to emphasis on hands-on research, the program offered a set of software training modules for the first few weeks. These were interleaved with a series of lectures every week covering a broad range of topics. The students were exposed to cutting-edge particle physics research and developed a broad set of skills in software, computing, data science, and machine learning. The modality of this program was virtual, due to the unknown circumstances following the pandemic. There is plan to continue the internship program annually, with in-person training and research participation. In this paper, we describe the experience with the pilot program U.S. CMS - PURSUE.


title: Probing the non-standard neutrino interactions using quantum statistics

abstract: Using the well established principles of Lorentz invariance, CP and CPT symmetry, and quantum statistics we do a model-independent study of effects of possible non-standard couplings of (Dirac and Majorana) neutrinos. The study is sensitive to the different quantum statistical properties of the Dirac and Majorana neutrinos which, contrary to neutrino-mediated processes of lepton number violation, could lead to observable effects not suppressed by the small ratios of neutrino and heavier particle masses. For processes with a neutrino-antineutrino pair of the same flavor in the final state, we formulate the ``Dirac Majorana confusion theorem (DMCT)'' showing why it is normally very difficult to observe the different behaviour of both kinds of neutrinos in experiments if they have only the standard model (SM)-like left-handed vector couplings to gauge bosons. We discuss deviations from the confusion theorem in the presence of non-standard neutrino interactions, allowing to discover or constrain such novel couplings. We illustrate the general results with two chosen examples of neutral current processes, $Z \to \nu \, \overline{\nu}$ and $\mathcal{P}_i \to \mathcal{P}_f \, \nu \, \overline{\nu}$ (with $\mathcal{P}_{i,f}$ denoting pseudoscalar mesons, such as $B,K,\pi$). Our analysis shows that using 3-body decays the presence of non-standard interactions can not only be constrained but one can also distinguish between Dirac and Majorana neutrino possibilities.


title: Rigel Exoplanet Geologist

abstract: The Rigel concept calls for direct, on-surface, exploration of an exoplanet. This proposal will send a robot geologist to an exoplanet in the tau Ceti system. At a distance of 10 light-years, this may be the nearest system that includes a temperate rocky planet. As with Apollo, the Rigel project will provide a way to marshal efforts from many fields of engineering. The key to the Rigel concept is long-term development and management. A mission that lasts for a thousand years will require multi-generational oversight. Rigel may start out as a NASA project, but will later become a global endeavor. The construction of a robot ambassador from planet Earth can serve to unite the community of nations. It will bring out the best in us as we work on a project that will benefit our distant descendants.


title: Comment on: "On the characteristic polynomial of an effective Hamiltonian"

abstract: We show that a method proposed recently, based on the characteristic polynomial of an effective Hamiltonian, had been developed several years earlier by other authors in a clearer and more general way. We outline both implementations of the approach and compare them by means of the calculation of the exceptional point closest to origin for a toy model.


title: Asynchronous Actor-Critic for Multi-Agent Reinforcement Learning

abstract: Synchronizing decisions across multiple agents in realistic settings is problematic since it requires agents to wait for other agents to terminate and communicate about termination reliably. Ideally, agents should learn and execute asynchronously instead. Such asynchronous methods also allow temporally extended actions that can take different amounts of time based on the situation and action executed. Unfortunately, current policy gradient methods are not applicable in asynchronous settings, as they assume that agents synchronously reason about action selection at every time step. To allow asynchronous learning and decision-making, we formulate a set of asynchronous multi-agent actor-critic methods that allow agents to directly optimize asynchronous policies in three standard training paradigms: decentralized learning, centralized learning, and centralized training for decentralized execution. Empirical results (in simulation and hardware) in a variety of realistic domains demonstrate the superiority of our approaches in large multi-agent problems and validate the effectiveness of our algorithms for learning high-quality and asynchronous solutions.


title: Summary Report of the Topical Group on Career Pipeline and Development (CommF2) Community Engagement Frontier Snowmass 2021

abstract: The HEP faculty hire job market has stayed fairly plateaued over the years not keeping up with number of postdocs and PhD produced seeking such employment. Physicists who seek jobs outside this realm face challenges. For example those hired as faculties at predominantly undergraduate institutions (PUI) and community colleges (CC) face hurdles to keep with research due higher teaching load and funding challenges. At the same time those who seek employment in industry may find themselves in unprepared territory despite marketable skills. New job opportunities seeking HEP developed skills have appeared in data science, machine learning and quantum computing. Given that a vast majority transition to the industry jobs, we must strengthen the existing paths for this transition and develop new ways to facilitating it. A strong engagement between HEP and its alumni would boost this process. At the same time those who stay in academia but choose to work at PUIs or CCs must be enabled to continue to pursue research and receive support and guidance for funding. PUIs and CCs serve as a gateway to opportunities for inclusiveness beyond national labs and academic research institutions offering an early starting point in the pipeline that can mitigate issues of lack of diversity and underrepresented participation of different groups in HEP. This report summarises the study undertaken to investigate these issues in HEP community and provide findings and recommendations.


title: Total Solar Irradiance during the Last Five Centuries

abstract: The total solar irradiance (TSI) varies on timescales of minute to centuries. On short timescales it varies due to the superposition of intensity fluctuations produced by turbulent convection and acoustic oscillations. On longer scale times, it changes due to photospheric magnetic activity, mainly because of the facular brightenings and dimmings caused by sunspots. While modern TSI variations have been monitored from space since 1970s, TSI variations over much longer periods can only be estimated using either historical observations of magnetic features, possibly supported by flux transport models, or from the measurements of the cosmogenic isotope (e.g., \textsuperscript{14}C or \textsuperscript{10}Be) concentrations in tree rings and ice cores. The reconstruction of the TSI in the last few centuries, particularly in the 17th/18th centuries during the Maunder minimum, is of primary importance for studying climatic effects. To separate the temporal components of the irradiance variations, specifically the magnetic cycle from secular variability, we decomposed the signals associated with historical observations of magnetic features and the solar modulation potential $\Phi$ by applying an Empirical Mode Decomposition algorithm. Thus, the reconstruction is empirical and does not require any feature contrast or field transport model. The assessed difference between the mean value during the Maunder minimum and the present value is $\simeq2.5 Wm^{-2}$. Moreover it shows, in the first half of the last century, a growth of $\simeq 1.5 W m^{-2}$ which stops around the middle of the century to remain constant for the next 50 years, apart from the modulation due to the solar cycle.


title: Density functional theory and non-relativistic photoelectric effects in the few-electron atomic systems

abstract: Closed analytical formulas are derived for the differential and total cross sections of the non-relativistic photoelectric effect in the three main classes of few-electron atomic systems: (1) neutral atoms and positively charged atomic ions which contain more than one bound electron, (2) negatively charged atomic ions, and (3) one-electron atoms and ions. Our procedure developed in this study is a combination of QED methods and results of the density functional theory obtained for atoms and ions. In all these systems the photoelectric effect is considered as photodetachment of the outer-most electron and our analysis is based on the results of density functional theory obtained for the electron density (radial) distribution in these atomic systems. Analytical formulas (similar to ours) for the differential and total cross sections of photoelectric effect for atomic systems from classes (1) and (2) have never been produced in earlier studies.


title: A Comprehensive Survey on Trustworthy Recommender Systems

abstract: As one of the most successful AI-powered applications, recommender systems aim to help people make appropriate decisions in an effective and efficient way, by providing personalized suggestions in many aspects of our lives, especially for various human-oriented online services such as e-commerce platforms and social media sites. In the past few decades, the rapid developments of recommender systems have significantly benefited human by creating economic value, saving time and effort, and promoting social good. However, recent studies have found that data-driven recommender systems can pose serious threats to users and society, such as spreading fake news to manipulate public opinion in social media sites, amplifying unfairness toward under-represented groups or individuals in job matching services, or inferring privacy information from recommendation results. Therefore, systems' trustworthiness has been attracting increasing attention from various aspects for mitigating negative impacts caused by recommender systems, so as to enhance the public's trust towards recommender systems techniques. In this survey, we provide a comprehensive overview of Trustworthy Recommender systems (TRec) with a specific focus on six of the most important aspects; namely, Safety & Robustness, Nondiscrimination & Fairness, Explainability, Privacy, Environmental Well-being, and Accountability & Auditability. For each aspect, we summarize the recent related technologies and discuss potential research directions to help achieve trustworthy recommender systems in the future.


title: Recent Approaches for Perceptive Legged Locomotion

abstract: As both legged robots and embedded compute have become more capable, researchers have started to focus on field deployment of these robots. Robust autonomy in unstructured environments requires perception of the world around the robot in order to avoid hazards. However, incorporating perception online while maintaining agile motion is more challenging for legged robots than other mobile robots due to the complex planners and controllers required to handle the dynamics of locomotion. This report will compare three recent approaches for perceptive locomotion and discuss the different ways in which vision can be used to enable legged autonomy.


title: Measuring and Controlling Split Layer Privacy Leakage Using Fisher Information

abstract: Split learning and inference propose to run training/inference of a large model that is split across client devices and the cloud. However, such a model splitting imposes privacy concerns, because the activation flowing through the split layer may leak information about the clients' private input data. There is currently no good way to quantify how much private information is being leaked through the split layer, nor a good way to improve privacy up to the desired level. In this work, we propose to use Fisher information as a privacy metric to measure and control the information leakage. We show that Fisher information can provide an intuitive understanding of how much private information is leaking through the split layer, in the form of an error bound for an unbiased reconstruction attacker. We then propose a privacy-enhancing technique, ReFIL, that can enforce a user-desired level of Fisher information leakage at the split layer to achieve high privacy, while maintaining reasonable utility.


title: Interactive Entanglement in Hybrid Opto-magno-mechanics System

abstract: We present a novel cavity opto-magno-mechanical hybrid system to generate entanglements among multiple quantum carriers, such as magnons, mechanical resonators, and cavity photons in both the optical and microwave domains. Two Yttrium iron garnet (YIG) spheres are embedded in two separate microwave cavities which are joined by a communal mechanical resonator. Because the microwave cavities are separate, the ferromagnetic resonate frequencies of two YIG spheres can be tuned independently, as well as the cavity frequencies. We show that entanglement can be achieved with experimentally reachable parameters. The entanglement is robust against environmental thermal noise, owing to the mechanical cooling process achieved by the optical cavity. The maximum entanglement among different carriers is achieved by optimizing the parameters of the system. The individual tunability of the separated cavities allows us to independently control the entanglement properties of different subsystems and establish quantum channels with different entanglement properties in one system. This work could provide promising applications in quantum metrology and quantum information tasks.


title: Leak Detection in Natural Gas Pipeline Using Machine Learning Models

abstract: Leak detection in gas pipelines is an important and persistent problem in the Oil and Gas industry. This is particularly important as pipelines are the most common way of transporting natural gas. This research aims to study the ability of data-driven intelligent models to detect small leaks for a natural gas pipeline using basic operational parameters and then compare the intelligent models among themselves using existing performance metrics. This project applies the observer design technique to detect leaks in natural gas pipelines using a regressoclassification hierarchical model where an intelligent model acts as a regressor and a modified logistic regression model acts as a classifier. Five intelligent models (gradient boosting, decision trees, random forest, support vector machine and artificial neural network) are studied in this project using a pipeline data stream of four weeks. The results shows that while support vector machine and artificial neural networks are better regressors than the others, they do not provide the best results in leak detection due to their internal complexities and the volume of data used. The random forest and decision tree models are the most sensitive as they can detect a leak of 0.1% of nominal flow in about 2 hours. All the intelligent models had high reliability with zero false alarm rate in testing phase. The average time to leak detection for all the intelligent models was compared to a real time transient model in literature. The results show that intelligent models perform relatively well in the problem of leak detection. This result suggests that intelligent models could be used alongside a real time transient model to significantly improve leak detection results.


title: DenseTact 2.0: Optical Tactile Sensor for Shape and Force Reconstruction

abstract: Collaborative robots stand to have an immense impact on both human welfare in domestic service applications and industrial superiority in advanced manufacturing with dexterous assembly. The outstanding challenge is providing robotic fingertips with a physical design that makes them adept at performing dexterous tasks that require high-resolution, calibrated shape reconstruction and force sensing. In this work, we present DenseTact 2.0, an optical-tactile sensor capable of visualizing the deformed surface of a soft fingertip and using that image in a neural network to perform both calibrated shape reconstruction and 6-axis wrench estimation. We demonstrate the sensor accuracy of 0.3633mm per pixel for shape reconstruction, 0.410N for forces, 0.387Nmm for torques, and the ability to calibrate new fingers through transfer learning, which achieves comparable performance with only 12% of the non-transfer learning dataset size.