title: Efficient Hyperparameter Tuning with Dynamic Accuracy Derivative-Free Optimization

abstract: Many machine learning solutions are framed as optimization problems which rely on good hyperparameters. Algorithms for tuning these hyperparameters usually assume access to exact solutions to the underlying learning problem, which is typically not practical. Here, we apply a recent dynamic accuracy derivative-free optimization method to hyperparameter tuning, which allows inexact evaluations of the learning problem while retaining convergence guarantees. We test the method on the problem of learning elastic net weights for a logistic classifier, and demonstrate its robustness and efficiency compared to a fixed accuracy approach. This demonstrates a promising approach for hyperparameter tuning, with both convergence guarantees and practical performance.


title: The zero-shear-rate limiting rheological behaviors of ideally conductive particles suspended in concentrated dispersions under an electric field

abstract: The rheological behaviors of suspension of ideally conductive particles in an electric field are studied using large-scale numerical simulations in the limit of zero-shear-rate flow. Under the action of an electric field, the particles undergo the nonlinear electrokinetic phenomenon termed as dipolophoresis, which is the combination of dielectrophoresis and induced-charge electrophoresis. For ideally conductive particles, the dynamics of the suspension are primarily controlled by induced-charge electrophoresis. To characterize the rheological properties of the suspension, the particle stress tensor and particle pressure are calculated in a range of volume fraction up to almost random close packing. The particle normal stress and particle pressure are shown to behave non-monotonically with volume fraction, especially in concentrated regimes. In particular, the particle pressure is positive for volume fraction up to 30\%, after which it becomes negative, indicating a change in the nature of the particle pressure. The microstructure expressed by pair distribution function and suspension entropy is also evaluated. Visible variations in the local microstructure seem to correlate with the non-monotonic variation in the particle normal stresses and particle pressure. These non-monotonic behaviors are also correlated with the change in the dominant mechanism of particle pairing dynamics observed in our recent study [Mirfendereski \& Park, J. Fluid Mech. \textbf{875}, R3 (2019)]. Lastly, the effects of confinement on the particle stress and particle pressure are investigated. It is found that the particle pressure changes its nature very quickly at high volume fractions as the level of confinement increases. This study should motivate control strategies to fully exploit the distinct changing nature of the pressure for rheological manipulation of such suspension system.


title: Robust Forecasting

abstract: We use a decision-theoretic framework to study the problem of forecasting discrete outcomes when the forecaster is unable to discriminate among a set of plausible forecast distributions because of partial identification or concerns about model misspecification or structural breaks. We derive "robust" forecasts which minimize maximum risk or regret over the set of forecast distributions. We show that for a large class of models including semiparametric panel data models for dynamic discrete choice, the robust forecasts depend in a natural way on a small number of convex optimization problems which can be simplified using duality methods. Finally, we derive "efficient robust" forecasts to deal with the problem of first having to estimate the set of forecast distributions and develop a suitable asymptotic efficiency theory. Forecasts obtained by replacing nuisance parameters that characterize the set of forecast distributions with efficient first-stage estimators can be strictly dominated by our efficient robust forecasts.


title: Confusable Learning for Large-class Few-Shot Classification

abstract: Few-shot image classification is challenging due to the lack of ample samples in each class. Such a challenge becomes even tougher when the number of classes is very large, i.e., the large-class few-shot scenario. In this novel scenario, existing approaches do not perform well because they ignore confusable classes, namely similar classes that are difficult to distinguish from each other. These classes carry more information. In this paper, we propose a biased learning paradigm called Confusable Learning, which focuses more on confusable classes. Our method can be applied to mainstream meta-learning algorithms. Specifically, our method maintains a dynamically updating confusion matrix, which analyzes confusable classes in the dataset. Such a confusion matrix helps meta learners to emphasize on confusable classes. Comprehensive experiments on Omniglot, Fungi, and ImageNet demonstrate the efficacy of our method over state-of-the-art baselines.


title: Parametric Flatten-T Swish: An Adaptive Non-linear Activation Function For Deep Learning

abstract: Activation function is a key component in deep learning that performs non-linear mappings between the inputs and outputs. Rectified Linear Unit (ReLU) has been the most popular activation function across the deep learning community. However, ReLU contains several shortcomings that can result in inefficient training of the deep neural networks, these are: 1) the negative cancellation property of ReLU tends to treat negative inputs as unimportant information for the learning, resulting in a performance degradation; 2) the inherent predefined nature of ReLU is unlikely to promote additional flexibility, expressivity, and robustness to the networks; 3) the mean activation of ReLU is highly positive and leads to bias shift effect in network layers; and 4) the multilinear structure of ReLU restricts the non-linear approximation power of the networks. To tackle these shortcomings, this paper introduced Parametric Flatten-T Swish (PFTS) as an alternative to ReLU. By taking ReLU as a baseline method, the experiments showed that PFTS improved classification accuracy on SVHN dataset by 0.31%, 0.98%, 2.16%, 17.72%, 1.35%, 0.97%, 39.99%, and 71.83% on DNN-3A, DNN-3B, DNN-4, DNN- 5A, DNN-5B, DNN-5C, DNN-6, and DNN-7, respectively. Besides, PFTS also achieved the highest mean rank among the comparison methods. The proposed PFTS manifested higher non-linear approximation power during training and thereby improved the predictive performance of the networks.


title: Wasserstein-based fairness interpretability framework for machine learning models

abstract: The objective of this article is to introduce a fairness interpretability framework for measuring and explaining the bias in classification and regression models at the level of a distribution. In our work, we measure the model bias across sub-population distributions in the model output using the Wasserstein metric. To properly quantify the contributions of predictors, we take into account the favorability of both the model and predictors with respect to the non-protected class. The quantification is accomplished by the use of transport theory, which gives rise to the decomposition of the model bias and bias explanations to positive and negative contributions. To gain more insight into the role of favorability and allow for additivity of bias explanations, we adapt techniques from cooperative game theory.


title: Variational approach with the superposition of the symmetry-restored quasi-particle vacua for nuclear shell-model calculations

abstract: We propose a variational calculation scheme utilizing the superposition of the angular-momentum, parity, number projected quasiparticle vacua, that is especially suitable for applying to medium-heavy nuclei in shell-model calculations. We derive a formula for the energy variance with quasi-particle vacua and apply the energy-variance extrapolation to the present scheme for further precise estimation of the exact shell-model energy. The validity of the method is presented for the shell-model calculation of $^{132}$Ba in the $50 \leq Z,N \leq 82$ model space. We also discuss the feasibility of this scheme in the case of the $^{150}$Nd in the $50 \leq Z \leq 82$ and $82 \leq Z \leq 126$ model space and demonstrate that its neutrinoless-double-beta-decay matrix element is obtained showing good convergence.


title: Leveraging an Efficient and Semantic Location Embedding to Seek New Ports of Bike Share Services

abstract: For short distance traveling in crowded urban areas, bike share services are becoming popular owing to the flexibility and convenience. To expand the service coverage, one of the key tasks is to seek new service ports, which requires to well understand the underlying features of the existing service ports. In this paper, we propose a new model, named for Efficient and Semantic Location Embedding (ESLE), which carries both geospatial and semantic information of the geo-locations. To generate ESLE, we first train a multi-label model with a deep Convolutional Neural Network (CNN) by feeding the static map-tile images and then extract location embedding vectors from the model. Compared to most recent relevant literature, ESLE is not only much cheaper in computation, but also easier to interpret via a systematic semantic analysis. Finally, we apply ESLE to seek new service ports for NTT DOCOMO's bike share services operated in Japan. The initial results demonstrate the effectiveness of ESLE, and provide a few insights that might be difficult to discover by using the conventional approaches.


title: Fock and Hardy spaces: Clifford-Appell case

abstract: In this paper, we study a specific system of Clifford-Appell polynomials and in particular their product. Moreover, we introduce a new family of quaternionic reproducing kernel Hilbert spaces in the framework of Fueter regular functions. The construction is based on a general idea which allows to obtain various function spaces, by specifying a suitable sequence of real numbers. We focus on the Fock and Hardy cases in this setting, and we study the action of the Fueter mapping and its range.


title: The Feasibility and Flexibility of Selecting Quasars by Variability Using Ensemble Machine Learning Algorithms

abstract: In this work we train three decision-tree based ensemble machine learning algorithms (Random Forest Classifier, Adaptive Boosting and Gradient Boosting Decision Tree respectively) to study quasar selection in the variable source catalog in SDSS Stripe 82. We build training and test samples (both containing 1:1 of quasars and stars) using the spectroscopic confirmed sources in SDSS DR14 (including 8330 quasars and 3966 stars). We find that, trained with variation parameters alone, all three models can select quasars with similarly and remarkably high precision and completeness ($\sim$ 98.5% and 97.5%), even better than trained with SDSS colors alone ($\sim$ 97.2% and 96.5%), consistent with previous studies. Through applying the trained models on the variable sources without spectroscopic identifications, we estimate the spectroscopically confirmed quasar sample in Stripe 82 variable source catalog is $\sim$ 93% complete (95% for $m_i<19.0$). Using the Random Forest Classifier we derive the relative importance of the observational features utilized for classifications. We further show that even using one- or two-year time domain observations, variability-based quasar selection could still be highly efficient.


title: What's New? Summarizing Contributions in Scientific Literature

abstract: With thousands of academic articles shared on a daily basis, it has become increasingly difficult to keep up with the latest scientific findings. To overcome this problem, we introduce a new task of disentangled paper summarization, which seeks to generate separate summaries for the paper contributions and the context of the work, making it easier to identify the key findings shared in articles. For this purpose, we extend the S2ORC corpus of academic articles, which spans a diverse set of domains ranging from economics to psychology, by adding disentangled "contribution" and "context" reference labels. Together with the dataset, we introduce and analyze three baseline approaches: 1) a unified model controlled by input code prefixes, 2) a model with separate generation heads specialized in generating the disentangled outputs, and 3) a training strategy that guides the model using additional supervision coming from inbound and outbound citations. We also propose a comprehensive automatic evaluation protocol which reports the relevance, novelty, and disentanglement of generated outputs. Through a human study involving expert annotators, we show that in 79%, of cases our new task is considered more helpful than traditional scientific paper summarization.


title: Coulomb barrier creation by means of electronic field emission in nanolayer capacitors

abstract: The main mechanism of energy loss in capacitors with nanoscale dielectric films is leakage currents. Using the example of Al-Al2O3-Al, we show that there are two main contributions, namely the cold field emission effect and the hopping conductivity through the dielectric. Our main finding is that an application of a high electric field, ~0.6-0.7 GV/m, causes electrons to penetrate the dielectric. If the temperature is sufficiently low, such electrons become permanently trapped in the dielectric. To achieve a strong charging of the dielectric, the voltage needs to be high enough, so that a field emission occurs from the cathode into the dielectric. Such a strongly charged dielectric layer generates a Coulomb barrier and leads to a suppression of the leakage current. Thus, after the dielectric nanolayer of the capacitor is charged, the field emission and the hopping conductivity are both suppressed, and the hysteresis of the I-V curve disappears. The phenomenon is observed at temperatures up to ~225 K. It would be advantageous to identify insulators in which the phenomenon of the Coulomb barriers persists even up to the room temperature, but at this time it is not known whether such dielectrics exist and/or can be designed.


title: Network-Constrained Transactive Control for Multi- Microgrids-based Distribution Networks with SOPs

abstract: Different from most transactive control studies only focusing on economic aspect, this paper develops a novel network-constrained transactive control (NTC) framework that can address both economic and secure issues for a multi-microgrids-based distribution network considering uncertainties. In particular, we innovatively integrate a transactive energy market with the novel power-electronics device (i.e., soft open point) based AC power flow regulation technique to improve economic benefits for individual microgrids and meanwhile ensure the security of the entire distribution network. In this framework, a dynamic two-timescale NTC model consisting of slow-timescale pre-scheduling and real-time scheduling stages is formulated to work against multiple system uncertainties. Moreover, the original bilevel game problems are transformed into single-level mixed-integer second-order cone programming problems through KKT conditions, duality, linearization and relaxation techniques to avoid iterations of transitional methods, so as to improve computational efficiency. Finally, numerical simulations on a modified 33-bus test system with 3 MGs verify the effectiveness of the proposed framework.


title: Learning Power Control for Cellular Systems with Heterogeneous Graph Neural Network

abstract: Optimizing power control in multi-cell cellular networks with deep learning enables such a non-convex problem to be implemented in real-time. When channels are time-varying, the deep neural networks (DNNs) need to be re-trained frequently, which calls for low training complexity. To reduce the number of training samples and the size of DNN required to achieve good performance, a promising approach is to embed the DNNs with priori knowledge. Since cellular networks can be modelled as a graph, it is natural to employ graph neural networks (GNNs) for learning, which exhibit permutation invariance (PI) and equivalence (PE) properties. Unlike the homogeneous GNNs that have been used for wireless problems, whose outputs are invariant or equivalent to arbitrary permutations of vertexes, heterogeneous GNNs (HetGNNs), which are more appropriate to model cellular networks, are only invariant or equivalent to some permutations. If the PI or PE properties of the HetGNN do not match the property of the task to be learned, the performance degrades dramatically. In this paper, we show that the power control policy has a combination of different PI and PE properties, and existing HetGNN does not satisfy these properties. We then design a parameter sharing scheme for HetGNN such that the learned relationship satisfies the desired properties. Simulation results show that the sample complexity and the size of designed GNN for learning the optimal power control policy in multi-user multi-cell networks are much lower than the existing DNNs, when achieving the same sum rate loss from the numerically obtained solutions.


title: Search for U(1)$_{L_\mu-L_\tau}$ charged Dark Matter with neutrino telescope

abstract: We study a simple Dirac fermion dark matter model in U(1)$_{L_\mu-L_\tau}$ theory. The new light gauge boson $X$ plays important roles in both dark matter physics and the explanation for the muon $g-2$ anomaly. The observed dark matter relic density is realized by a large U(1)$_{L_\mu-L_\tau}$ charge without introducing a resonance effect of the $X$ boson. As a by-product of the model, characteristic neutrino signatures from sub-GeV dark matter $\psi$ are predicted depending on the mass spectrum. We formulate the analysis of $\psi\bar\psi\to \nu\bar\nu$, and of $\psi\bar\psi\to XX$ followed by $X\to\nu\bar\nu$, in a model independent way. The energy spectrum of neutrinos in the former process is monochromatic while in the latter process is bowl-shape. We also evaluate sensitivity at Super-Kamiokande and future Hyper-Kamiokande detectors. The analysis is finally applied to the U(1)$_{L_\mu-L_\tau}$ dark matter model.


title: The type problem for Riemann surfaces via Fenchel-Nielsen parameters

abstract: A Riemann surface $X$ is said to be of \emph{parabolic type} if it supports a Green's function. Equivalently, the geodesic flow on the unit tangent of $X$ is ergodic. Given a Riemann surface $X$ of arbitrary topological type and a hyperbolic pants decomposition of $X$ we obtain sufficient conditions for parabolicity of $X$ in terms of the Fenchel-Nielsen parameters of the decomposition. In particular, we initiate the study of the effect of twist parameters on parabolicity. A key ingredient in our work is the notion of \textit{non standard half-collar} about a hyperbolic geodesic. We show that the modulus of such a half-collar is much larger than the modulus of a standard half-collar as the hyperbolic length of the core geodesic tends to infinity. Moreover, the modulus of the annulus obtained by gluing two non standard half-collars depends on the twist parameter, unlike in the case of standard collars. Our results are sharp in many cases. For instance, for zero-twist flute surfaces as well as half-twist flute surfaces with concave sequences of lengths our results provide a complete characterization of parabolicity in terms of the length parameters. It follows that parabolicity is equivalent to completeness in these cases. Applications to other topological types such as surfaces with infinite genus and one end (a.k.a. the infinite Loch-Ness monster), the ladder surface, Abelian covers of compact surfaces are also studied.


title: Estimating the nuclear saturation parameter via low-mass neutron star asteroseismology

abstract: We examine the fundamental ($f$-) and the 1st pressure ($p_1$-) mode frequencies in gravitational waves from cold neutron stars constructed with various unified realistic equations of state. With the calculated frequencies, we derive the empirical formulae for the $f$- and $p_1$-mode frequencies, $f_f$ and $f_{p_1}$, as a function of the square root of the stellar average density and the parameter ($\eta$), which is a combination of the nuclear saturation parameters. With our empirical formulae, we show that by simultaneously observing the $f$- and $p_1$-mode gravitational waves, when $1.5\lesssim f_{p_1}/f_f\lesssim 2.5$ (which corresponds to neutron star models with the mass of $\lesssim 0.9M_\odot$), one could estimate the value of $\eta$ within $\sim 10\%$ accuracy, which makes a strong constraint on the EOS for neutron star matter. In addition, we find that the maximum $f$-mode frequency is strongly associated with the minimum radius of neutron star. That is, if one would observe a larger frequency of the $f$-mode, one might constrain the upper limit of the minimum neutron star radius.


title: Neural Stochastic Contraction Metrics for Learning-based Control and Estimation

abstract: We present Neural Stochastic Contraction Metrics (NSCM), a new design framework for provably-stable robust control and estimation for a class of stochastic nonlinear systems. It uses a spectrally-normalized deep neural network to construct a contraction metric, sampled via simplified convex optimization in the stochastic setting. Spectral normalization constrains the state-derivatives of the metric to be Lipschitz continuous, thereby ensuring exponential boundedness of the mean squared distance of system trajectories under stochastic disturbances. The NSCM framework allows autonomous agents to approximate optimal stable control and estimation policies in real-time, and outperforms existing nonlinear control and estimation techniques including the state-dependent Riccati equation, iterative LQR, EKF, and the deterministic neural contraction metric, as illustrated in simulation results.


title: Real-Time Control over Wireless Networks

abstract: Industrial internet of Things (IIoT) are gaining popularity for use in large-scale applications such as oil-field management (e.g., $74\times 8$km$^2$ East Texas Oil-field), smart farming, smart manufacturing, smart grid, and data center power management. These applications require the wireless stack to provide a scalable, reliable, low-power and low-latency communication. To realize a predictable and reliable communication in a highly unreliable wireless environment, industrial wireless standards use a centralized wireless stack design. In a centralized wireless stack design, a central manager generates routes and a communication schedule for a multi-channel time division multiple access communication (TDMA) based medium access control (MAC). However, a centralized wireless stack design is highly energy consuming, not scalable, and does not support frequent changes to networks or workloads. To address these challenges, the following contributions are made in this dissertation: (1) A scalable and distributed routing algorithm for industrial IoT which generates graph routes, which offer a high degree of redundancy, (2) A local and online scheduling algorithm that is scalable, energy-efficient, and supports network/workload dynamics while ensuring reliability and real-time performance, (3) An approach to minimize latency for in-band integration of multiple low-power networks, (4) A fast and efficient test of schedulability that determines if an application meets the real-time performance requirement for given network topology, and (5) A distributed scheduling and control co-design that balances the control performance requirement and real-time performance for industrial IoT.


title: GHFP: Gradually Hard Filter Pruning

abstract: Filter pruning is widely used to reduce the computation of deep learning, enabling the deployment of Deep Neural Networks (DNNs) in resource-limited devices. Conventional Hard Filter Pruning (HFP) method zeroizes pruned filters and stops updating them, thus reducing the search space of the model. On the contrary, Soft Filter Pruning (SFP) simply zeroizes pruned filters, keeping updating them in the following training epochs, thus maintaining the capacity of the network. However, SFP, together with its variants, converges much slower than HFP due to its larger search space. Our question is whether SFP-based methods and HFP can be combined to achieve better performance and speed up convergence. Firstly, we generalize SFP-based methods and HFP to analyze their characteristics. Then we propose a Gradually Hard Filter Pruning (GHFP) method to smoothly switch from SFP-based methods to HFP during training and pruning, thus maintaining a large search space at first, gradually reducing the capacity of the model to ensure a moderate convergence speed. Experimental results on CIFAR-10/100 show that our method achieves the state-of-the-art performance.


title: An application of the Goulden-Jackson cluster theorem

abstract: Let A be an alphabet and let F be a set of words with letters in A. We show that the sum of all words with letters in A with no consecutive subwords in F, as a formal power series in noncommuting variables, is the reciprocal of a series with all coefficients 0, 1 or -1. We also explain how this result is related to a result of Curtis Greene on lattices with M\"obius function 0, 1, or -1.


title: Multi-output Gaussian Process Modulated Poisson Processes for Event Prediction

abstract: Prediction of events such as part replacement and failure events plays a critical role in reliability engineering. Event stream data are commonly observed in manufacturing and teleservice systems. Designing predictive models for individual units based on such event streams is challenging and an under-explored problem. In this work, we propose a non-parametric prognostic framework for individualized event prediction based on the inhomogeneous Poisson processes with a multivariate Gaussian convolution process (MGCP) prior on the intensity functions. The MGCP prior on the intensity functions of the inhomogeneous Poisson processes maps data from similar historical units to the current unit under study which facilitates sharing of information and allows for analysis of flexible event patterns. To facilitate inference, we derive a variational inference scheme for learning and estimation of parameters in the resulting MGCP modulated Poisson process model. Experimental results are shown on both synthetic data as well as real-world data for fleet based event prediction.


title: Does enforcing fairness mitigate biases caused by subpopulation shift?

abstract: Many instances of algorithmic bias are caused by subpopulation shifts. For example, ML models often perform worse on demographic groups that are underrepresented in the training data. In this paper, we study whether enforcing algorithmic fairness during training improves the performance of the trained model in the \emph{target domain}. On one hand, we conceive scenarios in which enforcing fairness does not improve performance in the target domain. In fact, it may even harm performance. On the other hand, we derive necessary and sufficient conditions under which enforcing algorithmic fairness leads to the Bayes model in the target domain. We also illustrate the practical implications of our theoretical results in simulations and on real data.


title: ULSD: Unified Line Segment Detection across Pinhole, Fisheye, and Spherical Cameras

abstract: Line segment detection is essential for high-level tasks in computer vision and robotics. Currently, most stateof-the-art (SOTA) methods are dedicated to detecting straight line segments in undistorted pinhole images, thus distortions on fisheye or spherical images may largely degenerate their performance. Targeting at the unified line segment detection (ULSD) for both distorted and undistorted images, we propose to represent line segments with the Bezier curve model. Then the line segment detection is tackled by the Bezier curve regression with an end-to-end network, which is model-free and without any undistortion preprocessing. Experimental results on the pinhole, fisheye, and spherical image datasets validate the superiority of the proposed ULSD to the SOTA methods both in accuracy and efficiency (40.6fps for pinhole images). The source code is available at https://github.com/lh9171338/Unified-LineSegment-Detection.


title: Active phase separation by turning toward regions of higher density

abstract: Studies of active matter, from molecular assemblies to animal groups, have revealed two broad classes of behavior: a tendency to align yields orientational order and collective motion, whereas particle repulsion leads to self-trapping and motility-induced phase separation. Here, we report a third class of behavior: orientational interactions that produce active phase separation. Combining theory and experiments on self-propelled Janus colloids, we show that stronger repulsion on the rear than on the front of these particles produces non-reciprocal torques that reorient particle motion toward high-density regions. Particles thus self-propel toward crowded areas, which leads to phase separation. Clusters remain fluid and exhibit fast particle turnover, in contrast to the jammed clusters that typically arise from self-trapping, and interfaces are sufficiently wide that they span entire clusters. Overall, our work identifies a torque-based mechanism for phase separation in active fluids, and our theory predicts that these orientational interactions yield coexisting phases that lack internal orientational order.


title: On the Ergodicity, Bias and Asymptotic Normality of Randomized Midpoint Sampling Method

abstract: The randomized midpoint method, proposed by [SL19], has emerged as an optimal discretization procedure for simulating the continuous time Langevin diffusions. Focusing on the case of strong-convex and smooth potentials, in this paper, we analyze several probabilistic properties of the randomized midpoint discretization method for both overdamped and underdamped Langevin diffusions. We first characterize the stationary distribution of the discrete chain obtained with constant step-size discretization and show that it is biased away from the target distribution. Notably, the step-size needs to go to zero to obtain asymptotic unbiasedness. Next, we establish the asymptotic normality for numerical integration using the randomized midpoint method and highlight the relative advantages and disadvantages over other discretizations. Our results collectively provide several insights into the behavior of the randomized midpoint discretization method, including obtaining confidence intervals for numerical integrations.


title: On Systematic Polarization-Adjusted Convolutional (PAC) Codes

abstract: Polarization-adjusted convolutional (PAC) codes were recently proposed and arouse the interest of the channel coding community because they were shown to approach theoretical bounds for the (128,64) code size. In this letter, we propose systematic PAC codes. Thanks to the systematic property, improvement in the bit-error rate of up to 0.2 dB is observed, while preserving the frame-error rate performance. Moreover, a genetic-algorithm based construction method targeted to approach the theoretical bound is provided. It is then shown that using the proposed construction method systematic and non-systematic PAC codes can approach the theoretical bound even for higher code sizes such as (256,128).


title: Beyond Marginal Uncertainty: How Accurately can Bayesian Regression Models Estimate Posterior Predictive Correlations?

abstract: While uncertainty estimation is a well-studied topic in deep learning, most such work focuses on marginal uncertainty estimates, i.e. the predictive mean and variance at individual input locations. But it is often more useful to estimate predictive correlations between the function values at different input locations. In this paper, we consider the problem of benchmarking how accurately Bayesian models can estimate predictive correlations. We first consider a downstream task which depends on posterior predictive correlations: transductive active learning (TAL). We find that TAL makes better use of models' uncertainty estimates than ordinary active learning, and recommend this as a benchmark for evaluating Bayesian models. Since TAL is too expensive and indirect to guide development of algorithms, we introduce two metrics which more directly evaluate the predictive correlations and which can be computed efficiently: meta-correlations (i.e. the correlations between the models correlation estimates and the true values), and cross-normalized likelihoods (XLL). We validate these metrics by demonstrating their consistency with TAL performance and obtain insights about the relative performance of current Bayesian neural net and Gaussian process models.


title: Filtering cohomology of ordinary and Lagrangian Grassmannians

abstract: This paper studies, for a positive integer $m$, the subalgebra of the cohomology ring of the complex Grassmannians generated by the elements of degree at most $m$. We build in two ways upon a conjecture for the Hilbert series of this subalgebra due to Reiner and Tudose. The first reinterprets it in terms of the operation of $k$-conjugation, suggesting two conjectural bases for the subalgebras that would imply their conjecture. The second introduces an analogous conjecture for the cohomology of Lagrangian Grassmannians.


title: FedSL: Federated Split Learning on Distributed Sequential Data in Recurrent Neural Networks

abstract: Federated Learning (FL) and Split Learning (SL) are privacy-preserving Machine-Learning (ML) techniques that enable training ML models over data distributed among clients without requiring direct access to their raw data. Existing FL and SL approaches work on horizontally or vertically partitioned data and cannot handle sequentially partitioned data where segments of multiple-segment sequential data are distributed across clients. In this paper, we propose a novel federated split learning framework, FedSL, to train models on distributed sequential data. The most common ML models to train on sequential data are Recurrent Neural Networks (RNNs). Since the proposed framework is privacy-preserving, segments of multiple-segment sequential data cannot be shared between clients or between clients and server. To circumvent this limitation, we propose a novel SL approach tailored for RNNs. A RNN is split into sub-networks, and each sub-network is trained on one client containing single segments of multiple-segment training sequences. During local training, the sub-networks on different clients communicate with each other to capture latent dependencies between consecutive segments of multiple-segment sequential data on different clients, but without sharing raw data or complete model parameters. After training local sub-networks with local sequential data segments, all clients send their sub-networks to a federated server where sub-networks are aggregated to generate a global model. The experimental results on simulated and real-world datasets demonstrate that the proposed method successfully trains models on distributed sequential data, while preserving privacy, and outperforms previous FL and centralized learning approaches in terms of achieving higher accuracy in fewer communication rounds.


title: Web Application Attack Detection using Deep Learning

abstract: Modern web applications are dominated by HTTP/HTTPS messages that consist of one or more headers, where most of the exploits and payloads can be injected by attackers. According to the OWASP, the 80 percent of the web attacks are done through HTTP/HTTPS requests queries. In this paper, we present a deep learning based web application attacks detection model. The model uses auto-encoder that can learn from the sequences of word and weight each word or character according to them. The classification engine is trained on ECML-KDD dataset for classification of anomaly queries with respect to specific attack type. The proposed web application detection engine is trained with anomaly and benign web queries to achieve the accuracy of receiver operating characteristic curve of 1. The experimental results show that the proposed model can detect web applications attack successfully with low false positive rate.


title: 5G Embraces Satellites for 6G Ubiquitous IoT: Basic Models for Integrated Satellite Terrestrial Networks

abstract: Terrestrial communication networks mainly focus on users in urban areas but have poor coverage performance in harsh environments, such as mountains, deserts, and oceans. Satellites can be exploited to extend the coverage of terrestrial fifth-generation (5G) networks. However, satellites are restricted by their high latency and relatively low data rate. Consequently, the integration of terrestrial and satellite components has been widely studied, to take advantage of both sides and enable seamless broadband coverage. Due to the significant differences between satellite communications (SatComs) and terrestrial communications (TerComs) in terms of channel fading, transmission delay, mobility, and coverage performance, the establishment of an efficient hybrid satellite-terrestrial network (HSTN) still faces many challenges. In general, it is difficult to decompose a HSTN into a sum of separate satellite and terrestrial links due to the complicated coupling relationships therein. To uncover the complete picture of HSTNs, we regard the HSTN as a combination of basic cooperative models that contain the main traits of satellite-terrestrial integration but are much simpler and thus more tractable than the large-scale heterogeneous HSTNs. In particular, we present three basic cooperative models, i.e., model X, model L, and model V, and provide a survey of the state-of-the-art technologies for each of them. We discuss future research directions towards establishing a cell-free, hierarchical, decoupled HSTN. We also outline open issues to envision an agile, smart, and secure HSTN for the sixth-generation (6G) ubiquitous Internet of Things (IoT).


title: Learning Object-Based State Estimators for Household Robots

abstract: A robot operating in a household makes observations of multiple objects as it moves around over the course of days or weeks. The objects may be moved by inhabitants, but not completely at random. The robot may be called upon later to retrieve objects and will need a long-term object-based memory in order to know how to find them. Existing work in semantic slam does not attempt to capture the dynamics of object movement. In this paper, we combine some aspects of classic techniques for data-association filtering with modern attention-based neural networks to construct object-based memory systems that operate on high-dimensional observations and hypotheses. We perform end-to-end learning on labeled observation trajectories to learn both the transition and observation models. We demonstrate the system's effectiveness in maintaining memory of dynamically changing objects in both simulated environment and real images, and demonstrate improvements over classical structured approaches as well as unstructured neural approaches. Additional information available at project website: https://yilundu.github.io/obm/.


title: Molecular Dynamic Study of Local Interfacial Thermal Resistance of Solid-Liquid and Solid-Solid Interfaces: Water and Nanotextured Surface

abstract: Degradation in performances of air conditioners and refrigerators is caused by a frost formation and adhesion on the surface. In the present study, by means of the classical molecular dynamics simulation, we investigate how and how much the nanotextured surface characteristics, such as surface wettability and geometry, influenced the interfacial thermal resistance (ITR) between the solid wall and the water/ice. The ITR of the interfacial region was comparable in both the water and the ice states. As the nanostructure gaps became narrower, the ITR of the interfacial region decreased. The local ITR had a weak negative correlation with the local H2O molecule density regardless of the phase of the H2O molecules. The local ITR decreased as the local density increased. The greater amount of the thermal energy was transferred through the material interface by means of the intermolecular interaction when more the H2O molecules were located in the proximity area, which was closer to the Pt solid wall than the first adsorption layer peak. When the H2O molecules were in the crystal form on the solid wall, the proximity molecules decreased, and then the local ITR significantly increased.


title: Efficient quantum algorithm for dissipative nonlinear differential equations

abstract: Nonlinear differential equations model diverse phenomena but are notoriously difficult to solve. While there has been extensive previous work on efficient quantum algorithms for linear differential equations, the linearity of quantum mechanics has limited analogous progress for the nonlinear case. Despite this obstacle, we develop a quantum algorithm for dissipative quadratic $n$-dimensional ordinary differential equations. Assuming $R < 1$, where $R$ is a parameter characterizing the ratio of the nonlinearity and forcing to the linear dissipation, this algorithm has complexity $T^2 q~\mathrm{poly}(\log T, \log n, \log 1/\epsilon)/\epsilon$, where $T$ is the evolution time, $\epsilon$ is the allowed error, and $q$ measures decay of the solution. This is an exponential improvement over the best previous quantum algorithms, whose complexity is exponential in $T$. While exponential decay precludes efficiency, driven equations can avoid this issue despite the presence of dissipation. Our algorithm uses the method of Carleman linearization, for which we give a novel convergence theorem. This method maps a system of nonlinear differential equations to an infinite-dimensional system of linear differential equations, which we discretize, truncate, and solve using the forward Euler method and the quantum linear system algorithm. We also provide a lower bound on the worst-case complexity of quantum algorithms for general quadratic differential equations, showing that the problem is intractable for $R \ge \sqrt{2}$. Finally, we discuss potential applications, showing that the $R < 1$ condition can be satisfied in realistic epidemiological models and giving numerical evidence that the method may describe a model of fluid dynamics even for larger values of $R$.


title: Revisiting Model-Agnostic Private Learning: Faster Rates and Active Learning

abstract: The Private Aggregation of Teacher Ensembles (PATE) framework is one of the most promising recent approaches in differentially private learning. Existing theoretical analysis shows that PATE consistently learns any VC-classes in the realizable setting, but falls short in explaining its success in more general cases where the error rate of the optimal classifier is bounded away from zero. We fill in this gap by introducing the Tsybakov Noise Condition (TNC) and establish stronger and more interpretable learning bounds. These bounds provide new insights into when PATE works and improve over existing results even in the narrower realizable setting. We also investigate the compelling idea of using active learning for saving privacy budget, and empirical studies show the effectiveness of this new idea. The novel components in the proofs include a more refined analysis of the majority voting classifier - which could be of independent interest - and an observation that the synthetic "student" learning problem is nearly realizable by construction under the Tsybakov noise condition.


title: Eulerian-Lagrangian modelling of rotating detonative combustion in partially pre-vaporized n-heptane sprays with hydrogen addition

abstract: Rotating detonation combustion (RDC) fuelled with partially pre-vaporized n-heptane sprays and gaseous hydrogen is studied with an Eulerian-Lagrangian method. Our focus is the effects of pre-vaporized n-heptane equivalence ratios and droplet diameters on detonation wave propagation and droplet dynamics in two-phase RDC. The results show that when the droplets are small, they are fully vaporized by the detonation wave. However, when the droplet diameter is relatively large and/or the detonation wave number is bifurcated, liquid droplets are observable beyond the refill zone. Moreover, the detonation speed is considerably influenced by the droplet pre-vaporization and diameter. The velocity deficits vary between 5% and 30%. Over 70% n-heptane is detonated in the simulated cases, and there exists a critical droplet diameter (about 20 um), around which the detonated fuel fraction is minimal. Four droplet trajectories in RDC are identified, which are differentiated by various evaporation times, residence times and interactions between droplets and the basic RDC flow structures. Inside the refill zone, three droplet categories are qualitatively identified. Droplets injected at the right end of the refill zone directly interact with the deflagration surface and meanwhile have relatively long residence time. However, droplets injected closer to the travelling detonation front have insufficient time to be heated and vaporized. Our results also demonstrate that when pre-vaporization level is low and initial droplet diameter is large, the liquid fuel droplets may disperse towards the combustor exit. Furthermore, the droplet dispersion height decreases with liquid fuel pre-vaporization, while increases with droplet diameter.


title: Automatic Brain Tumor Segmentation with Scale Attention Network

abstract: Automatic segmentation of brain tumors is an essential but challenging step for extracting quantitative imaging biomarkers for accurate tumor detection, diagnosis, prognosis, treatment planning and assessment. Multimodal Brain Tumor Segmentation Challenge 2020 (BraTS 2020) provides a common platform for comparing different automatic algorithms on multi-parametric Magnetic Resonance Imaging (mpMRI) in tasks of 1) Brain tumor segmentation MRI scans; 2) Prediction of patient overall survival (OS) from pre-operative MRI scans; 3) Distinction of true tumor recurrence from treatment related effects and 4) Evaluation of uncertainty measures in segmentation. We participate the image segmentation challenge by developing a fully automatic segmentation network based on encoder-decoder architecture. In order to better integrate information across different scales, we propose a dynamic scale attention mechanism that incorporates low-level details with high-level semantics from feature maps at different scales. Our framework was trained using the 369 challenge training cases provided by BraTS 2020, and achieved an average Dice Similarity Coefficient (DSC) of 0.8828, 0.8433 and 0.8177, as well as 95% Hausdorff distance (in millimeter) of 5.2176, 17.9697 and 13.4298 on 166 testing cases for whole tumor, tumor core and enhanced tumor, respectively, which ranked itself as the 3rd place among 693 registrations in the BraTS 2020 challenge.


title: KompaRe: A Knowledge Graph Comparative Reasoning System

abstract: Reasoning is a fundamental capability for harnessing valuable insight, knowledge and patterns from knowledge graphs. Existing work has primarily been focusing on point-wise reasoning, including search, link predication, entity prediction, subgraph matching and so on. This paper introduces comparative reasoning over knowledge graphs, which aims to infer the commonality and inconsistency with respect to multiple pieces of clues. We envision that the comparative reasoning will complement and expand the existing point-wise reasoning over knowledge graphs. In detail, we develop KompaRe, the first of its kind prototype system that provides comparative reasoning capability over large knowledge graphs. We present both the system architecture and its core algorithms, including knowledge segment extraction, pairwise reasoning and collective reasoning. Empirical evaluations demonstrate the efficacy of the proposed KompaRe.


title: ReFloat: Low-Cost Floating-Point Processing in ReRAM for Accelerating Iterative Linear Solvers

abstract: Resistive random access memory (ReRAM) is a promising technology that can perform low-cost and in-situ matrix-vector multiplication (MVM) in analog domain. Scientific computing requires high-precision floating-point (FP) processing. However, performing floating-point computation in ReRAM is challenging because of high hardware cost and execution time due to the large FP value range. In this work we present ReFloat, a data format and an accelerator architecture, for low-cost and high-performance floating-point processing in ReRAM for iterative linear solvers. ReFloat matches the ReRAM crossbar hardware and represents a block of FP values with reduced bits and an optimized exponent base for a high range of dynamic representation. Thus, ReFloat achieves less ReRAM crossbar consumption and fewer processing cycles and overcomes the noncovergence issue in a prior work. The evaluation on the SuiteSparse matrices shows ReFloat achieves 5.02x to 84.28x improvement in terms of solver time compared to a state-of-the-art ReRAM based accelerator.


title: Shape-dependent local strain in gold nanorods: data-driven atomic-resolution electron microscopy analysis

abstract: The local variation in inter-atomic distances, or local lattice strain often influences significantly material properties of nanoparticles. Strain measurement with ~1% precision is provided by recent atomic-resolution electron microscopy. However, the precision has been limited by noises in the experimental data. Here, we have applied one of the data-driven analyses, Gaussian process regression to predict true form of strain. The precision has been improved to be sub-percent of 0.2 % and more for detection of local strain. Rod-shaped nanoparticles have been revealed to contain characteristic lattice expansion ~+0.6 % around the subsurface cap tip area. The experimental results are reproduced by molecular dynamics simulations of the corresponding shaped atomic models. The strain peculiar to nanorods are explained in terms of curvature-dependent non-uniform surface stress due to shape anisotropy. The present results bring a hint to nanoscale engineering to optimize the strain in nanoparticles by shape control.


title: Cavity molecular dynamics simulations of vibrational polariton enhanced molecular nonlinear absorption

abstract: Recent experiments have observed that the chemical and photophysical properties of molecules can be modified inside an optical Fabry-Perot microcavity under collective vibrational strong coupling (VSC) conditions, and such modification is currently not well understood by theory. In an effort to understand the origin of such cavity induced phenomena, some recent studies have focused on the effect of the cavity environment on the nonlinear optical response of the molecular subsystem. Here, we use a recently proposed protocol for classical cavity molecular dynamics (CavMD) simulations to numerically investigate the linear and nonlinear response of liquid carbon dioxide under such VSC conditions following an optical pulse excitation. We find that applying a strong pulse of excitation to the lower hybrid light-matter state, i.e., the lower polariton (LP), can lead to an overall molecular nonlinear absorption which is enhanced by up to two orders of magnitude relative to the excitation outside the cavity. This polariton-enhanced multiphoton absorption also causes an ultrashort LP lifetime (0.2 ps) under strong illumination. Unlike usual polariton relaxation processes -- whereby polaritonic energy transfers directly to the manifold of singly excited vibrational dark states -- under the present mechanism, the LP transfers energy directly to the manifold of higher vibrationally excited dark states; these highly excited dark states subsequently relax to the manifold of singly excited states with a lifetime of tens of ps. Because the present mechanism is generic in nature, we expect these numerical predictions to be experimentally observed in different molecular systems and in cavities with different volumes.


title: Forward Higgs production within high energy factorization in the heavy quark limit at next-to-leading order accuracy

abstract: We use Lipatov's high energy effective action to determine the next-to-leading order corrections to Higgs production in the forward region within high energy factorization making use of the infinite top mass limit. Our result is based on an explicit calculation of real corrections combined with virtual corrections determined earlier by Nefedov. As a new element we provide a proper definition of the desired next-to-leading order coefficient within the high energy effective action framework, extending a previously proposed prescription. We further propose a subtraction mechanism to achieve for this coefficient a stable cancellation of real and virtual infra-red singularities in the presence of external off-shell legs. Apart from its relevance for direct phenomenological studies, such as high energy resummation of Higgs + jet configurations, our result will be further of use for the study of transverse momentum dependent factorization in the high energy limit.


title: Fast Approximation Algorithms for Bounded Degree and Crossing Spanning Tree Problems

abstract: We develop fast approximation algorithms for the minimum-cost version of the Bounded-Degree MST problem (BD-MST) and its generalization the Crossing Spanning Tree problem (Crossing-ST). We solve the underlying LP to within a $(1+\epsilon)$ approximation factor in near-linear time via the multiplicative weight update (MWU) technique. This yields, in particular, a near-linear time algorithm that outputs an estimate $B$ such that $B \le B^* \le \lceil (1+\epsilon)B \rceil +1$ where $B^*$ is the minimum-degree of a spanning tree of a given graph. To round the fractional solution, in our main technical contribution, we describe a fast near-linear time implementation of swap-rounding in the spanning tree polytope of a graph. The fractional solution can also be used to sparsify the input graph that can in turn be used to speed up existing combinatorial algorithms. Together, these ideas lead to significantly faster approximation algorithms than known before for the two problems of interest. In addition, a fast algorithm for swap rounding in the graphic matroid is a generic tool that has other applications, including to TSP and submodular function maximization.


title: Explainable AI meets Healthcare: A Study on Heart Disease Dataset

abstract: With the increasing availability of structured and unstructured data and the swift progress of analytical techniques, Artificial Intelligence (AI) is bringing a revolution to the healthcare industry. With the increasingly indispensable role of AI in healthcare, there are growing concerns over the lack of transparency and explainability in addition to potential bias encountered by predictions of the model. This is where Explainable Artificial Intelligence (XAI) comes into the picture. XAI increases the trust placed in an AI system by medical practitioners as well as AI researchers, and thus, eventually, leads to an increasingly widespread deployment of AI in healthcare. In this paper, we present different interpretability techniques. The aim is to enlighten practitioners on the understandability and interpretability of explainable AI systems using a variety of techniques available which can be very advantageous in the health-care domain. Medical diagnosis model is responsible for human life and we need to be confident enough to treat a patient as instructed by a black-box model. Our paper contains examples based on the heart disease dataset and elucidates on how the explainability techniques should be preferred to create trustworthiness while using AI systems in healthcare.


title: Task-Graph Scheduling Extensions for Efficient Synchronization and Communication

abstract: Task graphs have been studied for decades as a foundation for scheduling irregular parallel applications and incorporated in programming models such as OpenMP. While many high-performance parallel libraries are based on task graphs, they also have additional scheduling requirements, such as synchronization from inner levels of data parallelism and internal blocking communications. In this paper, we extend task-graph scheduling to support efficient synchronization and communication within tasks. Our scheduler avoids deadlock and oversubscription of worker threads, and refines victim selection to increase the overlap of sibling tasks. To the best of our knowledge, our approach is the first to combine gang-scheduling and work-stealing in a single runtime. Our approach has been evaluated on the SLATE highperformance linear algebra library. Relative to the LLVM OMP runtime, our runtime demonstrates performance improvements of up to 13.82%, 15.2%, and 36.94% for LU, QR, and Cholesky, respectively, evaluated across different configurations.


title: A multi-objective reliability-redundancy allocation problem with active redundancy and interval type-2 fuzzy parameters

abstract: This paper considers a multi-objective reliability-redundancy allocation problem (MORRAP) of a series-parallel system, where system reliability and system cost are to be optimized simultaneously subject to limits on weight, volume, and redundancy level. Precise computation of component reliability is very difficult as the estimation of a single number for the probabilities and performance levels are not always possible, because it is affected by many factors such as inaccuracy and insufficiency of data, manufacturing process, environment in which the system is running, evaluation done by multiple experts, etc. To cope with impreciseness, we model component reliabilities as interval type-2 fuzzy numbers (IT2 FNs), which is more suitable to represent uncertainties than usual or type-1 fuzzy numbers. To solve the problem with interval type-2 fuzzy parameters, we first apply various type-reduction and defuzzification techniques, and obtain corresponding defuzzified values. As maximization of system reliability and minimization of system cost are conflicting to each other, so to obtain compromise solution of the MORRAP with defuzzified parameters, we apply five different multi-objective optimization methods, and then corresponding solutions are analyzed. The problem is illustrated numerically for a real-world MORRAP on pharmaceutical plant, and solutions are obtained by standard optimization solver LINGO, which is based on gradient-based optimization - Generalized Reduced Gradient (GRG) technique.


title: Weak Limits of Fractional Sobolev Homeomorphisms are Almost Injective: A Note

abstract: Let $\Omega \subset \mathbb{R}^n$ be an open set and $f_k \in W^{s,p}(\Omega;\mathbb{R}^n)$ be a sequence of homeomorphisms weakly converging to $f \in W^{s,p}(\Omega;\mathbb{R}^n)$. It is known that if $s=1$ and $p > n-1$ then $f$ is injective almost everywhere in the domain and the target. In this note we extend such results to the case $s\in(0,1)$ and $sp > n-1$. This in particular applies to $C^s$-H\"older maps.


title: Secure Performance Analysis and Optimization for FD-NOMA Vehicular Communications

abstract: Vehicle-to-vehicle (V2V) communication appeals to increasing research interest as a result of its applications to provide safety information as well as infotainment services. The increasing demand of transmit rates and various requirements of quality of services (QoS) in vehicular communication scenarios call for the integration of V2V communication systems and potential techniques in the future wireless communications, such as full duplex (FD) and non-orthogonal multiple access (NOMA) which enhance spectral efficiency and provide massive connectivity. However, the large amount of data transmission and user connectivity give rise to the concern of security issues and personal privacy. In order to analyze the security performance of V2V communications, we introduce a cooperative NOMA V2V system model with an FD relay. This paper focuses on the security performance of the FD-NOMA based V2V system on the physical layer perspective. We first derive several analytical results of the ergodic secrecy capacity. Then, we propose a secrecy sum rate optimization scheme utilizing the instantaneous channel state information (CSI), which is formulated as a non-convex optimization problem. Based on the differential structure of the non-convex constraints, the original problem is approximated and solved by a series of convex optimization problems. Simulation results validate the analytical results and the effectiveness of the secrecy sum rate optimization algorithm.


title: A multi-objective multi-item solid transportation problem with vehicle cost, volume and weight capacity under fuzzy environment

abstract: Generally, in transportation problem, full vehicles (e.g., light commercial vehicles, medium duty and heavy duty trucks, etc.) are to be booked, and transportation cost of a vehicle has to be paid irrespective of the fulfilment of the capacity of the vehicle. Besides the transportation cost, total time that includes travel time of a vehicle, loading and unloading times of products is also an important issue. Also, instead of a single item, different types of items may need to be transported from some sources to destinations through different types of conveyances. The optimal transportation policy may be affected by many other issues like volume and weight of per unit of product, unavailability of sufficient number of certain types of vehicles, etc. In this paper, we formulate a multi-objective multi-item solid transportation problem by addressing all these issues. The problem is formulated with the transportation cost and time parameters as fuzzy variables. Using credibility theory of fuzzy variables, a chance-constraint programming model is formulated, and is then transformed into the corresponding deterministic form. Finally numerical example is provided to illustrate the problem.


title: Width effects in resonant three-body decays: $B$ decay as an example

abstract: For three-body hadron decays mediated by intermediate resonances with large widths, we show how to properly extract the quasi-two-body decay rates for a meaningful comparison with the corresponding theoretical estimates, using several $B$ decays as explicit examples. We compute the correction factor from finite width effects in the QCD factorization approach, and make a comparison with that using the experimental parameterization in which the momentum dependence in the weak dynamics is absent. Although the difference is generally less than $10\%$ for tensor and vector resonances, it can be as large as $(25-40)\%$ for scalar resonances. Our finding can in fact be applied to general quasi-two-body decays.


title: On the sensitivity of weak gravitational lensing to the cosmic expansion function

abstract: We analyse the functional derivative of the cosmic-shear power spectrum $C_\ell^\gamma$ with respect to the cosmic expansion function. Our interest in doing so is two-fold: (i) In view of attempts to detect minor changes of the cosmic expansion function which may be due to a possibly time-dependent dark-energy density, we wish to know how sensitive the weak-lensing power spectrum is to changes in the expansion function. (ii) In view of recent empirical determinations of the cosmic expansion function from distance measurements, independent of specific cosmological models, we wish to find out how uncertainties in the expansion function translate to uncertainties in the cosmic-shear power spectrum. We find the following answers: Relative changes of the expansion function are amplified by the cosmic-shear power spectrum by a factor $\approx 2-6$, weakly depending on the scale factor where the change is applied, and the current uncertainty of one example for an empirically determined expansion function translates to a relative uncertainty of the cosmic-shear power spectrum of $\approx10\,\%$.


title: Unleashing the Power of Neural Discourse Parsers -- A Context and Structure Aware Approach Using Large Scale Pretraining

abstract: RST-based discourse parsing is an important NLP task with numerous downstream applications, such as summarization, machine translation and opinion mining. In this paper, we demonstrate a simple, yet highly accurate discourse parser, incorporating recent contextual language models. Our parser establishes the new state-of-the-art (SOTA) performance for predicting structure and nuclearity on two key RST datasets, RST-DT and Instr-DT. We further demonstrate that pretraining our parser on the recently available large-scale "silver-standard" discourse treebank MEGA-DT provides even larger performance benefits, suggesting a novel and promising research direction in the field of discourse analysis.


title: Toward an Automated HPC Pipeline for Processing Large Scale Electron Microscopy Data

abstract: We present a fully modular and scalable software pipeline for processing electron microscope (EM) images of brain slices into 3D visualization of individual neurons and demonstrate an end-to-end segmentation of a large EM volume using a supercomputer. Our pipeline scales multiple packages used by the EM community with minimal changes to the original source codes. We tested each step of the pipeline individually, on a workstation, a cluster, and a supercomputer. Furthermore, we can compose workflows from these operations using a Balsam database that can be triggered during the data acquisition or with the use of different front ends and control the granularity of the pipeline execution. We describe the implementation of our pipeline and modifications required to integrate and scale up existing codes. The modular nature of our environment enables diverse research groups to contribute to the pipeline without disrupting the workflow, i.e. new individual codes can be easily integrated for each step on the pipeline.


title: Rank connectivity and pivot-minors of graphs

abstract: The cut-rank of a set $X$ in a graph $G$ is the rank of the $X\times (V(G)-X)$ submatrix of the adjacency matrix over the binary field. A split is a partition of the vertex set into two sets $(X,Y)$ such that the cut-rank of $X$ is less than $2$ and both $X$ and $Y$ have at least two vertices. A graph is prime (with respect to the split decomposition) if it is connected and has no splits. A graph $G$ is $k^{+\ell}$-rank-connected if for every set $X$ of vertices with the cut-rank less than $k$, $\lvert X\rvert$ or $\lvert V(G)-X\rvert $ is less than $k+\ell$. We prove that every prime $3^{+2}$-rank-connected graph $G$ with at least $10$ vertices has a prime $3^{+3}$-rank-connected pivot-minor $H$ such that $\lvert V(H)\rvert =\lvert V(G)\rvert -1$. As a corollary, we show that every excluded pivot-minor for the class of graphs of rank-width at most $k$ has at most $(3.5 \cdot 6^{k}-1)/5$ vertices for $k\ge 2$. We also show that the excluded pivot-minors for the class of graphs of rank-width at most $2$ have at most $16$ vertices.


title: Resource-Constrained Federated Learning with Heterogeneous Labels and Models

abstract: Various IoT applications demand resource-constrained machine learning mechanisms for different applications such as pervasive healthcare, activity monitoring, speech recognition, real-time computer vision, etc. This necessitates us to leverage information from multiple devices with few communication overheads. Federated Learning proves to be an extremely viable option for distributed and collaborative machine learning. Particularly, on-device federated learning is an active area of research, however, there are a variety of challenges in addressing statistical (non-IID data) and model heterogeneities. In addition, in this paper we explore a new challenge of interest -- to handle label heterogeneities in federated learning. To this end, we propose a framework with simple $\alpha$-weighted federated aggregation of scores which leverages overlapping information gain across labels, while saving bandwidth costs in the process. Empirical evaluation on Animals-10 dataset (with 4 labels for effective elucidation of results) indicates an average deterministic accuracy increase of at least ~16.7%. We also demonstrate the on-device capabilities of our proposed framework by experimenting with federated learning and inference across different iterations on a Raspberry Pi 2, a single-board computing platform.


title: Learning a Geometric Representation for Data-Efficient Depth Estimation via Gradient Field and Contrastive Loss

abstract: Estimating a depth map from a single RGB image has been investigated widely for localization, mapping, and 3-dimensional object detection. Recent studies on a single-view depth estimation are mostly based on deep Convolutional neural Networks (ConvNets) which require a large amount of training data paired with densely annotated labels. Depth annotation tasks are both expensive and inefficient, so it is inevitable to leverage RGB images which can be collected very easily to boost the performance of ConvNets without depth labels. However, most self-supervised learning algorithms are focused on capturing the semantic information of images to improve the performance in classification or object detection, not in depth estimation. In this paper, we show that existing self-supervised methods do not perform well on depth estimation and propose a gradient-based self-supervised learning algorithm with momentum contrastive loss to help ConvNets extract the geometric information with unlabeled images. As a result, the network can estimate the depth map accurately with a relatively small amount of annotated data. To show that our method is independent of the model structure, we evaluate our method with two different monocular depth estimation algorithms. Our method outperforms the previous state-of-the-art self-supervised learning algorithms and shows the efficiency of labeled data in triple compared to random initialization on the NYU Depth v2 dataset.


title: Federated Crowdsensing: Framework and Challenges

abstract: Crowdsensing is a promising sensing paradigm for smart city applications (e.g., traffic and environment monitoring) with the prevalence of smart mobile devices and advanced network infrastructure. Meanwhile, as tasks are performed by individuals, privacy protection is one of the key issues in crowdsensing systems. Traditionally, to alleviate users' privacy concerns, noises are added to participants' sensitive data (e.g., participants' locations) through techniques such as differential privacy. However, this inevitably results in quality loss to the crowdsensing task. Recently, federated learning paradigm has been proposed, which aims to achieve privacy preservation in machine learning while ensuring that the learning quality suffers little or no loss. Inspired by the federated learning paradigm, this article studies how federated learning may benefit crowdsensing applications. In particular, we first propose a federated crowdsensing framework, which analyzes the privacy concerns of each crowdsensing stage (i.e., task creation, task assignment, task execution, and data aggregation) and discuss how federated learning techniques may take effect. Finally, we summarize key challenges and opportunities in federated crowdsensing.


title: Mapper Interactive: A Scalable, Extendable, and Interactive Toolbox for the Visual Exploration of High-Dimensional Data

abstract: The mapper algorithm is a popular tool from topological data analysis for extracting topological summaries of high-dimensional datasets. In this paper, we present Mapper Interactive, a web-based framework for the interactive analysis and visualization of high-dimensional point cloud data. It implements the mapper algorithm in an interactive, scalable, and easily extendable way, thus supporting practical data analysis. In particular, its command-line API can compute mapper graphs for 1 million points of 256 dimensions in about 3 minutes (4 times faster than the vanilla implementation). Its visual interface allows on-the-fly computation and manipulation of the mapper graph based on user-specified parameters and supports the addition of new analysis modules with a few lines of code. Mapper Interactive makes the mapper algorithm accessible to nonspecialists and accelerates topological analytics workflows.


title: User-Centric Secure Cell Formation for Visible Light Networks with Statistical Delay Guarantees

abstract: In next-generation wireless networks, providing secure transmission and delay guarantees are two critical goals. However, either of them requires a concession on the transmission rate. In this paper, we consider a visible light network consisting of multiple access points and multiple users. Our first objective is to mathematically evaluate the achievable rate under constraints on delay and security. The second objective is to provide a cell formation with customized statistical delay and security guarantees for each user. First, we propose a user-centric design called secure cell formation, in which artificial noise is considered, and flexible user scheduling is determined. Then, based on the effective capacity theory, we derive the statistical-delay-constrained secrecy rate and formulate the cell formation problem as a stochastic optimization problem (OP). Further, based on the Lyapunov optimization theory, we transform the stochastic OP into a series of evolutionary per-slot drift-plus-penalty OPs. Finally, a modified particle swarm optimization algorithm and an interference graph-based user-centric scheduling algorithm are proposed to solve the OPs. We obtain a dynamic independent set of scheduled users as well as secure cell formation parameters. Simulation results show that the proposed algorithm can achieve a better delay-constrained secrecy rate than the existing cell formation approaches.


title: Invariant Integrals on Topological Groups

abstract: We generalize the fixed-point property for discrete groups acting on convex cones given by Monod in \cite{monod} to topological groups. At first, we focus on describing this fixed-point property from a functional point of view, and then we look at the class of groups that have it. Finally, we go through some applications of this fixed-point property. To accomplish these tasks, we introduce a new class of normed Riesz spaces that depend on group representation.


title: Optimal Online Algorithms for File-Bundle Caching and Generalization to Distributed Caching

abstract: We consider a generalization of the standard cache problem called file-bundle caching, where different queries (tasks), each containing $l\ge 1$ files, sequentially arrive. An online algorithm that does not know the sequence of queries ahead of time must adaptively decide on what files to keep in the cache to incur the minimum number of cache misses. Here a cache miss refers to the case where at least one file in a query is missing among the cache files. In the special case where $l=1$, this problem reduces to the standard cache problem. We first analyze the performance of the classic least recently used (LRU) algorithm in this setting and show that LRU is a near-optimal online deterministic algorithm for file-bundle caching with regard to competitive ratio. We then extend our results to a generalized $(h,k)$-paging problem in this file-bundle setting, where the performance of the online algorithm with a cache size $k$ is compared to an optimal offline benchmark of a smaller cache size $h<k$. In this latter case, we provide a randomized $O(l \ln \frac{k}{k-h})$-competitive algorithm for our generalized $(h,k)$-paging problem, which can be viewed as an extension of the classic marking algorithm. We complete this result by providing a matching lower bound for the competitive ratio, indicating that the performance of this modified marking algorithm is within a factor of two of any randomized online algorithm. Finally, we look at the distributed version of the file-bundle caching problem where there are $m\ge 1$ identical caches in the system. In this case we show that for $m=l+1$ caches, there is a deterministic distributed caching algorithm which is $(l^2+l)$-competitive and a randomized distributed caching algorithm which is $O(l\ln(2l+1))$-competitive when $l\ge 2$.


title: Data-Driven Predictive Control Towards Multi-Agent Motion Planning With Non-Parametric Closed-Loop Behavior Learning

abstract: In many specific scenarios, accurate and effective system identification is a commonly encountered challenge in the model predictive control (MPC) formulation. As a consequence, the overall system performance could be significantly weakened in outcome when the traditional MPC algorithm is adopted under those circumstances when such accuracy is lacking. This paper investigates a non-parametric closed-loop behavior learning method for multi-agent motion planning, which underpins a data-driven predictive control framework. Utilizing an innovative methodology with closed-loop input/output measurements of the unknown system, the behavior of the system is learned based on the collected dataset, and thus the constructed non-parametric predictive model can be used to determine the optimal control actions. This non-parametric predictive control framework alleviates the heavy computational burden commonly encountered in the optimization procedures typically in alternate methodologies requiring open-loop input/output measurement data collection and parametric system identification. The proposed data-driven approach is also shown to preserve good robustness properties. Finally, a multi-UAV system is used to demonstrate the highly effective outcome of this promising development.


title: Distributed Grid restoration based on graph theory

abstract: With the emergence of smart grids as the primary means of distribution across wide areas, the importance of improving its resilience to faults and mishaps is increasing. The reliability of a distribution system depends upon its tolerance to attacks and the efficiency of restoration after an attack occurs. This paper proposes a unique approach to the restoration of smart grids under attack by impostors or due to natural calamities via optimal islanding of the grid with primary generators and distributed generators(DGs) into sub-grids minimizing the amount of load shed which needs to be incurred and at the same time minimizing the number of switching operations via graph theory. The minimum load which needs to be shed is computed in the first stage followed by selecting the nodes whose load needs to be shed to achieve such a configuration and then finally deriving the sequence of switching operations required to achieve the configuration. The proposed method is tested against standard IEEE 37-bus and a 1069-bus grid system and the minimum load shed along with the sequencing steps to optimal configuration and time to achieve such a configuration are presented which demonstrates the effectiveness of the method when compared to the existing methods in the field. Moreover, the proposed algorithm can be easily modified to incorporate any other constraints which might arise due to any operational configuration of the grid.


title: Quantum Phase Transition in Organic Massless Dirac Fermion System $\alpha\ $-(BEDT-TTF)$_2$I$_3$ under pressure

abstract: We investigate the effect of strong electronic correlation on the massless Dirac fermion system, $\alpha$-(BEDT-TTF)$_2$I$_3$, under pressure. In this organic salt, one can control the electronic correlation by changing pressure and access the quantum critical point between the massless Dirac fermion phase and the charge ordering phase. We theoretically study the electronic structure of this system by applying the slave-rotor theory and find that the Fermi velocity decreases without creating a mass gap upon approaching the quantum critical point from the massless Dirac fermion phase. We show that the pressure-dependence of the Fermi velocity is in good quantitative agreement with the results of the experiment where the Fermi velocity is determined by the analysis of the Shubnikov-de Haas oscillations in the doped samples. Our result implies that the massless Dirac fermion system exhibits a quantum phase transition without creating a mass gap even in the presence of strong electronic correlations.


title: Task-relevant Representation Learning for Networked Robotic Perception

abstract: Today, even the most compute-and-power constrained robots can measure complex, high data-rate video and LIDAR sensory streams. Often, such robots, ranging from low-power drones to space and subterranean rovers, need to transmit high-bitrate sensory data to a remote compute server if they are uncertain or cannot scalably run complex perception or mapping tasks locally. However, today's representations for sensory data are mostly designed for human, not robotic, perception and thus often waste precious compute or wireless network resources to transmit unimportant parts of a scene that are unnecessary for a high-level robotic task. This paper presents an algorithm to learn task-relevant representations of sensory data that are co-designed with a pre-trained robotic perception model's ultimate objective. Our algorithm aggressively compresses robotic sensory data by up to 11x more than competing methods. Further, it achieves high accuracy and robust generalization on diverse tasks including Mars terrain classification with low-power deep learning accelerators, neural motion planning, and environmental timeseries classification.

categories: cs.RO cs.CV cs.IT cs.NI cs.SY eess.SY math.IT


title: Single step synthesis of size-controlled carbon quantum dots using electrochemical etching of graphite

abstract: Carbon Quantum dots (CQD's) are nanoscale sp2 hybridized carbon particles. In this work, we present a simple one-step synthesis of CQDs from the electrochemical shredding method and technique to control its size during its growth process. A graphite rod extracted from commercially available pencil batteries was used as electrode: source of carbon. CQDs of varying sizes were synthesized through controlled current to the solution for etching and Sodium dodecyl sulfate (SDS) as capping agent during growth. CQD's of controlled sizes as formed can be used as fluorescent marker for bio-imaging and sensing platform for wide range of applications.


title: Glide-Symmetric Acoustic Waveguides for Extreme Sensing and Isolation

abstract: Glide symmetry offers new degrees of freedom to engineer the properties of periodic structures, and thus it has been exploited in various electromagnetic structures. However, so far there has been little exploration on the impact that glide symmetry can offer in the field of acoustics. In this paper, we explore glide-symmetric acoustic waveguides, highlighting their dispersion characteristics and guiding properties and demonstrating opportunities in the context of acoustic devices. Here we analytically derive their dispersive features applying a semi-analytical mode matching technique. We then demonstrate how the unusual dispersion properties of glide-symmetric acoustic waveguides can be used to achieve very sharp frequency responses. Based on these results, we propose a sensing platform for liquid analytes that exhibits large sensitivity and linearity. Furthermore, by introducing fluid motion, we leverage these responses to design an acoustic isolator based on acoustic Mach-Zehnder interferometry, whose design is more favorable in terms of footprint and complexity in comparison to other acoustic nonreciprocal devices that do not rely on glide symmetry.


title: Mortality modeling and regression with matrix distributions

abstract: In this paper we investigate the flexibility of matrix distributions for the modeling of mortality. Starting from a simple Gompertz law, we show how the introduction of matrix-valued parameters via inhomogeneous phase-type distributions can lead to reasonably accurate and relatively parsimonious models for mortality curves across the entire lifespan. A particular feature of the proposed model framework is that it allows for a more direct interpretation of the implied underlying aging process than some previous approaches. Subsequently, towards applications of the approach for multi-population mortality modeling, we introduce regression via the concept of proportional intensities, which are more flexible than proportional hazard models, and we show that the two classes are asymptotically equivalent. We illustrate how the model parameters can be estimated from data by providing an adapted EM algorithm for which the likelihood increases at each iteration. The practical feasibility and competitiveness of the proposed approach, including the right-censored case, are illustrated by several sets of mortality and survival data.


title: Global Calder\'on-Zygmund inequalities on complete Riemannian manifolds

abstract: This paper is a survey of some recent results on the validity and the failure of global $W^{2,p}$ regularity properties of smooth solutions of the Poisson equation $\Delta u = f$ on a complete Riemannian manifold $(M,g)$. We review different methods developed to obtain a-priori $L^p$-Hessian estimates of the form $\| \Hess(u) \|_{L^p} \leq C_1 \| u \|_{L^p} + C_2 \| f \|_{L^p}$ under various geometric conditions on $M$ both in the case of real valued functions and for manifold valued maps. We also present explicit and somewhat implicit counterexamples showing that, in general, this integral inequality may fail to hold even in the presence of a lower sectional curvature bound. The r\^ole of a gradient estimate of the form $\| \nabla u \|_{L^{p}} \leq C_1 \| u \|_{L^p} + C_2 \| f \|_{L^p}$, and its connections with the $L^{p}$-Hessian estimate, are also discussed.


title: ARES IV: Probing the atmospheres of the two warm small planets HD 106315 c and HD 3167 c with the HST/WFC3 camera

abstract: We present an atmospheric characterization study of two medium sized planets bracketing the radius of Neptune: HD 106315 c (R$_{\rm{P}}$=4.98 $\pm$ 0.23 R$_{\oplus}$) and HD 3167 c (R$_{\rm{P}}$=2.740$_{-0.100}^{+0.106}$ R$_{\oplus}$). We analyse spatially scanned spectroscopic observations obtained with the G141 grism (1.125 - 1.650 $\mu$m) of the Wide Field Camera 3 (WFC3) onboard the Hubble Space Telescope. We use the publicly available Iraclis pipeline and TauREx3 atmospheric retrieval code and we detect water vapor in the atmosphere of both planets with an abundance of $\log_{10}[\mathrm{H_2O}]=-2.1^{+0.7}_{-1.3}$ ($\sim$5.68$\sigma$) and $\log_{10}[\mathrm{H_2O}]=-4.1^{+0.9}_{-0.9}$ ($\sim$3.17$\sigma$) for HD 106315 c and HD 3167 c, respectively. The transmission spectrum of HD 106315 c shows also a possible evidence of ammonia absorption ($\log_{10}[\mathrm {NH_3}]=-4.3^{+0.7}_{-2.0}$, $\sim$1.97$\sigma$ -even if it is not significant-), whilst carbon dioxide absorption features may be present in the atmosphere of HD 3167 c in the $\sim$1.1-1.6~$\mu$m wavelength range ($\log_{10}[\mathrm{CO_{2}}]= -2.4^{+0.7}_{-1.0}$, $\sim$3.28$\sigma$). However the CO$_2$ detection appears significant, it must be considered carefully and put into perspective. Indeed, CO$_2$ presence is not explained by 1D equilibrium chemistry models, and it could be due to possible systematics. The additional contribution of clouds, CO and CH$_4$ are discussed. HD 106315 c and HD 3167 c will be interesting targets for upcoming telescopes such as the James Webb Space Telescope (JWST) and the Atmospheric Remote-Sensing Infrared Exoplanet Large-Survey (Ariel).


title: Multi-chain slip-spring simulations with various slip-spring densities

abstract: Although it has been established that the multi-chain slip-spring (MCSS) model can reproduce entangled polymer dynamics, the effects of model parameters have not been fully elucidated yet. In this study, we systematically investigated the effects of slip-spring density. For the diffusion and the linear viscoelasticity, the simulation results exhibited universality. Namely, the results from the simulations with various slip-spring densities can be superposed with each other by the conversion factors for the bead number per chain, unit of length, unit of time, and modulus. The diffusion and the viscoelasticity were in good agreement with the literature data for the standard bead-spring simulations, including the molecular weight dependence. The universality among the MCSS simulations with various slip-spring density also held under mild shear if the slip-spring density was not significantly high. The results imply that the level of coarse-graining for the MCSS model can be arbitrarily chosen as in the Rouse model.


title: Anomalous spreading in reducible multitype branching Brownian motion

abstract: We consider a two-type reducible branching Brownian motion, defined as a particle system on the real line in which particles of two types move according to independent Brownian motion and create offspring at constant rate. Particles of type $1$ can give birth to particles of types $1$ and $2$, but particles of type $2$ only give birth to descendants of type $2$. Under some specific conditions, Biggins (2012) shows that this process exhibit an anomalous spreading behaviour: the rightmost particle at time $t$ is much further than the expected position for the rightmost particle in a branching Brownian motion consisting only of particles of type $1$ or of type $2$. This anomalous spreading also has been investigated from a reaction-diffusion equation standpoint by Holzer (2014,2016). The aim of this article is to study the asymptotic behaviour of the position of the furthest particles in the two-type reducible branching Brownian motion, obtaining in particular tight estimates for the median of the maximal displacement.


title: Testing of flag-based fault-tolerance on IBM quantum devices

abstract: It is hard to achieve a theoretical quantum advantage on NISQ devices. Besides the attempts to reduce error using error mitigation and dynamical decoupling, small quantum error correction and fault-tolerant schemes that reduce the high overhead of traditional schemes have also been proposed. According to the recent advancements in fault tolerance, it is possible to minimize the number of ancillary qubits using flags. While implementing those schemes is still impossible, it is worthwhile to bridge the gap between the NISQ era and the FTQC era. Here, we introduce a benchmarking method to test fault-tolerant quantum error correction with flags for the [[5,1,3]] code on NISQ devices. Based on results obtained using IBM's qasm simulator and its 15-qubit Melbourne processor, we show that this flagged scheme is testable on NISQ devices by checking how much the subspace of intermediate state overlaps with the expected state in the presence of noise.


title: Elasticity of randomly cross-linked networks in primitive chain network simulations

abstract: Primitive chain network simulations for randomly cross-linked slip-link networks were performed. For the percolated networks, the stress-strain relationship was compared to the theories by Ball et al. [Polymer, 22, 1010 (1981)] and Rubinstein and Panyukov [Macromolecules, 35, 6670 (2002)]. The simulation results were reasonably reproduced by both theories, given that the contributions from cross-links and slip-links were used as fitting parameters. However, these parameters were model dependent. Besides, the theories cannot describe the simulation results if the parameters were determined from the number of active links involved in the percolated networks. These results reveal that the fitting of experimental data to the theories does not provide a fraction of entanglements in the system unless the network only consists of Gaussian strands and it correctly reaches the state of free-energy minimum.


title: Molecular hydrogen in IllustrisTNG galaxies: carefully comparing signatures of environment with local CO & SFR data

abstract: We examine how the post-processed content of molecular hydrogen (H$_2$) in galaxies from the TNG100 cosmological, hydrodynamic simulation changes with environment at $z\!=\!0$, assessing central/satellite status and host halo mass. We make close comparisons with the carbon monoxide (CO) emission survey xCOLD GASS where possible, having mock-observed TNG100 galaxies to match the survey's specifications. For a representative sample of host haloes across $10^{11}\!\lesssim\!M_{\rm 200c}/{\rm M}_{\odot}\!<\!10^{14.6}$, TNG100 predicts that satellites with $m_*\!\geq\!10^9\,{\rm M}_{\odot}$ should have a median deficit in their H$_2$ fractions of $\sim$0.6 dex relative to centrals of the same stellar mass. Once observational and group-finding uncertainties are accounted for, the signature of this deficit decreases to $\sim$0.2 dex. Remarkably, we calculate a deficit in xCOLD GASS satellites' H$_2$ content relative to centrals of 0.2--0.3 dex, in line with our prediction. We further show that TNG100 and SDSS data exhibit continuous declines in the average star formation rates of galaxies at fixed stellar mass in denser environments, in quantitative agreement with each other. By tracking satellites from their moment of infall in TNG100, we directly show that atomic hydrogen (HI) is depleted at fractionally higher rates than H$_2$ on average. Supporting this picture, we find that the H$_2$/HI mass ratios of satellites are elevated relative to centrals in xCOLD GASS. We provide additional predictions for the effect of environment on H$_2$ -- both absolute and relative to HI -- that can be tested with spectral stacking in future CO surveys.


title: Estimation of High Impedance Fault Location in Electrical Transmission Lines Using Artificial Neural Networks and R-X Impedance Graph

abstract: It is very important to ensure continuity in the process from generation of electricity to transmission to cities. The most important part of the system is energy transmission lines and distance protection relays that protect these lines. The main function of the protection relays in electrical installations should be deactivated as soon as possible in the event of short circuits in the system. An accurate error location technique is required to make fast and efficient work. Distance relays are widely used as main and backup protection in transmission and distribution lines. Basically, distance protection relays determine the impedance of the line by comparing the voltage and current values. In this study, artificial neural network (ANN) has been used to accurately locate high impedance short circuit faults in 154 kV power transmission lines. The impedance diagram (R-X) of the circuit breaker, current-voltage transformer, overhead transmission line, distance protection relay and distance protection relay has been formed by using simulation program in order to make the study real. The data sets created by recording the image of the change of the impedance occurring at the time of high impedance short circuit fault. The related focal points in the images are given as input to different ANN models and predicted the short circuit faults occurring at different locations on the transmission lines with high accuracy.


title: From Dataset Recycling to Multi-Property Extraction and Beyond

abstract: This paper investigates various Transformer architectures on the WikiReading Information Extraction and Machine Reading Comprehension dataset. The proposed dual-source model outperforms the current state-of-the-art by a large margin. Next, we introduce WikiReading Recycled-a newly developed public dataset and the task of multiple property extraction. It uses the same data as WikiReading but does not inherit its predecessor's identified disadvantages. In addition, we provide a human-annotated test set with diagnostic subsets for a detailed analysis of model performance.


title: First-order phase transition to a nonmagnetic ground state in nonsymmorphic NbCrP

abstract: We report the discovery of a first-order phase transition at around 125 K in NbCrP, which is a nonsymmorphic crystal with Pnma space group. From the resistivity, magnetic susceptibility, and nuclear magnetic resonance measurements using the crystals made by the Sn-flux method, the high-temperature (HT) phase is characterized to be metallic with a non-negligible magnetic anisotropy. The low-temperature (LT) phase is also found to be a nonmagnetic metallic state with a crystal of lower symmetry. In the LT phase, the spin susceptibility is reduced by ~30 % from that in the HT phase, suggesting that the phase transition is triggered by the electronic instability. The possible origin of the phase transition in NbCrP is discussed based on the electronic structure by comparing with those in other nonsymmorphic compounds RuP and RuAs.


title: Nonequilibrium Charge-Density-Wave Order Beyond the Thermal Limit

abstract: The interaction of many-body systems with intense light pulses may lead to novel emergent phenomena far from equilibrium. Recent discoveries, such as the optical enhancement of the critical temperature in certain superconductors and the photo-stabilization of hidden phases, have turned this field into an important research frontier. Here, we demonstrate nonthermal charge-density-wave (CDW) order at electronic temperatures far greater than the thermodynamic transition temperature. Using time- and angle-resolved photoemission spectroscopy and time-resolved X-ray diffraction, we investigate the electronic and structural order parameters of an ultrafast photoinduced CDW-to-metal transition. Tracking the dynamical CDW recovery as a function of electronic temperature reveals a behaviour markedly different from equilibrium, which we attribute to the suppression of lattice fluctuations in the transient nonthermal phonon distribution. A complete description of the system's coherent and incoherent order-parameter dynamics is given by a time-dependent Ginzburg-Landau framework, providing access to the transient potential energy surfaces.