title: TBraTS: Trusted Brain Tumor Segmentation

abstract: Despite recent improvements in the accuracy of brain tumor segmentation, the results still exhibit low levels of confidence and robustness. Uncertainty estimation is one effective way to change this situation, as it provides a measure of confidence in the segmentation results. In this paper, we propose a trusted brain tumor segmentation network which can generate robust segmentation results and reliable uncertainty estimations without excessive computational burden and modification of the backbone network. In our method, uncertainty is modeled explicitly using subjective logic theory, which treats the predictions of backbone neural network as subjective opinions by parameterizing the class probabilities of the segmentation as a Dirichlet distribution. Meanwhile, the trusted segmentation framework learns the function that gathers reliable evidence from the feature leading to the final segmentation results. Overall, our unified trusted segmentation framework endows the model with reliability and robustness to out-of-distribution samples. To evaluate the effectiveness of our model in robustness and reliability, qualitative and quantitative experiments are conducted on the BraTS 2019 dataset.


title: Vehicle-to-Vehicle Charging Coordination over Information Centric Networking

abstract: Cities around the world are increasingly promoting electric vehicles (EV) to reduce and ultimately eliminate greenhouse gas emissions. For example, the city of San Francisco aims to increase the number of EVs from tens of thousands to over quarter of a million by 2025. This huge number of EVs will put unprecedented stress on the power grid. To efficiently serve the increased charging load, these EVs need to be charged in a coordinated fashion. One promising coordination strategy is vehicle-to-vehicle (V2V) charging coordination, enabling EVs to sell their surplus energy in an ad-hoc, peer to peer manner. Enabling V2V charging coordination requires new communication network protocols that can facilitate such charging coordination in a peer-to-peer fashion. This paper introduces an Information Centric Networking (ICN)-based protocol to support ad-hoc V2V charging coordination (V2V-CC). Our evaluations demonstrate that V2V-CC can provide added flexibility, fault tolerance, and reduced communication latency than a conventional centralized cloud based approach. We show that V2V-CC can achieve a 93\% reduction in protocol completion time compared to a conventional approach. We also show that V2V-CC also works well under extreme packet loss, making it ideal for V2V charging coordination.


title: Primal Estimated Subgradient Solver for SVM for Imbalanced Classification

abstract: We aim to demonstrate in experiments that our cost sensitive PEGASOS SVM achieves good performance on imbalanced data sets with a Majority to Minority Ratio ranging from 8.6:1 to 130:1 and to ascertain whether the including intercept (bias), regularization and parameters affects performance on our selection of datasets. Although many resort to SMOTE methods, we aim for a less computationally intensive method. We evaluate the performance by examining the learning curves. These curves diagnose whether we overfit or underfit or whether the random sample of data chosen during the process was not random enough or diverse enough in dependent variable class for the algorithm to generalized to unseen examples. We will also see the background of the hyperparameters versus the test and train error in validation curves. We benchmark our PEGASOS Cost-Sensitive SVM's results of Ding's LINEAR SVM DECIDL method. He obtained an ROC-AUC of .5 in one dataset. Our work will extend the work of Ding by incorporating kernels into SVM. We will use Python rather than MATLAB as python has dictionaries for storing mixed data types during multi-parameter cross-validation.


title: Evaluation of RF Fingerprinting-Aided RSS-Based Target Localization for Emergency Response

abstract: Target localization is essential for emergency dispatching situations. Maximum likelihood estimation (MLE) methods are widely used to estimate the target position based on the received signal strength measurements. However, the performance of MLE solvers is significantly affected by the initialization (i.e., initial guess of the solution or solution search space). To address this, a previous study proposed the semidefinite programming (SDP)-based MLE initialization. However, the performance of the SDP-based initialization technique is largely affected by the shadowing variance and geometric diversity between the target and receivers. In this study, a radio frequency (RF) fingerprinting-based MLE initialization is proposed. Further, a maximum likelihood problem for target localization combining RF fingerprinting is formulated. In the three test environments of open space, urban, and indoor, the proposed RF fingerprinting-aided target localization method showed a performance improvement of up to 63.31% and an average of 39.13%, compared to the MLE algorithm initialized with SDP. Furthermore, unlike the SDP-MLE method, the proposed method was not significantly affected by the poor geometry between the target and receivers in our experiments.


title: Laziness, Barren Plateau, and Noise in Machine Learning

abstract: We define \emph{laziness} to describe a large suppression of variational parameter updates for neural networks, classical or quantum. In the quantum case, the suppression is exponential in the number of qubits for randomized variational quantum circuits. We discuss the difference between laziness and \emph{barren plateau} in quantum machine learning created by quantum physicists in \cite{mcclean2018barren} for the flatness of the loss function landscape during gradient descent. We address a novel theoretical understanding of those two phenomena in light of the theory of neural tangent kernels. For noiseless quantum circuits, without the measurement noise, the loss function landscape is complicated in the overparametrized regime with a large number of trainable variational angles. Instead, around a random starting point in optimization, there are large numbers of local minima that are good enough and could minimize the mean square loss function, where we still have quantum laziness, but we do not have barren plateaus. However, the complicated landscape is not visible within a limited number of iterations, and low precision in quantum control and quantum sensing. Moreover, we look at the effect of noises during optimization by assuming intuitive noise models, and show that variational quantum algorithms are noise-resilient in the overparametrization regime. Our work precisely reformulates the quantum barren plateau statement towards a precision statement and justifies the statement in certain noise models, injects new hope toward near-term variational quantum algorithms, and provides theoretical connections toward classical machine learning. Our paper provides conceptual perspectives about quantum barren plateaus, together with discussions about the gradient descent dynamics in \cite{together}.


title: Robust Imitation Learning against Variations in Environment Dynamics

abstract: In this paper, we propose a robust imitation learning (IL) framework that improves the robustness of IL when environment dynamics are perturbed. The existing IL framework trained in a single environment can catastrophically fail with perturbations in environment dynamics because it does not capture the situation that underlying environment dynamics can be changed. Our framework effectively deals with environments with varying dynamics by imitating multiple experts in sampled environment dynamics to enhance the robustness in general variations in environment dynamics. In order to robustly imitate the multiple sample experts, we minimize the risk with respect to the Jensen-Shannon divergence between the agent's policy and each of the sample experts. Numerical results show that our algorithm significantly improves robustness against dynamics perturbations compared to conventional IL baselines.


title: Knowledge Learning with Crowdsourcing: A Brief Review and Systematic Perspective

abstract: Big data have the characteristics of enormous volume, high velocity, diversity, value-sparsity, and uncertainty, which lead the knowledge learning from them full of challenges. With the emergence of crowdsourcing, versatile information can be obtained on-demand so that the wisdom of crowds is easily involved to facilitate the knowledge learning process. During the past thirteen years, researchers in the AI community made great efforts to remove the obstacles in the field of learning from crowds. This concentrated survey paper comprehensively reviews the technical progress in crowdsourcing learning from a systematic perspective that includes three dimensions of data, models, and learning processes. In addition to reviewing existing important work, the paper places a particular emphasis on providing some promising blueprints on each dimension as well as discussing the lessons learned from our past research work, which will light up the way for new researchers and encourage them to pursue new contributions.


title: FRAPPE: $\underline{\text{F}}$ast $\underline{\text{Ra}}$nk $\underline{\text{App}}$roximation with $\underline{\text{E}}$xplainable Features for Tensors

abstract: Tensor decompositions have proven to be effective in analyzing the structure of multidimensional data. However, most of these methods require a key parameter: the number of desired components. In the case of the CANDECOMP/PARAFAC decomposition (CPD), the ideal value for the number of components is known as the canonical rank and greatly affects the quality of the decomposition results. Existing methods use heuristics or Bayesian methods to estimate this value by repeatedly calculating the CPD, making them extremely computationally expensive. In this work, we propose FRAPPE, the first method to estimate the canonical rank of a tensor without having to compute the CPD. This method is the result of two key ideas. First, it is much cheaper to generate synthetic data with known rank compared to computing the CPD. Second, we can greatly improve the generalization ability and speed of our model by generating synthetic data that matches a given input tensor in terms of size and sparsity. We can then train a specialized single-use regression model on a synthetic set of tensors engineered to match a given input tensor and use that to estimate the canonical rank of the tensor - all without computing the expensive CPD. FRAPPE is over 24 times faster than the best-performing baseline and exhibits a 10% improvement in MAPE on a synthetic dataset. It also performs as well as or better than the baselines on real-world datasets.


title: Engineering frictional characteristics of MoS2 structure by tuning thickness and morphology- An atomic, electronic structure, and exciton analysis

abstract: We performed atomic and electron dynamics analysis to study the impact of morphological and thickness changes of a MoS2 system on its tribological properties through a diamond tip. We had considered 4 cases: variable layers (1-4 layers) and number (2-8 indents), radius (12{\AA}, 16{\AA}, 20{\AA}, 24{\AA}), and pattern of indents (0{\deg}, 25{\deg}, 30{\deg}, 35{\deg}, 45{\deg}, 60{\deg}) resulting into 18 subcases. MD results showed changing the radius and number of indents were the most, and number of layers and indents' pattern were the least effective way to tune the frictional characteristics. Ground state ab-initio study demonstrated an increase in the number and radius of indents, raising the number of stretched bonds. Consequently, the volume covered by the HOMO iso-surface increases, and that of LUMO decreases. That makes higher area/volume available to lose/share electrons, resulting in stronger interlocking between layers and tip. And TD-DFT calculation proves the existence of interfacial excitons, resulting in stronger interlocking between the layer's surface and tip despite a contraction in the LUMO iso-surfaces' area/volume. We believe these interlayer excitons result in higher average Z-axis(hence frictional force) reaction forces for the indents number subcases and lower for indents radius subcases as the number and radius of indents increase.


title: Quantum sensing of rotation velocity based on Bose-Hubbard model

abstract: This work theoretically study the Bose-Hubbard model in a ring geometry in a rotating frame. We obtain an effective Hamiltonian by using unitary transformation, where the effect of the rotating reference frame is introducing additional phases to the hopping constant. Within the mean-field theory, the phase transition edge of the Bose-Hubbard model not only depends on the particle numbers and the ring radius, but also depends on the rotation velocity. Therefore, we propose a sensing method of the rotation velocity using the phase transition edge of the Bose-Hubbard model. At the exact phase transition edge where this sensing method is most sensitive, the resolution depends on the rotation velocity, the particle numbers and the ring radius, while is independent of the parameters in the Bose-Hubbard model such as the hopping constant and the on-site interaction.


title: TrafficFlowGAN: Physics-informed Flow based Generative Adversarial Network for Uncertainty Quantification

abstract: This paper proposes the TrafficFlowGAN, a physics-informed flow based generative adversarial network (GAN), for uncertainty quantification (UQ) of dynamical systems. TrafficFlowGAN adopts a normalizing flow model as the generator to explicitly estimate the data likelihood. This flow model is trained to maximize the data likelihood and to generate synthetic data that can fool a convolutional discriminator. We further regularize this training process using prior physics information, so-called physics-informed deep learning (PIDL). To the best of our knowledge, we are the first to propose an integration of flow, GAN and PIDL for the UQ problems. We take the traffic state estimation (TSE), which aims to estimate the traffic variables (e.g. traffic density and velocity) using partially observed data, as an example to demonstrate the performance of our proposed model. We conduct numerical experiments where the proposed model is applied to learn the solutions of stochastic differential equations. The results demonstrate the robustness and accuracy of the proposed model, together with the ability to learn a machine learning surrogate model. We also test it on a real-world dataset, the Next Generation SIMulation (NGSIM), to show that the proposed TrafficFlowGAN can outperform the baselines, including the pure flow model, the physics-informed flow model, and the flow based GAN model.


title: An unfiltered low-regularity integrator for the KdV equation with solutions below ${\bf H^1}$

abstract: This article is concerned with the construction and analysis of new time discretizations for the KdV equation on a torus for low-regularity solutions below $H^1$. New harmonic analysis tools, including new averaging approximations to the exponential phase functions, new frequency decomposition techniques, and new trilinear estimates of the KdV operator, are established for the construction and analysis of time discretizations with higher convergence orders under low-regularity conditions. In addition, new techniques are introduced to establish stability estimates of time discretizations under low-regularity conditions without using filters when the energy techniques fail. The proposed method is proved to be convergent with order $\gamma$ (up to a logarithmic factor) in $L^2$ under the regularity condition $u\in C([0,T];H^\gamma)$ for $\gamma\in(0,1]$.


title: Characterizing and Mitigating the Difficulty in Training Physics-informed Artificial Neural Networks under Pointwise Constraints

abstract: Neural networks can be used to learn the solution of partial differential equations (PDEs) on arbitrary domains without requiring a computational mesh. Common approaches integrate differential operators in training neural networks using a structured loss function. The most common training algorithm for neural networks is backpropagation which relies on the gradient of the loss function with respect to the parameters of the network. In this work, we characterize the difficulty of training neural networks on physics by investigating the impact of differential operators in corrupting the back propagated gradients. Particularly, we show that perturbations present in the output of a neural network model during early stages of training lead to higher levels of noise in a structured loss function that is composed of high-order differential operators. These perturbations consequently corrupt the back-propagated gradients and impede convergence. We mitigate this issue by introducing auxiliary flux parameters to obtain a system of first-order differential equations. We formulate a non-linear unconstrained optimization problem using the augmented Lagrangian method that properly constrains the boundary conditions and adaptively focus on regions of higher gradients that are difficult to learn. We apply our approach to learn the solution of various benchmark PDE problems and demonstrate orders of magnitude improvement over existing approaches.


title: Anti-classification results for smooth dynamical systems. Preliminary Report

abstract: The paper considers the equivalence relation of conjugacy-by-homeomorphism on diffeomorphisms of smooth manifolds. In dimension 2 and above it is shown that there is no Borel method of attaching complete numerical invariants. In dimension 5 and above it is shown that the equivalence relation is not Borel, and in fact is complete analytic.


title: Complex Monge-Amp\`ere equations for plurifinely plurisubharmonic functions

abstract: This paper studies the complex Monge-Amp\`ere equations for $\mathcal F$-plurisubharmonic functions in bounded $\mathcal F$-hyperconvex domains. We give sufficient conditions for this equation to solve for measures with a singular part.


title: Choi matrices revisited

abstract: A linear map between matrix algebras corresponds to the Choi matrix in the tensor product of two matrix algebras, whose definition depends on the matrix units. Paulsen and Shultz [J. Math. Phys. {\bf 54} (2013), 072201] considered the question if one can replace matrix units by another basis of matrix algebras in the definition of Choi matrix to retain the correspondence between complete positivity of maps and positivity of Choi matrices, and gave a sufficient condition on basis under which this is true. In this note, we provide necessary and sufficient conditions, to see that the Paulsen--Shultz condition is also necessary.


title: EATFormer: Improving Vision Transformer Inspired by Evolutionary Algorithm

abstract: Motivated by biological evolution, this paper explains the rationality of Vision Transformer by analogy with the proven practical Evolutionary Algorithm (EA) and derives that both have consistent mathematical formulation. Then inspired by effective EA variants, we propose a novel pyramid EATFormer backbone that only contains the proposed \emph{EA-based Transformer} (EAT) block, which consists of three residual parts, i.e., \emph{Multi-Scale Region Aggregation} (MSRA), \emph{Global and Local Interaction} (GLI), and \emph{Feed-Forward Network} (FFN) modules, to model multi-scale, interactive, and individual information separately. Moreover, we design a \emph{Task-Related Head} (TRH) docked with transformer backbone to complete final information fusion more flexibly and \emph{improve} a \emph{Modulated Deformable MSA} (MD-MSA) to dynamically model irregular locations. Massive quantitative and quantitative experiments on image classification, downstream tasks, and explanatory experiments demonstrate the effectiveness and superiority of our approach over State-Of-The-Art (SOTA) methods. \Eg, our Mobile (1.8M), Tiny (6.1M), Small (24.3M), and Base (49.0M) models achieve 69.4, 78.4, 83.1, and 83.9 Top-1 only trained on ImageNet-1K with naive training recipe; EATFormer-Tiny/Small/Base armed Mask-R-CNN obtain 45.4/47.4/49.0 box AP and 41.4/42.9/44.2 mask AP on COCO detection, surpassing contemporary MPViT-T, Swin-T, and Swin-S by 0.6/1.4/0.5 box AP and 0.4/1.3/0.9 mask AP separately with less FLOPs; Our EATFormer-Small/Base achieve 47.3/49.3 mIoU on ADE20K by Upernet that exceeds Swin-T/S by 2.8/1.7. Code is available at \url{https://github.com/zhangzjn/EATFormer}.


title: Toward Robust Manufacturing Scheduling: Stochastic Job-Shop Scheduling

abstract: Manufacturing plays a significant role in economic development, production, exports, and job creation, which ultimately contribute to improving the quality of life. The presence of manufacturing defects is, however, inevitable leading to products being discarded, i.e. scrapped. In some cases, defective products can be repaired through rework. Scrap and rework cause a longer completion time, which can contribute to orders being shipped late. Moreover, the presence of uncertainties and combinatorial complexity significantly increases the difficulty of complex manufacturing scheduling. This paper tackles this challenge, exemplified by a case study on stochastic job-shop scheduling in low-volume, high-variety manufacturing contexts. To ensure on-time delivery, high-quality solutions are required, and near-optimal solutions must be obtained within strict time constraints to ensure smooth operations on the job-shop floor. To efficiently solve the stochastic job-shop scheduling (JSS) problem, a recently-developed Surrogate "Level-Based" Lagrangian Relaxation is used to reduce computational effort while efficiently exploiting the geometric convergence potential inherent to Polyak's stepsizing formula thereby leading to fast convergence. Numerical testing demonstrates that the new method is two orders of magnitude faster as compared to commercial solvers.


title: Entangled vacuum state for accelerated observers

abstract: Entanglement of Dirac fields has been studied and it is known to decrease with increasing acceleration when a quantum state is shared between users in non-inertial frames. A new form of an entangled vacuum state observed by the accelerated observer is postulated in which it is assumed that entanglement is present between the modes of the quantum field with sharp and opposite momenta defined in two causally disconnected regions of space-time. We find that this assumption does not affect the entanglement of the system.


title: A Survey on Model-based Reinforcement Learning

abstract: Reinforcement learning (RL) solves sequential decision-making problems via a trial-and-error process interacting with the environment. While RL achieves outstanding success in playing complex video games that allow huge trial-and-error, making errors is always undesired in the real world. To improve the sample efficiency and thus reduce the errors, model-based reinforcement learning (MBRL) is believed to be a promising direction, which builds environment models in which the trial-and-errors can take place without real costs. In this survey, we take a review of MBRL with a focus on the recent progress in deep RL. For non-tabular environments, there is always a generalization error between the learned environment model and the real environment. As such, it is of great importance to analyze the discrepancy between policy training in the environment model and that in the real environment, which in turn guides the algorithm design for better model learning, model usage, and policy training. Besides, we also discuss the recent advances of model-based techniques in other forms of RL, including offline RL, goal-conditioned RL, multi-agent RL, and meta-RL. Moreover, we discuss the applicability and advantages of MBRL in real-world tasks. Finally, we end this survey by discussing the promising prospects for the future development of MBRL. We think that MBRL has great potential and advantages in real-world applications that were overlooked, and we hope this survey could attract more research on MBRL.


title: La conjecture du $K(\pi,1)$ pour les groupes d'Artin affines (d'apr\`es Paolini et Salvetti)

abstract: Consider an affine Coxeter group $W$ acting by isometries on the Euclidean space $\mathbb{R}^n$, and the arrangement of its reflection hyperplanes. The fundamental group of the complement $Y_W$ of the complexification of this arrangement in $\mathbb{C}^n$ mod out by $W$ is the affine Artin group $G_W$ associated with $W$. The $K(\pi,1)$ conjecture states that $Y_W$ is a classifying space for $G_W$. It has been recently proved by Paolini and Salvetti building on the works of McCammond and Sulway. We will present some ingredients of the proof that rests on the study of dual Garside structures for affine Artin groups, the factorisations of Euclidean isometries, and the shellability of noncrossing partitions. One consequence is that affine Artin groups, as well as braided crystallographic groups, have a finite classifying space.


title: Multi-period Optimal Control for Mobile Agents Considering State Unpredictability

abstract: The optimal control for mobile agents is an important and challenging issue. Recent work shows that using randomized mechanism in agents' control can make the state unpredictable, and thus improve the security of agents. However, the unpredictable design is only considered in single period, which can lead to intolerable control performance in long time horizon. This paper aims at the trade-off between the control performance and state unpredictability of mobile agents in long time horizon. Utilizing random perturbations consistent with uniform distributions to maximize the attackers' prediction errors of future states, we formulate the problem as a multi-period convex stochastic optimization problem and solve it through dynamic programming. Specifically, we design the optimal control strategy considering both unconstrained and input constrained systems. The analytical iterative expressions of the control are further provided. Simulation illustrates that the algorithm increases the prediction errors under Kalman filter while achieving the control performance requirements successfully.


title: Homogenization for operators with arbitrary perturbations in coefficients

abstract: We consider a general second order matrix operator in a multi-dimensional domain subject to a classical boundary condition. This operator is perturbed by a first order differential operator, the coefficients of which depend arbitrarily on a small multi-dimensional parameter. We study the existence of a limiting (homogenized) operator in the sense of the norm resolvent convergence for such perturbed operator. The first part of our main results states that the norm resolvent convergence is equivalent to the convergence of the coefficients in the perturbing operator in certain space of multipliers. If this is the case, the resolvent of the perturbed operator possesses a complete asymptotic expansion, which converges uniformly to the resolvent. The second part of our results says that the convergence in the mentioned spaces of multipliers is equivalent to the convergence of certain local mean values over small pieces of the considered domains. These results are supported by series of examples. We also provide a series of ways of generating new non-periodically oscillating perturbations, which finally leads to a very wide class of perturbations, for which our results are applicable.


title: Multilinear pseudo-differential operators with $S_{0,0}$ class symbols of limited smoothness

abstract: We consider the boundedness of the multilinear pseudo-differential operators with symbols in the multilinear H\"{o}rmander class $S_{0,0}$. The aim of this paper is to discuss smoothness conditions for symbols to assure the boundedness between local Hardy spaces.


title: LogGENE: A smooth alternative to check loss for Deep Healthcare Inference Tasks

abstract: Mining large datasets and obtaining calibrated predictions from tem is of immediate relevance and utility in reliable deep learning. In our work, we develop methods for Deep neural networks based inferences in such datasets like the Gene Expression. However, unlike typical Deep learning methods, our inferential technique, while achieving state-of-the-art performance in terms of accuracy, can also provide explanations, and report uncertainty estimates. We adopt the Quantile Regression framework to predict full conditional quantiles for a given set of housekeeping gene expressions. Conditional quantiles, in addition to being useful in providing rich interpretations of the predictions, are also robust to measurement noise. Our technique is particularly consequential in High-throughput Genomics, an area which is ushering a new era in personalized health care, and targeted drug design and delivery. However, check loss, used in quantile regression to drive the estimation process is not differentiable. We propose log-cosh as a smooth-alternative to the check loss. We apply our methods on GEO microarray dataset. We also extend the method to binary classification setting. Furthermore, we investigate other consequences of the smoothness of the loss in faster convergence. We further apply the classification framework to other healthcare inference tasks such as heart disease, breast cancer, diabetes etc. As a test of generalization ability of our framework, other non-healthcare related data sets for regression and classification tasks are also evaluated.


title: Maximal 3-wise Intersecting Families with Minimum Size: the Odd Case

abstract: A family $\mathcal{F}$ on ground set $\{1,2,\ldots, n\}$ is maximal $k$-wise intersecting if every collection of $k$ sets in $\mathcal{F}$ has non-empty intersection, and no other set can be added to $\mathcal{F}$ while maintaining this property. Erd\H{o}s and Kleitman asked for the minimum size of a maximal $k$-wise intersecting family. Complementing earlier work of Hendrey, Lund, Tompkins and Tran, who answered this question for $k=3$ and large even $n$, we answer it for $k=3$ and large odd $n$. We show that the unique minimum family is obtained by partitioning the ground set into two sets $A$ and $B$ with almost equal sizes and taking the family consisting of all the proper supersets of $A$ and of $B$. A key ingredient of our proof is the stability result by Ellis and Sudakov about the so-called $2$-generator set systems.


title: Decomposing 4-manifolds with positive scalar curvature

abstract: We show that every closed, oriented, topologically PSC 4-manifold can be obtained via 0 and 1-surgeries from a topologically PSC 4-orbifold with vanishing first Betti number and second Betti number at most as large as the original one.


title: Efficient Checking of Timed Order Compliance Rules over Graph-encoded Event Logs

abstract: Validation of compliance rules against process data is a fundamental functionality for business process management. Over the years, the problem has been addressed for different types of process data, i.e., process models, process event data at runtime, and event logs representing historical execution. Several approaches have been proposed to tackle compliance checking over process logs. These approaches have been based on different data models and storage technologies including relational databases, graph databases, and proprietary formats. Graph-based encoding of event logs is a promising direction that turns several process analytics tasks into queries on the underlying graph. Compliance checking is one class of such analysis tasks. In this paper, we argue that encoding log data as graphs alone is not enough to guarantee efficient processing of queries on this data. Efficiency is important due to the interactive nature of compliance checking. Thus, compliance checking would benefit from sub-linear scanning of the data. Moreover, as more data are added, e.g., new batches of logs arrive, the data size should grow sub-linearly to optimize both the space of storage and time for querying. We propose two encoding methods using graph representation, realized in Neo4J, and show the benefits of these encoding on a special class of queries, namely timed order compliance rules. Compared to a baseline encoding, our experiments show up to 5x speed up in the querying time as well as a 3x reduction in the graph size.


title: Learning Multiscale Transformer Models for Sequence Generation

abstract: Multiscale feature hierarchies have been witnessed the success in the computer vision area. This further motivates researchers to design multiscale Transformer for natural language processing, mostly based on the self-attention mechanism. For example, restricting the receptive field across heads or extracting local fine-grained features via convolutions. However, most of existing works directly modeled local features but ignored the word-boundary information. This results in redundant and ambiguous attention distributions, which lacks of interpretability. In this work, we define those scales in different linguistic units, including sub-words, words and phrases. We built a multiscale Transformer model by establishing relationships among scales based on word-boundary information and phrase-level prior knowledge. The proposed \textbf{U}niversal \textbf{M}ulti\textbf{S}cale \textbf{T}ransformer, namely \textsc{Umst}, was evaluated on two sequence generation tasks. Notably, it yielded consistent performance gains over the strong baseline on several test sets without sacrificing the efficiency.


title: Rank-$1$ matrix differential equations for structured eigenvalue optimization

abstract: A new approach to solving eigenvalue optimization problems for large structured matrices is proposed and studied. The class of optimization problems considered is related to computing structured pseudospectra and their extremal points, and to structured matrix nearness problems such as computing the structured distance to instability or to singularity. The structure can be a general linear structure and includes, for example, large matrices with a given sparsity pattern, matrices with given range and co-range, and Hamiltonian matrices. Remarkably, the eigenvalue optimization can be performed on the manifold of complex (or real) rank-1 matrices, which yields a significant reduction of storage and in some cases of the computational cost. The method relies on a constrained gradient system and the projection of the gradient onto the tangent space of the manifold of complex rank-$1$ matrices. It is shown that near a local minimizer this projection is very close to the identity map, and so the computationally favorable rank-1 projected system behaves locally like the %computationally expensive gradient system.


title: Channel Estimation for Delay Alignment Modulation

abstract: Delay alignment modulation (DAM) is a promising technology for inter-symbol interference (ISI)-free communication without relying on sophisticated channel equalization or multi-carrier transmissions. The key ideas of DAM are delay precompensation and path-based beamforming, so that the multi-path signal components will arrive at the receiver simultaneously and constructively, rather than causing the detrimental ISI. However, the practical implementation of DAM requires channel state information (CSI) at the transmitter side. Therefore, in this letter, we study an efficient channel estimation method for DAM based on block orthogonal matching pursuit (BOMP) algorithm, by exploiting the block sparsity of the channel vector. Based on the imperfectly estimated CSI, the delay pre-compensations and tap-based beamforming are designed for DAM, and the resulting performance is studied. Simulation results demonstrate that with the BOMP-based channel estimation method, the CSI can be effectively acquired with low training overhead, and the performance of DAM based on estimated CSI is comparable to the ideal case with perfect CSI.


title: A Note on Comparator-Overdrive-Delay Conditioning for Current-Mode Control

abstract: Comparator-overdrive-delay conditioning is a new control conditioning approach for high-frequency current-mode control. No existing literature rigorously studies the effect of the comparator overdrive delay on the current-mode control. The results in this paper provide insights into the mechanism of comparator-overdrive-delay conditioning.


title: Bayesian Optimization under Stochastic Delayed Feedback

abstract: Bayesian optimization (BO) is a widely-used sequential method for zeroth-order optimization of complex and expensive-to-compute black-box functions. The existing BO methods assume that the function evaluation (feedback) is available to the learner immediately or after a fixed delay. Such assumptions may not be practical in many real-life problems like online recommendations, clinical trials, and hyperparameter tuning where feedback is available after a random delay. To benefit from the experimental parallelization in these problems, the learner needs to start new function evaluations without waiting for delayed feedback. In this paper, we consider the BO under stochastic delayed feedback problem. We propose algorithms with sub-linear regret guarantees that efficiently address the dilemma of selecting new function queries while waiting for randomly delayed feedback. Building on our results, we also make novel contributions to batch BO and contextual Gaussian process bandits. Experiments on synthetic and real-life datasets verify the performance of our algorithms.


title: Asymptotic analysis for hydrodynamic force acting on stiff particles

abstract: A three-dimensional mathematical model of a viscous incompressible fluid with two stiff particles is investigated in the near-contact regime. When one of the particles approaches the other motionless particle with prescribed translational and angular velocities, there always appears blow-up of hydrodynamic force exerted on the moving particle. In this paper, we construct explicit singular functions corresponding to the fluid velocity and pressure to establish precise asymptotic formulas for hydrodynamic force with respect to small interparticle distance, which show that its largest singularity is determined by squeeze motion between two particles. Finally, the primal-dual variational principle is employed to give a complete justification for these asymptotics.


title: Analysis of curvature approximations via covariant curl and incompatibility for Regge metrics

abstract: The metric tensor of a Riemannian manifold can be approximated using Regge finite elements and such approximations can be used to compute approximations to the Gauss curvature and the Levi-Civita connection of the manifold. It is shown that certain Regge approximations yield curvature and connection approximations that converge at a higher rate than previously known. The analysis is based on covariant (distributional) curl and incompatibility operators which can be applied to piecewise smooth matrix fields whose tangential-tangential component is continuous across element interfaces. Using the properties of the canonical interpolant of the Regge space, we obtain superconvergence of approximations of these covariant operators. Numerical experiments further illustrate the results from the error analysis.


title: Global well-posedness for 2D non-resistive compressible MHD system in periodic domain

abstract: This paper focuses on the 2D compressible magnetohydrodynamic (MHD) equations without magnetic diffusion in a periodic domain. We present a systematic approach to establishing the global existence of smooth solutions when the initial data is close to a background magnetic field. In addition, stability and large-time decay rates are also obtained. When there is no magnetic diffusion, the magnetic field and the density are governed by forced transport equations and the problem considered here is difficult. This paper implements several key observations and ideas to maximize the enhanced dissipation due to hidden structures and interactions. In particular, the weak smoothing and stabilization generated by the background magnetic field and the extra regularization in the divergence part of the velocity field are fully exploited. Compared with the previous works, this paper appears to be the first to investigate such system on bounded domains and the first to solve this problem by pure energy estimates, which help reduce the complexity in other approaches. In addition, this paper combines the well-posedness with the precise large-time behavior, a strategy that can be extended to higher dimensions.


title: Finding Diverse and Predictable Subgraphs for Graph Domain Generalization

abstract: This paper focuses on out-of-distribution generalization on graphs where performance drops due to the unseen distribution shift. Previous graph domain generalization works always resort to learning an invariant predictor among different source domains. However, they assume sufficient source domains are available during training, posing huge challenges for realistic applications. By contrast, we propose a new graph domain generalization framework, dubbed as DPS, by constructing multiple populations from the source domains. Specifically, DPS aims to discover multiple \textbf{D}iverse and \textbf{P}redictable \textbf{S}ubgraphs with a set of generators, namely, subgraphs are different from each other but all the them share the same semantics with the input graph. These generated source domains are exploited to learn an \textit{equi-predictive} graph neural network (GNN) across domains, which is expected to generalize well to unseen target domains. Generally, DPS is model-agnostic that can be incorporated with various GNN backbones. Extensive experiments on both node-level and graph-level benchmarks shows that the proposed DPS achieves impressive performance for various graph domain generalization tasks.


title: Fairness-aware Model-agnostic Positive and Unlabeled Learning

abstract: With the increasing application of machine learning in high-stake decision-making problems, potential algorithmic bias towards people from certain social groups poses negative impacts on individuals and our society at large. In the real-world scenario, many such problems involve positive and unlabeled data such as medical diagnosis, criminal risk assessment and recommender systems. For instance, in medical diagnosis, only the diagnosed diseases will be recorded (positive) while others will not (unlabeled). Despite the large amount of existing work on fairness-aware machine learning in the (semi-)supervised and unsupervised settings, the fairness issue is largely under-explored in the aforementioned Positive and Unlabeled Learning (PUL) context, where it is usually more severe. In this paper, to alleviate this tension, we propose a fairness-aware PUL method named FairPUL. In particular, for binary classification over individuals from two populations, we aim to achieve similar true positive rates and false positive rates in both populations as our fairness metric. Based on the analysis of the optimal fair classifier for PUL, we design a model-agnostic post-processing framework, leveraging both the positive examples and unlabeled ones. Our framework is proven to be statistically consistent in terms of both the classification error and the fairness metric. Experiments on the synthetic and real-world data sets demonstrate that our framework outperforms state-of-the-art in both PUL and fair classification.


title: Enhancement of spin mixing conductance by $s$-$d$ orbital hybridization in heavy metals

abstract: In a magnetic multilayer, the spin transfer between localized magnetization dynamics and itinerant conduction spin arises from the interaction between a normal metal and an adjacent ferromagnetic layer. The spin-mixing conductance then governs the spin-transfer torques and spin pumping at the magnetic interface. Theoretical description of spin-mixing conductance at the magnetic interface often employs a single conduction-band model. However, there is orbital hybridization between conduction $s$ electron and localized $d$ electron of the heavy transition metal, in which the single conduction-band model is insufficient to describe the $s$-$d$ orbital hybridization. In this work, using the generalized Anderson model, we estimate the spin-mixing conductance that arises from the $s$-$d$ orbital hybridization. We find that the orbital hybridization increases the magnitude of the spin-mixing conductance.


title: Nested bandits

abstract: In many online decision processes, the optimizing agent is called to choose between large numbers of alternatives with many inherent similarities; in turn, these similarities imply closely correlated losses that may confound standard discrete choice models and bandit algorithms. We study this question in the context of nested bandits, a class of adversarial multi-armed bandit problems where the learner seeks to minimize their regret in the presence of a large number of distinct alternatives with a hierarchy of embedded (non-combinatorial) similarities. In this setting, optimal algorithms based on the exponential weights blueprint (like Hedge, EXP3, and their variants) may incur significant regret because they tend to spend excessive amounts of time exploring irrelevant alternatives with similar, suboptimal costs. To account for this, we propose a nested exponential weights (NEW) algorithm that performs a layered exploration of the learner's set of alternatives based on a nested, step-by-step selection method. In so doing, we obtain a series of tight bounds for the learner's regret showing that online learning problems with a high degree of similarity between alternatives can be resolved efficiently, without a red bus / blue bus paradox occurring.


title: Quantifying Uncertainty In Traffic State Estimation Using Generative Adversarial Networks

abstract: This paper aims to quantify uncertainty in traffic state estimation (TSE) using the generative adversarial network based physics-informed deep learning (PIDL). The uncertainty of the focus arises from fundamental diagrams, in other words, the mapping from traffic density to velocity. To quantify uncertainty for the TSE problem is to characterize the robustness of predicted traffic states. Since its inception, generative adversarial networks (GAN) have become a popular probabilistic machine learning framework. In this paper, we will inform the GAN based predictions using stochastic traffic flow models and develop a GAN based PIDL framework for TSE, named ``PhysGAN-TSE". By conducting experiments on a real-world dataset, the Next Generation SIMulation (NGSIM) dataset, this method is shown to be more robust for uncertainty quantification than the pure GAN model or pure traffic flow models. Two physics models, the Lighthill-Whitham-Richards (LWR) and the Aw-Rascle-Zhang (ARZ) models, are compared as the physics components for the PhysGAN, and results show that the ARZ-based PhysGAN achieves a better performance than the LWR-based one.


title: Extracting Hale Cycle Related Components from Cosmic-Ray Data Using Principal Component Analysis

abstract: We decompose the monthly cosmic-ray data, using several neutron monitor count rates, of Cycles 19-24 with principal component analysis (PCA). We show using different cycle limits that the first and second PC of cosmic-ray (CR) data explain 77-79% and 13-15% of the total variation of the Oulu CR Cycles 20-24 (C20- C24), 73-77% and 13-17% of the variation of Hermanus C20-C24, and 74-78% and 17-21% of the Climax C19-C22, respectively. The PC1 time series of the CR Cycles 19-24 has only one peak in its power spectrum at the period 10.95 years, which is the average solar cycle period for the interval SC19-SC24. The PC2 time series of the same cycles has a clear peak at period 21.90 (Hale cycle) and another peak at 1/3 of that period with no peak at the solar cycle period. We show that the PC2 of the CR is essential in explaining the differences in the intensities of the even and odd cycles of the CR. The odd cycles have positive phase in the first half and negative phase in the second half of their PC2. This leads to slow decrease of the intensity in the beginning of the cycle and at minimum for the odd cycles. On the contrary, for the even cycles the phases are vice versa and this leads to faster decrease and more rapid recovery in the CR intensity of the cycle. As a consequence the even cycles have more peak-like structure. The only exceptions of this rule are Cycles 23 and 24 such the former has almost zero line PC2, and the latter has similar PC2 than the earlier odd cycles. These results are confirmed with skewness-kurtosis (S-K) analysis. Furthermore, S-K shows that other even and odd cycles, except Cycle 21, are on the regression line with correlation coefficient 0.85. The Cycles 21 of all calculated eight stations are compactly located in the S -K coordinate system and have smaller skewnesses and higher kurtoses than the odd Cycles 23.


title: Spatial and Temporal Distribution of Solar Green Line Corona for Solar Cycles 18-24

abstract: Homogeneous coronal data set (HCDS) of the green corona (Fe XIV) and coronal index of the solar activity (CI) have been used to study time-latitudinal distribution in solar cycles 18-24 and compared with similar distribution of sunspots, the magnetic fields and the solar radio flux 10.7 cm. The most important results are: (a) distribution of coronal intensities related to the cycle maximum are different for individual cycles, (b) the poleward migration of the HCDS from mid latitudes in each cycle exists, even in extremely weak Cycle 24, and the same is valid for the equatorward migration (c) the overall values of HCDS are slightly stronger for the northern hemisphere than for the southern one, (d) distribution of the HDCS are in coincidence with strongest photospheric magnetic fields (B>50 Gauss) and histogram of the sunspot groups, (e) Gnevyshev gap was confirmed with at least 95% confidence in the CI, however, with different behavior for odd and even cycles. Principal component analysis (PCA) showed that the first and second component account for 87.7% and 7.3% of the total variation of the CI. Furthermore, the PC2 of the green corona was quite different for cycle 21, compared with other cycles.


title: A universal black-box optimization method with almost dimension-free convergence rate guarantees

abstract: Universal methods for optimization are designed to achieve theoretically optimal convergence rates without any prior knowledge of the problem's regularity parameters or the accurarcy of the gradient oracle employed by the optimizer. In this regard, existing state-of-the-art algorithms achieve an $\mathcal{O}(1/T^2)$ value convergence rate in Lipschitz smooth problems with a perfect gradient oracle, and an $\mathcal{O}(1/\sqrt{T})$ convergence rate when the underlying problem is non-smooth and/or the gradient oracle is stochastic. On the downside, these methods do not take into account the problem's dimensionality, and this can have a catastrophic impact on the achieved convergence rate, in both theory and practice. Our paper aims to bridge this gap by providing a scalable universal gradient method - dubbed UnderGrad - whose oracle complexity is almost dimension-free in problems with a favorable geometry (like the simplex, linearly constrained semidefinite programs and combinatorial bandits), while retaining the order-optimal dependence on $T$ described above. These "best-of-both-worlds" results are achieved via a primal-dual update scheme inspired by the dual exploration method for variational inequalities.


title: Improving Robotic Grasping Ability Through Deep Shape Generation

abstract: Data-driven approaches have become a dominant paradigm for robotic grasp planning. However, the performance of these approaches is enormously influenced by the quality of the available training data. In this paper, we propose a framework to generate object shapes to improve the grasping dataset quality, thus enhancing the grasping ability of a pre-designed learning-based grasp planning network. In this framework, the object shapes are embedded into a low-dimensional feature space using an AutoEncoder (encoder-decoder) based structure network. The rarity and graspness scores are defined for each object shape using outlier detection and grasp-quality criteria. Subsequently, new object shapes are generated in feature space that leverages the original high rarity and graspness score objects' features, which can be employed to augment the grasping dataset. Finally, the results obtained from the simulation and real-world experiments demonstrate that the grasping ability of the learning-based grasp planning network can be effectively improved with the generated object shapes.


title: Realization of one-dimensional electronic flat bands in an untwisted moire superlattice

abstract: Two-dimensional electronic flat bands and their induced correlated electronic interactions have been discovered, probed, and tuned in interlayer regions of hexagonally shaped van der Waals moire superlattices. Fabrication of anisotropic one-dimensional correlated bands by moire interference of 2D, however, remains a challenge. Here, we report an experimental discovery of 1D electronic flat bands near the Fermi level in an anisotropic rectangular moire superlattice composed of in situ grown, vdW stacked two-atomic-layer thick Bi(110) well-aligned on a SnSe(001) substrate. The epitaxial lattice mismatch between the aligned Bi and SnSe zigzag atomic chains causes strong three-dimensional anisotropic atomic relaxations with associated one-dimensional out-of- and in-plane strain distributions that are expressed in electronic bands of the Bi(110) layer, which are characterized jointly by scanning probe microscopy and density functional theory. At the regions of the strongest out-of-plane shear strain, a series of 1D flat bands near the Fermi level are experimentally observed and defined in our calculations. We establish that 1D flat bands can arise in moir\'e superlattices in absence of the relative layer twist, but solely through the lattice strain. We generalize the strategy of utilizing strain in lattice mismatched rectangular hetero-bilayers for engineering correlated anisotropic electronic bands.


title: A Unified Understanding of Deep NLP Models for Text Classification

abstract: The rapid development of deep natural language processing (NLP) models for text classification has led to an urgent need for a unified understanding of these models proposed individually. Existing methods cannot meet the need for understanding different models in one framework due to the lack of a unified measure for explaining both low-level (e.g., words) and high-level (e.g., phrases) features. We have developed a visual analysis tool, DeepNLPVis, to enable a unified understanding of NLP models for text classification. The key idea is a mutual information-based measure, which provides quantitative explanations on how each layer of a model maintains the information of input words in a sample. We model the intra- and inter-word information at each layer measuring the importance of a word to the final prediction as well as the relationships between words, such as the formation of phrases. A multi-level visualization, which consists of a corpus-level, a sample-level, and a word-level visualization, supports the analysis from the overall training set to individual samples. Two case studies on classification tasks and comparison between models demonstrate that DeepNLPVis can help users effectively identify potential problems caused by samples and model architectures and then make informed improvements.


title: Sparse Random Block Matrices : universality

abstract: We study ensembles of sparse random block matrices generated from the adjacency matrix of a Erd\"os-Renyi random graph with $N$ vertices of average degree $Z$, inserting a real symmetric $d \times d$ random block at each non-vanishing entry. We consider some ensembles of random block matrices with rank $r < d$ and with maximal rank, $r=d$. The spectral moments of the sparse random block matrix are evaluated for $N \to \infty$, $d$ finite or infinite, and several probability distributions for the blocks (e.g. fixed trace, bounded trace and Gaussian). Because of the concentration of the probability measure in the $d \to \infty$ limit, the spectral moments are independent of the probability measure of the blocks (with mild assumptions of isotropy, smoothness and sub-gaussian tails). The Effective Medium Approximation is the limiting spectral density of the sparse random block ensembles with finite rank. Analogous classes of universality hold for the Laplacian sparse block ensemble. The same limiting distributions are obtained using random regular graphs instead of Erd\"os-Renyi graphs.

categories: math-ph cond-mat.dis-nn cond-mat.stat-mech math.MP math.PR


title: Automatic Map Generation for Autonomous Driving System Testing

abstract: High-definition (HD) maps are essential in testing autonomous driving systems (ADSs). HD maps essentially determine the potential diversity of the testing scenarios. However, the current HD maps suffer from two main limitations: lack of junction diversity in the publicly available HD maps and cost-consuming to build a new HD map. Hence, in this paper, we propose, FEAT2MAP, to automatically generate concise HD maps with scenario diversity guarantees. FEAT2MAP focuses on junctions as they significantly influence scenario diversity, especially in urban road networks. FEAT2MAP first defines a set of features to characterize junctions. Then, FEAT2MAP extracts and samples concrete junction features from a list of input HD maps or user-defined requirements. Each junction feature generates a junction. Finally, FEAT2MAP builds a map by connecting the junctions in a grid layout. To demonstrate the effectiveness of FEAT2MAP, we conduct experiments with the public HD maps from SVL and the open-source ADS Apollo. The results show that FEAT2MAP can (1) generate new maps of reduced size while maintaining scenario diversity in terms of the code coverage and motion states of the ADS under test, and (2) generate new maps of increased scenario diversity by merging intersection features from multiple maps or taking user inputs.


title: What is Where by Looking: Weakly-Supervised Open-World Phrase-Grounding without Text Inputs

abstract: Given an input image, and nothing else, our method returns the bounding boxes of objects in the image and phrases that describe the objects. This is achieved within an open world paradigm, in which the objects in the input image may not have been encountered during the training of the localization mechanism. Moreover, training takes place in a weakly supervised setting, where no bounding boxes are provided. To achieve this, our method combines two pre-trained networks: the CLIP image-to-text matching score and the BLIP image captioning tool. Training takes place on COCO images and their captions and is based on CLIP. Then, during inference, BLIP is used to generate a hypothesis regarding various regions of the current image. Our work generalizes weakly supervised segmentation and phrase grounding and is shown empirically to outperform the state of the art in both domains. It also shows very convincing results in the novel task of weakly-supervised open-world purely visual phrase-grounding presented in our work. For example, on the datasets used for benchmarking phrase-grounding, our method results in a very modest degradation in comparison to methods that employ human captions as an additional input. Our code is available at https://github.com/talshaharabany/what-is-where-by-looking and a live demo can be found at https://replicate.com/talshaharabany/what-is-where-by-looking.


title: Productive Reproducible Workflows for DNNs: A Case Study for Industrial Defect Detection

abstract: As Deep Neural Networks (DNNs) have become an increasingly ubiquitous workload, the range of libraries and tooling available to aid in their development and deployment has grown significantly. Scalable, production quality tools are freely available under permissive licenses, and are accessible enough to enable even small teams to be very productive. However within the research community, awareness and usage of said tools is not necessarily widespread, and researchers may be missing out on potential productivity gains from exploiting the latest tools and workflows. This paper presents a case study where we discuss our recent experience producing an end-to-end artificial intelligence application for industrial defect detection. We detail the high level deep learning libraries, containerized workflows, continuous integration/deployment pipelines, and open source code templates we leveraged to produce a competitive result, matching the performance of other ranked solutions to our three target datasets. We highlight the value that exploiting such systems can bring, even for research, and detail our solution and present our best results in terms of accuracy and inference time on a server class GPU, as well as inference times on a server class CPU, and a Raspberry Pi 4.


title: Modeling Transformative AI Risks (MTAIR) Project -- Summary Report

abstract: This report outlines work by the Modeling Transformative AI Risk (MTAIR) project, an attempt to map out the key hypotheses, uncertainties, and disagreements in debates about catastrophic risks from advanced AI, and the relationships between them. This builds on an earlier diagram by Ben Cottier and Rohin Shah which laid out some of the crucial disagreements ("cruxes") visually, with some explanation. Based on an extensive literature review and engagement with experts, the report explains a model of the issues involved, and the initial software-based implementation that can incorporate probability estimates or other quantitative factors to enable exploration, planning, and/or decision support. By gathering information from various debates and discussions into a single more coherent presentation, we hope to enable better discussions and debates about the issues involved. The model starts with a discussion of reasoning via analogies and general prior beliefs about artificial intelligence. Following this, it lays out a model of different paths and enabling technologies for high-level machine intelligence, and a model of how advances in the capabilities of these systems might proceed, including debates about self-improvement, discontinuous improvements, and the possibility of distributed, non-agentic high-level intelligence or slower improvements. The model also looks specifically at the question of learned optimization, and whether machine learning systems will create mesa-optimizers. The impact of different safety research on the previous sets of questions is then examined, to understand whether and how research could be useful in enabling safer systems. Finally, we discuss a model of different failure modes and loss of control or takeover scenarios.


title: Nucleon form factors and parton distributions in nonlocal chiral effective theory

abstract: We present a review of recent applications of nonlocal chiral effective theory to hadron structure studies. Starting from a nonlocal meson--baryon effective chiral Lagrangian, we show how the introduction of a correlation function representing the finite extent of hadrons regularizes the meson loop integrals and introduces momentum dependence in vertex form factors in a gauge invariant manner. We apply the framework to the calculation of nucleon electromagnetic form factors, unpolarized and polarized parton distributions, as well as transverse momentum dependent distributions and generalized parton distributions. Assuming that the nonlocal behavior is a general property of all interactions, we also discuss the application to the lepton anomalous magnetic moment in nonlocal QED.


title: Towards Generalizable Person Re-identification with a Bi-stream Generative Model

abstract: Generalizable person re-identification (re-ID) has attracted growing attention due to its powerful adaptation capability in the unseen data domain. However, existing solutions often neglect either crossing cameras (e.g., illumination and resolution differences) or pedestrian misalignments (e.g., viewpoint and pose discrepancies), which easily leads to poor generalization capability when adapted to the new domain. In this paper, we formulate these difficulties as: 1) Camera-Camera (CC) problem, which denotes the various human appearance changes caused by different cameras; 2) Camera-Person (CP) problem, which indicates the pedestrian misalignments caused by the same identity person under different camera viewpoints or changing pose. To solve the above issues, we propose a Bi-stream Generative Model (BGM) to learn the fine-grained representations fused with camera-invariant global feature and pedestrian-aligned local feature, which contains an encoding network and two stream decoding sub-networks. Guided by original pedestrian images, one stream is employed to learn a camera-invariant global feature for the CC problem via filtering cross-camera interference factors. For the CP problem, another stream learns a pedestrian-aligned local feature for pedestrian alignment using information-complete densely semantically aligned part maps. Moreover, a part-weighted loss function is presented to reduce the influence of missing parts on pedestrian alignment. Extensive experiments demonstrate that our method outperforms the state-of-the-art methods on the large-scale generalizable re-ID benchmarks, involving domain generalization setting and cross-domain setting.


title: Towards Unified Conversational Recommender Systems via Knowledge-Enhanced Prompt Learning

abstract: Conversational recommender systems (CRS) aim to proactively elicit user preference and recommend high-quality items through natural language conversations. Typically, a CRS consists of a recommendation module to predict preferred items for users and a conversation module to generate appropriate responses. To develop an effective CRS, it is essential to seamlessly integrate the two modules. Existing works either design semantic alignment strategies, or share knowledge resources and representations between the two modules. However, these approaches still rely on different architectures or techniques to develop the two modules, making it difficult for effective module integration. To address this problem, we propose a unified CRS model named UniCRS based on knowledge-enhanced prompt learning. Our approach unifies the recommendation and conversation subtasks into the prompt learning paradigm, and utilizes knowledge-enhanced prompts based on a fixed pre-trained language model (PLM) to fulfill both subtasks in a unified approach. In the prompt design, we include fused knowledge representations, task-specific soft tokens, and the dialogue context, which can provide sufficient contextual information to adapt the PLM for the CRS task. Besides, for the recommendation subtask, we also incorporate the generated response template as an important part of the prompt, to enhance the information interaction between the two subtasks. Extensive experiments on two public CRS datasets have demonstrated the effectiveness of our approach.


title: Quantum implementation of circulant matrices and its use in quantum string processing

abstract: String problems in general can be solved faster by using special data structures such as suffixes in many cases structured as trees and arrays. In this paper, we show that suffixes used in those data structures can be obtained by using circulant matrices as a quantum operator which can be implemented in logarithmic time. Hence, if the strings are given as quantum states, using the presented circuit implementation one can do string processing efficiently on quantum computers.


title: Semi-supervised Change Detection of Small Water Bodies Using RGB and Multispectral Images in Peruvian Rainforests

abstract: Artisanal and Small-scale Gold Mining (ASGM) is an important source of income for many households, but it can have large social and environmental effects, especially in rainforests of developing countries. The Sentinel-2 satellites collect multispectral images that can be used for the purpose of detecting changes in water extent and quality which indicates the locations of mining sites. This work focuses on the recognition of ASGM activities in Peruvian Amazon rainforests. We tested several semi-supervised classifiers based on Support Vector Machines (SVMs) to detect the changes of water bodies from 2019 to 2021 in the Madre de Dios region, which is one of the global hotspots of ASGM activities. Experiments show that SVM-based models can achieve reasonable performance for both RGB (using Cohen's $\kappa$ 0.49) and 6-channel images (using Cohen's $\kappa$ 0.71) with very limited annotations. The efficacy of incorporating Lab color space for change detection is analyzed as well.


title: Large sumsets from medium-sized subsets

abstract: The classical Cauchy--Davenport inequality gives a lower bound for the size of the sum of two subsets of ${\mathbb Z}_p$, where $p$ is a prime. Our main aim in this paper is to prove a considerable strengthening of this inequality, where we take only a small number of points from each of the two subsets when forming the sum. One of our results is that there is an absolute constant $c>0$ such that if $A$ and $B$ are subsets of ${\mathbb Z}_p$ with $|A|=|B|=n\le p/3$ then there are subsets $A'\subset A$ and $B'\subset B$ with $|A'|=|B'|\le c \sqrt{n}$ such that $|A'+B'|\ge 2n-1$. In fact, we show that one may take any sizes one likes: as long as $c_1$ and $c_2$ satisfy $c_1c_2 \ge cn$ then we may choose $|A'|=c_1$ and $|B'|=c_2$. We prove related results for general abelian groups.


title: X-ray and GeV-gamma-ray emission property of TeV Compact Symmetric Object PKS 1413+135 and Implication for Episodic Jet Activity

abstract: PKS 1413+135, a compact symmetric object (CSO) with a two-side pc-scale structure in its miniature radio morphology, is spatially associated with 4FGL J1416.1+1320 and recently detected with MAGIC telescopes. We comprehensively analyze its X-ray and GeV gamma-ray observation data for revealing its high energy radiation physics. It is found that the source is in a low-flux stage before MJD 58500 and experiences violent outbursts after MJD 58500 in the GeV band. The flux at 10 GeV varies ~3 orders of magnitude, and the GeV-flux variation is accompanied by the clear spectral variation, which is characterized as a soft log-parabola spectrum in the low-flux state and a hard power-law spectrum in the bright flares. The variability amplitude of X-rays is lower than that of gamma-rays, and no correlation of variability between gamma-rays and X-rays is observed. Fitting the broadband spectral energy distribution during a GeV outburst with a multi-zone leptonic model, we show that the GeV gamma-rays are attributed to the external Compton process while the X-rays are hybrid of several components. The predicted TeV gamma-ray flux during the GeV outburst is consistent with the detection of MAGIC telescopes. These results, together with its CSO radio morphology, imply that PKS 1413+135 has the episodic nuclear jet activities. The weak gamma-ray emission before MJD 58500 may be from its sub-pc-/pc-scale jet component powered by previous activities, and the violent outbursts with short-timescale variability after MJD 58500 could be attributed to the recently restarted jet activity.


title: From tree- to loop-simplicity in affine Toda theories I: Landau singularities and their subleading coefficients

abstract: Various features of the even order poles appearing in the S-matrices of simply-laced affine Toda field theories are analysed in some detail. In particular, the coefficients of first- and second-order singularities appearing in the Laurent expansion of the S-matrix around a general $2N^{\rm th}$ order pole are derived in a universal way using perturbation theory at one loop. We show how to cut loop diagrams contributing to the pole into particular products of tree-level graphs that depend on the on-shell geometry of the loop; in this way, we recover the coefficients of the Laurent expansion around the pole exploiting tree-level integrability properties of the theory. The analysis is independent of the particular simply-laced theory considered, and all the results agree with those obtained in the conjectured bootstrapped S-matrices of the ADE series of theories.


title: Noncoplanar multi-k states in frustrated spinel and kagome magnets

abstract: We investigate analytically and numerically the classical ground states of frustrated Heisenberg models on pyrochlore and kagome lattices in zero and finite magnetic fields. Each model has a wide region in the microscopic parameter space, where the propagation vector is turned to a commensurate position equal to a half of the reciprocal lattice vector with a nontrivial star. Within these regions the zero-field ground states for both models correspond to noncoplanar triple-k spin configurations. A universal appearance of the 3-k states can be related to the spin-space dimensionality. A strong magnetic field freezes the longitudinal spin component reducing the spin-space dimensionality. Accordingly, we find transitions into the double-k magnetic structures induced by applied field for both spin models. The predicted transition between 3-k and 2-k states may explain the hitherto unexplained transitions observed experimentally in cubic spinels GeNi2O4 and GeCo2O4 under magnetic field.


title: Frank-Wolfe-based Algorithms for Approximating Tyler's M-estimator

abstract: Tyler's M-estimator is a well known procedure for robust and heavy-tailed covariance estimation. Tyler himself suggested an iterative fixed-point algorithm for computing his estimator however, it requires super-linear (in the size of the data) runtime per iteration, which maybe prohibitive in large scale. In this work we propose, to the best of our knowledge, the first Frank-Wolfe-based algorithms for computing Tyler's estimator. One variant uses standard Frank-Wolfe steps, the second also considers \textit{away-steps} (AFW), and the third is a \textit{geodesic} version of AFW (GAFW). AFW provably requires, up to a log factor, only linear time per iteration, while GAFW runs in linear time (up to a log factor) in a large $n$ (number of data-points) regime. All three variants are shown to provably converge to the optimal solution with sublinear rate, under standard assumptions, despite the fact that the underlying optimization problem is not convex nor smooth. Under an additional fairly mild assumption, that holds with probability 1 when the (normalized) data-points are i.i.d. samples from a continuous distribution supported on the entire unit sphere, AFW and GAFW are proved to converge with linear rates. Importantly, all three variants are parameter-free and use adaptive step-sizes.


title: Chaos assisted many-body tunnelling

abstract: We study the interplay of chaos and tunnelling between two weakly-coupled Bose-Josephson junctions. The classical phase space of the composite system has a mixed structure including quasi-integrable self-trapping islands for particles and excitations, separated by a chaotic sea. We show that the many-body dynamical tunnelling gap between macroscopic Schr\"odinger cat states supported by these islands is chaos-enhanced. The many-body tunnelling rate fluctuates over several orders of magnitude with small variations of the system parameters or the particle number.


title: mvHOTA: A multi-view higher order tracking accuracy metric to measure spatial and temporal associations in multi-point detection

abstract: Multi-point tracking is a challenging task that involves detecting points in the scene and tracking them across a sequence of frames. Computing detection-based measures like the F-measure on a frame-by-frame basis is not sufficient to assess the overall performance, as it does not interpret performance in the temporal domain. The main evaluation metric available comes from Multi-object tracking (MOT) methods to benchmark performance on datasets such as KITTI with the recently proposed higher order tracking accuracy (HOTA) metric, which is capable of providing a better description of the performance over metrics such as MOTA, DetA, and IDF1. While the HOTA metric takes into account temporal associations, it does not provide a tailored means to analyse the spatial associations of a dataset in a multi-camera setup. Moreover, there are differences in evaluating the detection task for points when compared to objects (point distances vs. bounding box overlap). Therefore in this work, we propose a multi-view higher order tracking metric (mvHOTA) to determine the accuracy of multi-point (multi-instance and multi-class) tracking methods, while taking into account temporal and spatial associations.mvHOTA can be interpreted as the geometric mean of detection, temporal, and spatial associations, thereby providing equal weighting to each of the factors. We demonstrate the use of this metric to evaluate the tracking performance on an endoscopic point detection dataset from a previously organised surgical data science challenge. Furthermore, we compare with other adjusted MOT metrics for this use-case, discuss the properties of mvHOTA, and show how the proposed multi-view Association and the Occlusion index (OI) facilitate analysis of methods with respect to handling of occlusions. The code is available at https://github.com/Cardio-AI/mvhota.


title: Counterexamples to the comparison principle in the special Lagrangian potential equation

abstract: For each $k = 0,\dots,n$ we construct a continuous phase $f_k$, with $f_k(0) = (n-2k)\frac{\pi}{2}$, and viscosity sub- and supersolutions $v_k$, $u_k$, of the elliptic PDE $\sum_{i=1}^n \arctan(\lambda_i(D^2 w)) = f_k(x)$ such that $v_k-u_k$ has an isolated maximum at the origin. It has been an open question whether the comparison principle would hold in this second order equation for arbitrary continuous phases $f\colon\Omega\to (-n\pi/2,n\pi/2)$. Our examples show it does not.


title: A robust and conservative dynamical low-rank algorithm

abstract: Dynamical low-rank approximation, as has been demonstrated recently, can be extremely efficient in solving kinetic equations. However, a major deficiency is that they do not preserve the structure of the underlying physical problem. For example, the classic dynamical low-rank methods violate mass, momentum, and energy conservation. In [L. Einkemmer, I. Joseph, J. Comput. Phys. 443:110495, 2021] a conservative dynamical low-rank approach has been proposed. However, directly integrating the resulting equations of motion, similar to the classic dynamical low-rank approach, results in an ill-posed scheme. In this work we propose a robust, i.e. well-posed, integrator for the conservative dynamical low-rank approach that conserves mass and momentum (up to machine precision) and significantly improves energy conservation. We also report improved qualitative results for some problems and show how the approach can be combined with a rank adaptive scheme.


title: Gray Learning from Non-IID Data with Out-of-distribution Samples

abstract: The integrity of training data, even when annotated by experts, is far from guaranteed, especially for non-IID datasets comprising both in- and out-of-distribution samples. In an ideal scenario, the majority of samples would be in-distribution, while samples that deviate semantically would be identified as out-of-distribution and excluded during the annotation process. However, experts may erroneously classify these out-of-distribution samples as in-distribution, assigning them labels that are inherently unreliable. This mixture of unreliable labels and varied data types makes the task of learning robust neural networks notably challenging. We observe that both in- and out-of-distribution samples can almost invariably be ruled out from belonging to certain classes, aside from those corresponding to unreliable ground-truth labels. This opens the possibility of utilizing reliable complementary labels that indicate the classes to which a sample does not belong. Guided by this insight, we introduce a novel approach, termed \textit{Gray Learning} (GL), which leverages both ground-truth and complementary labels. Crucially, GL adaptively adjusts the loss weights for these two label types based on prediction confidence levels. By grounding our approach in statistical learning theory, we derive bounds for the generalization error, demonstrating that GL achieves tight constraints even in non-IID settings. Extensive experimental evaluations reveal that our method significantly outperforms alternative approaches grounded in robust statistics.


title: Encoding High-level Quantum Programs as SZX-diagrams

abstract: The Scalable ZX-calculus is a compact graphical language used to reason about linear maps between quantum states. These diagrams have multiple applications, but they frequently have to be constructed in a case-by-case basis. In this work we present a method to encode quantum programs implemented in a fragment of the linear dependently typed Proto-Quipper-D language as families of SZX-diagrams. We define a subset of translatable Proto-Quipper-D programs and show that our procedure is able to encode non-trivial algorithms as diagrams that grow linearly on the size of the program.


title: On higher order hyperbolic equations with space-dependent coefficients: $C^\infty$ well-posedness and Levi conditions

abstract: This paper contributes to the wider study of hyperbolic equations with multiplicities. We focus here on some classes of higher order hyperbolic equations with space dependent coefficients in any space dimension. We prove Sobolev well-posedness of the corresponding Cauchy problem (with loss of derivatives due to the multiplicities) under suitable Levi conditions on the lower order terms. These conditions generalise the well known Olienik's conditions in \cite{O70} to orders higher than $2$.


title: A Self-Guided Framework for Radiology Report Generation

abstract: Automatic radiology report generation is essential to computer-aided diagnosis. Through the success of image captioning, medical report generation has been achievable. However, the lack of annotated disease labels is still the bottleneck of this area. In addition, the image-text data bias problem and complex sentences make it more difficult to generate accurate reports. To address these gaps, we pre-sent a self-guided framework (SGF), a suite of unsupervised and supervised deep learning methods to mimic the process of human learning and writing. In detail, our framework obtains the domain knowledge from medical reports with-out extra disease labels and guides itself to extract fined-grain visual features as-sociated with the text. Moreover, SGF successfully improves the accuracy and length of medical report generation by incorporating a similarity comparison mechanism that imitates the process of human self-improvement through compar-ative practice. Extensive experiments demonstrate the utility of our SGF in the majority of cases, showing its superior performance over state-of-the-art meth-ods. Our results highlight the capacity of the proposed framework to distinguish fined-grained visual details between words and verify its advantage in generating medical reports.


title: 0/1 Deep Neural Networks via Block Coordinate Descent

abstract: The step function is one of the simplest and most natural activation functions for deep neural networks (DNNs). As it counts 1 for positive variables and 0 for others, its intrinsic characteristics (e.g., discontinuity and no viable information of subgradients) impede its development for several decades. Even if there is an impressive body of work on designing DNNs with continuous activation functions that can be deemed as surrogates of the step function, it is still in the possession of some advantageous properties, such as complete robustness to outliers and being capable of attaining the best learning-theoretic guarantee of predictive accuracy. Hence, in this paper, we aim to train DNNs with the step function used as an activation function (dubbed as 0/1 DNNs). We first reformulate 0/1 DNNs as an unconstrained optimization problem and then solve it by a block coordinate descend (BCD) method. Moreover, we acquire closed-form solutions for sub-problems of BCD as well as its convergence properties. Furthermore, we also integrate $\ell_{2,0}$-regularization into 0/1 DNN to accelerate the training process and compress the network scale. As a result, the proposed algorithm has a high performance on classifying MNIST and Fashion-MNIST datasets. As a result, the proposed algorithm has a desirable performance on classifying MNIST, FashionMNIST, Cifar10, and Cifar100 datasets.


title: Supervision Adaptation Balancing In-distribution Generalization and Out-of-distribution Detection

abstract: The discrepancy between in-distribution (ID) and out-of-distribution (OOD) samples can lead to \textit{distributional vulnerability} in deep neural networks, which can subsequently lead to high-confidence predictions for OOD samples. This is mainly due to the absence of OOD samples during training, which fails to constrain the network properly. To tackle this issue, several state-of-the-art methods include adding extra OOD samples to training and assign them with manually-defined labels. However, this practice can introduce unreliable labeling, negatively affecting ID classification. The distributional vulnerability presents a critical challenge for non-IID deep learning, which aims for OOD-tolerant ID classification by balancing ID generalization and OOD detection. In this paper, we introduce a novel \textit{supervision adaptation} approach to generate adaptive supervision information for OOD samples, making them more compatible with ID samples. Firstly, we measure the dependency between ID samples and their labels using mutual information, revealing that the supervision information can be represented in terms of negative probabilities across all classes. Secondly, we investigate data correlations between ID and OOD samples by solving a series of binary regression problems, with the goal of refining the supervision information for more distinctly separable ID classes. Our extensive experiments on four advanced network architectures, two ID datasets, and eleven diversified OOD datasets demonstrate the efficacy of our supervision adaptation approach in improving both ID classification and OOD detection capabilities.


title: Graph Neural Network Aided MU-MIMO Detectors

abstract: Multi-user multiple-input multiple-output (MU-MIMO) systems can be used to meet high throughput requirements of 5G and beyond networks. A base station serves many users in an uplink MU-MIMO system, leading to a substantial multi-user interference (MUI). Designing a high-performance detector for dealing with a strong MUI is challenging. This paper analyses the performance degradation caused by the posterior distribution approximation used in the state-of-the-art message passing (MP) detectors in the presence of high MUI. We develop a graph neural network based framework to fine-tune the MP detectors' cavity distributions and thus improve the posterior distribution approximation in the MP detectors. We then propose two novel neural network based detectors which rely on the expectation propagation (EP) and Bayesian parallel interference cancellation (BPIC), referred to as the GEPNet and GPICNet detectors, respectively. The GEPNet detector maximizes detection performance, while GPICNet detector balances the performance and complexity. We provide proof of the permutation equivariance property, allowing the detectors to be trained only once, even in the systems with dynamic changes of the number of users. The simulation results show that the proposed GEPNet detector performance approaches maximum likelihood performance in various configurations and GPICNet detector doubles the multiplexing gain of BPIC detector.


title: Coverage Analysis of LEO Satellite Downlink Networks: Orbit Geometry Dependent Approach

abstract: The low-earth-orbit (LEO) satellite network with mega-constellations can provide global coverage while supporting the high-data rates. The coverage performance of such a network is highly dependent on orbit geometry parameters, including satellite altitude and inclination angle. Traditionally, simulation-based coverage analysis dominates because of the lack of analytical approaches. This paper presents a novel systematic analysis framework for the LEO satellite network by highlighting orbit geometric parameters. Specifically, we assume that satellite locations are placed on a circular orbit according to a one-dimensional Poisson point process. Then, we derive the distribution of the nearest distance between the satellite and a fixed user's location on the Earth in terms of the orbit-geometry parameters. Leveraging this distribution, we characterize the coverage probability of the single-orbit LEO network as a function of the network geometric parameters in conjunction with small and large-scale fading effects. Finally, we extend our coverage analysis to multi-orbit networks and verify the synergistic gain of harnessing multi-orbit satellite networks in terms of the coverage probability. Simulation results are provided to validate the mathematical derivations and the accuracy of the proposed model.


title: An expansion for the sum of a product of an exponential and a Bessel function. II

abstract: We examine the sum of a decaying exponential (depending non-linearly on the summation index) and a Bessel function in the form \[\sum_{n=1}^\infty e^{-an^p}\frac{J_\nu(an^px)}{(an^px/2)^\nu}\qquad (x>0),\] in the limit $a\to0$, where $J_\nu(z)$ is the Bessel function of the first kind of real order $\nu$ and $a$ and $p$ are positive parameters. By means of a Mellin transform approach we obtain an asymptotic expansion that enables the evaluation of this sum in the limit $a\to 0$. A similar result is derived for the sum when the Bessel function is replaced by the modified Bessel function $I_\nu(z)$ when $x\in (0,1)$. The case of even $p$ is of interest since the expansion becomes exponentially small in character. We demonstrate that in the case $p=2$, a result analogous to the Poisson-Jacobi transformation exists for the above sum.


title: Sampling from Log-Concave Distributions over Polytopes via a Soft-Threshold Dikin Walk

abstract: Given a Lipschitz or smooth convex function $\, f:K \to \mathbb{R}$ for a bounded polytope $K \subseteq \mathbb{R}^d$ defined by $m$ inequalities, we consider the problem of sampling from the log-concave distribution $\pi(\theta) \propto e^{-f(\theta)}$ constrained to $K$. Interest in this problem derives from its applications to Bayesian inference and differentially private learning. Our main result is a generalization of the Dikin walk Markov chain to this setting that requires at most $O((md + d L^2 R^2) \times md^{\omega-1}) \log(\frac{w}{\delta}))$ arithmetic operations to sample from $\pi$ within error $\delta>0$ in the total variation distance from a $w$-warm start. Here $L$ is the Lipschitz-constant of $f$, $K$ is contained in a ball of radius $R$ and contains a ball of smaller radius $r$, and $\omega$ is the matrix-multiplication constant. Our algorithm improves on the running time of prior works for a range of parameter settings important for the aforementioned learning applications. Technically, we depart from previous Dikin walks by adding a "soft-threshold" regularizer derived from the Lipschitz or smoothness properties of $f$ to the log-barrier function for $K$ that allows our version of the Dikin walk to propose updates that have a high Metropolis acceptance ratio for $f$, while at the same time remaining inside the polytope $K$.


title: Out-of-distribution Detection by Cross-class Vicinity Distribution of In-distribution Data

abstract: Deep neural networks for image classification only learn to map in-distribution inputs to their corresponding ground truth labels in training without differentiating out-of-distribution samples from in-distribution ones. This results from the assumption that all samples are independent and identically distributed (IID) without distributional distinction. Therefore, a pretrained network learned from in-distribution samples treats out-of-distribution samples as in-distribution and makes high-confidence predictions on them in the test phase. To address this issue, we draw out-of-distribution samples from the vicinity distribution of training in-distribution samples for learning to reject the prediction on out-of-distribution inputs. A \textit{Cross-class Vicinity Distribution} is introduced by assuming that an out-of-distribution sample generated by mixing multiple in-distribution samples does not share the same classes of its constituents. We thus improve the discriminability of a pretrained network by finetuning it with out-of-distribution samples drawn from the cross-class vicinity distribution, where each out-of-distribution input corresponds to a complementary label. Experiments on various in-/out-of-distribution datasets show that the proposed method significantly outperforms the existing methods in improving the capacity of discriminating between in- and out-of-distribution samples.


title: Scalable Neural Data Server: A Data Recommender for Transfer Learning

abstract: Absence of large-scale labeled data in the practitioner's target domain can be a bottleneck to applying machine learning algorithms in practice. Transfer learning is a popular strategy for leveraging additional data to improve the downstream performance, but finding the most relevant data to transfer from can be challenging. Neural Data Server (NDS), a search engine that recommends relevant data for a given downstream task, has been previously proposed to address this problem. NDS uses a mixture of experts trained on data sources to estimate similarity between each source and the downstream task. Thus, the computational cost to each user grows with the number of sources. To address these issues, we propose Scalable Neural Data Server (SNDS), a large-scale search engine that can theoretically index thousands of datasets to serve relevant ML data to end users. SNDS trains the mixture of experts on intermediary datasets during initialization, and represents both data sources and downstream tasks by their proximity to the intermediary datasets. As such, computational cost incurred by SNDS users remains fixed as new datasets are added to the server. We validate SNDS on a plethora of real world tasks and find that data recommended by SNDS improves downstream task performance over baselines. We also demonstrate the scalability of SNDS by showing its ability to select relevant data for transfer outside of the natural image setting.


title: Dual Representation Learning for Out-of-Distribution Detection

abstract: To classify in-distribution samples, deep neural networks explore strongly label-related information and discard weakly label-related information according to the information bottleneck. Out-of-distribution samples drawn from distributions differing from that of in-distribution samples could be assigned with unexpected high-confidence predictions because they could obtain minimum strongly label-related information. To distinguish in- and out-of-distribution samples, Dual Representation Learning (DRL) makes out-of-distribution samples harder to have high-confidence predictions by exploring both strongly and weakly label-related information from in-distribution samples. For a pretrained network exploring strongly label-related information to learn label-discriminative representations, DRL trains its auxiliary network exploring the remaining weakly label-related information to learn distribution-discriminative representations. Specifically, for a label-discriminative representation, DRL constructs its complementary distribution-discriminative representation by integrating diverse representations less similar to the label-discriminative representation. Accordingly, DRL combines label- and distribution-discriminative representations to detect out-of-distribution samples. Experiments show that DRL outperforms the state-of-the-art methods for out-of-distribution detection.


title: Privacy-Preserving Analytics on Decentralized Social Graphs: The Case of Eigendecomposition

abstract: Analytics over social graphs allows to extract valuable knowledge and insights for many fields like community detection, fraud detection, and interest mining. In practice, decentralized social graphs frequently arise, where the social graph is not available to a single entity and is decentralized among a large number of users, each holding only a limited local view about the whole graph. Collecting the local views for analytics of decentralized social graphs raises critical privacy concerns, as they encode private information about the social interactions among individuals. In this paper, we design, implement, and evaluate PrivGED, a new system aimed at privacy-preserving analytics over decentralized social graphs. PrivGED focuses on the support for eigendecomposition, one popular and fundamental graph analytics task producing eigenvalues/eigenvectors over the adjacency matrix of a social graph and benefits various practical applications. PrivGED is built from a delicate synergy of insights on graph analytics, lightweight cryptography, and differential privacy, allowing users to securely contribute their local views on a decentralized social graph for a cloud-based eigendecomposition analytics service while gaining strong privacy protection. Extensive experiments over real-world social graph datasets demonstrate that PrivGED achieves accuracy comparable to the plaintext domain, with practically affordable performance superior to prior art.


title: Two Results on Separation Logic With Theory Reasoning

abstract: Two results are presented concerning the entailment problem in Separation Logic with inductively defined predicate symbols and theory reasoning. First, we show that the entailment problem is undecidable for rules with bounded tree-width, if theory reasoning is considered. The result holds for a wide class of theories, even with a very low expressive power. For instance it applies to the natural numbers with the successor function, or with the usual order. Second, we show that every entailment problem can be reduced to an entailment problem containing no equality (neither in the formulas nor in the recursive rules defining the semantics of the predicate symbols).