title: Topological insulator-based Dirac hyperbolic metamaterial with large mode indices

abstract: Hyperbolic metamaterials (HMMs) are engineered materials with a hyperbolic isofrequency surface, enabling a range of novel phenomena and applications including negative refraction, enhanced sensing, and subdiffraction imaging, focusing, and waveguiding. Existing HMMs primarily work in the visible and infrared spectral range due to the inherent properties of their constituent materials. Here we demonstrate a THz-range Dirac HMM using topological insulators (TIs) as the building blocks. We find that the structure houses up to three high-wavevector volume plasmon polariton (VPP) modes, consistent with transfer matrix modeling. The VPPs have mode indices ranging from 126 to 531, 10-100x larger than observed for VPP modes in traditional media while maintaining comparable quality factors. We attribute these properties to the two-dimensional Dirac nature of the electrons occupying the topological insulator surface states. Because these are van der Waals materials, these structures can be grown at a wafer-scale on a variety of substrates, allowing them to be integrated with existing THz structures and enabling next-generation THz optical devices.


title: Approximation results for Gradient Descent trained Shallow Neural Networks in $1d$

abstract: Two aspects of neural networks that have been extensively studied in the recent literature are their function approximation properties and their training by gradient descent methods. The approximation problem seeks accurate approximations with a minimal number of weights. In most of the current literature these weights are fully or partially hand-crafted, showing the capabilities of neural networks but not necessarily their practical performance. In contrast, optimization theory for neural networks heavily relies on an abundance of weights in over-parametrized regimes. This paper balances these two demands and provides an approximation result for shallow networks in $1d$ with non-convex weight optimization by gradient descent. We consider finite width networks and infinite sample limits, which is the typical setup in approximation theory. Technically, this problem is not over-parametrized, however, some form of redundancy reappears as a loss in approximation rate compared to best possible rates.


title: Dirichlet Fractional Laplacian in multi-tubes

abstract: We describe the spectrum structure for the restricted Dirichlet fractional Laplacian in multi-tubes, i.e. domains with cylindrical outlets to infinity. Some new effects in comparison with the local case are discovered. In this version, Theorem 4 is essentially improved.


title: Nonlinear Heterogeneous Bayesian Decentralized Data Fusion

abstract: The factor graph decentralized data fusion (FG-DDF) framework was developed for the analysis and exploitation of conditional independence in {heterogeneous Bayesian decentralized fusion problems, in which robots update and fuse pdfs over different, but overlapping subsets of random states. This allows robots to efficiently use smaller probabilistic models and sparse message passing to accurately and scalably fuse relevant local parts of a larger global joint state pdf while accounting for data dependencies between robots. Whereas prior work required limiting assumptions about network connectivity and model linearity, this paper relaxes these to explore the applicability and robustness of FG-DDF in more general settings. We develop a new heterogeneous fusion rule which generalizes the homogeneous covariance intersection algorithm for such cases and test it in multi-robot tracking and localization scenarios with non-linear motion/observation models under communication dropouts. Simulation and hardware experiments show that, in practice, the FG-DDF continues to provide consistent filtered estimates under these more practical operating conditions, while reducing computation and communication costs by more than 99\%, thus enabling the design of scalable real-world multi-robot systems.


title: Designing experimental conditions to use the Lotka-Volterra model to infer tumor cell line interaction types

abstract: The Lotka-Volterra model is widely used to model interactions between two species. Here, we generate synthetic data mimicking competitive, mutualistic and antagonistic interactions between two tumor cell lines, and then use the Lotka-Volterra model to infer the interaction type. Structural identifiability of the Lotka-Volterra model is confirmed, and practical identifiability is assessed for three experimental designs: (a) use of a single data set, with a mixture of both cell lines observed over time, (b) a sequential design where growth rates and carrying capacities are estimated using data from experiments in which each cell line is grown in isolation, and then interaction parameters are estimated from an experiment involving a mixture of both cell lines, and (c) a parallel experimental design where all model parameters are fitted to data from two mixtures simultaneously. In addition to assessing each design for practical identifiability, we investigate how the predictive power of the model-i.e., its ability to fit data for initial ratios other than those to which it was calibrated-is affected by the choice of experimental design. The parallel calibration procedure is found to be optimal and is further tested on in silico data generated from a spatially-resolved cellular automaton model, which accounts for oxygen consumption and allows for variation in the intensity level of the interaction between the two cell lines. We use this study to highlight the care that must be taken when interpreting parameter estimates for the spatially-averaged Lotka-Volterra model when it is calibrated against data produced by the spatially-resolved cellular automaton model, since baseline competition for space and resources in the CA model may contribute to a discrepancy between the type of interaction used to generate the CA data and the type of interaction inferred by the LV model.


title: Advertising Media and Target Audience Optimization via High-dimensional Bandits

abstract: We present a data-driven algorithm that advertisers can use to automate their digital ad-campaigns at online publishers. The algorithm enables the advertiser to search across available target audiences and ad-media to find the best possible combination for its campaign via online experimentation. The problem of finding the best audience-ad combination is complicated by a number of distinctive challenges, including (a) a need for active exploration to resolve prior uncertainty and to speed the search for profitable combinations, (b) many combinations to choose from, giving rise to high-dimensional search formulations, and (c) very low success probabilities, typically just a fraction of one percent. Our algorithm (designated LRDL, an acronym for Logistic Regression with Debiased Lasso) addresses these challenges by combining four elements: a multiarmed bandit framework for active exploration; a Lasso penalty function to handle high dimensionality; an inbuilt debiasing kernel that handles the regularization bias induced by the Lasso; and a semi-parametric regression model for outcomes that promotes cross-learning across arms. The algorithm is implemented as a Thompson Sampler, and to the best of our knowledge, it is the first that can practically address all of the challenges above. Simulations with real and synthetic data show the method is effective and document its superior performance against several benchmarks from the recent high-dimensional bandit literature.


title: Critical phenomena in gravitational collapse with competing scalar field and gravitational waves, in 4+1 dimensions

abstract: In the gravitational collapse of matter beyond spherical symmetry, gravitational waves are necessarily present. On the other hand, gravitational waves can collapse to a black hole even without matter. One might therefore wonder how the interaction and competition between the matter fields and gravitational waves affects critical phenomena at the threshold of black hole formation. As a toy model for this, we study the threshold of black-hole formation in 4+1 dimensions, where we add a massless minimally coupled scalar matter field to the gravitational wave ansatz of Biz\'on, Chmaj and Schmidt (in a nutshell, Bianchi~IX on $S^3\times\text{radius}\times\text{time}$). In order to find a stable discretisation of the equation governing the gravitational waves in 4+1 physical dimensions, which has the same principal part as the spherical wave equation in 9+1 dimensions, we first revisit the problem of critical spherical scalar field collapse in $n+2$ dimensions with large $n$. Returning to the main problem, we find numerically that weak gravitational wave perturbations of the scalar field critical solution decay, while weak scalar perturbations of the gravitational wave critical solution also decay. A dynamical systems picture then suggests the existence of a codimension-two attractor. We find numerical evidence for this attractor by evolving mixed initial data and fine-tuning both an overall amplitude and the relative strength of the two fields.


title: A Steklov-spectral approach for solutions of Dirichlet and Robin boundary value problems

abstract: In this paper we revisit an approach pioneered by Auchmuty to approximate solutions of the Laplace- Robin boundary value problem. We demonstrate the efficacy of this approach on a large class of non-tensorial domains, in contrast with other spectral approaches for such problems. We establish a spectral approximation theorem showing an exponential fast numerical evaluation with regards to the number of Steklov eigenfunctions used, for smooth domains and smooth boundary data. A polynomial fast numerical evaluation is observed for either non-smooth domains or non-smooth boundary data. We additionally prove a new result on the regularity of the Steklov eigenfunctions, depending on the regularity of the domain boundary. We describe three numerical methods to compute Steklov eigenfunctions.


title: Temperature-driven changes in the Fermi surface of graphite

abstract: We report on temperature-dependent size and anisotropy of the Fermi pockets in graphite revealed by magnetotransport measurements. The magnetoresistances obtained in fields along the c-axis obey an extended Kohler's rule, with the carrier density following prediction of a temperature-dependent Fermi energy, indicating a change in the Fermi pocket size with temperature. The angle-dependent magnetoresistivities at a given temperature exhibit a scaling behavior. The scaling factor that reflects the anisotropy of the Fermi surface is also found to vary with temperature. Our results demonstrate that temperature-driven changes in Fermi surface can be ubiquitous and need to be considered in understanding the temperature-dependent carrier density and magnetoresistance anisotropy in semimetals.


title: Nonlocal Wasserstein Distance: Metric and Asymptotic Properties

abstract: The seminal result of Benamou and Brenier provides a characterization of the Wasserstein distance as the path of the minimal action in the space of probability measures, where paths are solutions of the continuity equation and the action is the kinetic energy. Here we consider a fundamental modification of the framework where the paths are solutions of nonlocal (jump) continuity equations and the action is a nonlocal kinetic energy. The resulting nonlocal Wasserstein distances are relevant to fractional diffusions and Wasserstein distances on graphs. We characterize the basic properties of the distance and obtain sharp conditions on the (jump) kernel specifying the nonlocal transport that determine whether the topology metrized is the weak or the strong topology. A key result of the paper are the quantitative comparisons between the nonlocal and local Wasserstein distance.


title: An Inductive Approach to Strongly Antimagic Labelings of Graphs

abstract: An antimagic labeling for a graph $G$ with $m$ edges is a bijection $f: E(G) \to \{1, 2, \dots, m\}$ so that $\phi_f(u) \neq \phi_f(v)$ holds for any pair of distinct vertices $u, v \in V(G)$, where $\phi_f(x) = \sum_{x \in e} f(e)$. A strongly antimagic labeling is an antimagic labeling with an additional condition: For any $u, v \in V(G)$, if $\deg(u) > \deg(v)$, then $\phi_f(u) > \phi_f(v)$. A graph $G$ is strongly antimagic if it admits a strongly antimagic labeling. We present inductive properties of strongly antimagic labelings of graphs. This approach leads to simplified proofs that spiders and double spiders are strongly antimagic, previously shown by Shang [Spiders are antimagic, Ars Combinatoria, 118 (2015), 367--372] and Huang [Antimagic labeling on spiders, Master's Thesis, Department of Mathematics, National Taiwan University, 2015], and by Chang, Chin, Li and Pan [The strongly antimagic labelings of double spiders, Indian J. Discrete Math. 6 (2020), 43--68], respectively. We fix a subtle error in [The strongly antimagic labelings of double spiders, Indian J. Discrete Math. 6 (2020), 43--68]. Further, we prove certain level-wise regular trees, cycle spiders and cycle double spiders are all strongly antimagic.


title: Uncertainty Guided Policy for Active Robotic 3D Reconstruction using Neural Radiance Fields

abstract: In this paper, we tackle the problem of active robotic 3D reconstruction of an object. In particular, we study how a mobile robot with an arm-held camera can select a favorable number of views to recover an object's 3D shape efficiently. Contrary to the existing solution to this problem, we leverage the popular neural radiance fields-based object representation, which has recently shown impressive results for various computer vision tasks. However, it is not straightforward to directly reason about an object's explicit 3D geometric details using such a representation, making the next-best-view selection problem for dense 3D reconstruction challenging. This paper introduces a ray-based volumetric uncertainty estimator, which computes the entropy of the weight distribution of the color samples along each ray of the object's implicit neural representation. We show that it is possible to infer the uncertainty of the underlying 3D geometry given a novel view with the proposed estimator. We then present a next-best-view selection policy guided by the ray-based volumetric uncertainty in neural radiance fields-based representations. Encouraging experimental results on synthetic and real-world data suggest that the approach presented in this paper can enable a new research direction of using an implicit 3D object representation for the next-best-view problem in robot vision applications, distinguishing our approach from the existing approaches that rely on explicit 3D geometric modeling.


title: Identification of a non-axisymmetric mode in laboratory experiments searching for standard magnetorotational instability

abstract: The standard magnetorotational instability (SMRI) is a promising mechanism for turbulence and rapid accretion in astrophysical disks. It is a magnetohydrodynamic (MHD) instability that destabilizes otherwise hydrodynamically stable disk flow. Due to its microscopic nature at astronomical distances and stringent requirements in laboratory experiments, SMRI has remained unconfirmed since its proposal, despite its astrophysical importance. Here we report a nonaxisymmetric MHD instability in a modified Taylor-Couette experiment. To search for SMRI, a uniform magnetic field is imposed along the rotation axis of a swirling liquid-metal flow. The instability initially grows exponentially, becoming prominent only for sufficient flow shear and moderate magnetic field. These conditions for instability are qualitatively consistent with SMRI, but at magnetic Reynolds numbers below the predictions of linear analyses with periodic axial boundaries. Three-dimensional numerical simulations, however, reproduce the observed instability, indicating that it grows linearly from the primary axisymmetric flow modified by the applied magnetic field.

categories: physics.plasm-ph astro-ph.HE astro-ph.IM physics.flu-dyn


title: DynaConF: Dynamic Forecasting of Non-Stationary Time Series

abstract: Deep learning has shown impressive results in a variety of time series forecasting tasks, where modeling the conditional distribution of the future given the past is the essence. However, when this conditional distribution is non-stationary, it poses challenges for these models to learn consistently and to predict accurately. In this work, we propose a new method to model non-stationary conditional distributions over time by clearly decoupling stationary conditional distribution modeling from non-stationary dynamics modeling. Our method is based on a Bayesian dynamic model that can adapt to conditional distribution changes and a deep conditional distribution model that handles multivariate time series using a factorized output space. Our experimental results on synthetic and real-world datasets show that our model can adapt to non-stationary time series better than state-of-the-art deep learning solutions.


title: Characterizing Internal Evasion Attacks in Federated Learning

abstract: Federated learning allows for clients in a distributed system to jointly train a machine learning model. However, clients' models are vulnerable to attacks during the training and testing phases. In this paper, we address the issue of adversarial clients performing "internal evasion attacks": crafting evasion attacks at test time to deceive other clients. For example, adversaries may aim to deceive spam filters and recommendation systems trained with federated learning for monetary gain. The adversarial clients have extensive information about the victim model in a federated learning setting, as weight information is shared amongst clients. We are the first to characterize the transferability of such internal evasion attacks for different learning methods and analyze the trade-off between model accuracy and robustness depending on the degree of similarities in client data. We show that adversarial training defenses in the federated learning setting only display limited improvements against internal attacks. However, combining adversarial training with personalized federated learning frameworks increases relative internal attack robustness by 60% compared to federated adversarial training and performs well under limited system resources.


title: Hierarchical Collision Avoidance for Adaptive-Speed Multirotor Teleoperation

abstract: This paper improves safe motion primitives-based teleoperation of a multirotor by developing a hierarchical collision avoidance method that modulates maximum speed based on environment complexity and perceptual constraints. Safe speed modulation is challenging in environments that exhibit varying clutter. Existing methods fix maximum speed and map resolution, which prevents vehicles from accessing tight spaces and places the cognitive load for changing speed on the operator. We address these gaps by proposing a high-rate (10 Hz) teleoperation approach that modulates the maximum vehicle speed through hierarchical collision checking. The hierarchical collision checker simultaneously adapts the local map's voxel size and maximum vehicle speed to ensure motion planning safety. The proposed methodology is evaluated in simulation and real-world experiments and compared to a non-adaptive motion primitives-based teleoperation approach. The results demonstrate the advantages of the proposed teleoperation approach both in time taken and the ability to complete the task without requiring the user to specify a maximum vehicle speed.


title: Towards Optimal Use of Surrogate Markers to Improve Power

abstract: Motivated by increasing pressure for decision makers to shorten the time required to evaluate the efficacy of a treatment such that treatments deemed safe and effective can be made publicly available, there has been substantial recent interest in using an earlier or easier to measure surrogate marker, $S$, in place of the primary outcome, $Y$. To validate the utility of a surrogate marker in these settings, a commonly advocated measure is the proportion of treatment effect on the primary outcome that is explained by the treatment effect on the surrogate marker (PTE). Model based and model free estimators for PTE have also been developed. While this measure is very intuitive, it does not directly address the important questions of how $S$ can be used to make inference of the unavailable $Y$ in the next phase clinical trials. In this paper, to optimally use the information of surrogate S, we provide a framework for deriving an optimal transformation of $S$, $g_{opt}(S)$, such that the treatment effect on $g_{opt}(S)$ maximally approximates the treatment effect on $Y$ in a certain sense. Based on the optimally transformed surrogate, $g_{opt}(S)$, we propose a new measure to quantify surrogacy, the relative power (RP), and demonstrate how RP can be used to make decisions with $S$ instead of $Y$ for next phase trials. We propose nonparametric estimation procedures, derive asymptotic properties, and compare the RP measure with the PTE measure. Finite sample performance of our estimators is assessed via a simulation study. We illustrate our proposed procedures using an application to the Diabetes Prevention Program (DPP) clinical trial to evaluate the utility of hemoglobin A1c and fasting plasma glucose as surrogate markers for diabetes.


title: Grammars over the Lambek Calculus with Permutation: Recognizing Power and Connection to Branching Vector Addition Systems with States

abstract: In (Van Benthem, 1991) it is proved that all permutation closures of context-free languages can be generated by grammars over the Lambek calculus with the permutation rule (LP-grammars); however, to our best knowledge, it is not established whether the converse holds or not. In this paper, we show that LP-grammars are equivalent to linearly-restricted branching vector addition systems with states and with additional memory (shortly, lBVASSAM), which are modified branching vector addition systems with states. Then an example of such an lBVASSAM is presented, which generates a non-semilinear set of vectors; this yields that LP-grammars generate more than permutation closures of context-free languages. Moreover, equivalence of LP-grammars and lBVASSAM allows us to present a normal form for LP-grammars and, as a consequence, prove that LP-grammars are equivalent to LP-grammars without product. Finally, we prove that the class of languages generated by LP-grammars is closed under intersection.


title: Survival of dominated strategies under imitation dynamics

abstract: The literature on evolutionary game theory suggests that pure strategies that are strictly dominated by other pure strategies always become extinct under imitative game dynamics, but they can survive under innovative dynamics. As we explain, this is because innovative dynamics favour rare strategies while standard imitative dynamics do not. However, as we also show, there are reasonable imitation protocols that favour rare or frequent strategies, thus allowing strictly dominated strategies to survive in large classes of imitation dynamics. Dominated strategies can persist at nontrivial frequencies even when the level of domination is not small.


title: Spatial-Temporal Deep Embedding for Vehicle Trajectory Reconstruction from High-Angle Video

abstract: Spatial-temporal Map (STMap)-based methods have shown great potential to process high-angle videos for vehicle trajectory reconstruction, which can meet the needs of various data-driven modeling and imitation learning applications. In this paper, we developed Spatial-Temporal Deep Embedding (STDE) model that imposes parity constraints at both pixel and instance levels to generate instance-aware embeddings for vehicle stripe segmentation on STMap. At pixel level, each pixel was encoded with its 8-neighbor pixels at different ranges, and this encoding is subsequently used to guide a neural network to learn the embedding mechanism. At the instance level, a discriminative loss function is designed to pull pixels belonging to the same instance closer and separate the mean value of different instances far apart in the embedding space. The output of the spatial-temporal affinity is then optimized by the mutex-watershed algorithm to obtain final clustering results. Based on segmentation metrics, our model outperformed five other baselines that have been used for STMap processing and shows robustness under the influence of shadows, static noises, and overlapping. The designed model is applied to process all public NGSIM US-101 videos to generate complete vehicle trajectories, indicating a good scalability and adaptability. Last but not least, the strengths of the scanline method with STDE and future directions were discussed. Code, STMap dataset and video trajectory are made publicly available in the online repository. GitHub Link: shorturl.at/jklT0.


title: Sample-based Uncertainty Quantification with a Single Deterministic Neural Network

abstract: Development of an accurate, flexible, and numerically efficient uncertainty quantification (UQ) method is one of fundamental challenges in machine learning. Previously, a UQ method called DISCO Nets has been proposed (Bouchacourt et al., 2016), which trains a neural network by minimizing the energy score. In this method, a random noise vector in $\mathbb{R}^{10\text{--}100}$ is concatenated with the original input vector in order to produce a diverse ensemble forecast despite using a single neural network. While this method has shown promising performance on a hand pose estimation task in computer vision, it remained unexplored whether this method works as nicely for regression on tabular data, and how it competes with more recent advanced UQ methods such as NGBoost. In this paper, we propose an improved neural architecture of DISCO Nets that admits faster and more stable training while only using a compact noise vector of dimension $\sim \mathcal{O}(1)$. We benchmark this approach on miscellaneous real-world tabular datasets and confirm that it is competitive with or even superior to standard UQ baselines. Moreover we observe that it exhibits better point forecast performance than a neural network of the same size trained with the conventional mean squared error. As another advantage of the proposed method, we show that local feature importance computation methods such as SHAP can be easily applied to any subregion of the predictive distribution. A new elementary proof for the validity of using the energy score to learn predictive distributions is also provided.


title: A mechanics--based perspective on the function of human sphincters during functional luminal imaging probe manometry

abstract: Functional luminal imaging probe (FLIP) is used to measure cross-sectional area (CSA) and pressure at sphincters. It consists of a catheter surrounded by a fluid filled cylindrical bag, closed on both ends. Plotting the pressure-CSA hysteresis of a sphincter during a contraction cycle, which is available through FLIP testing, offers information on its functionality, and can provide diagnostic insights. However, limited work has been done to explain the mechanics of these pressure-CSA loops. This work presents a consolidated picture of pressure-CSA loops of different sphincters. Clinical data reveal that although sphincters have a similar purpose (controlling the flow of liquids and solids by opening and closing), two different pressure-CSA loop patterns emerge: negative slope loop (NSL) and positive slope loop (PSL). We show that the loop type is the result of an interplay between (or lack thereof) two mechanical modes: (i) neurogenic mediated relaxation of the sphincter muscle and (ii) muscle contraction proximal to the sphincter which causes mechanical distention. We conclude that sphincters which only function through mechanism (i) exhibition NSL whereas sphincters which open as a result of both (i) and (ii) display a PSL. This work provides a fundamental mechanical understanding of human sphincters. This can be used to identify normal and abnormal phenotypes for the different sphincters and help in creating physiomarkers based on work calculation.


title: Robust and Efficient Sorting with Offset-Value Coding

abstract: Sorting and searching are large parts of database query processing, e.g., in the forms of index creation, index maintenance, and index lookup; and comparing pairs of keys is a substantial part of the effort in sorting and searching. We have worked on simple, efficient implementations of decades-old, neglected, effective techniques for fast comparisons and fast sorting, in particular offset-value coding. In the process, we happened upon its mutually beneficial relationship with prefix truncation in run files as well as the duality of compression techniques in row- and column-format storage structures, namely prefix truncation and run-length encoding of leading key columns. We also found a beneficial relationship with consumers of sorted streams, e.g., merging parallel streams, in-stream aggregation, and merge join. We report on our implementation in the context of Google's Napa and F1 Query systems as well as an experimental evaluation of performance and scalability.


title: Neighborhood VAR: Efficient estimation of multivariate timeseries with neighborhood information

abstract: In data science, vector autoregression (VAR) models are popular in modeling multivariate time series in the environmental sciences and other applications. However, these models are computationally complex with the number of parameters scaling quadratically with the number of time series. In this work, we propose a so-called neighborhood vector autoregression (NVAR) model to efficiently analyze large-dimensional multivariate time series. We assume that the time series have underlying neighborhood relationships, e.g., spatial or network, among them based on the inherent setting of the problem. When this neighborhood information is available or can be summarized using a distance matrix, we demonstrate that our proposed NVAR method provides a computationally efficient and theoretically sound estimation of model parameters. The performance of the proposed method is compared with other existing approaches in both simulation studies and a real application of stream nitrogen study.


title: Computed Decision Weights and a New Learning Algorithm for Neural Classifiers

abstract: In this paper we consider the possibility of computing rather than training the decision layer weights of a neural classifier. Such a possibility arises in two way, from making an appropriate choice of loss function and by solving a problem of constrained optimization. The latter formulation leads to a promising new learning process for pre-decision weights with both simplicity and efficacy.


title: Automated Segmentation and Recurrence Risk Prediction of Surgically Resected Lung Tumors with Adaptive Convolutional Neural Networks

abstract: Lung cancer is the leading cause of cancer related mortality by a significant margin. While new technologies, such as image segmentation, have been paramount to improved detection and earlier diagnoses, there are still significant challenges in treating the disease. In particular, despite an increased number of curative resections, many postoperative patients still develop recurrent lesions. Consequently, there is a significant need for prognostic tools that can more accurately predict a patient's risk for recurrence. In this paper, we explore the use of convolutional neural networks (CNNs) for the segmentation and recurrence risk prediction of lung tumors that are present in preoperative computed tomography (CT) images. First, expanding upon recent progress in medical image segmentation, a residual U-Net is used to localize and characterize each nodule. Then, the identified tumors are passed to a second CNN for recurrence risk prediction. The system's final results are produced with a random forest classifier that synthesizes the predictions of the second network with clinical attributes. The segmentation stage uses the LIDC-IDRI dataset and achieves a dice score of 70.3%. The recurrence risk stage uses the NLST dataset from the National Cancer institute and achieves an AUC of 73.0%. Our proposed framework demonstrates that first, automated nodule segmentation methods can generalize to enable pipelines for a wide range of multitask systems and second, that deep learning and image processing have the potential to improve current prognostic tools. To the best of our knowledge, it is the first fully automated segmentation and recurrence risk prediction system.


title: A Framework for Improving the Characterization Scope of Stein's Method on Riemannian Manifolds

abstract: Stein's method has been widely used to achieve distributional approximations for probability distributions defined in Euclidean spaces. Recently, techniques to extend Stein's method to manifold-valued random variables with distributions defined on the respective manifolds have been reported. However, several of these methods impose strong regularity conditions on the distributions as well as the manifolds and/or consider very special cases. In this paper, we present a novel framework for Stein's method on Riemannian manifolds using the Friedrichs extension technique applied to self-adjoint unbounded operators. This framework is applicable to a variety of conventional and unconventional situations, including but not limited to, intrinsically defined non-smooth distributions, truncated distributions on Riemannian manifolds, distributions on incomplete Riemannian manifolds, etc. Moreover, the stronger the regularity conditions imposed on the manifolds or target distributions, the stronger will be the characterization ability of our novel Stein pair, which facilitates the application of Stein's method to problem domains hitherto uncharted. We present several (non-numeric) examples illustrating the applicability of the presented theory.


title: Introspective Learning : A Two-Stage Approach for Inference in Neural Networks

abstract: In this paper, we advocate for two stages in a neural network's decision making process. The first is the existing feed-forward inference framework where patterns in given data are sensed and associated with previously learned patterns. The second stage is a slower reflection stage where we ask the network to reflect on its feed-forward decision by considering and evaluating all available choices. Together, we term the two stages as introspective learning. We use gradients of trained neural networks as a measurement of this reflection. A simple three-layered Multi Layer Perceptron is used as the second stage that predicts based on all extracted gradient features. We perceptually visualize the post-hoc explanations from both stages to provide a visual grounding to introspection. For the application of recognition, we show that an introspective network is 4% more robust and 42% less prone to calibration errors when generalizing to noisy data. We also illustrate the value of introspective networks in downstream tasks that require generalizability and calibration including active learning, out-of-distribution detection, and uncertainty estimation. Finally, we ground the proposed machine introspection to human introspection for the application of image quality assessment.


title: The Marchenko method to solve the general system of derivative nonlinear Schr\"odinger equations

abstract: A system of linear integral equations is presented, which is the analog of the system of Marchenko integral equations, to solve the inverse scattering problem for the linear system associated with the derivative NLS equations. The corresponding direct and inverse scattering problems are analyzed, and the recovery of the potentials and the Jost solutions from the solution to the Marchenko system is described. When the reflection coefficients are zero, some explicit solution formulas are provided for the potentials and the Jost solutions in terms of a pair of constant matrix triplets representing the bound-state information for any number of bound states and any multiplicities. In the reduced case, when the two potentials in the linear system are related to each other through complex conjugation, the corresponding reduced Marchenko integral equation is obtained. The solution to the derivative NLS equation is obtained from the solution to the reduced Marchenko integral equation. The theory presented is illustrated with some explicit examples.


title: A Nearly Tight Lower Bound for the $d$-Dimensional Cow-Path Problem

abstract: In the $d$-dimensional cow-path problem, a cow living in $\mathbb{R}^d$ must locate a $(d - 1)$-dimensional hyperplane $H$ whose location is unknown. The only way that the cow can find $H$ is to roam $\mathbb{R}^d$ until it intersects $\mathcal{H}$. If the cow travels a total distance $s$ to locate a hyperplane $H$ whose distance from the origin was $r \ge 1$, then the cow is said to achieve competitive ratio $s / r$. It is a classic result that, in $\mathbb{R}^2$, the optimal (deterministic) competitive ratio is $9$. In $\mathbb{R}^3$, the optimal competitive ratio is known to be at most $\approx 13.811$. But in higher dimensions, the asymptotic relationship between $d$ and the optimal competitive ratio remains an open question. The best upper and lower bounds, due to Antoniadis et al., are $O(d^{3/2})$ and $\Omega(d)$, leaving a gap of roughly $\sqrt{d}$. In this note, we achieve a stronger lower bound of $\tilde{\Omega}(d^{3/2})$.


title: Optimality conditions and constraint qualifications for cardinality constrained optimization problems

abstract: The cardinality constrained optimization problem (CCOP) is an optimization problem where the maximum number of nonzero components of any feasible point is bounded. In this paper, we consider CCOP as a mathematical program with disjunctive subspaces constraints (MPDSC). Since a subspace is a special case of a convex polyhedral set, MPDSC is a special case of the mathematical program with disjunctive constraints (MPDC). Using the special structure of subspaces, we are able to obtain more precise formulas for the tangent and (directional) normal cones for the disjunctive set of subspaces. We then obtain first and second order optimality conditions by using the corresponding results from MPDC. Thanks to the special structure of the subspace, we are able to obtain some results for MPDSC that do not hold in general for MPDC. In particular we show that the relaxed constant positive linear dependence (RCPLD) is a sufficient condition for the metric subregularity/error bound property for MPDSC which is not true for MPDC in general. Finally we show that under all constraint qualifications presented in this paper, certain exact penalization holds for CCOP.


title: Constrained Policy Optimization for Controlled Self-Learning in Conversational AI Systems

abstract: Recently, self-learning methods based on user satisfaction metrics and contextual bandits have shown promising results to enable consistent improvements in conversational AI systems. However, directly targeting such metrics by off-policy bandit learning objectives often increases the risk of making abrupt policy changes that break the current user experience. In this study, we introduce a scalable framework for supporting fine-grained exploration targets for individual domains via user-defined constraints. For example, we may want to ensure fewer policy deviations in business-critical domains such as shopping, while allocating more exploration budget to domains such as music. Furthermore, we present a novel meta-gradient learning approach that is scalable and practical to address this problem. The proposed method adjusts constraint violation penalty terms adaptively through a meta objective that encourages balanced constraint satisfaction across domains. We conduct extensive experiments using data from a real-world conversational AI on a set of realistic constraint benchmarks. Based on the experimental results, we demonstrate that the proposed approach is capable of achieving the best balance between the policy value and constraint satisfaction rate.


title: DytanVO: Joint Refinement of Visual Odometry and Motion Segmentation in Dynamic Environments

abstract: Learning-based visual odometry (VO) algorithms achieve remarkable performance on common static scenes, benefiting from high-capacity models and massive annotated data, but tend to fail in dynamic, populated environments. Semantic segmentation is largely used to discard dynamic associations before estimating camera motions but at the cost of discarding static features and is hard to scale up to unseen categories. In this paper, we leverage the mutual dependence between camera ego-motion and motion segmentation and show that both can be jointly refined in a single learning-based framework. In particular, we present DytanVO, the first supervised learning-based VO method that deals with dynamic environments. It takes two consecutive monocular frames in real-time and predicts camera ego-motion in an iterative fashion. Our method achieves an average improvement of 27.7% in ATE over state-of-the-art VO solutions in real-world dynamic environments, and even performs competitively among dynamic visual SLAM systems which optimize the trajectory on the backend. Experiments on plentiful unseen environments also demonstrate our method's generalizability.


title: The non-singular Trautman-Kopczy\'nski big-bang model and a torsional spinor description of dark matter

abstract: A view is taken up whereby the non-singular Trautman-Kopczy\'nski big-bang creation of the Universe produced a highly torsional hot state at early stages of the cosmic evolution which particularly brought about the formation of a dark matter cloud. It is thus assumed that the combination of Einstein-Cartan's theory with the torsionful version of the two-component {\epsilon}-formalism of Infeld and van der Waerden supplies a natural local description of dark matter in terms of uncharged spin-one massive fields. In the case of either handedness, the pertinent spinor field equation arises directly from a suitable form of the world Bianchi identity. It appears that each such field equation bears a term that is thought of as carrying part of the information on the mass of the fields. The whole information turns out to be extracted by well prescribed derivatives of certain couplings involving the fields and spinor torsion pieces in such a way that the mass of dark matter is really thought of as arising from the interaction between the fields and spinor torsion.


title: Weinberg's Compositeness

abstract: Nearly 60 years ago Weinberg suggested a criterion for particle "compositeness", which has acquired new life with the discovery of new, exotic hadrons. His idea resonates with model-based intuition. I discuss the role it plays in the context of another of Weinberg's creations, the model-independent framework of effective field theories.


title: Evolution of a Web-Scale Near Duplicate Image Detection System

abstract: Detecting near duplicate images is fundamental to the content ecosystem of photo sharing web applications. However, such a task is challenging when involving a web-scale image corpus containing billions of images. In this paper, we present an efficient system for detecting near duplicate images across 8 billion images. Our system consists of three stages: candidate generation, candidate selection, and clustering. We also demonstrate that this system can be used to greatly improve the quality of recommendations and search results across a number of real-world applications. In addition, we include the evolution of the system over the course of six years, bringing out experiences and lessons on how new systems are designed to accommodate organic content growth as well as the latest technology. Finally, we are releasing a human-labeled dataset of ~53,000 pairs of images introduced in this paper.


title: Topology of complements of skeletons

abstract: Given a polytopal complex $X$, we examine the topological complement of its $k$-skeleton. We construct a long exact sequence relating the homologies of the skeleton complements and links of faces in $X$, and using this long exact sequence, we obtain characterisations of Cohen-Macaulay and Leray complexes, stacked balls, and neighbourly spheres in terms of their skeleton complements. We also apply these results to CAT(0) cubical complexes, and find new similarities between such a complex and an associated simplicial complex, the crossing complex.


title: Rethinking Personalized Ranking at Pinterest: An End-to-End Approach

abstract: In this work, we present our journey to revolutionize the personalized recommendation engine through end-to-end learning from raw user actions. We encode user's long-term interest in Pinner- Former, a user embedding optimized for long-term future actions via a new dense all-action loss, and capture user's short-term intention by directly learning from the real-time action sequences. We conducted both offline and online experiments to validate the performance of the new model architecture, and also address the challenge of serving such a complex model using mixed CPU/GPU setup in production. The proposed system has been deployed in production at Pinterest and has delivered significant online gains across organic and Ads applications.


title: Estimating and Explaining Model Performance When Both Covariates and Labels Shift

abstract: Deployed machine learning (ML) models often encounter new user data that differs from their training data. Therefore, estimating how well a given model might perform on the new data is an important step toward reliable ML applications. This is very challenging, however, as the data distribution can change in flexible ways, and we may not have any labels on the new data, which is often the case in monitoring settings. In this paper, we propose a new distribution shift model, Sparse Joint Shift (SJS), which considers the joint shift of both labels and a few features. This unifies and generalizes several existing shift models including label shift and sparse covariate shift, where only marginal feature or label distribution shifts are considered. We describe mathematical conditions under which SJS is identifiable. We further propose SEES, an algorithmic framework to characterize the distribution shift under SJS and to estimate a model's performance on new data without any labels. We conduct extensive experiments on several real-world datasets with various ML models. Across different datasets and distribution shifts, SEES achieves significant (up to an order of magnitude) shift estimation error improvements over existing approaches.


title: A fast two-level Strang splitting method for multi-dimensional spatial fractional Allen-Cahn equations with discrete maximum principle

abstract: In this paper, we study the numerical solutions of the multi-dimensional spatial fractional Allen-Cahn equations. After semi-discretization for the spatial fractional Riesz derivative, a system of nonlinear ordinary differential equations with Toeplitz structure is obtained. For the sake of reducing the computational complexity, a two-level Strang splitting method is proposed, where the Toeplitz matrix in the system is split into the sum of a circulant matrix and a skew-circulant matrix. Therefore, the proposed method can be quickly implemented by the fast Fourier transform, substituting to calculate the expensive Toeplitz matrix exponential. Theoretically, the discrete maximum principle of our method is unconditionally preserved. Moreover, the analysis of error in the infinite norm with second-order accuracy is conducted in both time and space. Finally, numerical tests are given to corroborate our theoretical conclusions and the efficiency of the proposed method.


title: Exceptional families of measures on Carnot groups

abstract: We study the families of measures on Carnot groups that have vanishing $p$-module, which we call $p$-exceptional families. We found necessary and sufficient condition for the family of intrinsic Lipschitz surfaces passing through a common point to be $p$-exceptional for $p\geq 1$. We described a wide class of $p$-exceptional intrinsic Lipschitz surfaces for $p\in(0,\infty)$.


title: Equivalence between two charged black holes in dynamics of orbits outside the event horizons

abstract: Using the FermiDirac distribution function, Balart and Vagenas gave a charged spherically symmetric regular black hole, which is a solution of Einstein field equations coupled to a nonlinear electrodynamics. In fact, the regular black hole is a Reissner-Nordstrom (RN) black hole when a metric function is given a Taylor expansion to first order approximations. It does not have a curvature singularity at the origin,but the RN black hole does. Both black hole metrics have horizons and similar asymptotic behaviors, and satisfy the weak energy conditions everywhere. They are almost the same in photon effective potentials, photon circular orbits and photon spheres outside the event horizons. There are relatively minor differences between effective potentials, stable circular orbits and innermost stable circular orbits of charged particles outside the event horizons of the two black holes immersed in external magnetic fields. Although the twomagnetized black holes allow different construction methods of explicit symplectic integrators, they exhibit approximately consistent results in the regular and chaotic dynamics of charged particles outside the event horizons. Chaos gets strong as the magnetic field parameter or the magnitude of negative Coulomb parameter increases, but becomes weak when the black hole charge or the positive Coulomb parameter increases. A variation of dynamical properties is not sensitive dependence on an appropriate increase of the black hole charge. The basic equivalence between the two black hole gravitational systems in the dynamics of orbits outside the event horizons is due to the two metric functions having an extremely small difference. This implies that the RN black hole is reasonably replaced by the regular black hole without curvature singularity in many situations.


title: The influence of physiological flow development on popular wall shear stress metrics in an idealized curved artery

abstract: We numerically investigate the influence of flow development on secondary flow patterns and subsequent wall shear stress distributions in a curved artery model, and we compute vascular metrics commonly used to assess variations in blood flow characteristics as it applies to arterial disease. We model a human artery with a simple, rigid 180-degree curved tube with circular cross-section and constant curvature, neglecting effects of taper, torsion and elasticity. High-fidelity numerical results are computed from an in-house discontinuous spectral element flow solver. The flow rate used in this study is physiological. We perform this study using a Newtonian blood-analog fluid subjected to a pulsatile flow with two inflow conditions. The first flow condition is fully developed while the second condition is undeveloped (i.e. uniform). We observe and discuss differences in secondary flow patterns that emerge over the rapid acceleration and deceleration phases of the physiological waveform, and we directly connect the variation in intensity of these secondary flow patterns along the curvature to differences in the wall shear stress metrics for each entrance condition. Results indicate that decreased axial velocities under an undeveloped condition produce less intense secondary flow that, in turn, reduces both the oscillatory and multidirectional nature of the wall shear stress vector, and we link this effect to abnormalities in computed stress metrics. These results suggest potentially lower prevalence of disease in curvatures where entrance flow is rather undeveloped-a physiologically relevant result to further understand the influence of blood flow development on disease.


title: Design of the PMT underwater cascade implosion protection system for JUNO

abstract: Photomultiplier tubes (PMTs) are widely used underwater in large-scale neutrino experiments. As a hollow glass spherelike structure, implosion is unavoidable during long-term operation under large water pressure. There is a possibility of cascade implosion to neighbor PMTs due to shockwave. Jiangmen Underground Neutrino Observatory designed a protection structure for each 20-inch PMT, consisting of a top cover, a bottom cover, and their connection. This paper introduces the requirement and design of the PMT protection system, including the material selection, investigation of manufacture technology, and prototyping. Optimization and validation by simulation and underwater experiments are also presented.


title: Out-of-plane polarization and topological magnetic vortices in multiferroic CrPSe$_3$

abstract: Two-dimensional (2D) multiferroic materials are ideal systems for exploring new coupling mechanisms between different ferroic orders and producing novel quantum phenomena with potential applications. We employed first-principles density functional theory calculations to discover intrinsic ferroelectric and anti-ferroelectric phases of CrPSe$_3$, which show ferromagnetic order and compete with the centrosymmetric phase with an antiferromagnetic order. Our analysis show that the electrical dipoles of such type-I multiferroic phases come from the out-of-plane displacements of phosphorus ions due to the stereochemically active lone pairs. The coupling between polar and magnetic orders creates the opportunity for tunning the magnetic ground state by switching from the centrosymmetric to the ferroelectric phase using an out-of-plane electric field. In ferroelectric and antiferroelectric phases, the combination of easy-plane anisotropy and Dzyaloshinskii-Moriya interactions (DMI) indicate they can host topological magnetic vortices like meron pairs.


title: HAPI: A Large-scale Longitudinal Dataset of Commercial ML API Predictions

abstract: Commercial ML APIs offered by providers such as Google, Amazon and Microsoft have dramatically simplified ML adoption in many applications. Numerous companies and academics pay to use ML APIs for tasks such as object detection, OCR and sentiment analysis. Different ML APIs tackling the same task can have very heterogeneous performance. Moreover, the ML models underlying the APIs also evolve over time. As ML APIs rapidly become a valuable marketplace and a widespread way to consume machine learning, it is critical to systematically study and compare different APIs with each other and to characterize how APIs change over time. However, this topic is currently underexplored due to the lack of data. In this paper, we present HAPI (History of APIs), a longitudinal dataset of 1,761,417 instances of commercial ML API applications (involving APIs from Amazon, Google, IBM, Microsoft and other providers) across diverse tasks including image tagging, speech recognition and text mining from 2020 to 2022. Each instance consists of a query input for an API (e.g., an image or text) along with the API's output prediction/annotation and confidence scores. HAPI is the first large-scale dataset of ML API usages and is a unique resource for studying ML-as-a-service (MLaaS). As examples of the types of analyses that HAPI enables, we show that ML APIs' performance change substantially over time--several APIs' accuracies dropped on specific benchmark datasets. Even when the API's aggregate performance stays steady, its error modes can shift across different subtypes of data between 2020 and 2022. Such changes can substantially impact the entire analytics pipelines that use some ML API as a component. We further use HAPI to study commercial APIs' performance disparities across demographic subgroups over time. HAPI can stimulate more research in the growing field of MLaaS.


title: Strong Dzyaloshinskii-Moriya Interaction in Monolayer CrI$_3$ on Metal Substrates

abstract: Dzyaloshinskii-Moriya interaction (DMI) is the primary mechanism for realizing real-space chiral spin textures, which are regarded as key components for the next-generation spintronics. However, DMI arises from a perturbation term of the spin-orbit interaction and is usually weak in pristine magnetic semiconductors. To date, large DMI and the resulting skyrmions are only realized in a few materials under stringent conditions. Using first-principles calculations, we demonstrate that significant DMI occurs between nearest-neighbor Cr atoms in two-dimensional (2D) magnetic semiconductor CrI$_3$ on Au or Cu substrates. This exceptionally strong DMI is generated by the interfacial charge transfer and weak chemical interactions between chromium halides and metal substrates, which break the spatial inversion symmetry. These findings highlight the significance of substrate effects in 2D magnets and expand the inventory of feasible materials with strong DMI.


title: SDFE-LV: A Large-Scale, Multi-Source, and Unconstrained Database for Spotting Dynamic Facial Expressions in Long Videos

abstract: In this paper, we present a large-scale, multi-source, and unconstrained database called SDFE-LV for spotting the onset and offset frames of a complete dynamic facial expression from long videos, which is known as the topic of dynamic facial expression spotting (DFES) and a vital prior step for lots of facial expression analysis tasks. Specifically, SDFE-LV consists of 1,191 long videos, each of which contains one or more complete dynamic facial expressions. Moreover, each complete dynamic facial expression in its corresponding long video was independently labeled for five times by 10 well-trained annotators. To the best of our knowledge, SDFE-LV is the first unconstrained large-scale database for the DFES task whose long videos are collected from multiple real-world/closely real-world media sources, e.g., TV interviews, documentaries, movies, and we-media short videos. Therefore, DFES tasks on SDFE-LV database will encounter numerous difficulties in practice such as head posture changes, occlusions, and illumination. We also provided a comprehensive benchmark evaluation from different angles by using lots of recent state-of-the-art deep spotting methods and hence researchers interested in DFES can quickly and easily get started. Finally, with the deep discussions on the experimental evaluation results, we attempt to point out several meaningful directions to deal with DFES tasks and hope that DFES can be better advanced in the future. In addition, SDFE-LV will be freely released for academic use only as soon as possible.


title: Mutual Harmony: Sequential Recommendation with Dual Contrastive Network

abstract: With the outbreak of today's streaming data, the sequential recommendation is a promising solution to achieve time-aware personalized modeling. It aims to infer the next interacted item of a given user based on the historical item sequence. Some recent works tend to improve the sequential recommendation via random masking on the historical item so as to generate self-supervised signals. But such approaches will indeed result in sparser item sequence and unreliable signals. Besides, the existing sequential recommendation models are only user-centric, i.e., based on the historical items by chronological order to predict the probability of candidate items, which ignores whether the items from a provider can be successfully recommended. Such user-centric recommendation will make it impossible for the provider to expose their new items, failing to consider the accordant interactions between user and item dimensions. In this paper, we propose a novel Dual Contrastive Network (DCN) to achieve mutual harmony between user and item provider, generating ground-truth self-supervised signals for sequential recommendation by auxiliary user-sequence from an item-centric dimension. Specifically, we propose dual representation contrastive learning to refine the representation learning by minimizing the Euclidean distance between the representations of a given user/item and historical items/users of them. Before the second contrastive learning module, we perform the next user prediction to capture the trends of items preferred by certain types of users and provide personalized exploration opportunities for item providers. Finally, we further propose dual interest contrastive learning to self-supervise the dynamic interest from the next item/user prediction and static interest of matching probability. Experiments on four benchmark datasets verify the effectiveness of our proposed method.


title: A standing Leidenfrost drop with Sufi-whirling

abstract: The mobility of Leidenfrost drop has been exploited for the manipulation of drop motions. In the classical model, the Leidenfrost drop was levitated by a vapor cushion, in the absence of touch to the surface. Here we report a standing Leidenfrost state on a heated hydrophobic surface where drop stands on the surface with partial adhesion and further self-rotates like Sufi-whirling. To elucidate this new phenomenon, we imaged the evolution of the partial adhesion, the inner circulation, and the ellipsoidal rotation of the drop. The stable partial adhesion is accompanied by thermal and mechanical equilibrium, and further drives the development of the drop rotation.


title: NeuCEPT: Locally Discover Neural Networks' Mechanism via Critical Neurons Identification with Precision Guarantee

abstract: Despite recent studies on understanding deep neural networks (DNNs), there exists numerous questions on how DNNs generate their predictions. Especially, given similar predictions on different input samples, are the underlying mechanisms generating those predictions the same? In this work, we propose NeuCEPT, a method to locally discover critical neurons that play a major role in the model's predictions and identify model's mechanisms in generating those predictions. We first formulate a critical neurons identification problem as maximizing a sequence of mutual-information objectives and provide a theoretical framework to efficiently solve for critical neurons while keeping the precision under control. NeuCEPT next heuristically learns different model's mechanisms in an unsupervised manner. Our experimental results show that neurons identified by NeuCEPT not only have strong influence on the model's predictions but also hold meaningful information about model's mechanisms.


title: Factorization of polynomials in hyperbolic geometry and dynamics

abstract: Using factorization theorems for sparse polynomials, we compute the trace field of Dehn fillings of the Whitehead link, and (assuming Lehmer's Conjecture) the minimal polynomial of the small dilatation pseudo-Anosov maps and the trace field of fillings of the figure-8 knot. These results depend on the degrees of the trace fields over Q being sufficiently large.


title: TomocuPy: efficient GPU-based tomographic reconstruction with asynchronous data processing

abstract: Fast 3D data analysis and steering of a tomographic experiment by changing environmental conditions or acquisition parameters require fast, close to real-time, 3D reconstruction of large data volumes. Here we present a performance-optimized TomocuPy package as a GPU alternative to the commonly-used CPU-based TomoPy package for tomographic reconstruction. TomocuPy utilizes modern hardware capabilities to organize a 3D asynchronous reconstruction involving parallel read-write operations with storage drives, CPU-GPU data transfers, and GPU computations. In the asynchronous reconstruction, all the operations are timely overlapped to almost fully hide all data management time. Since most cameras work with less than 16-bit digital output, we furthermore optimize the memory usage and processing speed by using 16-bit floating-point arithmetic. As a result, 3D reconstruction with TomocuPy became 20-30 times faster than its multithreaded CPU equivalent. Full reconstruction (including read-write operations and methods initialization) of a 2048x2048x2048 tomographic volume takes less than 7~s on a single Nvidia Tesla A100 and PCIe 4.0 NVMe SSD, and scales almost linearly increasing the data size. To simplify operation at synchrotron beamlines, TomocuPy provides an easy-to-use command-line interface. Efficacy of the package was demonstrated during a tomographic experiment on gas-hydrate formation in porous samples, where a steering option was implemented as a lens-changing mechanism for zooming to regions of interest.


title: A counterexample to the periodic tiling conjecture (announcement)

abstract: The periodic tiling conjecture asserts that any finite subset of a lattice $\mathbb{Z^d}$ which tiles that lattice by translations, in fact tiles periodically. We announce here a disproof of this conjecture for sufficiently large $d$, which also implies a disproof of the corresponding conjecture for Euclidean spaces $\mathbb{R^d}$. In fact, we also obtain a counterexample in a group of the form $\mathbb{Z^2} \times G_0$ for some finite abelian $G_0$. Our methods rely on encoding a certain class of "$p$-adically structured functions" in terms of certain functional equations.


title: MetaDIP: Accelerating Deep Image Prior with Meta Learning

abstract: Deep image prior (DIP) is a recently proposed technique for solving imaging inverse problems by fitting the reconstructed images to the output of an untrained convolutional neural network. Unlike pretrained feedforward neural networks, the same DIP can generalize to arbitrary inverse problems, from denoising to phase retrieval, while offering competitive performance at each task. The central disadvantage of DIP is that, while feedforward neural networks can reconstruct an image in a single pass, DIP must gradually update its weights over hundreds to thousands of iterations, at a significant computational cost. In this work we use meta-learning to massively accelerate DIP-based reconstructions. By learning a proper initialization for the DIP weights, we demonstrate a 10x improvement in runtimes across a range of inverse imaging tasks. Moreover, we demonstrate that a network trained to quickly reconstruct faces also generalizes to reconstructing natural image patches.


title: EMaP: Explainable AI with Manifold-based Perturbations

abstract: In the last few years, many explanation methods based on the perturbations of input data have been introduced to improve our understanding of decisions made by black-box models. The goal of this work is to introduce a novel perturbation scheme so that more faithful and robust explanations can be obtained. Our study focuses on the impact of perturbing directions on the data topology. We show that perturbing along the orthogonal directions of the input manifold better preserves the data topology, both in the worst-case analysis of the discrete Gromov-Hausdorff distance and in the average-case analysis via persistent homology. From those results, we introduce EMaP algorithm, realizing the orthogonal perturbation scheme. Our experiments show that EMaP not only improves the explainers' performance but also helps them overcome a recently-developed attack against perturbation-based methods.


title: High-efficiency optical frequency mixing in an all-dielectric metasurface enabled by multiple bound states in the continuum

abstract: We present nonlinear optical four-wave mixing in a silicon nanodisk dimer metasurface. Under the oblique incident plane waves, the designed metasurface exhibits a multi-resonant feature with simultaneous excitations of three quasi-bound states in the continuum (BIC). Through employing these quasi-BICs with maximizing electric field energy at the input bump wavelengths, significant enhancement of third-order nonlinear processes including third-harmonic generation, degenerate and non-degenerate four-wave mixing are demonstrated, giving rise to ten new frequencies in the visible wavelengths. This work may lead to a new frontier of ultracompact optical mixer for applications in optical circuitry, ultrasensitive sensing, and quantum nanophotonics.


title: TODE-Trans: Transparent Object Depth Estimation with Transformer

abstract: Transparent objects are widely used in industrial automation and daily life. However, robust visual recognition and perception of transparent objects have always been a major challenge. Currently, most commercial-grade depth cameras are still not good at sensing the surfaces of transparent objects due to the refraction and reflection of light. In this work, we present a transformer-based transparent object depth estimation approach from a single RGB-D input. We observe that the global characteristics of the transformer make it easier to extract contextual information to perform depth estimation of transparent areas. In addition, to better enhance the fine-grained features, a feature fusion module (FFM) is designed to assist coherent prediction. Our empirical evidence demonstrates that our model delivers significant improvements in recent popular datasets, e.g., 25% gain on RMSE and 21% gain on REL compared to previous state-of-the-art convolutional-based counterparts in ClearGrasp dataset. Extensive results show that our transformer-based model enables better aggregation of the object's RGB and inaccurate depth information to obtain a better depth representation. Our code and the pre-trained model will be available at https://github.com/yuchendoudou/TODE.


title: Deep Learning-Based Rate-Splitting Multiple Access for Reconfigurable Intelligent Surface-Aided Tera-Hertz Massive MIMO

abstract: Reconfigurable intelligent surface (RIS) can significantly enhance the service coverage of Tera-Hertz massive multiple-input multiple-output (MIMO) communication systems. However, obtaining accurate high-dimensional channel state information (CSI) with limited pilot and feedback signaling overhead is challenging, severely degrading the performance of conventional spatial division multiple access. To improve the robustness against CSI imperfection, this paper proposes a deep learning (DL)-based rate-splitting multiple access (RSMA) scheme for RIS-aided Tera-Hertz multi-user MIMO systems. Specifically, we first propose a hybrid data-model driven DL-based RSMA precoding scheme, including the passive precoding at the RIS as well as the analog active precoding and the RSMA digital active precoding at the base station (BS). To realize the passive precoding at the RIS, we propose a Transformer-based data-driven RIS reflecting network (RRN). As for the analog active precoding at the BS, we propose a match-filter based analog precoding scheme considering that the BS and RIS adopt the LoS-MIMO antenna array architecture. As for the RSMA digital active precoding at the BS, we propose a low-complexity approximate weighted minimum mean square error (AWMMSE) digital precoding scheme. Furthermore, for better precoding performance as well as lower computational complexity, a model-driven deep unfolding active precoding network (DFAPN) is also designed by combining the proposed AWMMSE scheme with DL. Then, to acquire accurate CSI at the BS for the investigated RSMA precoding scheme to achieve higher spectral efficiency, we propose a CSI acquisition network (CAN) with low pilot and feedback signaling overhead, where the downlink pilot transmission, CSI feedback at the user equipments (UEs), and CSI reconstruction at the BS are modeled as an end-to-end neural network based on Transformer.


title: Observation of axisymmetric standard magnetorotational instability in the laboratory

abstract: We report the first direct evidence for the axisymmetric standard magnetorotational instability (SMRI) from a combined experimental and numerical study of a magnetized liquid-metal shear flow in a Taylor-Couette cell with independently rotating and electrically conducting end caps. When a uniform vertical magnetic field $B_i$ is applied along the rotation axis, the measured radial magnetic field $B_r$ on the inner cylinder increases linearly with a small magnetic Reynolds number $Rm$ due to the magnetization of the residue Ekman circulation. Onset of the axisymmetric SMRI is identified from the nonlinear increase of $B_r$ beyond a critical $Rm$ in both experiments and nonlinear numerical simulations. The axisymmetric SMRI exists only at sufficiently large $Rm$ and intermediate $B_i$, a feature consistent with theoretical predictions. Our simulations further show that the axisymmetric SMRI causes the velocity and magnetic fields to contribute an outward flux of axial angular momentum in the bulk region, just as it should in accretion disks.


title: Data-driven Adaptation for Robust Bipedal Locomotion with Step-to-Step Dynamics

abstract: This paper presents an online framework for synthesizing agile locomotion for bipedal robots that adapts to unknown environments, modeling errors, and external disturbances. To this end, we leverage step-to-step (S2S) dynamics which has proven effective in realizing dynamic walking on underactuated robots -- assuming known dynamics and environments. This paper considers the case of uncertain models and environments and presents a data-driven representation of the S2S dynamics that can be learned via an adaptive control approach that is both data-efficient and easy to implement. The learned S2S controller generates desired discrete foot placement, which is then realized on the full-order dynamics of the bipedal robot by tracking desired outputs synthesized from the given foot placement. The benefits of the proposed approach are twofold. First, it improves the ability of the robot to walk at a given desired velocity when compared to the non-adaptive baseline controller. Second, the data-driven approach enables stable and agile locomotion under the effect of various unknown disturbances: additional unmodeled payload, large robot model errors, external disturbance forces, biased velocity estimation, and sloped terrains. This is demonstrated through in-depth evaluation with a high-fidelity simulation of the bipedal robot Cassie subject to the aforementioned disturbances.


title: StereoVoxelNet: Real-Time Obstacle Detection Based on Occupancy Voxels from a Stereo Camera Using Deep Neural Networks

abstract: Obstacle detection is a safety-critical problem in robot navigation, where stereo matching is a popular vision-based approach. While deep neural networks have shown impressive results in computer vision, most of the previous obstacle detection works only leverage traditional stereo matching techniques to meet the computational constraints for real-time feedback. This paper proposes a computationally efficient method that employs a deep neural network to detect occupancy from stereo images directly. Instead of learning the point cloud correspondence from the stereo data, our approach extracts the compact obstacle distribution based on volumetric representations. In addition, we prune the computation of safety irrelevant spaces in a coarse-to-fine manner based on octrees generated by the decoder. As a result, we achieve real-time performance on the onboard computer (NVIDIA Jetson TX2). Our approach detects obstacles accurately in the range of 32 meters and achieves better IoU (Intersection over Union) and CD (Chamfer Distance) scores with only 2% of the computation cost of the state-of-the-art stereo model. Furthermore, we validate our method's robustness and real-world feasibility through autonomous navigation experiments with a real robot. Hence, our work contributes toward closing the gap between the stereo-based system in robot perception and state-of-the-art stereo models in computer vision. To counter the scarcity of high-quality real-world indoor stereo datasets, we collect a 1.36 hours stereo dataset with a mobile robot which is used to fine-tune our model. The dataset, the code, and further details including additional visualizations are available at https://lhy.xyz/stereovoxelnet


title: Tunable strong plasmon-exciton coupling based on borophene and deep subwavelength perovskite grating

abstract: Two-dimensional materials support deeply confined and tunable plasmonic modes, which have great potential for achieving device miniaturization and flexible manipulation. In this paper, we propose a diffraction-unlimited system composed of borophene layer and perovskite grating to investigate the strong coupling between the borophene guiding plasmon (BGP) and perovskite exciton (PE) mode. The resonant energy of BGP mode could be electrically tuned to match the energy of PE mode, and a remarkable Rabi splitting is attained under zero-detuning condition. The splitting energy could reach 230 meV due to the strong field enhancement provided by BGP mode. Consequently, an active reflective phase modulation with 1.76{\pi} range is achieved by dynamically manipulating the detuning. Furthermore, by increasing the distance between the borophene layer and perovskite grating, a parity-time symmetry breaking could be observed with the vanished energy splitting. Our results deepen the understanding of light-matter interaction at the sub-wavelength scale and provide a guideline for designing active plasmonic devices.


title: Random Fourier Features for Asymmetric Kernels

abstract: The random Fourier features (RFFs) method is a powerful and popular technique in kernel approximation for scalability of kernel methods. The theoretical foundation of RFFs is based on the Bochner theorem that relates symmetric, positive definite (PD) functions to probability measures. This condition naturally excludes asymmetric functions with a wide range applications in practice, e.g., directed graphs, conditional probability, and asymmetric kernels. Nevertheless, understanding asymmetric functions (kernels) and its scalability via RFFs is unclear both theoretically and empirically. In this paper, we introduce a complex measure with the real and imaginary parts corresponding to four finite positive measures, which expands the application scope of the Bochner theorem. By doing so, this framework allows for handling classical symmetric, PD kernels via one positive measure; symmetric, non-positive definite kernels via signed measures; and asymmetric kernels via complex measures, thereby unifying them into a general framework by RFFs, named AsK-RFFs. Such approximation scheme via complex measures enjoys theoretical guarantees in the perspective of the uniform convergence. In algorithmic implementation, to speed up the kernel approximation process, which is expensive due to the calculation of total mass, we employ a subset-based fast estimation method that optimizes total masses on a sub-training set, which enjoys computational efficiency in high dimensions. Our AsK-RFFs method is empirically validated on several typical large-scale datasets and achieves promising kernel approximation performance, which demonstrate the effectiveness of AsK-RFFs.


title: Novel Constructions of Mutually Unbiased Tripartite Absolutely Maximally Entangled Bases

abstract: We develop a new technique to construct mutually unbiased tripartite absolutely maximally entangled bases. We first explore the tripartite absolutely maximally entangled bases and mutually unbiased bases in $\mathbb{C}^{d} \otimes \mathbb{C}^{d} \otimes \mathbb{C}^{d}$ based on mutually orthogonal Latin squares. Then we generalize the approach to the case of $\mathbb{C}^{d_{1}} \otimes \mathbb{C}^{d_{2}} \otimes \mathbb{C}^{d_{1}d_{2}}$ by mutually weak orthogonal Latin squares. The concise direct constructions of mutually unbiased tripartite absolutely maximally entangled bases are remarkably presented with generality. Detailed examples in $\mathbb{C}^{3} \otimes \mathbb{C}^{3} \otimes \mathbb{C}^{3},$ $\mathbb{C}^{2} \otimes \mathbb{C}^{2} \otimes \mathbb{C}^{4}$ and $\mathbb{C}^{2} \otimes \mathbb{C}^{5} \otimes \mathbb{C}^{10}$ are provided to illustrate the advantages of our approach.


title: Active Defense Analysis of Blockchain Forking through the Spatial-Temporal Lens

abstract: Forking breaches the security and performance of blockchain as it is symptomatic of distributed consensus, spurring wide interest in analyzing and resolving it. The state-of-the-art works can be categorized into two kinds: experiment-based and model-based. However, the former falls short in exclusiveness since the derived observations are scenario-specific. Hence, it is problematic to abstractly reveal the crystal-clear forking laws. Besides, the models established in the latter are spatiality-free, which totally overlook the fact that forking is essentially an undesirable result under a given topology. Moreover, few of the ongoing studies have yielded to the active defense mechanisms but only recognized forking passively, which impedes forking prevention and cannot deter it at the source. In this paper, we fill the gap by carrying out the active defense analysis of blockchain forking from the spatial-temporal dimension. Our work is featured by the following two traits: 1) dual dimensions. We consider the spatiality of blockchain overlay network besides temporal characteristics, based on which, a spatial-temporal model for information propagation in blockchain is proposed; 2) active defense. We hint that shrinking the long-range link factor, which indicates the remote connection ability of a link, can cut down forking completely fundamentally. To the best of our knowledge, we are the first to inspect forking from the spatial-temporal perspective, so as to present countermeasures proactively. Solid theoretical derivations and extensive simulations are conducted to justify the validity and effectiveness of our analysis.


title: Partial wave analysis of the charmed baryon hadronic decay $\Lambda_c^+\to\Lambda\pi^+\pi^0$

abstract: Based on $e^+e^-$ collision samples corresponding to an integrated luminosity of 4.4 $\mbox{fb$^{-1}$}$ collected with the BESIII detector at center-of-mass energies between $4.6\,\,\mathrm{GeV}$ and $4.7\,\,\mathrm{GeV}$, a partial wave analysis of the charmed baryon hadronic decay $\Lambda_c^+\to\Lambda\pi^+\pi^0$ is performed, and the decays $\Lambda_c^+\to\Lambda\rho(770)^{+}$ and $\Lambda_c^+\to\Sigma(1385)\pi$ are studied for the first time. Making use of the world-average branching fraction $\mathcal{B}(\Lambda_c^+\to\Lambda\pi^+\pi^0)$, their branching fractions are determined to be \begin{eqnarray*} \begin{aligned} \mathcal{B}(\Lambda_c^+\to\Lambda\rho(770)^+)=&(4.06\pm0.30\pm0.35\pm0.23)\times10^{-2},\\ \mathcal{B}(\Lambda_c^+\to\Sigma(1385)^+\pi^0)=&(5.86\pm0.49\pm0.52\pm0.35)\times10^{-3},\\ \mathcal{B}(\Lambda_c^+\to\Sigma(1385)^0\pi^+)=&(6.47\pm0.59\pm0.66\pm0.38)\times10^{-3},\\ \end{aligned} \end{eqnarray*} where the first uncertainties are statistical, the second are systematic, and the third are from the uncertainties of the branching fractions $\mathcal{B}(\Lambda_c^+\to\Lambda\pi^+\pi^0)$ and $\mathcal{B}(\Sigma(1385)\to\Lambda\pi)$. In addition, %according to amplitudes determined from the partial wave analysis, the decay asymmetry parameters are measured to be $\alpha_{\Lambda\rho(770)^+}=-0.763\pm0.053\pm0.045$, $\alpha_{\Sigma(1385)^{+}\pi^0}=-0.917\pm0.069\pm0.056$, and $\alpha_{\Sigma(1385)^{0}\pi^+}=-0.789\pm0.098\pm0.056$.


title: Active Metric-Semantic Mapping by Multiple Aerial Robots

abstract: Traditional approaches for active mapping focus on building geometric maps. For most real-world applications, however, actionable information is related to semantically meaningful objects in the environment. We propose an approach to the active metric-semantic mapping problem that enables multiple heterogeneous robots to collaboratively build a map of the environment. The robots actively explore to minimize the uncertainties in both semantic (object classification) and geometric (object modeling) information. We represent the environment using informative but sparse object models, each consisting of a basic shape and a semantic class label, and characterize uncertainties empirically using a large amount of real-world data. Given a prior map, we use this model to select actions for each robot to minimize uncertainties. The performance of our algorithm is demonstrated through multi-robot experiments in diverse real-world environments. The proposed framework is applicable to a wide range of real-world problems, such as precision agriculture, infrastructure inspection, and asset mapping in factories. A demo video can be found at https://youtu.be/S86SgXi54oU.


title: Simplifying Model-based RL: Learning Representations, Latent-space Models, and Policies with One Objective

abstract: While reinforcement learning (RL) methods that learn an internal model of the environment have the potential to be more sample efficient than their model-free counterparts, learning to model raw observations from high dimensional sensors can be challenging. Prior work has addressed this challenge by learning low-dimensional representation of observations through auxiliary objectives, such as reconstruction or value prediction. However, the alignment between these auxiliary objectives and the RL objective is often unclear. In this work, we propose a single objective which jointly optimizes a latent-space model and policy to achieve high returns while remaining self-consistent. This objective is a lower bound on expected returns. Unlike prior bounds for model-based RL on policy exploration or model guarantees, our bound is directly on the overall RL objective. We demonstrate that the resulting algorithm matches or improves the sample-efficiency of the best prior model-based and model-free RL methods. While sample efficient methods typically are computationally demanding, our method attains the performance of SAC in about 50% less wall-clock time.


title: Hierarchical fuzzy neural networks with privacy preservation for heterogeneous big data

abstract: Heterogeneous big data poses many challenges in machine learning. Its enormous scale, high dimensionality, and inherent uncertainty make almost every aspect of machine learning difficult, from providing enough processing power to maintaining model accuracy to protecting privacy. However, perhaps the most imposing problem is that big data is often interspersed with sensitive personal data. Hence, we propose a privacy-preserving hierarchical fuzzy neural network (PP-HFNN) to address these technical challenges while also alleviating privacy concerns. The network is trained with a two-stage optimization algorithm, and the parameters at low levels of the hierarchy are learned with a scheme based on the well-known alternating direction method of multipliers, which does not reveal local data to other agents. Coordination at high levels of the hierarchy is handled by the alternating optimization method, which converges very quickly. The entire training procedure is scalable, fast and does not suffer from gradient vanishing problems like the methods based on back-propagation. Comprehensive simulations conducted on both regression and classification tasks demonstrate the effectiveness of the proposed model.


title: Human Performance Modeling and Rendering via Neural Animated Mesh

abstract: We have recently seen tremendous progress in the neural advances for photo-real human modeling and rendering. However, it's still challenging to integrate them into an existing mesh-based pipeline for downstream applications. In this paper, we present a comprehensive neural approach for high-quality reconstruction, compression, and rendering of human performances from dense multi-view videos. Our core intuition is to bridge the traditional animated mesh workflow with a new class of highly efficient neural techniques. We first introduce a neural surface reconstructor for high-quality surface generation in minutes. It marries the implicit volumetric rendering of the truncated signed distance field (TSDF) with multi-resolution hash encoding. We further propose a hybrid neural tracker to generate animated meshes, which combines explicit non-rigid tracking with implicit dynamic deformation in a self-supervised framework. The former provides the coarse warping back into the canonical space, while the latter implicit one further predicts the displacements using the 4D hash encoding as in our reconstructor. Then, we discuss the rendering schemes using the obtained animated meshes, ranging from dynamic texturing to lumigraph rendering under various bandwidth settings. To strike an intricate balance between quality and bandwidth, we propose a hierarchical solution by first rendering 6 virtual views covering the performer and then conducting occlusion-aware neural texture blending. We demonstrate the efficacy of our approach in a variety of mesh-based applications and photo-realistic free-view experiences on various platforms, i.e., inserting virtual human performances into real environments through mobile AR or immersively watching talent shows with VR headsets.


title: Fluctuating Non-linear Non-equilibrium System in Terms of Nambu Thermodynamics

abstract: It is shown that the structure of non-equilibrium thermodynamic system far from equilibrium can be captured in terms of a generalized "Nambu dynamics", in the presence of fluctuation effects in non-equilibrium thermodynamics. Triangular reactions are examined in detail, and it is shown that Nambu brackets can be used to describe them even when they are far from equilibrium, such as with cycles. Time evolution of the non-equilibrium state using the Hamiltonian and entropy is analyzed and it is shown that the entropy evolution is periodic with the negative contribution caused by the Hamiltonian suppressing the increase caused by entropy. As concrete examples, chemical reaction systems with time oscillation, such as the Belousov-Zhabotinsky reaction (BZ reaction), Hindmarsh-Rose(H-R) mode, are examined.

categories: cond-mat.stat-mech hep-th nlin.CD physics.chem-ph


title: GaitMM: Multi-Granularity Motion Sequence Learning for Gait Recognition

abstract: Gait recognition aims to identify individual-specific walking patterns by observing the different periodic movements of each body part. However, most existing methods treat each part equally and fail to account for the data redundancy caused by the different step frequencies and sampling rates of gait sequences. In this study, we propose a multi-granularity motion representation network (GaitMM) for gait sequence learning. In GaitMM, we design a combined full-body and fine-grained sequence learning module (FFSL) to explore part-independent spatio-temporal representations. Moreover, we utilize a frame-wise compression strategy, referred to as multi-scale motion aggregation (MSMA), to capture discriminative information in the gait sequence. Experiments on two public datasets, CASIA-B and OUMVLP, show that our approach reaches state-of-the-art performances.


title: MIPI 2022 Challenge on RGBW Sensor Re-mosaic: Dataset and Report

abstract: Developing and integrating advanced image sensors with novel algorithms in camera systems are prevalent with the increasing demand for computational photography and imaging on mobile platforms. However, the lack of high-quality data for research and the rare opportunity for in-depth exchange of views from industry and academia constrain the development of mobile intelligent photography and imaging (MIPI). To bridge the gap, we introduce the first MIPI challenge including five tracks focusing on novel image sensors and imaging algorithms. In this paper, RGBW Joint Remosaic and Denoise, one of the five tracks, working on the interpolation of RGBW CFA to Bayer at full resolution, is introduced. The participants were provided with a new dataset including 70 (training) and 15 (validation) scenes of high-quality RGBW and Bayer pairs. In addition, for each scene, RGBW of different noise levels was provided at 0dB, 24dB, and 42dB. All the data were captured using an RGBW sensor in both outdoor and indoor conditions. The final results are evaluated using objective metrics including PSNR, SSIM, LPIPS, and KLD. A detailed description of all models developed in this challenge is provided in this paper. More details of this challenge and the link to the dataset can be found at https://github.com/mipi-challenge/MIPI2022.


title: Multi-scale analysis of rural and urban areas: A case study of Indian districts

abstract: This paper explores the extension of the idea of allometric urban scaling law to study the scaling behaviour of Indian districts, with both the urban and rural population. To proceed, we have chosen districts (both rural and urban) of India, a relatively larger local administrative units, which are more or less independently functional within a country. This interdisciplinary work focus on the scaling analysis of various socio-economic indicators (SEIs) corresponding to the size (population) of four distinct urbanization classes, namely rural, semi-rural, semi-urban and urban districts. The scaling exponents were estimated for each classes for the years 2001 and 2011 along with their goodness-of-fit measured by the $R^2$ values. Our rigorous statistical analysis indicates that the scaling laws indeed exist even at the district level for most of the SEIs considered, related to education, employment, housing, health, etc.; the $R^2$ values obtained for these SEIs are very high (often greater than 0.8 or 0.9) in both the the years. Moreover, linearity of the scaling factors have been statistically tested and it has been found, at 95% level of confidence, that not all the SEIs behave linearly; some of them are characterized by super-linear behaviour and some behave sub-linearly. Statistical hypothesis tests have also been performed to test the equality of two scaling factors corresponding to two distinct classes and two different years to understand the differences in scaling relationships among increasing urbanisation classes and their changes over time.


title: Bootstrap Generalization Ability from Loss Landscape Perspective

abstract: Domain generalization aims to learn a model that can generalize well on the unseen test dataset, i.e., out-of-distribution data, which has different distribution from the training dataset. To address domain generalization in computer vision, we introduce the loss landscape theory into this field. Specifically, we bootstrap the generalization ability of the deep learning model from the loss landscape perspective in four aspects, including backbone, regularization, training paradigm, and learning rate. We verify the proposed theory on the NICO++, PACS, and VLCS datasets by doing extensive ablation studies as well as visualizations. In addition, we apply this theory in the ECCV 2022 NICO Challenge1 and achieve the 3rd place without using any domain invariant methods.


title: Superparamagnetic and metal-like Ru2TiGe: a propitious thermoelectric material

abstract: We report a study of structural, magnetic, heat capacity and thermoelectric properties of a Rubased Heusler alloy, Ru2TiGe. The magnetic measurements reveal that at higher temperatures, diamagnetic and Pauli paramagnetic contributions dominate the magnetic behaviour whereas, at lower temperatures (T<= 20 K), superparamagnetic interaction among clusters is observed. Effect of such magnetic defects is also evident in the electrical resistivity behaviour at lower temperatures. Though the temperature dependence of resistivity exhibits a metal-like nature, the large value of Seebeck coefficient leads to an appreciable power factor of the order of 1 mW/mK2 at 300 K. Large power factor as well as low thermal conductivity results in a value of ZT = 0.025 at 390 K for Ru2TiGe that is orders of magnitude higher than that of the other pure Heusler alloys and point towards its high potential for practical thermoelectric applications.


title: Scaling and Load-Balancing Equi-Joins

abstract: The task of joining two tables is fundamental for querying databases. In this paper, we focus on the equi-join problem, where a pair of records from the two joined tables are part of the join results if equality holds between their values in the join column(s). While this is a tractable problem when the number of records in the joined tables is relatively small, it becomes very challenging as the table sizes increase, especially if hot keys (join column values with a large number of records) exist in both joined tables. This paper, an extended version of [metwally-SIGMOD-2022], proposes Adaptive-Multistage-Join (AM-Join) for scalable and fast equi-joins in distributed shared-nothing architectures. AM-Join utilizes (a) Tree-Join, a proposed novel algorithm that scales well when the joined tables share hot keys, and (b) Broadcast-Join, the known fastest when joining keys that are hot in only one table. Unlike the state-of-the-art algorithms, AM-Join (a) holistically solves the join-skew problem by achieving load balancing throughout the join execution, and (b) supports all outer-join variants without record deduplication or custom table partitioning. For the fastest AM-Join outer-join performance, we propose the Index-Broadcast-Join (IB-Join) family of algorithms for Small-Large joins, where one table fits in memory and the other can be up to orders of magnitude larger. The outer-join variants of IB-Join improves on the state-of-the-art Small-Large outer-join algorithms. The proposed algorithms can be adopted in any shared-nothing architecture. We implemented a MapReduce version using Spark. Our evaluation shows the proposed algorithms execute significantly faster and scale to more skewed and orders-of-magnitude bigger tables when compared to the state-of-the-art algorithms.


title: Defense for Advanced Persistent Threat with Inadvertent or Malicious Insider Threats

abstract: In this paper, we propose a game-theoretical framework to investigate advanced persistent threat problems with two types of insider threats: malicious and inadvertent. Within this framework, a unified three-player game is established and Nash equilibria are obtained in response to different insiders. By analyzing Nash equilibria, we provide quantitative solutions to the advanced persistent threat problems with insider threats. Furthermore, optimal defense strategy and defender's cost comparisons between two insider threats have been performed. The findings suggest that the defender should employ more active defense strategies against inadvertent insider threats than against malicious insider threats, despite the fact that malicious insider threats cost the defender more. Our theoretical analysis is validated by numerical results, including an additional examination of the conditions of the risky strategies adopted by different insiders. This may help the defender in determining monitoring intensities and defensive strategies.