title: Wrapped Distributions on homogeneous Riemannian manifolds

abstract: We provide a general framework for constructing probability distributions on Riemannian manifolds, taking advantage of area-preserving maps and isometries. Control over distributions' properties, such as parameters, symmetry and modality yield a family of flexible distributions that are straightforward to sample from, suitable for use within Monte Carlo algorithms and latent variable models, such as autoencoders. As an illustration, we empirically validate our approach by utilizing our proposed distributions within a variational autoencoder and a latent space network model. Finally, we take advantage of the generalized description of this framework to posit questions for future work.


title: Robust Phase Retrieval via Reverse Kullback-Leibler Divergence

abstract: Robustness to noise and outliers is a desirable trait in phase retrieval algorithms for many applications in imaging and signal processing. In this paper, we develop novel robust phase retrieval algorithms based on the minimization of reverse Kullback-Leibler divergence (RKLD) within the Wirtinger Flow (WF) framework. We use RKLD over intensity-only measurements in two distinct ways: i) to design a novel initial estimate based on minimum distortion design of spectral estimates, and ii) as a loss function for iterative refinement based on WF. The RKLD-based loss function offers implicit regularization by processing data at the logarithmic scale and provides the following benefits: suppressing the influence of outliers and promoting projections orthogonal to noise subspace. We perform a quantitative analysis demonstrating the robustness of RKLD-based minimization as compared to that of the $\ell_2$ and Poisson loss-based minimization. We present three algorithms based on RKLD minimization, including two with truncation schemes to enhance the robustness to significant contamination. Our numerical study uses data generated based on synthetic coded diffraction patterns and real optical imaging data. The results demonstrate the advantages of our algorithms in terms of sample efficiency, convergence speed, and robustness with respect to outliers over the state-of-the-art techniques.


title: Assessing Machine Learning Algorithms for Near-Real Time Bus Ridership Prediction During Extreme Weather

abstract: Given an increasingly volatile climate, the relationship between weather and transit ridership has drawn increasing interest. However, challenges stemming from spatio-temporal dependency and non-stationarity have not been fully addressed in modelling and predicting transit ridership under the influence of weather conditions especially with the traditional statistical approaches. Drawing on three-month smart card data in Brisbane, Australia, this research adopts and assesses a suite of machine-learning algorithms, i.e., random forest, eXtreme Gradient Boosting (XGBoost) and Tweedie XGBoost, to model and predict near real-time bus ridership in relation to sudden change of weather conditions. The study confirms that there indeed exists a significant level of spatio-temporal variability of weather-ridership relationship, which produces equally dynamic patterns of prediction errors. Further comparison of model performance suggests that Tweedie XGBoost outperforms the other two machine-learning algorithms in generating overall more accurate prediction outcomes in space and time. Future research may advance the current study by drawing on larger data sets and applying more advanced machine and deep-learning approaches to provide more enhanced evidence for real-time operation of transit systems.


title: Clustering of football players based on performance data and aggregated clustering validity indexes

abstract: We analyse football (soccer) player performance data with mixed type variables from the 2014-15 season of eight European major leagues. We cluster these data based on a tailor-made dissimilarity measure. In order to decide between the many available clustering methods and to choose an appropriate number of clusters, we use the approach by Akhanli and Hennig (2020). This is based on several validation criteria that refer to different desirable characteristics of a clustering. These characteristics are chosen based on the aim of clustering, and this allows to define a suitable validation index as weighted average of calibrated individual indexes measuring the desirable features. We derive two different clusterings. The first one is a partition of the data set into major groups of essentially different players, which can be used for the analysis of a team's composition. The second one divides the data set into many small clusters (with 10 players on average), which can be used for finding players with a very similar profile to a given player. It is discussed in depth what characteristics are desirable for these clusterings. Weighting the criteria for the second clustering is informed by a survey of football experts.


title: On the Generation of Topological Vector Solitons from Bessel-Like Beams

abstract: Coupled solitary waves in optics literature, are coined vector solitons to reflect their particle-like nature that remains intact even after mutual collisions. They are born from a nonlinear change in the refractive index of an optical material induced by the light intensity. We've discovered that the second harmonic intensity profile generated by Bessel-like beams, is composed of solitons of various geometries surrounded by concentric rings; one of which is two central solitons of similar radius knotted by ellipsoidal concentric rings. We observe that their geometry and intensity distribution is dependent on the topological charge of the fundamental Bessel beams incident on the nonlinear medium. We show that their spatial profile is invariant against propagation. We observe that their behavior is similar to that of screw dislocations in wave trains: they collide and rebound at a 90$^\circ$ angle from the beam propagation direction. In this way, we have generated linked frequency doubled Bessel-type vector solitons with different topologies, that are knotted as they oscillate along the optical axis, when propagating in the laboratory environment.


title: SciTS: A Benchmark for Time-Series Databases in Scientific Experiments and Industrial Internet of Things

abstract: Time-series data has an increasingly growing usage in Industrial Internet of Things (IIoT) and large-scale scientific experiments. Managing time-series data needs a storage engine that can keep up with their constantly growing volumes while providing an acceptable query latency. While traditional ACID databases favor consistency over performance, many time-series databases with novel storage engines have been developed to provide better ingestion performance and lower query latency. To understand how the unique design of a time-series database affects its performance, we design SciTS, a highly extensible and parameterizable benchmark for time-series data. The benchmark studies the data ingestion capabilities of time-series databases especially as they grow larger in size. It also studies the latencies of 5 practical queries from the scientific experiments use case. We use SciTS to evaluate the performance of 4 databases of 4 distinct storage engines: ClickHouse, InfluxDB, TimescaleDB, and PostgreSQL.


title: Distributed Runtime Verification of Metric Temporal Properties for Cross-Chain Protocols

abstract: Transactions involving multiple blockchains are implemented by cross-chain protocols. These protocols are based on smart contracts, programs that run on blockchains, executed by a network of computers. Because smart contracts can automatically transfer ownership of cryptocurrencies, electronic securities, and other valuable assets among untrusting parties, verifying the runtime correctness of smart contracts is a problem of compelling practical interest. Such verification is challenging since smart contract execution is time-sensitive, and the clocks on different blockchains may not be perfectly synchronized. This paper describes a method for runtime monitoring of blockchain executions. First, we propose a generalized runtime verification technique for verifying partially synchronous distributed computations for the metric temporal logic (MTL) by exploiting bounded-skew clock synchronization. Second, we introduce a progression-based formula rewriting scheme for monitoring \MTL specifications which employ SMT solving techniques and report experimental results.


title: Multiply-and-Fire (MNF): An Event-driven Sparse Neural Network Accelerator

abstract: Machine learning, particularly deep neural network inference, has become a vital workload for many computing systems, from data centers and HPC systems to edge-based computing. As advances in sparsity have helped improve the efficiency of AI acceleration, there is a continued need for improved system efficiency for both high-performance and system-level acceleration. This work takes a unique look at sparsity with an event (or activation-driven) approach to ANN acceleration that aims to minimize useless work, improve utilization, and increase performance and energy efficiency. Our analytical and experimental results show that this event-driven solution presents a new direction to enable highly efficient AI inference for both CNN and MLP workloads. This work demonstrates state-of-the-art energy efficiency and performance centring on activation-based sparsity and a highly-parallel dataflow method that improves the overall functional unit utilization (at 30 fps). This work enhances energy efficiency over a state-of-the-art solution by 1.46$\times$. Taken together, this methodology presents a novel, new direction to achieve high-efficiency, high-performance designs for next-generation AI acceleration platforms.


title: Mobility unevenness in rock-paper-scissors models

abstract: We investigate a tritrophic system whose cyclic dominance is modelled by the rock-paper-scissors game. We consider that organisms of one or two species are affected by movement limitations, which unbalances the cyclic spatial game. Performing stochastic simulations, we show that mobility unevenness controls the population dynamics. In the case of one slow species, the predominant species depends on the level of mobility restriction, with the slow species being preponderant if the mobility limitations are substantial. If two species face mobility limitations, our outcomes show that being higher dispersive does not constitute an advantage in terms of population growth. On the contrary, if organisms move with higher mobility, they expose themselves to enemies more frequently, being more vulnerable to being eliminated. Finally, our findings show that biodiversity benefits in regions where species are slowed. Biodiversity loss for high mobility organisms, common to cyclic systems, may be avoided with coexistence probability being higher for robust mobility limitations. Our results may help biologists understand the dynamics of unbalanced spatial systems where organisms' dispersal is fundamental to biodiversity conservation.

categories: q-bio.PE cond-mat.stat-mech nlin.AO nlin.PS physics.bio-ph


title: Uniform regularity in the low Mach number and inviscid limits for the full Navier-Stokes system in domains with boundaries

abstract: In the present work, motivated by the studies on the low Mach number limit problem, we establish uniform regularity estimates with respect to the Mach number for the non-isentropic compressible Navier-Stokes system in smooth domains with Navier-slip boundary conditions, in the general case of ill-prepared initial data. The thermal conduction is taken into account and the large variation of temperature is allowed. Moreover, the obtained regularity estimates are also uniform in the Reynolds number $\text{Re}\in[1,+\infty),$ P\'eclet number $\text{Pe}\in [1,+\infty),$ provided $$\big|\frac{1}{\text{Re}}-\frac{\iota_0}{\text{Pe}}\big|\lesssim \frac{1}{\text{Pe}^{\frac{1}{2}}}\frac{1}{\text{Re}},$$ where $\iota_0$ is a fixed constant independent of the Mach number, Reynolds number, and P\'eclet number. The large temperature variation as well as the interactions of two kinds of boundary layers are the main obstacles to the proof.


title: Features of magnetic field switchbacks in relation to the local-field geometry of large-amplitude Alfv\'enic oscillations: \emph{Wind} and \emph{PSP} observations

abstract: In this letter we report observations of magnetic switchback (SB) features near 1 au using data from the \emph{Wind} spacecraft. These features appear to be strikingly similar to the ones observed by the Parker Solar Probe mission (PSP) closer to the Sun: namely, one-sided spikes (or enhancements) in the solar-wind bulk speed $V$ that correlate/anti-correlate with the spikes seen in the radial-field component $B_R$. In the solar-wind streams that we analyzed, these specific SB features near 1 au are associated with large-amplitude Alfv\'enic oscillations that propagate outward from the sun along a local background (prevalent) magnetic field $\bf{B}_0$ that is nearly radial. We also show that, when $\bf{B}_0$ is nearly perpendicular to the radial direction, the large amplitude Alfv\'enic oscillations display variations in $V$ that are two-sided (i.e., $V$ alternately increases and decreases depending on the vector $\Delta\bf{B}=\bf{B} - \bf{B}_0$). As a consequence, SBs may not appear always as one-sided spikes in $V$, especially at larger heliocentric distances where the local background field statistically departs from the radial direction. We suggest that SBs can be well described by large-amplitude Alfv\'enic fluctuations if the field rotation is computed with respect to a well-determined local background field that, in some cases, may deviate from the large-scale Parker field.


title: Exact Formulas for Finite-Time Estimation Errors of Decentralized Temporal Difference Learning with Linear Function Approximation

abstract: In this paper, we consider the policy evaluation problem in multi-agent reinforcement learning (MARL) and derive exact closed-form formulas for the finite-time mean-squared estimation errors of decentralized temporal difference (TD) learning with linear function approximation. Our analysis hinges upon the fact that the decentralized TD learning method can be viewed as a Markov jump linear system (MJLS). Then standard MJLS theory can be applied to quantify the mean and covariance matrix of the estimation error of the decentralized TD method at every time step. Various implications of our exact formulas on the algorithm performance are also discussed. An interesting finding is that under a necessary and sufficient stability condition, the mean-squared TD estimation error will converge to an exact limit at a specific exponential rate.


title: On state transfer in Cayley graphs for abelian groups

abstract: In this paper, we characterize perfect state transfer in Cayley graphs for abelian groups that have a cyclic Sylow-2-subgroup. This generalizes a result of Ba\v{s}i\'c from 2013 where he provides a similar characterization for Cayley graphs of cyclic groups.


title: GUARD: Graph Universal Adversarial Defense

abstract: Graph convolutional networks (GCNs) have been shown to be vulnerable to small adversarial perturbations, which becomes a severe threat and largely limits their applications in security-critical scenarios. To mitigate such a threat, considerable research efforts have been devoted to increasing the robustness of GCNs against adversarial attacks. However, current defense approaches are typically designed to prevent GCNs from untargeted adversarial attacks and focus on overall performance, making it challenging to protect important local nodes from more powerful targeted adversarial attacks. Additionally, a trade-off between robustness and performance is often made in existing research. Such limitations highlight the need for developing an effective and efficient approach that can defend local nodes against targeted attacks, without compromising the overall performance of GCNs. In this work, we present a simple yet effective method, named Graph Universal Adversarial Defense (GUARD). Unlike previous works, GUARD protects each individual node from attacks with a universal defensive patch, which is generated once and can be applied to any node (node-agnostic) in a graph. GUARD is fast, straightforward to implement without any change to network architecture nor any additional parameters, and is broadly applicable to any GCNs. Extensive experiments on four benchmark datasets demonstrate that GUARD significantly improves robustness for several established GCNs against multiple adversarial attacks and outperforms state-of-the-art defense methods by large margins.


title: Weighted Bayesian Gaussian Mixture Model for Roadside LiDAR Object Detection

abstract: Background modeling is widely used for intelligent surveillance systems to detect moving targets by subtracting the static background components. Most roadside LiDAR object detection methods filter out foreground points by comparing new data points to pre-trained background references based on descriptive statistics over many frames (e.g., voxel density, number of neighbors, maximum distance). However, these solutions are inefficient under heavy traffic, and parameter values are hard to transfer from one scenario to another. In early studies, the probabilistic background modeling methods widely used for the video-based system were considered unsuitable for roadside LiDAR surveillance systems due to the sparse and unstructured point cloud data. In this paper, the raw LiDAR data were transformed into a structured representation based on the elevation and azimuth value of each LiDAR point. With this high-order tensor representation, we break the barrier to allow efficient high-dimensional multivariate analysis for roadside LiDAR background modeling. The Bayesian Nonparametric (BNP) approach integrates the intensity value and 3D measurements to exploit the measurement data using 3D and intensity info entirely. The proposed method was compared against two state-of-the-art roadside LiDAR background models, computer vision benchmark, and deep learning baselines, evaluated at point, object, and path levels under heavy traffic and challenging weather. This multimodal Weighted Bayesian Gaussian Mixture Model (GMM) can handle dynamic backgrounds with noisy measurements and substantially enhances the infrastructure-based LiDAR object detection, whereby various 3D modeling for smart city applications could be created.


title: fairDMS: Rapid Model Training by Data and Model Reuse

abstract: Extracting actionable information rapidly from data produced by instruments such as the Linac Coherent Light Source (LCLS-II) and Advanced Photon Source Upgrade (APS-U) is becoming ever more challenging due to high (up to TB/s) data rates. Conventional physics-based information retrieval methods are hard-pressed to detect interesting events fast enough to enable timely focusing on a rare event or correction of an error. Machine learning~(ML) methods that learn cheap surrogate classifiers present a promising alternative, but can fail catastrophically when changes in instrument or sample result in degradation in ML performance. To overcome such difficulties, we present a new data storage and ML model training architecture designed to organize large volumes of data and models so that when model degradation is detected, prior models and/or data can be queried rapidly and a more suitable model retrieved and fine-tuned for new conditions. We show that our approach can achieve up to 100x data labelling speedup compared to the current state-of-the-art, 200x improvement in training speed, and 92x speedup in-terms of end-to-end model updating time.


title: Multi-polariton control in attosecond transient absorption of autoionizing states

abstract: Tunable attosecond transient absorption spectroscopy is an ideal tool for studying and manipulating autoionization dynamics in the continuum. We investigate near-resonant two-photon couplings between the bright 3s^-1 4p and dark 3s^-1 4f autoionizing states of argon that lead to Autler-Townes like interactions, forming entangled light-matter states, or polaritons. We observe that one-photon couplings with intermediate dark states play an important role in this interaction, leading to the formation of multiple polaritonic branches whose energies exhibit avoided crossings as a function of the dressing-laser frequency. Our experimental measurements and theoretical essential-state simulations show good agreement and reveal how the delay, frequency, and intensity of the dressing pulse govern the properties of autoionizing polariton multiplets. These results demonstrate new pathways for quantum control of autoionizing states with optical fields.


title: Quantum Analog of Vibration Isolation: From Room Temperature Superfluorescence to High Temperature Superconductivity

abstract: The development and the use of quantum technologies are hindered by a fundamental challenge: Quantum materials exhibit macroscopic quantum properties at extremely low temperatures due to the loss of quantum coherence at elevated temperatures. Here, based on our recent discovery of room temperature superfluorescence in perovskites, we present the Quantum Analog of Vibration Isolation, 'QAVI', model and explain how it protects the quantum phase against dephasing at high temperatures. We then postulate the requirements for observation of macroscopic quantum phenomena at practical temperatures and propose a unified model for all macroscopic quantum phase transitions. We further present the general features of the temperature and density phase diagram of macroscopic quantum phase transitions that are mediated by the QAVI process and identify the similarities observed in the phase diagram of high Tc superconductors. Understanding this fundamental quantum coherence protection mechanism is imperative to accelerate the discovery of high temperature macroscopic quantum phenomena, and offers significant potential for developing quantum technologies functioning under practical conditions.


title: Strategies to reduce the thermoelastic loss of multimaterial coated finite substrates

abstract: Thermoelastic loss is an important energy dissipation mechanisms in resonant systems. A careful analysis of the thermoelastic loss is critical to the design of low-noise devices for high-precision applications, such as the mirrors used for gravitational-wave detectors. In this paper, we present analytical solutions to the thermoelastic loss due to thermoelasticity between different materials that are in contact. We find expressions for the thermoelastic loss of multimaterial coatings of finite substrates, and analyze its dependencies on material properties, mirror design and operating experimental conditions. Our results show that lower operating mirror temperature, thinner layers and higher number of interfaces in the coating, and the choice of the first layer of the coating that minimizes the thermal expansion mismatch with the substrate are strategies that reduce the thermoelastic loss and, therefore, diminish the thermal noise that limits the resolution in sensing applications. The results presented in this paper are relevant for the development of low-noise gravitational-wave detectors and for other experiments sensitive to energy dissipation mechanisms when different materials are in contact.


title: Photometrically-Classified Superluminous Supernovae from the Pan-STARRS1 Medium Deep Survey: A Case Study for Science with Machine Learning-Based Classification

abstract: With the upcoming Vera C.~Rubin Observatory Legacy Survey of Space and Time (LSST), it is expected that only $\sim 0.1\%$ of all transients will be classified spectroscopically. To conduct studies of rare transients, such as Type I superluminous supernovae (SLSNe), we must instead rely on photometric classification. In this vein, here we carry out a pilot study of SLSNe from the Pan-STARRS1 Medium-Deep Survey (PS1-MDS) classified photometrically with our SuperRAENN and Superphot algorithms. We first construct a sub-sample of the photometric sample using a list of simple selection metrics designed to minimize contamination and ensure sufficient data quality for modeling. We then fit the multi-band light curves with a magnetar spin-down model using the Modular Open-Source Fitter for Transients (MOSFiT). Comparing the magnetar engine and ejecta parameter distributions of the photometric sample to those of the PS1-MDS spectroscopic sample and a larger literature spectroscopic sample, we find that these samples are overall consistent, but that the photometric sample extends to slower spins and lower ejecta masses, which correspond to lower luminosity events, as expected for photometric selection. While our PS1-MDS photometric sample is still smaller than the overall SLSN spectroscopic sample, our methodology paves the way to an orders-of-magnitude increase in the SLSN sample in the LSST era through photometric selection and study.


title: Deep transfer operator learning for partial differential equations under conditional shift

abstract: Transfer learning (TL) enables the transfer of knowledge gained in learning to perform one task (source) to a related but different task (target), hence addressing the expense of data acquisition and labeling, potential computational power limitations, and dataset distribution mismatches. We propose a new TL framework for task-specific learning (functional regression in partial differential equations (PDEs)) under conditional shift based on the deep operator network (DeepONet). Task-specific operator learning is accomplished by fine-tuning task-specific layers of the target DeepONet using a hybrid loss function that allows for the matching of individual target samples while also preserving the global properties of the conditional distribution of target data. Inspired by the conditional embedding operator theory, we minimize the statistical distance between labeled target data and the surrogate prediction on unlabeled target data by embedding conditional distributions onto a reproducing kernel Hilbert space. We demonstrate the advantages of our approach for various TL scenarios involving nonlinear PDEs under diverse conditions due to shift in the geometric domain and model dynamics. Our TL framework enables fast and efficient learning of heterogeneous tasks despite significant differences between the source and target domains.


title: Acoustic-phonon-mediated superconductivity in moir\'eless graphene multilayers

abstract: We investigate the competition between acoustic-phonon-mediated superconductivity and the long-range Coulomb interaction in moir\'eless graphene multilayers, specifically, Bernal bilayer graphene, rhombohedral trilayer graphene, and ABCA-stacked tetralayer graphene. In these graphene multilayers, the acoustic phonons can realize, through electron-phonon coupling, both spin-singlet and spin-triplet pairings, and the intra-sublattice pairings ($s$-wave spin-singlet and $f$-wave spin-triplet) are the dominant channels. Our theory naturally explains the distinct recent experimental findings in Bernal bilayer graphene and rhombohedral trilayer graphene, and we further predict existence of superconductivity in ABCA tetralayer graphene arising from electron-phonon interactions. In particular, we demonstrate that the acoustic-phonon-mediated superconductivity prevails over a wide range of doping in rhombohedral trilayer graphene and ABCA tetralayer graphene while superconductivity exists only in a narrow range of doping near the Van Hove singularity in Bernal bilayer graphene. Key features of our theory are the inclusion of realistic band structures with the appropriate Van Hove singularities and Coulomb repulsion effects (the so-called "$\mu^*$ effect") opposing the phonon-induced superconducting pairing. We also discuss how intervalley scatterings can suppress the spin-triplet spin-polarized superconductivity. Our work provides detailed prediction based on electron-acoustic-phonon-interaction-induced graphene superconductivity, which should be investigated in future experiments.


title: Comment on "On the recurrence times of neutron star X-ray binary transients and the nature of the Galactic Center quiescent X-ray binaries"

abstract: In 2018, we reported our discovery of a dozen quiescent X-ray binaries in the central parsec (pc) of the Galaxy (Hailey et al. 2018). In a recent follow-up paper (Mori et al. 2021), we published an extended analysis of these sources and other X-ray binaries (XRBs) in the central pc and beyond, showing that most if not all of the 12 non-thermal sources are likely black hole low-mass X-ray binary (BH-LMXB) candidates. In response, Maccarone et al. 2022 (TM22 hereafter) argued, primarily on the claim that neutron star low-mass X-ray binaries (NS-LMXBs) often do not have short outburst recurrence times (<~ 10 yr), that they cannot be excluded as a designation for the 12 quiescent X-ray binary sources. TM22 cites three main factors in their study: (1) X-ray outburst data of NS transients detected by RXTE and MAXI, (2) the Galactic population of NS-LMXBs, and (3) (persistently) quiescent NS-LMXBs in globular clusters. We address these arguments of TM22 and correct their misunderstandings of our work and the literature, even though most of these points have already been thoroughly addressed by Mori et al. 2021. We also correct TM22's assertion that our arguments are based solely on NS transients' recurrence times.


title: MashUp: Scaling TCAM-based IP Lookup to Larger Databases by Tiling Trees

abstract: Ternary content addressable memories (TCAMs) are commonly used to implement IP lookup, but suffer from high power and area costs. Thus TCAM included in modern chips is limited and can support moderately large datasets in data centers and enterprises, but fails to scale to backbone WAN databases of millions of prefixes. IPv6 deployment also makes it harder to deploy TCAMs because of the larger prefixes used in the 128-bit address space. While the combination of algorithmic techniques and TCAM has been proposed before for reducing power consumption or update costs(e.g., CoolCAM [32] and TreeCAM [28]), we focus on reducing TCAM bits using a scheme we call MashUp that can easily be implemented in modern reconfigurable pipeline chips such as Tofino-3. MashUp uses a new technique, tiling trees, which takes into account TCAM grain (tile) sizes. When applied to a publicly available IPv6 dataset using Tofino-3 TCAM grain sizes (44 by 512), there was a 2X reduction in TCAM required. Further, if we mix TCAM and SRAM using a new technique we call node hybridization, MashUp decreases TCAM bits by 4.5X for IPv6, and by 7.5X for IPv4, allowing wide area databases of 900,000 prefixes to be supported by Tofino-3 and similar chips


title: The Dwork-Frobenius operator on hypergeometric series

abstract: We describe the action of the Dwork-Frobenius operator on certain $A$-hypergeometric series. As a consequence, we obtain an integrality result for the coefficients of those series. This implies an integrality result for classical hypergeometric series.


title: Parametric Level-sets Enhanced To Improve Reconstruction (PaLEnTIR)

abstract: We introduce PaLEnTIR, a significantly enhanced parametric level-set (PaLS) method addressing the restoration and reconstruction of piecewise constant objects. Our key contribution involves a unique PaLS formulation utilizing a single level-set function to restore scenes containing multi-contrast piecewise-constant objects without requiring knowledge of the number of objects or their contrasts. Unlike standard PaLS methods employing radial basis functions (RBFs), our model integrates anisotropic basis functions (ABFs), thereby expanding its capacity to represent a wider class of shapes. Furthermore, PaLEnTIR improves the conditioning of the Jacobian matrix, required as part of the parameter identification process, and consequently accelerates optimization methods. We validate PaLEnTIR's efficacy through diverse experiments encompassing sparse and limited angle of view X-ray computed tomography (2D and 3D), nonlinear diffuse optical tomography (DOT), denoising, and deconvolution tasks using both real and simulated data sets.


title: A strengthening of Freiman's 3k-4 theorem

abstract: In its usual form, Freiman's 3k-4 theorem states that if A and B are subsets of the integers of size k with small sumset (of size close to 2k) then they are very close to arithmetic progressions. Our aim in this paper is to strengthen this by allowing only a bounded number of possible summands from one of the sets. We show that if A and B are subsets of the integers of size k such that for any four-element subset X of B the sumset A+X has size not much more than 2k then already this implies that A and B are very close to arithmetic progressions.


title: Making the Most of Text Semantics to Improve Biomedical Vision--Language Processing

abstract: Multi-modal data abounds in biomedicine, such as radiology images and reports. Interpreting this data at scale is essential for improving clinical care and accelerating clinical research. Biomedical text with its complex semantics poses additional challenges in vision--language modelling compared to the general domain, and previous work has used insufficiently adapted models that lack domain-specific language understanding. In this paper, we show that principled textual semantic modelling can substantially improve contrastive learning in self-supervised vision--language processing. We release a language model that achieves state-of-the-art results in radiology natural language inference through its improved vocabulary and novel language pretraining objective leveraging semantics and discourse characteristics in radiology reports. Further, we propose a self-supervised joint vision--language approach with a focus on better text modelling. It establishes new state of the art results on a wide range of publicly available benchmarks, in part by leveraging our new domain-specific language model. We release a new dataset with locally-aligned phrase grounding annotations by radiologists to facilitate the study of complex semantic modelling in biomedical vision--language processing. A broad evaluation, including on this new dataset, shows that our contrastive learning approach, aided by textual-semantic modelling, outperforms prior methods in segmentation tasks, despite only using a global-alignment objective.


title: Variance estimation in pseudo-expected estimating equations for missing data

abstract: Missing data is a common challenge in biomedical research. This fact, along with growing dataset volumes of the modern era, make the issue of computationally-efficient analysis with missing data of crucial practical importance. A general computationally-efficient estimation framework for dealing with missing data is the pseudo-expected estimating equations (PEEE) approach. The method is applicable with any parametric model for which estimation involves the solution of a set of estimating equations, such as likelihood score equations. A key limitation of the PEEE approach is that there is currently no closed-form variance estimator, and variance estimation requires the computationally burdensome bootstrap method. In this work, we address the gap and provide a closed-form variance estimator whose computation can be significantly faster than a bootstrap approach. Our variance estimator is shown to be consistent even with auxiliary variables and under misspecified models for the incomplete variables. Simulation studies show that our variance estimator performs well and that its computation can be over 50 times faster than the bootstrap. The computational efficiency gain from our proposed variance estimator is crucial with large datasets or when the main analysis method is computationally intensive. Finally, the PEEE approach along with our variance estimator are used to analyze incomplete electronic health record data of patients with traumatic brain injury.


title: Extensible Database Simulator for Fast Prototyping In-Database Algorithms

abstract: With the rapid increasing of data scale, in-database analytics and learning has become one of the most studied topics in data science community, because of its significance on reducing the gap between the management and the analytics of data. By extending the capability of database on analytics and learning, data scientists can save much time on exchanging data between databases and external analytic tools. For this goal, researchers are attempting to integrate more data science algorithms into database. However, implementing the algorithms in mainstream databases is super time-consuming, especially when it is necessary to have a deep dive into the database kernels. Thus there are demands for an easy-to-extend database simulator to help fast prototype and verify the in-database algorithms before implementing them in real databases. In this demo, we present such an extensible relational database simulator, DBSim, to help data scientists prototype their in-database analytics and learning algorithms and verify the effectiveness of their ideas with minimal cost. DBSim simulates a real relational database by integrating all the major components in mainstream RDBMS, including SQL parser, relational operators, query optimizer, etc. In addition, DBSim provides various interfaces for users to flexibly plug their custom extension modules into any of the major components, without modifying the kernel. By those interfaces, DBSim supports easy extensions on SQL syntax, relational operators, query optimizer rules and cost models, and physical plan execution. Furthermore, DBSim provides utilities to facilitate users' developing and debugging, like query plan visualizer and interactive analyzer on optimization rules. We develop DBSim using pure Python to support seamless implementation of most data science algorithms into it, since many of them are written in Python.


title: Machine Learning for Optical Scanning Probe Nanoscopy

abstract: The ability to perform nanometer-scale optical imaging and spectroscopy is key to deciphering the low-energy effects in quantum materials, as well as vibrational fingerprints in planetary and extraterrestrial particles, catalytic substances, and aqueous biological samples. The scattering-type scanning near-field optical microscopy (s-SNOM) technique has recently spread to many research fields and enabled notable discoveries. In this brief perspective, we show that the s-SNOM, together with scanning probe research in general, can benefit in many ways from artificial intelligence (AI) and machine learning (ML) algorithms. We show that, with the help of AI- and ML-enhanced data acquisition and analysis, scanning probe optical nanoscopy is poised to become more efficient, accurate, and intelligent.


title: Understanding AR Activism: An Interview Study with Creators of Augmented Reality Experiences for Social Change

abstract: The rise of consumer augmented reality (AR) technology has opened up new possibilities for interventions intended to disrupt and subvert cultural conventions. From defacing corporate logos to erecting geofenced digital monuments, more and more people are creating AR experiences for social causes. We sought to understand this new form of activism, including why people use AR for these purposes, opportunities and challenges in using it, and how well it can support activist goals. We conducted semi-structured interviews with twenty people involved in projects that used AR for a social cause across six different countries. We found that AR can overcome physical world limitations of activism to convey immersive, multilayered narratives that aim to reveal invisible histories and perspectives. At the same time, people experienced challenges in creating, maintaining, and distributing their AR experiences to audiences. We discuss open questions and opportunities for creating AR tools and experiences for social change.


title: Nonlocality of electrically-induced spin accumulation in chiral metals

abstract: Spin accumulation induced by an electric field in chiral electron system is investigated based on a linear response theory. It is shown that the spin response function has a spatially uniform component due to the chiral angular momentum generation effect, resulting in a nonlocal spin generation. The result suggests a scenario for nonlocal long-range spin transport in chiral metals reported experimentally recently.


title: Magnetic on-surface assemblies predicted from a pious computational method

abstract: Molecular self-assembly will not become a routine method for building nanomaterials unless our ability to predict the outcome of this process is dramatically improved. Even then, reliable strategies for realizing molecular assemblies with novel properties are required for building nanomaterials for specific device applications. In this paper, I simulate the self-assembly of metal phthalocyanine derivatives adsorbed to gold(111) surfaces using a detailed statistical mechanical model and a new computational method based upon genetic algorithms and Markov chain Monte Carlo (MCMC). This method yields predictions that are not only are superior to those of ordinary MCMC but also show good agreement with experimental results. Crucially, it is predicted that molecular assemblies displaying locally disordered magnetic moments - and having potential applications as non-Gaussian noise sources for device applications - can be realized by the simple strategy of introducing asymmetry into the phthalocyanine ligands.


title: Orbifold Hirzebruch-Riemann-Roch for Quotient Deligne-Mumford Stacks and Equivariant Moduli Theory on $ K3 $ Surfaces

abstract: We study the orbifold Hirzebruch-Riemann-Roch (HRR) theorem for quotient Deligne-Mumford stacks, explore its relation with the representation theory of finite groups, and derive a new orbifold HRR formula via an orbifold Mukai pairing. As a first application, we use this formula to compute the dimensions of $ G $-equivariant moduli spaces of stable sheaves on a $ K3 $ surface $ X $ under the action of a finite subgroup $ G $ of its symplectic automorphism group. We then apply the orbifold HRR formula to reproduce the number of fixed points on $ X $ when $ G $ is cyclic without using the Lefschetz fixed point formula. We prove that under some mild conditions, equivariant moduli spaces of stable sheaves on $ X $ are irreducible symplectic manifolds deformation equivalent to Hilbert schemes of points on $ X $ via a connection between Gieseker and Bridgeland moduli spaces, as well as the derived McKay correspondence.


title: A Revealing Large-Scale Evaluation of Unsupervised Anomaly Detection Algorithms

abstract: Anomaly detection has many applications ranging from bank-fraud detection and cyber-threat detection to equipment maintenance and health monitoring. However, choosing a suitable algorithm for a given application remains a challenging design decision, often informed by the literature on anomaly detection algorithms. We extensively reviewed twelve of the most popular unsupervised anomaly detection methods. We observed that, so far, they have been compared using inconsistent protocols - the choice of the class of interest or the positive class, the split of training and test data, and the choice of hyperparameters - leading to ambiguous evaluations. This observation led us to define a coherent evaluation protocol which we then used to produce an updated and more precise picture of the relative performance of the twelve methods on five widely used tabular datasets. While our evaluation cannot pinpoint a method that outperforms all the others on all datasets, it identifies those that stand out and revise misconceived knowledge about their relative performances.


title: SimMC: Simple Masked Contrastive Learning of Skeleton Representations for Unsupervised Person Re-Identification

abstract: Recent advances in skeleton-based person re-identification (re-ID) obtain impressive performance via either hand-crafted skeleton descriptors or skeleton representation learning with deep learning paradigms. However, they typically require skeletal pre-modeling and label information for training, which leads to limited applicability of these methods. In this paper, we focus on unsupervised skeleton-based person re-ID, and present a generic Simple Masked Contrastive learning (SimMC) framework to learn effective representations from unlabeled 3D skeletons for person re-ID. Specifically, to fully exploit skeleton features within each skeleton sequence, we first devise a masked prototype contrastive learning (MPC) scheme to cluster the most typical skeleton features (skeleton prototypes) from different subsequences randomly masked from raw sequences, and contrast the inherent similarity between skeleton features and different prototypes to learn discriminative skeleton representations without using any label. Then, considering that different subsequences within the same sequence usually enjoy strong correlations due to the nature of motion continuity, we propose the masked intra-sequence contrastive learning (MIC) to capture intra-sequence pattern consistency between subsequences, so as to encourage learning more effective skeleton representations for person re-ID. Extensive experiments validate that the proposed SimMC outperforms most state-of-the-art skeleton-based methods. We further show its scalability and efficiency in enhancing the performance of existing models. Our codes are available at https://github.com/Kali-Hac/SimMC.


title: Data-Driven Design of a New Organic Semiconductor via an Electronic Structure Chart

abstract: Data-driven methodologies for designing new materials are developing apace, yet advances for organic crystals have been infrequent. For organic crystals, the need to predict solid-state electronic properties from molecular structure alone is an exceedingly difficult task for typical, regression-based design strategies. In this paper, we present a new strategy for designing organic crystals which circumvents the need to regress solid-state physical properties directly. At the core of this strategy is an electronic structure chart, a two-dimensional projection of an organic crystal database in which each material is positioned according to its solid-state electronic properties. We illustrate this strategy by identifying a new molecule which is predicted to show a targeted band gap and better-than-average band curvatures in the crystalline state. This strategy is the first data-driven method which can design new molecules on the basis of genuine solid-state electronic properties, and has potential to accelerate breakthroughs in the field of organic electronics and beyond.


title: Relevance-guided Unsupervised Discovery of Abilities with Quality-Diversity Algorithms

abstract: Quality-Diversity algorithms provide efficient mechanisms to generate large collections of diverse and high-performing solutions, which have shown to be instrumental for solving downstream tasks. However, most of those algorithms rely on a behavioural descriptor to characterise the diversity that is hand-coded, hence requiring prior knowledge about the considered tasks. In this work, we introduce Relevance-guided Unsupervised Discovery of Abilities; a Quality-Diversity algorithm that autonomously finds a behavioural characterisation tailored to the task at hand. In particular, our method introduces a custom diversity metric that leads to higher densities of solutions near the areas of interest in the learnt behavioural descriptor space. We evaluate our approach on a simulated robotic environment, where the robot has to autonomously discover its abilities based on its full sensory data. We evaluated the algorithms on three tasks: navigation to random targets, moving forward with a high velocity, and performing half-rolls. The experimental results show that our method manages to discover collections of solutions that are not only diverse, but also well-adapted to the considered downstream task.


title: Block Hunter: Federated Learning for Cyber Threat Hunting in Blockchain-based IIoT Networks

abstract: Nowadays, blockchain-based technologies are being developed in various industries to improve data security. In the context of the Industrial Internet of Things (IIoT), a chain-based network is one of the most notable applications of blockchain technology. IIoT devices have become increasingly prevalent in our digital world, especially in support of developing smart factories. Although blockchain is a powerful tool, it is vulnerable to cyber attacks. Detecting anomalies in blockchain-based IIoT networks in smart factories is crucial in protecting networks and systems from unexpected attacks. In this paper, we use Federated Learning (FL) to build a threat hunting framework called Block Hunter to automatically hunt for attacks in blockchain-based IIoT networks. Block Hunter utilizes a cluster-based architecture for anomaly detection combined with several machine learning models in a federated environment. To the best of our knowledge, Block Hunter is the first federated threat hunting model in IIoT networks that identifies anomalous behavior while preserving privacy. Our results prove the efficiency of the Block Hunter in detecting anomalous activities with high accuracy and minimum required bandwidth.


title: Quantum Walk Inspired Dynamic Adiabatic Local Search

abstract: We investigate the irreconcilability issue that raises in translating the search algorithm from the Continuous-Time Quantum Walk (CTQW) framework to the Adiabatic Quantum Computing (AQC) framework. For the AQC formulation to evolve along the same path as the CTQW requires a constant energy gap in the former Hamiltonian throughout the AQC schedule. To resolve the issue, we modify the CTQW-inspired AQC catalyst Hamiltonian with a $Z$ oracle operator. Through simulation we demonstrate that the total running time for the proposed approach remains optimal. Inspired by this solution, we further investigate adaptive scheduling for the catalyst Hamiltonian and its coefficient function in the adiabatic path to improve the adiabatic local search.


title: Accurate Molecular-Orbital-Based Machine Learning Energies via Unsupervised Clustering of Chemical Space

abstract: We introduce an unsupervised clustering algorithm to improve training efficiency and accuracy in predicting energies using molecular-orbital-based machine learning (MOB-ML). This work determines clusters via the Gaussian mixture model (GMM) in an entirely automatic manner and simplifies an earlier supervised clustering approach [J. Chem. Theory Comput., 15, 6668 (2019)] by eliminating both the necessity for user-specified parameters and the training of an additional classifier. Unsupervised clustering results from GMM have the advantage of accurately reproducing chemically intuitive groupings of frontier molecular orbitals and having improved performance with an increasing number of training examples. The resulting clusters from supervised or unsupervised clustering is further combined with scalable Gaussian process regression (GPR) or linear regression (LR) to learn molecular energies accurately by generating a local regression model in each cluster. Among all four combinations of regressors and clustering methods, GMM combined with scalable exact Gaussian process regression (GMM/GPR) is the most efficient training protocol for MOB-ML. The numerical tests of molecular energy learning on thermalized datasets of drug-like molecules demonstrate the improved accuracy, transferability, and learning efficiency of GMM/GPR over not only other training protocols for MOB-ML, i.e., supervised regression-clustering combined with GPR(RC/GPR) and GPR without clustering. GMM/GPR also provide the best molecular energy predictions compared with the ones from literature on the same benchmark datasets. With a lower scaling, GMM/GPR has a 10.4-fold speedup in wall-clock training time compared with scalable exact GPR with a training size of 6500 QM7b-T molecules.


title: An Information-theoretical Secured Byzantine-fault Tolerance Consensus in Quantum Key Distribution Network

abstract: Quantum key distribution (QKD) networks is expected to provide information-theoretical secured (ITS) communication over long distances. QKD networks based trusted relay architecture are now the most widely used scheme in practice. However, it is an unrealistic assumption that all relays are fully trustable in complex networks. In the past, only a few studies have theoretically analyzed the case of passive eavesdropping attack by dishonest relays and corresponding defense method. However, we have found that active attacks by dishonest relays can be more threatening. With the consideration of passive and active attacks, we treat dishonest relays as Byzantine nodes and analyzes the upper limit of Byzantine nodes that the QKD network can accommodate. In this paper, we propose an ITS Byzantine-fault tolerance (BFT) QKD network scheme to achieve end-to-end key distribution based on point-to-point QKD links. To ensure consistency and provide BFT ability in the QKD network, we design an ITSBFT-consensus protocol for this network scheme. To ensure the information-theoretic security of consensus, we design a temporary signature scheme based on point-to-point QKD link keys. To prevent Byzantine nodes from disrupting the execution process of key distribution, we design an end-to-end key distribution scheme combined with consensus. We theoretically analyze proposed ITSBFT-QKD network scheme from four aspects: QKD key distribution security, temporary signature security, consensus security, and leader election fairness. The simulation result proved the feasibility and demonstrate the performance.


title: Sample-Based Bounds for Coherent Risk Measures: Applications to Policy Synthesis and Verification

abstract: The dramatic increase of autonomous systems subject to variable environments has given rise to the pressing need to consider risk in both the synthesis and verification of policies for these systems. This paper aims to address a few problems regarding risk-aware verification and policy synthesis, by first developing a sample-based method to bound the risk measure evaluation of a random variable whose distribution is unknown. These bounds permit us to generate high-confidence verification statements for a large class of robotic systems. Second, we develop a sample-based method to determine solutions to non-convex optimization problems that outperform a large fraction of the decision space of possible solutions. Both sample-based approaches then permit us to rapidly synthesize risk-aware policies that are guaranteed to achieve a minimum level of system performance. To showcase our approach in simulation, we verify a cooperative multi-agent system and develop a risk-aware controller that outperforms the system's baseline controller. We also mention how our approach can be extended to account for any $g$-entropic risk measure - the subset of coherent risk measures on which we focus.


title: Coronagraph Experiment on Dark-hole Control by Speckle Area Nulling Method

abstract: In high-contrast imaging optical systems for direct observation of planets outside our solar system, adaptive optics with an accuracy of lambda/10,000 root mean square is required to reduce the speckle noise down to 1e-10 level in addition to the nulling coronagraph which eliminate the diffracted light. We developed the speckle area nulling (SAN) method as a new dark-hole control algorithm which is capable of controlling speckle electric field in a wide area quickly, in spite of an extension of speckle nulling, and is robust not relying upon an optical model. We conducted a validation experiment for the SAN method with a monochromatic light and succeeded in reducing the intensity of areal speckles by 4.4e-2.


title: High-Performance Optimal Incentive-Seeking in Transactive Control for Traffic Congestion

abstract: Traffic congestion has dire economic and social impacts in modern metropolitan areas. To address this problem, in this paper we introduce a novel type of model-free transactive controllers to manage vehicle traffic in highway networks for which precise mathematical models are not available. Specifically, we consider a highway system with managed lanes on which dynamic tolling mechanisms can be implemented in real-time using measurements from the roads. We present three incentive-seeking feedback controllers able to find in real-time the optimal economic incentives (e.g., tolls) that persuade highway users to follow a suitable driving behavior that minimizes a predefined performance index. The controllers are agnostic with respect to the exact model of the highway, and they are also able to guarantee fast convergence to the optimal tolls by leveraging non-smooth and hybrid dynamic mechanisms that combine continuous-time dynamics and discrete-time dynamics. We provide numerical examples to illustrate the advantages of the different presented techniques.


title: On nonlinear Miyadera-Voigt perturbations

abstract: Let $A,C,P:D(A)\subset X\to X$ be linear operators on a Banach space $X$ such that $-A$ generates a strongly continuous semigroup on $X$, and $F:X\to X$ be a globally Lipschitz function. We study the well-posedness of semilinear equations of the form $\dot{u}(t)=G(u(t))$, where $G:D(A)\to X$ is a nonlinear map defined by $G=-A+C+F\circ P$. In fact, using the concept of maximal $L^p$-regularity and a fixed point theorem, we establish the existence and uniqueness of a strong solution for the above-mentioned semilinear equation. We illustrate our results by applications to nonlinear heat equations with respect to Dirichlet and Neumann boundary conditions, and a nonlocal unbounded nonlinear perturbation.


title: Memory Bounds for the Experts Problem

abstract: Online learning with expert advice is a fundamental problem of sequential prediction. In this problem, the algorithm has access to a set of $n$ "experts" who make predictions on each day. The goal on each day is to process these predictions, and make a prediction with the minimum cost. After making a prediction, the algorithm sees the actual outcome on that day, updates its state, and then moves on to the next day. An algorithm is judged by how well it does compared to the best expert in the set. The classical algorithm for this problem is the multiplicative weights algorithm. However, every application, to our knowledge, relies on storing weights for every expert, and uses $\Omega(n)$ memory. There is little work on understanding the memory required to solve the online learning with expert advice problem, or run standard sequential prediction algorithms, in natural streaming models, which is especially important when the number of experts, as well as the number of days on which the experts make predictions, is large. We initiate the study of the learning with expert advice problem in the streaming setting, and show lower and upper bounds. Our lower bound for i.i.d., random order, and adversarial order streams uses a reduction to a custom-built problem using a novel masking technique, to show a smooth trade-off for regret versus memory. Our upper bounds show novel ways to run standard sequential prediction algorithms in rounds on small "pools" of experts, thus reducing the necessary memory. For random-order streams, we show that our upper bound is tight up to low order terms. We hope that these results and techniques will have broad applications in online learning, and can inspire algorithms based on standard sequential prediction techniques, like multiplicative weights, for a wide range of other problems in the memory-constrained setting.


title: Fast AdvProp

abstract: Adversarial Propagation (AdvProp) is an effective way to improve recognition models, leveraging adversarial examples. Nonetheless, AdvProp suffers from the extremely slow training speed, mainly because: a) extra forward and backward passes are required for generating adversarial examples; b) both original samples and their adversarial counterparts are used for training (i.e., 2$\times$ data). In this paper, we introduce Fast AdvProp, which aggressively revamps AdvProp's costly training components, rendering the method nearly as cheap as the vanilla training. Specifically, our modifications in Fast AdvProp are guided by the hypothesis that disentangled learning with adversarial examples is the key for performance improvements, while other training recipes (e.g., paired clean and adversarial training samples, multi-step adversarial attackers) could be largely simplified. Our empirical results show that, compared to the vanilla training baseline, Fast AdvProp is able to further model performance on a spectrum of visual benchmarks, without incurring extra training cost. Additionally, our ablations find Fast AdvProp scales better if larger models are used, is compatible with existing data augmentation methods (i.e., Mixup and CutMix), and can be easily adapted to other recognition tasks like object detection. The code is available here: https://github.com/meijieru/fast_advprop.


title: 6GAN: IPv6 Multi-Pattern Target Generation via Generative Adversarial Nets with Reinforcement Learning

abstract: Global IPv6 scanning has always been a challenge for researchers because of the limited network speed and computational power. Target generation algorithms are recently proposed to overcome the problem for Internet assessments by predicting a candidate set to scan. However, IPv6 custom address configuration emerges diverse addressing patterns discouraging algorithmic inference. Widespread IPv6 alias could also mislead the algorithm to discover aliased regions rather than valid host targets. In this paper, we introduce 6GAN, a novel architecture built with Generative Adversarial Net (GAN) and reinforcement learning for multi-pattern target generation. 6GAN forces multiple generators to train with a multi-class discriminator and an alias detector to generate non-aliased active targets with different addressing pattern types. The rewards from the discriminator and the alias detector help supervise the address sequence decision-making process. After adversarial training, 6GAN's generators could keep a strong imitating ability for each pattern and 6GAN's discriminator obtains outstanding pattern discrimination ability with a 0.966 accuracy. Experiments indicate that our work outperformed the state-of-the-art target generation algorithms by reaching a higher-quality candidate set.


title: Multi-Tier Platform for Cognizing Massive Electroencephalogram

abstract: An end-to-end platform assembling multiple tiers is built for precisely cognizing brain activities. Being fed massive electroencephalogram (EEG) data, the time-frequency spectrograms are conventionally projected into the episode-wise feature matrices (seen as tier-1). A spiking neural network (SNN) based tier is designed to distill the principle information in terms of spike-streams from the rare features, which maintains the temporal implication in the nature of EEGs. The proposed tier-3 transposes time- and space-domain of spike patterns from the SNN; and feeds the transposed pattern-matrices into an artificial neural network (ANN, Transformer specifically) known as tier-4, where a special spanning topology is proposed to match the two-dimensional input form. In this manner, cognition such as classification is conducted with high accuracy. For proof-of-concept, the sleep stage scoring problem is demonstrated by introducing multiple EEG datasets with the largest comprising 42,560 hours recorded from 5,793 subjects. From experiment results, our platform achieves the general cognition overall accuracy of 87% by leveraging sole EEG, which is 2% superior to the state-of-the-art. Moreover, our developed multi-tier methodology offers visible and graphical interpretations of the temporal characteristics of EEG by identifying the critical episodes, which is demanded in neurodynamics but hardly appears in conventional cognition scenarios.


title: Multiscale Analysis for Improving Texture Classification

abstract: Information from an image occurs over multiple and distinct spatial scales. Image pyramid multiresolution representations are a useful data structure for image analysis and manipulation over a spectrum of spatial scales. This paper employs the Gaussian-Laplacian pyramid to treat different spatial frequency bands of a texture separately. First, we generate three images corresponding to three levels of the Gaussian-Laplacian pyramid for an input image to capture intrinsic details. Then we aggregate features extracted from gray and color texture images using bio-inspired texture descriptors, information-theoretic measures, gray-level co-occurrence matrix features, and Haralick statistical features into a single feature vector. Such an aggregation aims at producing features that characterize textures to their maximum extent, unlike employing each descriptor separately, which may lose some relevant textural information and reduce the classification performance. The experimental results on texture and histopathologic image datasets have shown the advantages of the proposed method compared to state-of-the-art approaches. Such findings emphasize the importance of multiscale image analysis and corroborate that the descriptors mentioned above are complementary.


title: Some sufficient conditions for path-factor uniform graphs

abstract: For a set $\mathcal{H}$ of connected graphs, a spanning subgraph $H$ of $G$ is called an $\mathcal{H}$-factor of $G$ if each component of $H$ is isomorphic to an element of $\mathcal{H}$. A graph $G$ is called an $\mathcal{H}$-factor uniform graph if for any two edges $e_1$ and $e_2$ of $G$, $G$ has an $\mathcal{H}$-factor covering $e_1$ and excluding $e_2$. Let each component in $\mathcal{H}$ be a path with at least $d$ vertices, where $d\geq2$ is an integer. Then an $\mathcal{H}$-factor and an $\mathcal{H}$-factor uniform graph are called a $P_{\geq d}$-factor and a $P_{\geq d}$-factor uniform graph, respectively. In this article, we verify that (\romannumeral1) a 2-edge-connected graph $G$ is a $P_{\geq3}$-factor uniform graph if $\delta(G)>\frac{\alpha(G)+4}{2}$; (\romannumeral2) a $(k+2)$-connected graph $G$ of order $n$ with $n\geq5k+3-\frac{3}{5\gamma-1}$ is a $P_{\geq3}$-factor uniform graph if $|N_G(A)|>\gamma(n-3k-2)+k+2$ for any independent set $A$ of $G$ with $|A|=\lfloor\gamma(2k+1)\rfloor$, where $k$ is a positive integer and $\gamma$ is a real number with $\frac{1}{3}\leq\gamma\leq1$.


title: Generalized Langevin equation with fluctuating diffusivity

abstract: A generalized Langevin equation with fluctuating diffusivity (GLEFD) is proposed, and it is shown that the GLEFD satisfies a generalized fluctuation-dissipation relation. If the memory kernel is a power law, the GLEFD exhibits anomalous subdiffusion, non-Gaussianity, and stretched-exponential relaxation. The case in which the memory kernel is given by a single exponential function is also investigated as an analytically tractable example. In particular, the mean-square displacement and the self-intermediate-scattering function of this system show plateau structures. A numerical scheme to integrate the GLEFD is also presented.


title: On the admissibility of observation operators in the context of maximal regularity

abstract: We study admissible observation operators for perturbed evolution equations using the concept of maximal regularity. We first show the invariance of the maximal $L^p$-regularity under non-autonomous Miyadera-Voigt perturbations. Second, we establish the invariance of admissibility of observation operators under such a class of perturbations. Finally, we illustrate our result with two examples, one on a non-autonomous parabolic system, and the other on an evolution equation with mixed boundary conditions and a non-local perturbation.


title: On the Kawaguchi--Silverman Conjecture for birational automorphisms of irregular varieties

abstract: We study the main open parts of the Kawaguchi--Silverman Conjecture, asserting that for a birational self-map $f$ of a smooth projective variety $X$ defined over $\overline{\mathbb Q}$, the arithmetic degree $\alpha_f(x)$ exists and coincides with the first dynamical degree $\delta_f$ for any $\overline{\mathbb Q}$-point $x$ of $X$ with a Zariski dense orbit. Among other results, we show that this holds when $X$ has Kodaira dimension zero and irregularity $q(X) \ge \dim X -1$ or $X$ is an irregular threefold (modulo one possible exception). We also study the existence of Zariski dense orbits, with explicit examples.


title: Tailoring neuromorphic switching by CuNx-mediated orbital currents

abstract: Current-induced spin-orbit torque (SOT) is regarded as a promising mechanism for driving neuromorphic behavior in spin-orbitronic devices. In principle, the strong SOT in heavy metal-based magnetic heterostructure is attributed to the spin-orbit coupling (SOC)-induced spin Hall effect (SHE) and/or the spin Rashba-Edelstein effect (SREE). Recently, SOC-free mechanisms such as the orbital angular momentum (OAM)-induced orbital Hall effect (OHE) and/or the orbital Rashba-Edelstein effect (OREE) have been proposed to generate sizable torques comparable to those from the conventional spin Hall mechanism. In this work, we show that the orbital current can be effectively generated by the nitrided light metal Cu. The overall damping-like SOT efficiency, which consists of both the spin and the orbital current contributions, can be tailored from ~ 0.06 to 0.4 in a Pt/Co/CuNx magnetic heterostructure by tuning the nitrogen doping concentration. Current-induced magnetization switching further verifies the efficacy of such orbital current with a critical switching current density as low as Jc ~ 5 x 10^10 A/m2. Most importantly, the orbital-current-mediated memristive switching behavior can be observed in such heterostructures, which reveals that the gigantic SOT and efficient magnetization switching are the tradeoffs for the applicable window of memristive switching. Our work provides insights into the role of orbital current might play in SOT neuromorphic devices and paves a new route for making energy-efficient spin-orbitronic devices.


title: Unseen Object Instance Segmentation with Fully Test-time RGB-D Embeddings Adaptation

abstract: Segmenting unseen objects is a crucial ability for the robot since it may encounter new environments during the operation. Recently, a popular solution is leveraging RGB-D features of large-scale synthetic data and directly applying the model to unseen real-world scenarios. However, the domain shift caused by the sim2real gap is inevitable, posing a crucial challenge to the segmentation model. In this paper, we emphasize the adaptation process across sim2real domains and model it as a learning problem on the BatchNorm parameters of a simulation-trained model. Specifically, we propose a novel non-parametric entropy objective, which formulates the learning objective for the test-time adaptation in an open-world manner. Then, a cross-modality knowledge distillation objective is further designed to encourage the test-time knowledge transfer for feature enhancement. Our approach can be efficiently implemented with only test images, without requiring annotations or revisiting the large-scale synthetic training data. Besides significant time savings, the proposed method consistently improves segmentation results on the overlap and boundary metrics, achieving state-of-the-art performance on unseen object instance segmentation.


title: Weakly Aligned Feature Fusion for Multimodal Object Detection

abstract: To achieve accurate and robust object detection in the real-world scenario, various forms of images are incorporated, such as color, thermal, and depth. However, multimodal data often suffer from the position shift problem, i.e., the image pair is not strictly aligned, making one object has different positions in different modalities. For the deep learning method, this problem makes it difficult to fuse multimodal features and puzzles the convolutional neural network (CNN) training. In this article, we propose a general multimodal detector named aligned region CNN (AR-CNN) to tackle the position shift problem. First, a region feature (RF) alignment module with adjacent similarity constraint is designed to consistently predict the position shift between two modalities and adaptively align the cross-modal RFs. Second, we propose a novel region of interest (RoI) jitter strategy to improve the robustness to unexpected shift patterns. Third, we present a new multimodal feature fusion method that selects the more reliable feature and suppresses the less useful one via feature reweighting. In addition, by locating bounding boxes in both modalities and building their relationships, we provide novel multimodal labeling named KAIST-Paired. Extensive experiments on 2-D and 3-D object detection, RGB-T, and RGB-D datasets demonstrate the effectiveness and robustness of our method.


title: Standard conjecture D for local stacky matrix factorizations

abstract: We establish the non-commutative analogue of Grothendieck's standard conjecture D for the differential graded category of $G$-equivariant matrix factorizations associated to an isolated hypersurface singularity where $G$ is a finite group.


title: FedCL: Federated Contrastive Learning for Privacy-Preserving Recommendation

abstract: Contrastive learning is widely used for recommendation model learning, where selecting representative and informative negative samples is critical. Existing methods usually focus on centralized data, where abundant and high-quality negative samples are easy to obtain. However, centralized user data storage and exploitation may lead to privacy risks and concerns, while decentralized user data on a single client can be too sparse and biased for accurate contrastive learning. In this paper, we propose a federated contrastive learning method named FedCL for privacy-preserving recommendation, which can exploit high-quality negative samples for effective model training with privacy well protected. We first infer user embeddings from local user data through the local model on each client, and then perturb them with local differential privacy (LDP) before sending them to a central server for hard negative sampling. Since individual user embedding contains heavy noise due to LDP, we propose to cluster user embeddings on the server to mitigate the influence of noise, and the cluster centroids are used to retrieve hard negative samples from the item pool. These hard negative samples are delivered to user clients and mixed with the observed negative samples from local data as well as in-batch negatives constructed from positive samples for federated model training. Extensive experiments on four benchmark datasets show FedCL can empower various recommendation methods in a privacy-preserving way.


title: A Masked Image Reconstruction Network for Document-level Relation Extraction

abstract: Document-level relation extraction aims to extract relations among entities within a document. Compared with its sentence-level counterpart, Document-level relation extraction requires inference over multiple sentences to extract complex relational triples. Previous research normally complete reasoning through information propagation on the mention-level or entity-level document-graphs, regardless of the correlations between the relationships. In this paper, we propose a novel Document-level Relation Extraction model based on a Masked Image Reconstruction network (DRE-MIR), which models inference as a masked image reconstruction problem to capture the correlations between relationships. Specifically, we first leverage an encoder module to get the features of entities and construct the entity-pair matrix based on the features. After that, we look on the entity-pair matrix as an image and then randomly mask it and restore it through an inference module to capture the correlations between the relationships. We evaluate our model on three public document-level relation extraction datasets, i.e. DocRED, CDR, and GDA. Experimental results demonstrate that our model achieves state-of-the-art performance on these three datasets and has excellent robustness against the noises during the inference process.


title: The Risks of Machine Learning Systems

abstract: The speed and scale at which machine learning (ML) systems are deployed are accelerating even as an increasing number of studies highlight their potential for negative impact. There is a clear need for companies and regulators to manage the risk from proposed ML systems before they harm people. To achieve this, private and public sector actors first need to identify the risks posed by a proposed ML system. A system's overall risk is influenced by its direct and indirect effects. However, existing frameworks for ML risk/impact assessment often address an abstract notion of risk or do not concretize this dependence. We propose to address this gap with a context-sensitive framework for identifying ML system risks comprising two components: a taxonomy of the first- and second-order risks posed by ML systems, and their contributing factors. First-order risks stem from aspects of the ML system, while second-order risks stem from the consequences of first-order risks. These consequences are system failures that result from design and development choices. We explore how different risks may manifest in various types of ML systems, the factors that affect each risk, and how first-order risks may lead to second-order effects when the system interacts with the real world. Throughout the paper, we show how real events and prior research fit into our Machine Learning System Risk framework (MLSR). MLSR operates on ML systems rather than technologies or domains, recognizing that a system's design, implementation, and use case all contribute to its risk. In doing so, it unifies the risks that are commonly discussed in the ethical AI community (e.g., ethical/human rights risks) with system-level risks (e.g., application, design, control risks), paving the way for holistic risk assessments of ML systems.


title: The Cheeger constants of random Belyi surfaces

abstract: Brooks and Makover developed a combinatorial model of random hyperbolic surfaces by gluing certain hyperbolic ideal triangles. In this paper we show that for any $\epsilon>0$, as the number of ideal triangles goes to infinity, a generic hyperbolic surface in Brooks-Makover's model has Cheeger constant less than $\frac{3}{2\pi}+\epsilon$.


title: Self-Supervised Learning to Guide Scientifically Relevant Categorization of Martian Terrain Images

abstract: Automatic terrain recognition in Mars rover images is an important problem not just for navigation, but for scientists interested in studying rock types, and by extension, conditions of the ancient Martian paleoclimate and habitability. Existing approaches to label Martian terrain either involve the use of non-expert annotators producing taxonomies of limited granularity (e.g. soil, sand, bedrock, float rock, etc.), or rely on generic class discovery approaches that tend to produce perceptual classes such as rover parts and landscape, which are irrelevant to geologic analysis. Expert-labeled datasets containing granular geological/geomorphological terrain categories are rare or inaccessible to public, and sometimes require the extraction of relevant categorical information from complex annotations. In order to facilitate the creation of a dataset with detailed terrain categories, we present a self-supervised method that can cluster sedimentary textures in images captured from the Mast camera onboard the Curiosity rover (Mars Science Laboratory). We then present a qualitative analysis of these clusters and describe their geologic significance via the creation of a set of granular terrain categories. The precision and geologic validation of these automatically discovered clusters suggest that our methods are promising for the rapid classification of important geologic features and will therefore facilitate our long-term goal of producing a large, granular, and publicly available dataset for Mars terrain recognition.


title: On the non-existence of trapped surfaces under low-regularity bounds

abstract: The emergence of trapped surfaces in solutions to the Einstein field equations is intimately tied to the well-posedness properties of the corresponding Cauchy problem in the low regularity regime. In this paper, we study the question of existence of trapped surfaces already at the level of the initial hypersurface when the scale invariant size of the Cauchy data is assumed to be bounded. Our main theorem states that no trapped surfaces can exist initially when the Cauchy data are close to the data induced on a spacelike hypersurface of Minkowski spacetime (not necessarily a flat hyperplane) in the Besov $B^{3/2}_{2,1}$ norm. We also discuss the question of extending the above result to the case when merely smallness in $H^{3/2}$ is assumed.


title: Magnetic Couplings in Edge-Sharing High-Spin $d^7$ Compounds

abstract: High-spin $d^7$ Co(II) compounds have recently been identified as possible platforms for realising highly anisotropic and bond-dependent couplings featured in quantum-compass models such as the celebrated Kitaev model. In order to evaluate this potential, we consider all symmetry-allowed contributions to the magnetic exchange for ideal edge-sharing bonds. Though a combination of ab-initio and cluster many-body calculations we conclude that bond-dependent couplings are generally suppressed in favor of Heisenberg exchange for real materials. Consequences for several prominent materials including Na$_2$Co$_2$TeO$_6$ and BaCo$_2$(AsO$_4$)$_2$ are discussed.


title: Linear and nonlinear analysis of the viscous Rayleigh-Taylor system with Navier-slip boundary conditions

abstract: In this paper, we are interested in the nonlinear Rayleigh-Taylor instability for the gravity-driven incompressible Navier-Stokes equations with Navier-slip boundary conditions around a smooth increasing density profile $\rho_0(x_2)$ in a slab domain $2\pi L\mathbb{T} \times (-1,1)$ ($L>0$, $\mathbb{T}$ is the usual 1D torus). The linear instability study of the viscous Rayleigh-Taylor model amounts to the study of the following ODE on the finite interval $(-1,1)$, \begin{equation}\label{EqMain} \lambda^2 ( \rho_0 k^2 \phi - (\rho_0 \phi')')+ \lambda \mu (\phi^{(4)} - 2k^2 \phi'' + k^4 \phi) = gk^2 \rho_0'\phi, \end{equation} with the boundary conditions \begin{equation}\label{4thBound} \begin{cases} \phi(-1)=\phi(1)=0,\\ \mu \phi''(1) = \xi_+ \phi'(1), \\ \mu \phi''(-1) =- \xi_- \phi'(-1), \end{cases} \end{equation} where $\lambda>0$ is the growth rate in time, $g>0$ is the gravity constant, $k$ is the wave number and two Navier-slip coefficients $\xi_{\pm}$ are nonnegative constants. For each $k\in L^{-1}\mathbb{Z}$, we define a threshold of viscosity coefficient $\mu_c(k,\Xi)$ for the linear instability. So that, in the $k$-supercritical regime, i.e. $\mu>\mu_c(k,\Xi)$, we describe a spectral analysis adapting the operator method initiated by Lafitte-Nguyen \cite{LN20} and prove that there are infinite nontrivial solutions $(\lambda_n, \phi_n)_{n\geqslant 1} $ of \eqref{EqMain}-\eqref{4thBound} with $\lambda_n \to 0$ as $n\to \infty$ and $\phi_n\in H^4((-1,1))$. Based on the existence of infinitely many normal modes of the linearized problem, we construct a wide class of initial data to the nonlinear equations, extending the previous framework of Guo-Strauss \cite{GS95} and of Grenier \cite{Gre00}, to prove the nonlinear Rayleigh-Taylor instability in a high regime of viscosity coefficient, namely $\mu >3\sup_{k\in L^{-1}\mathbb{Z}\setminus\{0\}}\mu_c(k,\Xi)$.


title: Ultraviolet Finiteness or Asymptotic Safety in Higher Derivative Gravitational Theories

abstract: We present and discuss well known conditions for ultraviolet finiteness and asymptotic safety. The requirements for complete absence of ultraviolet divergences in quantum field theories and existence of a non-trivial fixed point for renormalization group flow in the ultraviolet regime are compared based on the example of a six-derivative quantum gravitational theory in $d=4$ spacetime dimensions. In this model, it is possible for the first time to have fully UV-finite quantum theory without adding matter or special symmetry, but by inclusion of additional terms cubic in curvatures. We comment on similarities and some apparent differences between the two approaches, but we show that they are both compatible to each other. Finally, we motivate the claim that actually asymptotic safety needs UV-finite models for providing explicit form of the ultraviolet limit of Wilsonian effective actions describing special situations at fixed points.

categories: hep-th gr-qc hep-ph math-ph math.MP quant-ph


title: Purcell enhancement of erbium ions in TiO$_{2}$ on silicon nanocavities

abstract: Isolated solid-state atomic defects with telecom optical transitions are ideal quantum photon emitters and spin qubits for applications in long-distance quantum communication networks. Prototypical telecom defects such as erbium suffer from poor photon emission rates, requiring photonic enhancement using resonant optical cavities. Many of the traditional hosts for erbium ions are not amenable to direct incorporation with existing integrated photonics platforms, limiting scalable fabrication of qubit-based devices. Here we present a scalable approach towards CMOS-compatible telecom qubits by using erbium-doped titanium dioxide thin films grown atop silicon-on-insulator substrates. From this heterostructure, we have fabricated one-dimensional photonic crystal cavities demonstrating quality factors in excess of $5\times10^{4}$ and corresponding Purcell-enhanced optical emission rates of the erbium ensembles in excess of 200. This easily fabricated materials platform represents an important step towards realizing telecom quantum memories in a scalable qubit architecture compatible with mature silicon technologies.


title: Remote Sensing Cross-Modal Text-Image Retrieval Based on Global and Local Information

abstract: Cross-modal remote sensing text-image retrieval (RSCTIR) has recently become an urgent research hotspot due to its ability of enabling fast and flexible information extraction on remote sensing (RS) images. However, current RSCTIR methods mainly focus on global features of RS images, which leads to the neglect of local features that reflect target relationships and saliency. In this article, we first propose a novel RSCTIR framework based on global and local information (GaLR), and design a multi-level information dynamic fusion (MIDF) module to efficaciously integrate features of different levels. MIDF leverages local information to correct global information, utilizes global information to supplement local information, and uses the dynamic addition of the two to generate prominent visual representation. To alleviate the pressure of the redundant targets on the graph convolution network (GCN) and to improve the model s attention on salient instances during modeling local features, the de-noised representation matrix and the enhanced adjacency matrix (DREA) are devised to assist GCN in producing superior local representations. DREA not only filters out redundant features with high similarity, but also obtains more powerful local features by enhancing the features of prominent objects. Finally, to make full use of the information in the similarity matrix during inference, we come up with a plug-and-play multivariate rerank (MR) algorithm. The algorithm utilizes the k nearest neighbors of the retrieval results to perform a reverse search, and improves the performance by combining multiple components of bidirectional retrieval. Extensive experiments on public datasets strongly demonstrate the state-of-the-art performance of GaLR methods on the RSCTIR task. The code of GaLR method, MR algorithm, and corresponding files have been made available at https://github.com/xiaoyuan1996/GaLR .


title: Dual $r$-Rank Decomposition and Its Applications

abstract: In this paper, we introduce the dual $r$-rank decomposition of dual matrix, get its existence condition and equivalent form of the decomposition, as well as derive some characterizations of dual Moore-Penrose generalized inverse(DMPGI). Based on DMPGI, we introduce one special dual matrix(dual EP matrix). By applying the dual $r$-rank decomposition we derive several characterizations of dual EP matrix, dual idempotent matrix, dual generalized inverses, and the relationships among dual Penrose equations.


title: Targeting functional parameters with semiparametric Bayesian inference

abstract: Typical Bayesian inference requires parameter identification via likelihood parameterization, which has invited criticism for being less flexible than the Frequentist framework and subject to misspecification. Though misspecification may be avoided by functional parameter inference under a nonparametric model space, there does not exist a flexible Bayesian semiparametric model that would allow full control over the marginal prior over any general functional parameter. We present the technique of $\theta$-augmentation which helps us manipulate nonparametric models into semiparametric ones that directly target any functional parameter. The method allows Bayesian probabilistic statements to be drawn for any estimator that is defined as a functional of the empirical distribution without requiring a likelihood function, thus providing a path to Bayesian analysis in problems like causal inference and censoring where there do not exist well-accepted likelihood functions.


title: Optimal design of exchange water networks with control inputs in Eco-Industrial Parks

abstract: Industrial water conservation is an important adaptation to preserve the environment. Eco-Industrial Parks (EIPs) have been designed to encourage the establishment of water exchange networks between enterprises in order to minimize freshwater consumption and wastewater discharge by maximizing wastewater reuse. This control-input model presents a mathematical programming formulation for designing and optimizing industrial water networks in EIPs, formulating and solving it as a Single- Leader Multi-Follower (SLMF) game problem. Enterprises (followers) aim to minimize their operating costs by reusing wastewater from other enterprises, while the designer (leader) aims to minimize the consumption of natural resources within the ecopark. Moreover, when participating in the ecopark, enterprises can control all their input fluxes and the designer guarantees a minimal relative improvement in comparison with the stand-alone operation of each enterprise. The SLMF game is transformed into a single mixed-integer optimization problem. The obtained results are compared with the results of the blind-input model [D. Salas, Cao Van Kien, D. Aussel, L. Montastruc, Optimal design of exchange networks with blind inputs and its application to Eco-Industrial parks, Computers \& Chemical Engineering 143 (2020)].


title: Using SGX for Meta-Transactions Support in Ethereum DApps

abstract: Decentralized applications (DApps) gained traction in the context of the blockchain technology. Ethereum is currently the public blockchain that backs the largest amount of the existing DApps. Onboarding new users to Ethereum DApps is a notoriously hard issue to solve. This is mainly caused by lack of cryptocurrency ownership, needed for transaction fees. Several meta-transaction patterns emerged for decoupling users from paying these fees. However, such solutions are mostly offered via off-chain, often paid relayer services and do not fully address the security issues present in the meta-transaction path. In this paper, we introduce a new meta-transaction architecture that makes use of the Intel Software Guard Extensions (SGX). Unlike other solutions, our approach would offer the possibility to deploy a fee-free Ethereum DApp on a web server that can directly relay meta-transactions to the Ethereum network while having essential security guarantees integrated by design.


title: Detection of roton and phonon excitations in a spin-orbit coupled Bose-Einstein condensate with a moving barrier

abstract: We propose to detect phonon and roton excitations in a two-dimensional Bose-Einstein condensate with Raman-induced spin-orbit coupling by perturbing the atomic cloud with a weak barrier. The two excitation modes can be observed by moving the barrier along different directions in appropriate parameter regimes. Phonon excitations are identified by the appearance of solitary waves, while roton excitations lead to distinctive spatial density modulations. We show that this method can also be used to determine the anisotropic critical velocities of superfluid.


title: Pixel2Mesh++: 3D Mesh Generation and Refinement from Multi-View Images

abstract: We study the problem of shape generation in 3D mesh representation from a small number of color images with or without camera poses. While many previous works learn to hallucinate the shape directly from priors, we adopt to further improve the shape quality by leveraging cross-view information with a graph convolution network. Instead of building a direct mapping function from images to 3D shape, our model learns to predict series of deformations to improve a coarse shape iteratively. Inspired by traditional multiple view geometry methods, our network samples nearby area around the initial mesh's vertex locations and reasons an optimal deformation using perceptual feature statistics built from multiple input images. Extensive experiments show that our model produces accurate 3D shapes that are not only visually plausible from the input perspectives, but also well aligned to arbitrary viewpoints. With the help of physically driven architecture, our model also exhibits generalization capability across different semantic categories, and the number of input images. Model analysis experiments show that our model is robust to the quality of the initial mesh and the error of camera pose, and can be combined with a differentiable renderer for test-time optimization.


title: A Model-Agnostic Data Manipulation Method for Persona-based Dialogue Generation

abstract: Towards building intelligent dialogue agents, there has been a growing interest in introducing explicit personas in generation models. However, with limited persona-based dialogue data at hand, it may be difficult to train a dialogue generation model well. We point out that the data challenges of this generation task lie in two aspects: first, it is expensive to scale up current persona-based dialogue datasets; second, each data sample in this task is more complex to learn with than conventional dialogue data. To alleviate the above data issues, we propose a data manipulation method, which is model-agnostic to be packed with any persona-based dialogue generation model to improve its performance. The original training samples will first be distilled and thus expected to be fitted more easily. Next, we show various effective ways that can diversify such easier distilled data. A given base model will then be trained via the constructed data curricula, i.e. first on augmented distilled samples and then on original ones. Experiments illustrate the superiority of our method with two strong base dialogue models (Transformer encoder-decoder and GPT2).


title: Exploring a Fine-Grained Multiscale Method for Cross-Modal Remote Sensing Image Retrieval

abstract: Remote sensing (RS) cross-modal text-image retrieval has attracted extensive attention for its advantages of flexible input and efficient query. However, traditional methods ignore the characteristics of multi-scale and redundant targets in RS image, leading to the degradation of retrieval accuracy. To cope with the problem of multi-scale scarcity and target redundancy in RS multimodal retrieval task, we come up with a novel asymmetric multimodal feature matching network (AMFMN). Our model adapts to multi-scale feature inputs, favors multi-source retrieval methods, and can dynamically filter redundant features. AMFMN employs the multi-scale visual self-attention (MVSA) module to extract the salient features of RS image and utilizes visual features to guide the text representation. Furthermore, to alleviate the positive samples ambiguity caused by the strong intraclass similarity in RS image, we propose a triplet loss function with dynamic variable margin based on prior similarity of sample pairs. Finally, unlike the traditional RS image-text dataset with coarse text and higher intraclass similarity, we construct a fine-grained and more challenging Remote sensing Image-Text Match dataset (RSITMD), which supports RS image retrieval through keywords and sentence separately and jointly. Experiments on four RS text-image datasets demonstrate that the proposed model can achieve state-of-the-art performance in cross-modal RS text-image retrieval task.


title: Relaxed constant positive linear dependence constraint qualification for disjunctive programs

abstract: The disjunctive system is a system involving a disjunctive set which is the union of finitely many polyhedral convex sets. In this paper, we introduce a notion of the relaxed constant positive linear dependence constraint qualification (RCPLD) for the disjunctive system. For a disjunctive system, our notion is weaker than the one we introduced for a more general system recently (J. Glob. Optim. 2020) and is still a constraint qualification. To obtain the local error bound for the disjunctive system, we introduce the piecewise RCPLD under which the error bound property holds if all inequality constraint functions are subdifferentially regular and the rest of the constraint functions are smooth. We then specialize our results to the ortho-disjunctive program, which includes the mathematical program with equilibrium constraints (MPEC), the mathematical program with vanishing constraints (MPVC) and the mathematical program with switching constraints (MPSC) as special cases. For MPEC, we recover MPEC-RCPLD, an MPEC variant of RCPLD and propose the MPEC piecewise RCPLD to obtain the {error bound property}. For MPVC, we introduce new constraint qualifications MPVC-RCPLD and the piecewise RCPLD, which also implies the local error bound. For MPSC, we show that both RCPLD and the piecewise RCPLD coincide and hence it leads to the local error bound.