title: VoxelCache: Accelerating Online Mapping in Robotics and 3D Reconstruction Tasks

abstract: Real-time 3D mapping is a critical component in many important applications today including robotics, AR/VR, and 3D visualization. 3D mapping involves continuously fusing depth maps obtained from depth sensors in phones, robots, and autonomous vehicles into a single 3D representative model of the scene. Many important applications, e.g., global path planning and trajectory generation in micro aerial vehicles, require the construction of large maps at high resolutions. In this work, we identify mapping, i.e., construction and updates of 3D maps to be a critical bottleneck in these applications. The memory required and access times of these maps limit the size of the environment and the resolution with which the environment can be feasibly mapped, especially in resource constrained environments such as autonomous robot platforms and portable devices. To address this challenge, we propose VoxelCache: a hardware-software technique to accelerate map data access times in 3D mapping applications. We observe that mapping applications typically access voxels in the map that are spatially co-located to each other. We leverage this temporal locality in voxel accesses to cache indices to blocks of voxels to enable quick lookup and avoid expensive access times. We evaluate VoxelCache on popularly used mapping and reconstruction applications on both GPUs and CPUs. We demonstrate an average speedup of 1.47X (up to 1.66X) and 1.79X (up to 1.91X) on CPUs and GPUs respectively.


title: Robust Bayesian state and parameter estimation framework for stochastic dynamical systems with combined time-varying and time-invariant parameters

abstract: We consider state and parameter estimation for a dynamical system having both time-varying and time-invariant parameters. It has been shown that the robustness of the Markov Chain Monte Carlo (MCMC) algorithm for estimating time-invariant parameters alongside nonlinear filters for state estimation provided more reliable estimates than the estimates obtained solely using nonlinear filters for combined state and parameter estimation. In a similar fashion, we adopt the extended Kalman filter (EKF) for state estimation and the estimation of the time-varying system parameters, but reserve the task of estimating time-invariant parameters to the MCMC algorithm. In a standard method, we augment the state vector to include the original states of the system and the subset of the parameters that are time-varying. Each time-varying parameter is perturbed by a white noise process, and we treat the strength of this artificial noise as an additional time-invariant parameter to be estimated by MCMC, circumventing the need for manual tuning. Conventionally, both time-varying and time-invariant parameters are appended in the state vector, and thus for the purpose of estimation, both are free to vary in time. However, allowing time-invariant system parameters to vary in time introduces artificial dynamics into the system, which we avoid by treating these time-invariant parameters as static and estimating them using MCMC. Furthermore, by estimating the time-invariant parameters by MCMC, the augmented state is smaller and the nonlinearity in the ensuing state space model will tend to be weaker than in the conventional approach. We illustrate the above-described approach for a simple dynamical system in which some model parameters are time-varying, while the remaining parameters are time-invariant.


title: A High Fidelity Simulation Framework for Potential Safety Benefits Estimation of Cooperative Pedestrian Perception

abstract: This paper proposes a high-fidelity simulation framework that can estimate the potential safety benefits of vehicle-to-infrastructure (V2I) pedestrian safety strategies. This simulator can support cooperative perception algorithms in the loop by simulating the environmental conditions, traffic conditions, and pedestrian characteristics at the same time. Besides, the benefit estimation model applied in our framework can systematically quantify both the risk conflict (non-crash condition) and the severity of the pedestrian's injuries (crash condition). An experiment was conducted in this paper that built a digital twin of a crowded urban intersection in China. The result shows that our framework is efficient for safety benefit estimation of V2I pedestrian safety strategies.


title: Forecasting Human Trajectory from Scene History

abstract: Predicting the future trajectory of a person remains a challenging problem, due to randomness and subjectivity of human movement. However, the moving patterns of human in a constrained scenario typically conform to a limited number of regularities to a certain extent, because of the scenario restrictions and person-person or person-object interactivity. Thus, an individual person in this scenario should follow one of the regularities as well. In other words, a person's subsequent trajectory has likely been traveled by others. Based on this hypothesis, we propose to forecast a person's future trajectory by learning from the implicit scene regularities. We call the regularities, inherently derived from the past dynamics of the people and the environment in the scene, scene history. We categorize scene history information into two types: historical group trajectory and individual-surroundings interaction. To exploit these two types of information for trajectory prediction, we propose a novel framework Scene History Excavating Network (SHENet), where the scene history is leveraged in a simple yet effective approach. In particular, we design two components: the group trajectory bank module to extract representative group trajectories as the candidate for future path, and the cross-modal interaction module to model the interaction between individual past trajectory and its surroundings for trajectory refinement. In addition, to mitigate the uncertainty in ground-truth trajectory, caused by the aforementioned randomness and subjectivity of human movement, we propose to include smoothness into the training process and evaluation metrics. We conduct extensive evaluations to validate the efficacy of our proposed framework on ETH, UCY, as well as a new, challenging benchmark dataset PAV, demonstrating superior performance compared to state-of-the-art methods.


title: Unequivocal Determination of Spin-Triplet Superconductivity Using Composite Rings

abstract: Phase-sensitive measurements on a composite ring made of a superconductor of interest connected by a known singlet $s$-wave superconductor can unambiguously determine its pairing symmetry. In composite rings with epitaxial $\beta-$Bi$_2$Pd and $s$-wave Nb, we have observed half-integer quantum flux when Nb is connected to the opposite crystalline ends of $\beta-$Bi$_2$Pd and integer-quantum flux when Nb is connected to the same crystalline ends of $\beta-$Bi$_2$Pd. These findings provide unequivocal evidence of odd-parity pairing state of the triplet superconductor $\beta-$Bi$_2$Pd.


title: How many radiographs are needed to re-train a deep learning system for object detection?

abstract: Background: Object detection in radiograph computer vision has largely benefited from progress in deep convolutional neural networks and can, for example, annotate a radiograph with a box around a knee joint or intervertebral disc. Is deep learning capable of detect small (less than 1% of the image) in radiographs? And how many radiographs do we need use when re-training a deep learning model? Methods: We annotated 396 radiographs of left and right carpi dorsal 75 medial to palmarolateral oblique (DMPLO) projection with the location of radius, proximal row of carpal bones, distal row of carpal bones, accessory carpal bone, first carpal bone (if present), and metacarpus (metacarpal II, III, and IV). The radiographs and respective annotations were splited into sets that were used to leave-one-out cross-validation of models created using transfer learn from YOLOv5s. Results: Models trained using 96 radiographs or more achieved precision, recall and mAP above 0.95, including for the first carpal bone, when trained for 32 epochs. The best model needed the double of epochs to learn to detect the first carpal bone compared with the other bones. Conclusions: Free and open source state of the art object detection models based on deep learning can be re-trained for radiograph computer vision applications with 100 radiographs and achieved precision, recall and mAP above 0.95.


title: 2nd Place Solution to Google Universal Image Embedding

abstract: Image representations are a critical building block of computer vision applications. This paper presents the 2nd place solution to the Google Universal Image Embedding Competition, which is part of the ECCV2022 instance-level recognition workshops. We use the instance-level fine-grained image classification method to complete this competition. We focus on data building and processing, model structure, and training strategies. Finally, the solution scored 0.713 on the public leaderboard and 0.709 on the private leaderboard.


title: Towards a theory of surface orbital magnetization

abstract: The theory of bulk orbital magnetization has been formulated both in reciprocal space based on Berry curvature and related quantities, and in real space in terms of the spatial average of a quantum mechanical local marker. Here we consider a three-dimensional antiferromagnetic material having a vanishing bulk but a nonzero surface orbital magnetization. We ask whether the surface-normal component of the surface magnetization is well defined, and if so, how to compute it. As the physical observable corresponding to this quantity, we identify the macroscopic current running along a hinge shared by two facets. However, the hinge current only constrains the difference of the surface magnetizations on the adjoined facets, leaving a potential ambiguity. By performing a symmetry analysis, we find that only crystals exhibiting a pseudoscalar symmetry admit well-defined magnetizations at their surfaces at the classical level. We then explore the possibility of computing surface magnetization via a coarse-graining procedure applied to a quantum local marker. We show that multiple expressions for the local marker exist, and apply constraints to filter out potentially meaningful candidates. Using several tight-binding models as our theoretical test bed and several potential markers, we compute surface magnetizations for slab geometries and compare their predictions with explicit calculations of the macroscopic hinge currents of rod geometries. We find that only a particular form of the marker consistently predicts the correct hinge currents.


title: Temporal and Contextual Transformer for Multi-Camera Editing of TV Shows

abstract: The ability to choose an appropriate camera view among multiple cameras plays a vital role in TV shows delivery. But it is hard to figure out the statistical pattern and apply intelligent processing due to the lack of high-quality training data. To solve this issue, we first collect a novel benchmark on this setting with four diverse scenarios including concerts, sports games, gala shows, and contests, where each scenario contains 6 synchronized tracks recorded by different cameras. It contains 88-hour raw videos that contribute to the 14-hour edited videos. Based on this benchmark, we further propose a new approach temporal and contextual transformer that utilizes clues from historical shots and other views to make shot transition decisions and predict which view to be used. Extensive experiments show that our method outperforms existing methods on the proposed multi-camera editing benchmark.


title: PCGen: Point Cloud Generator for LiDAR Simulation

abstract: Data is a fundamental building block for LiDAR perception systems. Unfortunately, real-world data collection and annotation is extremely costly & laborious. Recently, real data based LiDAR simulators have shown tremendous potential to complement real data, due to their scalability and high-fidelity compared to graphics engine based methods. Before simulation can be deployed in the real-world, two shortcomings need to be addressed. First, existing methods usually generate data which are more noisy and complete than the real point clouds, due to 3D reconstruction error and pure geometry-based raycasting method. Second, prior works on simulation for object detection focus solely on rigid objects, like cars, but VRUs, like pedestrians, are important road participants. To tackle the first challenge, we propose FPA raycasting and surrogate model raydrop. FPA enables the simulation of both point cloud coordinates and sensor features, while taking into account reconstruction noise. The ray-wise surrogate raydrop model mimics the physical properties of LiDAR's laser receiver to determine whether a simulated point would be recorded by a real LiDAR. With minimal training data, the surrogate model can generalize to different geographies and scenes, closing the domain gap between raycasted and real point clouds. To tackle the simulation of deformable VRU simulation, we employ SMPL dataset to provide a pedestrian simulation baseline and compare the domain gap between CAD and reconstructed objects. Applying our pipeline to perform novel sensor synthesis, results show that object detection models trained by simulation data can achieve similar result as the real data trained model.


title: A new alloy for Al-chalcogen system: AlSe surface alloy on Al (111)

abstract: Metal chalcogenide is a promising material for studying novel underlying physical phenomena and nanoelectronics applications. Here, we systematically investigate the crystal structure and electronic properties of the AlSe surface alloy on Al (111) using scanning tunneling microscopy, angle-resolved photoelectron spectrometer, and first-principle calculations. We reveal that the AlSe surface alloy possesses a hexagonal closed-packed structure. The AlSe surface alloy comprises two atomic sublayers (Se sublayer and Al sublayer) with 1.16 A along the z direction. The dispersion shows two hole-like bands for AlSe surface alloy located at about -2.2 eV, far below the Fermi level, which is sharply different from other metal chalcogenide and binary alloys. These two bands mainly derive from the in-plane orbital of AlSe (px and py). These results provide implications for related Al-chalcogen interface. Meanwhile, AlSe alloy have an advantage of large-scale atomic flatness and a wide band gap near the Fermi level in serving as an interface for two-dimensional materials.


title: Risk-Sensitive Markov Decision Processes with Long-Run CVaR Criterion

abstract: CVaR (Conditional Value at Risk) is a risk metric widely used in finance. However, dynamically optimizing CVaR is difficult since it is not a standard Markov decision process (MDP) and the principle of dynamic programming fails. In this paper, we study the infinite-horizon discrete-time MDP with a long-run CVaR criterion, from the view of sensitivity-based optimization. By introducing a pseudo CVaR metric, we derive a CVaR difference formula which quantifies the difference of long-run CVaR under any two policies. The optimality of deterministic policies is derived. We obtain a so-called Bellman local optimality equation for CVaR, which is a necessary and sufficient condition for local optimal policies and only necessary for global optimal policies. A CVaR derivative formula is also derived for providing more sensitivity information. Then we develop a policy iteration type algorithm to efficiently optimize CVaR, which is shown to converge to local optima in the mixed policy space. We further discuss some extensions including the mean-CVaR optimization and the maximization of CVaR. Finally, we conduct numerical experiments relating to portfolio management to demonstrate the main results. Our work may shed light on dynamically optimizing CVaR from a sensitivity viewpoint.


title: Anisotropic subwavelength grating perturbation enables zero crosstalk in a leaky mode

abstract: Electromagnetic coupling via either exponentially decaying evanescent field or radiative wave is a primary characteristic of light, allowing optical signal/power transfer but limiting integration density in a photonic circuit. A leaky mode combines both evanescent field and radiative wave, causing stronger crosstalk and thus not ideal for dense integration. Here we show that a leaky mode with anisotropic perturbation rather can achieve completely zero crosstalk realized by subwavelength grating (SWG) metamaterials. The oscillating fields in the SWGs enable coupling coefficients in each direction to counteract each other, resulting in completely zero crosstalk. We experimentally demonstrate such an extraordinarily low coupling between closely spaced identical leaky SWG waveguides, suppressing the crosstalk by $\approx$40 dB compared to conventional strip waveguides, corresponding to $\approx$100 times longer coupling length. This leaky-SWG suppresses the crosstalk of transverse-magnetic (TM) mode, which is challenging due to its low confinement, and marks a novel approach in electromagnetic coupling applicable to other spectral regimes and generic devices.


title: Tencent AI Lab - Shanghai Jiao Tong University Low-Resource Translation System for the WMT22 Translation Task

abstract: This paper describes Tencent AI Lab - Shanghai Jiao Tong University (TAL-SJTU) Low-Resource Translation systems for the WMT22 shared task. We participate in the general translation task on English$\Leftrightarrow$Livonian. Our system is based on M2M100 with novel techniques that adapt it to the target language pair. (1) Cross-model word embedding alignment: inspired by cross-lingual word embedding alignment, we successfully transfer a pre-trained word embedding to M2M100, enabling it to support Livonian. (2) Gradual adaptation strategy: we exploit Estonian and Latvian as auxiliary languages for many-to-many translation training and then adapt to English-Livonian. (3) Data augmentation: to enlarge the parallel data for English-Livonian, we construct pseudo-parallel data with Estonian and Latvian as pivot languages. (4) Fine-tuning: to make the most of all available data, we fine-tune the model with the validation set and online back-translation, further boosting the performance. In model evaluation: (1) We find that previous work underestimated the translation performance of Livonian due to inconsistent Unicode normalization, which may cause a discrepancy of up to 14.9 BLEU score. (2) In addition to the standard validation set, we also employ round-trip BLEU to evaluate the models, which we find more appropriate for this task. Finally, our unconstrained system achieves BLEU scores of 17.0 and 30.4 for English to/from Livonian.


title: Low Mach number limit of the global solution to the compressible Navier-Stokes system for large data in the critical Besov space

abstract: In this paper, we consider the compressible Navier--Stokes system around the constant equilibrium states and prove the unique existence of a global solution for arbitrarily large initial data in the scaling critical Besov space provided that the Mach number is sufficiently small and the incompressible part of the initial velocity generates the global solution of the incompressible Navier--Stokes equation. Moreover, we consider the low Mach number limit and show that the compressible solution converges to the solution of the incompressible Navier--Stokes equation in some space-time norms.


title: Modified C0 interior penalty analysis for fourth order Dirichlet boundary control problem and a posteriori error estimate

abstract: We revisit the L2 norm error estimate for the C0 interior penalty analysis of fourth order Dirichlet boundary control problem. The L2 norm estimate for the optimal control is derived under reduced regularity assumption and this analysis can be carried out on any convex polygonal domains. Residual based a-posteriori error bounds are derived for optimal control, state and adjoint state variables under minimal regularity assumptions. The estimators are shown to be reliable and locally efficient. The theoretical findings are illustrated by numerical experiments.


title: Row-wise LiDAR Lane Detection Network with Lane Correlation Refinement

abstract: Lane detection is one of the most important functions for autonomous driving. In recent years, deep learning-based lane detection networks with RGB camera images have shown promising performance. However, camera-based methods are inherently vulnerable to adverse lighting conditions such as poor or dazzling lighting. Unlike camera, LiDAR sensor is robust to the lighting conditions. In this work, we propose a novel two-stage LiDAR lane detection network with row-wise detection approach. The first-stage network produces lane proposals through a global feature correlator backbone and a row-wise detection head. Meanwhile, the second-stage network refines the feature map of the first-stage network via attention-based mechanism between the local features around the lane proposals, and outputs a set of new lane proposals. Experimental results on the K-Lane dataset show that the proposed network advances the state-of-the-art in terms of F1-score with 30% less GFLOPs. In addition, the second-stage network is found to be especially robust to lane occlusions, thus, demonstrating the robustness of the proposed network for driving in crowded environments.


title: Unifying Lengthscale-Based Rheology of Dense Granular-Fluid Mixtures

abstract: In this communication, we present a new lengthscale-based rheology for dense sheared particle suspensions as they transition from inertial- to viscous-dominated. We derive a lengthscale ratio using straightforward physics-based considerations for a particle subjected to pressure and drag forces. In doing so, we demonstrate that an appropriately chosen length-scale ratio intrinsically provides a consistent relationship between normal stress and system proximity to its ''jammed'' or solid-like state, even as a system transitions between inertial and viscous states, captured by a variable Stokes number.


title: A note on local energy decay results for wave equations with a potential

abstract: In this paper we consider the local energy decay result for wave equations with a short-range potential. It is important to note that one never uses a finite speed of propagation property unlike the historical previous papers. The essential parts of analysis are in getting L^2-bound of the solution itself, and deriving the weighted energy estimates. In this paper we only use a simple multiplier method to treat the variable coefficient case, and do not rely on any resolvent estimates.


title: Dual-Curriculum Teacher for Domain-Inconsistent Object Detection in Autonomous Driving

abstract: Object detection for autonomous vehicles has received increasing attention in recent years, where labeled data are often expensive while unlabeled data can be collected readily, calling for research on semi-supervised learning for this area. Existing semi-supervised object detection (SSOD) methods usually assume that the labeled and unlabeled data come from the same data distribution. In autonomous driving, however, data are usually collected from different scenarios, such as different weather conditions or different times in a day. Motivated by this, we study a novel but challenging domain inconsistent SSOD problem. It involves two kinds of distribution shifts among different domains, including (1) data distribution discrepancy, and (2) class distribution shifts, making existing SSOD methods suffer from inaccurate pseudo-labels and hurting model performance. To address this problem, we propose a novel method, namely Dual-Curriculum Teacher (DucTeacher). Specifically, DucTeacher consists of two curriculums, i.e., (1) domain evolving curriculum seeks to learn from the data progressively to handle data distribution discrepancy by estimating the similarity between domains, and (2) distribution matching curriculum seeks to estimate the class distribution for each unlabeled domain to handle class distribution shifts. In this way, DucTeacher can calibrate biased pseudo-labels and handle the domain-inconsistent SSOD problem effectively. DucTeacher shows its advantages on SODA10M, the largest public semi-supervised autonomous driving dataset, and COCO, a widely used SSOD benchmark. Experiments show that DucTeacher achieves new state-of-the-art performance on SODA10M with 2.2 mAP improvement and on COCO with 0.8 mAP improvement.


title: A Transformer-based Generative Model for De Novo Molecular Design

abstract: In the scope of drug discovery, the molecular design aims to identify novel compounds from the chemical space where the potential drug-like molecules are estimated to be in the order of 10^60 - 10^100. Since this search task is computationally intractable due to the unbounded search space, deep learning draws a lot of attention as a new way of generating unseen molecules. As we seek compounds with specific target proteins, we propose a Transformer-based deep model for de novo target-specific molecular design. The proposed method is capable of generating both drug-like compounds (without specified targets) and target-specific compounds. The latter are generated by enforcing different keys and values of the multi-head attention for each target. In this way, we allow the generation of SMILES strings to be conditional on the specified target. Experimental results demonstrate that our method is capable of generating both valid drug-like compounds and target-specific compounds. Moreover, the sampled compounds from conditional model largely occupy the real target-specific molecules' chemical space and also cover a significant fraction of novel compounds.


title: Keep Me Updated! Memory Management in Long-term Conversations

abstract: Remembering important information from the past and continuing to talk about it in the present are crucial in long-term conversations. However, previous literature does not deal with cases where the memorized information is outdated, which may cause confusion in later conversations. To address this issue, we present a novel task and a corresponding dataset of memory management in long-term conversations, in which bots keep track of and bring up the latest information about users while conversing through multiple sessions. In order to support more precise and interpretable memory, we represent memory as unstructured text descriptions of key information and propose a new mechanism of memory management that selectively eliminates invalidated or redundant information. Experimental results show that our approach outperforms the baselines that leave the stored memory unchanged in terms of engagingness and humanness, with larger performance gap especially in the later sessions.


title: Use of a smartphone camera to determine the focal length of a thin lens by finding the transverse magnification of the virtual image of an object

abstract: In this work we have determined the focal length of a concave lens by photographing the virtual image of an object by a smartphone camera. We have similarly determined the focal length of a convex lens by forming a virtual image of an object keeping it within the focal distance from the lens. When a photograph is taken by a smartphone, the transverse width of the image on the sensor of the camera in pixels can be read off by software available freely from the internet. By taking a photograph of the virtual image from two positions of the camera separated by a distance along the line of sight of the camera, we have determined the transverse width of the virtual image. From this we find the focal lengths of the lenses knowing the transverse width and the distance of the object from the lenses.


title: On the Bj\"orling problem for Born-Infeld solitons

abstract: The Bj\"orling problem and its solution is a well known result for minimal surfaces in Euclidean three-space. The minimal surface equation is similar to the Born-Infeld equation, which is naturally studied in physics. In this semi-expository article, we ask the question of the Bj\"orling problem for Born-Infeld solitons. This begins with the case of locally Born-Infeld soliton surfaces and later moves on to graph-like surfaces. We also present some results about their representation formulae.


title: MCP: Self-supervised Pre-training for Personalized Chatbots with Multi-level Contrastive Sampling

abstract: Personalized chatbots focus on endowing the chatbots with a consistent personality to behave like real users and further act as personal assistants. Previous studies have explored generating implicit user profiles from the user's dialogue history for building personalized chatbots. However, these studies only use the response generation loss to train the entire model, thus it is prone to suffer from the problem of data sparsity. Besides, they overemphasize the final generated response's quality while ignoring the correlations and fusions between the user's dialogue history, leading to rough data representations and performance degradation. To tackle these problems, we propose a self-supervised learning framework MCP for capturing better representations from users' dialogue history for personalized chatbots. Specifically, we apply contrastive sampling methods to leverage the supervised signals hidden in user dialog history, and generate the pre-training samples for enhancing the model. We design three pre-training tasks based on three types of contrastive pairs from user dialogue history, namely response pairs, sequence augmentation pairs, and user pairs. We pre-train the utterance encoder and the history encoder towards the contrastive objectives and use these pre-trained encoders for generating user profiles while personalized response generation. Experimental results on two real-world datasets show a significant improvement in our proposed model MCP compared with the existing methods.


title: Saturation of the filamentation instability and dispersion measure of Fast Radio Bursts

abstract: Nonlinear effects are crucial for the propagation of Fast Radio Bursts (FRBs) near the source. We study the filamentation of FRBs in the relativistic winds of magnetars, which are commonly invoked as the most natural FRB progenitors. As a result of filamentation, the particle number density and the radiation intensity develop strong gradients along the direction of the wind magnetic field. A steady state is reached when the plasma pressure balances the ponderomotive force. In such a steady state, particles are confined into periodically spaced thin sheets, and electromagnetic waves propagate between them as in a waveguide. We show that: (i) The dispersion relation resembles that in the initial homogeneous plasma, but the effective plasma frequency is determined by the separation of the sheets, not directly by the mean particle density. (ii) The contribution of relativistic magnetar winds to the dispersion measure of FRBs could be several orders of magnitude larger than previously thought. The dispersion measure of the wind depends on the properties of individual bursts (e.g. the luminosity), and therefore can change significantly among different bursts from repeating FRBs. (iii) Induced Compton scattering is suppressed because most of the radiation propagates in near vacuum regions.


title: Atmospheric heat redistribution effect on Emission spectra of Hot-Jupiters

abstract: Hot Jupiters are the most studied and easily detectable exoplanets for transit observations.However, the correlation between the atmospheric flow and the emission spectra of such planets is still not understood. Due to huge day-night temperature contrast in hot Jupiter, the thermal redistribution through atmospheric circulation has a significant impact on the vertical temperature-pressure structure and on the emission spectra. In the present work, we aim to study the variation of the temperature-pressure profiles and the emission spectra of such planets due to different amounts of atmospheric heat redistribution. For this purpose, we first derive an analytical relation between the heat redistribution parameter f and the emitted flux from the uppermost atmospheric layers of hot Jupiter. We adopt the three possible values of f under isotropic approximation as 1/4, 1/2, and 2/3 for full-redistribution, semi-redistribution and no-redistribution cases respectively and calculate the corresponding temperature-pressure profiles and the emission spectra. Next, we model the emission spectra for different values of f by numerically solving the radiative transfer equations using the discrete space theory formalism. We demonstrate that the atmospheric temperature-pressure profiles and the emission spectra both are susceptible to the values of the heat redistribution function. A reduction in the heat redistribution yields a thermal inversion in the temperature-pressure profiles and hence increases the amount of emission flux. Finally, we revisits the hot Jupiter XO-1b temperature-pressure profile degeneracy case and show that a non-inversion temperature-pressure profile best explains this observed planetary dayside emission spectra.


title: Combinatorial structures of the space of gradient vector fields on compact surfaces

abstract: A gradient flow is one of the fundamental objects from a theoretical and practical point of view. For instance, various phenomena are modeled as gradient flows. On the other hand, little is known about the topology of the space of gradient flows. For instance, it is not even known whether the space of gradient flows has non-simply-connected connected components. In this paper, to construct a foundation for describing the possible generic time evolution of gradient flows on surfaces with or without restriction conditions, we study the topology of the space of such flows under the non-existence of creations and annihilations of singular points. In fact, the space of gradient flows has non-contractible connected components.


title: A Quantum Algorithm for the Linear Response of Nuclei

abstract: We present a quantum algorithm to obtain the response of the atomic nucleus to a small external electromagnetic perturbation. The Hamiltonian of the system is presented by a harmonic oscillator, and the linear combination of unitaries (LCU) based method is utilized to simulate the Hamiltonian on the quantum computer. The output of the Hamiltonian simulation is utilized in calculating the dipole response with the SWAP test algorithm. The results of the response function computed using the quantum algorithm are compared with the experimental data and provide a good agreement. We show the results for $^{120}$Sn and $^{208}$Pb to corroborate with the experimental data in Sn and Pb region and also compare the results with those obtained using the conventional linear response theory.


title: Systematic Evaluation of Predictive Fairness

abstract: Mitigating bias in training on biased datasets is an important open problem. Several techniques have been proposed, however the typical evaluation regime is very limited, considering very narrow data conditions. For instance, the effect of target class imbalance and stereotyping is under-studied. To address this gap, we examine the performance of various debiasing methods across multiple tasks, spanning binary classification (Twitter sentiment), multi-class classification (profession prediction), and regression (valence prediction). Through extensive experimentation, we find that data conditions have a strong influence on relative model performance, and that general conclusions cannot be drawn about method efficacy when evaluating only on standard datasets, as is current practice in fairness research.


title: Towards Relation Extraction From Speech

abstract: Relation extraction typically aims to extract semantic relationships between entities from the unstructured text. One of the most essential data sources for relation extraction is the spoken language, such as interviews and dialogues. However, the error propagation introduced in automatic speech recognition (ASR) has been ignored in relation extraction, and the end-to-end speech-based relation extraction method has been rarely explored. In this paper, we propose a new listening information extraction task, i.e., speech relation extraction. We construct the training dataset for speech relation extraction via text-to-speech systems, and we construct the testing dataset via crowd-sourcing with native English speakers. We explore speech relation extraction via two approaches: the pipeline approach conducting text-based extraction with a pretrained ASR module, and the end2end approach via a new proposed encoder-decoder model, or what we called SpeechRE. We conduct comprehensive experiments to distinguish the challenges in speech relation extraction, which may shed light on future explorations. We share the code and data on https://github.com/wutong8023/SpeechRE.


title: Emergence of time periodic solutions for the generalized surface quasi-geostrophic equation in the disc

abstract: In this paper we address the existence of time periodic solutions for the generalized inviscid SQG equation in the unit disc with homogeneous Dirichlet boundary condition when $\alpha\in (0,1)$. We show the existence of a countable family of bifurcating curves from the radial patches. In contrast with the preceding studies in active scalar equations, the Green function is no longer explicit and we circumvent this issue by a suitable splitting into a singular explicit part (which coincides with the planar one) and a smooth implicit one induced by the boundary of the domain. Another problem is connected to the analysis of the linear frequencies which admit a complicated form through a discrete sum involving Bessel functions and their zeros. We overcome this difficulty by using Sneddon's formula leading to a suitable integral representation of the frequencies.


title: Protein Sequence and Structure Co-Design with Equivariant Translation

abstract: Proteins are macromolecules that perform essential functions in all living organisms. Designing novel proteins with specific structures and desired functions has been a long-standing challenge in the field of bioengineering. Existing approaches generate both protein sequence and structure using either autoregressive models or diffusion models, both of which suffer from high inference costs. In this paper, we propose a new approach capable of protein sequence and structure co-design, which iteratively translates both protein sequence and structure into the desired state from random initialization, based on context features given a priori. Our model consists of a trigonometry-aware encoder that reasons geometrical constraints and interactions from context features, and a roto-translation equivariant decoder that translates protein sequence and structure interdependently. Notably, all protein amino acids are updated in one shot in each translation step, which significantly accelerates the inference process. Experimental results across multiple tasks show that our model outperforms previous state-of-the-art baselines by a large margin, and is able to design proteins of high fidelity as regards both sequence and structure, with running time orders of magnitude less than sampling-based methods.


title: Inflaton as a pseudo-Nambu-Goldstone boson

abstract: In the realistic model of cosmic inflation the inflaton potential should be flat and stable under quantum corrections. It is natural to imagine that there is some symmetry behind and an idea of the inflaton as a Nambu-Goldstone boson of spontaneous breaking of some symmetry has been examined. We give a general formulation of this idea using the non-linear realization of Nambu-Goldstone boson in low-energy effective theory with some explicit symmetry breaking to generate non-trivial potential. The potential is naturally a simple function, typically the mass term of inflaton, and the scenario of "warm inflation" should necessarily be applied under the present observational constraints. We investigate the generation mechanism of necessary thermal dissipation term in inflaton field equation for "warm inflation" without large thermal corrections to inflaton potential. A simple numerical analysis is given to investigate the viability of this scenario.


title: ReasonChainQA: Text-based Complex Question Answering with Explainable Evidence Chains

abstract: The ability of reasoning over evidence has received increasing attention in question answering (QA). Recently, natural language database (NLDB) conducts complex QA in knowledge base with textual evidences rather than structured representations, this task attracts a lot of attention because of the flexibility and richness of textual evidence. However, existing text-based complex question answering datasets fail to provide explicit reasoning process, while it's important for retrieval effectiveness and reasoning interpretability. Therefore, we present a benchmark \textbf{ReasonChainQA} with explanatory and explicit evidence chains. ReasonChainQA consists of two subtasks: answer generation and evidence chains extraction, it also contains higher diversity for multi-hop questions with varying depths, 12 reasoning types and 78 relations. To obtain high-quality textual evidences for answering complex question. Additional experiment on supervised and unsupervised retrieval fully indicates the significance of ReasonChainQA. Dataset and codes will be made publicly available upon accepted.


title: Effects of Emerging Bipolar Magnetic Regions in Mean-field Dynamo Model of Solar Cycles 23 and 24

abstract: We model the physical parameters of Solar Cycles 23 and 24 using a nonlinear dynamical mean-field dynamo model that includes the formation and evolution of bipolar magnetic regions (BMR). The Parker-type dynamo model consists of a complete MHD system in the mean-field formulation: the 3D magnetic induction equation, and 2D momentum and energy equations in the anelastic approximation. The initialization of BMR is modeled in the framework of Parker's magnetic buoyancy instability. It defines the depths of BMR injections, which are typically located at the edge of the global dynamo waves. The distribution with longitude and latitude and the size of the initial BMR perturbations are taken from the NOAA database of active regions. The tilt of the perturbations is modeled by random function, and the mean tilt is modeled as a near-surface helicity (alpha-effect) term. The data-driven models are compared with the models calculated for random longitudinal and latitudinal distributions of the initial perturbation. The modeling results are compared with various observed characteristics of the solar cycles, including the magnetic butterfly diagram, the polar magnetic and basal magnetic fluxes, and the probability distributions of the BMR flux on the surface. Our results show that BMR can play a substantial role in the dynamo processes, and affect the strength of the solar cycle. However, the data-driven model shows that the BMR effect alone cannot explain the weak Cycle 24. This weak cycle and the prolonged preceding minimum of magnetic activity were probably caused by a decrease of the turbulent helicity in the bulk of the convection zone during the decaying phase of Cycle 23.


title: Temporal Link Prediction: A Unified Framework, Taxonomy, and Review

abstract: Dynamic graphs serve as a generic abstraction and description of the evolutionary behaviors of various complex systems (e.g., social networks and communication networks). Temporal link prediction (TLP) is a classic yet challenging inference task on dynamic graphs, which predicts possible future linkage based on historical topology. The predicted future topology can be used to support some advanced applications on real-world systems (e.g., resource pre-allocation) for better system performance. This survey provides a comprehensive review of existing TLP methods. Concretely, we first give the formal problem statements and preliminaries regarding data models, task settings, and learning paradigms that are commonly used in related research. A hierarchical fine-grained taxonomy is further introduced to categorize existing methods in terms of their data models, learning paradigms, and techniques. From a generic perspective, we propose a unified encoder-decoder framework to formulate all the methods reviewed, where different approaches only differ in terms of some components of the framework. Moreover, we envision serving the community with an open-source project OpenTLP that refactors or implements some representative TLP methods using the proposed unified framework and summarizes other public resources. As a conclusion, we finally discuss advanced topics in recent research and highlight possible future directions.


title: Intersection theory and Chern classes on normal varieties

abstract: We study intersection theory and Chern classes of reflexive sheaves on normal varieties. In particular, we define generalization of Mumford's intersection theory on normal surfaces to higher dimensions. We also define and study the second Chern class for reflexive sheaves on normal varieties. We use these results to prove some Bogomolov type inequalities on normal varieties in positive characteristic. We also prove some new boundedness results on normal varieties in positive characteristic.


title: Bogomolov's inequality and Higgs sheaves on normal varieties in positive characteristic

abstract: We prove Bogomolov's inequality on a normal projective variety in positive characteristic and we use it to show some new restriction theorems and a new boundedness result. Then we redefine Higgs sheaves on normal varieties and we prove restriction theorems and Bogomolov type inequalities for semistable logarithmic Higgs sheaves on some normal varieties in an arbitrary characteristic.


title: N-pad : Neighboring Pixel-based Industrial Anomaly Detection

abstract: Identifying defects in the images of industrial products has been an important task to enhance quality control and reduce maintenance costs. In recent studies, industrial anomaly detection models were developed using pre-trained networks to learn nominal representations. To employ the relative positional information of each pixel, we present \textit{\textbf{N-pad}}, a novel method for anomaly detection and segmentation in a one-class learning setting that includes the neighborhood of the target pixel for model training and evaluation. Within the model architecture, pixel-wise nominal distributions are estimated by using the features of neighboring pixels with the target pixel to allow possible marginal misalignment. Moreover, the centroids from clusters of nominal features are identified as a representative nominal set. Accordingly, anomaly scores are inferred based on the Mahalanobis distances and Euclidean distances between the target pixel and the estimated distributions or the centroid set, respectively. Thus, we have achieved state-of-the-art performance in MVTec-AD with AUROC of 99.37 for anomaly detection and 98.75 for anomaly segmentation, reducing the error by 34\% compared to the next best performing model. Experiments in various settings further validate our model.


title: Status of the singlino-dominated dark matter in general Next-to-Minimal Supersymmetric Standard Model

abstract: With the rapid progress of dark matter direct detection experiments, the attractiveness of the popular bino-dominated dark matter in economical supersymmetric theories is fading. As an alternative, the singlino-dominated dark matter in general Next-to-Minimal Supersymmetric Standard Model (NMSSM) is paying due attention. This scenario has the following distinct characteristics: free from the tadpole problem and the domain-wall problem of the NMSSM with a $Z_3$-symmetry, predicting more stable vacuum states than the $Z_3$-NMSSM, capable of forming an economical secluded dark matter sector to yield the dark matter experimental results naturally, and readily weaken the restrictions from the LHC search for SUSY. Consequently, it can explain the muon g-2 anomaly in broad parameter space that agrees with various experimental results while simultaneously breaking the electroweak symmetry naturally. In this study, we show in detail how the scenario coincides with the experiments, such as the SUSY search at the LHC, the dark matter search by the LZ experiment, and the improved measurement of the muon g-2. We provide a simple and clear picture of the physics inherent in the general NMSSM.


title: Massive MIMO Channel Prediction Via Meta-Learning and Deep Denoising: Is a Small Dataset Enough?

abstract: Accurate channel knowledge is critical in massive multiple-input multiple-output (MIMO), which motivates the use of channel prediction. Machine learning techniques for channel prediction hold much promise, but current schemes are limited in their ability to adapt to changes in the environment because they require large training overheads. To accurately predict wireless channels for new environments with reduced training overhead, we propose a fast adaptive channel prediction technique based on a meta-learning algorithm for massive MIMO communications. We exploit the model-agnostic meta-learning (MAML) algorithm to achieve quick adaptation with a small amount of labeled data. Also, to improve the prediction accuracy, we adopt the denoising process for the training data by using deep image prior (DIP). Numerical results show that the proposed MAML-based channel predictor can improve the prediction accuracy with only a few fine-tuning samples. The DIP-based denoising process gives an additional gain in channel prediction, especially in low signal-to-noise ratio regimes.


title: ADE Bundles over Surfaces

abstract: This is a review paper about ADE bundles over surfaces. Based on the deep connections between the geometry of surfaces and ADE Lie theory, we construct the corresponding ADE bundles over surfaces and study some related problems.


title: Signal Processing for Implicit Neural Representations

abstract: Implicit Neural Representations (INRs) encoding continuous multi-media data via multi-layer perceptrons has shown undebatable promise in various computer vision tasks. Despite many successful applications, editing and processing an INR remains intractable as signals are represented by latent parameters of a neural network. Existing works manipulate such continuous representations via processing on their discretized instance, which breaks down the compactness and continuous nature of INR. In this work, we present a pilot study on the question: how to directly modify an INR without explicit decoding? We answer this question by proposing an implicit neural signal processing network, dubbed INSP-Net, via differential operators on INR. Our key insight is that spatial gradients of neural networks can be computed analytically and are invariant to translation, while mathematically we show that any continuous convolution filter can be uniformly approximated by a linear combination of high-order differential operators. With these two knobs, INSP-Net instantiates the signal processing operator as a weighted composition of computational graphs corresponding to the high-order derivatives of INRs, where the weighting parameters can be data-driven learned. Based on our proposed INSP-Net, we further build the first Convolutional Neural Network (CNN) that implicitly runs on INRs, named INSP-ConvNet. Our experiments validate the expressiveness of INSP-Net and INSP-ConvNet in fitting low-level image and geometry processing kernels (e.g. blurring, deblurring, denoising, inpainting, and smoothening) as well as for high-level tasks on implicit fields such as image classification.


title: Plug-and-Play VQA: Zero-shot VQA by Conjoining Large Pretrained Models with Zero Training

abstract: Visual question answering (VQA) is a hallmark of vision and language reasoning and a challenging task under the zero-shot setting. We propose Plug-and-Play VQA (PNP-VQA), a modular framework for zero-shot VQA. In contrast to most existing works, which require substantial adaptation of pretrained language models (PLMs) for the vision modality, PNP-VQA requires no additional training of the PLMs. Instead, we propose to use natural language and network interpretation as an intermediate representation that glues pretrained models together. We first generate question-guided informative image captions, and pass the captions to a PLM as context for question answering. Surpassing end-to-end trained baselines, PNP-VQA achieves state-of-the-art results on zero-shot VQAv2 and GQA. With 11B parameters, it outperforms the 80B-parameter Flamingo model by 8.5% on VQAv2. With 738M PLM parameters, PNP-VQA achieves an improvement of 9.1% on GQA over FewVLM with 740M PLM parameters. Code is released at https://github.com/salesforce/LAVIS/tree/main/projects/pnp-vqa


title: $K_1$ and $K$-groups of absolute matrix order unit spaces

abstract: In this paper, we describe the Grothendieck groups $K_1(V)$ and $K(V)$ of an absolute matrix order unit space $V$ for unitary and partial unitary elements respectively. For this purpose, we study some basic properties of unitary and partial unitary elements, and define their path homotopy equivalence. The construction of $K(V)$ follows in a almost similar manner as that of $K_1(V).$ We prove that $K_1(V)$ and $K(V)$ are ordered abelian groups. We also prove that $K_1(V)$ and $K(V)$ are functors from the category of absolute matrix order unit spaces with morphisms as unital completely $\vert \cdot \vert$-preserving maps to the category of ordered abelian groups. Later, we show that under certain conditions, quotient of $K(V)$ is isomorphic to the direct sum of $K_0(V)$ and $K_1(V),$ where $K_0(V)$ is the Grothendieck group for order projections.


title: Quantum battery in nonequilibrium reservoirs

abstract: We investigate a quantum battery system in which the coupled two-level charger and battery are immersed in nonequilbrium boson or fermion reservoirs. Based on the Redfield master equation, we consider the change of the energy spectrum induced by the external driving to the charger. When the charger and the battery possess the same transition frequency and the charger is driven in resonance, a bistability can emerge with the closure of the Liouvillian gap. As a result, the efficiency of the battery depends on the initial state of the charger-battery system, and certain types of entangled initial states can enhance the efficiency. In the non-resonance driving regime, the efficiency of the quantum battery can be optimized by the compensation mechanism for both the boson and fermion reservoirs. Our investigation is helpful to the design and optimization of quantum battery in the nonequlibrium open system.


title: Multiplicative generalized Jordan $n$-derivations of unital rings with idempotents

abstract: Let $\mathfrak{A}$ be a unital ring with a nontrivial idempotent. In this paper, it is shown that under certain conditions every multiplicative generalized Jordan $n$-derivation $\Delta:\mathfrak{A}\rightarrow\mathfrak{A}$ is additive. More precisely, it is proved that $\Delta$ is of the form $\Delta(t)=\mu t+\delta(t),$ where $\mu\in\mathcal{Z}(\mathfrak{A})$ and $\delta:\mathfrak{A}\rightarrow\mathfrak{A}$ is a Jordan $n$-derivation. The main result is then applied to some classical examples of unital rings with nontrivial idempotents such as triangular rings, matrix rings, prime rings, nest algebras, standard operator algebras, and von Neumann algebras.


title: Spin and thermal transport and critical phenomena in three-dimensional antiferromagnets

abstract: We investigate spin and thermal transport near the N\'{e}el transition temperature $T_N$ in three dimensions, by numerically analyzing the classical antiferromagnetic $XXZ$ model on the cubic lattice, where in the model, the anisotropy of the exchange interaction $\Delta=J_z/J_x$ plays a role to control the universality class of the transition. It is found by means of the hybrid Monte-Carlo and spin-dynamics simulations that in the $XY$ and Heisenberg cases of $\Delta \leq 1$, the longitudinal spin conductivity $\sigma^s_{\mu\mu}$ exhibits a divergent enhancement on cooling toward $T_N$, while not in the Ising case of $\Delta>1$. In all the three cases, the temperature dependence of the thermal conductivity $\kappa_{\mu\mu}$ is featureless at $T_N$, being consistent with experimental results. The divergent enhancement of $\sigma^s_{\mu\mu}$ toward $T_N$ is attributed to the spin-current relaxation time which gets longer toward $T_N$, showing a power-law divergence characteristic of critical phenomena. It is also found that in contrast to the $XY$ case where the divergence in $\sigma^s_{\mu\mu}$ is rapidly suppressed below $T_N$, $\sigma^s_{\mu\mu}$ likely remains divergent even below $T_N$ in the Heisenberg case, which might experimentally be observed in the ideally isotropic antiferromagnet RbMnF$_3$.


title: Searching for scalar field dark matter with hyperfine transitions in alkali atoms

abstract: Fundamental constants such as masses and coupling constants of elementary particles can have small temporal and spatial variations in the scalar field dark matter model. These variations entail time oscillations of other constants, such as the Bohr and nuclear magnetons, Bohr radius and the hyperfine structure constant. In the presence of an external magnetic field, these oscillations induce hyperfine transitions in atoms and molecules. We determine the probability of magnetic dipole hyperfine transitions, caused by the oscillating fundamental constants, and propose an experiment that could detect the scalar field dark matter through this effect. This experiment may be sensitive to the scalar field and axion dark matter with mass in the range $1\,\mu\text{eV}<m<100\,\mu\text{eV}$.


title: Towards Summary Candidates Fusion

abstract: Sequence-to-sequence deep neural models fine-tuned for abstractive summarization can achieve great performance on datasets with enough human annotations. Yet, it has been shown that they have not reached their full potential, with a wide gap between the top beam search output and the oracle beam. Recently, re-ranking methods have been proposed, to learn to select a better summary candidate. However, such methods are limited by the summary quality aspects captured by the first-stage candidates. To bypass this limitation, we propose a new paradigm in second-stage abstractive summarization called SummaFusion that fuses several summary candidates to produce a novel abstractive second-stage summary. Our method works well on several summarization datasets, improving both the ROUGE scores and qualitative properties of fused summaries. It is especially good when the candidates to fuse are worse, such as in the few-shot setup where we set a new state-of-the-art. We will make our code and checkpoints available at https://github.com/ntunlp/SummaFusion/.


title: Sample-efficient Model Predictive Control Design of Soft Robotics by Bayesian Optimization

abstract: This paper presents a sample-efficient data-driven method to design model predictive control (MPC) for cable-actuated soft robotics using Bayesian optimization. Instead of modeling the complex dynamics of the soft robots, the proposed approach uses Bayesian optimization to search the best-guessed low-dimensional prediction model and its associated controller to minimize the objective function of closed-loop responses. The prediction model is updated by Bayesian optimization from the closed-loop input-output data in each iteration. A linear MPC is then designed based on the updated prediction model, and evaluated based on the closed-loop responses. Different from directly searching controller parameters, the closed-loop system stability, and inputs/outputs constraints can be easily handled in the MPC design. After a few iterations, a convergent solution of a (sub-)optimal controller can be obtained, which minimizes the user-defined closed-loop performance index. The proposed method is simulated and validated by a high-fidelity simulation of a cable-actuated soft robot. The simulation results demonstrate that the proposed approach can achieve desired tracking controller for the soft robot without a prior-known model.


title: Stochastic Differentially Private and Fair Learning

abstract: Machine learning models are increasingly used in high-stakes decision-making systems. In such applications, a major concern is that these models sometimes discriminate against certain demographic groups such as individuals with certain race, gender, or age. Another major concern in these applications is the violation of the privacy of users. While fair learning algorithms have been developed to mitigate discrimination issues, these algorithms can still leak sensitive information, such as individuals' health or financial records. Utilizing the notion of differential privacy (DP), prior works aimed at developing learning algorithms that are both private and fair. However, existing algorithms for DP fair learning are either not guaranteed to converge or require full batch of data in each iteration of the algorithm to converge. In this paper, we provide the first stochastic differentially private algorithm for fair learning that is guaranteed to converge. Here, the term "stochastic" refers to the fact that our proposed algorithm converges even when minibatches of data are used at each iteration (i.e. stochastic optimization). Our framework is flexible enough to permit different fairness notions, including demographic parity and equalized odds. In addition, our algorithm can be applied to non-binary classification tasks with multiple (non-binary) sensitive attributes. As a byproduct of our convergence analysis, we provide the first utility guarantee for a DP algorithm for solving nonconvex-strongly concave min-max problems. Our numerical experiments show that the proposed algorithm consistently offers significant performance gains over the state-of-the-art baselines, and can be applied to larger scale problems with non-binary target/sensitive attributes.


title: On powers of circular arc graphs

abstract: A class of graphs $\mathcal{C}$ is closed under powers if for every graph $G\in\mathcal{C}$ and every $k\in\mathbb{N}$, $G^k\in\mathcal{C}$. Also $\mathcal{C}$ is strongly closed under powers if for every $k\in\mathbb{N}$, if $G^k\in\mathcal{C}$, then $G^{k+1}\in\mathcal{C}$. It is known that circular arc graphs and proper circular arc graphs are closed under powers. But it is open whether these classes of graphs are also strongly closed under powers. In this paper we have settled these problems.


title: Thread/State correspondence: from bit threads to qubit threads

abstract: Starting from an interesting coincidence between the bit threads and SS (surface/state) correspondence, both of which are closely related to the holographic RT formula, we introduce a property of bit threads that has not been explicitly proposed before, which can be referred to as thread/state correspondence (see~\cite{Lin:2022agc} for a brief pre-release version). Using this thread/state correspondence, we can construct the explicit expressions for the SS states corresponding to a set of bulk extremal surfaces in the SS correspondence, and nicely characterize their entanglement structure. Based on this understanding, we use the locking bit thread configurations to construct a holographic qubit threads model as a new toy model of the holographic principle, and show that it is closely related to the holographic tensor networks, the kinematic space, and the connectivity of spacetime.


title: Cross-layer Attention Network for Fine-grained Visual Categorization

abstract: Learning discriminative representations for subtle localized details plays a significant role in Fine-grained Visual Categorization (FGVC). Compared to previous attention-based works, our work does not explicitly define or localize the part regions of interest; instead, we leverage the complementary properties of different stages of the network, and build a mutual refinement mechanism between the mid-level feature maps and the top-level feature map by our proposed Cross-layer Attention Network (CLAN). Specifically, CLAN is composed of 1) the Cross-layer Context Attention (CLCA) module, which enhances the global context information in the intermediate feature maps with the help of the top-level feature map, thereby improving the expressive power of the middle layers, and 2) the Cross-layer Spatial Attention (CLSA) module, which takes advantage of the local attention in the mid-level feature maps to boost the feature extraction of local regions at the top-level feature maps. Experimental results show our approach achieves state-of-the-art on three publicly available fine-grained recognition datasets (CUB-200-2011, Stanford Cars and FGVC-Aircraft). Ablation studies and visualizations are provided to understand our approach. Experimental results show our approach achieves state-of-the-art on three publicly available fine-grained recognition datasets (CUB-200-2011, Stanford Cars and FGVC-Aircraft).


title: Welfare estimations from imagery. A test of domain experts ability to rate poverty from visual inspection of satellite imagery

abstract: The present study uses domain experts to estimate welfare levels and indicators from high-resolution satellite imagery. We use the wealth quintiles from the 2015 Tanzania DHS dataset as ground truth data. We analyse the performance of the visual estimation of relative wealth at the cluster level and compare these with wealth rankings from the DHS survey of 2015 for that country using correlations, ordinal regressions and multinomial logistic regressions. Of the 608 clusters, 115 received the same ratings from human experts and the independent DHS rankings. For 59 percent of the clusters, experts ratings were slightly lower. On the one hand, significant positive predictors of wealth are the presence of modern roofs and wider roads. For instance, the log odds of receiving a rating in a higher quintile on the wealth rankings is 0.917 points higher on average for clusters with buildings with slate or tile roofing compared to those without. On the other hand, significant negative predictors included poor road coverage, low to medium greenery coverage, and low to medium building density. Other key predictors from the multinomial regression model include settlement structure and farm sizes. These findings are significant to the extent that these correlates of wealth and poverty are visually readable from satellite imagery and can be used to train machine learning models in poverty predictions. Using these features for training will contribute to more transparent ML models and, consequently, explainable AI.


title: Exposing Influence Campaigns in the Age of LLMs: A Behavioral-Based AI Approach to Detecting State-Sponsored Trolls

abstract: The detection of state-sponsored trolls operating in influence campaigns on social media is a critical and unsolved challenge for the research community, which has significant implications beyond the online realm. To address this challenge, we propose a new AI-based solution that identifies troll accounts solely through behavioral cues associated with their sequences of sharing activity, encompassing both their actions and the feedback they receive from others. Our approach does not incorporate any textual content shared and consists of two steps: First, we leverage an LSTM-based classifier to determine whether account sequences belong to a state-sponsored troll or an organic, legitimate user. Second, we employ the classified sequences to calculate a metric named the "Troll Score", quantifying the degree to which an account exhibits troll-like behavior. To assess the effectiveness of our method, we examine its performance in the context of the 2016 Russian interference campaign during the U.S. Presidential election. Our experiments yield compelling results, demonstrating that our approach can identify account sequences with an AUC close to 99% and accurately differentiate between Russian trolls and organic users with an AUC of 91%. Notably, our behavioral-based approach holds a significant advantage in the ever-evolving landscape, where textual and linguistic properties can be easily mimicked by Large Language Models (LLMs): In contrast to existing language-based techniques, it relies on more challenging-to-replicate behavioral cues, ensuring greater resilience in identifying influence campaigns, especially given the potential increase in the usage of LLMs for generating inauthentic content. Finally, we assessed the generalizability of our solution to various entities driving different information operations and found promising results that will guide future research.


title: A note on the capacity estimate in metastability for generic configurations

abstract: In this paper we further develop the ideas from Geometric Function Theory initially introduced in [arXiv:2206.13206], to derive capacity estimate in metastability for arbitrary configurations. The novelty of this paper is twofold. First, the graph theoretical connection enables us to exactly compute the pre-factor in the capacity. Second, we complete the method from [arXiv:2206.13206] by providing an upper bound using Geometric Function Theory together with Thompson's principle, avoiding explicit constructions of test functions.


title: EISeg: An Efficient Interactive Segmentation Tool based on PaddlePaddle

abstract: In recent years, the rapid development of deep learning has brought great advancements to image and video segmentation methods based on neural networks. However, to unleash the full potential of such models, large numbers of high-quality annotated images are necessary for model training. Currently, many widely used open-source image segmentation software relies heavily on manual annotation which is tedious and time-consuming. In this work, we introduce EISeg, an Efficient Interactive SEGmentation annotation tool that can drastically improve image segmentation annotation efficiency, generating highly accurate segmentation masks with only a few clicks. We also provide various domain-specific models for remote sensing, medical imaging, industrial quality inspections, human segmentation, and temporal aware models for video segmentation. The source code for our algorithm and user interface are available at: https://github.com/PaddlePaddle/PaddleSeg.


title: Symmetric generating functions and Euler-Stirling statistics on permutations

abstract: We present (bi-)symmetric generating functions for the joint distributions of Euler-Stirling statistics on permutations, including the number of descents ($\mathsf{des}$), inverse descents ($\mathsf{ides}$), the number of left-to-right maxima ($\mathsf{lmax}$), the number of right-to-left maxima ($\mathsf{rmax}$) and the number of left-to-right minima ($\mathsf{lmin}$). We also show how they recover the classical symmetric generating function of permutations due to Carlitz, Roselle and Scoville (1966). Our proofs exploit three different recursive constructions of inversion sequences, bijections on the multiple equidistributions of Euler-Stirling statistics over permutations and transformation formulas of basic hypergeometric series. Furthermore, we establish a new quadruple equidistribution of Euler-Stirling statistics over inversion sequences, as progress towards a conjecture proposed by Schlosser and the author (2020).


title: Repulsion of a N\'eel-type skyrmion from a Pearl vortex in thin ferromagnet-superconductor heterostructures

abstract: In this paper we study repulsion of a N\'eel-type skyrmion in a chiral ferromagnetic film from a superconducting Pearl vortex due to the stray fields. Taking into account an effect of the vortex magnetic field on the skyrmion non-perturbatively, we find that the repulsion between them is suppressed with increase of the dimensionless strength of the vortex magnetic field. This manifests itself in complicated evolution of the free energy with increase of the vortex magnetic field and reduction of the equilibrium distance between the centers of N\'eel-type skyrmion and Pearl vortex.


title: Broadband X-ray Spectral Analysis of the Dual AGN System Mrk 739

abstract: We present the result of a broadband (0.5-70 keV) X-ray spectral analysis of the late-merger galaxy Mrk 739, which contains a dual active galactic nucleus (AGN), Mrk 739E and Mrk 739W, with a separation of $\sim$3.4 kpc. The spectra obtained with NuSTAR, Chandra, XMM-Newton and Swift/BAT are simultaneously analyzed by separating the contributions from the two AGNs and extended emission with the Chandra data. To evaluate the reflection components from the AGN tori, we consider two models, a phenomenological one (pexrav and zgauss) and a more physically motivated one (XCLUMPY; Tanimoto et al. 2019). On the basis of the results with XCLUMPY, we find that the AGNs in Mrk 739E and Mrk 739W have intrinsic 2-10 keV luminosities of $1.0 \times 10^{43}$ and $7.5 \times 10^{41}\ \rm{erg}\ \rm{s}^{-1}$ absorbed by hydrogen column densities of $N_{\rm{H}} < 6.5 \times 10^{19}\ \rm{cm}^{-2}$ and $N_{\rm{H}} = 6.9^{+3.2}_{-1.7} \times 10^{21}\ \rm{cm}^{-2}$, respectively. The torus covering fraction of the material with $N_{\rm{H}} > 10^{22} \rm{cm}^{-2}$ in Mrk 739E, $C_{\rm{T}}^{(22)} < 0.50$ at a 90% confidence limit, is found to be smaller than those found for late-merger ultra/luminous infrared galaxies, $C_{\rm{T}}^{(22)} = 0.71\pm0.16$ (mean and standard deviation; Yamada et al. 2021). Considering the small star formation rate of Mrk 739E, we suggest that the gas-to-mass ratio of the host galaxy is an important parameter to determine the circumnuclear environment of an AGN in late merger.


abstract: Graph contrastive learning (GCL) has recently emerged as an effective learning paradigm to alleviate the reliance on labelling information for graph representation learning. The core of GCL is to maximise the mutual information between the representation of a node and its contextual representation (i.e., the corresponding instance with similar semantic information) summarised from the contextual scope (e.g., the whole graph or 1-hop neighbourhood). This scheme distils valuable self-supervision signals for GCL training. However, existing GCL methods still suffer from limitations, such as the incapacity or inconvenience in choosing a suitable contextual scope for different datasets and building biased contrastiveness. To address aforementioned problems, we present a simple self-supervised learning method termed Unifying Graph Contrastive Learning with Flexible Contextual Scopes (UGCL for short). Our algorithm builds flexible contextual representations with tunable contextual scopes by controlling the power of an adjacency matrix. Additionally, our method ensures contrastiveness is built within connected components to reduce the bias of contextual representations. Based on representations from both local and contextual scopes, UGCL optimises a very simple contrastive loss function for graph representation learning. Essentially, the architecture of UGCL can be considered as a general framework to unify existing GCL methods. We have conducted intensive experiments and achieved new state-of-the-art performance in six out of eight benchmark datasets compared with self-supervised graph representation learning baselines. Our code has been open-sourced.


title: Rethinking Trajectory Prediction via "Team Game"

abstract: To accurately predict trajectories in multi-agent settings, e.g. team games, it is important to effectively model the interactions among agents. Whereas a number of methods have been developed for this purpose, existing methods implicitly model these interactions as part of the deep net architecture. However, in the real world, interactions often exist at multiple levels, e.g. individuals may form groups, where interactions among groups and those among the individuals in the same group often follow significantly different patterns. In this paper, we present a novel formulation for multi-agent trajectory prediction, which explicitly introduces the concept of interactive group consensus via an interactive hierarchical latent space. This formulation allows group-level and individual-level interactions to be captured jointly, thus substantially improving the capability of modeling complex dynamics. On two multi-agent settings, i.e. team sports and pedestrians, the proposed framework consistently achieves superior performance compared to existing methods.


title: Break The Spell Of Total Correlation In betaTCVAE

abstract: In the absence of artificial labels, the independent and dependent features in the data are cluttered. How to construct the inductive biases of the model to flexibly divide and effectively contain features with different complexity is the main focal point of unsupervised disentangled representation learning. This paper proposes a new iterative decomposition path of total correlation and explains the disentangled representation ability of VAE from the perspective of model capacity allocation. The newly developed objective function combines latent variable dimensions into joint distribution while relieving the independence constraints of marginal distributions in combination, leading to latent variables with a more manipulable prior distribution. The novel model enables VAE to adjust the parameter capacity to divide dependent and independent data features flexibly. Experimental results on various datasets show an interesting relevance between model capacity and the latent variable grouping size, called the "V"-shaped best ELBO trajectory. Additionally, we empirically demonstrate that the proposed method obtains better disentangling performance with reasonable parameter capacity allocation.


title: Saturated orbit closures in the Hodge bundle

abstract: We give a new proof of the classification of ${\rm GL}^+(2,\mathbb{R})$-orbit closures that are saturated for the absolute period foliation of the Hodge bundle. As a consequence, we obtain a short proof of the classification of closures of leaves of the absolute period foliation of the Hodge bundle. Our approach is based on a method for classifying ${\rm GL}^+(2,\mathbb{R})$-orbit closures using deformations of flat pairs of pants.


title: In-vitro to in-vivo acetaminophen hepatotoxicity extrapolation using classical schemes, pharmaco-dynamic models and a multiscale spatial-temporal liver twin

abstract: In vitro to in vivo extrapolation represents a critical challenge in toxicology. In this paper we explore extrapolation strategies for acetaminophen (APAP) based on mechanistic models, comparing classical homogeneous compartment pharmaco-dynamic (PD) models and a multiscale digital twin model resolving liver microarchitecture at cellular resolution. The models integrate consensus detoxification reactions in each individual hepatocyte. We study the consequences of the two model types on the extrapolation and show in which cases these models perform better than the classical extrapolation strategy that is based either on the maximal drug concentration (Cmax) or the area under the pharmaco-kinetic curve (AUC) of the drug blood concentration.


title: Recurrence algorithms of waiting time for the success run of length $k$ in relation to generalized Fibonacci sequences

abstract: Let $V(k)$ denote the waiting time, the number of trials needed to get a consecutive $k$ ones. We propose recurrence algorithms for the probability distribution function (pdf) and the probability generating function (pgf) of $V(k)$ in sequences of independent and Markov dependent Bernoulli trials using generalized Fibonacci sequences of order $k$. Maximum likelihood estimation (MLE) methods for the probability distributions are presented in both cases with simulation examples.


title: Cluster Explanation via Polyhedral Descriptions

abstract: Clustering is an unsupervised learning problem that aims to partition unlabelled data points into groups with similar features. Traditional clustering algorithms provide limited insight into the groups they find as their main focus is accuracy and not the interpretability of the group assignments. This has spurred a recent line of work on explainable machine learning for clustering. In this paper we focus on the cluster description problem where, given a dataset and its partition into clusters, the task is to explain the clusters. We introduce a new approach to explain clusters by constructing polyhedra around each cluster while minimizing either the complexity of the resulting polyhedra or the number of features used in the description. We formulate the cluster description problem as an integer program and present a column generation approach to search over an exponential number of candidate half-spaces that can be used to build the polyhedra. To deal with large datasets, we introduce a novel grouping scheme that first forms smaller groups of data points and then builds the polyhedra around the grouped data, a strategy which out-performs simply sub-sampling data. Compared to state of the art cluster description algorithms, our approach is able to achieve competitive interpretability with improved description accuracy.


title: Breathing Pattern Monitoring using Remote Sensors

abstract: Breathing is one of the most important body functions because it provides it with oxygen, which is vital for energy production. In addition, the removal of carbon dioxide actively regulates the acid-base level, which is essential for the physiological function of the body. Due to its close connection with many other body functions, respiration can also be used as an indicator for a wide spectrum of medical conditions, which at first glance have little to do with breathing. Neurological, cardiological, inflammatory, metabolic, and even psychological conditions symptomatically show up in breathing patterns. Hence, being able to classify them automatically and unobtrusively, can allow cost-effective monitoring systems to continuously assess the health of a patient. In this work, multiple respiratory signal-extraction algorithms for thermal and RGB cameras are presented and compared. A novel algorithm for the extraction of multiple respiratory features is presented and evaluated. Using a one vs. one multiclass support vector machine, these features were used to classify a wide range of respiratory patterns with an accuracy of up to 95.79%.


title: Parametric estimation of stochastic differential equations via online gradient descent

abstract: We propose an online parametric estimation method of stochastic differential equations with discrete observations and misspecified modelling based on online gradient descent. Our study provides uniform upper bounds for the risks of the estimators over a family of stochastic differential equations. The derivation of the bounds involves three underlying theoretical results: the analysis of the stochastic mirror descent algorithm based on dependent and biased subgradients, the simultaneous exponential ergodicity of classes of diffusion processes, and the proposal of loss functions whose approximated stochastic subgradients are dependent only on the known model and observations.


title: Sequential Topic Selection Model with Latent Variable for Topic-Grounded Dialogue

abstract: Recently, topic-grounded dialogue system has attracted significant attention due to its effectiveness in predicting the next topic to yield better responses via the historical context and given topic sequence. However, almost all existing topic prediction solutions focus on only the current conversation and corresponding topic sequence to predict the next conversation topic, without exploiting other topic-guided conversations which may contain relevant topic-transitions to current conversation. To address the problem, in this paper we propose a novel approach, named Sequential Global Topic Attention (SGTA) to exploit topic transition over all conversations in a subtle way for better modeling post-to-response topic-transition and guiding the response generation to the current conversation. Specifically, we introduce a latent space modeled as a Multivariate Skew-Normal distribution with hybrid kernel functions to flexibly integrate the global-level information with sequence-level information, and predict the topic based on the distribution sampling results. We also leverage a topic-aware prior-posterior approach for secondary selection of predicted topics, which is utilized to optimize the response generation task. Extensive experiments demonstrate that our model outperforms competitive baselines on prediction and generation tasks.


title: spatial-dccrn: dccrn equipped with frame-level angle feature and hybrid filtering for multi-channel speech enhancement

abstract: Recently, multi-channel speech enhancement has drawn much interest due to the use of spatial information to distinguish target speech from interfering signal. To make full use of spatial information and neural network based masking estimation, we propose a multi-channel denoising neural network -- Spatial DCCRN. Firstly, we extend S-DCCRN to multi-channel scenario, aiming at performing cascaded sub-channel and full-channel processing strategy, which can model different channels separately. Moreover, instead of only adopting multi-channel spectrum or concatenating first-channel's magnitude and IPD as the model's inputs, we apply an angle feature extraction module (AFE) to extract frame-level angle feature embeddings, which can help the model to apparently perceive spatial information. Finally, since the phenomenon of residual noise will be more serious when the noise and speech exist in the same time frequency (TF) bin, we particularly design a masking and mapping filtering method to substitute the traditional filter-and-sum operation, with the purpose of cascading coarsely denoising, dereverberation and residual noise suppression. The proposed model, Spatial-DCCRN, has surpassed EaBNet, FasNet as well as several competitive models on the L3DAS22 Challenge dataset. Not only the 3D scenario, Spatial-DCCRN outperforms state-of-the-art (SOTA) model MIMO-UNet by a large margin in multiple evaluation metrics on the multi-channel ConferencingSpeech2021 Challenge dataset. Ablation studies also demonstrate the effectiveness of different contributions.


title: Merlin HugeCTR: GPU-accelerated Recommender System Training and Inference

abstract: In this talk, we introduce Merlin HugeCTR. Merlin HugeCTR is an open source, GPU-accelerated integration framework for click-through rate estimation. It optimizes both training and inference, whilst enabling model training at scale with model-parallel embeddings and data-parallel neural networks. In particular, Merlin HugeCTR combines a high-performance GPU embedding cache with an hierarchical storage architecture, to realize low-latency retrieval of embeddings for online model inference tasks. In the MLPerf v1.0 DLRM model training benchmark, Merlin HugeCTR achieves a speedup of up to 24.6x on a single DGX A100 (8x A100) over PyTorch on 4x4-socket CPU nodes (4x4x28 cores). Merlin HugeCTR can also take advantage of multi-node environments to accelerate training even further. Since late 2021, Merlin HugeCTR additionally features a hierarchical parameter server (HPS) and supports deployment via the NVIDIA Triton server framework, to leverage the computational capabilities of GPUs for high-speed recommendation model inference. Using this HPS, Merlin HugeCTR users can achieve a 5~62x speedup (batch size dependent) for popular recommendation models over CPU baseline implementations, and dramatically reduce their end-to-end inference latency.


title: A GPU-specialized Inference Parameter Server for Large-Scale Deep Recommendation Models

abstract: Recommendation systems are of crucial importance for a variety of modern apps and web services, such as news feeds, social networks, e-commerce, search, etc. To achieve peak prediction accuracy, modern recommendation models combine deep learning with terabyte-scale embedding tables to obtain a fine-grained representation of the underlying data. Traditional inference serving architectures require deploying the whole model to standalone servers, which is infeasible at such massive scale. In this paper, we provide insights into the intriguing and challenging inference domain of online recommendation systems. We propose the HugeCTR Hierarchical Parameter Server (HPS), an industry-leading distributed recommendation inference framework, that combines a high-performance GPU embedding cache with an hierarchical storage architecture, to realize low-latency retrieval of embeddings for online model inference tasks. Among other things, HPS features (1) a redundant hierarchical storage system, (2) a novel high-bandwidth cache to accelerate parallel embedding lookup on NVIDIA GPUs, (3) online training support and (4) light-weight APIs for easy integration into existing large-scale recommendation workflows. To demonstrate its capabilities, we conduct extensive studies using both synthetically engineered and public datasets. We show that our HPS can dramatically reduce end-to-end inference latency, achieving 5~62x speedup (depending on the batch size) over CPU baseline implementations for popular recommendation models. Through multi-GPU concurrent deployment, the HPS can also greatly increase the inference QPS.


title: Uniformly closed sublattices of finite codimension

abstract: The paper investigates uniformly closed subspaces, sublattices, and ideals of finite codimension in Archimedean vector lattices. It is shown that every uniformly closed subspace (or sublattice) of finite codimension may be written as an intersection of uniformly closed subspaces (respectively, sublattices) of codimension one. Every uniformly closed sublattice of codimension $n$ contains a uniformly closed ideal of codimension at most $2n$. If the vector lattice is uniformly complete then every ideal of finite codimension is uniformly closed. Results of the paper extend (and are motivated by) results of [AL90a,AL90b] and , as well as Kakutani's characterization of closed sublattices of $C(K)$ spaces.


title: HCL-TAT: A Hybrid Contrastive Learning Method for Few-shot Event Detection with Task-Adaptive Threshold

abstract: Conventional event detection models under supervised learning settings suffer from the inability of transfer to newly-emerged event types owing to lack of sufficient annotations. A commonly-adapted solution is to follow a identify-then-classify manner, which first identifies the triggers and then converts the classification task via a few-shot learning paradigm. However, these methods still fall far short of expectations due to: (i) insufficient learning of discriminative representations in low-resource scenarios, and (ii) trigger misidentification caused by the overlap of the learned representations of triggers and non-triggers. To address the problems, in this paper, we propose a novel Hybrid Contrastive Learning method with a Task-Adaptive Threshold (abbreviated as HCLTAT), which enables discriminative representation learning with a two-view contrastive loss (support-support and prototype-query), and devises a easily-adapted threshold to alleviate misidentification of triggers. Extensive experiments on the benchmark dataset FewEvent demonstrate the superiority of our method to achieve better results compared to the state-of-the-arts. All the code and data of this paper will be available for online public access.


title: Regularizing nested Monte Carlo Sobol' index estimators to balance the trade-off between explorations and repetitions in global sensitivity analysis of stochastic models

abstract: Sobol' sensitivity index estimators for stochastic models are functions of nested Monte Carlo estimators, which are estimators built from two nested Monte Carlo loops. The outer loop explores the input space and, for each of the explorations, the inner loop repeats model runs to estimate conditional expectations. Although the optimal allocation between explorations and repetitions of one's computational budget is well-known for nested Monte Carlo estimators, it is less clear how to deal with functions of nested Monte Carlo estimators, especially when those functions have unbounded Hessian matrices, as it is the case for Sobol' index estimators. To address this problem, a regularization method is introduced to bound the mean squared error of functions of nested Monte Carlo estimators. Based on a heuristic, an allocation strategy that seeks to minimize a bias-variance trade-off is proposed. The method is applied to Sobol' index estimators for stochastic models. A practical algorithm that adapts to the level of intrinsic randomness in the models is given and illustrated on numerical experiments.


title: Towards Robust k-Nearest-Neighbor Machine Translation

abstract: k-Nearest-Neighbor Machine Translation (kNN-MT) becomes an important research direction of NMT in recent years. Its main idea is to retrieve useful key-value pairs from an additional datastore to modify translations without updating the NMT model. However, the underlying retrieved noisy pairs will dramatically deteriorate the model performance. In this paper, we conduct a preliminary study and find that this problem results from not fully exploiting the prediction of the NMT model. To alleviate the impact of noise, we propose a confidence-enhanced kNN-MT model with robust training. Concretely, we introduce the NMT confidence to refine the modeling of two important components of kNN-MT: kNN distribution and the interpolation weight. Meanwhile we inject two types of perturbations into the retrieved pairs for robust training. Experimental results on four benchmark datasets demonstrate that our model not only achieves significant improvements over current kNN-MT models, but also exhibits better robustness. Our code is available at https://github.com/DeepLearnXMU/Robust-knn-mt.


title: Effective and Efficient Query-aware Snippet Extraction for Web Search

abstract: Query-aware webpage snippet extraction is widely used in search engines to help users better understand the content of the returned webpages before clicking. Although important, it is very rarely studied. In this paper, we propose an effective query-aware webpage snippet extraction method named DeepQSE, aiming to select a few sentences which can best summarize the webpage content in the context of input query. DeepQSE first learns query-aware sentence representations for each sentence to capture the fine-grained relevance between query and sentence, and then learns document-aware query-sentence relevance representations for snippet extraction. Since the query and each sentence are jointly modeled in DeepQSE, its online inference may be slow. Thus, we further propose an efficient version of DeepQSE, named Efficient-DeepQSE, which can significantly improve the inference speed of DeepQSE without affecting its performance. The core idea of Efficient-DeepQSE is to decompose the query-aware snippet extraction task into two stages, i.e., a coarse-grained candidate sentence selection stage where sentence representations can be cached, and a fine-grained relevance modeling stage. Experiments on two real-world datasets validate the effectiveness and efficiency of our methods.


title: Enhanced Secrecy in Optical Communication using Speckle from Multiple Scattering Layers

abstract: We study the secrecy of an optical communication system with two scattering layers, to hide both the sender and receiver, by measuring the correlation of the intermediate speckle generated between the two layers. The binary message is modulated as spatially shaped wavefronts, and the high number of transmission modes of the scattering layers allows for many uncorrelated incident wavefronts to send the same message, making it difficult for an attacker to intercept or decode the message and thus increasing secrecy. We collect 50,000 intermediate speckle patterns and analyze their correlation distribution using Kolmogorov-Smirnov (K-S) test. We search for further correlations using the K-Means and Hierarchical unsupervised classification algorithms. We find no correlation between the intermediate speckle and the message, suggesting a person-in-the-middle attack is not possible. This method is compatible with any digital encryption method and is applicable for codifications in optical wireless communication (OWC).


title: CS-MLGCN : Multiplex Graph Convolutional Networks for Community Search in Multiplex Networks

abstract: Community Search (CS) is one of the fundamental tasks in network science and has attracted much attention due to its ability to discover personalized communities with a wide range of applications. Given any query nodes, CS seeks to find a densely connected subgraph containing query nodes. Most existing approaches usually study networks with a single type of proximity between nodes, which defines a single view of a network. However, in many applications such as biological, social, and transportation networks, interactions between objects span multiple aspects, yielding networks with multiple views, called multiplex networks. Existing CS approaches in multiplex networks adopt pre-defined subgraph patterns to model the communities, which cannot find communities that do not have such pre-defined patterns in real-world networks. In this paper, we propose a query-driven graph convolutional network in multiplex networks, CS-MLGCN, that can capture flexible community structures by learning from the ground-truth communities in a data-driven fashion. CS-MLGCN first combines the local query-dependent structure and global graph embedding in each type of proximity and then uses an attention mechanism to incorporate information on different types of relations. Experiments on real-world graphs with ground-truth communities validate the quality of the solutions we obtain and the efficiency of our model.