title: Analysis and Evaluation of Synchronous and Asynchronous FLchain

abstract: Motivated by the heterogeneous nature of devices participating in large-scale Federated Learning (FL) optimization, we focus on an asynchronous server-less FL solution empowered by blockchain technology. In contrast to mostly adopted FL approaches, which assume synchronous operation, we advocate an asynchronous method whereby model aggregation is done as clients submit their local updates. The asynchronous setting fits well with the federated optimization idea in practical large-scale settings with heterogeneous clients. Thus, it potentially leads to higher efficiency in terms of communication overhead and idle periods. To evaluate the learning completion delay of BC-enabled FL, we provide an analytical model based on batch service queue theory. Furthermore, we provide simulation results to assess the performance of both synchronous and asynchronous mechanisms. Important aspects involved in the BC-enabled FL optimization, such as the network size, link capacity, or user requirements, are put together and analyzed. As our results show, the synchronous setting leads to higher prediction accuracy than the asynchronous case. Nevertheless, asynchronous federated optimization provides much lower latency in many cases, thus becoming an appealing solution for FL when dealing with large datasets, tough timing constraints (e.g., near-real-time applications), or highly varying training data.


title: IID Sampling from Doubly Intractable Distributions

abstract: Intractable posterior distributions of parameters with intractable normalizing constants depending upon the parameters are known as doubly intractable posterior distributions. The terminology itself indicates that obtaining Bayesian inference from such posteriors is doubly difficult compared to traditional intractable posteriors where the normalizing constants are tractable and admit traditional Markov Chain Monte Carlo (MCMC) solutions. As can be anticipated, a plethora of MCMC-based methods have originated in the literature to deal with doubly intractable distributions. Yet, it remains very much unclear if any of the methods can satisfactorily sample from such posteriors, particularly in high-dimensional setups. In this article, we consider efficient Monte Carlo and importance sampling approximations of the intractable normalizing constant for a few values of the parameters, and Gaussian process interpolations for the remaining values of the parameters, using the approximations. We then incorporate this strategy within the exact iid sampling framework developed in Bhattacharya (2021a) and Bhattacharya (2021b), and illustrate the methodology with simulation experiments comprising a two-dimensional normal-gamma posterior, a two-dimensional Ising model posterior, a two-dimensional Strauss process posterior and a 100-dimensional autologistic model posterior. In each case we demonstrate great accuracy of our methodology, which is also computationally extremely efficient, often taking only a few minutes for generating 10, 000 iid realizations on 80 processors.


title: The exploitation of Multiple Feature Extraction Techniques for Speaker Identification in Emotional States under Disguised Voices

abstract: Due to improvements in artificial intelligence, speaker identification (SI) technologies have brought a great direction and are now widely used in a variety of sectors. One of the most important components of SI is feature extraction, which has a substantial impact on the SI process and performance. As a result, numerous feature extraction strategies are thoroughly investigated, contrasted, and analyzed. This article exploits five distinct feature extraction methods for speaker identification in disguised voices under emotional environments. To evaluate this work significantly, three effects are used: high-pitched, low-pitched, and Electronic Voice Conversion (EVC). Experimental results reported that the concatenated Mel-Frequency Cepstral Coefficients (MFCCs), MFCCs-delta, and MFCCs-delta-delta is the best feature extraction method.


title: DRaGon: Mining Latent Radio Channel Information from Geographical Data Leveraging Deep Learning

abstract: Radio channel modeling is one of the most fundamental aspects in the process of designing, optimizing, and simulating wireless communication networks. In this field, long-established approaches such as analytical channel models and ray tracing techniques represent the de-facto standard methodologies. However, as demonstrated by recent results, there remains an untapped potential to innovate this research field by enriching model-based approaches with machine learning techniques. In this paper, we present Deep RAdio channel modeling from GeOinformatioN (DRaGon) as a novel machine learning-enabled method for automatic generation of Radio Environmental Maps (REMs) from geographical data. For achieving accurate path loss prediction results, DRaGon combines determining features extracted from a three-dimensional model of the radio propagation environment with raw images of the receiver area within a deep learning model. In a comprehensive performance evaluation and validation campaign, we compare the accuracy of the proposed approach with real world measurements, ray tracing analyses, and well-known channel models. It is found that the combination of expert knowledge from the communications domain and the data analysis capabilities of deep learning allows to achieve a significantly higher prediction accuracy than the reference methods.


title: Supersymmetry and trace formulas I. Compact Lie groups

abstract: In the context of supersymmetric quantum mechanics we formulate new supersymmetric localization principle, with application to trace formulas for a full thermal partition function. Unlike the standard localization principle, this new principle allows to compute the supertrace of non-supersymmetric observables, and is based on the existence of fermionic zero modes. We describe corresponding new invariant supersymmetric deformations of the path integral; they differ from the standard deformations arising from the circle action and require higher derivatives terms. Consequently, we prove that the path integral localizes to periodic orbits and not not only on constant ones. We illustrate the principle by deriving bosonic trace formulas on compact Lie groups, including classical Jacobi inversion formula.


title: Decoding Continual Muscle Movements Related to Complex Hand Grasping from EEG Signals

abstract: Brain-computer interface (BCI) is a practical pathway to interpret users' intentions by decoding motor execution (ME) or motor imagery (MI) from electroencephalogram (EEG) signals. However, developing a BCI system driven by ME or MI is challenging, particularly in the case of containing continual and compound muscles movements. This study analyzes three grasping actions from EEG under both ME and MI paradigms. We also investigate the classification performance in offline and pseudo-online experiments. We propose a novel approach that uses muscle activity pattern (MAP) images for the convolutional neural network (CNN) to improve classification accuracy. We record the EEG and electromyogram (EMG) signals simultaneously and create the MAP images by decoding both signals to estimate specific hand grasping. As a result, we obtained an average classification accuracy of 63.6($\pm$6.7)% in ME and 45.8($\pm$4.4)% in MI across all fifteen subjects for four classes. Also, we performed pseudo-online experiments and obtained classification accuracies of 60.5($\pm$8.4)% in ME and 42.7($\pm$6.8)% in MI. The proposed method MAP-CNN, shows stable classification performance, even in the pseudo-online experiment. We expect that MAP-CNN could be used in various BCI applications in the future.


title: Background model of Phoswich X-ray detector on board small balloon

abstract: We performed a detailed modelling of the background counts observed in a phoswich scintillator X-ray detector at balloon altitude, used for astronomical observations, on board small scientific balloon. We used Monte Carlo simulation technique in Geant4 simulation environment, to estimate the detector background from various plausible sources. High energy particles and radiation generated from the interaction of Galactic Cosmic Rays with the atmospheric nuclei is a major source of background counts (under normal solar condition) for such detectors. However, cosmogenic or induced radioactivity in the detector materials due to the interaction of high energy particles and natural radioactive contamination present in the detector can also contribute substantially to the detector background. We considered detailed 3D modelling of the earth's atmosphere and magnetosphere to calculate the radiation environment at the balloon altitude and deployed a proper mass model of the detector to calculate the background counts in it. The calculation satisfactorily explains the observed background in the detector at 30 km altitude (atmospheric depth: 11.5 $g/cm^{2}$) during the balloon flight experiment from a location near 14.5$^{\circ}$N geomagnetic latitude.


title: Efficient Geometry-aware 3D Generative Adversarial Networks

abstract: Unsupervised generation of high-quality multi-view-consistent images and 3D shapes using only collections of single-view 2D photographs has been a long-standing challenge. Existing 3D GANs are either compute-intensive or make approximations that are not 3D-consistent; the former limits quality and resolution of the generated images and the latter adversely affects multi-view consistency and shape quality. In this work, we improve the computational efficiency and image quality of 3D GANs without overly relying on these approximations. We introduce an expressive hybrid explicit-implicit network architecture that, together with other design choices, synthesizes not only high-resolution multi-view-consistent images in real time but also produces high-quality 3D geometry. By decoupling feature generation and neural rendering, our framework is able to leverage state-of-the-art 2D CNN generators, such as StyleGAN2, and inherit their efficiency and expressiveness. We demonstrate state-of-the-art 3D-aware synthesis with FFHQ and AFHQ Cats, among other experiments.


title: Role of redox additive modified electrolytes in making Na-ion supercapacitors a competitive energy storage device

abstract: The study shows the importance of moving towards hollow nanostructures for obtaining next-generation supercapacitors and batteries. Amongst various sodium-based electrode materials, NaFePO4 is one of the most promising cathodic material because of its high electrochemical potential, structural, and thermal stability. To use this material in high performance Na-ion based energy storage device, it is imperative to combine it with a suitably optimized carbon structures and a redox additive modified electrolyte. This strategy is unequivocally established in the paper. On addition of redox additive, the performance can be improved by 50%. This makes the Na-ion supercapacitor competitive with other metal ion based systems. the performance by as high as 50%. This makes the Na-ion supercapacitors competitive with other metal ion based systems.


title: Theory of versatile fidelity estimation with confidence

abstract: Estimating the fidelity with a target state is important in quantum information tasks. Many fidelity estimation techniques present a suitable measurement scheme to perform the estimation. In contrast, we present techniques that allow the experimentalist to choose a convenient measurement setting. Our primary focus lies on a method that constructs an estimator with nearly minimax optimal confidence interval for any specified measurement setting. We demonstrate, through a combination of theoretical and numerical results, various desirable properties for the method: robustness against experimental imperfections, competitive sample complexity, and accurate estimates in practice. We compare this method with Maximum Likelihood Estimation and the associated Profile Likelihood method, a Semi-Definite Programming based approach, as well as a popular direct fidelity estimation technique.


title: Transcoded Video Restoration by Temporal Spatial Auxiliary Network

abstract: In most video platforms, such as Youtube, and TikTok, the played videos usually have undergone multiple video encodings such as hardware encoding by recording devices, software encoding by video editing apps, and single/multiple video transcoding by video application servers. Previous works in compressed video restoration typically assume the compression artifacts are caused by one-time encoding. Thus, the derived solution usually does not work very well in practice. In this paper, we propose a new method, temporal spatial auxiliary network (TSAN), for transcoded video restoration. Our method considers the unique traits between video encoding and transcoding, and we consider the initial shallow encoded videos as the intermediate labels to assist the network to conduct self-supervised attention training. In addition, we employ adjacent multi-frame information and propose the temporal deformable alignment and pyramidal spatial fusion for transcoded video restoration. The experimental results demonstrate that the performance of the proposed method is superior to that of the previous techniques. The code is available at https://github.com/icecherylXuli/TSAN.


title: An Operator-Splitting Finite Element Method for the Numerical Solution of Radiative Transfer Equation

abstract: An operator-splitting finite element scheme for the time-dependent, high-dimensional radiative transfer equation is presented in this paper. The streamline upwind Petrov-Galerkin finite element method and discontinuous Galerkin finite element method are used for the spatial-angular discretization of the radiative transfer equation, whereas the implicit backward Euler scheme is used for temporal discretization. Error analysis of the proposed numerical scheme for the fully discrete radiative transfer equation is presented. The stability and convergence estimates for the fully discrete problem are derived. Moreover, an operator-splitting algorithm for numerical simulation of high-dimensional equations is also presented. The validation of the derived estimates and implementation is demonstrated with appropriate numerical experiments.


title: Spheroidal force-free neutron star magnetospheres

abstract: Abridged. Fast rotating and self-gravitating astrophysical objects suffer strong deformations from centrifugal forces. If moreover they are magnetized, they generate an electromagnetic wave that is perturbed accordingly. When stellar objects are also surrounded by an ideal plasma, a magnetosphere is formed. We study the electromagnetic configuration of a force-free magnetosphere encompassing an ideal spheroidal rotating conductor as an inner boundary. We put special emphasize to millisecond period neutron star magnetospheres, those showing a significant oblate shape. Force-free solutions are computed by numerical integration of the time-dependent Maxwell equations in spheroidal coordinates. Relevant quantities such as the magnetic field structure, the spin down luminosity, the polar cap rims and the current density are shown. We find that the force-free magnetic field produced by spheroidal stars remains very similar to their spherical counterpart. However, the spin down luminosity slightly decreases with increasing oblateness or prolateness. Moreover the polar cap area increases and always mostly encompasses the equivalent spherical star polar cap rims. The polar cap current density is also drastically affected.


title: Fox pairings of Poincar\'{e} duality groups

abstract: This paper develops the study of Fox pairings of a group $G$ from the viewpoint of group cohomology. We compute some cohomology groups of Fox pairings of $G$, where $G$ admits a Poincar\'{e} duality group pair. We also suggest fundamental Fox pairings and higher Fox pairings.


title: Cardinal invariants associated with Hausdorff measures

abstract: We consider cardinal invariants determined from Hausdorff measures. We separate many cardinal invariants of Hausdorff measure $0$ ideals using two models that separate many cardinal invariants of Yorioka ideals at once from earlier work. Also we show the uniformity numbers of $s$-dimensional Hausdorff measure $0$ ideals for $0 < s < 1$ and that of Lebesgue null ideal can be separated using the Mathias forcing.


title: Learning the statistics and landscape of somatic mutation-induced insertions and deletions in antibodies

abstract: Affinity maturation is crucial for improving the binding affinity of antibodies to antigens. This process is mainly driven by point substitutions caused by somatic hypermutations of the immunoglobulin gene. It also includes deletions and insertions of genomic material known as indels. While the landscape of point substitutions has been extensively studied, a detailed statistical description of indels is still lacking. Here we present a probabilistic inference tool to learn the statistics of indels from repertoire sequencing data, which overcomes the pitfalls and biases of standard annotation methods. The model includes antibody-specific maturation ages to account for variable mutational loads in the repertoire. After validation on synthetic data, we applied our tool to a large dataset of human immunoglobulin heavy chains. The inferred model allows us to identify universal statistical features of indels in heavy chains. We report distinct insertion and deletion hotspots, and show that the distribution of lengths of indels follows a geometric distribution, which puts constraints on future mechanistic models of the hypermutation process.


title: Object Pursuit: Building a Space of Objects via Discriminative Weight Generation

abstract: We propose a framework to continuously learn object-centric representations for visual learning and understanding. Existing object-centric representations either rely on supervisions that individualize objects in the scene, or perform unsupervised disentanglement that can hardly deal with complex scenes in the real world. To mitigate the annotation burden and relax the constraints on the statistical complexity of the data, our method leverages interactions to effectively sample diverse variations of an object and the corresponding training signals while learning the object-centric representations. Throughout learning, objects are streamed one by one in random order with unknown identities, and are associated with latent codes that can synthesize discriminative weights for each object through a convolutional hypernetwork. Moreover, re-identification of learned objects and forgetting prevention are employed to make the learning process efficient and robust. We perform an extensive study of the key features of the proposed framework and analyze the characteristics of the learned representations. Furthermore, we demonstrate the capability of the proposed framework in learning representations that can improve label efficiency in downstream tasks. Our code and trained models are made publicly available at: https://github.com/pptrick/Object-Pursuit.


title: Channel Parameter Estimation in the Presence of Phase Noise Based on Maximum Correntropy Criterion

abstract: Oscillator output generally has phase noise causing the output power spectral density (PSD) to disperse around a Dirac delta function. In this paper, the AWGN channel is considered, where the sent signal accompanying with phase noise is added to the channel Gaussian noise and received at the receiver. Conventional channel estimation algorithms such as least mean square (LMS) and mean MSE criterion are not suitable for this channel estimation. We (i) analyze this phase noise channel estimation with information theoretic learning (ITL) criterion, i.e., maximum correntropy criterion (MCC), leading to robustness in the channel estimator's steady state behavior; and (ii) improve the convergence rate by combining MSE and MCC as a novel mixed-LMS algorithm.


title: Detector challenges of the strong-field QED experiment LUXE at the European XFEL

abstract: The LUXE experiment (Laser Und XFEL Experiment) is a new experiment in planning at DESY Hamburg using the electron beam of the European XFEL (Eu.XFEL). LUXE is intended to study collisions between a high-intensity optical laser and up to 16.5 GeV electrons from the Eu.XFEL electron beam, or, alternatively, high-energy secondary photons. The physics objective of LUXE are processes of Quantum Electrodynamics (QED) at the strong-field frontier, where QED is non-perturbative. The design of the experimental setup and the different detectors are presented.


title: FEAR: Fast, Efficient, Accurate and Robust Visual Tracker

abstract: We present FEAR, a family of fast, efficient, accurate, and robust Siamese visual trackers. We present a novel and efficient way to benefit from dual-template representation for object model adaption, which incorporates temporal information with only a single learnable parameter. We further improve the tracker architecture with a pixel-wise fusion block. By plugging-in sophisticated backbones with the abovementioned modules, FEAR-M and FEAR-L trackers surpass most Siamese trackers on several academic benchmarks in both accuracy and efficiency. Employed with the lightweight backbone, the optimized version FEAR-XS offers more than 10 times faster tracking than current Siamese trackers while maintaining near state-of-the-art results. FEAR-XS tracker is 2.4x smaller and 4.3x faster than LightTrack with superior accuracy. In addition, we expand the definition of the model efficiency by introducing FEAR benchmark that assesses energy consumption and execution speed. We show that energy consumption is a limiting factor for trackers on mobile devices. Source code, pretrained models, and evaluation protocol are available at https://github.com/PinataFarms/FEARTracker.


title: Is TOL 1326-379 a Prototype of gamma-ray Emitting FR0 Radio Galaxy?

abstract: With the possible spacial association to the Fermi/LAT source 3FGL J1330.0-3818, TOL 1326-379 may be the first one that is identified as a gamma-ray emitting Fanaroff-Riley type 0 radio galaxy (FR0 RG). We analyze the ~12 yr Fermi/LAT observation data of this gamma-ray source and examine its association to TOL 1326-379. We show that the gamma-ray source (named as J1331.0-3818) is tentatively detected with a TS value of 28.7, 3FGL J1330.0-3818 is out of the 95% containment of J1331.0-3818, and their positions are spatially separated ~0.2 degr. 4FGL J1331.3-3818 falls into the 68% containment of J1331.0-3818, suggesting that our result agrees with that reported in the Fourth Fermi LAT Source Catalog. TOL 1326-379 is out of the 95% containment of J1331.0-3818, and their positions are spatially separated ~0.4 degr, indicating that the association between J1331.0-3818 and TOL 1326-379 is quite ambiguous. However, we do not find other possible potential radio or X-ray counterpart within the circle centered at J1331.0-3818 with a radius of 0.4 degr. The spectral energy distribution (SED) of TOL 1326-379 shows a bimodal feature as seen in the gamma-ray emitting RGs. We fit the SED with the one-zone leptonic model and find that the average energy spectrum of J1331.0-3818 agrees with the model prediction. Assuming that J1331.0-3818 is an unidentified gamma-ray source, we derive the upper-limit of the gamma-ray flux for TOL 1326-379. It is not tight enough to exclude this possibility with the SED modeling. Based on these results, we cautiously argue that the gamma-ray source J1331.0-3818 is associated with TOL 1326-379 and its jet radiation physic is similar to those gamma-ray emitting RGs.


title: Extremality, Left-Modularity and Semidistributivity

abstract: In this article we investigate the relations between three classes of lattices each extending the class of distributive lattices in a different way. In particular, we consider join-semidistributive, join-extremal and left-modular lattices, respectively. Our main motivation is a recent result by Thomas and Williams proving that every semidistributive, extremal lattice is left modular. We prove the converse of this on a slightly more general level. Our main result asserts that every join-semidistributive, left-modular lattice is join extremal. We also relate these properties to the topological notion of lexicographic shellability.


title: Constrained discounted stochastic games

abstract: In this paper, we consider a large class of constrained non-cooperative stochastic Markov games with countable state spaces and discounted cost criteria. In one-player case, i.e., constrained discounted Markov decision models, it is possible to formulate a static optimisation problem whose solution determines a stationary optimal strategy (alias control or policy) in the dynamical infinite horizon model. This solution lies in the compact convex set of all occupation measures induced by strategies, defined on the set of state-action pairs. In case of n-person discounted games the occupation measures are induced by strategies of all players. Therefore, it is difficult to generalise the approach for constrained discounted Markov decision processes directly. It is not clear how to define the domain for the best-response correspondence whose fixed point induces a stationary equilibrium in the Markov game. This domain should be the Cartesian product of compact convex sets in locally convex topological vector spaces. One of our main results shows how to overcome this difficulty and define a constrained non-cooperative static game whose Nash equilibrium induces by a stationary Nash equilibrium in the Markov game. This is done for games with bounded cost functions and positive initial state distribution. An extension to a class of Markov games with unbounded costs and arbitrary initial state distribution relies on approximation of the unbounded game by bounded ones with positive initial state distributions. In the unbounded case, we assume the uniform integrability of the discounted costs with respect to all probability measures induced by strategies of the players, defined on the space of plays (histories) of the game. Our assumptions are weaker than those applied in earlier works on discounted dynamic programming or stochastic games using so-called weighted norm approaches.


title: Improved limits on the tensor-to-scalar ratio using BICEP and Planck

abstract: We present constraints on the tensor-to-scalar ratio r using a combination of BICEP/Keck 2018 and Planck PR4 data allowing us to fit for r consistently with the six parameters of the $\Lambda$CDM model without fixing any of them. In particular, we are able to derive a constraint on the reionization optical depth $\tau$ and thus propagate its uncertainty onto the posterior distribution for r. While Planck sensitivity to r is no longer comparable with ground-based measurements, combining Planck with BK18 and BAO gives results consistent with r = 0 and tightens the constraint to r < 0.032.


title: A learning-based approach to feature recognition of Engineering shapes

abstract: In this paper, we propose a machine learning approach to recognise engineering shape features such as holes, slots, etc. in a CAD mesh model. With the advent of digital archiving, newer manufacturing techniques such as 3D printing, scanning of components and reverse engineering, CAD data is proliferated in the form of mesh model representation. As the number of nodes and edges become larger in a mesh model as well as the possibility of presence of noise, direct application of graph-based approaches would not only be expensive but also difficult to be tuned for noisy data. Hence, this calls for newer approaches to be devised for feature recognition for CAD models represented in the form of mesh. Here, we show that a discrete version of Gauss map can be used as a signature for a feature learning. We show that this approach not only requires fewer memory requirements but also the training time is quite less. As no network architecture is involved, the number of hyperparameters are much lesser and can be tuned in a much faster time. The recognition accuracy is also very similar to that of the one obtained using 3D convolutional neural networks (CNN) but in much lesser running time and storage requirements. A comparison has been done with other non-network based machine learning approaches to show that our approach has the highest accuracy. We also show the recognition results for CAD models having multiple features as well as complex/interacting features obtained from public benchmarks. The ability to handle noisy data has also been demonstrated.


title: Towards General and Efficient Active Learning

abstract: Active learning selects the most informative samples to exploit limited annotation budgets. Existing work follows a cumbersome pipeline that repeats the time-consuming model training and batch data selection multiple times. In this paper, we challenge this status quo by proposing a novel general and efficient active learning (GEAL) method following our designed new pipeline. Utilizing a publicly available pretrained model, our method selects data from different datasets with a single-pass inference of the same model without extra training or supervision. To capture subtle local information, we propose knowledge clusters extracted from intermediate features. Free from the troublesome batch selection strategy, all data samples are selected in one-shot through a distance-based sampling in the fine-grained knowledge cluster level. This whole process is faster than prior arts by hundreds of times. Extensive experiments verify the effectiveness of our method on object detection, image classification, and semantic segmentation. Our code is publicly available in https://github.com/yichen928/GEAL_active_learning.


title: Floquet-engineered pair and single particle filter in the Fermi Hubbard model

abstract: We investigate the Fermi-Hubbard model with a Floquet-driven impurity in the form of a local time-oscillating potential. For strong attractive interactions a stable formation of pairs is observed. These pairs show a completely different transmission behavior than the transmission that is observed for the single unpaired particles. Whereas in the high frequency limit the single particles show a maximum of the transition at low driving amplitudes, the pairs display a pronounced maximum transmission when the amplitude of the driving lies close to the ratio of the interaction U and the driving frequency {\omega}. We use the distinct transmission behaviour to design filters for pairs or single particles, respectively. For example one can totally block the transmission of single particles through the driven impurity and allow only for the transmission of pairs. We quantify the quality of the designed filters.


title: Application of hypergraph Hoffman's bound to intersecting families

abstract: Using the Filmus-Golubev-Lifshitz method to bound the independence number of a hypergraph, we solve some problems concerning multiply intersecting families with biased measure. Among other results we obtain a stability result of a measure version of the Erdos-Ko-Rado theorem for multiply intersecting families.


title: Modality-Aware Triplet Hard Mining for Zero-shot Sketch-Based Image Retrieval

abstract: This paper tackles the Zero-Shot Sketch-Based Image Retrieval (ZS-SBIR) problem from the viewpoint of cross-modality metric learning. This task has two characteristics: 1) the zero-shot setting requires a metric space with good within-class compactness and the between-class discrepancy for recognizing the novel classes and 2) the sketch query and the photo gallery are in different modalities. The metric learning viewpoint benefits ZS-SBIR from two aspects. First, it facilitates improvement through recent good practices in deep metric learning (DML). By combining two fundamental learning approaches in DML, e.g., classification training and pairwise training, we set up a strong baseline for ZS-SBIR. Without bells and whistles, this baseline achieves competitive retrieval accuracy. Second, it provides an insight that properly suppressing the modality gap is critical. To this end, we design a novel method named Modality-Aware Triplet Hard Mining (MATHM). MATHM enhances the baseline with three types of pairwise learning, e.g., a cross-modality sample pair, a within-modality sample pair, and their combination.\We also design an adaptive weighting method to balance these three components during training dynamically. Experimental results confirm that MATHM brings another round of significant improvement based on the strong baseline and sets up new state-of-the-art performance. For example, on the TU-Berlin dataset, we achieve 47.88+2.94% mAP@all and 58.28+2.34% Prec@100. Code will be publicly available at: https://github.com/huangzongheng/MATHM.


title: Black Tsunamis and Naked Singularities in AdS

abstract: We study the evolution of the Gregory-Laflamme instability for black strings in global AdS spacetime, and investigate the CFT dual of the formation of a bulk naked singularity. Using an effective theory in the large D limit, we uncover a rich variety of dynamical behaviour, depending on the thickness of the string and on initial perturbations. These include: large inflows of horizon generators from the asymptotic boundary (a `black tsunami'); a pinch-off of the horizon that likely reveals a naked singularity; and competition between these two behaviours, such as a nakedly singular pinch-off that subsequently gets covered by a black tsunami. The holographic dual describes different patterns of heat flow due to the Hawking radiation of two black holes placed at the antipodes of a spherical universe. We also present a model that describes, in any D, the burst in the holographic stress-energy tensor when the signal from a bulk self-similar naked singularity reaches the boundary. The model shows that the shear components of the boundary stress diverge in finite time, while the energy density and pressures from the burst vanish.


title: Science Factionalism: How Group Identity Language Affects Public Engagement with Misinformation and Debunking Narratives on a Popular Q&A Platform in China

abstract: Misinformation and intergroup bias are two pathologies challenging informed citizenship. This paper examines how identity language is used in misinformation and debunking messages about controversial science on Chinese digital public sphere, and their impact on how the public engage with science. We collected an eight-year time series dataset of public discussion (N=6039) on one of the most controversial science issues in China (GMO) from a popular Q&A platform, Zhihu. We found that both misinformation and debunking messages use a substantial amount of group identity languages when discussing the controversial science issue, which we define as science factionalism -- discussion about science is divided by factions that are formed upon science attitudes. We found that posts that use science factionalism receive more digital votes and comments, even among the science-savvy community in China. Science factionalism also increases the use of negativity in public discourse. We discussed the implications of how science factionalism interacts with the digital attention economy to affect public engagement with science misinformation.


title: Predicting Media Memorability: Comparing Visual, Textual and Auditory Features

abstract: This paper describes our approach to the Predicting Media Memorability task in MediaEval 2021, which aims to address the question of media memorability by setting the task of automatically predicting video memorability. This year we tackle the task from a comparative standpoint, looking to gain deeper insights into each of three explored modalities, and using our results from last year's submission (2020) as a point of reference. Our best performing short-term memorability model (0.132) tested on the TRECVid2019 dataset -- just like last year -- was a frame based CNN that was not trained on any TRECVid data, and our best short-term memorability model (0.524) tested on the Memento10k dataset, was a Bayesian Ride Regressor fit with DenseNet121 visual features.


title: Magneto-electric cooling rate of a multiferroic antiferromagnetic quantum spin system: the cumulative influence of the site-dependent magnetic and electric fields

abstract: The magneto-electrocaloric effect which can be defined as the coupling between magnetocaloric and electrocaloric effects attracts currently considerable attention due to the advantages provided by the caloric effect in designing solid-state refrigeration technologies. The magneto-electrocaloric effect of a multiferroic antiferromagnetic spin system with the Dzyaloshinskii Moriya (DM) interaction is investigated in this paper. The DM interaction is assimilated to a coupling between an external site-dependent electric field and a local electric polarization. The external magnetic is also considered as a site-dependent magnetic field. The spin-wave theory is used as a diagonalization method and through the canonical partition function, some thermodynamic properties such as the Boltzmann entropy and the specific heat capacity are obtained. Then, the adiabatic magnetic, electric, and magnetoelectric cooling rates are also derived. The graphs obtained for the adiabatic magnetic, electric, and magnetoelectric cooling rate show a characteristic behavior of the caloric or multi-caloric effect which is in good agreement with some experimental and theoretical works. Besides, the entropy response due to the variation of the external site-dependent magnetic field exhibits two anomalous entropy peaks indicating the existence of an intermediate phase tuneable by the magnetic and electric site-dependent parameters. Overall, it is demonstrated that the cumulative influence of the site-dependent magnetic and electric fields allows us not only to reveal quantum critical points hidden in a multiferroic quantum spin system but also to control the caloric or multi-caloric effect essential in the construction of solid-state refrigeration devices.


title: Nonlinear intensity dependence of photogalvanics and photoconductance induced by terahertz laser radiation in twisted bilayer graphene close to magic angle

abstract: We report on the observation of the nonlinear intensity dependence of the bulk photogalvanic current and photoconductivity in the twisted graphene with small twist angles close to the second magical angle. We show that terahertz radiation results in the photoresponses, which is caused by indirect optical transitions (free carrier absorption), direct interband transitions and optical transitions between Moir\'e subbands. The relative contribution of these absorption channels depends on the Fermi level position with respect to the multiple Moir\'e subbands of the twisted graphene. The interplay of these absorption channels results in oscillations of the photoresponses with variation of the gate voltage. We show that the photoresponse saturates at high intensities. For different absorption channels it has different intensity dependencies and saturation intensities. The latter depends non-monotonically on the Fermi level position, which is controlled by the gate voltage.


title: Hints of the Quantum Nature of the Universe in Classical Electrodynamics and Their Connection to the Electronic Charge and Dark Energy

abstract: The electromagnetic fields of linear radiating systems working without dispersive and dissipative losses are analyzed both in the time and the frequency domains. In the case of the time domain radiating system, the parameter studied is the action, A, associated with the radiation. The action is defined as the product of the energy and the duration of the radiation. In the case of the frequency domain radiating system, which produces radiation in bursts of duration T/2 where T is the period of oscillation, the parameter studied is the energy, U, dissipated in a single burst of radiation of duration T/2. In this paper, we have studied how A and U vary as a function of the charge associated with the current in the radiating system and the ratio of the length of the radiating system and its radius. We have observed remarkable results when this ratio is equal to the ratio of the radius of the universe to the Bohr radius. In the case of the time domain radiating system, we have observed that when the charge associated with the current propagating along the radiator reaches the electronic charge, the action associated with the radiation reduces to h/2*pi where h is the Planck constant. In the case of the frequency domain radiating system, we have observed that as the magnitude of the oscillating charge reduces to the electronic charge, the energy dissipated in a single burst of radiation reduces to h*v, where v is the frequency of oscillation. Interestingly, all these results are based purely on classical electrodynamics and general relativity. The importance of the findings is discussed. In particular, the fact that the minimum free charge that exists in nature is the electronic charge, is shown for the first time to be a direct consequence of the photonic nature of the electromagnetic fields. Furthermore, the presented findings allow to derive for the first time an expression for the dark energy density of the universe in terms of the other fundamental constants in nature, the prediction of which is consistent with experimental observations. This Equation, which combines together the dark energy, electronic charge and mass, speed of light, gravitational constant and Planck constant, creates a link between classical field theories (i.e., classical electrodynamics and general relativity) and quantum mechanics.


title: Weak branch and multimodal convection in rapidly rotating spheres at low Prandtl number

abstract: The focus of this study is to investigate primary and secondary bifurcations to weakly nonlinear flows (weak branch) in convective rotating spheres in a regime where only strongly nonlinear oscillatory sub- and super-critical flows (strong branch) were previously found in [E. J. Kaplan, N. Schaeffer, J. Vidal, and P. Cardin, Phys. Rev. Lett. 119, 094501 (2017)]. The relevant regime corresponds to low Prandtl and Ekman numbers, indicating a predominance of Coriolis forces and thermal diffusion in the system. We provide the bifurcation diagrams for rotating waves (RWs) computed by means of continuation methods and the corresponding stability analysis of these periodic flows to detect secondary bifurcations giving rise to quasiperiodic modulated rotating waves (MRWs). Additional direct numerical simulations (DNS) are performed for the analysis of these quasiperiodic flows for which Poincar\'e sections and kinetic energy spectra are presented. The diffusion time scales are investigated as well. Our study reveals very large initial transients (more than 30 diffusion time units) for the nonlinear saturation of solutions on the weak branch, either RWs or MRWs, when DNS are employed. In addition, we demonstrate that MRWs have multimodal nature involving resonant triads. The modes can be located in the bulk of the fluid or attached to the outer sphere and exhibit multicellular structures. The different resonant modes forming the nonlinear quasiperiodic flows can be predicted with the stability analysis of RWs, close to the Hopf bifurcation point, by analyzing the leading unstable Floquet eigenmode.


title: Detail-aware Deep Clothing Animations Infused with Multi-source Attributes

abstract: This paper presents a novel learning-based clothing deformation method to generate rich and reasonable detailed deformations for garments worn by bodies of various shapes in various animations. In contrast to existing learning-based methods, which require numerous trained models for different garment topologies or poses and are unable to easily realize rich details, we use a unified framework to produce high fidelity deformations efficiently and easily. To address the challenging issue of predicting deformations influenced by multi-source attributes, we propose three strategies from novel perspectives. Specifically, we first found that the fit between the garment and the body has an important impact on the degree of folds. We then designed an attribute parser to generate detail-aware encodings and infused them into the graph neural network, therefore enhancing the discrimination of details under diverse attributes. Furthermore, to achieve better convergence and avoid overly smooth deformations, we proposed output reconstruction to mitigate the complexity of the learning task. Experiment results show that our proposed deformation method achieves better performance over existing methods in terms of generalization ability and quality of details.


title: Solving Linear Tensor Equations II: Including Parity Odd Terms in $4$-dimensions

abstract: In this letter, focusing in $4$-dimensions, we extend our previous results of solving linear tensor equations. In particular, we consider a $30$ parameter linear tensor equation for the unknown tensor components $N_{\alpha\mu\nu}$ in terms of the known (sources) components $B_{\alpha\mu\nu}$. Our extension now consists in including also the parity even linear terms in $N_{\alpha\mu\nu}$ (and the associated traces) formed by contracting the latter with the $4$-dimensional Levi-Civita pseudo-tensor. Assuming a generic non-degeneracy condition and following a step by step procedure we show how one can solve explicitly for the unknown tensor field components $N_{\alpha\mu\nu}$ and consequently derive its unique and exact solution in terms of the components $B_{\alpha\mu\nu}$.


title: Laser-lithographically written micron-wide superconducting nanowire single-photon detectors

abstract: We demonstrate the fabrication of micron-wide tungsten silicide superconducting nanowire single-photon detectors on a silicon substrate using laser lithography. We show saturated internal detection efficiencies with wire widths from 0.59$\mu$m to 1.43$\mu$m under illumination at 1550nm. We demonstrate both straight wires, as well as meandered structures. Single-photon sensitivity is shown in devices up to 4mm in length. Laser-lithographically written devices allow for fast and easy structuring of large areas while maintaining a saturated internal efficiency for wire width around 1$\mu$m.


title: A New Type of Compositionally Complex M5Si3 Silicides: Cation Ordering and Unexpected Phase Stability

abstract: A new type of compositionally complex (medium- or high-entropy) M5Si3 silicides is synthesized. Both (V1/5Cr1/5Nb1/5Ta1/5W1/5)5Si3 and (Ti1/5Zr1/5Nb1/5Mo1/5Hf1/5)5Si3 form single-phase homogenous solid solutions. Notably, (V1/5Cr1/5Nb1/5Ta1/5W1/5)5Si3 forms the hexagonal gamma (D88) phase, while all its five constituent binary silicides, V5Si3, Cr5Si3, Nb5Si3, Ta5Si3, and W5Si3, are stable in the tetragonal alpha (D8l) or beta (D8m) phases. Annealing at 1600C demonstrates that this hexagonal gamma phase is stable. Comparison of the experimental and calculated X-ray diffraction patterns, Rietveld refinements, and analysis of aberration-corrected scanning transmission electron microscopy high-angle annular dark-field images suggest cation ordering, which reduces the configurational entropy. This work expands the field of high-entropy and compositional complex ceramics by not only discovering a new compositional complex silicide phase but also demonstrating the cation ordering and unusual phase stability. These compositionally complex silicides can be combined with refractory high-entropy alloys to make the high-entropy counterparts to the Nb-silicide and Mo-Si-B composites.


title: Entanglement between superconducting qubits and a tardigrade

abstract: Quantum and biological systems are seldom discussed together as they seemingly demand opposing conditions. Life is complex, "hot and wet" whereas quantum objects are small, cold and well controlled. Here, we overcome this barrier with a tardigrade -- a microscopic multicellular organism known to tolerate extreme physiochemical conditions via a latent state of life known as cryptobiosis. We observe coupling between the animal in cryptobiosis and a superconducting quantum bit and prepare a highly entangled state between this combined system and another qubit. The tardigrade itself is shown to be entangled with the remaining subsystems. The animal is then observed to return to its active form after 420 hours at sub 10 mK temperatures and pressure of $6\times 10^{-6}$ mbar, setting a new record for the conditions that a complex form of life can survive.


title: Discovery of a reversible redox-induced order-disorder transition in a 10-cation compositionally complex ceramic

abstract: This study discovers a reversible order-disorder transition (ODT) in a 10-cation compositionally complex ceramic, (Nd0.15Pr0.15Dy0.8Ho0.8Er0.8Ti0.2Yb0.1Hf0.1Zr0.1Nb0.8)O7-delta, induced via annealing in oxidized vs. reduced environments at 1600C. Notably, the 10-cation oxide remains a homogenous single-phase high-entropy solid solution before and after the ODT in the pyrochlore vs. fluorite structure that can be quenched. In-situ neutron diffraction reveals the oxygen vacancy formation and atomic displacement during this ODT. The temperature dependence of thermal conductivity is altered by the ODT. This study reveals a new pathway to induce ODT via a redox transition to tailor the properties of compositionally complex fluorite-based oxides.


title: Data Placement for Multi-Tenant Data Federation on the Cloud

abstract: Due to privacy concerns of users and law enforcement in data security and privacy, it becomes more and more difficult to share data among organizations. Data federation brings new opportunities to the data-related cooperation among organizations by providing abstract data interfaces. With the development of cloud computing, organizations store data on the cloud to achieve elasticity and scalability for data processing. The existing data placement approaches generally only consider one aspect, which is either execution time or monetary cost, and do not consider data partitioning for hard constraints. In this paper, we propose an approach to enable data processing on the cloud with the data from different organizations. The approach consists of a data federation platform named FedCube and a Lyapunov-based data placement algorithm. FedCube enables data processing on the cloud. We use the data placement algorithm to create a plan in order to partition and store data on the cloud so as to achieve multiple objectives while satisfying the constraints based on a multi-objective cost model. The cost model is composed of two objectives, i.e., reducing monetary cost and execution time. We present an experimental evaluation to show our proposed algorithm significantly reduces the total cost (up to 69.8\%) compared with existing approaches.


title: Reduced typed angularly decorated planar rooted trees and generalized tridendriform algebras

abstract: We introduce a generalization of tridendriform algebras, where each of the three products are replaced by a family of products indexed by a set $\Omega$. We study the needed structure on $\Omega$ for free $\Omega$-tridendriform algebras to be built on Schr{\"o}der trees (as it is the case in the classical case), with convenient decorations on their leaves. We obtain in this way extended triassociative semigroups. We describe commutative $\Omega$-tridendriform algebras in terms of typed words. We also study links with generalizations of Rota-Baxter algebras and describe the Koszul duals of the corresponding operads.


title: A Georgi-Machacek Interpretation of the Associate Production of a Neutral Scalar with Mass around 151 GeV

abstract: Following an investigation of several indications for new physics from LHC data, a detailed exploration of the Georgi-Machacek (GM) model was elaborated in a previous publication. This framework is used here to interpret the findings of Crivellin et al., which were obtained by combining the 2 photon mass spectrum from ATLAS and CMS, adding extra conditions, the most efficient one being the presence of >90 GeV missing transverse energy. The claim is a ~5 s.d. excess at 151 GeV. The GM model naturally explains this as coming from the cascade A(400)->H(151)Z, where H(151) is an isosinglet predicted by GM and where the accompanying signal comes from the decay of a Z boson into neutrino pairs. Satisfying the constraints from LHC measurements of the ZWW channel, which can receive a large contribution from this cascade, suggests that H(151) could dominantly decay into two light CP-odd scalars, following an ATLAS indication for h(125) decaying into bbmumu. A spectacular occurrence of signals is predicted at an $e^+e^-$ collider operating up to 1 TeV, an energy sufficient to cover the whole scenario.


title: Data-Driven Models for Control Engineering Applications Using the Koopman Operator

abstract: Within this work, we investigate how data-driven numerical approximation methods of the Koopman operator can be used in practical control engineering applications. We refer to the method Extended Dynamic Mode Decomposition (EDMD), which approximates a nonlinear dynamical system as a linear model. This makes the method ideal for control engineering applications, because a linear system description is often assumed for this purpose. Using academic examples, we simulatively analyze the prediction performance of the learned EDMD models and show how relevant system properties like stability, controllability, and observability are reflected by the EDMD model, which is a critical requirement for a successful control design process. Subsequently, we present our experimental results on a mechatronic test bench and evaluate the applicability to the control engineering design process. As a result, the investigated methods are suitable as a low-effort alternative for the design steps of model building and adaptation in the classical model-based controller design method.


title: Temporal Action Proposal Generation with Background Constraint

abstract: Temporal action proposal generation (TAPG) is a challenging task that aims to locate action instances in untrimmed videos with temporal boundaries. To evaluate the confidence of proposals, the existing works typically predict action score of proposals that are supervised by the temporal Intersection-over-Union (tIoU) between proposal and the ground-truth. In this paper, we innovatively propose a general auxiliary Background Constraint idea to further suppress low-quality proposals, by utilizing the background prediction score to restrict the confidence of proposals. In this way, the Background Constraint concept can be easily plug-and-played into existing TAPG methods (e.g., BMN, GTAD). From this perspective, we propose the Background Constraint Network (BCNet) to further take advantage of the rich information of action and background. Specifically, we introduce an Action-Background Interaction module for reliable confidence evaluation, which models the inconsistency between action and background by attention mechanisms at the frame and clip levels. Extensive experiments are conducted on two popular benchmarks, i.e., ActivityNet-1.3 and THUMOS14. The results demonstrate that our method outperforms state-of-the-art methods. Equipped with the existing action classifier, our method also achieves remarkable performance on the temporal action localization task.


title: Solving the Data Sparsity Problem in Predicting the Success of the Startups with Machine Learning Methods

abstract: Predicting the success of startup companies is of great importance for both startup companies and investors. It is difficult due to the lack of available data and appropriate general methods. With data platforms like Crunchbase aggregating the information of startup companies, it is possible to predict with machine learning algorithms. Existing research suffers from the data sparsity problem as most early-stage startup companies do not have much data available to the public. We try to leverage the recent algorithms to solve this problem. We investigate several machine learning algorithms with a large dataset from Crunchbase. The results suggest that LightGBM and XGBoost perform best and achieve 53.03% and 52.96% F1 scores. We interpret the predictions from the perspective of feature contribution. We construct portfolios based on the models and achieve high success rates. These findings have substantial implications on how machine learning methods can help startup companies and investors.


title: Revisiting the no-boundary proposal with a scalar field

abstract: Recent works have suggested that the no-boundary proposal should be defined as a sum over regular, not necessarily compact, metrics. We show that such a prescription can be implemented in the presence of a scalar field. For concreteness, we consider the model of Garay et al., in which the potential is a sum of exponentials, and which lends itself to an analytical treatment. Compared to the earlier implementation, we find that saddle points with unstable fluctuations can be eliminated by imposition of an appropriate regularity condition. This leads to the appearance of additional saddle points, corresponding to unclosed geometries. We argue that such saddles will occur generically, though we also find in our example that they are subdominant to the closed, Hartle-Hawking, saddle points. When the potential is positive, classical spacetime is only predicted for inflationary histories. When the potential is negative, we recover the AdS gravitational path integral, with a stable scalar field included. One puzzle that we find is that in general the path integral must be restricted to sum only over specific, discrete and late time dependent initial values of the scalar field. Only when the scalar is required to take real values is this puzzle eliminated, a situation that moreover leads to advantageous phenomenological characteristics.


title: Highlights from the NA61/SHINE strong-interactions programme

abstract: NA61/SHINE is a multipurpose fixed-target facility at the CERN SPS. The main goals of the NA61/SHINE strong-interactions programme are to discover the critical point of strongly interacting matter as well as to study the properties of the onset of deconfinement. In order to reach these goals, a study of hadron production properties is performed in nucleus-nucleus, proton-proton and proton-nucleus interactions as a function of collision energy and size of the colliding nuclei. In this contribution, the NA61/SHINE results from a strong interaction measurement programme are presented. In particular, the latest results from different reactions p+p, Be+Be, Ar+Sc, and Pb+Pb on hadron spectra, as well as intermittency, higher-order moments of multiplicity fluctuations and spectator induced electromagnetic effects are discussed.


title: Light modulation in Silicon photonics by PZT actuated acoustic waves

abstract: Tailoring the interaction between light and sound has opened new possibilities in photonic integrated circuits (PICs) that ranges from achieving quantum control of light to high-speed information processing. However, the actuation of sound waves in Si PICs usually requires integration of a piezoelectric thin film. Lead Zirconate Titanate (PZT) is a promising material due to its strong piezoelectric and electromechanical coupling coefficient. Unfortunately, the traditional methods to grow PZT on Silicon are detrimental for photonic applications due to the presence of an optical lossy intermediate layer. In this work, we report integration of a high quality PZT thin film on a Silicon-on-insulator (SOI) photonic chip using an optically transparent buffer layer. We demonstrate acousto-optic modulation in Silicon waveguides with the PZT actuated acoustic waves. We fabricate inter digital transducers (IDTs) on the PZT film with a contact photo-lithography and electron-beam lithography to generate the acoustic waves in MHz and GHz range respectively. We obtain a V$_{\pi}$L $\sim$ 3.35 V$\cdot$cm at 576 MHz from a 350 nm thick gold (Au) IDT with 20 finger-pairs. After taking the effect of mass-loading and grating reflection into account, we measured a V$_{\pi}$L $\sim$ 3.60 V$\cdot$cm at 2 GHz from a 100 nm thick Aluminum (Al) IDT consisting of only 4 finger-pairs. Thus, without patterning the PZT film nor suspending the device, we obtained figures-of-merit comparable to state-of-the-art modulators based on SOI, making it a promising candidate for broadband and efficient acousto-optic modulator for future integration.


title: Origin of postmaximum bump in luminous type Ic SN 2019stc

abstract: We address the issue of the postmaximum bump observed in the light curve of some superluminous supernovae. We rule out the popular mechanism of a circumstellar interaction suggested for the bump explanation. Instead we propose that the postmaximum bump is caused by the magnetar dipole field enhancement several months after the explosion. The modeling of SN 2019stc light curve based on the thin shell approximation implies that at the age of $\sim 90$ days the initial dipole magnetic field should be amplified by a factor of 2.8 to account for the postmaximum bump. The specific mechanism for the field amplification of the newborn magnetar on the timescale of several months has yet to be identified.


title: Supervised learning of analysis-sparsity priors with automatic differentiation

abstract: Sparsity priors are commonly used in denoising and image reconstruction. For analysis-type priors, a dictionary defines a representation of signals that is likely to be sparse. In most situations, this dictionary is not known, and is to be recovered from pairs of ground-truth signals and measurements, by minimizing the reconstruction error. This defines a hierarchical optimization problem, which can be cast as a bi-level optimization. Yet, this problem is unsolvable, as reconstructions and their derivative wrt the dictionary have no closed-form expression. However, reconstructions can be iteratively computed using the Forward-Backward splitting (FB) algorithm. In this paper, we approximate reconstructions by the output of the aforementioned FB algorithm. Then, we leverage automatic differentiation to evaluate the gradient of this output wrt the dictionary, which we learn with projected gradient descent. Experiments show that our algorithm successfully learns the 1D Total Variation (TV) dictionary from piecewise constant signals. For the same case study, we propose to constrain our search to dictionaries of 0-centered columns, which removes undesired local minima and improves numerical stability.


title: Paley-Wiener-Schwartz Theorems on Quadratic CR Manifolds

abstract: Given a quadratic CR manifold $\mathcal{M}$ embedded in a complex space, we study Paley-Wiener-Schwartz theorems for spaces of Schwartz functions and tempered distributions on $\mathcal{M}$.


title: Computational Associative Memory with Amorphous InGaZnO Channel 3D NAND-Compatible FG Transistors

abstract: 3D NAND enables continuous NAND density and cost scaling beyond conventional 2D NAND. However, its poly-Si channel suffers from low mobility, large device variations, and instability caused by grain boundaries. Here, we overcome these drawbacks by introducing an amorphous indium-gallium-zinc-oxide (a-IGZO) channel, which has the advantages of ultra-low OFF current, back-end-of-line compatibility, higher mobility and better uniformity than poly-Si, and free of grain boundaries due to the amorphous nature. Ultra-scaled floating-gate (FG) transistors with a channel length of 60 nm are reported, achieving the highest ON current of 127 uA/um among all reported a-IGZO-based flash devices for high-density, low-power, and high-performance 3D NAND applications. Furthermore, a non-volatile and area-efficient ternary content-addressable memory (TCAM) with only two a-IGZO FG transistors is experimentally demonstrated. Array-level simulations using experimentally calibrated models show that this design achieves at least 240x array-size scalability and 2.7-fold reduction in search energy than 16T-CMOS, 2T2R, and 2FeFET TCAMs.


title: The global landscape of phase retrieval I: perturbed amplitude models

abstract: A fundamental task in phase retrieval is to recover an unknown signal $\vx\in \Rn$ from a set of magnitude-only measurements $y_i=\abs{\nj{\va_i,\vx}}, \; i=1,\ldots,m$. In this paper, we propose two novel perturbed amplitude models (PAMs) which have non-convex and quadratic-type loss function. When the measurements $ \va_i \in \Rn$ are Gaussian random vectors and the number of measurements $m\ge Cn$, we rigorously prove that the PAMs admit no spurious local minimizers with high probability, i.e., the target solution $ \vx$ is the unique global minimizer (up to a global phase) and the loss function has a negative directional curvature around each saddle point. Thanks to the well-tamed benign geometric landscape, one can employ the vanilla gradient descent method to locate the global minimizer $\vx$ (up to a global phase) without spectral initialization. We carry out extensive numerical experiments to show that the gradient descent algorithm with random initialization outperforms state-of-the-art algorithms with spectral initialization in empirical success rate and convergence speed.


title: Bernstein Spaces on Siegel CR Manifolds

abstract: In this paper we introduce and study Bernstein spaces on a class of quadratic CR manifolds, that we call Siegel CR manifolds. These are spaces of entire functions of exponential type whose restrictions to a given Siegel CR submanifold are $L^p$-integrable with respect to a natural measure. For these spaces, among other results, we prove the Plancherel-P\'olya inequality, a Bernstein inequality and a sufficient condition for a sequence to be sampling.


title: Domain-informed neural networks for interaction localization within astroparticle experiments

abstract: This work proposes a domain-informed neural network architecture for experimental particle physics, using particle interaction localization with the time-projection chamber (TPC) technology for dark matter research as an example application. A key feature of the signals generated within the TPC is that they allow localization of particle interactions through a process called reconstruction. While multilayer perceptrons (MLPs) have emerged as a leading contender for reconstruction in TPCs, such a black-box approach does not reflect prior knowledge of the underlying scientific processes. This paper looks anew at neural network-based interaction localization and encodes prior detector knowledge, in terms of both signal characteristics and detector geometry, into the feature encoding and the output layers of a multilayer neural network. The resulting Domain-informed Neural Network (DiNN) limits the receptive fields of the neurons in the initial feature encoding layers in order to account for the spatially localized nature of the signals produced within the TPC. This aspect of the DiNN, which has similarities with the emerging area of graph neural networks in that the neurons in the initial layers only connect to a handful of neurons in their succeeding layer, significantly reduces the number of parameters in the network in comparison to an MLP. In addition, in order to account for the detector geometry, the output layers of the network are modified using two geometric transformations to ensure the DiNN produces localizations within the interior of the detector. The end result is a neural network architecture that has 60% fewer parameters than an MLP, but that still achieves similar localization performance and provides a path to future architectural developments with improved performance because of their ability to encode additional domain knowledge into the architecture.


title: A Note on Hardy Spaces on Quadratic CR Manifolds

abstract: Given a quadratic CR manifold $\mathcal{M}$ embedded in a complex space, and a holomorphic function $f$ on a tubular neighbourhood of $\mathcal{M}$, we show that the $L^p$-norms of the restriction of $f$ to the translates of $\mathcal{M}$ is decreasing for the ordering induced by the closed convex envelope of the image of the Levi form of $\mathcal{M}$.


title: The global landscape of phase retrieval II: quotient intensity models

abstract: A fundamental problem in phase retrieval is to reconstruct an unknown signal from a set of magnitude-only measurements. In this work we introduce three novel quotient intensity-based models (QIMs) based a deep modification of the traditional intensity-based models. A remarkable feature of the new loss functions is that the corresponding geometric landscape is benign under the optimal sampling complexity. When the measurements $ a_i\in \Rn$ are Gaussian random vectors and the number of measurements $m\ge Cn$, the QIMs admit no spurious local minimizers with high probability, i.e., the target solution $ x$ is the unique global minimizer (up to a global phase) and the loss function has a negative directional curvature around each saddle point. Such benign geometric landscape allows the gradient descent methods to find the global solution $x$ (up to a global phase) without spectral initialization.


title: Multi-modal Networks Reveal Patterns of Operational Similarity of Terrorist Organizations

abstract: Capturing dynamics of operational similarity among terrorist groups is critical to provide actionable insights for counter-terrorism and intelligence monitoring. Yet, in spite of its theoretical and practical relevance, research addressing this problem is currently lacking. We tackle this problem proposing a novel computational framework for detecting clusters of terrorist groups sharing similar behaviors, focusing on groups' yearly repertoire of deployed tactics, attacked targets, and utilized weapons. Specifically considering those organizations that have plotted at least 50 attacks from 1997 to 2018, accounting for a total of 105 groups responsible for more than 42,000 events worldwide, we offer three sets of results. First, we show that over the years global terrorism has been characterized by increasing operational cohesiveness. Second, we highlight that year-to-year stability in co-clustering among groups has been particularly high from 2009 to 2018, indicating temporal consistency of similarity patterns in the last decade. Third, we demonstrate that operational similarity between two organizations is driven by three factors: (a) their overall activity; (b) the difference in the diversity of their operational repertoires; (c) the difference in a combined measure of diversity and activity. Groups' operational preferences, geographical homophily and ideological affinity have no consistent role in determining operational similarity.


title: Self-Ensembling GAN for Cross-Domain Semantic Segmentation

abstract: Deep neural networks (DNNs) have greatly contributed to the performance gains in semantic segmentation. Nevertheless, training DNNs generally requires large amounts of pixel-level labeled data, which is expensive and time-consuming to collect in practice. To mitigate the annotation burden, this paper proposes a self-ensembling generative adversarial network (SE-GAN) exploiting cross-domain data for semantic segmentation. In SE-GAN, a teacher network and a student network constitute a self-ensembling model for generating semantic segmentation maps, which together with a discriminator, forms a GAN. Despite its simplicity, we find SE-GAN can significantly boost the performance of adversarial training and enhance the stability of the model, the latter of which is a common barrier shared by most adversarial training-based methods. We theoretically analyze SE-GAN and provide an $\mathcal O(1/\sqrt{N})$ generalization bound ($N$ is the training sample size), which suggests controlling the discriminator's hypothesis complexity to enhance the generalizability. Accordingly, we choose a simple network as the discriminator. Extensive and systematic experiments in two standard settings demonstrate that the proposed method significantly outperforms current state-of-the-art approaches. The source code of our model is available online (https://github.com/YonghaoXu/SE-GAN).


title: Learning Submodular Objectives for Team Environmental Monitoring

abstract: In this paper, we study the well-known team orienteering problem where a fleet of robots collects rewards by visiting locations. Usually, the rewards are assumed to be known to the robots; however, in applications such as environmental monitoring or scene reconstruction, the rewards are often subjective and specifying them is challenging. We propose a framework to learn the unknown preferences of the user by presenting alternative solutions to them, and the user provides a ranking on the proposed alternative solutions. We consider the two cases for the user: 1) a deterministic user which provides the optimal ranking for the alternative solutions, and 2) a noisy user which provides the optimal ranking according to an unknown probability distribution. For the deterministic user we propose a framework to minimize a bound on the maximum deviation from the optimal solution, namely regret. We adapt the approach to capture the noisy user and minimize the expected regret. Finally, we demonstrate the importance of learning user preferences and the performance of the proposed methods in an extensive set of experimental results using real world datasets for environmental monitoring problems.


title: Autoencoder-based background reconstruction and foreground segmentation with background noise estimation

abstract: Even after decades of research, dynamic scene background reconstruction and foreground object segmentation are still considered as open problems due various challenges such as illumination changes, camera movements, or background noise caused by air turbulence or moving trees. We propose in this paper to model the background of a frame sequence as a low dimensional manifold using an autoencoder and compare the reconstructed background provided by this autoencoder with the original image to compute the foreground/background segmentation masks. The main novelty of the proposed model is that the autoencoder is also trained to predict the background noise, which allows to compute for each frame a pixel-dependent threshold to perform the foreground segmentation. Although the proposed model does not use any temporal or motion information, it exceeds the state of the art for unsupervised background subtraction on the CDnet 2014 and LASIESTA datasets, with a significant improvement on videos where the camera is moving. It is also able to perform background reconstruction on some non-video image datasets.


title: Strongly singular convective elliptic equations in RN driven by a non-homogeneous operator

abstract: Existence of a generalized solution to a strongly singular convective elliptic equation in the whole space is established. The differential operator, patterned after the (p,q)-Laplacian, can be non-homogeneous. The result is obtained by solving some regularized problems through fixed point theory, variational methods and compactness results, besides exploiting nonlinear regularity theory and comparison principles.


title: Taplint, the TAP Service Validator

abstract: TAP, the Table Access Protocol, is a widely used Virtual Observatory specification allowing client software to interact with remote database services in a standardised way. This paper presents taplint, a tool for assessing the compliance of deployed TAP services with the the dozen or so formal specifications that form the TAP protocol stack. We provide an overview of its capabilities and operation, and the context within which it is used to improve robustness of data services.


title: Observation of ELVES with Mini-EUSO telescope on board the International Space Station

abstract: Mini-EUSO is a detector observing the Earth in the ultraviolet band from the International Space Station through a nadir-facing window, transparent to the UV radiation, in the Russian Zvezda module. Mini-EUSO main detector consists in an optical system with two Fresnel lenses and a focal surface composed of an array of 36 Hamamatsu Multi-Anode Photo-Multiplier tubes, for a total of 2304 pixels, with single photon counting sensitivity. The telescope also contains two ancillary cameras, in the near infrared and visible ranges, to complement measurements in these bandwidths. The instrument has a field of view of 44 degrees, a spatial resolution of about 6.3 km on the Earth surface and of about 4.7 km on the ionosphere. The telescope detects UV emissions of cosmic, atmospheric and terrestrial origin on different time scales, from a few micoseconds upwards. On the fastest timescale of 2.5 microseconds, Mini-EUSO is able to observe atmospheric phenomena as Transient Luminous Events and in particular the ELVES, which take place when an electromagnetic wave generated by intra-cloud lightning interacts with the ionosphere, ionizing it and producing apparently superluminal expanding rings of several 100 km and lasting about 100 microseconds. These highly energetic fast events have been observed to be produced in conjunction also with Terrestrial Gamma-Ray Flashes and therefore a detailed study of their characteristics (speed, radius, energy...) is of crucial importance for the understanding of these phenomena. In this paper we present the observational capabilities of ELVE detection by Mini-EUSO and specifically the reconstruction and study of ELVE characteristics.


title: Well ordering principles for iterated $\Pi^1_1$-comprehension

abstract: We introduce ordinal collapsing principles that are inspired by proof theory but have a set theoretic flavor. These principles are shown to be equivalent to iterated $\Pi^1_1$-comprehension and the existence of admissible sets, over weak base theories. Our work extends a previous result on the non-iterated case, which had been conjectured in Montalb\'an's "Open questions in reverse mathematics" (Bull. Symb. Log. 17(3)2011). This previous result has already been applied to the reverse mathematics of combinatorial and set theoretic principles. The present paper is a significant contribution to a general approach that connects these fields.


title: Consistent Depth Prediction under Various Illuminations using Dilated Cross Attention

abstract: In this paper, we aim to solve the problem of consistent depth prediction in complex scenes under various illumination conditions. The existing indoor datasets based on RGB-D sensors or virtual rendering have two critical limitations - sparse depth maps (NYU Depth V2) and non-realistic illumination (SUN CG, SceneNet RGB-D). We propose to use internet 3D indoor scenes and manually tune their illuminations to render photo-realistic RGB photos and their corresponding depth and BRDF maps, obtaining a new indoor depth dataset called Vari dataset. We propose a simple convolutional block named DCA by applying depthwise separable dilated convolution on encoded features to process global information and reduce parameters. We perform cross attention on these dilated features to retain the consistency of depth prediction under different illuminations. Our method is evaluated by comparing it with current state-of-the-art methods on Vari dataset and a significant improvement is observed in our experiments. We also conduct the ablation study, finetune our model on NYU Depth V2 and also evaluate on real-world data to further validate the effectiveness of our DCA block. The code, pre-trained weights and Vari dataset are open-sourced.


title: Bicolored tilings and the Scott map

abstract: We define bicolored tilings as a disk with a collection of smooth curves with a coloring map on the tiles that these curves delimit. Using two transformations, we define an equivalence on tilings. We then define the Scott map which creates a bijection between a generalised version of Postnikov diagrams and bicolored tilings, preserving equivalences, and mapping the geometric exchange of a diagram to an edge flip in a tiling.


title: Single-junction quantum-circuit refrigerator

abstract: We propose a quantum-circuit refrigerator (QCR) based on photon-assisted quasiparticle tunneling through a single normal-metal--insulator--superconductor (NIS) junction. In contrast to previous works with multiple junctions and an additional charge island for the QCR, we galvanically connect the NIS junction to an inductively shunted electrode of a superconducting microwave resonator making the device immune to low-frequency charge noise. At low characteristic impedance of the resonator and parameters relevant to a recent experiment, we observe that a semiclassical impedance model of the NIS junction reproduces the bias voltage dependence of the QCR-induced damping rate and frequency shift. For high characteristic impedances, we derive a Born--Markov master equation and use it to observe significant non-linearities in the QCR-induced dissipation and frequency shift. We further demonstrate that in this regime, the QCR can be used to initialize the linear resonator into a non-thermal state even in the absence of any microwave drive.


title: Reducing current crowding in meander superconducting strip single-photon detectors by thickening bends

abstract: To facilitate high optical coupling efficiency and absorptance, the active area of a superconducting nano/microstrip single-photon detector (SNSPD/SMSPD) is often designed as a meander configuration with a high filling factor (e.g., >=0.5). However, the switching current (Isw) of SNSPD/SMSPD, at which the detector switches into the normal state, is significantly suppressed by a geometry-induced "current crowding effect", where there are sharp bends in the strip. Here we propose and experimentally verify an alternative method to reduce current crowding both in SNSPD and SMSPD by directly increasing the thickness of the bends through the deposition and lift-off of a secondary superconducting film. We measure and compare the performance of SNSPDs and SMSPDs with different filling factors and bend configurations, with or without thickened bends. Improvements for detectors were observed in detection efficiency, intrinsic dark count rate, and time jitter, owing to the enhanced Isw. Our method provides a promising way of optimizing SNSPD/SMSPD detection performance.


title: Static Code Analyzer Using Micro-Grammar

abstract: [THIS IS AN UNDERGRADUATE PROJECT] This paper discusses the effectiveness of the bug finder based on "micro-grammar".


title: Generalized Difference Coder: A Novel Conditional Autoencoder Structure for Video Compression

abstract: Motion compensated inter prediction is a common component of all video coders. The concept was established in traditional hybrid coding and successfully transferred to learning-based video compression. To compress the residual signal after prediction, usually the difference of the two signals is compressed using a standard autoencoder. However, information theory tells us that a general conditional coder is more efficient. In this paper, we provide a solid foundation based on information theory and Shannon entropy to show the potentials but also the limits of conditional coding. Building on those results, we then propose the generalized difference coder, a special case of a conditional coder designed to avoid limiting bottlenecks. With this coder, we are able to achieve average rate savings of 27.8% compared to a standard autoencoder, by only adding a moderate complexity overhead of less than 7%.


title: Service Oriented Architecture in Enterprise Application

abstract: At present organizations try to achieve competitive advantages using information technology (IT). Organizations not only use Information technology to manage their internal operations but also to collaborate with their customers and suppliers. For these organizations use enterprise applications. Also, organizations expect IT to address their shifting needs in on demand environment. So currently IT face challenges in integrating the various system into a function that can address the organization's on-demand needs and span over the organizational boundaries. Now Service-Oriented Architecture (SOA) imagine as an architectural framework that addresses the issues on previous enterprise applications. This paper represents the Service-Oriented Architecture in Enterprise Applications. The enterprise application gives a brief idea about enterprise applications. Afterward, this paper addresses the main problems faced by enterprise applications on the evolution of enterprise applications and the needs of service-oriented architecture in enterprise applications. Afterward, discuss Service Oriented Architecture and challenges on Service Oriented Architecture.


title: Spin Squeezing Induced Enhancement of Sensitivity of an Atomic Clock using Coherent Population Trapping

abstract: The coherent population trapping (CPT) effect is used for making compact atomic clocks. There are two types of CPT clocks: the one in which the Raman beams are applied continuously and the one in which two CPT pulses separated by a dark period are applied (Ramsey scheme). It is obvious that the technique of spin squeezing can only be applied to the Ramsey CPT clock to enhance the sensitivity. However, it is not apparent how to adapt to the CPT clock the protocols for the microwave clock using one-axis-twist squeezing (OATS), since the Ramsey CPT clock is not trivially equivalent to the Ramsey microwave clock. In this paper, we show explicitly how to adapt two protocols using OATS, namely the Schr\"odinger cat state protocol (SCSP) and the generalization thereof, and the echo squeezing protocol (ESP), to the CPT clock. The ESP magnifies the phase shift by a factor of the square-root of (N/e), while the SCSP magnifies the phase shift by a factor of N/2 , making it able to achieve a higher sensitivity in the presence of excess noise.


title: On LL(k) linear conjunctive grammars

abstract: Linear conjunctive grammars are a family of formal grammars with an explicit conjunction operation allowed in the rules, which is notable for its computational equivalence fo one-way real-time cellular automata, also known as trellis automata. This paper investigates the LL($k$) subclass of linear conjunctive grammars, defined by analogy with the classical LL($k$) grammars: these are grammars that admit top-down linear-time parsing with $k$-symbol lookahead. Two results are presented. First, every LL($k$) linear conjunctive grammar can be transformed to an LL(1) linear conjunctive grammar, and, accordingly, the hierarchy with respect to $k$ collapses. Secondly, a parser for these grammars that works in linear time and uses logarithmic space is constructed, showing that the family of LL($k$) linear conjunctive languages is contained in the complexity class $L$.


title: Protein Enrichment by Flotation: Experiment and Modeling

abstract: Protein flotation is a process in which protein molecules are enriched by adsorption at rising bubbles. The bubbles then form a foam above the solution, where the liquid drains down and the dried foam, which is concentrated in protein, is extracted. Here, the recovery rate and purity of the extract depend on foam stability, surface coverage, bubble size, gas flow rate, etc. In this work, we performed flotation experiments using bovine serum albumin (BSA). In addition, an unsteady state simulation of the protein flotation process was carried out by numerically solving the liquid drainage equation in the foam. Thereby, the extracted liquid volume and protein concentration at the outlet were calculated with time. Required quantities such as foam stability, interface coverage or bubble size distribution were measured in corresponding experiments and were fed into the model. The experiments showed that the foam coalescence accelerates the liquid drainage leading to dryer extract and higher protein enrichment. The modeling also reproduced the liquid recovery and extract concentration of the flotation tests within a reasonable error range. The modeling solely relies on experimental inputs and does not require any tuning parameters. It can be further used for optimization or up-scaling of protein flotation.


title: Form factors of $P\to T$ transition within the light-front quark models

abstract: In this paper, we calculate the vector, axial-vector and tensor form factors of $P\to T$ transition within the standard light-front~(SLF) and covariant light-front~(CLF) quark models~(QMs). The self-consistency and Lorentz covariance of CLF QM with two types of correspondence schemes are investigated. The zero-mode effects and the spurious $\omega$-dependent contributions to the form factors of $P\to T$ transition are analyzed. Employing a self-consistent CLF QM, we present our numerical predictions for the vector, axial-vector and tensor form factors of $c\to (q,s)$~($q=u,d$) induced $D \to (a_2,K^*_2)$, $D_s \to (K^*_2,f'_{2})$, $\eta_c(1S) \to (D^*_2,D^*_{s2})$, $ B_c \to (B^*_2,B^*_{s2})$ transitions and $b\to (q,s,c)$ induced $B \to (a_2,K^*_2,D^*_2)$, $B_s \to (K^*_2,f'_2,D^*_{s2})$, $B_c \to (D^*_2,D^*_{s2},\chi_{c2}(1P))$, $\eta_b(1S) \to (B^*_2,B^*_{s2})$ transitions. Finally, in order to test the obtained form factors, the semileptonic $B\to \bar{D}_2^*(2460)\ell^+\nu_\ell$~($\ell=e,\mu$) and $\bar{D}_2^*(2460)\tau^+\nu_{\tau}$ decays are studied. It is expected that our results for the form factors of $P\to T$ transition can be applied further to the relevant phenomenological studies of meson decays.


title: Extensions of the Mandelstam-Tamm quantum speed limit to systems in mixed states

abstract: The Mandelstam-Tamm quantum speed limit puts a bound on how fast a closed system in a pure state can evolve. In this paper, we derive several extensions of this quantum speed limit to closed systems in mixed states. We also compare the strengths of these extensions and examine their tightness. The most widely used extension of the Mandelstam-Tamm quantum speed limit originates in Uhlmann's energy dispersion estimate. We carefully analyze the underlying geometry of this estimate, an analysis that makes apparent that the Bures metric, or equivalently the quantum Fisher information, will rarely give rise to tight extensions. This observation leads us to address whether there is a tightest general extension of the Mandelstam-Tamm quantum speed limit. Using a geometric construction similar to that developed by Uhlmann, we prove that this is indeed the case. In addition, we show that tight evolutions of mixed states are typically generated by time-varying Hamiltonians, which contrasts with the case for systems in pure states.


title: MissMarple : A Novel Socio-inspired Feature-transfer Learning Deep Network for Image Splicing Detection

abstract: In this paper we propose a novel socio-inspired convolutional neural network (CNN) deep learning model for image splicing detection. Based on the premise that learning from the detection of coarsely spliced image regions can improve the detection of visually imperceptible finely spliced image forgeries, the proposed model referred to as, MissMarple, is a twin CNN network involving feature-transfer learning. Results obtained from training and testing the proposed model using the benchmark datasets like Columbia splicing, WildWeb, DSO1 and a proposed dataset titled AbhAS consisting of realistic splicing forgeries revealed improvement in detection accuracy over the existing deep learning models.


title: Black Holes, Gravitational Waves and Quantum Gravity

abstract: Loop Quantum Gravity is a theory that attempts to describe the quantum mechanics of the gravitational field based on the canonical quantization of General Relativity. According to Loop Quantum Gravity, in a gravitational field, geometric quantities such as area and volume are quantized in terms of the Planck lenth. In this paper we present the basic ideas for a future, mathematically more rigorous, attempt to combine black holes and gravitational waves using the quantization of geometric quantities introduced by Loop Quantum Gravity.


title: Creative proofs in combinations

abstract: In this article, we present four issues and provide a creative and concise proof for each of them. The four issues are: 1- Inequality $\frac{1}{\sqrt{n\pi+\frac{\pi}{2}}}<\frac{\binom{2n}{n}}{2^{2n}}<\frac{1}{\sqrt{n\pi}}$ 2- A special case of Jonathan Wilde's problem 3- Combination series 4- A feature of powerful numbers.


title: Anyons in One Dimension

abstract: I give a non-technical account of fractional statistics in one dimension. In systems with periodic boundary conditions, the crossing of anyons is always uni-directional, and the fractional phase $\theta$ acquired by the anyons gives rise to fractional shifts in the spacings of the relative momenta, ${\Delta p =2\pi\hbar/L\, (|\theta|/\pi+n)}$. The fractional shift $\theta/\pi$ is a good quantum number of interacting anyons, even though the single particle momenta, and hence the non-negative integers $n$, are generally not.


title: Segmentation-Reconstruction-Guided Facial Image De-occlusion

abstract: Occlusions are very common in face images in the wild, leading to the degraded performance of face-related tasks. Although much effort has been devoted to removing occlusions from face images, the varying shapes and textures of occlusions still challenge the robustness of current methods. As a result, current methods either rely on manual occlusion masks or only apply to specific occlusions. This paper proposes a novel face de-occlusion model based on face segmentation and 3D face reconstruction, which automatically removes all kinds of face occlusions with even blurred boundaries,e.g., hairs. The proposed model consists of a 3D face reconstruction module, a face segmentation module, and an image generation module. With the face prior and the occlusion mask predicted by the first two, respectively, the image generation module can faithfully recover the missing facial textures. To supervise the training, we further build a large occlusion dataset, with both manually labeled and synthetic occlusions. Qualitative and quantitative results demonstrate the effectiveness and robustness of the proposed method.


title: Target estimands for population-adjusted indirect comparisons

abstract: Disagreement remains on what the target estimand should be for population-adjusted indirect treatment comparisons. This debate is of central importance for policy-makers and applied practitioners in health technology assessment. Misunderstandings are based on properties inherent to estimators, not estimands, and on generalizing conclusions based on linear regression to non-linear models. Estimators of marginal estimands need not be unadjusted and may be covariate-adjusted. The population-level interpretation of conditional estimates follows from collapsibility and does not necessarily hold for the underlying conditional estimands. For non-collapsible effect measures, neither conditional estimates nor estimands have a population-level interpretation. Estimators of marginal effects tend to be more precise and efficient than estimators of conditional effects where the measure of effect is non-collapsible. In any case, such comparisons are inconsequential for estimators targeting distinct estimands. Statistical efficiency should not drive the choice of the estimand. On the other hand, the estimand, selected on the basis of relevance to decision-making, should drive the choice of the most efficient estimator. Health technology assessment agencies make reimbursement decisions at the population level. Therefore, marginal estimands are required. Current pairwise population adjustment methods such as matching-adjusted indirect comparison are restricted to target marginal estimands that are specific to the comparator study sample. These may not be relevant for decision-making. Multilevel network meta-regression (ML-NMR) can potentially target marginal estimands in any population of interest. Such population could be characterized by decision-makers using increasingly available "real-world" data sources. Therefore, ML-NMR presents new directions and abundant opportunities for evidence synthesis.


title: Visually Guided UGV for Autonomous Mobile Manipulation in Dynamic and Unstructured GPS Denied Environments

abstract: A robotic solution for the unmanned ground vehicles (UGVs) to execute the highly complex task of object manipulation in an autonomous mode is presented. This paper primarily focuses on developing an autonomous robotic system capable of assembling elementary blocks to build the large 3D structures in GPS-denied environments. The key contributions of this system paper are i) Designing of a deep learning-based unified multi-task visual perception system for object detection, part-detection, instance segmentation, and tracking, ii) an electromagnetic gripper design for robust grasping, and iii) system integration in which multiple system components are integrated to develop an optimized software stack. The entire mechatronic and algorithmic design of UGV for the above application is detailed in this work. The performance and efficacy of the overall system are reported through several rigorous experiments.


title: TLogic: Temporal Logical Rules for Explainable Link Forecasting on Temporal Knowledge Graphs

abstract: Conventional static knowledge graphs model entities in relational data as nodes, connected by edges of specific relation types. However, information and knowledge evolve continuously, and temporal dynamics emerge, which are expected to influence future situations. In temporal knowledge graphs, time information is integrated into the graph by equipping each edge with a timestamp or a time range. Embedding-based methods have been introduced for link prediction on temporal knowledge graphs, but they mostly lack explainability and comprehensible reasoning chains. Particularly, they are usually not designed to deal with link forecasting -- event prediction involving future timestamps. We address the task of link forecasting on temporal knowledge graphs and introduce TLogic, an explainable framework that is based on temporal logical rules extracted via temporal random walks. We compare TLogic with state-of-the-art baselines on three benchmark datasets and show better overall performance while our method also provides explanations that preserve time consistency. Furthermore, in contrast to most state-of-the-art embedding-based methods, TLogic works well in the inductive setting where already learned rules are transferred to related datasets with a common vocabulary.