title: E-RAFT: Dense Optical Flow from Event Cameras

abstract: We propose to incorporate feature correlation and sequential processing into dense optical flow estimation from event cameras. Modern frame-based optical flow methods heavily rely on matching costs computed from feature correlation. In contrast, there exists no optical flow method for event cameras that explicitly computes matching costs. Instead, learning-based approaches using events usually resort to the U-Net architecture to estimate optical flow sparsely. Our key finding is that the introduction of correlation features significantly improves results compared to previous methods that solely rely on convolution layers. Compared to the state-of-the-art, our proposed approach computes dense optical flow and reduces the end-point error by 23% on MVSEC. Furthermore, we show that all existing optical flow methods developed so far for event cameras have been evaluated on datasets with very small displacement fields with a maximum flow magnitude of 10 pixels. Based on this observation, we introduce a new real-world dataset that exhibits displacement fields with magnitudes up to 210 pixels and 3 times higher camera resolution. Our proposed approach reduces the end-point error on this dataset by 66%.


title: Some implications of the Gessel identity

abstract: We generalize the congruences of Friedmann-Tamarkine (1909), Lehmer (1938), Ernvall-Metsankyla (1991) on the sums of powers of integers weighted by powers of the Fermat quotients to the next Fermat quotient power, namely to the third power of the Fermat quotient. Using this result and the Gessel identity (2005) combined with our past work (2001), we are able to relate residues of some truncated convolutions of Bernoulli numbers with some Ernvall-Metsankyla residues to some full convolutions of the same kind. We also establish some congruences concerning other related weighed sums of powers of integers when these sums are weighted by some analogs of the Teichmuller characters.


title: A proof of the Multiplicative 1-2-3 Conjecture

abstract: We prove that the product version of the 1-2-3 Conjecture, raised by Skowronek-Kazi{\'o}w in 2012, is true. Namely, for every connected graph with order at least 3, we prove that we can assign labels 1,2,3 to the edges in such a way that no two adjacent vertices are incident to the same product of labels.


title: MIMO OFDM Dual-Function Radar-Communication Under Error Rate and Beampattern Constraints

abstract: In this work we consider a multiple-input multiple-output (MIMO) dual-function radar-communication (DFRC) system, which senses multiple spatial directions and serves multiple users. Upon resorting to an orthogonal frequency division multiplexing (OFDM) transmission format and a differential phase shift keying (DPSK) modulation, we study the design of the radiated waveforms and of the receive filters employed by the radar and the users. The approach is communication-centric, in the sense that a radar-oriented objective is optimized under constraints on the average transmit power, the power leakage towards specific directions, and the error rate of each user, thus safeguarding the communication quality of service (QoS). We adopt a unified design approach allowing a broad family of radar objectives, including both estimation- and detection-oriented merit functions. We devise a suboptimal solution based on alternating optimization of the involved variables, a convex restriction of the feasible search set, and minorization-maximization, offering a single algorithm for all of the radar merit functions in the considered family. Finally, the performance is inspected through numerical examples.


title: Two-dimensional beam profile monitor for the detection of alpha-emitting radioactive isotope beam

abstract: Ions with similar charge-to-mass ratios cannot be separated from existing beam profile monitors (BPMs) in nuclear facilities in which low-energy radioactive ions are produced due to nuclear fusion reactions. In this study, we developed a BPM using a microchannel plate and a charge-coupled device to differentiate the beam profiles of alpha-decaying radioactive isotopes from other ions (reaction products) produced in a nuclear reaction. This BPM was employed to optimize the low-energy radioactive francium ion (Fr+) beam developed at the Cyclotron and Radioisotope Center (CYRIC), Tohoku University, for electron permanent electric dipole moment (e-EDM) search experiments using Fr atoms. We demonstrated the performance of the BPM by separating the Fr+ beam from other reaction products produced during the nuclear fusion reaction of an oxygen (18O) beam and gold (197Au) target. However, as the mass of Au is close to that of Fr, separating the ions of these elements using a mass filter is a challenge, and a dominant number of Au+ renders the Fr+ beam profile invisible when using a typical BPM. Therefore, by employing the new BPM, we could successfully observe the Fr+ beam and other ion beams distinctly by measuring the alpha decay of Fr isotopes. This novel technique to monitor the alpha-emitting radioactive beam covers a broad range of lifetimes, for example, from approximately 1 s to 10 min, and can be implemented for other alpha-emitter beams utilized for medical applications.


title: Adaptation-Agnostic Meta-Training

abstract: Many meta-learning algorithms can be formulated into an interleaved process, in the sense that task-specific predictors are learned during inner-task adaptation and meta-parameters are updated during meta-update. The normal meta-training strategy needs to differentiate through the inner-task adaptation procedure to optimize the meta-parameters. This leads to a constraint that the inner-task algorithms should be solved analytically. Under this constraint, only simple algorithms with analytical solutions can be applied as the inner-task algorithms, limiting the model expressiveness. To lift the limitation, we propose an adaptation-agnostic meta-training strategy. Following our proposed strategy, we can apply stronger algorithms (e.g., an ensemble of different types of algorithms) as the inner-task algorithm to achieve superior performance comparing with popular baselines. The source code is available at https://github.com/jiaxinchen666/AdaptationAgnosticMetaLearning.


title: The Mays and Musts of Concurrent Strategies

abstract: Concurrent strategies based on event structures are examined from the viewpoint of 'may' and 'must' testing in traditional process calculi. In their pure form concurrent strategies fail to expose the deadlocks and divergences that can arise in their composition. This motivates an extension of the bicategory of concurrent strategies to treat the 'may' and 'must' behaviour of strategies under testing. One extension adjoins neutral moves to strategies but in so doing loses identities w.r.t. composition. This in turn motivates another extension in which concurrent strategies are accompanied by stopping configurations; the ensuing stopping strategies inherit the structure of a bicategory from that of strategies. The technical developments converge in providing characterisations of the 'may' and 'must' equivalences and preorders on strategies.


title: Coexistence in competing first passage percolation with conversion

abstract: We introduce a two-type first passage percolation competition model on infinite connected graphs as follows. Type 1 spreads through the edges of the graph at rate 1 from a single distinguished site, while all other sites are initially vacant. Once a site is occupied by type 1, it converts to type 2 at rate $\rho>0$. Sites occupied by type 2 then spread at rate $\lambda>0$ through vacant sites \emph{and} sites occupied by type 1, whereas type 1 can only spread through vacant sites. If the set of sites occupied by type 1 is non-empty at all times, we say type 1 \emph{survives}. In the case of a regular $d$-ary tree for $d\geq 3$, we show type 1 can survive when it is slower than type 2, provided $\rho$ is small enough. This is in contrast to when the underlying graph is $\mathbb{Z}^d$, where for any $\rho>0$, type 1 dies out almost surely if $\lambda>1$.


title: Self-Supervised Graph Co-Training for Session-based Recommendation

abstract: Session-based recommendation targets next-item prediction by exploiting user behaviors within a short time period. Compared with other recommendation paradigms, session-based recommendation suffers more from the problem of data sparsity due to the very limited short-term interactions. Self-supervised learning, which can discover ground-truth samples from the raw data, holds vast potentials to tackle this problem. However, existing self-supervised recommendation models mainly rely on item/segment dropout to augment data, which are not fit for session-based recommendation because the dropout leads to sparser data, creating unserviceable self-supervision signals. In this paper, for informative session-based data augmentation, we combine self-supervised learning with co-training, and then develop a framework to enhance session-based recommendation. Technically, we first exploit the session-based graph to augment two views that exhibit the internal and external connectivities of sessions, and then we build two distinct graph encoders over the two views, which recursively leverage the different connectivity information to generate ground-truth samples to supervise each other by contrastive learning. In contrast to the dropout strategy, the proposed self-supervised graph co-training preserves the complete session information and fulfills genuine data augmentation. Extensive experiments on multiple benchmark datasets show that, session-based recommendation can be remarkably enhanced under the regime of self-supervised graph co-training, achieving the state-of-the-art performance.


title: Taming the Beast: Learning to Control Neural Conversational Models

abstract: This thesis investigates the controllability of deep learning-based, end-to-end, generative dialogue systems in both task-oriented and chit-chat scenarios. In particular, we study the different aspects of controlling generative dialogue systems, including controlling styles and topics and continuously adding and combining dialogue skills. In the three decades since the first dialogue system was commercialized, the basic architecture of such systems has remained substantially unchanged, consisting of four pipelined basic components, namely, natural language understanding (NLU), dialogue state tracking (DST), a dialogue manager (DM) and natural language generation (NLG). The dialogue manager, which is the critical component of the modularized system, controls the response content and style. This module is usually programmed by rules and is designed to be highly controllable and easily extendable. With the emergence of powerful "deep learning" architectures, end-to-end generative dialogue systems have been proposed to optimize overall system performance and simplify training. However, these systems cannot be easily controlled and extended as the modularized dialogue manager can. This is because a single neural system is used, which is usually a large pre-trained language model (e.g., GPT-2), and thus it is hard to surgically change desirable attributes (e.g., style, topics, etc.). More importantly, uncontrollable dialogue systems can generate offensive and even toxic responses. Therefore, in this thesis, we study controllable methods for end-to-end generative dialogue systems in task-oriented and chit-chat scenarios. Throughout the chapters, we describe 1) how to control the style and topics of chit-chat models, 2) how to continuously control and extend task-oriented dialogue systems, and 3) how to compose and control multi-skill dialogue models.


title: A LOFAR-uGMRT spectral index study of distant radio halos

abstract: Context. Radio halos are megaparsec-scale diffuse radio sources{ mostly} located at the centres of merging galaxy clusters. The common mechanism invoked to explain their origin is the re-acceleration of relativistic particles caused by large-scale turbulence. Aims. Current re-acceleration models predict that a significant number of halos at high redshift should be characterised by very steep spectra ($\alpha<-1.5$) because of increasing inverse Compton energy losses. In this paper, we investigate the spectral index properties of a sample of nine clusters selected from the second Planck Sunyaev-Zel'dovich catalogue showing diffuse radio emission with the Low Frequency Array (LOFAR) in the 120-168 MHz band. This is the first time that radio halos discovered at low frequencies are followed up at higher frequencies. Methods. We analysed upgraded Giant Metrewave Radio Telescope (uGMRT) observations in Bands 3 and 4, that is, 250-500 and 550-900 MHz respectively. These observations were combined with existing LOFAR data to obtain information on the spectral properties of the diffuse radio emission. Results. We find diffuse radio emission in the uGMRT observations for five of the nine high-$z$ radio halos previously discovered with LOFAR. For those, we measure spectral indices in the range of $-1$ to $-1.4$. For the uGMRT non-detections, we estimated that the halos should have a spectral index steeper than $-1.5$. We also confirm the presence of one candidate relic. Conclusions. Despite the small number of clusters, we find evidence that about half of the massive and merging clusters at high redshift host radio halos with a very steep spectrum. This is in line with theoretical predictions, although larger statistical samples are necessary to test models.


title: Traveling waves for the porous medium equation in the incompressible limit: asymptotic behavior and nonlinear stability

abstract: In this study, we analyze the behavior of monotone traveling waves of a one-dimensional porous medium equation modeling mechanical properties of living tissues. We are interested in the asymptotics where the pressure, which governs the diffusion process and limits the creation of new cells, becomes very stiff, and the porous medium equation degenerates towards a free boundary problem of Hele-Shaw type. This is the so-called incompressible limit. The solutions of the limit Hele-Shaw problem then couple "free dynamics" with zero pressure, and "incompressible dynamics" with positive pressure and constant density. In the first part of the work, we provide a refined description of the traveling waves for the porous medium equation in the vicinity of the transition between the free domain and the incompressible domain. The second part of the study is devoted to the analysis of the stability of the traveling waves. We prove that the linearized system enjoys a spectral gap property in suitable weighted $L^2$ spaces, and we give quantitative estimates on the rate of decay of solutions. The nonlinear terms are treated perturbatively, using an $L^\infty$ control stemming from the maximum principle. As a consequence, we prove that traveling waves are stable under small perturbations.


title: Coherence and flow-maximization of a one-way valve

abstract: We consider a mathematical model for the gas flow through a one-way valve and focus on two issues. First, we propose a way to eliminate the chattering (the fast switch on and off of the valve) by slightly modifying the design of the valve. This mathematically amounts to the construction of a coupling Riemann solver with a suitable stability property, namely, coherence. We provide a numerical comparison of the behavior of the two valves. Second, we analyze, both analytically and numerically, for several significative situations, the maximization of the flow through the modified valve according to a control parameter of the valve and time.


title: An Efficient ADER-DG Local Time Stepping Scheme for 3D HPC Simulation of Seismic Waves in Poroelastic Media

abstract: Many applications from geosciences require simulations of seismic waves in porous media. Biot's theory of poroelasticity describes the coupling between solid and fluid phases and introduces a stiff source term, thereby increasing computational cost and motivating efficient methods utilising High-Performance Computing. We present a novel realisation of the discontinuous Galerkin scheme with Arbitrary DERivative time stepping (ADER-DG) that copes with stiff source terms. To integrate this source term with a reasonable time step size, we use an element-local space-time predictor, which needs to solve medium-sized linear systems - with 1000 to 10000 unknowns - in each element update (i.e., billions of times). We present a novel block-wise back-substitution algorithm for solving these systems efficiently. In comparison to LU decomposition, we reduce the number of floating-point operations by a factor of up to 25. The block-wise back-substitution is mapped to a sequence of small matrix-matrix multiplications, for which code generators are available to generate highly optimised code. We verify the new solver thoroughly in problems of increasing complexity. We demonstrate high-order convergence for 3D problems. We verify the correct treatment of point sources, material interfaces and traction-free boundary conditions. In addition, we compare against a finite difference code for a newly defined layer over half-space problem. We find that extremely high accuracy is required to resolve the slow P-wave at a free surface, while solid particle velocities are not affected by coarser resolutions. By using a clustered local time stepping scheme, we reduce time to solution by a factor of 6 to 10 compared to global time stepping. We conclude our study with a scaling and performance analysis, demonstrating our implementation's efficiency and its potential for extreme-scale simulations.

categories: cs.DC cs.MS physics.comp-ph physics.geo-ph


title: sigmoidF1: A Smooth F1 Score Surrogate Loss for Multilabel Classification

abstract: Multiclass multilabel classification is the task of attributing multiple labels to examples via predictions. Current models formulate a reduction of the multilabel setting into either multiple binary classifications or multiclass classification, allowing for the use of existing loss functions (sigmoid, cross-entropy, logistic, etc.). Multilabel classification reductions do not accommodate for the prediction of varying numbers of labels per example and the underlying losses are distant estimates of the performance metrics. We propose a loss function, sigmoidF1, which is an approximation of the F1 score that (1) is smooth and tractable for stochastic gradient descent, (2) naturally approximates a multilabel metric, and (3) estimates label propensities and label counts. We show that any confusion matrix metric can be formulated with a smooth surrogate. We evaluate the proposed loss function on text and image datasets, and with a variety of metrics, to account for the complexity of multilabel classification evaluation. sigmoidF1 outperforms other loss functions on one text and two image datasets and several metrics. These results show the effectiveness of using inference-time metrics as loss functions for non-trivial classification problems like multilabel classification.


title: Image-based Insider Threat Detection via Geometric Transformation

abstract: Insider threat detection has been a challenging task over decades, existing approaches generally employ the traditional generative unsupervised learning methods to produce normal user behavior model and detect significant deviations as anomalies. However, such approaches are insufficient in precision and computational complexity. In this paper, we propose a novel insider threat detection method, Image-based Insider Threat Detector via Geometric Transformation (IGT), which converts the unsupervised anomaly detection into supervised image classification task, and therefore the performance can be boosted via computer vision techniques. To illustrate, our IGT uses a novel image-based feature representation of user behavior by transforming audit logs into grayscale images. By applying multiple geometric transformations on these behavior grayscale images, IGT constructs a self-labelled dataset and then train a behavior classifier to detect anomaly in self-supervised manner. The motivation behind our proposed method is that images converted from normal behavior data may contain unique latent features which keep unchanged after geometric transformation, while malicious ones cannot. Experimental results on CERT dataset show IGT outperforms the classical autoencoder-based unsupervised insider threat detection approaches, and improves the instance and user based Area under the Receiver Operating Characteristic Curve (AUROC) by 4% and 2%, respectively.


title: Auto-Parsing Network for Image Captioning and Visual Question Answering

abstract: We propose an Auto-Parsing Network (APN) to discover and exploit the input data's hidden tree structures for improving the effectiveness of the Transformer-based vision-language systems. Specifically, we impose a Probabilistic Graphical Model (PGM) parameterized by the attention operations on each self-attention layer to incorporate sparse assumption. We use this PGM to softly segment an input sequence into a few clusters where each cluster can be treated as the parent of the inside entities. By stacking these PGM constrained self-attention layers, the clusters in a lower layer compose into a new sequence, and the PGM in a higher layer will further segment this sequence. Iteratively, a sparse tree can be implicitly parsed, and this tree's hierarchical knowledge is incorporated into the transformed embeddings, which can be used for solving the target vision-language tasks. Specifically, we showcase that our APN can strengthen Transformer based networks in two major vision-language tasks: Captioning and Visual Question Answering. Also, a PGM probability-based parsing algorithm is developed by which we can discover what the hidden structure of input is during the inference.


title: Communication Modes with Large Intelligent Surfaces in the Near Field

abstract: This paper proposes a practical method for the definition of communication modes when antennas operate in the near-field region, by realizing ad-hoc beams exploiting the focusing capability of large antennas. The beamspace modeling proposed to define the communication modes is then exploited to derive expressions for their number (i.e., the degrees of freedom) in a generic setup, beyond the traditional paraxial scenario, together with closed-form definitions for the basis set at the transmitting and receiving antennas for several cases of interest, such as for the communication between a large antenna and a small antenna. Numerical results show that quasi-optimal communication can be obtained starting from focusing functions. This translates into the possibility of a significant enhancement of the channel capacity even in line-of-sight channel condition, without the need of implementing optimal but complex phase/amplitude profiles on transmitting/receiving antennas as well as resorting to intensive numerical solutions. Traditional results valid under paraxial approximation are revised in light of the proposed modeling, showing that similar conclusions can be obtained from different perspectives.


title: METRO: A Software-Hardware Co-Design of Interconnections for Spatial DNN Accelerators

abstract: Tiled spatial architectures have proved to be an effective solution to build large-scale DNN accelerators. In particular, interconnections between tiles are critical for high performance in these tile-based architectures. In this work, we identify the inefficiency of the widely used traditional on-chip networks and the opportunity of software-hardware co-design. We propose METRO with the basic idea of decoupling the traffic scheduling policies from hardware fabrics and moving them to the software level. METRO contains two modules working in synergy: METRO software scheduling framework to coordinate the traffics and METRO hardware facilities to deliver the data based on software configurations. We evaluate the co-design using different flit sizes for synthetic study, illustrating its effectiveness under various hardware resource constraints, in addition to a wide range of DNN models selected from real-world workloads. The results show that METRO achieves 56.3% communication speedup on average and up to 73.6% overall processing time reduction compared with traditional on-chip network designs.


title: Envelope theorems for static optimization and calculus of variations

abstract: We establish differentiability properties of the value function of problems of Static Optimization in an abstract infinite dimensional setting and we apply that to problems of Calculus of Variations. We lighten the assumptions of existing results, notably by using G{\^a}teaux and Hadamard differentials. Moreover we use recently established Multipliers Rules.


title: Optimal UAV Hitching on Ground Vehicles

abstract: Due to its mobility and agility, unmanned aerial vehicle (UAV) has emerged as a promising technology for various tasks, such as sensing, inspection and delivery. However, a typical UAV has limited energy storage and cannot fly a long distance without being recharged. This motivates several existing proposals to use trucks and other ground vehicles to offer riding to help UAVs save energy and expand the operation radius. We present the first theoretical study regarding how UAVs should optimally hitch on ground vehicles, considering vehicles' different travelling patterns and supporting capabilities. For a single UAV, we derive closed-form optimal vehicle selection and hitching strategy. When vehicles only support hitching, a UAV would prefer the vehicle that can carry it closest to its final destination. When vehicles can offer hitching plus charging, the UAV may hitch on a vehicle that carries it farther away from its destination and hitch a longer distance. The UAV may also prefer to hitch on a slower vehicle for the benefit of battery recharging. For multiple UAVs in need of hitching, we develop the max-saving algorithm (MSA) to optimally match UAV-vehicle collaboration. We prove that the MSA globally optimizes the total hitching benefits for the UAVs.


title: The staircase property: How hierarchical structure can guide deep learning

abstract: This paper identifies a structural property of data distributions that enables deep neural networks to learn hierarchically. We define the "staircase" property for functions over the Boolean hypercube, which posits that high-order Fourier coefficients are reachable from lower-order Fourier coefficients along increasing chains. We prove that functions satisfying this property can be learned in polynomial time using layerwise stochastic coordinate descent on regular neural networks -- a class of network architectures and initializations that have homogeneity properties. Our analysis shows that for such staircase functions and neural networks, the gradient-based algorithm learns high-level features by greedily combining lower-level features along the depth of the network. We further back our theoretical results with experiments showing that staircase functions are also learnable by more standard ResNet architectures with stochastic gradient descent. Both the theoretical and experimental results support the fact that staircase properties have a role to play in understanding the capabilities of gradient-based learning on regular networks, in contrast to general polynomial-size networks that can emulate any SQ or PAC algorithms as recently shown.


title: Spectral Efficiency Analysis of Cell-free Distributed Massive MIMO Systems with Imperfect Covariance Matrix

abstract: In this paper, the impacts of imperfect channel covariance matrix on the spectral efficiency (SE) of cell-free distributed massive multiple-input multiple-output (MIMO) systems are analyzed. We propose to estimate the channel covariance matrix by alternately using the assigned pilots and their phase-shifted pilots in different coherent blocks, which improves the accuracy of channel estimation with imperfect covariance matrix and reduces pilot overhead. Under this scheme, the closed-form expressions of SE with maximum ratio combination (MRC) and zero-forcing (ZF) receivers are derived, which enables us to select key parameters for better system performance. Simulation results verify the effectiveness of the proposed channel estimation method and the accuracy of the derived closed-form expressions. When more coherent blocks are used to estimate the covariance matrix, we can get better system performance. Moreover, some insightful conclusions are arrived at from the SE comparisons between different receiving schemes (ZF and MRC) and different pilot allocation schemes (orthogonal pilot and pilot reuse).


title: Label-free chip-based evanescent light scattering super-resolution and superior-contrast optical microscopy (cELS)

abstract: Chip-based Evanescent Light Scattering (cELS) utilizes the multiple modes of a high-index contrast optical waveguide for near-field illumination of unlabeled samples, thereby repositioning the highest spatial frequencies of the sample into the far-field. The multiple modes scattering off the sample with different phase differences is engineered to have random spatial distributions within the integration time of the camera, mitigating the coherent speckle noise. This enables label-free superior-contrast imaging of weakly scattering nanosized specimens such as extra-cellular vesicles (EVs) and liposomes, dynamics of living HeLa cells etc. The article explains and validates experimentally the physics behind cELS by demonstrating a multi-moded straight waveguide as a partially coherent light source. For isotropic super-resolution, spatially incoherent light engineered via multiple-arms waveguide chip and intensity-fluctuation based algorithms are used. The proof-of-concept results are demonstrated on 100 nm polystyrene beads and resolution improvement of close to 2X is shown. cELS also realizes (2-10)X more contrast as opposed to conventional imaging techniques. In addition, cELS platform is miniaturized and enables large field-of-view imaging compared to state of the art label-free techniques. cELS holds a potential for label-free super-resolution imaging of nanosized biological specimens at high-throughput.


title: Support-Set Based Cross-Supervision for Video Grounding

abstract: Current approaches for video grounding propose kinds of complex architectures to capture the video-text relations, and have achieved impressive improvements. However, it is hard to learn the complicated multi-modal relations by only architecture designing in fact. In this paper, we introduce a novel Support-set Based Cross-Supervision (Sscs) module which can improve existing methods during training phase without extra inference cost. The proposed Sscs module contains two main components, i.e., discriminative contrastive objective and generative caption objective. The contrastive objective aims to learn effective representations by contrastive learning, while the caption objective can train a powerful video encoder supervised by texts. Due to the co-existence of some visual entities in both ground-truth and background intervals, i.e., mutual exclusion, naively contrastive learning is unsuitable to video grounding. We address the problem by boosting the cross-supervision with the support-set concept, which collects visual information from the whole video and eliminates the mutual exclusion of entities. Combined with the original objectives, Sscs can enhance the abilities of multi-modal relation modeling for existing approaches. We extensively evaluate Sscs on three challenging datasets, and show that our method can improve current state-of-the-art methods by large margins, especially 6.35% in terms of R1@0.5 on Charades-STA.


title: A multiple time renewal equation for neural assemblies with elapsed time model

abstract: We introduce and study an extension of the classical elapsed time equation in the context of neuron populations that are described by the elapsed time since the last discharge, i.e., the refractory period. In this extension we incorporate the elapsed since the penultimate discharge and we obtain a more complex system of integro-differential equations. For this new system we prove convergence to stationary state by means of Doeblin's theory in the case of weak non-linearities in an appropriate functional setting, inspired by the case of the classical elapsed time equation. Moreover, we present some numerical simulations to observe how different firing rates can give different types of behaviors and to contrast them with theoretical results of both classical and extended models.


title: Finite-difference approximation of the inverse Sturm-Liouville problem with frozen argument

abstract: This paper deals with the discrete system being the finite-difference approximation of the Sturm-Liouville problem with frozen argument. The inverse problem theory is developed for this discrete system. We describe the two principal cases: degenerate and non-degenerate. For these two cases, appropriate inverse problems statements are provided, uniqueness theorems are proved, and reconstruction algorithms are obtained. Moreover, the relationship between the eigenvalues of the continuous problem and its finite-difference approximation is investigated. We obtain the "correction terms" for approximation of the discrete problem eigenvalues by using the eigenvalues of the continuous problem. Relying on these results, we develop a numerical algorithm for recovering the potential of the Sturm-Liouville operator with frozen argument from a finite set of eigenvalues. The effectiveness of this algorithm is illustrated by numerical examples.


title: Lossy Medical Image Compression using Residual Learning-based Dual Autoencoder Model

abstract: In this work, we propose a two-stage autoencoder based compressor-decompressor framework for compressing malaria RBC cell image patches. We know that the medical images used for disease diagnosis are around multiple gigabytes size, which is quite huge. The proposed residual-based dual autoencoder network is trained to extract the unique features which are then used to reconstruct the original image through the decompressor module. The two latent space representations (first for the original image and second for the residual image) are used to rebuild the final original image. Color-SSIM has been exclusively used to check the quality of the chrominance part of the cell images after decompression. The empirical results indicate that the proposed work outperformed other neural network related compression technique for medical images by approximately 35%, 10% and 5% in PSNR, Color SSIM and MS-SSIM respectively. The algorithm exhibits a significant improvement in bit savings of 76%, 78%, 75% & 74% over JPEG-LS, JP2K-LM, CALIC and recent neural network approach respectively, making it a good compression-decompression technique.


title: Detection of Criminal Texts for the Polish State Border Guard

abstract: This paper describes research on the detection of Polish criminal texts appearing on the Internet. We carried out experiments to find the best available setup for the efficient classification of unbalanced and noisy data. The best performance was achieved when our model was fine-tuned on a pre-trained Polish-based transformer language model. For the detection task, a large corpus of annotated Internet snippets was collected as training data. We share this dataset and create a new task for the detection of criminal texts using the Gonito platform as the benchmark.


title: Higher-order ferromagnetic resonances in periodic arrays of synthetic-antiferromagnet nanodiscs

abstract: We investigate spin dynamics in nanodisc arrays of synthetic-antiferromagnets (SAF) made of Py/NiCu/Py trilayers, where the NiCu spacer undergoes a Curie transition at about 200 K. The observed ferromagnetic resonance spectra have three distinct resonance modes at room temperature, which are fully recreated in our micromagnetic simulations showing also how the intra-SAF asymmetry can be used to create and control the higher-order resonances in the structure. Below the Curie temperature of the spacer, the system effectively transitions into a single-layer nanodisc array with only two resonance modes. Our results show how multi-layering of nano-arrays can add tunable GHz functionality relevant for such rapidly developing fields as magnetic meta-materials, magnonic crystals, arrays of spin-torque oscillators and neuromorphic junctions.


title: Full-Spin-Wave-Scaled Finite Element Stochastic Micromagnetism: Mesh-Independent FUSSS LLG Simulations of Ferromagnetic Resonance and Reversal

abstract: In this paper, we address the problem that standard stochastic Landau-Lifshitz-Gilbert (sLLG) simulations typically produce results that show unphysical mesh-size dependence. The root cause of this problem is that the effects of spin wave fluctuations are ignored in sLLG. We propose to represent the effect of these fluctuations by a "FUll-Spinwave-Scaled Stochastic LLG", or FUSSS LLG method. In FUSSS LLG, the intrinsic parameters of the sLLG simulations are first scaled by scaling factors that integrate out the spin wave fluctuations up to the mesh size, and the sLLG simulation is then performed with these scaled parameters. We developed FUSSS LLG by studying the Ferromagnetic Resonance (FMR) in Nd$_2$Fe$_{14}$B cubes. The nominal scaling greatly reduced the mesh size dependence relative to sLLG. We further discovered that adjusting one scaling exponent by less than 10% delivered fully mesh-size-independent results for the FMR peak. We then performed three tests and validations of our FUSSS LLG with this modified scaling. 1) We studied the same FMR but with magnetostatic fields included. 2) We simulated the total magnetization of the Nd$_2$Fe$_{14}$B cube. 3) We studied the effective, temperature- and sweeping rate-dependent coercive field of the cubes. In all three cases we found that FUSSS LLG delivered essentially mesh-size-independent results, which tracked the theoretical expectations better than unscaled sLLG. Motivated by these successful validations, we propose that FUSSS LLG provides marked, qualitative progress towards accurate, high precision modeling of micromagnetics in hard, permanent magnets.


title: A 2-stage elastic net algorithm for estimation of sparse networks with heavy tailed data

abstract: We propose a new 2-stage procedure that relies on the elastic net penalty to estimate a network based on partial correlations when data are heavy-tailed. The new estimator allows to consider the lasso penalty as a special case. Using Monte Carlo simulations, we test the performance on several underlying network structures and four different multivariate distributions: Gaussian, t-Student with 3 and 20 degrees of freedom and contaminated Gaussian. Simulation analysis shows that the 2-stage estimator performs best for heavy-tailed data and it is also robust to distribution misspecification, both in terms of identification of the sparsity patterns and numerical accuracy. Empirical results on real-world data focus on the estimation of the European banking network during the Covid-19 pandemic. We show that the new estimator can provide interesting insights both for the development of network indicators, such as network strength, to identify crisis periods and for the detection of banking network properties, such as centrality and level of interconnectedness, that might play a relevant role in setting up adequate risk management and mitigation tools.


title: State estimation for aoristic models

abstract: Aoristic data can be described by a marked point process in time in which the points cannot be observed directly but are known to lie in observable intervals, the marks. We consider Bayesian state estimation for the latent points when the marks are modelled in terms of an alternating renewal process in equilibrium and the prior is a Markov point point process. We derive the posterior distribution, estimate its parameters and present some examples that illustrate the influence of the prior distribution.


title: Learning Spatiotemporal Occupancy Grid Maps for Lifelong Navigation in Dynamic Scenes

abstract: We present a novel method for generating, predicting, and using Spatiotemporal Occupancy Grid Maps (SOGM), which embed future information of dynamic scenes. Our automated generation process creates groundtruth SOGMs from previous navigation data. We build on prior work to annotate lidar points based on their dynamic properties, which are then projected on time-stamped 2D grids: SOGMs. We design a 3D-2D feedforward architecture, trained to predict the future time steps of SOGMs, given 3D lidar frames as input. Our pipeline is entirely self-supervised, thus enabling lifelong learning for robots. The network is composed of a 3D back-end that extracts rich features and enables the semantic segmentation of the lidar frames, and a 2D front-end that predicts the future information embedded in the SOGMs within planning. We also design a navigation pipeline that uses these predicted SOGMs. We provide both quantitative and qualitative insights into the predictions and validate our choices of network design with a comparison to the state of the art and ablation studies.


title: Topological Models of Abstract Commensurators

abstract: The full solenoid over a topological space $X$ is the inverse limit of all finite covers. When $X$ is a compact Hausdorff space admitting a locally path connected universal cover, we relate the pointed homotopy equivalences of the full solenoid to the abstract commensurator of the fundamental group $\pi_1(X)$. The relationship is an isomorphism when $X$ is an aspherical CW complex. If $X$ is additionally a geodesic metric space and $\pi_1(X)$ is residually finite, we show that this topological model is compatible with the realization of the abstract commensurator as a subgroup of the quasi-isometry group of $\pi_1(X)$. This is a general topological analogue of work of Biswas, Nag, Odden, Sullivan, and others on the universal hyperbolic solenoid, the full solenoid over a closed surface of genus at least two.


title: Pooling Architecture Search for Graph Classification

abstract: Graph classification is an important problem with applications across many domains, like chemistry and bioinformatics, for which graph neural networks (GNNs) have been state-of-the-art (SOTA) methods. GNNs are designed to learn node-level representation based on neighborhood aggregation schemes, and to obtain graph-level representation, pooling methods are applied after the aggregation operation in existing GNN models to generate coarse-grained graphs. However,due to highly diverse applications of graph classification, and the performance of existing pooling methods vary on different graphs. In other words, it is a challenging problem to design a universal pooling architecture to perform well in most cases, leading to a demand for data-specific pooling methods in real-world applications. To address this problem, we propose to use neural architecture search (NAS) to search for adaptive pooling architectures for graph classification. Firstly we designed a unified framework consisting of four modules: Aggregation, Pooling, Readout, and Merge, which can cover existing human-designed pooling methods for graph classification. Based on this framework, a novel search space is designed by incorporating popular operations in human-designed architectures. Then to enable efficient search, a coarsening strategy is proposed to continuously relax the search space, thus a differentiable search method can be adopted. Extensive experiments on six real-world datasets from three domains are conducted, and the results demonstrate the effectiveness and efficiency of the proposed framework.


title: Long-duration transient, gravitational-wave search pipeline

abstract: As the sensitivity and observing time of gravitational-wave detectors increase, a more diverse range of signals is expected to be observed from a variety of sources. Especially, long-lived gravitational-wave transients have received interest in the last decade. Because most of long-duration signals are poorly modeled, detection must rely on generic search algorithms, which make few or no assumption on the nature of the signal. However, the computational cost of those searches remains a limiting factor, which leads to sub-optimal sensitivity. Several detection algorithms have been developed to cope with this issue. In this paper, we present a new data analysis pipeline to search for un-modeled long-lived transient gravitational-wave signals with duration between 10 and 1000 s, based on an excess cross-power statistic in a network of detectors. The pipeline implements several new features that are intended to reduce computational cost and increase detection sensitivity for a wide range of signal morphologies. The method is generalized to a network of an arbitrary number of detectors and aims to provide a stable interface for further improvements. Comparisons with a previous implementation of a similar method on simulated and real gravitational-wave data show an overall increase in detection efficiency depending on the signal morphology, and a computing time reduced by at least a factor 10.


title: Optimal Control of a SIR Epidemic With ICU Constraints and Target Objectives

abstract: The aim of this paper is to provide a rigorous mathematical analysis of an optimal control problem with SIR dynamics. The main feature of our study is the presence of state constraints (related to intensive care units ICU capacity) and strict target objectives (related to the immunity threshold). The first class of results provides a comprehensive description of different zones of interest using viability tools. The second achievement is a thorough mathematical analysis of Pontryagin extremals for the aforementioned problem allowing to obtain an explicit closed-loop feedback optimal control. All our theoretical results are numerically illustrated for a further understanding of the geometrical features and scenarios.


title: Discrete Boltzmann Modeling of Plasma Shock Wave

abstract: Plasma shock waves widely exist and play an important role in high-energy-density environment, especially in the inertial confinement fusion. Due to the large gradient of macroscopic physical quantities and the coupled thermal, electrical, magnetic and optical phenomena, there exist not only hydrodynamic non-equilibrium (HNE) effects, but also strong thermodynamic non-equilibrium (TNE) effects around the wavefront. In this work, a two-dimensional single-fluid discrete Boltzmann model is proposed to investigate the physical structure of ion shock. The electron is assumed inertialess and always in thermodynamic equilibrium. The Rankine-Hugoniot relations for single fluid theory of plasma shock wave is derived. It is found that the physical structure of shock wave in plasma is significantly different from that in normal fluid and somewhat similar to that of detonation wave from the sense that a peak appears in the front. The non-equilibrium effects around the shock front become stronger with increasing Mach number. The charge of electricity deviates oppositely from neutrality in upstream and downstream of the shock wave. The large inertia of the ions causes them to lag behind, so the wave front charge is negative and the wave rear charge is positive. The variations of HNE and TNE with Mach number are numerically investigated. The characteristics of TNE can be used to distinguish plasma shock wave from detonation wave.

categories: physics.plasm-ph cond-mat.mes-hall cond-mat.stat-mech physics.comp-ph physics.flu-dyn


title: Communication-hiding pipelined BiCGSafe methods for solving large linear systems

abstract: Recently, a new variant of the BiCGStab method, known as the pipeline BiCGStab, has been proposed. This method can achieve a higher degree of scalability and speed-up rates through a mechanism in which the communication phase for the computation of the inner product can be overlapped with the computation of the matrix-vector product. On the other hand, there exist several generalized iteration methods with better convergence behavior than BiCGStab such as ssBiCGSafe, BiCGSafe, GPBi-CG. Of these methods, ssBiCGSafe, which requires a single phase of computing inner products per one iteration, is best suited for high-performance computing systems. In this paper, inspired by the success of the pipelined BiCGStab method, we propose variations of the ssBiCGSafe method, in which only one phase of inner product computation per iteration is required and this inner product computation phase can be overlapped with the matrix-vector computation. Through numerical experiments, we show that the proposed methods lead to improvements in convergence behavior and execution time compared to the pipelined BiCGStab and ssBiCGSafe methods.


title: Relative Cauchy evolution for linear homotopy AQFTs

abstract: This paper develops a concept of relative Cauchy evolution for the class of homotopy algebraic quantum field theories (AQFTs) that are obtained by canonical commutation relation quantization of Poisson chain complexes. The key element of the construction is a rectification theorem proving that the homotopy time-slice axiom, which is a higher categorical relaxation of the time-slice axiom of AQFT, can be strictified for theories in this class. The general concept is illustrated through a detailed study of the relative Cauchy evolution for the homotopy AQFT associated with linear Yang-Mills theory, for which the usual stress-energy tensor is recovered.


title: Uniform approximation of continuous couplings

abstract: We study the approximation of non-negative multi-variate couplings in the uniform norm while matching given single-variable marginal constraints.


title: State-clustering method of payoff computation in repeated multiplayer games

abstract: Direct reciprocity is a well-known mechanism that could explain how cooperation emerges and prevails in an evolving population. Numerous prior researches have studied the emergence of cooperation in multiplayer games. However, most of them use numerical or experimental methods, not theoretical analysis. This lack of theoretical works on the evolution of cooperation is due to the high complexity of calculating payoffs. In this paper, we propose a new method, namely, the state-clustering method to calculate the long-term payoffs in repeated games. Using this method, in an $n$-player repeated game, the computing complexity is reduced from $O(2^n)$ to $O(n^2)$, which makes it possible to compute a large-scale repeated game's payoff. We explore the evolution of cooperation in both infinitely and finitely repeated public goods games as an example to show the effectiveness of our method. In both cases, we find that when the synergy factor is sufficiently large, the increasing number of participants in a game is detrimental to the evolution of cooperation. Our work provides a theoretical approach to study the evolution of cooperation in repeated multiplayer games.


title: A Generalized Knockoff Procedure for FDR Control in Structural Change Detection

abstract: Controlling false discovery rate (FDR) is crucial for variable selection, multiple testing, among other signal detection problems. In literature, there is certainly no shortage of FDR control strategies when selecting individual features, but the relevant works for structural change detection, such as profile analysis for piecewise constant coefficients and integration analysis with multiple data sources, are limited. In this paper, we propose a generalized knockoff procedure (GKnockoff) for FDR control under such problem settings. We prove that the GKnockoff possesses pairwise exchangeability, and is capable of controlling the exact FDR under finite sample sizes. We further explore GKnockoff under high dimensionality, by first introducing a new screening method to filter the high-dimensional potential structural changes. We adopt a data splitting technique to first reduce the dimensionality via screening and then conduct GKnockoff on the refined selection set. Furthermore, the powers of proposed methods are systematically studied. Numerical comparisons with other methods show the superior performance of GKnockoff, in terms of both FDR control and power. We also implement the proposed methods to analyze a macroeconomic dataset for detecting changes of driven effects of economic development on the secondary industry.


title: A second order difference scheme for time fractional diffusion equation with generalized memory kernel

abstract: In the current work we build a difference analog of the Caputo fractional derivative with generalized memory kernel ($_\lambda$L2-1$_\sigma$ formula). The fundamental features of this difference operator are studied and on its ground some difference schemes generating approximations of the second order in time for the generalized time-fractional diffusion equation with variable coefficients are worked out. We have proved stability and convergence of the given schemes in the grid $L_2$ - norm with the rate equal to the order of the approximation error. The achieved results are supported by the numerical computations performed for some test problems.


title: Causal sparse domination of Beurling maximal regularity operators

abstract: We prove boundedness of Calder\'on-Zygmund operators acting in Banach functions spaces on domains, defined by the $L_1$ Carleson functional and $L_q$ ($1<q<\infty$) Whitney averages. For such bounds to hold, we assume that the operator maps towards the boundary of the domain. We obtain the Carleson estimates by proving a pointwise domination of the operator, by sparse operators with a causal structure. The work is motivated by maximal regularity estimates for elliptic PDEs and is related to one-sided weighted estimates for singular integrals.


title: Coherence and de-coherence in the Time-Resolved ARPES of realistic materials: an ab-initio perspective

abstract: Coherence and de-coherence are the most fundamental steps that follow the initial photo-excitation occurring in typical Pump&Probe experiments. Indeed, the initial external laser pulse transfers coherence to the system in terms of creation of multiple electron-hole pairs excitation. The excitation concurs both to the creation of a finite carriers density and to the appearance of induced electromagnetic fields. The two effects, to a very first approximation, can be connected to the simple concepts of populations and oscillations. The dynamics of the system following the initial photo-excitation is, thus, entirely dictated by the interplay between coherence and de-coherence. This interplay and the de-coherence process itself, is due to the correlation effects stimulated by the photo-excitation. Single-particle, like the electron-phonon, and two-particles, like the electron-electron, scattering processes induce a complex dynamics of the electrons that, in turn, makes the description of the correlated and photo-excited system in terms of pure excitonic and/or carriers populations challenging.


title: Quasiparticle band-gap renormalization in doped monolayer MoS$_2$

abstract: The quasiparticle band-gap renormalization induced by the doped carriers is an important and well-known feature in two-dimensional semiconductors, including transition-metal dichalcogenides (TMDs), and it is of both theoretical and practical interest. To get a quantitative understanding of this effect, here we calculate the quasiparticle band-gap renormalization of the electron-doped monolayer MoS$_2$, a prototypical member of TMDs. The many-body electron-electron interaction induced renormalization of the self-energy is found within the random phase approximation and to account for the quasi-2D character of the Coulomb interaction in this system a Keldysh-type interaction with a nonlocal dielectric constant is used. Considering the renormalization of both the valence and the conduction bands, our calculations reveal a large and nonlinear band-gap renormalization upon adding free carriers to the conduction band. We find a 410 meV reduction of the band gap for the monolayer MoS$_2$ on SiO$_2$ substrate at the free carrier density $n=4.9\times 10^{12} \rm{cm^{-2}}$ which is in excellent agreement with available experimental results. We also discuss the role of exchange and correlation parts of the self-energy on the overall band-gap renormalization of the system. The strong dependence of the band-gap renormalization on the surrounding dielectric environment is also demonstrated in this work, and a much larger shrinkage of the band gap is predicted for the freestanding monolayer MoS$_2$.


title: DeepSleepNet-Lite: A Simplified Automatic Sleep Stage Scoring Model with Uncertainty Estimates

abstract: Deep learning is widely used in the most recent automatic sleep scoring algorithms. Its popularity stems from its excellent performance and from its ability to directly process raw signals and to learn feature from the data. Most of the existing scoring algorithms exploit very computationally demanding architectures, due to their high number of training parameters, and process lengthy time sequences in input (up to 12 minutes). Only few of these architectures provide an estimate of the model uncertainty. In this study we propose DeepSleepNet-Lite, a simplified and lightweight scoring architecture, processing only 90-seconds EEG input sequences. We exploit, for the first time in sleep scoring, the Monte Carlo dropout technique to enhance the performance of the architecture and to also detect the uncertain instances. The evaluation is performed on a single-channel EEG Fpz-Cz from the open source Sleep-EDF expanded database. DeepSleepNet-Lite achieves slightly lower performance, if not on par, compared to the existing state-of-the-art architectures, in overall accuracy, macro F1-score and Cohen's kappa (on Sleep-EDF v1-2013 +/-30mins: 84.0%, 78.0%, 0.78; on Sleep-EDF v2-2018 +/-30mins: 80.3%, 75.2%, 0.73). Monte Carlo dropout enables the estimate of the uncertain predictions. By rejecting the uncertain instances, the model achieves higher performance on both versions of the database (on Sleep-EDF v1-2013 +/-30mins: 86.1.0%, 79.6%, 0.81; on Sleep-EDF v2-2018 +/-30mins: 82.3%, 76.7%, 0.76). Our lighter sleep scoring approach paves the way to the application of scoring algorithms for sleep analysis in real-time.


title: Non-classical nucleation of zinc oxide from a physically-motivated machine-learning approach

abstract: Observing non-classical nucleation pathways remains challenging in simulations of complex materials with technological interests. This is because it requires very accurate force fields that can capture the whole complexity of their underlying interatomic interactions and an advanced structural analysis. Here, we first report the construction of a machine-learning force field for zinc oxide interactions using the Physical LassoLars Interaction Potentials approach which allows us to be predictive even for untrained structures. Then, we carried out freezing simulations from a liquid and observed the crystal formation with atomistic precision. Our results, which are analyzed using a data-driven approach based on bond order parameters, demonstrate the presence of both prenucleation clusters and two-step nucleation scenarios thus retrieving seminal predictions of non-classical nucleation pathways made on much simpler models.

categories: cond-mat.mtrl-sci cond-mat.soft cond-mat.stat-mech physics.chem-ph physics.comp-ph


title: Overcoming the curse of dimensionality in the numerical approximation of backward stochastic differential equations

abstract: Backward stochastic differential equations (BSDEs) belong nowadays to the most frequently studied equations in stochastic analysis and computational stochastics. BSDEs in applications are often nonlinear and high-dimensional. In nearly all cases such nonlinear high-dimensional BSDEs cannot be solved explicitly and it has been and still is a very active topic of research to design and analyze numerical approximation methods to approximatively solve nonlinear high-dimensional BSDEs. Although there are a large number of research articles in the scientific literature which analyze numerical approximation methods for nonlinear BSDEs, until today there has been no numerical approximation method in the scientific literature which has been proven to overcome the curse of dimensionality in the numerical approximation of nonlinear BSDEs in the sense that the number of computational operations of the numerical approximation method to approximatively compute one sample path of the BSDE solution grows at most polynomially in both the reciprocal $1/ \varepsilon$ of the prescribed approximation accuracy $\varepsilon \in (0,\infty)$ and the dimension $d\in \mathbb N=\{1,2,3,\ldots\}$ of the BSDE. It is the key contribution of this article to overcome this obstacle by introducing a new Monte Carlo-type numerical approximation method for high-dimensional BSDEs and by proving that this Monte Carlo-type numerical approximation method does indeed overcome the curse of dimensionality in the approximative computation of solution paths of BSDEs.


title: Rotation-constrained optical see-through headset calibration withbare-hand alignment

abstract: The inaccessibility of user-perceived reality remains an open issue in pursuing the accurate calibration of optical see-through (OST) head-mounted displays (HMDs). Manual user alignment is usually required to collect a set of virtual-to-real correspondences, so that a default or an offline display calibration can be updated to account for the user's eye position(s). Current alignment-based calibration procedures usually require point-wise alignments between rendered image point(s) and associated physical landmark(s) of a target calibration tool. As each alignment can only provide one or a few correspondences, repeated alignments are required to ensure calibration quality. This work presents an accurate and tool-less online OST calibration method to update an offline-calibrated eye-display model. The user's bare hand is markerlessly tracked by a commercial RGBD camera anchored to the OST headset to generate a user-specific cursor for correspondence collection. The required alignment is object-wise, and can provide thousands of unordered corresponding points in tracked space. The collected correspondences are registered by a proposed rotation-constrained iterative closest point (rcICP) method to optimise the viewpoint-related calibration parameters. We implemented such a method for the Microsoft HoloLens 1. The resiliency of the proposed procedure to noisy data was evaluated through simulated tests and real experiments performed with an eye-replacement camera. According to the simulation test, the rcICP registration is robust against possible user-induced rotational misalignment. With a single alignment, our method achieves 8.81 arcmin (1.37 mm) positional error and 1.76 degree rotational error by camera-based tests in the arm-reach distance, and 10.79 arcmin (7.71 pixels) reprojection error by user tests.


title: Prompt-Learning for Fine-Grained Entity Typing

abstract: As an effective approach to tune pre-trained language models (PLMs) for specific tasks, prompt-learning has recently attracted much attention from researchers. By using \textit{cloze}-style language prompts to stimulate the versatile knowledge of PLMs, prompt-learning can achieve promising results on a series of NLP tasks, such as natural language inference, sentiment classification, and knowledge probing. In this work, we investigate the application of prompt-learning on fine-grained entity typing in fully supervised, few-shot and zero-shot scenarios. We first develop a simple and effective prompt-learning pipeline by constructing entity-oriented verbalizers and templates and conducting masked language modeling. Further, to tackle the zero-shot regime, we propose a self-supervised strategy that carries out distribution-level optimization in prompt-learning to automatically summarize the information of entity types. Extensive experiments on three fine-grained entity typing benchmarks (with up to 86 classes) under fully supervised, few-shot and zero-shot settings show that prompt-learning methods significantly outperform fine-tuning baselines, especially when the training data is insufficient.


title: Extracting Quantitative Dielectric Properties from Pump-Probe Spectroscopy

abstract: Optical pump-probe spectroscopy is a powerful tool for the study of non-equilibrium electronic dynamics and finds wide applications across a range of fields, from physics and chemistry to material science and biology. However, a shortcoming of conventional pump-probe spectroscopy is that photoinduced changes in transmission, reflection and scattering can simultaneously contribute to the measured differential spectra, leading to ambiguities in assigning the origin of spectral signatures and ruling out quantitative interpretation of the spectra. Ideally, these methods would measure the underlying dielectric function (or the complex refractive index) which would then directly provide quantitative information on the transient excited state dynamics free of these ambiguities. Here we present and test a model independent route to transform differential transmission or reflection spectra, measured via conventional optical pump-probe spectroscopy, to changes in the quantitative transient dielectric function. We benchmark this method against changes in the real refractive index measured using time-resolved Frequency Domain Interferometry in prototypical inorganic and organic semiconductor films. Our methodology can be applied to existing and future pump-probe data sets, allowing for an unambiguous and quantitative characterisation of the transient photoexcited spectra of materials. This in turn will accelerate the adoption of pump-probe spectroscopy as a facile and robust materials characterisation and screening tool.


title: Making Higher Order MOT Scalable: An Efficient Approximate Solver for Lifted Disjoint Paths

abstract: We present an efficient approximate message passing solver for the lifted disjoint paths problem (LDP), a natural but NP-hard model for multiple object tracking (MOT). Our tracker scales to very large instances that come from long and crowded MOT sequences. Our approximate solver enables us to process the MOT15/16/17 benchmarks without sacrificing solution quality and allows for solving MOT20, which has been out of reach up to now for LDP solvers due to its size and complexity. On all these four standard MOT benchmarks we achieve performance comparable or better than current state-of-the-art methods including a tracker based on an optimal LDP solver.


title: An Upper Bound of Composition Series

abstract: An upper bound of composition series of groups of finite order is obtained. The bound is a nontrivial bound and so far best possible.


title: Occlusion-robust Visual Markerless Bone Tracking for Computer-Assisted Orthopaedic Surgery

abstract: Conventional computer-assisted orthopaedic navigation systems rely on the tracking of dedicated optical markers for patient poses, which makes the surgical workflow more invasive, tedious, and expensive. Visual tracking has recently been proposed to measure the target anatomy in a markerless and effortless way, but the existing methods fail under real-world occlusion caused by intraoperative interventions. Furthermore, such methods are hardware-specific and not accurate enough for surgical applications. In this paper, we propose a RGB-D sensing-based markerless tracking method that is robust against occlusion. We design a new segmentation network that features dynamic region-of-interest prediction and robust 3D point cloud segmentation. As it is expensive to collect large-scale training data with occlusion instances, we also propose a new method to create synthetic RGB-D images for network training. Experimental results show that our proposed markerless tracking method outperforms recent state-of-the-art approaches by a large margin, especially when an occlusion exists. Furthermore, our method generalises well to new cameras and new target models, including a cadaver, without the need for network retraining. In practice, by using a high-quality commercial RGB-D camera, our proposed visual tracking method achieves an accuracy of 1-2 degress and 2-4 mm on a model knee, which meets the standard for clinical applications.


title: Ricci curvature of quantum channels on non-commutative transportation metric spaces

abstract: Following Ollivier's work, we introduce the coarse Ricci curvature of a quantum channel as the contraction of non-commutative metrics on the state space. These metrics are defined as a non-commutative transportation cost in the spirit of [N. Gozlan and C. L\'{e}onard. 2006], which gives a unified approach to different quantum Wasserstein distances in the literature. We prove that the coarse Ricci curvature lower bound and its dual gradient estimate, under suitable assumptions, imply the Poincar\'{e} inequality (spectral gap) as well as transportation cost inequalities. Using intertwining relations, we obtain positive bounds on the coarse Ricci curvature of Gibbs samplers, Bosonic and Fermionic beam-splitters as well as Pauli channels on n-qubits.


title: On the Sum of Extended $\eta$-$\mu$ Variates with MRC Applications

abstract: In this paper, the sum of L independent but not necessarily identically distributed (i.n.i.d.) extended $\eta$-$\mu$ variates is considered. In particular, novel expressions for the probability density function and cumulative distribution function are derived in closed-forms. The derived expressions are represented in two different forms, i.e., in terms of confluent multivariate hypergeometric function and general Fox's H-function. Subsequently, closed-form expressions for the outage probability and average symbol error rate are derived. Our analytical results are validated by some numerical and Monte-Carlo simulation results.


title: A novel, Fourier series based method of control optimization and its application to a discontinuous capsule drive model

abstract: This paper presents a novel, Fourier series based numerical method of open-loop control optimization. Due to its flexible assumptions, it can be applied in a large variety of systems, including discontinuous ones or even so-called black boxes, whose equations are not fully known. This aspect is particularly important in mechanical systems, where friction or impact induced discontinuities are common. The paper includes a mathematical background of the new method, a detailed discussion of the algorithm and a numerical example, in which control function of a discontinuous capsule drive is optimized. It is expected that the proposed method can facilitate research in all areas where control of non-smooth, discontinuous or black box systems is crucial. In particular, authors hope that the presented algorithm is going to be used for control optimization of other capsule drives.


title: ProtoMIL: Multiple Instance Learning with Prototypical Parts for Whole-Slide Image Classification

abstract: Multiple Instance Learning (MIL) gains popularity in many real-life machine learning applications due to its weakly supervised nature. However, the corresponding effort on explaining MIL lags behind, and it is usually limited to presenting instances of a bag that are crucial for a particular prediction. In this paper, we fill this gap by introducing ProtoMIL, a novel self-explainable MIL method inspired by the case-based reasoning process that operates on visual prototypes. Thanks to incorporating prototypical features into objects description, ProtoMIL unprecedentedly joins the model accuracy and fine-grained interpretability, which we present with the experiments on five recognized MIL datasets.


title: Outdoor Position Recovery from HeterogeneousTelco Cellular Data

abstract: Recent years have witnessed unprecedented amounts of data generated by telecommunication (Telco) cellular networks. For example, measurement records (MRs) are generated to report the connection states between mobile devices and Telco networks, e.g., received signal strength. MR data have been widely used to localize outdoor mobile devices for human mobility analysis, urban planning, and traffic forecasting. Existing works using first-order sequence models such as the Hidden Markov Model (HMM) attempt to capture spatio-temporal locality in underlying mobility patterns for lower localization errors. The HMM approaches typically assume stable mobility patterns of the underlying mobile devices. Yet real MR datasets exhibit heterogeneous mobility patterns due to mixed transportation modes of the underlying mobile devices and uneven distribution of the positions associated with MR samples. Thus, the existing solutions cannot handle these heterogeneous mobility patterns. we propose a multi-task learning-based deep neural network (DNN) framework, namely PRNet+, to incorporate outdoor position recovery and transportation mode detection. To make sure the framework work, PRNet+ develops a feature extraction module to precisely learn local-, short- and long-term spatio-temporal locality from heterogeneous MR samples. Extensive evaluation on eight datasets collected at three representative areas in Shanghai indicates that PRNet+ greatly outperforms state-of-the-arts.


title: Boundary terms in Lovelock gravity from dimensionally continued Chern-Simons forms

abstract: Boundary terms for Lovelock gravity are obtained by calculating in arbitrary dimension the index theorem for the de Rham complex of a manifold with nonempty boundary.


title: Multi-UAV Assisted Data Gathering in WSN: A MILP Approach For Optimizing Network Lifetime

abstract: In this paper, we study the problem of gathering data from large-scale wireless sensor networks using multiple unmanned air vehicles (UAVs) to gather data at designated rendezvouses, where the goal is to maximize the network lifetime. Previous proposals often consider a practical approach where the problem of determining a data gathering scheme is decomposed into 2 sub-problems: i) partitioning the networks into clusters for determining the rendezvouses as these obtained cluster heads; and ii) determining the paths for a set of a given number of UAVs to come gathering data at these rendezvouses which have been harvesting data within each local clusters, respectively. We try to deal with this as a whole optimization problem, expecting a significant increase in computation complexity which would bring new challenge in creating practical solutions for large-scale WSNs. We introduce two alternatives mixed-integer linear programming (MILP) formulations, namely the 2-index model with $O(n^2)$ variables and the 3-index model that has $O(n^3)$ variables, where $n$ denotes the number of sensor nodes. We show that our best model could solve optimally the problem instances with up to 50 sensor nodes in less than 30 minutes. Next, we propose a heuristic idea to reduce the number of variables in implementing the 3-index model to effectively handle larger-scale networks with size in hundreds. The experiment results show that our heuristic approach significantly prolongs the network lifetime compared to existing most efficient proposals.


title: Bosonic fluctuations in the $( 1 + 1 )$-dimensional Gross-Neveu(-Yukawa) model at varying $\mu$ and $T$ and finite $N$

abstract: Using analogies between flow equations from the Functional Renormalization Group and flow equations from (numerical) fluid dynamics we investigate the effects of bosonic fluctuations in a bosonized Gross-Neveu model -- namely the Gross-Neveu-Yukawa model. We study this model for finite numbers of fermions at varying chemical potential and temperature in the local potential approximation. Thereby we numerically demonstrate that for any finite number of fermions and as long as the temperature is non-zero, there is no $\mathbb{Z}_2$ symmetry breaking for arbitrary chemical potentials.


title: Image-free single-pixel segmentation

abstract: The existing segmentation techniques require high-fidelity images as input to perform semantic segmentation. Since the segmentation results contain most of edge information that is much less than the acquired images, the throughput gap leads to both hardware and software waste. In this letter, we report an image-free single-pixel segmentation technique. The technique combines structured illumination and single-pixel detection together, to efficiently samples and multiplexes scene's segmentation information into compressed one-dimensional measurements. The illumination patterns are optimized together with the subsequent reconstruction neural network, which directly infers segmentation maps from the single-pixel measurements. The end-to-end encoding-and-decoding learning framework enables optimized illumination with corresponding network, which provides both high acquisition and segmentation efficiency. Both simulation and experimental results validate that accurate segmentation can be achieved using two-order-of-magnitude less input data. When the sampling ratio is 1%, the Dice coefficient reaches above 80% and the pixel accuracy reaches above 96%. We envision that this image-free segmentation technique can be widely applied in various resource-limited platforms such as UAV and unmanned vehicle that require real-time sensing.


title: Discretization of parameter identification in PDEs using Neural Networks

abstract: We consider the ill-posed inverse problem of identifying a nonlinearity in a time-dependent PDE model. The nonlinearity is approximated by a neural network, and needs to be determined alongside other unknown physical parameters and the unknown state. Hence, it is not possible to construct input-output data pairs to perform a supervised training process. Proposing an all-at-once approach, we bypass the need for training data and recover all the unknowns simultaneously. In the general case, the approximation via a neural network can be realized as a discretization scheme, and the training with noisy data can be viewed as an ill-posed inverse problem. Therefore, we study discretization of regularization in terms of Tikhonov and projected Landweber methods for discretization of inverse problems, and prove convergence when the discretization error (network approximation error) and the noise level tend to zero.


title: Weakly Supervised Cross-platform Teenager Detection with Adversarial BERT

abstract: Teenager detection is an important case of the age detection task in social media, which aims to detect teenage users to protect them from negative influences. The teenager detection task suffers from the scarcity of labelled data, which exacerbates the ability to perform well across social media platforms. To further research in teenager detection in settings where no labelled data is available for a platform, we propose a novel cross-platform framework based on Adversarial BERT. Our framework can operate with a limited amount of labelled instances from the source platform and with no labelled data from the target platform, transferring knowledge from the source to the target social media. We experiment on four publicly available datasets, obtaining results demonstrating that our framework can significantly improve over competitive baseline models on the cross-platform teenager detection task.


title: Strain-Modulated Graphene Heterostructure as a Valleytronic Current Switch

abstract: Strain engineering is a promising approach for suppressing the OFF-state conductance in graphene-based devices that arises from Klein tunnelling. In this work, we derive a comprehensive tight-binding Hamiltonian for strained graphene that incorporates strain-induced effects that have been neglected hitherto, such as the distortion of the unit cell under strain, the effect of strain on the next-nearest neighbor coupling, and the second-order contributions of the strain tensor. We derive the corresponding low-energy effective Hamiltonian about the Dirac points and reformulate the boundary conditions at the interfaces between strained and unstrained graphene in light of additional terms in the Hamiltonian. By applying these boundary conditions, we evaluate the transmission across a strained graphene heterostructure consisting of a central segment sandwiched between two unstrained leads. Modulation of the transmitted current can be effected by varying the magnitude and direction of the applied strain, as well as by the applying a gate voltage. Based on realistic parameter values, we predict that high ON-OFF ratios of up to $10^{12}$ as well as high current valley polarization can be achieved in the strain-modulated device.


title: Dimension independent atomic decoposition for dyadic martingale $H^1$

abstract: We introduce atoms for dyadic atomic $H^1$ for which the equivalence between atomic and maximal function defnitions is dimension independent. We give the sharp, up to $\log(d)$ factor, estimates for the $H^1 \to L^1$ norm estimates for the special maximal function.


title: Spin-orbit torque: Moving towards two-dimensional van der Waals heterostructures

abstract: The manipulation of magnetic properties using either electrical currents or gate bias is the key of future high-impact nanospintronics applications such as spin-valve read heads, non-volatile logic, and random-access memories. The current technology for magnetic switching with spin-transfer torque requires high current densities, whereas gate-tunable magnetic materials such as ferromagnetic semiconductors and multiferroic materials are still far from practical applications. Recently, magnetic switching induced by pure spin currents using the spin Hall and Rashba effects in heavy metals, called spin-orbit torque (SOT), has emerged as a candidate for designing next-generation magnetic memory with low current densities. The recent discovery of topological materials and two-dimensional (2D) van der Waals (vdW) materials provides opportunities to explore versatile 3D-2D and 2D-2D heterostructures with interesting characteristics. In this review, we introduce the emerging approaches to realizing SOT nanodevices including techniques to evaluate the SOT efficiency as well as the opportunities and challenges of using 2D topological materials and vdW materials in such applications.


title: Data-Free Evaluation of User Contributions in Federated Learning

abstract: Federated learning (FL) trains a machine learning model on mobile devices in a distributed manner using each device's private data and computing resources. A critical issues is to evaluate individual users' contributions so that (1) users' effort in model training can be compensated with proper incentives and (2) malicious and low-quality users can be detected and removed. The state-of-the-art solutions require a representative test dataset for the evaluation purpose, but such a dataset is often unavailable and hard to synthesize. In this paper, we propose a method called Pairwise Correlated Agreement (PCA) based on the idea of peer prediction to evaluate user contribution in FL without a test dataset. PCA achieves this using the statistical correlation of the model parameters uploaded by users. We then apply PCA to designing (1) a new federated learning algorithm called Fed-PCA, and (2) a new incentive mechanism that guarantees truthfulness. We evaluate the performance of PCA and Fed-PCA using the MNIST dataset and a large industrial product recommendation dataset. The results demonstrate that our Fed-PCA outperforms the canonical FedAvg algorithm and other baseline methods in accuracy, and at the same time, PCA effectively incentivizes users to behave truthfully.


title: A conjecture of Zhi-Wei Sun on determinants over finite fields

abstract: In this paper, we study certain determinants over finite fields. Let $\mathbb{F}_q$ be the finite field of $q$ elements and let $a_1,a_2,\cdots,a_{q-1}$ be all nonzero elements of $\mathbb{F}_q$. Let $T_q=\left[\frac{1}{a_i^2-a_ia_j+a_j^2}\right]_{1\le i,j\le q-1}$ be a matrix over $\mathbb{F}_q$. We obtain the explicit value of $\det T_q$. Also, as a consequence of our result, we confirm a conjecture posed by Zhi-Wei Sun.


title: Ground state pseudoscalar mesons on the light front: from the light to heavy sector

abstract: We extract the leading Fock-state light front wave functions (LF-LFWFs) of both the light and heavy pseudoscalar mesons, e.g., the pion (at masses of 130 MeV, 310 MeV and 690 MeV), $\eta_c$ and $\eta_b$, from their covariant Bethe-Salpeter wave functions within the rainbow-ladder (RL) truncation. It is shown that the LF-LFWFs get narrower in $x$ (the longitudinal momentum fraction of meson carried by the quark) with the increasing current quark mass, and the leading twist parton distribution amplitudes (PDAs) inherit this feature. Meanwhile, we find in the pion the LF-LFWFs only contribute around 30\% to the total Fock-state normalization, indicating the presence of significant higher Fock-states within. In contrast, in the $\eta_c$ and $\eta_b$ the LF-LFWFs contribute more than $90$\%, suggesting the $Q\bar{Q}$ valence Fock-state truncation as a good approximation for heavy mesons. We thus study the 3-dimensional parton distributions of the $\eta_c$ and $\eta_b$ with the unpolarized generalized parton distribution function (GPD) and the transverse momentum dependent parton distribution function (TMD). Through the gravitational form factors in connection with the GPD, the mass radii of the $\eta_c$ and $\eta_b$ in the light-cone frame are determined to be $r_{E,{\rm LC}}^{\eta_c} =0.150$ fm and $r_{E,{\rm LC}}^{\eta_b} =0.089$ fm respectively.


title: Bargmann Representation of Spin Chains

abstract: Spin chain Hamiltonians can be written in terms of complex differential operators using the Bargmann representation of the Jordan-Schwinger map. In this case, the eigenfunctions are expressed as the product of orthonormal monomials of the phase-space coordinates $z_{i}=Q_{i}+i P_{i}$ in the complex plane. Furthermore, the series constructed from each phase-space coordinate converges uniformly in any compact domain of the complex plane. Formulating spin chains with respect to the phase-space coordinates helps in discussing their classical limit and in the calculations of quasi-probability distributions.


title: A Prior Derivation and Local Existence of Classical Solutions for the Relativistic Euler Equations with Logarithmic Equation of State

abstract: In this paper, from an investigation of a symmetric hyperbolic system, a prior derivation of the logarithm equation of state is provided. Through a diffeomorphism transforming the classical Euler equations to the symmetric hyperbolic system, we show that the logarithm pressure co-exists with existing barotropic equations of state without applying any physical laws. In this connection, we also establish a local existence of classical solutions for the relativistic Euler equations with the logarithm equation of state.


title: Towards Predictive Replica Placement for Distributed Data Stores in Fog Environments

abstract: Mobile clients that consume and produce data are abundant in fog environments. Low latency access to this data can only be achieved by storing it in close physical proximity to the clients. Current data store systems fall short as they do not replicate data based on client movement. We propose an approach to predictive replica placement that autonomously and proactively replicates data close to likely client locations.


title: Improving Generalization of Batch Whitening by Convolutional Unit Optimization

abstract: Batch Whitening is a technique that accelerates and stabilizes training by transforming input features to have a zero mean (Centering) and a unit variance (Scaling), and by removing linear correlation between channels (Decorrelation). In commonly used structures, which are empirically optimized with Batch Normalization, the normalization layer appears between convolution and activation function. Following Batch Whitening studies have employed the same structure without further analysis; even Batch Whitening was analyzed on the premise that the input of a linear layer is whitened. To bridge the gap, we propose a new Convolutional Unit that is in line with the theory, and our method generally improves the performance of Batch Whitening. Moreover, we show the inefficacy of the original Convolutional Unit by investigating rank and correlation of features. As our method is employable off-the-shelf whitening modules, we use Iterative Normalization (IterNorm), the state-of-the-art whitening module, and obtain significantly improved performance on five image classification datasets: CIFAR-10, CIFAR-100, CUB-200-2011, Stanford Dogs, and ImageNet. Notably, we verify that our method improves stability and performance of whitening when using large learning rate, group size, and iteration number.


title: Spectrum of SU(2) gauge theory at large number of flavors

abstract: We present a numerical study of the spectrum of an asymptotically non-free $SU(2)$ gauge theory with $N_f=24$ massive fermion flavors. For such large number of flavors, asymptotic freedom is lost and the massless theory is governed by a gaussian fixed point at long distances. If fermions are massive they decouple at low energy scales and the theory is confining. We present a scaling law for the masses of the hadrons, glueballs and string tension as functions of fermion mass. The hadrons become effectively heavy quark systems, with masses approximately twice the fermion mass, whereas the energy scale of the confinement, probed by e.g. the string tension, is much smaller and vanishes asymptotically as $m_\text{fermion}^{2.18}$. Our results from lattice simulations are compatible with this behaviour.


title: On Z-mean reflected BSDEs

abstract: In this paper we provide conditions for the existence of supersolutions to BSDEs with mean-reflections on the $Z$ component. We show that, contrary to BSDEs with mean-reflections on the $Y$ component, we cannot expect a supersolution with a deterministic increasing process $K$. Nonetheless, we give conditions for the existence of a supersolution for a stochastic component $K$ and under various constraints. We formalize some previous arguments on the time-inconsistency of such problems, proving that a minimal supersolution is necessarily a solution in our framework.


title: A Random Geometric Model of Blockages in Vehicular Networks

abstract: This paper presents a novel spatially consistent approach for modeling line-of-sight (LOS) paths in vehicular networks. We use stochastic geometry to model transmitters, obstacles, and receivers located in three parallel lines, respectively. Their geometric interactions are leveraged to characterize the existence of LOS paths. Specifically, the proposed approach focuses on the role of obstacles in blocking one or more LOS paths, which has been overlooked in most statistical models for blockage. Under the proposed framework, we derive the probability that a typical vehicle is in LOS with respect to transmitters with received signal-to-noise ratios greater than a threshold. The proposed framework and LOS coverage analysis are instrumental to the analysis of LOS-critical applications such as positioning or mmWave communications in vehicular networks.


title: On higher dimensional gravity: the Lagrangian, its dimensional reduction and a cosmological model

abstract: By dimensional reduction of the Lovelock Lagrangian, effective four-dimensional field equations and expressions for the cosmological and gravitational constants are obtained. A cosmological model is discussed with the n-torus as internal space.


title: Learning to Arbitrate Human and Robot Control using Disagreement between Sub-Policies

abstract: In the context of teleoperation, arbitration refers to deciding how to blend between human and autonomous robot commands. We present a reinforcement learning solution that learns an optimal arbitration strategy that allocates more control authority to the human when the robot comes across a decision point in the task. A decision point is where the robot encounters multiple options (sub-policies), such as having multiple paths to get around an obstacle or deciding between two candidate goals. By expressing each directional sub-policy as a von Mises distribution, we identify the decision points by observing the modality of the mixture distribution. Our reward function reasons on this modality and prioritizes to match its learned policy to either the user or the robot accordingly. We report teleoperation experiments on reach-and-grasping objects using a robot manipulator arm with different simulated human controllers. Results indicate that our shared control agent outperforms direct control and improves the teleoperation performance among different users. Using our reward term enables flexible blending between human and robot commands while maintaining safe and accurate teleoperation.


title: Necessary conditions for existence of $\Gamma_n$-contractions and examples of $\Gamma_3$-contractions

abstract: The fundamental result of B. Sz. Nazy states that every contraction has a coisometric extension and a unitary dilation. The isometric dilation of a contraction on a Hilbert space motivated whether this theory can be extended sensibly to families of operators. It is natural to ask whether this idea can be generalized, where the contraction $T$ is substituted by a commuting $n$-tuples of operators $(S_1,\cdots, S_n)$ acting on some Hilbert space having $\Gamma_n$ as a spectral set. We derive the necessary conditions for the existence of a $\Gamma_n$-isometric dilation for $\Gamma_n$-contractions. Also we discuss an example of a $\Gamma_3$-contraction $(S_1, S_2, S_3)$ acting on some Hilbert space $\mathcal H,$ which has a $\Gamma_3$-isometric dilation, but it fails to satisfy the following condition: $$E_1^*E_1-E_1E_1^*= E_2^*E_2-E_2E_2^*,$$ where $E_1$ and $E_2$ are the fundamental operators of $(S_1, S_2, S_3),$ $(S_1,S_2)$ is a pair of commuting contractions and $S_3$ is a partial isometry. Thus, the set of sufficient conditions for the existence of a $\Gamma_3$-isometric dilation breaks down, in general, to be necessary, even when the $\Gamma_3$-contraction $(S_1, S_2, S_3)$ has the special structure as described above.


title: Layer-wise Adaptive Graph Convolution Networks Using Generalized Pagerank

abstract: We investigate adaptive layer-wise graph convolution in deep GCN models. We propose AdaGPR to learn generalized Pageranks at each layer of a GCNII network to induce adaptive convolution. We show that the generalization bound for AdaGPR is bounded by a polynomial of the eigenvalue spectrum of the normalized adjacency matrix in the order of the number of generalized Pagerank coefficients. By analysing the generalization bounds we show that oversmoothing depends on both the convolutions by the higher orders of the normalized adjacency matrix and the depth of the model. We performed evaluations on node-classification using benchmark real data and show that AdaGPR provides improved accuracies compared to existing graph convolution networks while demonstrating robustness against oversmoothing. Further, we demonstrate that analysis of coefficients of layer-wise generalized Pageranks allows us to qualitatively understand convolution at each layer enabling model interpretations.


title: Full-Velocity Radar Returns by Radar-Camera Fusion

abstract: A distinctive feature of Doppler radar is the measurement of velocity in the radial direction for radar points. However, the missing tangential velocity component hampers object velocity estimation as well as temporal integration of radar sweeps in dynamic scenes. Recognizing that fusing camera with radar provides complementary information to radar, in this paper we present a closed-form solution for the point-wise, full-velocity estimate of Doppler returns using the corresponding optical flow from camera images. Additionally, we address the association problem between radar returns and camera images with a neural network that is trained to estimate radar-camera correspondences. Experimental results on the nuScenes dataset verify the validity of the method and show significant improvements over the state-of-the-art in velocity estimation and accumulation of radar points.


title: Cluster algebraic description of entanglement patterns for the BTZ black hole

abstract: We study the thermal state of a two dimensional conformal field theory which is dual to the static BTZ black hole in the high temperature limit. After partitioning the boundary of the static BTZ slice into $N$ subsystems we show that there is an underlying $C_{N-1}$ cluster algebra encoding entanglement patterns of the thermal state. We also demonstrate that the polytope encapsulating such patterns in a geometric manner for a fixed $N$ is the cyclohedron ${\mathcal C}_{N-1}$. Alternatively these patterns of entanglement can be represented in the space of geodesics (kinematic space) in terms of a Zamolodchikov $Y$-system of $C_{N-1}$ type. The boundary condition for such an $Y$-system is featuring the entropy of the BTZ black hole.