title: CLiMB: A Continual Learning Benchmark for Vision-and-Language Tasks

abstract: Current state-of-the-art vision-and-language models are evaluated on tasks either individually or in a multi-task setting, overlooking the challenges of continually learning (CL) tasks as they arrive. Existing CL benchmarks have facilitated research on task adaptation and mitigating "catastrophic forgetting", but are limited to vision-only and language-only tasks. We present CLiMB, a benchmark to study the challenge of learning multimodal tasks in a CL setting, and to systematically evaluate how upstream continual learning can rapidly generalize to new multimodal and unimodal tasks. CLiMB includes implementations of several CL algorithms and a modified Vision-Language Transformer (ViLT) model that can be deployed on both multimodal and unimodal tasks. We find that common CL methods can help mitigate forgetting during multimodal task learning, but do not enable cross-task knowledge transfer. We envision that CLiMB will facilitate research on a new class of CL algorithms for this challenging multimodal setting.


title: Skyrmion crystal under $D_{3h}$ point group: Role of out-of-plane Dzyaloshinskii-Moriya interaction

abstract: The Dzyaloshinkii-Moriya (DM) interaction that originates from relativistic spin-orbit coupling in noncentrosymmetric magnets is a source of topological spin textures. We theoretically investigate the possibility of a skyrmion crystal by focusing on the role of the out-of-plane DM interaction that is different from the polar- and chiral-type DM interaction. By performing the simulated annealing for a spin model on a triangular lattice belonging to the $D_{3h}$ point group, we construct low-temperature magnetic phase diagrams in an applied magnetic field. As a result, we find the instability toward different skyrmion crystals under in-plane and out-of-plane magnetic fields, where the key ingredients to stabilize the SkX are different according to the magnetic field direction; the SkX is stabilized under the out-of-plane DM interaction for the in-plane magnetic field, while it is stabilized by additionally introducing an easy-axis anisotropy for the out-of-plane magnetic field. We also discuss the possible multiple-$Q$ states other than the skyrmion crystals in the presence of the out-of-plane DM interaction. Our result indicates that noncentrosymmetric magnetic materials with the out-of-plane DM interaction are potential candidates to host the skyrmion crystals.


title: Design of Supervision-Scalable Learning Systems: Methodology and Performance Benchmarking

abstract: The design of robust learning systems that offer stable performance under a wide range of supervision degrees is investigated in this work. We choose the image classification problem as an illustrative example and focus on the design of modularized systems that consist of three learning modules: representation learning, feature learning and decision learning. We discuss ways to adjust each module so that the design is robust with respect to different training sample numbers. Based on these ideas, we propose two families of learning systems. One adopts the classical histogram of oriented gradients (HOG) features while the other uses successive-subspace-learning (SSL) features. We test their performance against LeNet-5, which is an end-to-end optimized neural network, for MNIST and Fashion-MNIST datasets. The number of training samples per image class goes from the extremely weak supervision condition (i.e., 1 labeled sample per class) to the strong supervision condition (i.e., 4096 labeled sample per class) with gradual transition in between (i.e., $2^n$, $n=0, 1, \cdots, 12$). Experimental results show that the two families of modularized learning systems have more robust performance than LeNet-5. They both outperform LeNet-5 by a large margin for small $n$ and have performance comparable with that of LeNet-5 for large $n$.


title: Some rigidity results on compact hypersurfaces with capillary boundary in Hyperbolic space

abstract: In this paper, we prove a Heintze-Karcher type inequality for capillary hypersurfaces supported on various hypersurfaces in the hyperbolic space. The equality case only occurs on capillary totally umbilical hypersurfaces. Then we apply this result to prove the Alexandrov type theorem for embedded capillary hypersurfaces in the hyperbolic space. In addition, we prove some other rigidity results for capillary hypersurfaces supported on totally geodesic plane in $\mathbb B^{n+1}_+$.


title: Radiation resistance in simulated metallic core-shell nanoparticles

abstract: We present molecular dynamics (MD) simulations of radiation damage in pure Fe nanoparticles (NP) and bimetallic FeCu core-shell nanoparticles (CSNP). The CSNP includes a perfect body centered cubic (bcc) Fe core coated with a face-centered cubic (fcc) Cu shell. Irradiation with Fe Primary Knock-on Atoms (PKA) with energies between 1 and 7 keV leads to point defects, without clustering beyond divacancies and very few slightly larger vacancy clusters, and without interstitial clusters, unlike what happens in bulk at the same PKA energies. The Fe-Cu interface and shell can act as a defect sink, absorbing radiation-induced damage and, therefore, the final number of defects in the Fe core is significantly lower than in the Fe NP. In addition, the Cu shell substantially diminishes the number of sputtered Fe atoms, acting as a barrier for recoil ejection. Structurally, the Cu shell responds to the stress generated by the collision cascade by creating and destroying stacking faults across the shell width, which could also accommodate further irradiation defects. Sputtering yield (Y) is underestimated by BCA, which is also expected since the simulation is for a thin film at normal incidence. We also compare MD defect production to bulk predictions of the analytic Athermal Recombination Corrected Displacements Per Atom (arc-dpa) model. The number of vacancies in the Fe core is only slightly lower than arc-dpa predictions, but the number of interstitials is reduced by about one order of magnitude compared to vacancies, at 5 keV. According to the radiation resistance found for FeCu CSNP in our simulations, this class of nanomaterial could be suitable for developing new radiation resistant coatings, nanostructured components, and shields for use in extreme environments, for instance, in nuclear energy and astrophysical applications.


title: A machine learning photon detection algorithm for coherent X-ray ultrafast fluctuation analysis

abstract: X-ray free electron laser (XFEL) experiments have brought unique capabilities and opened new directions in research, such as creating new states of matter or directly measuring atomic motion. One such area is the ability to use finely spaced sets of coherent x-ray pulses to be compared after scattering from a dynamic system at different times. This enables the study of fluctuations in many-body quantum systems at the level of the ultrafast pulse durations, but this method has been limited to a select number of examples and required complex and advanced analytical tools. By applying a new methodology to this problem, we have made qualitative advances in three separate areas that will likely also find application to new fields. As compared to the `droplet-type' models which typically are used to estimate the photon distributions on pixelated detectors to obtain the coherent X-ray speckle patterns, our algorithm pipeline achieves an order of magnitude speedup on CPU hardware and two orders of magnitude improvement on GPU hardware. We also find that it retains accuracy in low-contrast conditions, which is the typical regime for many experiments in structural dynamics. Finally, it can predict photon distributions in high average-intensity applications, a regime which up until now, has not been accessible. Our AI-assisted algorithm will enable a wider adoption of x-ray coherence spectroscopies, by both automating previously challenging analyses and enabling new experiments that were not otherwise feasible without the developments described in this work.


title: Free-form Lesion Synthesis Using a Partial Convolution Generative Adversarial Network for Enhanced Deep Learning Liver Tumor Segmentation

abstract: Automatic deep learning segmentation models has been shown to improve both the segmentation efficiency and the accuracy. However, training a robust segmentation model requires considerably large labeled training samples, which may be impractical. This study aimed to develop a deep learning framework for generating synthetic lesions that can be used to enhance network training. The lesion synthesis network is a modified generative adversarial network (GAN). Specifically, we innovated a partial convolution strategy to construct an Unet-like generator. The discriminator is designed using Wasserstein GAN with gradient penalty and spectral normalization. A mask generation method based on principal component analysis was developed to model various lesion shapes. The generated masks are then converted into liver lesions through a lesion synthesis network. The lesion synthesis framework was evaluated for lesion textures, and the synthetic lesions were used to train a lesion segmentation network to further validate the effectiveness of this framework. All the networks are trained and tested on the public dataset from LITS. The synthetic lesions generated by the proposed approach have very similar histogram distributions compared to the real lesions for the two employed texture parameters, GLCM-energy and GLCM-correlation. The Kullback-Leibler divergence of GLCM-energy and GLCM-correlation were 0.01 and 0.10, respectively. Including the synthetic lesions in the tumor segmentation network improved the segmentation dice performance of U-Net significantly from 67.3% to 71.4% (p<0.05). Meanwhile, the volume precision and sensitivity improve from 74.6% to 76.0% (p=0.23) and 66.1% to 70.9% (p<0.01), respectively. The synthetic data significantly improves the segmentation performance.


title: Bandwidth and Aliasing in the Microwave SQUID Multiplexer

abstract: The microwave SQUID multiplexer (umux) has enabled higher bandwidth or higher channel counts across a wide range of experiments in particle physics, astronomy, and spectroscopy. The large multiplexing factor coupled with recent commercial availability of microwave components and warm electronics readout systems make it an attractive candidate for systems requiring large cryogenic detector counts. Since the multiplexer is considered for both bolometric and calorimetric applications across several orders of magnitude of signal frequencies, understanding the bandwidth of the device and its interaction with readout electronics is key to appropriately designing and engineering systems. Here we discuss several important factors contributing to the bandwidth properties of umux systems, including the intrinsic device bandwidth, interactions with warm electronics readout systems, and aliasing. We present simulations and measurements of umux devices coupled with SLAC Microresonator RF (SMuRF) tone-tracking electronics and discuss several implications for future experimental design.


title: Extreme wave excitation from localized phase-shift perturbations

abstract: The modulation instability is a focusing mechanism responsible for the formation of strong wave localizations not only on the water surface, but also in a variety of nonlinear dispersive media. Such dynamics is initiated from the injection of side-bands, which translate into an amplitude modulation of the wave field. The nonlinear stage of unstable wave evolution can be described by exact solutions of the nonlinear Schr\"odinger equation (NLSE). In that case, the amplitude modulation of such coherent extreme wave structures is connected to a particular phase-shift seed in the carrier wave. In this letter, we show that phase-shifts localization applied to the background, excluding any amplitude modulation excitation, can indeed trigger extreme events. Such rogue waves can be for instance generated by considering the parametrization of fundamental breathers and thus, by seeding only the local phase-shift information to the regular carrier wave. Our wave tank experiments show an excellent agreement with the expected NLSE hydrodynamics and confirm that even though delayed in their evolution, breather-type extreme waves can be generated from a purely regular wave train. Such novel focusing mechanism awaits experimental confirmation in other nonlinear media, such optics, plasma, and Bose-Einstein condensates.


title: Attention-based Dynamic Subspace Learners for Medical Image Analysis

abstract: Learning similarity is a key aspect in medical image analysis, particularly in recommendation systems or in uncovering the interpretation of anatomical data in images. Most existing methods learn such similarities in the embedding space over image sets using a single metric learner. Images, however, have a variety of object attributes such as color, shape, or artifacts. Encoding such attributes using a single metric learner is inadequate and may fail to generalize. Instead, multiple learners could focus on separate aspects of these attributes in subspaces of an overarching embedding. This, however, implies the number of learners to be found empirically for each new dataset. This work, Dynamic Subspace Learners, proposes to dynamically exploit multiple learners by removing the need of knowing apriori the number of learners and aggregating new subspace learners during training. Furthermore, the visual interpretability of such subspace learning is enforced by integrating an attention module into our method. This integrated attention mechanism provides a visual insight of discriminative image features that contribute to the clustering of image sets and a visual explanation of the embedding features. The benefits of our attention-based dynamic subspace learners are evaluated in the application of image clustering, image retrieval, and weakly supervised segmentation. Our method achieves competitive results with the performances of multiple learners baselines and significantly outperforms the classification network in terms of clustering and retrieval scores on three different public benchmark datasets. Moreover, our attention maps offer a proxy-labels, which improves the segmentation accuracy up to 15% in Dice scores when compared to state-of-the-art interpretation techniques.


title: The exterior Dirichlet problems of Hessian quotient equations

abstract: In this paper, we study the Dirichlet problem of Hessian quotient equations in exterior domains. By estimating the eigenvalues of the solution, the necessary and sufficient conditions on existence of radial solutions are obtained. Applying the solutions of ODE, the viscosity subsolutions and supersolutions are constructed and then the existence of viscosity solutions for exterior problems is established by the Perron's method.


title: Hydration free energies of polypeptides from popular implicit solvent models versus all-atom simulation results based on molecular quasichemical theory

abstract: The hydration free energy of a macromolecule is the central property of interest for understanding its distribution over conformations and its state of aggregation. Calculating the hydration free energy of a macromolecule in all-atom simulations has long remained a challenge, necessitating the use of models wherein the effect of the solvent is captured without explicit account of solvent degrees of freedom. This situation has changed with developments in the molecular quasi-chemical theory (QCT), an approach that enables calculation of the hydration free energy of macromolecules within all-atom simulations at the same resolution as is possible for small molecule solutes. The theory also provides a rigorous and physically transparent framework to conceptualize and model interactions in molecular solutions, and thus provides a convenient framework to investigate the assumptions in implicit-solvent models. In this study, we compare the results using molecular QCT versus predictions from EEF1, ABSINTH, and GB/SA implicit-solvent models for poly-glycine and poly-alanine solutes covering a range of chain lengths and conformations. Among the three models, GB/SA does best in capturing the broad trends in hydration free energy. We trace the deficiencies of the group-additive EEF1 and ABSINTH models to their under-appreciation of the cooperativity of hydration between solute groups; seen in this light, the better performance of GB/SA can be attributed to its treatment of the collective properties of hydration, albeit within a continuum dielectric framework. We highlight the importance of validating the individual physical components that enter implicit solvent models for protein solution thermodynamics.


title: Analysis & Computational Complexity Reduction of Monocular and Stereo Depth Estimation Techniques

abstract: Accurate depth estimation with lowest compute and energy cost is a crucial requirement for unmanned and battery operated autonomous systems. Robotic applications require real time depth estimation for navigation and decision making under rapidly changing 3D surroundings. A high accuracy algorithm may provide the best depth estimation but may consume tremendous compute and energy resources. A general trade-off is to choose less accurate methods for initial depth estimate and a more accurate yet compute intensive method when needed. Previous work has shown this trade-off can be improved by developing a state-of-the-art method (AnyNet) to improve stereo depth estimation. We studied both the monocular and stereo vision depth estimation methods and investigated methods to reduce computational complexity of these methods. This was our baseline. Consequently, our experiments show reduction of monocular depth estimation model size by ~75% reduces accuracy by less than 2% (SSIM metric). Our experiments with the novel stereo vision method (AnyNet) show that accuracy of depth estimation does not degrade more than 3% (three pixel error metric) in spite of reduction in model size by ~20%. We have shown that smaller models can indeed perform competitively.


title: Semi-supervised Time Domain Target Speaker Extraction with Attention

abstract: In this work, we propose Exformer, a time-domain architecture for target speaker extraction. It consists of a pre-trained speaker embedder network and a separator network based on transformer encoder blocks. We study multiple methods to combine speaker information with the input mixture, and the resulting Exformer architecture obtains superior extraction performance compared to prior time-domain networks. Furthermore, we investigate a two-stage procedure to train the model using mixtures without reference signals upon a pre-trained supervised model. Experimental results show that the proposed semi-supervised learning procedure improves the performance of the supervised baselines.


title: Interpretable and Actionable Vehicular Greenhouse Gas Emission Prediction at Road link-level

abstract: To help systematically lower anthropogenic Greenhouse gas (GHG) emissions, accurate and precise GHG emission prediction models have become a key focus of the climate research. The appeal is that the predictive models will inform policymakers, and hopefully, in turn, they will bring about systematic changes. Since the transportation sector is constantly among the top GHG emission contributors, especially in populated urban areas, substantial effort has been going into building more accurate and informative GHG prediction models to help create more sustainable urban environments. In this work, we seek to establish a predictive framework of GHG emissions at the urban road segment or link level of transportation networks. The key theme of the framework centers around model interpretability and actionability for high-level decision-makers using econometric Discrete Choice Modelling (DCM). We illustrate that DCM is capable of predicting link-level GHG emission levels on urban road networks in a parsimonious and effective manner. Our results show up to 85.4% prediction accuracy in the DCM models' performances. We also argue that since the goal of most GHG emission prediction models focuses on involving high-level decision-makers to make changes and curb emissions, the DCM-based GHG emission prediction framework is the most suitable framework.


title: Weakly Supervised Classification of Vital Sign Alerts as Real or Artifact

abstract: A significant proportion of clinical physiologic monitoring alarms are false. This often leads to alarm fatigue in clinical personnel, inevitably compromising patient safety. To combat this issue, researchers have attempted to build Machine Learning (ML) models capable of accurately adjudicating Vital Sign (VS) alerts raised at the bedside of hemodynamically monitored patients as real or artifact. Previous studies have utilized supervised ML techniques that require substantial amounts of hand-labeled data. However, manually harvesting such data can be costly, time-consuming, and mundane, and is a key factor limiting the widespread adoption of ML in healthcare (HC). Instead, we explore the use of multiple, individually imperfect heuristics to automatically assign probabilistic labels to unlabeled training data using weak supervision. Our weakly supervised models perform competitively with traditional supervised techniques and require less involvement from domain experts, demonstrating their use as efficient and practical alternatives to supervised learning in HC applications of ML.


title: Comment on Transferability and Input Transformation with Additive Noise

abstract: Adversarial attacks have verified the existence of the vulnerability of neural networks. By adding small perturbations to a benign example, adversarial attacks successfully generate adversarial examples that lead misclassification of deep learning models. More importantly, an adversarial example generated from a specific model can also deceive other models without modification. We call this phenomenon ``transferability". Here, we analyze the relationship between transferability and input transformation with additive noise by mathematically proving that the modified optimization can produce more transferable adversarial examples.


title: Fair Generalized Linear Models with a Convex Penalty

abstract: Despite recent advances in algorithmic fairness, methodologies for achieving fairness with generalized linear models (GLMs) have yet to be explored in general, despite GLMs being widely used in practice. In this paper we introduce two fairness criteria for GLMs based on equalizing expected outcomes or log-likelihoods. We prove that for GLMs both criteria can be achieved via a convex penalty term based solely on the linear components of the GLM, thus permitting efficient optimization. We also derive theoretical properties for the resulting fair GLM estimator. To empirically demonstrate the efficacy of the proposed fair GLM, we compare it with other well-known fair prediction methods on an extensive set of benchmark datasets for binary classification and regression. In addition, we demonstrate that the fair GLM can generate fair predictions for a range of response variables, other than binary and continuous outcomes.


title: Ultrafast opto-magnetic effects induced by nitrogen-vacancy centers in diamond crystals

abstract: The current generation of quantum sensing technologies using color centers in diamond crystals is primarily based on the principle that the resonant microwave frequency of the luminescence between quantum levels of the nitrogen-vacancy (NV) center varies with temperature, electric and magnetic fields. This principle enables us to measure, for instance, magnetic and electric fields, as well as local temperature with nanometer resolution in conjunction with a scanning probe microscope (SPM). However, the time resolution of conventional quantum sensing technologies has been limited to microseconds due to the limited luminescence lifetime. Here, we investigate ultrafast opto-magnetic effects in diamond crystals containing nitrogen-vacancy NV centers to improve the time resolution of quantum sensing to sub-picosecond time scales. The spin ensemble from diamond NV centers induces an inverse Cotton-Mouton effect (ICME) in the form of a sub-picosecond optical response in a femtosecond pump-probe measurement. The helicity and quadratic power dependence of the ICME can be interpreted as a second-order opto-magnetic effect in which ensembles of NV electron spins act as a source for the ICME. The results provide fundamental guidelines for enabling high-resolution spatial-time quantum sensing technologies when combined with SPM techniques.


title: Galileo's speedometer: an approach to the concept of instantaneous velocity

abstract: Difficulties presented by students on the concept of instantaneous velocity are well known. This is in part due to instantaneous speed being often defined in terms of the notion of mathematical limit, which may not be clear to many students in introductory physics courses. In this work we present a complementary teaching proposal that can help students to get a better grasp of instantaneous velocity. The approach is based on Galileo's ideas on instantaneous speed, which he borrowed from the Mertonian scholars much before infinitesimal calculus was developed.


title: Aluminum functionalized silicene: a potential anode material for alkali metal ion batteries

abstract: We have investigated the possibility of using aluminum functionalized silicene trilayers (ABC-Si$_4$Al$_2$) as an anode material for alkali metal ion batteries (AMIBs). First, we studied the thermodynamic stability of ABC-Si$_4$Al$_2$ using ab-initio molecular dynamics simulations, showing that this material remains stable up to 600 K. Then, we explored the properties of alkali metal atoms (Li, Na, K) adsorption in ABC-Si$_4$Al$_2$, finding several available sites with high adsorption energies. Moreover, we computed the diffusion properties of those atoms along high-symmetry paths using the nudged elastic band method. The results indicated diffusion barriers as low as those in graphite, especially for Na (0.32 eV) and K (0.22 eV), which allows those ions to migrate easily on the material's surface. Our studies also revealed that the full loaded Li$_4$Si$_4$Al$_2$, Na$_2$Si$_4$Al$_2$, and K$_2$Si$_4$Al$_2$ systems provide low open-circuit voltage, ranging from 0.14 to 0.49 V, and large theoretical capacity of 645 mAh/g for Li- and 322 mAh/g for Na- and K-ion batteries, values that are close to the ones in other anode materials, such as graphite, TiO$_2$, and silicene-based systems. Those results indicate that aluminum functionalized few-layer silicene is a promising material for AMIBs anodes, particularly for Na- and K-ion batteries.


title: Prediction of the Optical Polarization and High Field Hyperfine Structure Via a Parametrized Crystal-Field Model for the Low Symmetry Centers in Er$^{3+}$ Doped Y$_{2}$SiO$_{5}$

abstract: We report on the development and application of a parametrized crystal-field model for both C$_{1}$ symmetry centers in trivalent erbium-doped Y$_{2}$SiO$_{5}$. High resolution Zeeman and temperature dependent absorption spectroscopy was performed to acquire the necessary experimental data. The obtained data, in addition to the ground ($^{4}$I$_{15/2}$Z$_{1}$) state and exited ($^{4}$I$_{13/2}$Y$_{1}$) state Zeeman and hyperfine structure, was simultaneously fitted in order to refine an existing crystal-field interpretation of the Er$^{3+}$:Y$_{2}$SiO$_{5}$ system. We demonstrate that it is possible to account for the electronic, magnetic and hyperfine structure of the full 4f$^{11}$ configuration of Er$^{3+}$:Y$_{2}$SiO$_{5}$ and further, that it is possible to predict both optical polarization behavior and high magnetic field hyperfine structure of transitions in the 1.5 $\mu$m telecommunications band.


title: Quasinormal modes and thermodynamic properties of GUP-corrected Schwarzschild black hole surrounded by quintessence

abstract: We study the Quasinormal Modes (QNMs) of the Schwarzschild black hole surrounded by a quintessence field after implementing the quantum corrections to its solution as required by the Generalised Uncertainty Principle (GUP). We analyse the dependence of the QNMs on the deformation parameters of GUP as well as on the quintessence parameter. In most cases the QNMs show the appreciable dependency on these parameters. For a better idea of the accuracy of calculations of QNMs, we compare the results of the QNMs obtained via Mashhoon method with the 6th order WKB method. A good agreement between these two methods of QNM calculations is seen depending on the different factors. Further, we study the thermodynamic properties of the GUP-corrected Schwarzschild black hole and check for any dependence with the deformation parameters and the quintessence parameter. In particular, we compute the Hawking temperature, heat capacity and entropy for the black hole and analyse the results graphically to show the dependency of the thermodynamic properties on the said parameters. We have seen that the thermodynamic properties of black holes also depend noticeably on the model parameters in most cases. Black hole remnants have been studied and it is shown that the possible existence of remnant radius as well as remnant temperature depends on the deformations introduced. However, it is observed that the GUP-corrected black hole constructed here can not become a remnant.


title: Context-aware Proposal Network for Temporal Action Detection

abstract: This technical report presents our first place winning solution for temporal action detection task in CVPR-2022 AcitivityNet Challenge. The task aims to localize temporal boundaries of action instances with specific classes in long untrimmed videos. Recent mainstream attempts are based on dense boundary matchings and enumerate all possible combinations to produce proposals. We argue that the generated proposals contain rich contextual information, which may benefits detection confidence prediction. To this end, our method mainly consists of the following three steps: 1) action classification and feature extraction by Slowfast, CSN, TimeSformer, TSP, I3D-flow, VGGish-audio, TPN and ViViT; 2) proposal generation. Our proposed Context-aware Proposal Network (CPN) builds on top of BMN, GTAD and PRN to aggregate contextual information by randomly masking some proposal features. 3) action detection. The final detection prediction is calculated by assigning the proposals with corresponding video-level classifcation results. Finally, we ensemble the results under different feature combination settings and achieve 45.8% performance on the test set, which improves the champion result in CVPR-2021 ActivityNet Challenge by 1.1% in terms of average mAP.


title: Universal Behavior of Opponent Statistics and Applications to the MLB

abstract: In most popular sports leagues, like the MLB, NBA, and NFL, none of the commonly used statistics take into account the strengths of the opponents a player faces. One of the main reasons for this is the conventional belief that a player's luck tends to even out over the course of a season. The other main reason is the difficulties of finding a sensible algorithm to both quantify the strengths of the opponents and incorporate such quantifications into a renormalization of a player's statistics. In this paper, we first argue that certain statistics, such as Earned Run Average (ERA) or Fielding Independent Pitching (FIP) can be significantly skewed by opponents' strengths in the MLB. We then present an algorithm to renormalize such statistics, using FIP as the main example. This is achieved by observing that certain opponent statistics for all 30 teams in the MLB (e.g. the collection of each game's opponent FIP value over the course of a season) follow a universal distribution, up to scaling and shift. This enables us to establish a data set for a hypothetical average team and to develop a pitching statistic based on FIP which accounts for the strength of a pitcher's schedule through methods based on equipercentile equating. It is called aFIP, which measures what a pitcher's FIP would have been if he had faced a league-average offensive team every time he pitched. We find that there is a significant difference between aFIP and FIP for some pitchers during the 2019 season and other seasons as well, adding a new tool for player evaluation. This could make millions of dollars of difference in player contracts and in profits for teams as they enhance the accuracy with which they make player acquisitions. The universal distribution we observed also has many possible future applications throughout the sports world.


title: Numerical Studies of Optimized Designs for Carbon Nanotube Microstrip Antennas

abstract: We perform systematic numerical simulations for carbon nanotube (CNT) film microstrip antennas to fabricate flexible and durable applications in terms of various device design parameters. The selection of appropriate materials for conductive films and a substrate of the conformable and robust microstrip antennas are crucial to increase the radiation efficiency and to reduce the losses while maintaining the mechanical properties. CNTs have been spotlighted as a promising nano-material, exhibiting excellent electrical and mechanical performances as desirable features for microwave wearable devices. Considering the material properties of the conductor and the substrate, we examine the possible ranges of the CNT film conductivities, conductive film thickness, and a dielectric constant and thickness of a substrate. Furthermore, we model non-uniform spatial distributions of conductivity in the CNT film to assess their impact on the antenna performance. Our extensive studies of material constants and conductivity spatial patterns propose design guidelines for optimal microstrip antennas made of CNT conductive films operating in microwave frequencies.


title: Ambiguity Tube MPC

abstract: This paper is about a class of distributionally robust model predictive controllers (MPC) for nonlinear stochastic processes that evaluate risk and control performance measures by propagating ambiguity sets in the space of state probability measures. A framework for formulating such ambiguity tube MPC controllers is presented, which is based on modern measure-theoretic methods from the field of optimal transport theory. Moreover, a supermartingale based analysis technique is proposed, leading to stochastic stability results for a large class of distributionally robust controllers for linear and nonlinear systems. In this context, we also discuss how to construct terminal cost functions for stochastic and distributionally robust MPC that ensure closed-loop stability and asymptotic convergence to robust invariant sets. The corresponding theoretical developments are illustrated by tutorial-style examples and a numerical case study.


title: Random Telegraph Noise of a 28-nm Cryogenic MOSFET in the Coulomb Blockade Regime

abstract: We observe rich phenomena of two-level random telegraph noise (RTN) from a commercial bulk 28-nm p-MOSFET (PMOS) near threshold at 14 K, where a Coulomb blockade (CB) hump arises from a quantum dot (QD) formed in the channel. Minimum RTN is observed at the CB hump where the high-current RTN level dramatically switches to the low-current level. The gate-voltage dependence of the RTN amplitude and power spectral density match well with the transconductance from the DC transfer curve in the CB hump region. Our work unequivocally captures these QD transport signatures in both current and noise, revealing quantum confinement effects in commercial short-channel PMOS even at 14 K, over 100 times higher than the typical dilution refrigerator temperatures of QD experiments (<100 mK). We envision that our reported RTN characteristics rooted from the QD and a defect trap would be more prominent for smaller technology nodes, where the quantum effect should be carefully examined in cryogenic CMOS circuit designs.


title: Solutions of the 2D Radially Symmetric Vlasov-Maxwell System with an Initial Focusing Phase

abstract: We study radially symmetric solutions to the 2D Vlasov-Maxwell system and construct solutions that initially possess arbitrarily small $C^k$ norms ($k \geq 1$) for the charge densities and the electric fields, but attain arbitrarily large $L^\infty$ norms of them at some later time.


title: Comparative study for two-terminal transport through a lossy one-dimensional quantum wire

abstract: Motivated by realization of the dissipative quantum point contact in ultracold atomic gases, we investigate a two-terminal mesoscopic transport system in which a single-particle loss is locally present in a one-dimensional chain. By means of the Dyson equation approach in the Keldysh formalism that can incorporate dissipative effects, we reveal analytic structures of the particle and energy currents whose formal expressions correspond to ones in certain three-terminal systems where the particle loss is absent. The obtained formulas are also consistent with non-hermitian and three-terminal Landauer-B\"{u}ttiiker analyses. The universality on the current expressions holds regardless of quantum statistics and may be useful for understanding lossy two-terminal transport in terms of three-terminal transport and vice versa.


title: A Dynamic Data Driven Approach for Explainable Scene Understanding

abstract: Scene-understanding is an important topic in the area of Computer Vision, and illustrates computational challenges with applications to a wide range of domains including remote sensing, surveillance, smart agriculture, robotics, autonomous driving, and smart cities. We consider the active explanation-driven understanding and classification of scenes. Suppose that an agent utilizing one or more sensors is placed in an unknown environment, and based on its sensory input, the agent needs to assign some label to the perceived scene. The agent can adjust its sensor(s) to capture additional details about the scene, but there is a cost associated with sensor manipulation, and as such, it is important for the agent to understand the scene in a fast and efficient manner. It is also important that the agent understand not only the global state of a scene (e.g., the category of the scene or the major events taking place in the scene) but also the characteristics/properties of the scene that support decisions and predictions made about the global state of the scene. Finally, when the agent encounters an unknown scene category, it must be capable of refusing to assign a label to the scene, requesting aid from a human, and updating its underlying knowledge base and machine learning models based on feedback provided by the human. We introduce a dynamic data driven framework for the active explanation-driven classification of scenes. Our framework is entitled ACUMEN: Active Classification and Understanding Method by Explanation-driven Networks. To demonstrate the utility of the proposed ACUMEN approach and show how it can be adapted to a domain-specific application, we focus on an example case study involving the classification of indoor scenes using an active robotic agent with vision-based sensors, i.e., an electro-optical camera.


title: From Understanding Genetic Drift to a Smart-Restart Mechanism for Estimation-of-Distribution Algorithms

abstract: Estimation-of-distribution algorithms (EDAs) are optimization algorithms that learn a distribution on the search space from which good solutions can be sampled easily. A key parameter of most EDAs is the sample size (population size). If the population size is too small, the update of the probabilistic model builds on few samples, leading to the undesired effect of genetic drift. Too large population sizes avoid genetic drift, but slow down the process. Building on a recent quantitative analysis of how the population size leads to genetic drift, we design a smart-restart mechanism for EDAs. By stopping runs when the risk for genetic drift is high, it automatically runs the EDA in good parameter regimes. Via a mathematical runtime analysis, we prove a general performance guarantee for this smart-restart scheme. This in particular shows that in many situations where the optimal (problem-specific) parameter values are known, the restart scheme automatically finds these, leading to the asymptotically optimal performance. We also conduct an extensive experimental analysis. On four classic benchmark problems, we clearly observe the critical influence of the population size on the performance, and we find that the smart-restart scheme leads to a performance close to the one obtainable with optimal parameter values. Our results also show that previous theory-based suggestions for the optimal population size can be far from the optimal ones, leading to a performance clearly inferior to the one obtained via the smart-restart scheme. We also conduct experiments with PBIL (cross-entropy algorithm) on two combinatorial optimization problems from the literature, the max-cut problem and the bipartition problem. Again, we observe that the smart-restart mechanism finds much better values for the population size than those suggested in the literature, leading to a much better performance.


title: Hodge Filtrations on Tempered Hodge Modules

abstract: We show that the Hodge filtration of a tempered Hodge module is generated by the lowest piece of its Hodge filtration. As a consequence, we prove the main conjecture of [SV] in the special case of tempered representations of real reductive Lie groups.


title: Dynamic and heterogeneous treatment effects with abrupt changes

abstract: From personalised medicine to targeted advertising, it is an inherent task to provide a sequence of decisions with historical covariates and outcome data. This requires understanding of both the dynamics and heterogeneity of treatment effects. In this paper, we are concerned with detecting abrupt changes in the treatment effects in terms of the conditional average treatment effect (CATE) in a sequential fashion. To be more specific, at each time point, we consider a nonparametric model to allow for maximal flexibility and robustness. Along the time, we allow for temporal dependence on historical covariates and noise functions. We provide a kernel-based change point estimator, which is shown to be consistent in terms of its detection delay, under an average run length control. Numerical results are provided to support our theoretical findings.


title: Dust Accretion onto Exoplanets

abstract: Accretion of interplanetary dust onto gas giant exoplanets is considered. Poynting-Robertson drag causes dust particles from distant reservoirs to slowly inspiral toward the star. Orbital simulations for the three-body system of the star, planet, and dust particle show that a significant fraction of the dust may accrete onto massive planets in close orbits. The deceleration of the supersonic dust in the planet's atmosphere is modeled, including ablation by thermal evaporation and sputtering. The fraction of the accreted dust mass deposited as gas-phase atoms is found to be large for close-in orbits and massive planets. If mass outflow and vertical mixing are sufficiently weak, the accreted dust produces a constant mixing ratio of atoms and remnant dust grains below the stopping layer. When vertical mixing is included along with settling, the solutions interpolate between the mixing ratio due to the meteoric source above the homopause, and that of the well-mixed deeper atmosphere below the homopause. The line opacity from atoms and continuum opacity from remnant dust may be observable in transmission spectra for sufficiently large dust accretion rates, a grain size distribution tilted toward the blowout size, and sufficiently weak vertical mixing. If mixing is strong, the meteoric source may still act to augment heavy elements mixed up from the deep atmosphere as well as provide nucleation sites for the formation of larger particles. The possible role of the Lorentz drag force in limiting the flow speeds and mixing coefficient for pressures $\la 1\, \rm mbar$ is discussed.


title: Free-Standing Epitaxial SrTiO$_3$ Nanomembranes via Remote Epitaxy using Hybrid Molecular Beam Epitaxy

abstract: The epitaxial growth of functional materials using a substrate with a graphene layer is a highly desirable method for improving structural quality and obtaining free-standing epitaxial nano-membranes for scientific study, applications, and economical reuse of substrates. However, the aggressive oxidizing conditions typically employed to grow epitaxial perovskite oxides can damage graphene. Here, we demonstrate a technique based on hybrid molecular beam epitaxy that does not require an independent oxygen source to achieve epitaxial growth of complex oxides without damaging the underlying graphene. The technique produces films with self-regulating cation stoichiometry control and epitaxial orientation to the oxide substrate. Furthermore, the films can be exfoliated and transferred to foreign substrates while leaving the graphene on the original substrate. These results open the door to future studies of previously unattainable free-standing nano-membranes grown in an adsorption-controlled manner by hybrid molecular beam epitaxy, and has potentially important implications for the commercial application of perovskite oxides in flexible electronics.


title: Necessary and sufficient conditions on existence of radial solutions for exterior Dirichlet problem of fully nonlinear elliptic equations

abstract: In this paper, we study the exterior Dirichlet problem for the fully nonlinear elliptic equation $f(\lambda(D^{2}u))=1$. We obtain the necessary and sufficient conditions of existence of radial solutions with prescribed asymptotic behavior at infinity.


title: A unified theory of emergent equilibrium phenomena in active and passive matter

abstract: Recent attempts towards a theory of active matter utilize concepts and methods from hydrodynamics, kinetic theory, and non-equilibrium statistical physics. However, such approaches typically do not seem to recognize the critical feature of some kinds of active matter (particularly the biological ones), namely, the role of purpose, and the naturally attendant concept of the pursuit of maximum utility, which we believe is the crucial difference between active and passive matter. Here we introduce a novel game-theoretic framework, statistical teleodynamics, that accounts for this feature explicitly and show how it can be integrated with conventional statistical mechanics to develop a unified theory of arbitrage equilibrium in active and passive matter. We propose a spectrum of self-actualizing capabilities, going from none to completely strategic decision-making, and envision the various examples of active matter systems occupying someplace in this spectrum. We show how statistical teleodynamics reduces to familiar results in statistical mechanics in the limit of zero self-actualization. At the other extreme, in an economic setting, it provides novel insights about the emergence of income distributions and their fairness in an ideal free-market society. As examples of agents in between these limits, we show how our theory predicts the behavior of active Brownian particles, the emergence of ant craters, and phase equilibria in social segregation dynamics. We suggest that our theory offers a novel systems theoretic perspective of emergent phenomena that could serve as the starting point for a more comprehensive theory of design, control, and optimization through self-organization.


title: Secure Embedding Aggregation for Federated Representation Learning

abstract: We consider a federated representation learning framework, where with the assistance of a central server, a group of $N$ distributed clients train collaboratively over their private data, for the representations (or embeddings) of a set of entities (e.g., users in a social network). Under this framework, for the key step of aggregating local embeddings trained privately at the clients, we develop a secure embedding aggregation protocol named \scheme, which leverages all potential aggregation opportunities among all the clients, while providing privacy guarantees for the set of local entities and corresponding embeddings \emph{simultaneously} at each client, against a curious server and up to $T < N/2$ colluding clients.


title: Existence and Minimax Theorems for Adversarial Surrogate Risks in Binary Classification

abstract: Adversarial training is one of the most popular methods for training methods robust to adversarial attacks, however, it is not well-understood from a theoretical perspective. We prove and existence, regularity, and minimax theorems for adversarial surrogate risks. Our results explain some empirical observations on adversarial robustness from prior work and suggest new directions in algorithm development. Furthermore, our results extend previously known existence and minimax theorems for the adversarial classification risk to surrogate risks.


title: The Consistency of Adversarial Training for Binary Classification

abstract: Robustness to adversarial perturbations is of paramount concern in modern machine learning. One of the state-of-the-art methods for training robust classifiers is adversarial training, which involves minimizing a supremum-based surrogate risk. The statistical consistency of surrogate risks is well understood in the context of standard machine learning, but not in the adversarial setting. In this paper, we characterize which supremum-based surrogates are consistent for distributions absolutely continuous with respect to Lebesgue measure in binary classification. Furthermore, we obtain quantitative bounds relating adversarial surrogate risks to the adversarial classification risk. Lastly, we discuss implications for the $\cH$-consistency of adversarial training.


title: Closed-form Error Propagation on the SE_n(3) Group for Invariant Extended Kalman Filtering with Applications to VINS

abstract: Pose estimation is important for robotic perception, path planning, etc. Robot poses can be modeled on matrix Lie groups and are usually estimated via filter-based methods. In this paper, we establish the closed-form formula for the error propagation for the Invariant extended Kalman filter (IEKF) in the presence of random noises and apply it to vision-aided inertial navigation. We evaluate our algorithm via numerical simulations and experiments on the OPENVINS platform. Both simulations and the experiments performed on the public EuRoC MAV datasets demonstrate that our algorithm outperforms some state-of-art filter-based methods such as the quaternion-based EKF, first estimates Jacobian EKF, etc.


title: Quantized Weyl algebras, the double centralizer property, and a new First Fundamental Theorem for $U_q(\mathfrak{gl}_n)$

abstract: Let $\mathcal P:=\mathcal P_{m\times n}$ denote the quantized coordinate ring of the space of $m\times n$ matrices, equipped with natural actions of the quantized enveloping algebras $U_q(\mathfrak{gl}_m)$ and $U_q(\mathfrak{gl}_n)$. Let $\mathcal L$ and $\mathcal R$ denote the images of $U_q(\mathfrak{gl}_m)$ and $U_q(\mathfrak{gl}_n)$ in $\mathrm{End}(\mathcal P)$, respectively. We define a $q$-analogue of the algebra of polynomial-coefficient differential operators inside $\mathrm{End}(\mathcal P)$, henceforth denoted by $\mathcal{PD}$, and we prove that $\mathcal L\cap \mathcal{PD}$ and $\mathcal{R}\cap \mathcal{PD}$ are mutual centralizers inside $\mathcal{PD}$. Using this, we establish a new First Fundamental Theorem of invariant theory for $U_q(\mathfrak{gl}_n)$. We also compute explicit formulas in terms of $q$-determinants for generators of the intersections with $\mathcal{PD}$ of the images of the Cartan subalgebras of $U_q(\mathfrak{gl}_m)$ and $U_q(\mathfrak{gl}_n)$.


title: Decoupled Federated Learning for ASR with Non-IID Data

abstract: Automatic speech recognition (ASR) with federated learning (FL) makes it possible to leverage data from multiple clients without compromising privacy. The quality of FL-based ASR could be measured by recognition performance, communication and computation costs. When data among different clients are not independently and identically distributed (non-IID), the performance could degrade significantly. In this work, we tackle the non-IID issue in FL-based ASR with personalized FL, which learns personalized models for each client. Concretely, we propose two types of personalized FL approaches for ASR. Firstly, we adapt the personalization layer based FL for ASR, which keeps some layers locally to learn personalization models. Secondly, to reduce the communication and computation costs, we propose decoupled federated learning (DecoupleFL). On one hand, DecoupleFL moves the computation burden to the server, thus decreasing the computation on clients. On the other hand, DecoupleFL communicates secure high-level features instead of model parameters, thus reducing communication cost when models are large. Experiments demonstrate two proposed personalized FL-based ASR approaches could reduce WER by 2.3% - 3.4% compared with FedAvg. Among them, DecoupleFL has only 11.4% communication and 75% computation cost compared with FedAvg, which is also significantly less than the personalization layer based FL.


title: Identifying Source Speakers for Voice Conversion based Spoofing Attacks on Speaker Verification Systems

abstract: An automatic speaker verification system aims to verify the speaker identity of a speech signal. However, a voice conversion system could manipulate a person's speech signal to make it sound like another speaker's voice and deceive the speaker verification system. Most countermeasures for voice conversion-based spoofing attacks are designed to discriminate bona fide speech from spoofed speech for speaker verification systems. In this paper, we investigate the problem of source speaker identification -- inferring the identity of the source speaker given the voice converted speech. To perform source speaker identification, we simply add voice-converted speech data with the label of source speaker identity to the genuine speech dataset during speaker embedding network training. Experimental results show the feasibility of source speaker identification when training and testing with converted speeches from the same voice conversion model(s). In addition, our results demonstrate that having more converted utterances from various voice conversion model for training helps improve the source speaker identification performance on converted utterances from unseen voice conversion models.


title: Score-Guided Intermediate Layer Optimization: Fast Langevin Mixing for Inverse Problems

abstract: We prove fast mixing and characterize the stationary distribution of the Langevin Algorithm for inverting random weighted DNN generators. This result extends the work of Hand and Voroninski from efficient inversion to efficient posterior sampling. In practice, to allow for increased expressivity, we propose to do posterior sampling in the latent space of a pre-trained generative model. To achieve that, we train a score-based model in the latent space of a StyleGAN-2 and we use it to solve inverse problems. Our framework, Score-Guided Intermediate Layer Optimization (SGILO), extends prior work by replacing the sparsity regularization with a generative prior in the intermediate layer. Experimentally, we obtain significant improvements over the previous state-of-the-art, especially in the low measurement regime.


title: Graphite forms via annihilation of screw dislocations

abstract: Graphite is the thermodynamically stable form of carbon, and yet is remarkably difficult to synthesise. A key step in graphite formation is the removal of defects at high temperature ($>$2300~$^{\circ}$C) that allow graphenic fragments to rearrange into ordered crystallites. We find the critical defect controlling graphitisation is a screw dislocation that winds through the layers like a spiral staircase, inhibiting lateral growth of the graphenic crystallites ($L_a$) and preventing AB stacking of Bernal graphite. High-resolution transmission electron microscopy (HRTEM) identifies screws as interdigitated fringes with narrow focal depth in graphitising polyvinyl chloride (PVC). Molecular dynamics simulations of parallel graphenic fragments confirm that screws spontaneously form during heating, with higher annealing temperature driving screw annihilation and crystallite growth. The time evolution of graphitisation is tracked via X-ray diffraction (XRD), showing the growth of $L_a$ and reduction of the interlayer spacing consistent with molecular dynamics of screw annihilation. This mechanistic insight raises opportunities to lower the barrier for graphitisation as well as broadening the range of carbonaceous materials that can turn into graphite, thereby lowering the cost of synthetic graphite used in lithium-ion batteries, carbon fibre, and electrodes for smelting.


title: Embodied Scene-aware Human Pose Estimation

abstract: We propose embodied scene-aware human pose estimation where we estimate 3D poses based on a simulated agent's proprioception and scene awareness, along with external third-person observations. Unlike prior methods that often resort to multistage optimization, non-causal inference, and complex contact modeling to estimate human pose and human scene interactions, our method is one-stage, causal, and recovers global 3D human poses in a simulated environment. Since 2D third-person observations are coupled with the camera pose, we propose to disentangle the camera pose and use a multi-step projection gradient defined in the global coordinate frame as the movement cue for our embodied agent. Leveraging a physics simulation and prescanned scenes (e.g., 3D mesh), we simulate our agent in everyday environments (library, office, bedroom, etc.) and equip our agent with environmental sensors to intelligently navigate and interact with the geometries of the scene. Our method also relies only on 2D keypoints and can be trained on synthetic datasets derived from popular human motion databases. To evaluate, we use the popular H36M and PROX datasets and achieve high quality pose estimation on the challenging PROX dataset without ever using PROX motion sequences for training. Code and videos are available on the project page.


title: Tree-Guided Rare Feature Selection and Logic Aggregation with Electronic Health Records Data

abstract: Statistical learning with a large number of rare binary features is commonly encountered in analyzing electronic health records (EHR) data, especially in the modeling of disease onset with prior medical diagnoses and procedures. Dealing with the resulting highly sparse and large-scale binary feature matrix is notoriously challenging as conventional methods may suffer from a lack of power in testing and inconsistency in model fitting while machine learning methods may suffer from the inability of producing interpretable results or clinically-meaningful risk factors. To improve EHR-based modeling and utilize the natural hierarchical structure of disease classification, we propose a tree-guided feature selection and logic aggregation approach for large-scale regression with rare binary features, in which dimension reduction is achieved through not only a sparsity pursuit but also an aggregation promoter with the logic operator of ``or''. We convert the combinatorial problem into a convex linearly-constrained regularized estimation, which enables scalable computation with theoretical guarantees. In a suicide risk study with EHR data, our approach is able to select and aggregate prior mental health diagnoses as guided by the diagnosis hierarchy of the International Classification of Diseases. By balancing the rarity and specificity of the EHR diagnosis records, our strategy improves both prediction and model interpretation. We identify important higher-level categories and subcategories of mental health conditions and simultaneously determine the level of specificity needed for each of them in predicting suicide risk.


title: Nontriviality of the first Hochschild cohomology of some block algebras of finite groups

abstract: We show that for some finite group block algebras, with nontrivial defect groups, the first Hochschild cohomology is nontrivial. Along the way we obtain methods to investigate the nontriviality of the first Hochschild cohomology of some twisted group algebras.


title: Fast and Provable Tensor Robust Principal Component Analysis via Scaled Gradient Descent

abstract: An increasing number of data science and machine learning problems rely on computation with tensors, which better capture the multi-way relationships and interactions of data than matrices. When tapping into this critical advantage, a key challenge is to develop computationally efficient and provably correct algorithms for extracting useful information from tensor data that are simultaneously robust to corruptions and ill-conditioning. This paper tackles tensor robust principal component analysis (RPCA), which aims to recover a low-rank tensor from its observations contaminated by sparse corruptions, under the Tucker decomposition. To minimize the computation and memory footprints, we propose to directly recover the low-dimensional tensor factors -- starting from a tailored spectral initialization -- via scaled gradient descent (ScaledGD), coupled with an iteration-varying thresholding operation to adaptively remove the impact of corruptions. Theoretically, we establish that the proposed algorithm converges linearly to the true low-rank tensor at a constant rate that is independent with its condition number, as long as the level of corruptions is not too large. Empirically, we demonstrate that the proposed algorithm achieves better and more scalable performance than state-of-the-art matrix and tensor RPCA algorithms through synthetic experiments and real-world applications.


title: Hochschild cohomology of some finite category algebras as simplicial cohomology

abstract: By a result of Gerstenhaber and Schack the simplicial cohomology ring $H^*(\mathcal{C};k)$ of a poset $\mathcal{C}$ is isomorphic to the Hochschild cohomology ring $HH^*(k\mathcal{C})$ of the category algebra $k\mathcal{C}$, where the poset is viewed as a category and $k$ is a field. Extending results of Mishchenko [6], under certain assumptions on a category $\mathcal{C}$, we construct a category $\mathcal{D}$ and a graded $k$-linear isomorphism $HH^*(k\mathcal{C})\cong H^*(\mathcal{D}; k)$. Interpreting the degree one cohomology, we also show how the $k$-space of derivations on $k\mathcal{C}$, graded by some semigroup, corresponds to the $k$-space of characters on $\mathcal{D}$.


title: VReBERT: A Simple and Flexible Transformer for Visual Relationship Detection

abstract: Visual Relationship Detection (VRD) impels a computer vision model to 'see' beyond an individual object instance and 'understand' how different objects in a scene are related. The traditional way of VRD is first to detect objects in an image and then separately predict the relationship between the detected object instances. Such a disjoint approach is prone to predict redundant relationship tags (i.e., predicate) between the same object pair with similar semantic meaning, or incorrect ones that have a similar meaning to the ground truth but are semantically incorrect. To remedy this, we propose to jointly train a VRD model with visual object features and semantic relationship features. To this end, we propose VReBERT, a BERT-like transformer model for Visual Relationship Detection with a multi-stage training strategy to jointly process visual and semantic features. We show that our simple BERT-like model is able to outperform the state-of-the-art VRD models in predicate prediction. Furthermore, we show that by using the pre-trained VReBERT model, our model pushes the state-of-the-art zero-shot predicate prediction by a significant margin (+8.49 R@50 and +8.99 R@100).


title: Decoupled Dynamic Spatial-Temporal Graph Neural Network for Traffic Forecasting

abstract: We all depend on mobility, and vehicular transportation affects the daily lives of most of us. Thus, the ability to forecast the state of traffic in a road network is an important functionality and a challenging task. Traffic data is often obtained from sensors deployed in a road network. Recent proposals on spatial-temporal graph neural networks have achieved great progress at modeling complex spatial-temporal correlations in traffic data, by modeling traffic data as a diffusion process. However, intuitively, traffic data encompasses two different kinds of hidden time series signals, namely the diffusion signals and inherent signals. Unfortunately, nearly all previous works coarsely consider traffic signals entirely as the outcome of the diffusion, while neglecting the inherent signals, which impacts model performance negatively. To improve modeling performance, we propose a novel Decoupled Spatial-Temporal Framework (DSTF) that separates the diffusion and inherent traffic information in a data-driven manner, which encompasses a unique estimation gate and a residual decomposition mechanism. The separated signals can be handled subsequently by the diffusion and inherent modules separately. Further, we propose an instantiation of DSTF, Decoupled Dynamic Spatial-Temporal Graph Neural Network (D2STGNN), that captures spatial-temporal correlations and also features a dynamic graph learning module that targets the learning of the dynamic characteristics of traffic networks. Extensive experiments with four real-world traffic datasets demonstrate that the framework is capable of advancing the state-of-the-art.


title: Pre-training Enhanced Spatial-temporal Graph Neural Network for Multivariate Time Series Forecasting

abstract: Multivariate Time Series (MTS) forecasting plays a vital role in a wide range of applications. Recently, Spatial-Temporal Graph Neural Networks (STGNNs) have become increasingly popular MTS forecasting methods. STGNNs jointly model the spatial and temporal patterns of MTS through graph neural networks and sequential models, significantly improving the prediction accuracy. But limited by model complexity, most STGNNs only consider short-term historical MTS data, such as data over the past one hour. However, the patterns of time series and the dependencies between them (i.e., the temporal and spatial patterns) need to be analyzed based on long-term historical MTS data. To address this issue, we propose a novel framework, in which STGNN is Enhanced by a scalable time series Pre-training model (STEP). Specifically, we design a pre-training model to efficiently learn temporal patterns from very long-term history time series (e.g., the past two weeks) and generate segment-level representations. These representations provide contextual information for short-term time series input to STGNNs and facilitate modeling dependencies between time series. Experiments on three public real-world datasets demonstrate that our framework is capable of significantly enhancing downstream STGNNs, and our pre-training model aptly captures temporal patterns.


title: Bear the Query in Mind: Visual Grounding with Query-conditioned Convolution

abstract: Visual grounding is a task that aims to locate a target object according to a natural language expression. As a multi-modal task, feature interaction between textual and visual inputs is vital. However, previous solutions mainly handle each modality independently before fusing them together, which does not take full advantage of relevant textual information while extracting visual features. To better leverage the textual-visual relationship in visual grounding, we propose a Query-conditioned Convolution Module (QCM) that extracts query-aware visual features by incorporating query information into the generation of convolutional kernels. With our proposed QCM, the downstream fusion module receives visual features that are more discriminative and focused on the desired object described in the expression, leading to more accurate predictions. Extensive experiments on three popular visual grounding datasets demonstrate that our method achieves state-of-the-art performance. In addition, the query-aware visual features are informative enough to achieve comparable performance to the latest methods when directly used for prediction without further multi-modal fusion.


title: Killed Distribution Dependent SDE for Nonlinear Dirichlet Problem

abstract: To characterize nonlinear Dirichlet problems in an open domain, we investigate killed distribution dependent SDEs. By constructing the coupling by projection and using the Zvonkin/Girsanov transforms, the well-posedness is proved for three different situations: 1) monotone case with distribution dependent noise (possibly degenerate), 2) singular case with non-degenerate distribution dependent noise, and 3) singular case with non-degenerate distribution independent noise. In the first two cases the domain is $C^2$ smooth such that the Lipschitz continuity in initial distributions is also derived, and in the last case the domain is arbitrary.


title: Person-job fit estimation from candidate profile and related recruitment history with co-attention neural networks

abstract: Existing online recruitment platforms depend on automatic ways of conducting the person-job fit, whose goal is matching appropriate job seekers with job positions. Intuitively, the previous successful recruitment records contain important information, which should be helpful for the current person-job fit. Existing studies on person-job fit, however, mainly focus on calculating the similarity between the candidate resumes and the job postings on the basis of their contents, without taking the recruiters' experience (i.e., historical successful recruitment records) into consideration. In this paper, we propose a novel neural network approach for person-job fit, which estimates person-job fit from candidate profile and related recruitment history with co-attention neural networks (named PJFCANN). Specifically, given a target resume-job post pair, PJFCANN generates local semantic representations through co-attention neural networks and global experience representations via graph neural networks. The final matching degree is calculated by combining these two representations. In this way, the historical successful recruitment records are introduced to enrich the features of resumes and job postings and strengthen the current matching process. Extensive experiments conducted on a large-scale recruitment dataset verify the effectiveness of PJFCANN compared with several state-of-the-art baselines. The codes are released at: https://github.com/CCIIPLab/PJFCANN.


title: NISPA: Neuro-Inspired Stability-Plasticity Adaptation for Continual Learning in Sparse Networks

abstract: The goal of continual learning (CL) is to learn different tasks over time. The main desiderata associated with CL are to maintain performance on older tasks, leverage the latter to improve learning of future tasks, and to introduce minimal overhead in the training process (for instance, to not require a growing model or retraining). We propose the Neuro-Inspired Stability-Plasticity Adaptation (NISPA) architecture that addresses these desiderata through a sparse neural network with fixed density. NISPA forms stable paths to preserve learned knowledge from older tasks. Also, NISPA uses connection rewiring to create new plastic paths that reuse existing knowledge on novel tasks. Our extensive evaluation on EMNIST, FashionMNIST, CIFAR10, and CIFAR100 datasets shows that NISPA significantly outperforms representative state-of-the-art continual learning baselines, and it uses up to ten times fewer learnable parameters compared to baselines. We also make the case that sparsity is an essential ingredient for continual learning. The NISPA code is available at https://github.com/BurakGurbuz97/NISPA.


title: Set-theoretical entropies of weighted generalized shifts

abstract: In this paper for a finite field $F$, a nonempty set $\Gamma$, a self--map $\varphi:\Gamma\to\Gamma$ and a weight vector $\mathfrak{w}\in F^\Gamma$, we show that the set--theoretical entropy of the weighted generalized shift $\sigma_{\varphi,\mathfrak{w}}:F^\Gamma\to F^\Gamma$ is either zero or $+\infty$, moreover it is equal to zero if and only if $\sigma_{\varphi,\mathfrak{w}}$ is quasi--periodic. On the other hand after characterizing all conditions under which $\sigma_{\varphi,\mathfrak{w}}:F^\Gamma\to F^\Gamma$ is of finite fibre, we show that the cotravariant set--theoretical entropy of the finite fibre $\sigma_{\varphi,\mathfrak{w}}:F^\Gamma\to F^\Gamma$ depends only on $\varphi$ and $\rm{supp}(\mathfrak{w})$. In final sections we study the restriction of $\sigma_{\varphi,\mathfrak{w}}$ to the direct sum $\mathop{\bigoplus}\limits_{\Gamma}F$.


title: Ultrafast electronic heat dissipation through surface-to-bulk Coulomb coupling in quantum materials

abstract: The timescale of electronic cooling is an important parameter controlling the performance of devices based on quantum materials for optoelectronic, thermoelectric and thermal management applications. In most conventional materials, cooling proceeds via the emission of phonons, a relatively slow process that can bottleneck the carrier relaxation dynamics, thus degrading the device performance. Here we present the theory of near-field radiative heat transfer, that occurs when a two-dimensional electron system is coupled via the non-retarded Coulomb interaction to a three-dimensional bulk that can behave as a very efficient electronic heat sink. We apply our theory to study the cooling dynamics of surface states of three dimensional topological insulators, and of graphene in proximity to small-gap bulk materials. The ``Coulomb cooling'' we introduce is alternative to the conventional phonon-mediated cooling, can be very efficient and dominate the cooling dynamics under certain circumstances. We show that this cooling mechanism can lead to a sub-picosecond time scale, significantly faster than the cooling dynamics normally observed in Dirac materials.


title: Pursuit of a Discriminative Representation for Multiple Subspaces via Sequential Games

abstract: We consider the problem of learning discriminative representations for data in a high-dimensional space with distribution supported on or around multiple low-dimensional linear subspaces. That is, we wish to compute a linear injective map of the data such that the features lie on multiple orthogonal subspaces. Instead of treating this learning problem using multiple PCAs, we cast it as a sequential game using the closed-loop transcription (CTRL) framework recently proposed for learning discriminative and generative representations for general low-dimensional submanifolds. We prove that the equilibrium solutions to the game indeed give correct representations. Our approach unifies classical methods of learning subspaces with modern deep learning practice, by showing that subspace learning problems may be provably solved using the modern toolkit of representation learning. In addition, our work provides the first theoretical justification for the CTRL framework, in the important case of linear subspaces. We support our theoretical findings with compelling empirical evidence. We also generalize the sequential game formulation to more general representation learning problems. Our code, including methods for easy reproduction of experimental results, is publically available on GitHub.


title: Linear subspaces in cubic hypersurfaces

abstract: We prove that for any cubic polynomial of slice rank $r$, the intersection of all linear subspaces of minimal codimension contained in the corresponding hypersurface has codimension $\le r^2+\frac{(r+1)^2}{4}+r$ in the affine space. This is deduced from the following result of independent interest. Consider the intersection $I$ of linear ideals $(P_i)$ in $k[x_1,\ldots,x_n]$, with $\dim P_i\le r$. Then the number of quadratic generators of $I$ is $\le r^2$.


title: Measuring Lower Bounds of Local Differential Privacy via Adversary Instantiations in Federated Learning

abstract: Local differential privacy (LDP) gives a strong privacy guarantee to be used in a distributed setting like federated learning (FL). LDP mechanisms in FL protect a client's gradient by randomizing it on the client; however, how can we interpret the privacy level given by the randomization? Moreover, what types of attacks can we mitigate in practice? To answer these questions, we introduce an empirical privacy test by measuring the lower bounds of LDP. The privacy test estimates how an adversary predicts if a reported randomized gradient was crafted from a raw gradient $g_1$ or $g_2$. We then instantiate six adversaries in FL under LDP to measure empirical LDP at various attack surfaces, including a worst-case attack that reaches the theoretical upper bound of LDP. The empirical privacy test with the adversary instantiations enables us to interpret LDP more intuitively and discuss relaxation of the privacy parameter until a particular instantiated attack surfaces. We also demonstrate numerical observations of the measured privacy in these adversarial settings, and the worst-case attack is not realistic in FL. In the end, we also discuss the possible relaxation of privacy levels in FL under LDP.


title: POD-ROMs for incompressible flows including snapshots of the temporal derivative of the full order solution

abstract: In this paper we study the influence of including snapshots that approach the velocity time derivative in the numerical approximation of the incompressible Navier-Stokes equations by means of proper orthogonal decomposition (POD) methods. Our set of snapshots includes the velocity approximation at the initial time from a full order mixed finite element method (FOM) together with approximations to the time derivative at different times. The approximation at the initial velocity can be replaced by the mean value of the velocities at the different times so that implementing the method to the fluctuations, as done mostly in practice, only approximations to the time derivatives are included in the set of snapshots. For the POD method we study the differences between projecting onto $L^2$ and $H^1$. In both cases pointwise in time error bounds can be proved. Including grad-div stabilization both in the FOM and POD methods error bounds with constants independent on inverse powers of the viscosity can be obtained.


title: Lorentzian Taub-NUT spacetimes: Misner string charges and the first law

abstract: Motivated by recent activities in Lorentzian Taub-NUT space thermodynamics, we calculate conserved charges of these spacetimes. We find additional mass, nut, angular momentum, electric and magnetic charge densities distributed along Misner string. These additional charges are needed to account for the difference between the values of the above charges at horizon and at infinity. We propose an unconstrained thermodynamical treatment for Taub-NUT spaces, where we introduce the nut charge $n$ as a relevant thermodynamic quantity with its chemical potential \phi_n. The internal energy in this treatment is M-n\phi_n rather than the mass M. This approach leads to an entropy which is a quarter of the area of the horizon and all thermodynamic quantities satisfy the first law, Gibbs-Duhem relation as well as Smarr's relation. We found a general form of the first law where the quantities depend on an arbitrary parameter. Demanding that the first law is independent of this arbitrary parameter or invariant under electric-magnetic duality leads to a unique form which depends on Misner string electric and magnetic charges. Misner string charges play an essential role in the first law, without them the first law is not satisfied.


title: High Density Vertical Optical Interconnects for Passive Assembly

abstract: The co-packaging of optics and electronics provides a potential path forward to achieving beyond 50 Tbps top of rack switch packages. In a co-packaged design, the scaling of bandwidth, cost, and energy is governed by the number of optical transceivers (TxRx) per package as opposed to transistor shrink. Due to the large footprint of optical components relative to their electronic counterparts, the vertical stacking of optical TxRx chips in a co-packaged optics design will become a necessity. As a result, development of efficient, dense, and wide alignment tolerance chip-to-chip optical couplers will be an enabling technology for continued TxRx scaling. In this paper, we propose a novel scheme to vertically couple into standard 220 nm silicon on insulator waveguides from 220 nm silicon nitride on glass waveguides using overlapping, inverse double tapers. Simulation results using Lumerical's 3D Finite Difference Time Domain solver solver are presented, demonstrating insertion losses below -0.13 dB for an inter-chip spacing of 1 $\mu$m, 1 dB vertical and lateral alignment tolerances of approximately $\pm$ 2.7 $\mu$m, a greater than 300 nm 1 dB bandwidth, and 1 dB twist and tilt tolerance of approximately 2.3 degrees and 0.4 degrees, respectively. These results demonstrate the potential of our coupler for use in co-packaged designs requiring high performance, high density, CMOS compatible out of plane optical connections.


title: Quantifying the value of transient voltage sources

abstract: Some voltage sources are transient, lasting only for a moment of time, such as the voltage generated by converting a human motion into electricity. Such sources moreover tend to have a degree of randomness as well as internal resistance. We investigate how to put a number to how valuable a given transient source is. We derive several candidate measures via a systematic approach. We establish an inter-convertibility hierarchy between such sources, where inter-conversion means adding passive interface circuits to the sources. Resistors at the ambient temperature are at the bottom of this hierarchy and sources with low internal resistance and high internal voltages are at the top. We provide three possible measures for a given source that assign a number to the source respecting this hierarchy. One measure captures how much ``unitdc" the source contains, meaning $1$ V dc with $1\Omega$ internal resistance for $1$s. Another measure relates to the signal-to-noise ratio of the voltage time-series whereas a third is based on the relative entropy between the voltage probability distribution and a thermal noise resistor. We argue that the unitdc measure is particularly useful by virtue of its operational interpretation in terms of the number of unit dc sources that one needs to combine to create the source or that can be distilled from the source.

categories: cond-mat.stat-mech eess.SP physics.app-ph quant-ph


title: Nonparametric Multi-shape Modeling with Uncertainty Quantification

abstract: The modeling and uncertainty quantification of closed curves is an important problem in the field of shape analysis, and can have significant ramifications for subsequent statistical tasks. Many of these tasks involve collections of closed curves, which often exhibit structural similarities at multiple levels. Modeling multiple closed curves in a way that efficiently incorporates such between-curve dependence remains a challenging problem. In this work, we propose and investigate a multiple-output (a.k.a. multi-output), multi-dimensional Gaussian process modeling framework. We illustrate the proposed methodological advances, and demonstrate the utility of meaningful uncertainty quantification, on several curve and shape-related tasks. This model-based approach not only addresses the problem of inference on closed curves (and their shapes) with kernel constructions, but also opens doors to nonparametric modeling of multi-level dependence for functional objects in general.


title: A Combined PCA-MLP Network for Early Breast Cancer Detection

abstract: Breast cancer is the second most responsible for all cancer types and has been the cause of numerous deaths over the years, especially among women. Any improvisation of the existing diagnosis system for the detection of cancer can contribute to minimizing the death ratio. Moreover, cancer detection at an early stage has recently been a prime research area in the scientific community to enhance the survival rate. Proper choice of machine learning tools can ensure early-stage prognosis with high accuracy. In this paper, we have studied different machine learning algorithms to detect whether a patient is likely to face breast cancer or not. Due to the implicit behavior of early-stage features, we have implemented a multilayer perception model with the integration of PCA and suggested it to be more viable than other detection algorithms. Our 4 layers MLP-PCA network has obtained the best accuracy of 100% with a mean of 90.48% accuracy on the BCCD dataset.


title: Identities of the stylic monoid

abstract: We observe that for each $n\ge 2$, the identities of the stylic monoid with $n$ generators coincide with the identities of $n$-generated monoids from other distinguished series of $\mathscr{J}$-trivial monoids studied in the literature, e.g., Catalan monoids and Kiselman monoids. This solves the Finite Basis Problem for stylic monoids.


title: Critical Curvature of Algebraic Surfaces in Three-Space

abstract: We study the curvature of a smooth algebraic surface $X\subset \mathbb R^3$ of degree $d$ from the point of view of algebraic geometry. More precisely, we consider umbilical points and points of critical curvature. We prove that the number of complex critical curvature points is of order $d^3$. For general quadrics, we fully characterize the number of real and complex umbilics and critical curvature points.


title: Tackling Spoofing-Aware Speaker Verification with Multi-Model Fusion

abstract: Recent years have witnessed the extraordinary development of automatic speaker verification (ASV). However, previous works show that state-of-the-art ASV models are seriously vulnerable to voice spoofing attacks, and the recently proposed high-performance spoofing countermeasure (CM) models only focus solely on the standalone anti-spoofing tasks, and ignore the subsequent speaker verification process. How to integrate the CM and ASV together remains an open question. A spoofing aware speaker verification (SASV) challenge has recently taken place with the argument that better performance can be delivered when both CM and ASV subsystems are optimized jointly. Under the challenge's scenario, the integrated systems proposed by the participants are required to reject both impostor speakers and spoofing attacks from target speakers, which intuitively and effectively matches the expectation of a reliable, spoofing-robust ASV system. This work focuses on fusion-based SASV solutions and proposes a multi-model fusion framework to leverage the power of multiple state-of-the-art ASV and CM models. The proposed framework vastly improves the SASV-EER from 8.75% to 1.17\%, which is 86% relative improvement compared to the best baseline system in the SASV challenge.


title: Replacing Labeled Real-image Datasets with Auto-generated Contours

abstract: In the present work, we show that the performance of formula-driven supervised learning (FDSL) can match or even exceed that of ImageNet-21k without the use of real images, human-, and self-supervision during the pre-training of Vision Transformers (ViTs). For example, ViT-Base pre-trained on ImageNet-21k shows 81.8% top-1 accuracy when fine-tuned on ImageNet-1k and FDSL shows 82.7% top-1 accuracy when pre-trained under the same conditions (number of images, hyperparameters, and number of epochs). Images generated by formulas avoid the privacy/copyright issues, labeling cost and errors, and biases that real images suffer from, and thus have tremendous potential for pre-training general models. To understand the performance of the synthetic images, we tested two hypotheses, namely (i) object contours are what matter in FDSL datasets and (ii) increased number of parameters to create labels affects performance improvement in FDSL pre-training. To test the former hypothesis, we constructed a dataset that consisted of simple object contour combinations. We found that this dataset can match the performance of fractals. For the latter hypothesis, we found that increasing the difficulty of the pre-training task generally leads to better fine-tuning accuracy.


title: Efficacy of Asynchronous GPS Spoofing Against High Volume Consumer GNSS Receivers

abstract: The vulnerability of the Global Positioning System (GPS) against spoofing is known for quite some time. Also, the positioning and navigation of most semi-autonomous and autonomous drones are dependent on Global Navigation Satellite System (GNSS) signals. In prior work, simplistic or asynchronous GPS spoofing was found to be a simple, efficient, and effective cyber attack against L1 GPS or GNSS dependent commercial drones. In this paper, first we make some important observations on asynchronous GPS spoofing attacks on drones presented in prior research literature. Then, we design an asynchronous GPS spoofing attack plan. Next, we test the effectiveness of this attack against GNSS receivers (high volume consumer devices based on Android mobile phones) of different capabilities and a commercial drone (DJI Mavic 2 Pro) under various conditions. Finally, we present several novel insights based on the results of the tests.


title: A modular relation involving non-trivial zeros of the Dedekind zeta function, and the Generalized Riemann Hypothesis

abstract: We give a number field analogue of a result of Ramanujan, Hardy and Littlewood, thereby obtaining a modular relation involving the non-trivial zeros of the Dedekind zeta function. We also provide a Riesz-type criterion for the Generalized Riemann Hypothesis for $\zeta_K(s)$. New elegant transformations are obtained when $K$ is a quadratic extension, one of which involves the modified Bessel function of the second kind.


title: Spatial distribution of dark matter in and around galaxy clusters traced by galaxies, gas and intracluster stars in a simulated universe

abstract: To understand how well galaxies, gas and intracluster stars trace dark matter in and around galaxy clusters, we use the IllustrisTNG cosmological hydrodynamical simulation and compare the spatial distribution of dark matter with those of baryonic components in clusters. To quantify the global morphology of the density distribution of each component in clusters, we fit an ellipse to the density contour of each component and derive shape parameters at different radii. We find that ellipticity of dark matter is better correlated with that of galaxy mass-weighted number density, rather than with that of galaxy number density or galaxy velocity dispersion. We thus use the galaxy mass-weighted number density map as a representative of the galaxy maps. Among three different density maps from galaxies, gas, and intracluster stars, the ellipticity of dark matter is best reproduced by that of the galaxy map over the entire radii. The 'virialized' galaxy clusters show a better correlation of spatial distribution between dark matter and other components than the 'unvirialized' clusters, suggesting that it requires some time for each component to follow the spatial distribution of dark matter after merging events. Our results demonstrate that galaxies are still good tracers of dark matter distribution even in the non-linear regime corresponding to the scales in and around galaxy clusters, being consistent with the case where galaxies trace well the matter distribution in cosmologically large scales.


title: Provable Generalization of Overparameterized Meta-learning Trained with SGD

abstract: Despite the superior empirical success of deep meta-learning, theoretical understanding of overparameterized meta-learning is still limited. This paper studies the generalization of a widely used meta-learning approach, Model-Agnostic Meta-Learning (MAML), which aims to find a good initialization for fast adaptation to new tasks. Under a mixed linear regression model, we analyze the generalization properties of MAML trained with SGD in the overparameterized regime. We provide both upper and lower bounds for the excess risk of MAML, which captures how SGD dynamics affect these generalization bounds. With such sharp characterizations, we further explore how various learning parameters impact the generalization capability of overparameterized MAML, including explicitly identifying typical data and task distributions that can achieve diminishing generalization error with overparameterization, and characterizing the impact of adaptation learning rate on both excess risk and the early stopping time. Our theoretical findings are further validated by experiments.


title: Isomorphisms of $\mathcal{C}(K, E)$ spaces and height of $K$

abstract: Let $K_1$, $K_2$ be compact Hausdorff spaces and $E_1, E_2$ be Banach spaces not containing a copy of $c_0$. We establish lower estimates of the Banach-Mazur distance between the spaces of continuous functions $\mathcal{C}(K_1, E_1)$ and $\mathcal{C}(K_2, E_2)$ based on the ordinals $ht(K_1)$, $ht(K_2)$, which are new even for the case of spaces of real valued functions on ordinal intervals. As a corollary we deduce that $\mathcal{C}(K_1, E_1)$ and $\mathcal{C}(K_2, E_2)$ are not isomorphic if $ht(K_1)$ is substantially different from $ht(K_2)$.


title: Application of a General Family of Bivariate Distributions in Modelling Dependent Competing Risks Data with Associated Model Selection

abstract: In this article, a general family of bivariate distributions is used to model competing risks data with dependent factors. The general structure of competing risks data considered here includes ties. A comprehensive inferential framework for the proposed model is presented: maximum likelihood estimation, confidence interval construction, and model selection within the bivariate family of distributions for a given dependent competing risks data. The inferential methods are very convenient to implement. Through detailed simulations, the inferential methods are observed to provide quite reasonable results. Analysis of a real data from the Diabetic Retinopathy Study is carried out with the help of the proposed model as an illustrative example.


title: Port-Hamiltonian systems and monotonicity

abstract: The relationships between port-Hamiltonian systems modeling and the notion of monotonicity are explored. The earlier introduced notion of incrementally port-Hamiltonian systems is extended to maximal cyclically monotone relations, together with their generating functions. This gives rise to new classes of incrementally port-Hamiltonian systems, with examples stemming from physical systems modeling as well as from convex optimization. An in-depth treatment is given of the composition of maximal monotone and maximal cyclically monotone relations, where in the latter case the resulting maximal cyclically monotone relation is shown to be computable through the use of generating functions. Furthermore, connections are discussed with incremental versions of passivity, and it is shown how incrementally port-Hamiltonian systems with strictly convex Hamiltonians are (maximal) equilibrium independent passive. Finally, the results on compositionality of monotone relations are employed for a convex optimization approach to the computation of the equilibrium of interconnected incrementally port-Hamiltonian systems.


title: Certified Graph Unlearning

abstract: Graph-structured data is ubiquitous in practice and often processed using graph neural networks (GNNs). With the adoption of recent laws ensuring the ``right to be forgotten'', the problem of graph data removal has become of significant importance. To address the problem, we introduce the first known framework for \emph{certified graph unlearning} of GNNs. In contrast to standard machine unlearning, new analytical and heuristic unlearning challenges arise when dealing with complex graph data. First, three different types of unlearning requests need to be considered, including node feature, edge and node unlearning. Second, to establish provable performance guarantees, one needs to address challenges associated with feature mixing during propagation. The underlying analysis is illustrated on the example of simple graph convolutions (SGC) and their generalized PageRank (GPR) extensions, thereby laying the theoretical foundation for certified unlearning of GNNs. Our empirical studies on six benchmark datasets demonstrate excellent performance-complexity trade-offs when compared to complete retraining methods and approaches that do not leverage graph information. For example, when unlearning $20\%$ of the nodes on the Cora dataset, our approach suffers only a $0.1\%$ loss in test accuracy while offering a $4$-fold speed-up compared to complete retraining. Our scheme also outperforms unlearning methods that do not leverage graph information with a $12\%$ increase in test accuracy for a comparable time complexity.