title: Solving the clustered traveling salesman problem with d-relaxed priority rule

abstract: The Clustered Traveling Salesman Problem with a Prespecified Order on the Clusters, a variant of the well-known traveling salesman problem is studied in literature. In this problem, delivery locations are divided into clusters with different urgency levels and more urgent locations must be visited before less urgent ones. However, this could lead to an inefficient route in terms of traveling cost. This priority-oriented constraint can be relaxed by a rule called d-relaxed priority that provides a trade-off between transportation cost and emergency level. Our research proposes two approaches to solve the problem with d-relaxed priority rule. We improve the mathematical formulation proposed in the literature to construct an exact solution method. A meta-heuristic method based on the framework of Iterated Local Search with problem-tailored operators is also introduced to find approximate solutions. Experimental results show the effectiveness of our methods.


title: Deep Decoder: Concise Image Representations from Untrained Non-convolutional Networks

abstract: Deep neural networks, in particular convolutional neural networks, have become highly effective tools for compressing images and solving inverse problems including denoising, inpainting, and reconstruction from few and noisy measurements. This success can be attributed in part to their ability to represent and generate natural images well. Contrary to classical tools such as wavelets, image-generating deep neural networks have a large number of parameters---typically a multiple of their output dimension---and need to be trained on large datasets. In this paper, we propose an untrained simple image model, called the deep decoder, which is a deep neural network that can generate natural images from very few weight parameters. The deep decoder has a simple architecture with no convolutions and fewer weight parameters than the output dimensionality. This underparameterization enables the deep decoder to compress images into a concise set of network weights, which we show is on par with wavelet-based thresholding. Further, underparameterization provides a barrier to overfitting, allowing the deep decoder to have state-of-the-art performance for denoising. The deep decoder is simple in the sense that each layer has an identical structure that consists of only one upsampling unit, pixel-wise linear combination of channels, ReLU activation, and channelwise normalization. This simplicity makes the network amenable to theoretical analysis, and it sheds light on the aspects of neural networks that enable them to form effective signal representations.


title: Self-propulsion near the onset of Marangoni instability of deformable active droplets

abstract: Experimental observations indicate that chemically active droplets suspended in a surfactant-laden fluid can self-propel spontaneously. The onset of this motion is attributed to a symmetry-breaking Marangoni instability resulting from the nonlinear advective coupling of the distribution of surfactant to the hydrodynamic flow generated by Marangoni stresses at the droplet's surface. Here, we use weakly nonlinear analysis to characterize the self-propulsion near the instability threshold and the influence of the droplet's deformability. We report that in vicinity of the threshold, deformability enhances self-propulsion of viscous droplets, but hinders propulsion of drops that are roughly less viscous than the surrounding fluid. Our asymptotics further reveals that droplet deformability may alter the type of bifurcation leading to symmetry breaking: for moderately deformable droplets the onset of self-propulsion is transcritical and a regime of steady self-propulsion is stable; while in the case of highly deformable drops, no steady flows can be found within the asymptotic limit considered in this paper suggesting that the bifurcation is subcritical.


title: An Imaging Spectroscopic Survey of the Planetary Nebula NGC 7009 with MUSE

abstract: The spatial structure of the emission lines and continuum over the 50 arcsecond extent of the nearby, O-rich, planetary nebula NGC 7009 (Saturn Nebula) have been observed with the MUSE integral field spectrograph on the ESO Very Large Telescope. Science Verification data, in <0.6 arcsecond seeing, have been reduced and analysed as images over the wavelength range 4750-9350A. Emission line maps over the bright shells are presented, from neutral to the highest ionization available (He II and [Mn V]). For collisionally excited lines (CELs), maps of electron temperature (T_e from [N II] and [S III]) and electron density (N_e from [S II] and [Cl III]) are available and for optical recombination lines (ORLs) temperature (from the Paschen jump and ratio of He I lines) and density (from high Paschen lines). These estimates are compared: for the first time, maps of the differences in CEL and ORL T_e's have been derived, and correspondingly a map of t^2 between a CEL and ORL temperature, showing considerable detail. Total abundances of He and O were formed, the latter using three ionization correction factors. However the map of He/H is not flat, departing by ~2% from a constant value, with remnants corresponding to ionization structures. Ionization correction factor methods are compared for O abundance, but none delivers a flat map. An integrated spectrum over an area of 2340 square arcseconds was also formed and compared to 1D photoionization models. The spatial variation of a range of nebular parameters illustrates the complexity of the ionized media in NGC 7009. These MUSE data are very rich with detections of many lines over areas of hundreds of square arcseconds and follow-on studies are indicated. (Abridged)


title: High-performance Power Allocation Strategies for Secure Spatial Modulation

abstract: Optimal power allocation (PA) strategies can make a significant rate improvement in secure spatial modulation (SM). Due to the lack of secrecy rate (SR) closed-form expression in secure SM networks, it is hard to optimize the PA factor. In this paper, two PA strategies are proposed: gradient descent, and maximum product of signal-to-interference-plus-noise ratio (SINR) and artificial-noise-to-signal-plus-noise ratio (ANSNR)(Max-P-SINR-ANSNR). The former is an iterative method and the latter is a closed-form solution. Compared to the former, the latter is of low-complexity. Simulation results show that the proposed two PA methods can approximately achieve the same SR performance as exhaustive search method and perform far better than three fixed PA ones. With extremely low complexity, the SR performance of the proposed Max-P-SINR-ANSNR performs slightly better and worse than that of the proposed GD in the low to medium, and high signal-to-noise ratio regions, respectively.


title: SAM-GCNN: A Gated Convolutional Neural Network with Segment-Level Attention Mechanism for Home Activity Monitoring

abstract: In this paper, we propose a method for home activity monitoring. We demonstrate our model on dataset of Detection and Classification of Acoustic Scenes and Events (DCASE) 2018 Challenge Task 5. This task aims to classify multi-channel audios into one of the provided pre-defined classes. All of these classes are daily activities performed in a home environment. To tackle this task, we propose a gated convolutional neural network with segment-level attention mechanism (SAM-GCNN). The proposed framework is a convolutional model with two auxiliary modules: a gated convolutional neural network and a segment-level attention mechanism. Furthermore, we adopted model ensemble to enhance the capability of generalization of our model. We evaluated our work on the development dataset of DCASE 2018 Task 5 and achieved competitive performance, with a macro-averaged F-1 score increasing from 83.76% to 89.33%, compared with the convolutional baseline system.


title: On the Evaluation and Validation of Off-the-shelf Statistical Shape Modeling Tools: A Clinical Application

abstract: Statistical shape modeling (SSM) has proven useful in many areas of biology and medicine as a new generation of morphometric approaches for the quantitative analysis of anatomical shapes. Recently, the increased availability of high-resolution in vivo images of anatomy has led to the development and distribution of open-source computational tools to model anatomical shapes and their variability within populations with unprecedented detail and statistical power. Nonetheless, there is little work on the evaluation and validation of such tools as related to clinical applications that rely on morphometric quantifications for treatment planning. To address this lack of validation, we systematically assess the outcome of widely used off-the-shelf SSM tools, namely ShapeWorks, SPHARM-PDM, and Deformetrica, in the context of designing closure devices for left atrium appendage (LAA) in atrial fibrillation (AF) patients to prevent stroke, where an incomplete LAA closure may be worse than no closure. This study is motivated by the potential role of SSM in the geometric design of closure devices, which could be informed by population-level statistics, and patient-specific device selection, which is driven by anatomical measurements that could be automated by relating patient-level anatomy to population-level morphometrics. Hence, understanding the consequences of different SSM tools for the final analysis is critical for the careful choice of the tool to be deployed in real clinical scenarios. Results demonstrate that estimated measurements from ShapeWorks model are more consistent compared to models from Deformetrica and SPHARM-PDM. Furthermore, ShapeWorks and Deformetrica shape models capture clinically relevant population-level variability compared to SPHARM-PDM models.


title: GPU based Parallel Optimization for Real Time Panoramic Video Stitching

abstract: Panoramic video is a sort of video recorded at the same point of view to record the full scene. With the development of video surveillance and the requirement for 3D converged video surveillance in smart cities, CPU and GPU are required to possess strong processing abilities to make panoramic video. The traditional panoramic products depend on post processing, which results in high power consumption, low stability and unsatisfying performance in real time. In order to solve these problems,we propose a real-time panoramic video stitching framework.The framework we propose mainly consists of three algorithms, LORB image feature extraction algorithm, feature point matching algorithm based on LSH and GPU parallel video stitching algorithm based on CUDA.The experiment results show that the algorithm mentioned can improve the performance in the stages of feature extraction of images stitching and matching, the running speed of which is 11 times than that of the traditional ORB algorithm and 639 times than that of the traditional SIFT algorithm. Based on analyzing the GPU resources occupancy rate of each resolution image stitching, we further propose a stream parallel strategy to maximize the utilization of GPU resources. Compared with the L-ORB algorithm, the efficiency of this strategy is improved by 1.6-2.5 times, and it can make full use of GPU resources. The performance of the system accomplished in the paper is 29.2 times than that of the former embedded one, while the power dissipation is reduced to 10W.


title: Image-to-Video Person Re-Identification by Reusing Cross-modal Embeddings

abstract: Image-to-video person re-identification identifies a target person by a probe image from quantities of pedestrian videos captured by non-overlapping cameras. Despite the great progress achieved,it's still challenging to match in the multimodal scenario,i.e. between image and video. Currently,state-of-the-art approaches mainly focus on the task-specific data,neglecting the extra information on the different but related tasks. In this paper,we propose an end-to-end neural network framework for image-to-video person reidentification by leveraging cross-modal embeddings learned from extra information.Concretely speaking,cross-modal embeddings from image captioning and video captioning models are reused to help learned features be projected into a coordinated space,where similarity can be directly computed. Besides,training steps from fixed model reuse approach are integrated into our framework,which can incorporate beneficial information and eventually make the target networks independent of existing models. Apart from that,our proposed framework resorts to CNNs and LSTMs for extracting visual and spatiotemporal features,and combines the strengths of identification and verification model to improve the discriminative ability of the learned feature. The experimental results demonstrate the effectiveness of our framework on narrowing down the gap between heterogeneous data and obtaining observable improvement in image-to-video person re-identification.


title: DeepNIS: Deep Neural Network for Nonlinear Electromagnetic Inverse Scattering

abstract: Nonlinear electromagnetic (EM) inverse scattering is a quantitative and super-resolution imaging technique, in which more realistic interactions between the internal structure of scene and EM wavefield are taken into account in the imaging procedure, in contrast to conventional tomography. However, it poses important challenges arising from its intrinsic strong nonlinearity, ill-posedness, and expensive computation costs. To tackle these difficulties, we, for the first time to our best knowledge, exploit a connection between the deep neural network (DNN) architecture and the iterative method of nonlinear EM inverse scattering. This enables the development of a novel DNN-based methodology for nonlinear EM inverse problems (termed here DeepNIS). The proposed DeepNIS consists of a cascade of multi-layer complexvalued residual convolutional neural network (CNN) modules. We numerically and experimentally demonstrate that the DeepNIS outperforms remarkably conventional nonlinear inverse scattering methods in terms of both the image quality and computational time. We show that DeepNIS can learn a general model approximating the underlying EM inverse scattering system. It is expected that the DeepNIS will serve as powerful tool in treating highly nonlinear EM inverse scattering problems over different frequency bands, involving large-scale and high-contrast objects, which are extremely hard and impractical to solve using conventional inverse scattering methods.


title: Configurational entropy and Newton's Law in double sine-Gordon braneworlds

abstract: In this work, we evaluate the Shannon-like entropic measure of spatially-localized functions for a five-dimensional braneworld generated by a double sine-Gordon (DSG) potential. The differential configurational entropy (DCE) has been shown in several recent works to be a configurational informational measure (CIM) that selects critical points and brings out phase transitions in confined energy models with arbitrary parameters. We select the DSG scenario because it presents an energy-degenerate spatially localized profile where the solutions to the scalar field demonstrate critical behavior that is only a result of geometrical effects. As we will show, the DCE evaluation provides a method for predicting the existence of a transition between the phases of the domain wall solutions. Moreover, the entropic measure reveals information about the model that is capable of describing the phase sector where we obtain resonance modes on the massive spectra of the graviton. The graviton resonance lifetimes are related to the existence of scales on which 4D gravity is recovered. Thus, we correlate the critical points defined by the {CIMs} with the existence of resonances and their lifetimes. To extend our research regarding this system, we calculate the corrections to Newton's Law coming from the graviton modes.


title: Magneto-thermoplasmonics: from theory to applications

abstract: We review recent theoretical developments on the nanoscale radiative heat transfer in magneto-optical many-particle systems. We discuss in detail the circular heat flux, the giant magneto-resistance effect, the persistent heat current, and the thermal Hall effect for light in such systems within the framework of fluctuational electrodynamics, using the dipolar approximation. We show that the directionality of heat flux in such systems can in principle be understood by analyzing the competing contributions to the heat exchange of the magnetic-field-dependent dipolar resonances of quantum numbers m = +1 and m = -1. Some potential applications of these effects to thermal and magnetic sensing are also briefly discussed.


title: Model Cards for Model Reporting

abstract: Trained machine learning models are increasingly used to perform high-impact tasks in areas such as law enforcement, medicine, education, and employment. In order to clarify the intended use cases of machine learning models and minimize their usage in contexts for which they are not well suited, we recommend that released models be accompanied by documentation detailing their performance characteristics. In this paper, we propose a framework that we call model cards, to encourage such transparent model reporting. Model cards are short documents accompanying trained machine learning models that provide benchmarked evaluation in a variety of conditions, such as across different cultural, demographic, or phenotypic groups (e.g., race, geographic location, sex, Fitzpatrick skin type) and intersectional groups (e.g., age and race, or sex and Fitzpatrick skin type) that are relevant to the intended application domains. Model cards also disclose the context in which models are intended to be used, details of the performance evaluation procedures, and other relevant information. While we focus primarily on human-centered machine learning models in the application fields of computer vision and natural language processing, this framework can be used to document any trained machine learning model. To solidify the concept, we provide cards for two supervised models: One trained to detect smiling faces in images, and one trained to detect toxic comments in text. We propose model cards as a step towards the responsible democratization of machine learning and related AI technology, increasing transparency into how well AI technology works. We hope this work encourages those releasing trained machine learning models to accompany model releases with similar detailed evaluation numbers and other relevant documentation.


title: (Di)graph decompositions and magic type labelings: a dual relation

abstract: A graph $G$ is called edge-magic if there is a bijective function $f$ from the set of vertices and edges to the set $\{1,2,\ldots,|V(G)|+|E(G)|\}$ such that the sum $f(x)+f(xy)+f(y)$ for any $xy$ in $E(G)$ is constant. Such a function is called an edge-magic labelling of G and the constant is called the valence of $f$. An edge-magic labelling with the extra property that $f(V(G))= \{1,2,\ldots,|V(G)|\}$ is called super edge-magic. In this paper, we establish a relationship between the valences of (super) edge-magic labelings of certain types of bipartite graphs and the existence of a particular type of decompositions of such graphs.


title: Brezis pseudomonotonicity is strictly weaker than Ky-Fan hemicontinuity

abstract: In 1968, H. Brezis introduced a notion of operator pseudomonotonicity which provides a unified approach to monotone and nonmonotone variational inequalities (VIs). A closely related notion is that of Ky-Fan hemicontinuity, a continuity property which arises if the famous Ky-Fan minimax inequality is applied to the VI framework. It is clear from the corresponding definitions that Ky-Fan hemicontinuity implies Brezis pseudomonotonicity, but quite surprisingly, a recent publication by Sadeqi and Paydar (J. Optim. Theory Appl., 165(2):344-358, 2015) claims the equivalence of the two properties. The purpose of the present note is to show that this equivalence is false; this is achieved by providing a concrete example of a nonlinear operator which is Brezis pseudomonotone but not Ky--Fan hemicontinuous.


title: Learning Noun Cases Using Sequential Neural Networks

abstract: Morphological declension, which aims to inflect nouns to indicate number, case and gender, is an important task in natural language processing (NLP). This research proposal seeks to address the degree to which Recurrent Neural Networks (RNNs) are efficient in learning to decline noun cases. Given the challenge of data sparsity in processing morphologically rich languages and also, the flexibility of sentence structures in such languages, we believe that modeling morphological dependencies can improve the performance of neural network models. It is suggested to carry out various experiments to understand the interpretable features that may lead to a better generalization of the learned models on cross-lingual tasks.


title: Spin Seebeck imaging of spin-torque switching in antiferromagnetic Pt/NiO heterostructures

abstract: As electrical control of N\'eel order opens the door to reliable antiferromagnetic spintronic devices, understanding the microscopic mechanisms of antiferromagnetic switching is crucial. Spatially-resolved studies are necessary to distinguish multiple nonuniform switching mechanisms; however, progress has been hindered by the lack of tabletop techniques to image the N\'eel order. We demonstrate spin Seebeck microscopy as a sensitive, table-top method for imaging antiferromagnetic order in thin films, and apply this technique to study spin-torque switching in NiO/Pt and Pt/NiO/Pt heterostructures. We establish the interfacial antiferromagnetic spin Seebeck effect in NiO as a probe of surface N\'eel order, resolving antiferromagnetic spin domains within crystalline twin domains. By imaging before and after applying current-induced spin torque, we resolve spin domain rotation and domain wall motion, acting simultaneously. We correlate the changes in spin Seebeck images with electrical measurements of the average N\'eel orientation through the spin Hall magnetoresistance, confirming that we image antiferromagnetic order.


title: The floating-body problem: an integro-differential equation without irregular frequencies

abstract: The linear boundary value problem under consideration describes time-harmonic motion of water in a horizontal three-dimensional layer of constant depth in the presence of an obstacle adjacent to the upper side of the layer (floating body). This problem for a complex-valued harmonic function involves mixed boundary conditions and a radiation condition at infinity. Under rather general geometric assumptions the existence of a unique solution is proved for all values of the nonnegative problem's parameter related to the frequency of oscillations. The proof is based on the representation of solution as a sum of simple- and double-layer potentials with densities distributed over the obstacle's surface, thus reducing the problem to an indefinite integro-differential equation. The latter is shown to be soluble for all continuous right-hand side terms for which purpose S.~G. Krein's theorem about indefinite equations is used.


title: Computationally Efficient Deep Neural Network for Computed Tomography Image Reconstruction

abstract: Deep-neural-network-based image reconstruction has demonstrated promising performance in medical imaging for under-sampled and low-dose scenarios. However, it requires large amount of memory and extensive time for the training. It is especially challenging to train the reconstruction networks for three-dimensional computed tomography (CT) because of the high resolution of CT images. The purpose of this work is to reduce the memory and time consumption of the training of the reconstruction networks for CT to make it practical for current hardware, while maintaining the quality of the reconstructed images. We unrolled the proximal gradient descent algorithm for iterative image reconstruction to finite iterations and replaced the terms related to the penalty function with trainable convolutional neural networks (CNN). The network was trained greedily iteration by iteration in the image-domain on patches, which requires reasonable amount of memory and time on mainstream graphics processing unit (GPU). To overcome the local-minimum problem caused by greedy learning, we used deep UNet as the CNN and incorporated separable quadratic surrogate with ordered subsets for data fidelity, so that the solution could escape from easy local minimums and achieve better image quality. The proposed method achieved comparable image quality with state-of-the-art neural network for CT image reconstruction on 2D sparse-view and limited-angle problems on the low-dose CT challenge dataset.


title: The combination of context information to enhance simple question answering

abstract: With the rapid development of knowledge base,question answering based on knowledge base has been a hot research issue. In this paper, we focus on answering singlerelation factoid questions based on knowledge base. We build a question answering system and study the effect of context information on fact selection, such as entity's notable type,outdegree. Experimental results show that context information can improve the result of simple question answering.


title: Rescuing Single Field Inflation from the Swampland

abstract: The difficulty of building metastable vacua in string theory has led some to conjecture that, in the string theory landscape, potentials satisfy $\left|\nabla V/V\right|\geq c\sim \mathcal{O}(1)$. This condition, which is supported by different explicit constructions, suggests that the EFTs which lead to metastable de-Sitter vacua belong to what is dubbed as swampland. This condition endangers the paradigm of single field inflation. In this paper, we show how scalar excited initial states cannot rescue single field inflation from the swampland, as they produce large local scalar non-gaussianity, which is in conflict with the Planck upper bound. Instead, we demonstrate that one can salvage single field inflation using excited initial states for tensor perturbations, which in this case produce only large flattened non-gaussianity in the tensor bispectrum. We comment on the possible methods one can prepare such excited initial conditions for the tensor perturbations.


title: Decoupled Classification Refinement: Hard False Positive Suppression for Object Detection

abstract: In this paper, we analyze failure cases of state-of-the-art detectors and observe that most hard false positives result from classification instead of localization and they have a large negative impact on the performance of object detectors. We conjecture there are three factors: (1) Shared feature representation is not optimal due to the mismatched goals of feature learning for classification and localization; (2) multi-task learning helps, yet optimization of the multi-task loss may result in sub-optimal for individual tasks; (3) large receptive field for different scales leads to redundant context information for small objects. We demonstrate the potential of detector classification power by a simple, effective, and widely-applicable Decoupled Classification Refinement (DCR) network. In particular, DCR places a separate classification network in parallel with the localization network (base detector). With ROI Pooling placed on the early stage of the classification network, we enforce an adaptive receptive field in DCR. During training, DCR samples hard false positives from the base detector and trains a strong classifier to refine classification results. During testing, DCR refines all boxes from the base detector. Experiments show competitive results on PASCAL VOC and COCO without any bells and whistles. Our codes are available at: https://github.com/bowenc0221/Decoupled-Classification-Refinement.


title: Antisymmetric tensor propagator with spontaneous Lorentz violation

abstract: In this work, we study the spontaneous Lorentz symmetry breaking due to an antisymmetric 2-tensor field in Minkowski spacetime. For a smooth quadratic potential, the spectrum of the theory exhibits massless and massive excitations. We show that the equations of motion for the free field obey some constraints which lead to the massive mode be non-propagating at leading order. Besides, there exists a massless mode in the theory which can be identified with the usual Kalb-Ramond field, carrying only one on-shell degree of freedom. The same conclusion holds when one analyses the pole structure of its Feynman propagator. A new complete set of spin-type operators is found, which was the requirement to evaluate the propagator of the Kalb-Ramond field modified by the presence of a nonzero vacuum expectation value responsible for the Lorentz violation.


title: Strong geodetic number of complete bipartite graphs, crown graphs and hypercubes

abstract: The strong geodetic number, $\text{sg}(G),$ of a graph $G$ is the smallest number of vertices such that by fixing one geodesic between each pair of selected vertices, all vertices of the graph are covered. In this paper, the study of the strong geodetic number of complete bipartite graphs is continued. The formula for $\text{sg}(K_{n,m})$ is given, as well as a formula for the crown graphs $S_n^0$. Bounds on $\text{sg}(Q_n)$ are also discussed.


title: Non-uniform spin wave softening in 2D magnonic crystals as a tool for opening omnidirectional magnonic band gaps

abstract: By means of the plane wave method we study spin wave dynamics in two-dimensional bi-component magnonic crystals based on a squeezed hexagonal lattice and consist of a permalloy thin film with cobalt inclusions. We explore the dependence of a spin wave frequency on the external magnetic field, especially in weak fields where the mode softening takes place. For considered structures, the mode softening proves to be highly non-uniform on both the mode number and the wave vector. We found this effect to be responsible for the omnidirectional band gap opening. Moreover, we show that the enhancement of the demagnetizing field caused by the squeezing of the structure is of crucial importance for the non-uniform mode softening. This allows us to employ this mechanism to design magnonic gaps with different sensitivity for the tiny change of the external field. The effects we have found should be useful in designing and optimization of spin wave filters highly tunable by a small external magnetic field.


title: Enumerating models of DNF faster: breaking the dependency on the formula size

abstract: In this article, we study the problem of enumerating the models of DNF formulas. The aim is to provide enumeration algorithms with a delay that depends polynomially on the size of each model and not on the size of the formula, which can be exponentially larger. We succeed for two subclasses of DNF formulas: we provide a constant delay algorithm for $k$-DNF with fixed $k$ by an appropriate amortization method and we give a quadratic delay algorithm for monotone formulas. We then focus on the \emph{average delay} of enumeration algorithms and show how to obtain a sublinear delay in the formula size.


title: The entropy production of thermal operations

abstract: According to the first and second laws of thermodynamics and the definitions of work and heat, microscopic expressions for the non-equilibrium entropy production have been achieved. Recently, a redefinition of heat has been presented in [\href{Nature Communicationsvolume 8, Article number: 2180 (2017)}{Nat. Commun. 8, 2180 (2017)}]. We are going to determine how this redefinition of heat could affect the expression of the entropy production. Utilizing this new definition of heat, it could be found out that there is a new expression for the entropy production for thermal operations. It could be derived if the initial state of the system and the bath is factorized, and if the total entropy of composite system is preserved, then the new entropy production will be equal to mutual information between the system and the bath. It is shown that if the initial state of the system is diagonal in energy bases, then the thermal operations cannot create a quantum correlation between the system and the bath.


title: Glioma Segmentation with Cascaded Unet

abstract: MRI analysis takes central position in brain tumor diagnosis and treatment, thus it's precise evaluation is crucially important. However, it's 3D nature imposes several challenges, so the analysis is often performed on 2D projections that reduces the complexity, but increases bias. On the other hand, time consuming 3D evaluation, like, segmentation, is able to provide precise estimation of a number of valuable spatial characteristics, giving us understanding about the course of the disease.\newline Recent studies, focusing on the segmentation task, report superior performance of Deep Learning methods compared to classical computer vision algorithms. But still, it remains a challenging problem. In this paper we present deep cascaded approach for automatic brain tumor segmentation. Similar to recent methods for object detection, our implementation is based on neural networks; we propose modifications to the 3D UNet architecture and augmentation strategy to efficiently handle multimodal MRI input, besides this we introduce approach to enhance segmentation quality with context obtained from models of the same topology operating on downscaled data. We evaluate presented approach on BraTS 2018 dataset and discuss results.


title: Deep learning: Extrapolation tool for ab initio nuclear theory

abstract: Ab initio approaches in nuclear theory, such as the no-core shell model (NCSM), have been developed for approximately solving finite nuclei with realistic strong interactions. The NCSM and other approaches require an extrapolation of the results obtained in a finite basis space to the infinite basis space limit and assessment of the uncertainty of those extrapolations. Each observable requires a separate extrapolation and most observables have no proven extrapolation method. We propose a feed-forward artificial neural network (ANN) method as an extrapolation tool to obtain the ground state energy and the ground state point-proton root-mean-square (rms) radius along with their extrapolation uncertainties. The designed ANNs are sufficient to produce results for these two very different observables in $^6$Li from the ab initio NCSM results in small basis spaces that satisfy the following theoretical physics condition: independence of basis space parameters in the limit of extremely large matrices. Comparisons of the ANN results with other extrapolation methods are also provided.


title: On the Normal Force and Static Friction Acting on a Rolling Ball Actuated by Internal Point Masses

abstract: The goal of this paper is to investigate the normal and tangential forces acting at the point of contact between a horizontal surface and a rolling ball actuated by internal point masses moving in the ball's frame of reference. The normal force and static friction are derived from the equations of motion for a rolling ball actuated by internal point masses that move inside the ball's frame of reference, and, as a special case, a rolling disk actuated by internal point masses. The masses may move along one-dimensional trajectories fixed in the ball's and disk's frame. The dynamics of a ball and disk actuated by masses moving along one-dimensional trajectories are simulated numerically and the minimum coefficients of static friction required to prevent slippage are computed.


title: Spatial moments for high-dimensional critical contact process, oriented percolation and lattice trees

abstract: Recently, Holmes and Perkins identified conditions which ensure that for a class of critical lattice models the scaling limit of the range is the range of super-Brownian motion. One of their conditions is an estimate on a spatial moment of order higher than four, which they verified for the sixth moment for spread-out lattice trees in dimensions $d>8$. Chen and Sakai have proved the required moment estimate for spread-out critical oriented percolation in dimensions $d+1>4+1$. We prove estimates on all moments for the spread-out critical contact process in dimensions $d>4$, which in particular fulfills the spatial moment condition of Holmes and Perkins. Our method of proof is relatively simple, and, as we show, it applies also to oriented percolation and lattice trees. Via the convergence results of Holmes and Perkins, the upper bounds on the spatial moments can in fact be promoted to asymptotic formulas with explicit constants.


title: Learning Converged Propagations with Deep Prior Ensemble for Image Enhancement

abstract: Enhancing visual qualities of images plays very important roles in various vision and learning applications. In the past few years, both knowledge-driven maximum a posterior (MAP) with prior modelings and fully data-dependent convolutional neural network (CNN) techniques have been investigated to address specific enhancement tasks. In this paper, by exploiting the advantages of these two types of mechanisms within a complementary propagation perspective, we propose a unified framework, named deep prior ensemble (DPE), for solving various image enhancement tasks. Specifically, we first establish the basic propagation scheme based on the fundamental image modeling cues and then introduce residual CNNs to help predicting the propagation direction at each stage. By designing prior projections to perform feedback control, we theoretically prove that even with experience-inspired CNNs, DPE is definitely converged and the output will always satisfy our fundamental task constraints. The main advantage against conventional optimization-based MAP approaches is that our descent directions are learned from collected training data, thus are much more robust to unwanted local minimums. While, compared with existing CNN type networks, which are often designed in heuristic manners without theoretical guarantees, DPE is able to gain advantages from rich task cues investigated on the bases of domain knowledges. Therefore, DPE actually provides a generic ensemble methodology to integrate both knowledge and data-based cues for different image enhancement tasks. More importantly, our theoretical investigations verify that the feedforward propagations of DPE are properly controlled toward our desired solution. Experimental results demonstrate that the proposed DPE outperforms state-of-the-arts on a variety of image enhancement tasks in terms of both quantitative measure and visual perception quality.


title: Identifying the electron-positron cascade regimes in high-intensity laser-matter interactions

abstract: Strong-field quantum electrodynamics predicts electron-seeded electron-positron pair cascades when the electric field in the rest-frame of the seed electron approaches the Sauter-Schwinger field, i.e. $\eta = E_{RF}/E_S \sim 1$. Electrons in the focus of next generation multi-PW lasers are expected to reach this threshold. We identify three distinct cascading regimes in the interaction of counter-propagating, circularly-polarised laser pulses with a thin foil by performing a comprehensive scan over the laser intensity (from $10^{23}$ -- $5\times10^{24}$\ Wcm$^{-2}$) and initial foil target density (from $10^{26}$ -- $10^{31}$\ m$^{-3}$). For low densities and intensities the number of pairs grows exponentially. If the intensity and target density are high enough the number density of created pairs reaches the relativistically-corrected critical density, the pair plasma efficiently absorbs the laser energy (through radiation reaction) and the cascade saturates. If the initial density is too high, such that the initial target is overdense, the cascade is suppressed by the skin effect. We derive a semi-analytical model which predicts that dense pair plasmas are endemic features of these interactions for intensities above $10^{24}$ Wcm$^{-2}$ provided the target's relativistic skin-depth is longer than the laser wavelength. Further, it shows that pair production is maximised in near-critical-density targets, providing a guide for near-term experiments.


title: Radial evolution of the solar wind in pure high-speed streams: HELIOS revised observations

abstract: Spacecraft observations have shown that the proton temperature in the solar wind falls off with radial distance more slowly than expected for an adiabatic prediction. Usually, previous studies have been focused on the evolution of the solar-wind plasma by using the bulk speed as an order parameter to discriminate different regimes. In contrast, here, we study the radial evolution of pure and homogeneous fast streams (i.e. well-defined streams of coronal-hole plasma that maintain their identity during several solar rotations) by means of re-processed particle data, from the HELIOS satellites between 0.3 and 1 AU. We have identified 16 intervals of unperturbed high-speed coronal hole plasma, from three different sources and measured at different radial distances. The observations show that, for all three streams, (i) the proton density decreases as expected for a radially expanding plasma, unlike previous analysis that found a slower decrease; (ii) the magnetic field deviates from the Parker prediction, with the radial and tangential components decreasing more slowly and quickly than expected, respectively; (iii) the double-adiabatic invariants are violated and an increase of entropy is observed; (iv) the proton-core temperature anisotropy is constrained by mirror mode instability; (v) the collisional frequency is not constant, but decreases as the plasma travels away from the Sun. The present work provides an insight into the heating problem in pure fast solar wind, fitting in the context of the next solar missions, and, especially for Parker Solar Probe, it enables us to predict the high-speed solar-wind environment much closer to the Sun.


title: Algorithmic construction of representations of finite solvable groups

abstract: The dominant theme of this thesis is the construction of matrix representations of finite solvable groups using a suitable system of generators. For a finite solvable group $G$ of order $N = p_{1}p_{2}\dots p_{n}$, where $p_{i}$'s are primes, there always exists a subnormal series: $\langle {e} \rangle = G_{o} < G_{1} < \dots < G_{n} = G$ such that $G_{i}/G_{i-1}$ is isomorphic to a cyclic group of order $p_{i}$, $i = 1,2,\dots,n$. Associated with this series, there exists a system of generators consisting $n$ elements $x_{1}, x_{2}, \dots, x_{n}$ (say), such that $G_{i} = \langle x_{1}, x_{2}, \dots, x_{i} \rangle$, $i = 1,2,\dots,n$, which is called a "long system of generators". In terms of this system of generators and conjugacy class sum of $x_{i}$ in $G_{i}$, $i = 1,2, \dots, n$, we present an algorithm for constructing the irreducible matrix representations of $G$ over $\mathbb{C}$ within the group algebra $\mathbb{C}[G]$. This algorithmic construction needs the knowledge of primitive central idempotents, a well defined set of primitive (not necessarily central) idempotents and the "diagonal subalgebra" of $\mathbb{C}[G]$. In terms of this system of generators, we give simple expressions for the primitive central idempotents, a well defined system of primitive (not necessarily central) idempotents and a convenient set of generators of the "diagonal subalgebra" of $\mathbb{C}[G]$. For a finite abelian group, we present an algorithm for constructing the inequivalent irreducible matrix representations over a field of characteristic $0$ or prime to the order of the group and a systematic way of computing the primitive central idempotents of the group algebra. Besides that, we give simple expressions of the primitive central idempotents of the rational group algebra of a finite abelian group using a "long presentation" and it's Wedderburn decomposition.


title: Redundant Robot Assignment on Graphs with Uncertain Edge Costs

abstract: We provide a framework for the assignment of multiple robots to goal locations, when robot travel times are uncertain. Our premise is that time is the most valuable asset in the system. Hence, we make use of redundant robots to counter the effect of uncertainty and minimize the average waiting time at destinations. We apply our framework to transport networks represented as graphs, and consider uncertainty in the edge costs (i.e., travel time). Since solving the redundant assignment problem is strongly NP-hard, we exploit structural properties of our problem to propose a polynomial-time solution with provable sub-optimality bounds. Our method uses distributive aggregate functions, which allow us to efficiently (i.e., incrementally) compute the effective cost of assigning redundant robots. Experimental results on random graphs show that the deployment of redundant robots through our method reduces waiting times at goal locations, when edge traversals are uncertain.


title: Comparison of U-net-based Convolutional Neural Networks for Liver Segmentation in CT

abstract: Various approaches for liver segmentation in CT have been proposed: Besides statistical shape models, which played a major role in this research area, novel approaches on the basis of convolutional neural networks have been introduced recently. Using a set of 219 liver CT datasets with reference segmentations from liver surgery planning, we evaluate the performance of several neural network classifiers based on 2D and 3D U-net architectures. An interesting observation is that slice-wise approaches perform surprisingly well, with mean and median Dice coefficients above 0.97, and may be preferable over 3D approaches given current hardware and software limitations.


title: Rank growth of elliptic curves in nonabelian extensions

abstract: Given an elliptic curve $E/\mathbb{Q}$, it is a conjecture of Goldfeld that asymptotically half of its quadratic twists will have rank zero and half will have rank one. Nevertheless, higher rank twists do occur: subject to the parity conjecture, Gouv\^ea and Mazur constructed $X^{1/2-\epsilon}$ twists by discriminants up to $X$ with rank at least two. For any $d\geq 3$, we build on their work to consider twists by degree $d$ $S_d$-extensions of $\mathbb{Q}$ with discriminant up to $X$. We prove that there are at least $X^{c_d-\epsilon}$ such twists with positive rank, where $c_d$ is a positive constant that tends to $1/4$ as $d\to\infty$. Moreover, subject to a suitable parity conjecture, we obtain the same result for twists with rank at least two.


title: Boundedness of varieties of Fano type with alpha-invariants and volumes bounded below

abstract: We show that fixed dimensional klt weak Fano pairs with alpha-invariants and volumes bounded away from $0$ and the coefficients of the boundaries belong to the set of hyperstandard multiplicities $\Phi(\mathscr{R})$ associated to a fixed finite set $\mathscr{R}$ form a bounded family. We also show $\alpha(X,B)^{d-1}\mathrm{vol}(-(K_X+B))$ are bounded from above for all klt weak Fano pairs $(X,B)$ of a fixed dimension $d$.


title: A Comprehensive Survey of Deep Learning for Image Captioning

abstract: Generating a description of an image is called image captioning. Image captioning requires to recognize the important objects, their attributes and their relationships in an image. It also needs to generate syntactically and semantically correct sentences. Deep learning-based techniques are capable of handling the complexities and challenges of image captioning. In this survey paper, we aim to present a comprehensive review of existing deep learning-based image captioning techniques. We discuss the foundation of the techniques to analyze their performances, strengths and limitations. We also discuss the datasets and the evaluation metrics popularly used in deep learning based automatic image captioning.


title: Deep Geodesic Learning for Segmentation and Anatomical Landmarking

abstract: In this paper, we propose a novel deep learning framework for anatomy segmentation and automatic landmark- ing. Specifically, we focus on the challenging problem of mandible segmentation from cone-beam computed tomography (CBCT) scans and identification of 9 anatomical landmarks of the mandible on the geodesic space. The overall approach employs three inter-related steps. In step 1, we propose a deep neu- ral network architecture with carefully designed regularization, and network hyper-parameters to perform image segmentation without the need for data augmentation and complex post- processing refinement. In step 2, we formulate the landmark localization problem directly on the geodesic space for sparsely- spaced anatomical landmarks. In step 3, we propose to use a long short-term memory (LSTM) network to identify closely- spaced landmarks, which is rather difficult to obtain using other standard detection networks. The proposed fully automated method showed superior efficacy compared to the state-of-the- art mandible segmentation and landmarking approaches in craniofacial anomalies and diseased states. We used a very challenging CBCT dataset of 50 patients with a high-degree of craniomaxillofacial (CMF) variability that is realistic in clinical practice. Complementary to the quantitative analysis, the qualitative visual inspection was conducted for distinct CBCT scans from 250 patients with high anatomical variability. We have also shown feasibility of the proposed work in an independent dataset from MICCAI Head-Neck Challenge (2015) achieving the state-of-the-art performance. Lastly, we present an in-depth analysis of the proposed deep networks with respect to the choice of hyper-parameters such as pooling and activation functions.


title: Testing exchangeability with martingale for change-point detection

abstract: This work proposes a new exchangeability test for a random sequence through a martingale based approach. Its main contributions include: 1) an additive martingale which is more amenable for designing exchangeability tests by exploiting the Hoeffding-Azuma lemma; 2) different betting functions for constructing the additive martingale are studied. By choosing the underlying probability density function of p-values as a betting function, it can be shown that, when a change-point appears, a satisfying trade-off between the smoothness and expected one-step increment of the martingale sequence can be obtained. An online algorithm based on Beta distribution parametrization for constructing this betting function is discussed in detail as well.


title: The Disk-Based Origami Theorem and a Glimpse of Holography for Traversing Flows

abstract: This paper describes a mechanism by which a traversally generic flow $v$ on a smooth connected manifold $X$ with boundary produces a compact $CW$-complex $\mathcal T(v)$, which is homotopy equivalent to $X$ and such that $X$ embeds in $\mathcal T(v)\times \mathbf R$. The $CW$-complex $\mathcal T(v)$ captures some residual information about the smooth structure on $X$ (such as the stable tangent bundle of $X$). Moreover, $\mathcal T(v)$ is obtained from a simplicial \emph{origami map} $O: D^n \to \mathcal T(v)$, whose source space is a disk $D^n \subset \partial X$ of dimension $n = \dim(X) -1$. The fibers of $O$ have the cardinality $(n+1)$ at most. The knowledge of the map $O$, together with the restriction to $D^n$ of a Lyapunov function $f:X \to \mathbf R$ for $v$, make it possible to reconstruct the topological type of the pair $(X, \mathcal F(v))$, were $\mathcal F(v)$ is the $1$-foliation, generated by $v$. This fact motivates the use of "holography" in the title.


title: Real time description of fission

abstract: Using the time-dependent superfluid local density approximation, the dynamics of fission is investigated in real time from just beyond the saddle to fully separated fragments. Simulations produced in this fully microscopic framework can help to assess the validity of the current approaches to fission, and to obtain estimate of fission observables. In this contribution, we concentrate on general aspects of fission dynamics.


title: Analysis of multinucleon transfer reactions involving spherical and statically deformed nuclei using a Langevin-type approach

abstract: An increasing interest in multinucleon transfer processes in low-energy deep inelastic (damped) collisions of heavy ions appeared in recent years is due, in part, to by the possibility of using them as a method of production of heavy neutron-enriched nuclei. Possible promising projectile-target combinations include nuclei deformed in the ground state (e.g., actinides). Mutual orientations of such the nuclei in the entrance channel of the reaction may significantly influence the reaction dynamics. Available experimental data on multinucleon transfer reactions with statically deformed as well as spherical heavy nuclei 144Sm + 144Sm, 154Sm + 154Sm, 160Gd + 186W, and 208Pb + 208Pb/238U have been analyzed within the developed model. A good agreement of the calculated quantities with the corresponding experimental data is reached. Special attention in the paper is paid to analysis of production possibility of the neutron-enriched isotopes of heavy and superheavy elements in multinucleon transfer processes in the 238U + 238U/248Cm/254Es collisions.


title: Spectral Resolution Clustering for Brain Parcellation

abstract: We take an image science perspective on the problem of determining brain network connectivity given functional activity. But adapting the concept of image resolution to this problem, we provide a new perspective on network partitioning for individual brain parcellation. The typical goal here is to determine densely-interconnected subnetworks within a larger network by choosing the best edges to cut. We instead define these subnetworks as resolution cells, where highly-correlated activity within the cells makes edge weights difficult to determine from the data. Subdividing the resolution estimates into disjoint resolution cells via clustering yields a new variation, and new perspective, on spectral clustering. This provides insight and strategies for open questions such as the selection of model order and the optimal choice of preprocessing steps for functional imaging data. The approach is demonstrated using functional imaging data, where we find the proposed approach produces parcellations which are more predictive across multiple scans versus conventional methods, as well as versus alternative forms of spectral clustering.


title: Low-Energy Lepton-Proton Bremsstrahlung via Effective Field Theory

abstract: We present a systematic calculation of the cross section for the lepton-proton bremsstrahlung process l + p --> l' + p + gamma in chiral perturbation theory at next-to-leading order. This process corresponds to an undetected background signal for the proposed MUSE experiment at PSI. MUSE is designed to measure elastic scattering of low-energy electrons and muons off a proton target in order to extract a precise value of the proton's r.m.s. radius. We show that the commonly used peaking approximation, which is used to evaluate the radiative tail for the elastic cross section, is not applicable for muon-proton scattering at the low-energy MUSE kinematics. Furthermore, we point out a certain pathology with the standard chiral power counting scheme associated with electron scattering, whereby the next-to-next-to-leading order contribution from the pion loop diagrams is kinematically enhanced and numerically of the same magnitude as the next-to-leading order corrections. We correct a misprint in a commonly cited review article.


title: Hartley Spectral Pooling for Deep Learning

abstract: In most convolution neural networks (CNNs), downsampling hidden layers is adopted for increasing computation efficiency and the receptive field size. Such operation is commonly so-called pooling. Maximation and averaging over sliding windows (max/average pooling), and plain downsampling in the form of strided convolution are popular pooling methods. Since the pooling is a lossy procedure, a motivation of our work is to design a new pooling approach for less lossy in the dimensionality reduction. Inspired by the Fourier spectral pooling(FSP) proposed by Rippel et. al. [1], we present the Hartley transform based spectral pooling method in CNNs. Compared with FSP, the proposed spectral pooling avoids the use of complex arithmetic for frequency representation and reduces the computation. Spectral pooling preserves more structure features for network's discriminability than max and average pooling. We empirically show that Hartley spectral pooling gives rise to the convergence of training CNNs on MNIST and CIFAR-10 datasets.


title: Selective Distillation of Weakly Annotated GTD for Vision-based Slab Identification System

abstract: This paper proposes an algorithm for recognizing slab identification numbers in factory scenes. In the development of a deep-learning based system, manual labeling to make ground truth data (GTD) is an important but expensive task. Furthermore, the quality of GTD is closely related to the performance of a supervised learning algorithm. To reduce manual work in the labeling process, we generated weakly annotated GTD by marking only character centroids. Whereas bounding-boxes for characters require at least a drag-and-drop operation or two clicks to annotate a character location, the weakly annotated GTD requires a single click to record a character location. The main contribution of this paper is on selective distillation to improve the quality of the weakly annotated GTD. Because manual GTD are usually generated by many people, it may contain personal bias or human error. To address this problem, the information in manual GTD is integrated and refined by selective distillation. In the process of selective distillation, a fully convolutional network is trained using the weakly annotated GTD, and its prediction maps are selectively used to revise locations and boundaries of semantic regions of characters in the initial GTD. The modified GTD are used in the main training stage, and a post-processing is conducted to retrieve text information. Experiments were thoroughly conducted on actual industry data collected at a steelmaking factory to demonstrate the effectiveness of the proposed method.


title: A Complete Surface Integral Method for Broadband Modeling of 3D Interconnects in Stratified Media

abstract: A surface integral equation solver is proposed for fast and accurate simulation of interconnects embedded in stratified media. A novel technique for efficient computation of the multilayer Green's function is proposed. Using the Taylor expansion of Bessel functions, the computation of Sommerfeld integrals during the method of moments procedure is reduced to simple algebraic operations. To model skin effect in conductors, the single-source differential surface admittance operator is extended to conductors in stratified media. To handle large realistic structures, the adaptive integral method is developed for a multilayer environment in a generalized manner that poses no restrictions on layout of conductors, and requires no special grid refinement, unlike previous works. The proposed method is made robust over a wide frequency range with the augmented electric field integral equation. Realistic structures of different shapes and electrical sizes are successfully analyzed over a wide frequency range, and results are validated against a commercial finite element tool.


title: Many-body quantum dynamics of an asymmetric bosonic Josephson junction

abstract: The out-of-equilibrium quantum dynamics of an interacting Bose gas trapped in a 1D asymmetric double-well potential is studied by solving the many-body Schr\"odinger equation numerically accurately. We examine how the loss of symmetry of the confining trap affects the macroscopic quantum tunneling dynamics of the system between the two wells. In an asymmetric DW, the two wells are not equivalent anymore -the left well is deeper than the right one. Accordingly, we analyze the dynamics by initially preparing the condensate in both the left and the right well. We examined the frequencies and amplitudes of the oscillations of the survival probabilities, the time scale for the development of fragmentation and its degree, and the growth and oscillatory behavior of the many-body position and momentum variances. There is an overall suppression of the oscillations of the survival probabilities in an asymmetric double well. However, depending on whether the condensate is initially prepared in the left or right well, the repulsive inter-atomic interactions affect the survival probabilities differently. The degree of fragmentation depends both on the asymmetry of the trap and the initial well in which the condensate is prepared in a non-trivial manner. Overall, the many-body position and momentum variances bear the prominent signatures of the density oscillations of the system in the asymmetric double well as well as a breathing-mode oscillation. Finally, a universality of fragmentation for systems made of different numbers of particles but the same interaction parameter is also found. The phenomenon is robust despite the asymmetry of the junction and admits a macroscopically-large fragmented condensate characterized by a diverging many-body position variance.


title: Meson cloud effects on kaon quark distribution functions and the SU(3) flavor symmetry

abstract: We present our analysis on the valence quark distribution functions of the $K^{+}$ meson, $v^{K (u)} (x, Q^2)$ and $v^{K (\bar{s})} (x, Q^2)$, taking into account the meson cloud effects in the framework of the chiral constituent quark model. Assuming appropriate bare quark distribution functions at the initial scale, evaluating the Goldstone boson dressing corrections with the model, and performing the QCD evolution, one can obtain the realistic dressed distributions at a certain scale. The phenomenologically satisfactory valence quark distribution of the pion was obtained in the previous study and there are available experimental data of the valence $u$ quark distribution ratio $v^{K(u)} (x, Q^2) / v^{\pi (u)} (x, Q^2)$, which enable us to obtain the kaon quark distribution functions. Besides presenting the resulting dressed distributions, we also show how the meson cloud effects affect the bare distributions in detail. A striking result is that the observed size of the SU(3) flavor symmetry breaking is considerably smaller than those seen in the preceding works based on other approaches.


title: Coloured and task-based stencil codes

abstract: Simple stencil codes are and remain an important building block in scientific computing. On shared memory nodes, they are traditionally parallelised through colouring or (recursive) tiling. New OpenMP versions alternatively allow users to specify data dependencies explicitly and to outsource the decision how to distribute the work to the runtime system. We evaluate traditional multithreading strategies on both Broadwell and KNL, study the arising assignment of tasks to threads and, from there, derive two efficient ways to parallelise stencil codes on regular Cartesian grids that fuse colouring and task-based approaches.


title: Tailoring the Local Density of Optical States and directionality of light emission by symmetry-breaking

abstract: We present a method to simultaneously engineer the energy-momentum dispersion and the local density of optical states. Using vertical symmetry-breaking in high-contrast gratings, we enable the mixing of modes with different parities, thus producing hybridized modes with controlled dispersion. By tuning geometric parameters, we control the coupling between Bloch modes, leading to flatband, M- and W-shaped dispersion as well as Dirac dispersion. Such a platform opens up a new way to control the direction of emitted photons, and to enhance the spontaneous emission into desired modes. We then experimentally demonstrate that this method can be used to redirect light emission from weak emitters -- defects in Silicon -- to optical modes with adjustable density of states and angle of emission.


title: On Characteristics of Hyperfields Obtained as Quotients of Finite Fields

abstract: Hyperstructures are a natural extension of regular algebraic structures in which one of the operations, known as the hyperoperation, is multivalued; a hyperfield is such an extension on a field. M. Krasner (1962) proved that the quotient $\mathbb{F}_p/G$, where $G$ is a subgroup of units in $\mathbb{F}_p$ is a hyperfield. The characteristic of a field may be explicitly determined from the order of the field, but there are no existing generalizations for determining the characteristic of a hyperfield of the form $\mathbb{F}_p/G$. We show that for odd primes $p$, there exists an explicit form for the characteristic of the hyperfield $\mathbb{F}_p/G$ and $|G|=1,2,3,4$. Finally, we prove a general form of the characteristic for hyperfields where $|G|$ is prime.


title: A computational study explaining processes underlying phase transition

abstract: In real-world systems, phase transitions often materialize abruptly, making it difficult to design appropriate controls that help uncover underlying processes. Some agent-based computational models display transformations similar to phase transitions. For such cases, it is possible to elicit detailed underlying processes that can be subsequently tested for applicability in real-world systems. In a genetic algorithm, we investigate how a modest difference in the concentration of correct and incorrect knowledge leads to radically different outcomes obtained through learning efforts by a group of agents. We show that a difference in concentration of correct and incorrect knowledge triggers virtuous and vicious cycles that impact the emergent outcome. When virtuous cycles are in operation, delaying the onset of equilibrium attains superior outcomes. For the vicious cycles, reaching equilibrium quickly attains superior outcomes. Our approach helps uncover simple mechanisms by which Nature works, jettisoning the yoke of unrealistic assumptions endemic in mathematics-based approaches. Our explanatory model helps direct research to investigate concentrations of inputs that obtains outcomes on the favourable side of phase transitions. For example, by tracking change in concentration of relevant parameters, scientists may look for reasons why cells cease to reproduce fit cells in organs. This can help design rejuvenation of organs. Further, in the world of physics, our model may inform in situations where the dominant Ising model falls short.


title: Dust acoustic solitary structures in presence of nonthermal ions, isothermally distributed electrons and positrons

abstract: Arbitrary amplitude dust acoustic solitary structures have been investigated in a four component multi-species plasma consisting of negatively charged dust grains, nonthermal ions, isothermally distributed electrons and positrons including the effect of dust temperature. We have used the Sagdeev pseudo-potential method to discuss the arbitrary amplitude steady state dust acoustic solitary structures in the present plasma system. We have designed a computational scheme to draw the existence domains of different dust acoustic solitary structures. We have observed only negative potential solitary waves for isothermal ions. But for strong nonthermality of ions the system supports positive potential solitary waves, positive potential double layers and coexistence of solitary waves of both polarities. The positive potential solitary waves are restricted by the positive potential double layers but negative potential double layer has not been found for any parameter regime. The system does not support dust acoustic supersoliton of any polarity. The concentration of positrons plays an important role in the formation of positive potential double layers. Finally, the phase portraits of the dynamical system have been presented to confirm the existence of different dust acoustic solitary structures.


title: Understanding and Improving Recurrent Networks for Human Activity Recognition by Continuous Attention

abstract: Deep neural networks, including recurrent networks, have been successfully applied to human activity recognition. Unfortunately, the final representation learned by recurrent networks might encode some noise (irrelevant signal components, unimportant sensor modalities, etc.). Besides, it is difficult to interpret the recurrent networks to gain insight into the models' behavior. To address these issues, we propose two attention models for human activity recognition: temporal attention and sensor attention. These two mechanisms adaptively focus on important signals and sensor modalities. To further improve the understandability and mean F1 score, we add continuity constraints, considering that continuous sensor signals are more robust than discrete ones. We evaluate the approaches on three datasets and obtain state-of-the-art results. Furthermore, qualitative analysis shows that the attention learned by the models agree well with human intuition.


title: Conversational Group Detection With Deep Convolutional Networks

abstract: Detection of interacting and conversational groups from images has applications in video surveillance and social robotics. In this paper we build on prior attempts to find conversational groups by detection of social gathering spaces called o-spaces used to assign people to groups. As our contributions to the task, we are the first paper to incorporate features extracted from the room layout image, and the first to incorporate a deep network to generate an image representation of the proposed o-spaces. Specifically, this novel network builds on the PointNet architecture which allows unordered inputs of variable sizes. We present accuracies which demonstrate the ability to rival and sometimes outperform the best models, but due to a data imbalance issue we do not yet outperform existing models in our test results.


title: Person-Job Fit: Adapting the Right Talent for the Right Job with Joint Representation Learning

abstract: Person-Job Fit is the process of matching the right talent for the right job by identifying talent competencies that are required for the job. While many qualitative efforts have been made in related fields, it still lacks of quantitative ways of measuring talent competencies as well as the job's talent requirements. To this end, in this paper, we propose a novel end-to-end data-driven model based on Convolutional Neural Network (CNN), namely Person-Job Fit Neural Network (PJFNN), for matching a talent qualification to the requirements of a job. To be specific, PJFNN is a bipartite neural network which can effectively learn the joint representation of Person-Job fitness from historical job applications. In particular, due to the design of a hierarchical representation structure, PJFNN can not only estimate whether a candidate fits a job, but also identify which specific requirement items in the job posting are satisfied by the candidate by measuring the distances between corresponding latent representations. Finally, the extensive experiments on a large-scale real-world dataset clearly validate the performance of PJFNN in terms of Person-Job Fit prediction. Also, we provide effective data visualization to show some job and talent benchmark insights obtained by PJFNN.


title: On Learning and Learned Data Representation by Capsule Networks

abstract: In this work, we investigate the following: 1) how the routing affects the CapsNet model fitting; 2) how the representation using capsules helps discover global structures in data distribution, and; 3) how the learned data representation adapts and generalizes to new tasks. Our investigation yielded the results some of which have been mentioned in the original paper of CapsNet, they are: 1) the routing operation determines the certainty with which a layer of capsules pass information to the layer above and the appropriate level of certainty is related to the model fitness; 2) in a designed experiment using data with a known 2D structure, capsule representations enable a more meaningful 2D manifold embedding than neurons do in a standard convolutional neural network (CNN), and; 3) compared with neurons of the standard CNN, capsules of successive layers are less coupled and more adaptive to new data distribution.


title: Gr\"obner bases and dimension formulas for ternary partially associative operads

abstract: Dotsenko and Vallette discovered an extension to nonsymmetric operads of Buchberger's algorithm for Gr\"obner bases of polynomial ideals. In the free nonsymmetric operad with one ternary operation $({\ast}{\ast}{\ast})$, we compute a Gr\"obner basis for the ideal generated by partial associativity $((abc)de) + (a(bcd)e) + (ab(cde)$. In the category of $\mathbb{Z}$-graded vector spaces with Koszul signs, the (homological) degree of $({\ast}{\ast}{\ast})$ may be even or odd. We use the Gr\"obner bases to calculate the dimension formulas for these operads.


title: Isotropy Groups and Kinematic Orbits for 1 and 2-$d$ $N$-Body Problems

abstract: Mitchell and Littlejohn showed that isotropy groups and orbits for $N$-body problems attain a sense of genericity for $N = 5$. The author recently showed that the arbitrary-$d$ generalization of this 3-$d$ result is that genericity in this sense occurs for $N = d + 2$. The author also showed that a second sense of genericity -- now order-theoretic rather than a matter of counting -- occurs for $N = 2 d + 1$, excepting $d = 3$, for which it is not 7 but 8. Applications of this work include 1) that some of the increase in complexity in passing from 3 to 4 and 5 body problems in 3-$d$ is already present in the more-well known setting of passing from intervals to triangles and then to quadrilaterals in 2-$d$. 2) That not $(d, N) = (3, 6)$ but $(4, 6)$ is a natural theoretical successor of $(3, 5)$. 3) Such consideration isotropy groups and orbits is moreover a model for a larger case of interest, namely that of GR's reduced configuration spaces. The current Article presents the lower-$d$ cases explicitly: 0, 1 and 2-$d$, including also the topological and geometrical form of the corresponding isotropy groups and orbits.


title: Entanglement protection of high-dimensional states by adaptive optics

abstract: We study the potential of adaptive optics (AO) to protect entanglement of high-dimensional photonic orbital-angular-momentum (OAM) states against turbulence-induced phase distortions. We demonstrate that AO is able to reduce crosstalk among the OAM modes and, consequently, the entanglement decay as well as photon losses. A test of the AO-stabilized output state against high-dimensional Bell inequalities shows that the transmitted entanglement allows for secure communication, even in the strong scintillation regime.


title: Dropout as a Structured Shrinkage Prior

abstract: Dropout regularization of deep neural networks has been a mysterious yet effective tool to prevent overfitting. Explanations for its success range from the prevention of "co-adapted" weights to it being a form of cheap Bayesian inference. We propose a novel framework for understanding multiplicative noise in neural networks, considering continuous distributions as well as Bernoulli noise (i.e. dropout). We show that multiplicative noise induces structured shrinkage priors on a network's weights. We derive the equivalence through reparametrization properties of scale mixtures and without invoking any approximations. Given the equivalence, we then show that dropout's Monte Carlo training objective approximates marginal MAP estimation. We leverage these insights to propose a novel shrinkage framework for resnets, terming the prior 'automatic depth determination' as it is the natural analog of automatic relevance determination for network depth. Lastly, we investigate two inference strategies that improve upon the aforementioned MAP approximation in regression benchmarks.


title: Hyperon-Nucleon Interaction from Lattice QCD at ${(m_\pi,m_K)\approx(146,525)}$ MeV

abstract: Comprehensive study of generalized baryon-baryon ($BB$) interaction including strangeness is one of the important subject of nuclear physics. In order to obtain a complete set of isospin-base baryon interactions, we perform a large scale lattice QCD calculation with almost physical quark masses corresponding to $(m_\pi,m_K)\approx(146,525)$ MeV and large volume $(La)^4=(96a)^4\approx$ (8.1 fm)$^4$. A large number of Nambu-Bethe-Salpeter (NBS) correlation functions from nucleon-nucleon ($NN$) to $\Xi\Xi$ are calculated simultaneously. In this contribution, we focus on the strangeness $S=-1$ channels of the hyperon interactions by means of HAL QCD method. Three potentials ((i) the $^1S_0$ central, (ii) the $^3S_1-^3D_1$ central, and (iii) $^3S_1-^3D_1$ tensor potentials) are presented for four isospin components; (1) the $\Sigma N - \Sigma N$ (the isospin $I=3/2$) diagonal, (2) the $\Lambda N - \Lambda N$ diagonal, (3) the $\Lambda N \rightarrow \Sigma N$ transition, and (4) the $\Sigma N - \Sigma N$ ($I=1/2$) diagonal. Scattering phase shifts for $\Sigma N$ $(I=3/2)$ system are presented.


title: Inter-BMV: Interpolation with Block Motion Vectors for Fast Semantic Segmentation on Video

abstract: Models optimized for accuracy on single images are often prohibitively slow to run on each frame in a video. Recent work exploits the use of optical flow to warp image features forward from select keyframes, as a means to conserve computation on video. This approach, however, achieves only limited speedup, even when optimized, due to the accuracy degradation introduced by repeated forward warping, and the inference cost of optical flow estimation. To address these problems, we propose a new scheme that propagates features using the block motion vectors (BMV) present in compressed video (e.g. H.264 codecs), instead of optical flow, and bi-directionally warps and fuses features from enclosing keyframes to capture scene context on each video frame. Our technique, interpolation-BMV, enables us to accurately estimate the features of intermediate frames, while keeping inference costs low. We evaluate our system on the CamVid and Cityscapes datasets, comparing to both a strong single-frame baseline and related work. We find that we are able to substantially accelerate segmentation on video, achieving near real-time frame rates (20+ frames per second) on large images (e.g. 960 x 720 pixels), while maintaining competitive accuracy. This represents an improvement of almost 6x over the single-frame baseline and 2.5x over the fastest prior work.


title: Color-octet scalar decays to a gluon and an electroweak gauge boson in the Manohar-Wise model

abstract: We present one loop results for the amplitudes giving rise to couplings between a color octet scalar, a gluon, and an electroweak gauge boson. These amplitudes could signal new physics in $\gamma$ jet, $Z$ jet and $W$ jet production at the LHC. We compute the relevant branching ratios and identify regions of parameter space where these decay modes become important. This can happen for scalar masses below the threshold for decay into heavy quark pairs ($t\bar t$ and $t\bar b$); or for small Yukawa couplings in which case the colored scalars are fermiophobic. In the case of light scalars, ${\cal B}(S\to \gamma g)$ can reach up to 10\% whereas ${\cal B}(S\to Z g)$ can reach a few percent. In the fermiophobic region of parameter space, ${\cal B}(S\to \gamma g)$ and ${\cal B}(S\to Z g)$ can reach up to 72\% and 28\% respectively, whereas ${\cal B}(S\to g g)$ can be 100\%. For the charged scalar, the decay mode ${\cal B}(S^\pm \to W^\pm g)$ can become dominant in both scenarios.


title: Existence of a system of discrete volume-localized quantum levels for charged fullerenes

abstract: In the framework of a simple physical model, we demonstrate the existence of a system of discrete short-lifetime quantum levels for electrons in the potential well of the self-consistent field of charged fullerenes and onion-like structures. For electrons, in the case of positively charged fullerenes and onion-like structures, combining analytic and numeric considerations we find that the energy of the volume-localized levels ranges from 1 eV to 100 eV.


title: Algebraic deformation quantization of Leibniz algebras

abstract: In this paper we focus on a certain self-distributive multiplication on coalgebras, which leads to so-called rack bialgebra. We construct canon-ical rack bialgebras (some kind of enveloping algebras) for any Leibniz algebra. Our motivation is deformation quantization of Leibniz algebras in the sense of [6]. Namely, the canonical rack bialgebras we have constructed for any Leibniz algebra lead to a simple explicit formula of the rack-star-product on the dual of a Leibniz algebra recently constructed by Dherin and Wagemann in [6]. We clarify this framework setting up a general deformation theory for rack bialgebras and show that the rack-star-product turns out to be a deformation of the trivial rack bialgebra product.


title: Thermodynamic Prescription of Cosmological Constant in Randall Sundrum-II Brane

abstract: In this work, we apply quantum corrected entropy function derived from the Generalized Uncertainty Principle (GUP) to the Holographic Equipartition Law to study the cosmological scenario in Randall-Sundrum (RS) II brane. An extra driving term has come up in the effective Friedmann equation for a homogeneous, isotropic and spatially flat universe. Further, thermodynamic prescription of the universe constraints this term eventually with order equivalent to that of the cosmological constant.


title: $p$-filtrations of dual Weyl modules

abstract: Let $G$ be a semisimple algebraic group over a field of characteristic $p > 0$. We prove that the dual Weyl modules for $G$ all have $p$-filtrations when $p$ is not too small. Moreover, we give applications of this theorem to $p^n$-filtrations for $n > 1$, to modules containing the Steinberg module as a tensor factor, and to the Donkin conjecture on modules having $p$-filtrations.


title: The 30-Year Cycle In The AI Debate

abstract: In the last couple of years, the rise of Artificial Intelligence and the successes of academic breakthroughs in the field have been inescapable. Vast sums of money have been thrown at AI start-ups. Many existing tech companies -- including the giants like Google, Amazon, Facebook, and Microsoft -- have opened new research labs. The rapid changes in these everyday work and entertainment tools have fueled a rising interest in the underlying technology itself; journalists write about AI tirelessly, and companies -- of tech nature or not -- brand themselves with AI, Machine Learning or Deep Learning whenever they get a chance. Confronting squarely this media coverage, several analysts are starting to voice concerns about over-interpretation of AI's blazing successes and the sometimes poor public reporting on the topic. This paper reviews briefly the track-record in AI and Machine Learning and finds this pattern of early dramatic successes, followed by philosophical critique and unexpected difficulties, if not downright stagnation, returning almost to the clock in 30-year cycles since 1958.


title: Exact solution for a two-phase Stefan problem with variable latent heat and a convective boundary condition at the fixed face

abstract: Recently it was obtained in [Tarzia, Thermal Sci. 21A (2017) 1-11] for the classical two-phase Lam\'e-Clapeyron-Stefan problem an equivalence between the temperature and convective boundary conditions at the fixed face under a certain restriction. Motivated by this article we study the two-phase Stefan problem for a semi-infinite material with a latent heat defined as a power function of the position and a convective boundary condition at the fixed face. An exact solution is constructed using Kummer functions in case that an inequality for the convective transfer coefficient is satisfied generalizing recent works for the corresponding one-phase free boundary problem. We also consider the limit to our problem when that coefficient goes to infinity obtaining a new free boundary problem, which has been recently studied in [Zhou-Shi-Zhou, J. Engng. Math. (2017) DOI 10.1007/s10665-017-9921-y].


title: Testing hyperbolicity of real polynomials

abstract: Hyperbolic polynomials are real multivariate polynomials with only real roots along a fixed pencil of lines. Testing whether a given polynomial is hyperbolic is a difficult task in general. We examine different ways of translating hyperbolicity into nonnegativity conditions, which can then be tested via sum-of-squares relaxations.


title: Data-driven competitive facilitative tree interactions and their implications on nature-based solutions

abstract: Spatio temporal data are more ubiquitous and richer than even before and the availability of such data poses great challenges in data analytics. Ecological facilitation, the positive effect of density of individuals on the individual's survival across a stress gradient, is a complex phenomenon. A large number of tree individuals coupled with soil moisture, temperature, and water stress data across a long temporal period were followed. Data driven analysis in the absence of hypothesis was performed. Information theoretic analysis of multiple statistical models was employed in order to quantify the best data-driven index of vegetation density and spatial scale of interactions. Sequentially, tree survival was quantified as a function of the size of the individual, vegetation density, and time at the optimal spatial interaction scale. Land surface temperature and soil moisture were also statistically explained by tree size, density, and time. Results indicated that in space both facilitation and competition coexist in the same ecosystem and the sign and magnitude of this depend on the spatial scale. Overall, within the optimal data driven spatial scale, tree survival was best explained by the interaction between density and year, sifting overall from facilitation to competition through time. However, small sized trees were always facilitated by increased densities, while large sized trees had either negative or no density effects. Tree size was more important predictor than density in survival and this has implications for nature based solutions: maintaining large tree individuals or planting species that can become large-sized can safeguard against tree less areas by promoting survival at long time periods through harsh environmental conditions. Large trees had also a significant effect in moderating land surface temperature.


title: Finite-size corrections for the attractive mean-field monomer-dimer model

abstract: The finite volume correction for a mean-field monomer-dimer system with an attractive interaction are computed for the pressure density, the monomer density and the susceptibility. The results are obtained by introducing a two-dimensional integral representation for the partition function decoupling both the hard-core interaction and the attractive one. The next-to-leading terms for each of the mentioned quantities is explicitly derived as well as the value of their sign that is related to their monotonic convergence in the thermodynamic limit.


title: A Distributed Reinforcement Learning Solution With Knowledge Transfer Capability for A Bike Rebalancing Problem

abstract: Rebalancing is a critical service bottleneck for many transportation services, such as Citi Bike. Citi Bike relies on manual orchestrations of rebalancing bikes between dispatchers and field agents. Motivated by such problem and the lack of smart autonomous solutions in this area, this project explored a new RL architecture called Distributed RL (DiRL) with Transfer Learning (TL) capability. The DiRL solution is adaptive to changing traffic dynamics when keeping bike stock under control at the minimum cost. DiRL achieved a 350% improvement in bike rebalancing autonomously and TL offered a 62.4% performance boost in managing an entire bike network. Lastly, a field trip to the dispatch office of Chariot, a ride-sharing service, provided insights to overcome challenges of deploying an RL solution in the real world.


title: Dynamic Optimization with Convergence Guarantees

abstract: We present a novel direct transcription method to solve optimization problems subject to nonlinear differential and inequality constraints. We prove convergence of our numerical method under reasonably mild assumptions: boundedness and Lipschitz-continuity of the problem-defining functions. We do not require uniqueness, differentiability or constraint qualifications to hold and we avoid the use of Lagrange multipliers. Our approach differs fundamentally from well-known methods based on collocation; we follow a penalty-barrier approach, where we compute integral quadratic penalties on the equality path constraints and point constraints, and integral log-barriers on the inequality path constraints. The resulting penalty-barrier functional can be minimized numerically using finite elements and penalty-barrier interior-point nonlinear programming solvers. Order of convergence results are derived, even if components of the solution are discontinuous. We also present numerical results to compare our method against collocation methods. The numerical results show that for the same degree and mesh, the computational cost is similar, but that the new method can achieve a smaller error and converges in cases where collocation methods fail.


title: Data calibration for the MASCARA and bRing instruments

abstract: Aims: MASCARA and bRing are photometric surveys designed to detect variability caused by exoplanets in stars with $m_V < 8.4$. Such variability signals are typically small and require an accurate calibration algorithm, tailored to the survey, in order to be detected. This paper presents the methods developed to calibrate the raw photometry of the MASCARA and bRing stations and characterizes the performance of the methods and instruments. Methods: For the primary calibration a modified version of the coarse decorrelation algorithm is used, which corrects for the extinction due to the earth's atmosphere, the camera transmission, and intrapixel variations. Residual trends are removed from the light curves of individual stars using empirical secondary calibration methods. In order to optimize these methods, as well as characterize the performance of the instruments, transit signals were injected in the data. Results: After optimal calibration an RMS scatter of 10 mmag at $m_V \sim 7.5$ is achieved in the light curves. By injecting transit signals with periods between one and five days in the MASCARA data obtained by the La Palma station over the course of one year, we demonstrate that MASCARA La Palma is able to recover 84.0, 60.5 and 20.7% of signals with depths of 2, 1 and 0.5% respectively, with a strong dependency on the observed declination, recovering 65.4% of all transit signals at $\delta > 0^\circ$ versus 35.8% at $\delta < 0^\circ$. Using the full three years of data obtained by MASCARA La Palma to date, similar recovery rates are extended to periods up to ten days. We derive a preliminary occurrence rate for hot Jupiters around A-stars of ${>} 0.4 \%$, knowing that many hot Jupiters are still overlooked. In the era of TESS, MASCARA and bRing will provide an interesting synergy for finding long-period (${>} 13.5$ days) transiting gas-giant planets around the brightest stars.


title: Off-shell initial state effects, gauge invariance and angular distributions in the Drell-Yan process

abstract: We discuss production of Drell-Yan lepton pairs at hadron colliders in the framework of the parton Reggeization approach, which includes off-shell initial state effects in a gauge-invariant way. Other possible prescriptions to restore gauge-invariance of hard-scattering coefficient with off-shell initial-state partons are also investigated and significant differences for the resulting structure functions are found, especially for the $F_{UU}^{(\cos2\phi)}$. We compare our numerical results for $q_T$-spectra of the lepton pair with experimental data, obtained by E-288 collaboration ($\sqrt{S}=19.4$ and 23.8 GeV) and find a good agreement. Also we perform predictions for the Drell-Yan structure functions at NICA $pp$-collider ($\sqrt{S}=24$ GeV).


title: Simultaneous extension of two bounded operators between Hilbert spaces

abstract: The paper is concerned with the following question: if $A$ and $B$ are two bounded operators between Hilbert spaces $\mathcal{H}$ and $\mathcal{K}$, and $\mathcal{M}$ and $\mathcal{N}$ are two closed subspaces in $\mathcal{H}$, when will there exist a bounded operator $C:\mathcal{H}\to\mathcal{K}$ which coincides with $A$ on $\mathcal{M}$ and with $B$ on $\mathcal{N}$ simultaneously? Besides answering this and some related questions, we also wish to emphasize the role played by the class of so-called semiclosed operators and the unbounded Moore-Penrose inverse in this work. Finally, we will relate our results to several well-known concepts, such as the operator equation $XA=B$ and the theorem of Douglas, Halmos' two projections theorem, and Drazin's star partial order.


title: To Use or Not to Use: CPUs' Cache Optimization Techniques on GPGPUs

abstract: General Purpose Graphic Processing Unit(GPGPU) is used widely for achieving high performance or high throughput in parallel programming. This capability of GPGPUs is very famous in the new era and mostly used for scientific computing which requires more processing power than normal personal computers. Therefore, most of the programmers, researchers and industry use this new concept for their work. However, achieving high-performance or high-throughput using GPGPUs are not an easy task compared with conventional programming concepts in the CPU side. In this research, the CPU's cache memory optimization techniques have been adopted to the GPGPU's cache memory to identify rare performance improvement techniques compared to GPGPU's best practices. The cache optimization techniques of blocking, loop fusion, array merging and array transpose were tested on GPGPUs for finding suitability of these techniques. Finally, we identified that some of the CPU cache optimization techniques go well with the cache memory system of the GPGPU and shows performance improvements while some others show the opposite effect on the GPGPUs compared with the CPUs.


title: A Family of Maximum Margin Criterion for Adaptive Learning

abstract: In recent years, pattern analysis plays an important role in data mining and recognition, and many variants have been proposed to handle complicated scenarios. In the literature, it has been quite familiar with high dimensionality of data samples, but either such characteristics or large data have become usual sense in real-world applications. In this work, an improved maximum margin criterion (MMC) method is introduced firstly. With the new definition of MMC, several variants of MMC, including random MMC, layered MMC, 2D^2 MMC, are designed to make adaptive learning applicable. Particularly, the MMC network is developed to learn deep features of images in light of simple deep networks. Experimental results on a diversity of data sets demonstrate the discriminant ability of proposed MMC methods are compenent to be adopted in complicated application scenarios.


title: Generalized No Free Lunch Theorem for Adversarial Robustness

abstract: This manuscript presents some new impossibility results on adversarial robustness in machine learning, a very important yet largely open problem. We show that if conditioned on a class label the data distribution satisfies the $W_2$ Talagrand transportation-cost inequality (for example, this condition is satisfied if the conditional distribution has density which is log-concave; is the uniform measure on a compact Riemannian manifold with positive Ricci curvature, any classifier can be adversarially fooled with high probability once the perturbations are slightly greater than the natural noise level in the problem. We call this result The Strong "No Free Lunch" Theorem as some recent results (Tsipras et al. 2018, Fawzi et al. 2018, etc.) on the subject can be immediately recovered as very particular cases. Our theoretical bounds are demonstrated on both simulated and real data (MNIST). We conclude the manuscript with some speculation on possible future research directions.


title: Deep learning with differential Gaussian process flows

abstract: We propose a novel deep learning paradigm of differential flows that learn a stochastic differential equation transformations of inputs prior to a standard classification or regression function. The key property of differential Gaussian processes is the warping of inputs through infinitely deep, but infinitesimal, differential fields, that generalise discrete layers into a dynamical system. We demonstrate state-of-the-art results that exceed the performance of deep Gaussian processes and neural networks


title: Second-Order Topological Phases in Non-Hermitian Systems

abstract: A $d$-dimensional second-order topological insulator (SOTI) can host topologically protected $(d - 2)$-dimensional gapless boundary modes. Here we show that a 2D non-Hermitian SOTI can host zero-energy modes at its corners. In contrast to the Hermitian case, these zero-energy modes can be localized only at one corner. A 3D non-Hermitian SOTI is shown to support second-order boundary modes, which are localized not along hinges but anomalously at a corner. The usual bulk-corner (hinge) correspondence in the second-order 2D (3D) non-Hermitian system breaks down. The winding number (Chern number) based on complex wavevectors is used to characterize the second-order topological phases in 2D (3D). A possible experimental situation with ultracold atoms is also discussed. Our work lays the cornerstone for exploring higher-order topological phenomena in non-Hermitian systems.